TWI486910B - Parking lot management system combined with two-factor identification and method therefore - Google Patents

Description

Parking lot management system and method combining two-factor identity identification

The invention relates to the application of a two-factor identity recognition technology, and particularly relates to a combination of two-factor identity recognition technology for controlling the access of a parking lot vehicle, displaying a personal message on a display device, automatically monitoring an abnormal situation of the parking lot and an abnormal notification of the instant. Status of the parking lot management system.

Thanks to the advancement of technology, in today's life, no matter whether it is a residential parking lot or an office building parking lot, there is no need for security personnel to control the vehicle. The vehicle enters and exits using radio frequency technology such as remote control or proximity card to control the opening of the access control device. Closed, even more equipped with camera using license plate recognition technology to control the legality of entering and leaving the vehicle, eliminating the loopholes caused by the loss of the remote control or proximity card to enter and exit the parking lot. This practice has been exposed in the patent "Central Control Room Unmanned Parking Management System" (Announcement No.: I271667). However, the above technique does not mention the verification method of the vehicle driver. Although the license plate recognition technology can avoid the loss and abuse of the remote control or proximity card, it cannot prevent the security situation such as theft of the vehicle and the forgery of the license plate, and how to make it easy for the manager to control the parking lot related equipment except that the vehicle needs to be controlled in and out of the parking lot. And the instant occurrence of abnormal conditions is also a very important issue in parking lot management.

In addition to the above-mentioned parking lot vehicle entry and exit and security control issues, how to integrate identity technology and information display technology in an all-round way, so that vehicle users can easily take identification after identity recognition through face recognition technology. The relevant personal information that the unit manager wishes to transmit or the information required by the application is also the research application direction in this field.

The invention provides a parking lot management system combining two-factor identity recognition, which combines license plate recognition technology and face recognition technology to identify a vehicle user, and generates an input/output (I/O) signal to display personal information and public. The information is displayed on the display panel and dynamically controls the input/output (I/O) devices such as access to and from the fence. In addition, one or more cameras are connected for video recording, and one or more camera images are automatically detected to detect the state of the camera. When an identity verification abnormality, a gateway access device abnormality, and a camera image abnormal state occur, an abnormal state message is automatically transmitted to the management. And retrieve the anomalous event time video clip for the administrator to view. By automatically controlling the access of vehicles in the parking lot, the immediate notification of warning status and the display of important personal messages, the vehicle safety and management convenience of the parking lot management are improved.

The invention provides a parking lot management system combining two-factor identity identification, which comprises a two-factor identity recognition unit, an image monitoring unit, a display kanban unit and a control management unit. The control management unit is coupled to the image monitoring unit, and the control management unit is configured to control the gateway access control device. The display kanban unit is coupled to the control management unit. The two-factor identity recognition unit is coupled to the image monitoring unit, the control management unit, and the display kanban unit. The two-factor identity recognition unit captures the vehicle information image of the vehicle from the image monitoring unit, detects the license plate characteristic area, and recognizes the license plate recognition feature, thereby obtaining the license plate recognition information, thereby using the license plate recognition information to retrieve the vehicle database and obtaining one or more personnel. Capital News. At the same time, the two-factor identity recognition unit captures the user information image from the image monitoring unit, and obtains the face recognition information of the vehicle user, and uses the face recognition information to detect the facial recognition feature of the vehicle user. Comparing and recognizing the facial recognition feature with the pre-existing facial recognition feature in the personnel database to obtain a vehicle user information and the vehicle user information and one or more digits obtained from the vehicle identification information The personnel information is compared and verified, and a verification result is recorded in the verification database. After the verification result is that the verification is successful, the two-factor identity recognition unit generates an acknowledged input/output (I/O) control signal to the control management unit to control the action of the gateway access control device, and generates an input/output display signal. Go to the display kanban unit to display the personal and public information of the vehicle user.

In an embodiment of the present invention, the two-factor identity recognition unit includes a vehicle identification unit, a face recognition unit, and a comparison unit. The vehicle identification unit obtains the vehicle information image, detects the license plate characteristic area, and recognizes the license plate recognition feature, and obtains the license plate identification information therefrom, thereby searching the vehicle database to obtain one or more personnel information as the first identity factor information. The face recognition unit can capture the user information image, obtain the face recognition feature of the user of the vehicle, retrieve the pre-stored face recognition feature taken by the personnel database for face recognition, and identify a person information as The second identity factor information. The comparison unit couples the vehicle identification unit and the face recognition unit. The comparison unit interprets the identity information of the vehicle user by using a comparison judgment mechanism and using the first identity factor information and the second identity factor information.

In an embodiment of the invention, the image monitoring unit includes an image capturing unit, an image recording unit, and an image detecting unit. The image capturing unit is coupled to and captures camera images of one or more cameras, and is used to distinguish the camera images into vehicle information images and user information images. The image recording unit is coupled to the image capturing unit for recording a picture of the camera image, and generating a video file in the storage device and storing the video recording in the video database. The manager can use the verification record composed by the verification result to play back the video clip of the camera image according to the two-factor identity recognition unit, and can also play back the video image of the camera image at any time point, and/or can monitor the camera instantly. The scene picture of the image. The image detecting unit is coupled to the image capturing unit for detecting a state of the camera image, and the detecting type includes a connection condition of the camera and/or detection of image blur/shadow. When the image detecting unit detects that an abnormal condition has occurred, the control management unit transmits an abnormal state message to the manager.

In an embodiment of the invention, the camera described above generally refers to a wired/wireless digital camera and/or analog camera.

In an embodiment of the present invention, the control unit transmits the abnormal status message to the manager by means of a short message, an email, and a management interface display and/or a set of the foregoing.

In an embodiment of the present invention, the display kanban unit divides the display area owned by the display unit into a plurality of information display areas according to the input and output display signals and a kanban setting, and according to the attributes of the information display area. Display personal information and public information...etc.

In an embodiment of the present invention, the attribute of the information display area is one of information display areas of text information, text marquee information, and bulletin board information, and the personal information and the common information correspond to the input and output display signals. produce.

In an embodiment of the invention, the control management unit includes a gateway access control unit, a warning unit, and a management interface unit. The gate access control unit is configured to control the gate access control device. When the verification result of the two-factor identity recognition unit is successful verification, the gateway access control unit controls the gate access control device to enable it to be turned on, and after the vehicle passes The control gate access control device is turned off. The alert unit is used to notify the administrator of the abnormal condition. The management interface unit is coupled to the alert unit, which provides a control interface for the administrator to manage the parking management system. The administrator can use a near-end or remote network communication function device to connect through a web browser. Go to the parking management system to use the management interface unit.

In an embodiment of the invention, the above-mentioned gateway access control device is a peripheral device control device when the vehicle enters and exits. The gate access control devices can be fences, iron shutter doors and infrared sensors.

In an embodiment of the present invention, the abnormal condition may be a two-factor identity recognition abnormality, a camera state abnormality, and a gateway access device abnormality.

In an embodiment of the present invention, the management interface unit includes vehicle information management, user information management, video recording management, verification record management, camera instant screen interface, setting management, and the like. Vehicle information management is used to enable managers to manage vehicle information, to add, modify and delete vehicle information, and to access vehicle database at the same time; user information management Used to enable the administrator to manage user information, to add, modify, and delete user information, and to manually establish the user's face recognition feature as the above-mentioned preset face recognition feature, and simultaneously access the personnel database; Record management is used to enable the administrator to manage the video recording, to query the video recording and view the video screen, and to access the video database; the verification record management is used to enable the administrator to manage the verification record, and the vehicle and the user verification record can be queried. And according to the verification recording time point, the video segment of the time point is viewed, and the verification database is accessed at the same time; the camera instant screen interface is used for real-time monitoring of the camera screen; and the setting management is used to set related function parameters.

In an embodiment of the present invention, the field of each vehicle data in the vehicle database may include: a license plate number of the vehicle, and a name or a representative number of one or more persons using the vehicle. The field of each vehicle data in the vehicle database can also be added to the relevant information fields according to the needs of the unit, such as the parking number and the house number.

In an embodiment of the present invention, the field of each personnel data in the personnel database may include: a name or a representative number of the person and a preset face recognition feature corresponding to the person. The field of each personnel data in the personnel database can also be added with relevant information fields according to the needs of the user, for example, the house number or the name of the unit.

In another aspect, a parking lot management method combining two-factor identity identification is provided, which comprises the steps of: capturing vehicle vehicle image of a vehicle, detecting a license plate characteristic area, and identifying a license plate recognition feature, thereby obtaining a license plate. Identify the information, retrieve the vehicle database based on the license plate identification information, and obtain one or more personnel information. Capture a user information image, and The facial recognition information of the vehicle user is obtained, and the facial recognition feature of the vehicle user is detected from the facial recognition information. The face recognition feature is compared and identified with at least one pre-stored face recognition feature in the personnel database to obtain vehicle user information. Comparing the vehicle user information and the one or more personnel information obtained from the license plate identification information and the corresponding facial recognition feature to perform comparison verification to determine whether the personnel information is recognized, and recording a verification result in a verification database . After the verification result is that the verification is successful, the information database is retrieved according to the identity information of the vehicle user to obtain the personal information and the public information of the vehicle user. A confirmed input and output control signal is generated to control the operation of a gateway access control device. And, an input and output display signal is generated to display the personal information and the public information of the vehicle user.

In an embodiment of the invention, generating the input and output display signals to display the personal and common information of the vehicle user includes the following steps. The display area of the display kanban is divided into a plurality of information display areas according to the input/output display signal and the kanban setting. The information database is retrieved according to the identity information of the vehicle user to obtain the personal information and the public information corresponding to the vehicle user. And, according to the attributes of the information display area, the personal information and the public information of the vehicle user are respectively displayed.

In an embodiment of the invention, generating the acknowledged input/output control signal to control the action of the gateway access device comprises the following steps. After the vehicle user successfully verifies, an input/output control signal is transmitted, the control fence or the iron shutter door is opened, and the infrared sensor output signal is detected to wait for the vehicle to pass through the entrance and exit to control the fence or the iron door to close.

In an embodiment of the present invention, the parking lot management method further includes the steps of: connecting and capturing camera images of one or more cameras, so that an administrator can instantly monitor the scene images of the camera images. These camera images are recorded for storage in a storage device and stored in a video library. The administrator can use the verification record composed of the verification results to play back the video clips of the camera images, play back the video images of the camera images at any time point, and/or monitor the scene images of the camera images in real time, and enhance the flexibility of the parking lot security control. .

In an embodiment of the present invention, the field of the video database includes: a camera number, a video start time, a video end time, and/or a video file location.

In an embodiment of the present invention, the parking lot management method further comprises the steps of: automatically detecting the status of the camera images after connecting and capturing the camera images, and the detection type includes a connection status and/or image type of the cameras. Blurring/shadow detection. And, when detecting that the camera has an abnormal condition, according to the alert setting, the abnormal state message is transmitted to the manager. The types of abnormal conditions mentioned above also include two-factor identity recognition anomalies and vehicle in and out of peripheral devices.

In an embodiment of the invention, the field of the verification database includes a vehicle verification result, a user verification result, a vehicle verification time, and/or a user verification time.

Based on the above, the parking lot management system combined with the two-factor identity recognition according to the embodiment of the present invention combines the license plate recognition and the face recognition technology to identify the vehicle user, and simultaneously performs the two-factor identity identification. An input and output signal is generated to dynamically display personal information and public information related to the vehicle user in an instant, for example, the display displays text information and bulletin board information, and the LED caption machine displays text marquee and the like is related to the vehicle user. Linked information, any display device capable of displaying text can realize information display purposes, and should not be limited to the above display device type.

The parking lot management system of the embodiment is implemented by using a network communication capability and a computing power. For example, the network communication capability generally refers to wired/wireless communication (for example, USB, Ethernet, WIFI, Bluetooth, etc.) Wireless information transmission technology allows administrators to have network communication functions at the near or far end, and can control the parking management system by using a web browser, such as vehicle information management, user information management, video recording management, and verification record management. , camera instant screen interface and setting management.

The above described features and advantages of the present invention will be more apparent from the following description.

DETAILED DESCRIPTION OF THE INVENTION Reference will now be made in detail to the exemplary embodiments embodiments In addition, wherever possible, the elements and/

The vehicle identification technology is combined with the face recognition technology to identify the vehicle user, and after the two-factor identity recognition is performed, the input and output control signals and the input and output display signals are simultaneously generated, thereby controlling the parking lot gate access control device. Improve the safety and automation of parking lots and instantly present individuals associated with this vehicle user Messages and public information. In addition, the embodiment of the present invention proposes a camera recording mechanism, an image blur/shadow detection, a gateway access control device detection, and a two-factor identity recognition verification result, and the generated warning message can be automatically transmitted to the management according to the alert setting. The administrator can view the video clips according to the time of the event, effectively reducing the burden on the administrator to monitor the abnormal situation of the parking lot, and increasing the possibility of immediately handling the abnormal situation.

Therefore, in order to achieve the above object, the embodiments of the present invention are set forth below to enable those skilled in the art to understand the present invention.

Please refer to FIG. 1. FIG. 1 is a schematic diagram showing the usage scenario of a parking lot management system 10 incorporating two-factor identity identification according to an embodiment of the invention. As shown in FIG. 1, the parking lot management system 10 combined with the two-factor identity identification includes a two-factor identity recognition unit 110, an image monitoring unit 120, a display kanban unit 130, and a control management unit 140. The two-factor identity identification unit 110 is coupled to the image monitoring unit 120, the display kanban unit 130, and the control management unit 140. The image monitoring unit 120 is coupled to the control management unit 140, and the display kanban unit 130 is coupled to the control management unit 140. In this embodiment, the main unit connection relationship is that a vehicle user 300 drives a vehicle 500 in front of the gateway access control device 220, and at the same time, the vehicle 500 enters the image range of the camera 200, and the image monitoring unit 120 connects and captures the image of the camera 200, The factor identification unit 110 captures the camera image of the image monitoring unit 120, and cooperates with the database group 230 to perform vehicle identification and face recognition, and performs association verification between the license plate and the identity, and stores the verification result in the database group 230.

In other words, the two-factor identity recognition unit 110 retrieves the vehicle information image of the vehicle 500 from the image monitoring unit 120, detects the license plate feature area, and recognizes the license plate recognition feature, thereby obtaining the license plate recognition information. Moreover, the two-factor identity identification unit 110 retrieves one or more personnel information by using the vehicle database in the license plate identification information retrieval database group 230. At the same time, the two-factor identity recognition unit 110 captures the user information image from the image monitoring unit 120, and obtains the face recognition information of the vehicle user 300, and uses the face recognition information to detect the vehicle user 300. The face recognition feature compares and recognizes the face recognition feature with the pre-stored face recognition feature in the personnel database to obtain vehicle user information, and obtains vehicle user information and information obtained from the vehicle identification information. One or more personnel information is compared and verified, and the verification results are recorded in the verification database.

After the verification result of the two-factor identity recognition unit 110 is that the verification is successful, the related information of the vehicle user 300 is used to retrieve and obtain the personal information and the common information from the database group 230, thereby generating an input/output display signal to the display kanban unit. 130. Output a text message, a text marquee, and a bulletin board information to the display device 210. At the same time, after the verification of the two-factor identity recognition unit 110 is successful, an input and output control signal is generated to the control management unit 140, and the control gate access control device 220 is turned on. After the vehicle 500 passes through the gateway access control area, the control management unit 140 controls the gate access control. Device 220 is turned off. If the verification result of the two-factor identity identification unit 110 is that the verification fails, the control management unit 140 transmits the verification information and the abnormality status to the administrator 400, and the verification information may include the license plate number, the personnel information, and the video recording. The URL of the clip, the URL of the vehicle image screenshot, and the URL of the user's image screenshot, etc., include email, SMS, and management interface display.

The above-mentioned parking lot management system 10 combined with two-factor identity recognition is realized by a machine having network communication capability and computing capability, and the camera 200 generally refers to a general wired/wireless digital camera and an analog camera, and the network communication capability is universal. Refers to wired/wireless communication (for example, wired/wireless information transmission technology such as USB, Ethernet, WIFI, Bluetooth, etc.), and the display device 210 is a display device having a display capability such as a display or an LED captioning machine, and the gateway access control device 220 is a vehicle. In and out of the peripheral device, for example, the gateway access control device 220 is a related gateway device for entering and leaving the vehicle, such as a fence, an iron roller door, and an infrared sensor. For detailed description of the embodiment, a fence and an infrared sensor are used in this embodiment. As the gateway access control device 220, the present invention should not be limited to the type of the gate access control device, and the device having the gate access control effect can be an embodiment of the present invention.

As shown in FIG. 1, the control management unit 140 automatically detects the status of the gateway access control device 220, and the image monitoring unit 120 automatically detects the status of one or more cameras 200. When the gateway access control device 220 or the camera 200 is in an abnormal state, for example, If the line is abnormal or the camera 200 is blurred or obscured, the control unit 140 transmits an alert message to the administrator 400. The transmission method includes an email, a short message, and a management interface display, so that the administrator 400 can immediately know the abnormal situation. And disposed of.

As shown in FIG. 1, the image monitoring unit 120 automatically performs full-time video recording, and stores the video recording in the database group 230 and stores the video file to the storage device. Set. The manager 400 can use the near-end or far-end network communication function device to view the time-lapse video screen by using a web browser.

Please refer to FIG. 2. FIG. 2 is a detailed block diagram of the parking lot management system 10 of FIG. 1 combined with two-factor identity identification. As shown in FIG. 2, the image capturing unit 121 connects and captures the image of the camera 200, transmits the image data to the image recording unit 122 for full-time recording, and stores the video recording to the video library 234 and generates a video file and stores it in the storage device. . The image capturing unit 121 transmits the image data to the image detecting unit 123 to detect the condition of the camera 200. The detected condition includes the connection status of the camera 200 and the image blur/shadow detection, etc., and the image capturing unit 121 The camera 200 is sent to the alert unit 142. The alert unit 142 notifies the administrator of the immediate handling according to the setting. The notification mode includes the display of the email, the newsletter and the management interface unit 143. The image capturing unit 121 transmits the image data to the vehicle identification unit 111. The license plate recognition unit 111 detects the license plate feature area in the image data, and recognizes the license plate recognition feature, thereby obtaining the license plate recognition information, and searching the vehicle database 231 by using the license plate recognition information. One or more pieces of personnel information (first identity factor) are transmitted to the comparison unit 113 to wait for comparison.

The image capturing unit 121 transmits the image data to the face recognition unit 112. The face recognition unit 112 detects the face recognition area in the image data, and extracts the face recognition feature of the vehicle user 300 from the face recognition area. The face recognition feature retrieves the pre-stored face recognition feature in the personnel database 232, identifies a matching person information (also referred to as a second identity factor), and transmits it to the comparison unit 113 to compare with the first identity factor. For verification, the comparison unit 113 compares and succeeds to generate a confirmed input and output. The outgoing signal (I/O) to the gateway access control unit 141 controls the access control device 220 to be turned on, and the gateway access control device 220 generally refers to vehicles entering and exiting peripheral devices, such as fences, iron shutters, and infrared sensors, etc. The infrared sensor signal is detected. After the vehicle passes through the gate access area, the gateway access control unit 141 controls the gateway access control device 220 to be turned off. After the comparison unit 113 successfully verifies the verification, an input/output signal (I/O) is generated to the display kanban unit 130, and the display kanban unit 130 obtains the personal information and the public information according to the personnel information entrained by the unit 113 to the information database 235. And displayed in the text information, the text marquee and the bulletin board information block to the display device 210 according to the setting, and the display device 210 is a display device having a display character capability such as a display or an LED captioning machine. When the comparison unit 113 fails the verification, the verification information is transmitted to the warning unit 142, and the verification information may include the license plate number, the user information, the video clip URL, the vehicle image screenshot URL, and the user image screenshot URL, etc., and the warning unit 142 The transmission abnormality is set to the administrator, and the transmission method includes an email, a message, and a management interface unit 143 display. After the comparison unit 113 completes the verification, the verification information is stored in the verification database 233.

As shown in FIG. 1 and FIG. 2, the administrator 400 can use the network communication function device such as the computer device 600 and the mobile device 700 to connect to the management interface unit 143 and the management interface unit 143 by using a web browser. Accessing the database group 230, the database group 230 includes a vehicle database 231, a personnel database 232, a verification database 233, a video database 234, and an information database 235. The management interface unit 143 provides various management functions, including vehicle information management. , user information management, video recording management, verification record Management, camera instant screen interface and setting management. Vehicle information management is used to manage vehicle information, and the manager 400 can add, modify, and delete vehicle information, and simultaneously access the vehicle database 231. The user information management is used to manage the vehicle user 300 information, and the manager 400 can add, modify, and delete the vehicle user 300 information, and manually establish the vehicle user 300 facial recognition feature as a pre-stored facial recognition feature, and simultaneously save the information. The personnel database 232 is taken. The video recording management is used to manage the video recording, and the manager 400 can query the video recording and view the video recording while accessing the video library 234. The verification record management is used to manage the verification record, and the manager 400 can query the vehicle 500 and the vehicle user 300 to verify the record, and view the video clip at the time point according to the verification recording time point, and access the verification database 233. The camera's instant screen interface is used to instantly monitor the camera 200 image. Setting management is used to set related function parameters.

As shown in FIG. 1 , the computer device 600 and the mobile device 700 are computer devices having network communication capabilities, web browsing capabilities, and computing capabilities. Network communication capabilities generally refer to wired/wireless communication (eg, USB, Ethernet, WIFI, Bluetooth). Such as wired/wireless information transmission technology, the computer device generally refers to a personal computer, a tablet computer, a notebook computer, a smart phone, etc., and is not limited to the computer device 600 and the mobile device 700.

Please refer to FIG. 3A. FIG. 3A is a schematic diagram of a functional block of two-factor identity identification, which illustrates the identification process of a two-factor identity in this embodiment. As shown in FIG. 3A, the image capturing unit 121 is connected to and captures one or more cameras 200, and the vehicle image capturing module 1111 captures vehicle images from the image capturing unit 121. The license plate detecting and positioning module 1112 is used. From vehicle image detection In the license plate area, the license plate feature normalization extraction module 1113 normalizes the license plate area and extracts the license plate features, the license plate recognition module 1114 analyzes and recognizes the license plate characteristics, obtains the license plate number information, and retrieves the vehicle database of the database group 230. 231 Obtain one or more personnel information 1115 corresponding to the license plate number information, and send it to the comparison unit 113 to wait for the comparison verification. The user image capturing module 1121 captures the image of the vehicle user 300 from the image capturing unit 121, and the face detecting and positioning module 1122 detects the face region from the image of the vehicle user 300, and the facial features are normalized. The extraction module 1123 normalizes the facial region and extracts the facial recognition feature. The facial recognition module 1124 obtains all the pre-existing facial recognition features from the database group 230 to perform facial recognition to obtain a corresponding person, and obtains personnel. The information 1125 is transmitted to the comparison unit 113 for comparison verification. After the verification is completed, the verification result is stored in the repository group 230, and a corresponding output signal 1131 is generated.

Please refer to FIG. 4A. FIG. 4A is a flowchart of the comparison verification mechanism corresponding to the comparison unit 113 of FIG. 3A, which illustrates a flowchart of the comparison verification mechanism of the parking lot management method for the two-factor identity identification of the present embodiment. As shown in FIG. 4A, the vehicle identification unit 111 retrieves the vehicle image from the image capturing unit 121, and identifies the license plate number to retrieve the database group 230, and determines whether there is a personnel information (vehicle) 1132 in the search result. If there is no personnel information. Then, the verification fails 1135, the verification result is stored to the database group 230, and a corresponding output signal 1131 is generated; if there is personnel information, the comparison verification is awaited. The face recognition unit 112 extracts the user image from the image capturing unit 121, and extracts the face recognition feature and the pre-stored face recognition feature in the database group 230 to identify whether the identification result has personnel information (person) 1133. If it does not exist The personnel information is the verification failure 1135, the verification result is stored to the database group 230, and a corresponding output signal 1131 is generated; if there is user information, the comparison verification is awaited. When both the vehicle identification unit 111 and the face recognition unit 112 have user information, it is determined whether the information matches the person 1134. If the match does not match, the verification fails, and if the match is successful, the verification is successful, and the verification result is stored in the database group 230, and is generated. A corresponding output signal 1131.

Please refer to FIG. 3B. FIG. 3B is a schematic diagram of a functional block of two-factor identity identification, which illustrates another two-factor identity identification process in this embodiment. As shown in FIG. 3B, first, the image capturing unit 121 is connected to and captures one or more cameras 200, and the vehicle image capturing module 1111 captures vehicle images from the image capturing unit 121. The license plate detecting and positioning module 1112 is used. The license plate area is detected from the vehicle image detection, the license plate normalization extraction module 1113 normalizes the license plate area and extracts the license plate feature, and the license plate recognition module 1114 analyzes and recognizes the license plate characteristics, obtains the license plate number information, and retrieves the database group. The vehicle database 231 of 230 obtains one or more persons information 1115 corresponding to the license plate number information and obtains a pre-stored face recognition feature, and transmits the face recognition module 1124 to wait for identification. The user image capturing module 1121 captures the image of the vehicle user 300 from the image capturing unit 121, and the face detecting and positioning module 1122 detects the face region from the image of the vehicle user 300, and the facial features are normalized. The extraction module 1123 normalizes the face region and extracts the face recognition feature. The face recognition module 1124 identifies the pre-stored face recognition feature and the face in the one or more personnel information 1115 obtained by the license plate recognition module 1114. The face recognition feature extracted by the feature normalization extraction module 1123 obtains a corresponding personnel information 1125 to the comparison comparison unit 113. For verification. After the verification is completed, the verification result is stored in the repository group 230, and a corresponding output signal 1131 is generated.

Please refer to FIG. 4B. FIG. 4B is a flowchart of the comparison verification mechanism corresponding to the comparison unit 113 of FIG. 3B, which illustrates a flowchart of the comparison verification mechanism of another two-factor identity recognition parking lot management method in this embodiment. As shown in FIG. 4B, the vehicle identification unit 111 retrieves the vehicle image from the image capturing unit 121, and recognizes the license plate number to retrieve the database group 230, and obtains one or more personnel information and pre-stored facial recognition features, and transmits the facial features to the face. The recognition unit 112 waits for the recognition; the face recognition unit 112 captures the image of the vehicle user 300 from the image capturing unit 121, and extracts the facial recognition feature and the pre-stored facial recognition feature transmitted by the vehicle identification unit 111 for identification. As a result, there is a person information (person) 1133. If there is no person information, it is a verification failure 1135. If it exists, the verification is successful, the verification result is stored to the database group 230, and a corresponding output signal 1131 is generated.

The technique used by the vehicle identification unit 111 and the face recognition unit 112 will be described in detail in order to better understand the present invention by those skilled in the art, as shown in FIGS. 3A and 3B. First, the related art of the vehicle identification unit 111 according to the embodiment of the present invention is described. The license plate detection and positioning module 1112 detects moving objects by using optical flow and detects similar license plates by edge detection. In the area, the license plate area is filtered by the shape, size and proportion of the license plate. In addition to the above method, an adaptive boosting algorithm (AdaBoost) or an artificial neural network (Artificial Neural Network; The training method detects the location of the license plate area, and thus the embodiment of the present invention is not limited to a single license plate detection and positioning. Method; the license plate feature normalization extraction module 1113 uses edge detection and Hough transform to correct the license plate area image angle, and uses the optimal threshold algorithm (Otsu method) to the license plate area binary value. , the Connected component is used to divide the license plate area text object and extract the text object feature; the license plate recognition module 1114 uses the Support Vector Machine (SVM) and the multiple image voting mechanism to identify the license plate number, in addition to the above method. In addition, the license plate can also be identified using a training method such as an artificial neural network (ANN), and thus the embodiment of the present invention is not limited to a single license plate recognition method. Next, the related art of the face recognition unit 112 of the embodiment of the present invention is described. The face detection and positioning module 1122 uses an adaptive boosting algorithm (AdaBoost) to calculate a plurality of temporally adjacent image images in an instant image. Pixel information difference value. Since the vehicle user 300 may be slightly shaken with time, the plurality of suspected facial regions of the vehicle user 300 may be detected by using the pixel information difference value, and the proportion of the skin color of the suspected facial regions may be calculated. It is determined that these suspected facial regions are indeed the facial regions of the vehicle user 300, to obtain a facial image of the facial region, and an active shape model (ASM) is used to calibrate the facial image. Face contour points, using face contour points for face rotation positioning, correcting face offset tilt problems. The face detection and positioning method of the present invention can detect and locate the face region by using a plurality of face detection and positioning algorithms, for example, an ellipse detection method, an Active Appearance Model (AAM), and a facial features projection area. The algorithm is divided into equal algorithms, and the embodiment of the present invention is not limited to a single algorithm to detect Positioning the above facial region image; the facial feature normalization extraction module 1123 uses two nonlinear algorithms such as a Model of retinal processing and a Laplacian of Gaussian (LoG) filtering. The Gaussian smoothing filter algorithm is used to correct the light, which can eliminate the uneven distribution of light brightness, shadow shading and excessive darkness in the face image, automatically correct the facial features of the facial image more clearly, and then use the gradient transform (Gradient transform) and The Gabor filter extracts the facial features; the facial recognition unit 1124 uses the Fisher Linear Discriminant (FLD) to transform and classify the facial feature space, and calculates the face using the Euclidean Distance (Euclidean Distance). The feature similarity, while using Scale Invariant Feature Transform (SIFT) to compare the similarity of the face region image, and finally identify the corresponding user. The face recognition method of the present invention can identify corresponding users by various face recognition algorithms, for example, Principle Component Analysis (PCA), Linear Discriminate Analysis (LDA), and neural network (Artificial). The neural network; ANN) and the like, the embodiment of the present invention is not limited to a single algorithm to perform the above-described face recognition operation.

In this embodiment, the face detection and positioning module 1122 can further increase the execution of a biological living body detection program, and confirm that the detected facial image is a real living organism, and avoid artificially using a photo or the like to perform facial expression. Identification. The biological living body detection procedure is outlined here. The biometric detection program detects whether there is a change in the facial features in the face area to determine the use. Whether the person actually exists in front of the camera, not a non-living body such as a photo that cannot be changed by the five senses.

Please refer to FIG. 5. FIG. 5 is a schematic diagram of a detailed block of the image detecting unit 123. To better understand the present invention, those skilled in the art can further describe the image detecting method. First, the signal detecting module 1231 detects the image. The image signal transmitted from the unit 121 is sent to the status transfer module 1237 and transmitted to the alert unit 142 to notify the manager 400 if the signal is abnormal. If the image signal is normal, the original image is transmitted to the background module 1232 to create/update the background image. In the embodiment of the present invention, the background image can be created and updated by using a Gaussian Mixture Model (GMM), and multiple images are retained by the cache concept. A time-correlated image produces a background model (background image). At the same time, the original image and the background image are transmitted to the blur detection module 1233 for blur detection, and the original image and the background image are compared by using a histogram and a wavelet transform (Wavelet transform) to extract a low-low region to determine the image blur. In the same situation, the original image and the background image are transmitted to the low visibility detection module 1234. The low visibility detection module 1234 is designed to detect the condition of the smoke and the like, and the original image is extracted by the Wavelet transform. The area is compared with the edge of the background image to determine the low visibility state of the image; the edge corresponding verification module 1235 is used to detect whether the camera 200 has been moved, and the original image and the background image are subjected to wavelet transform to extract high and low frequencies ( The high-low region and the high-high region map the edges and count the corresponding edge points to determine whether the camera 200 scene has a transition. Then, the image abnormality statistics module 1236 analyzes all the state determination nodes. If the image duration is continued for a plurality of image times, the image state is output to the state transfer module 1237. When the image is interpreted as an abnormal state, the state transfer module 1237 transmits an abnormal state message to the alert unit 142 to notify the manager.

In summary, the parking lot management system combined with the two-factor identity identification described in the embodiment of the present invention combines the license plate recognition technology and the face recognition technology to identify the user, and dynamically displays the identity after the identity recognition is performed. User-related personal information, such as management-side notification messages, text marquees, and bulletin board information, and other information associated with the user. And combined with the access control device and image monitoring equipment, it automatically detects the use of the device, and proposes image blur/shadow detection to prevent artificially spraying, masking or moving the camera lens, regardless of abnormality or image of the device. When it is blurred/obscured or the two-factor identity is abnormal, the notification mechanism is used to display the notification manager by email, SMS and management interface, and the video image is matched with the two-factor authentication time to retrieve the video image playback and viewing function, which greatly reduces the management. Monitor the burden of parking conditions and effectively improve the safety of parking lot users.

Although the present invention has been disclosed in the above embodiments, it is not intended to limit the invention, and any one of ordinary skill in the art can make some modifications and refinements without departing from the spirit and scope of the invention. The scope of the invention is defined by the scope of the appended claims.

10‧‧‧Parking management system combined with two-factor identification

110‧‧‧Two-factor identity identification unit

111‧‧‧Vehicle Identification Unit

112‧‧‧Face recognition unit

113‧‧‧ comparison unit

120‧‧‧Image Monitoring Unit

121‧‧‧Image capture unit

122‧‧‧Video Recording Unit

123‧‧‧Image detection unit

130‧‧‧Display kanban unit

140‧‧‧Control Management Unit

141‧‧‧Gateway access control unit

142‧‧‧Warning unit

143‧‧‧Management interface unit

200‧‧‧ camera

210‧‧‧ display device

220‧‧‧Guide access control equipment

230‧‧‧Database group

231‧‧‧Vehicle database

232‧‧‧Personnel Database

233‧‧‧Verification database

234‧‧‧Video database

235‧‧Information database

300‧‧‧Vehicle users

400‧‧‧Manager

500‧‧‧ vehicles

600‧‧‧Computer equipment

700‧‧‧Mobile devices

1111‧‧‧ Vehicle image capture module

1112‧‧‧ License Plate Detection and Positioning Module

1113‧‧‧ License plate feature normalization extraction module

1114‧‧‧ License Plate Identification Module

1115‧‧‧One or more personnel information

1121‧‧‧User image capture module

1122‧‧‧Face Detection and Positioning Module

1123‧‧‧Face feature normalization extraction module

1124‧‧‧Face recognition module

1125‧‧‧Personnel Information

1131‧‧‧ Output signal

1132‧‧‧ There is personnel information (car) judgment

1133‧‧‧ There is personnel information (person) judgment

1134‧‧‧ Vehicles and personnel are judged

1135‧‧‧Verification failed

1136‧‧‧Verified successful

1231‧‧‧Signal Detection Module

1232‧‧‧Background module

1233‧‧‧Fuzzy detection module

1234‧‧‧Low visibility detection module

1235‧‧‧Edge Correspondence Verification Module

1236‧‧‧Image Anomaly Statistics Module

1237‧‧‧State Transfer Module

1 is a schematic diagram showing the usage scenario of a parking lot management system incorporating two-factor identity recognition, in accordance with an embodiment of the present invention.

2 is a detailed block diagram of the parking lot management system of FIG. 1 in combination with two-factor identity identification.

FIG. 3A is a schematic diagram of a functional block of two-factor identity identification, which illustrates the identification process of a two-factor identity in the present embodiment.

FIG. 3B is a schematic diagram of a functional block of two-factor identity identification, which illustrates the identification process of another two-factor identity in this embodiment.

4A is a flow chart corresponding to the comparison verification mechanism of the comparison unit of FIG. 3A, which illustrates a flow chart of the comparison verification mechanism of the parking lot management method of the two-factor identity identification of the present embodiment.

FIG. 4B is a flow chart corresponding to the comparison verification mechanism of the comparison unit of FIG. 3B, which illustrates a flow chart of the comparison verification mechanism of another two-factor identity recognition parking lot management method in the embodiment.

FIG. 5 is a schematic diagram of a detailed block of the image detecting unit.

10‧‧‧Parking management system combined with two-factor identification

110‧‧‧Two-factor identity identification unit

120‧‧‧Image Monitoring Unit

130‧‧‧Display kanban unit

140‧‧‧Control Management Unit

200‧‧‧ camera

210‧‧‧ display device

220‧‧‧Guide access control equipment

230‧‧‧Database group

300‧‧‧Vehicle users

400‧‧‧Manager

500‧‧‧ vehicles

600‧‧‧Computer equipment

700‧‧‧Mobile devices

Claims (23)

A parking lot management system combining two-factor identity identification includes: an image monitoring unit; a control management unit coupled to the image monitoring unit, the control management unit controls a gateway access control device; and a display kanban unit coupled to the control a management unit; and a two-factor identity identification unit coupled to the image monitoring unit, the control management unit, and the display kanban unit, the two-factor identity recognition unit extracts a vehicle information image of the vehicle from the image monitoring unit, and detects Detecting a license plate characteristic area, and identifying a license plate recognition feature, thereby obtaining a license plate identification information, searching a vehicle database with the license plate identification information, and obtaining one or more personnel information, the two-factor identity recognition unit from the image monitoring unit Taking a user information image and obtaining a facial recognition information of a vehicle user, and detecting, by the facial recognition information, a facial recognition feature of the vehicle user, the facial recognition feature and a person At least one pre-stored face recognition feature in the database is compared and identified to obtain a car User information, and comparing the vehicle user information with one or more personnel information obtained from the license plate identification information, and recording a verification result in a verification database, when the verification result is successful verification, The two-factor identity recognition unit generates an acknowledged input/output control signal to the control management unit to control the action of the gateway access control device, and generates an input and output display signal. The image display unit includes: an image capturing unit that couples and captures camera images of one or more cameras for the camera The image is divided into the vehicle information image and the user information image; the image recording unit is coupled to the image capturing unit for recording the images of the camera images, and generating a video file in a storage device and recording a video recording Stored in a video database, a manager uses the verification record formed by the verification result to play back the video segments of the camera images, and plays back the video images of the camera images at any time point. And/or monitoring the scene image of the camera images in real time; and the image detecting unit is coupled to the image capturing unit for detecting the state of the camera images, and the detection type includes a connection status of the cameras And/or image blur/shadow detection, wherein when the image detecting unit detects that a difference has occurred When the condition, the control unit managing the abnormal state transmits a message to the manager. The parking lot management system of claim 1, wherein the two-factor identity recognition unit comprises: a vehicle identification unit that acquires the vehicle information image, detects the license plate feature area, and recognizes the license plate recognition feature, and obtains the The license plate identification information is used to retrieve the vehicle database to obtain one or more personnel information as a first identity factor information; The face recognition unit captures the user information image, obtains the face recognition feature of the vehicle user, and retrieves the at least one pre-stored face recognition feature taken by the personnel database for face recognition, and recognizes a vehicle user information as the second identity factor information; and a comparison unit coupled to the vehicle identification unit and the face recognition unit, the comparison unit transmits a comparison determination mechanism, and by the first identity factor Information and the second identity factor information to interpret the identity information of the vehicle user. The parking lot management system of claim 1, wherein the cameras are wired/wireless digital cameras and/or analog cameras. The parking lot management system of claim 1, wherein the control management unit transmits the abnormal status message to the manager by means of a short message, an email, and a management interface display and/or a set of the foregoing. The parking lot management system of claim 1, wherein the display kanban unit divides the display area owned by the kanban unit into a plurality of information display areas according to the input and output display signals and a kanban setting, and displays the information according to the information. The attributes of the area to display personal and public information, respectively. The parking lot management system of claim 5, wherein the attributes of the information display area are one of a text message, a text marquee information, and an information display area of a bulletin board information, and the personal message and the public Information is generated corresponding to the input and output display signals. The parking lot management system of claim 1, wherein the control management unit comprises: a gate access control unit for controlling the gateway access control device, wherein the verification result of the two-factor identity identification unit is successful Thereafter, the gate access control device is controlled to be turned on, and the gate access control device is controlled to be closed after the vehicle passes; the warning unit notifies an abnormal condition to an administrator; and the management interface unit is coupled to the warning unit, Providing a control interface for the manager to manage the parking lot management system, the manager uses a near-end or remote networked communication function device to connect to the parking lot management system using a web browser to use the Management interface unit. The parking lot management system according to claim 7, wherein the gateway access control device is a peripheral device control device when the vehicle enters and exits. The parking lot management system of claim 8, wherein the gate access control device is a fence, an iron roll door, and an infrared sensor. For example, in the parking lot management system described in claim 7, wherein the abnormal condition is a two-factor identity recognition abnormality, a camera state abnormality, and a gateway access control device abnormality. The parking lot management system of claim 7, wherein the management interface unit comprises vehicle information management, user information management, video recording management, verification record management, camera instant screen interface and setting management; In order for the manager to manage vehicle information, add, modify and delete vehicle information, and simultaneously access the vehicle The user information management is used to enable the manager to manage user information, add, modify, and delete user information, and manually create a user face recognition feature for the preset face recognition feature, and simultaneously save Taking the personnel database; the video recording management is used to enable the manager to manage the video recording, query the video recording and view the video screen, and access the video database; the verification record management is used to enable the manager to manage the verification Recording, querying the vehicle and the user verification record, and viewing the video clip at the time point according to the verification recording time point, and accessing the verification database; the camera instant screen interface is used for real-time monitoring of the camera screen; and the setting management is used for Set related function parameters. The parking lot management system of claim 1, wherein the field of each vehicle data in the vehicle database comprises: a license plate number of the vehicle, a name or a representative number of one or more persons using the vehicle. For example, in the parking lot management system described in claim 12, the field of each vehicle data in the vehicle database further includes: a parking space number and a house number. The parking lot management system of claim 1, wherein the field of each personnel data in the personnel database comprises: a name or a representative number of the person and a preset face recognition feature corresponding to the person. For example, in the parking lot management system described in claim 14, the field of each personnel data in the personnel database further includes: the residential house number of the person and the unit name of the person. A parking lot management method combining two-factor identity identification includes the following steps: capturing a vehicle information image of a vehicle, detecting a license plate characteristic area, and identifying a license plate recognition feature, thereby obtaining a license plate identification information; Identifying information retrieval a vehicle database to obtain one or more personnel information; capturing a user information image, obtaining a facial recognition information of a vehicle user, and obtaining the vehicle user from the facial recognition information detection a face recognition feature; comparing and recognizing the face recognition feature with at least one pre-stored face recognition feature in a personnel database to obtain a vehicle user information; The one or more personnel information obtained by the license plate identification information and the corresponding facial recognition feature are compared and verified to determine whether the personnel information is recognized, and a verification result is recorded in a verification database; when the verification result is successful verification Retrieving an information database according to the information of the user of the vehicle to obtain the user of the vehicle a person message and public information; generating an acknowledged input/output control signal to control the action of a gateway access control device; generating an input/output display signal to display the personal information and the public information of the vehicle user, connecting and capturing one or more a camera image of a camera that allows a manager to instantly monitor the scene images of the camera images; Recording the camera images to generate a video file for storage in a storage device and storing a video recording in a video database, wherein a manager uses a verification record composed of the verification results to play back video of the camera images. Fragment, playback of video images of the camera images at any point in time, and/or real-time monitoring of scene images of the camera images. For example, in the parking lot management method described in claim 16, the generating the input/output display signal to display the personal information and the common information of the vehicle user includes the following steps: displaying the kanban according to the input and output display signals and a kanban setting The display area is divided into a plurality of information display areas; the information database is searched according to the information of the vehicle user to obtain the personal information and the public information corresponding to the vehicle user; and the attributes are displayed according to the attributes of the information display areas. Personal and public information of the vehicle user. The parking lot management method of claim 16, wherein generating the confirmed input/output control signal to control the operation of the gateway access control device comprises the steps of: transmitting the input/output control signal, controlling a fence or an iron coil The door is opened and an output signal of an infrared sensor is detected to control the fence or the iron door to close after the vehicle passes through the entrance and exit. The parking lot management method according to claim 16, wherein the field of the video database includes: a camera number, a video start time, a video end time, and/or a video file location. The parking lot management method described in claim 16 further includes the following steps: after connecting and capturing the camera images, automatically detecting the status of the camera images, and the detection type includes a connection status of the cameras. And/or image blur/shadow detection; and when an abnormal condition of the cameras is detected, an abnormal state message is transmitted to the manager according to an alert setting. The parking lot management method according to claim 19, wherein the abnormal condition type further includes a two-factor identity recognition abnormality and an abnormality of the vehicle entering and exiting the peripheral device. For example, in the parking lot management method described in claim 19, the transmission of the abnormal status message to the manager is performed by a short message, an email, and a management interface display and/or a collection of the above. The parking lot management method according to claim 19, wherein the field of the verification database includes a vehicle verification result, a user verification result, a vehicle verification time, and/or a user verification time.