KR20220159841A - Smart field management method and system for access control of registered/unregistered vehicles and automatic recognition of occupants at construction sites - Google Patents

Abstract

According to the present invention, a smart site management method includes the steps of: storing information about a user terminal of a vehicle driver pre-registered for vehicle access; receiving gate arrival information transmitted by the user terminal based on an ID signal generated by a short-range communication device installed at a gate; and storing information about departure and departure details of the vehicle based on the arrival information. According to the present invention, vehicle departure management at the construction site using short-range communication and a CCTV camera is possible.

Description

Smart field management method and system for access management of registered/unregistered vehicles and automatic recognition of occupants at construction sites

The present invention relates to a smart site management method and system for access management of registered/unregistered vehicles and automatic recognition of occupants at a construction site, and more particularly, to a vehicle entering and exiting a construction site for checking access based on short-range communication. In addition, it relates to a smart site management method that collects vehicle access information based on a CCTV camera and a smart site management system using the same, and it relates to a technology that can supplement AI machine vision.

License Plate Recognition (LPR) is an important technology for analyzing vehicle information in an unmanned parking system, and is a key technology in next-generation telematics fields such as unmanned vehicles. In particular, vehicle license plates in Korea are given different numbers for each type of vehicle, and by revising the license plate system three times, there are various types ranging from old license plates, new license plates, and license plates without regional markings. Research on the technology continues.

License plate recognition is based on an LPR algorithm that pre-constructs a library of letters and numbers that can be displayed on license plates, and then compares the library with the characters included in the images of license plates collected in the field. . Recently, a method of recognizing a license plate of a vehicle displayed in a collected image of a learned artificial intelligence model after learning a library into a model using an artificial intelligence algorithm has been developed from simple comparison.

However, even when using the LPR algorithm and artificial intelligence model, license plate recognition may have limitations. These limitations may be caused by weather, illumination, sunlight, and license plate contamination, particularly at a construction site. And depending on the learning level of character recognition, the LPR function of the artificial intelligence model may appear differently.

A recent incident in which a car with forged license plates through paper printing skillfully cheated the LPR algorithm and passed through the front gate of a government office clearly shows the limitations of the currently used LPR algorithm.

CCTV is an acronym for closed-circuit television. The opposite of closed-circuit is open-circuit television, which means home TV that is shown to an unspecified number of people. Therefore, closed-circuit TV is TV provided to a specific person for a specific purpose. Because of its specific purpose, CCTV is called closed circuit TV because it is not wired or wirelessly connected to the outside world.

A CCTV system may include, as a component, a camera and a digital video recorder (DVR) for recording images captured by the camera. A DVR is a device that records video, and is the most important component among the elements that make up a CCTV. Depending on the performance of this equipment, the quality of the video that can be recorded or the number of cameras that can record simultaneously may vary.

CCTV is mainly installed for safety, such as traffic, crime prevention, various monitoring, and fire prevention. Recently, CCTVs are installed in schools to prevent violence in schools. As the number of violent crimes increases, an alternative to preventing them is the expansion of CCTV installations. In addition, the installation of CCTV is expanding to prevent theft in private workplaces such as saunas or models.

Meanwhile, vehicle access management or parking management may be defined as policies and programs that result in efficient use of parking resources. In the case of parking lots included in public houses such as apartments, government offices, large shopping centers, and buildings with multiple offices and individual business sites, such as parking towers, underground parking lots, or outdoor parking lots, a smart on-site management system is required for efficient vehicle access management. It is installed and managed by itself or through a service company specializing in vehicle access control.

In vehicle access management, a camera may be used to identify a license plate of a vehicle entering or exiting. In addition, CCTV cameras are installed in the parking lot, so the situation in the parking lot can be monitored. However, according to the prior art, a camera for vehicle access management and a camera for CCTV are separately installed in the parking lot, and the system for managing them and the CCTV system are independent of each other, so the cost of operating them is doubled.

However, even at a building construction site, for example, many vehicles, such as ready-mixed concrete vehicles, material transport vehicles, and commuting vehicles of construction workers, come in and out, but a new parking management system has not been built yet. It is difficult to build.

The smart site management method and system according to an embodiment of the present invention is based on exit management for vehicles entering and exiting a construction site, can supplement LPR by machines, especially artificial intelligence models, and prevents counterfeiting of vehicle license plates. The present invention relates to a method and system capable of managing vehicle entry and exit using an existing CCTV system, using occupant's personal information and user terminal information in addition to vehicle information in order to prevent vehicle information.

As a technology related to access security management, Korean Patent No. 10-1981328, a system and method for managing access security of a vehicle entering and exiting a port discloses real-time detection of driver identity information and occupant information, but Since it is based on RFID tag recognition, it still has the problems of the prior art that it is not suitable for recognizing a vehicle without a tag and does not show a big difference from license plate recognition, so that illegal authentication using a forged tag cannot be prevented. have.

Korean Patent Publication No. 10-2019-0097461 (published on August 21, 2019)

One problem of the present invention for solving the problems of the prior art described above is a smart site management method for easily managing vehicle access and automatic recognition of occupants at a construction site using a short-range communication device when there is no parking management facility, and to propose a system

One problem to be solved by the present invention is to solve the recognition error of the LPR algorithm by a machine in the prior art.

An object to be solved by the present invention is an integrated access management method and system using the same that manages the access of registered/unregistered vehicles at a construction site and functions as a CCTV monitoring function, compared to a conventional CCTV system in which the monitoring target is mainly a person. is to provide

One problem to be solved by the present invention is to provide a method for managing vehicle access at a construction site and a system using the same, which can solve the problem of forged vehicle license plates using vehicle occupant's personal information and user terminal information. is to do

The problem to be solved by the present invention is not limited to the above-mentioned problems, and other problems and advantages of the present invention that are not mentioned above will be more clearly understood by the embodiments of the present invention. It will also be appreciated that the objects and advantages of the present invention may be realized by means of the instrumentalities and combinations indicated in the claims.

In order to achieve the above object, a smart on-site management method according to an embodiment of the present invention includes storing ID information about a user terminal of the vehicle driver registered in advance for vehicle access; receiving gate arrival information transmitted by the user terminal based on an ID signal generated by a short-range communication device installed at the gate; and confirming the departure of the user using the ID information and the arrival information.

In addition, the smart site management method may be configured to further include the step of performing authentication for the vehicle driver using pre-registered driver information.

In addition, the smart site management method may be configured to further include the step of storing the vehicle's entry and exit information including the entry and exit times of the vehicle.

In addition, the smart site management method, recognizing the entry of the vehicle using a camera installed in the construction site; Based on the recognition, it may be configured to further include recognizing the vehicle license plate using an entry image captured at the entrance gate.

In addition, in the smart on-site management method, the step of recognizing the vehicle license plate is the primary recognition by a machine based on a character recognition algorithm, and when the vehicle number recognition fails in the primary recognition, 2 by the manager's user terminal through the network It can be configured to include car recognition.

In addition, the smart on-site management method may be configured to further include the step of collecting information about a user terminal of a manager who will participate in license plate recognition for secondary recognition by the manager's user terminal.

In addition, the secondary recognition may include transmitting data necessary for license plate recognition to at least one of a plurality of user terminals; and receiving a recognition result according to license plate recognition.

In addition, the smart on-site management method may be configured to further include determining failure of the primary recognition according to a threshold value related to a recognition probability.

In addition, the threshold value is characterized in that it is preset differently according to at least one of the type and condition of the vehicle, weather condition, time zone, and illumination at the time of license plate recognition.

In addition, the secondary recognition by the user terminal may be configured to be based on a comprehensive recognition result by a plurality of user terminals.

In addition, the primary recognition recognizes the horizontal/vertical ratio of the license plate, the number of rows, the background color, and the arrangement structure of letters and numbers of the license plate using the type of the recognized vehicle, and uses this to recognize the letters and numbers of the license plate. It may be configured to include the step of recognizing.

In addition, the smart site management method, using a camera installed in the construction site, the step of photographing the unloading process of the vehicle; Taking pictures of the process of getting out of the vehicle; The method may further include extracting vehicle appearance information including time information about fade-in and fade-out of the vehicle for each photographed image.

In addition, the smart on-site management method may be configured to further include reproducing a section of the image in which the vehicle appears to be seamlessly connected based on the vehicle appearance information.

Smart on-site management system according to an embodiment of the present invention, a storage device for storing information about the user terminal of the vehicle driver pre-registered for vehicle entry; a communication device for receiving arrival information transmitted by the user terminal at the gate based on an ID signal generated by a short-range communication device installed at the gate; Departure management unit for storing information about the departure and departure details of the vehicle; and a control unit controlling the output management unit based on the driver's user terminal information and arrival information.

In addition, the smart site management system, a vehicle recognition unit for recognizing the entry of the vehicle using a camera for photographing the construction site; and an LPR module recognizing the vehicle license plate, wherein the controller may control the LPR module to recognize the vehicle license plate using an entry image captured at the entrance gate based on the recognition.

In addition, the smart on-site management system further includes a mobile communication management module for managing communication with the manager's user terminal for secondary recognition through a network when the primary recognition fails by the LPR module, and the control unit includes a vehicle license plate It may be configured to determine recognition failure, switch from primary recognition to secondary recognition, and control the mobile communication management module.

Details of other embodiments are included in the "specific details for carrying out the invention" and the accompanying "drawings".

Advantages and/or features of the present invention, and methods of achieving them, will become apparent with reference to the various embodiments described below in detail in conjunction with the accompanying drawings.

However, the present invention is not limited only to the configuration of each embodiment disclosed below, but may also be implemented in various other forms, and each embodiment disclosed herein only makes the disclosure of the present invention complete, and the present invention It is provided to completely inform those skilled in the art of the scope of the present invention, and it should be noted that the present invention is only defined by the scope of each claim of the claims.

According to the present invention, smart site management is possible through the confirmation of entering and exiting vehicles rather than restricting access without installing a parking management system at a construction site.

In addition, security of vehicle access management may be enhanced through authentication of the vehicle driver's user terminal and the vehicle driver.

In addition, a problem can be solved through communication with a manager terminal in a situation where it is impossible to identify a vehicle license plate at a construction site where vehicles with contaminated license plates frequently enter and exit.

In addition, a CCTV camera at a construction site may be used for vehicle access management.

In addition, illegal access can be detected through authentication of the vehicle driver and user terminal.

In addition, safety accidents can be prevented by monitoring the movement of incoming and outgoing vehicles using CCTV.

1 is an exemplary view of a gate in which a smart on-site management method according to an embodiment of the present invention can be used.
2 is a network relationship diagram of a smart site management system according to an embodiment of the present invention.
3 is a block diagram of a vehicle access control device according to an embodiment of the present invention.
4 is a flowchart of a smart on-site management method based on short-distance communication according to an embodiment of the present invention.
5 is a flowchart of a camera-based smart site management method according to an embodiment of the present invention.
6 is a flowchart of a camera-based smart on-site management method upon vehicle entry according to an embodiment of the present invention.
7 is an exemplary diagram of a camera-based smart on-site management method upon exiting a vehicle according to an embodiment of the present invention.
8 is an exemplary view of CCTV-based vehicle access management according to an embodiment of the present invention.

Before explaining the present invention in detail, the terms or words used in this specification should not be construed unconditionally in a conventional or dictionary sense, and in order for the inventor of the present invention to explain his/her invention in the best way It should be noted that concepts of various terms may be appropriately defined and used, and furthermore, these terms or words should be interpreted as meanings and concepts corresponding to the technical idea of the present invention.

That is, the terms used in this specification are only used to describe preferred embodiments of the present invention, and are not intended to specifically limit the contents of the present invention, and these terms represent various possibilities of the present invention. It should be noted that it is a defined term.

In addition, it should be noted that in this specification, singular expressions may include plural expressions unless the context clearly indicates otherwise, and similarly, even if they are expressed in plural numbers, they may include singular meanings. .

Throughout this specification, when a component is described as "including" another component, it does not exclude any other component, but further includes any other component, unless otherwise stated. It can mean you can do it.

Furthermore, when a component is described as “existing inside or connected to and installed” of another component, this component may be directly connected to or installed in contact with the other component, and a certain It may be installed at a distance, and when it is installed at a certain distance, a third component or means for fixing or connecting the corresponding component to another component may exist, and now It should be noted that the description of the components or means of 3 may be omitted.

On the other hand, when it is described that a certain element is "directly connected" to another element, or is "directly connected", it should be understood that no third element or means exists.

Similarly, other expressions describing the relationship between components, such as "between" and "directly between", or "adjacent to" and "directly adjacent to" have the same meaning. should be interpreted as

In addition, in this specification, the terms "one side", "the other side", "one side", "the other side", "first", "second", etc., if used, refer to one component It is used to be clearly distinguished from other components, and it should be noted that the meaning of the corresponding component is not limitedly used by such a term.

In addition, in this specification, terms related to positions such as "top", "bottom", "left", and "right", if used, should be understood as indicating a relative position in the drawing with respect to the corresponding component, Unless an absolute position is specified for these positions, these positional terms should not be understood as referring to an absolute position.

In addition, in this specification, in specifying the reference numerals for each component of each drawing, for the same component, even if the component is displayed in different drawings, it has the same reference numeral, that is, the same reference throughout the specification. Symbols indicate identical components.

In the drawings accompanying this specification, the size, position, coupling relationship, etc. of each component constituting the present invention is partially exaggerated, reduced, or omitted in order to sufficiently clearly convey the spirit of the present invention or for convenience of explanation. may be described, and therefore the proportions or scale may not be exact.

In addition, in the following description of the present invention, a detailed description of a configuration that is determined to unnecessarily obscure the subject matter of the present invention, for example, a known technology including the prior art, may be omitted.

Hereinafter, embodiments of the present invention will be described in detail with reference to related drawings.

In the process of describing the smart field management method, device, and system according to an embodiment of the present invention, "data" for one object is used as a physical element including binary code handled by a computer, and "information" is data It can be used as a content element to include. Therefore, data and information can refer to the same object.

1 is an exemplary view of a smart site management system according to an embodiment of the present invention.

Referring to Figure 1, a smart on-site management system 100 according to an embodiment of the present invention may be configured to include a short-range communication device. The short-range communication device broadcasts a signal including location information, for example, a signal including a universally unique identifier (UUID), and broadcasts location information of a location where the device is installed, for example, a gate at a construction site. can do. A construction vehicle passing through a gate, that is, a user terminal driving a construction vehicle receives a signal including location information and transmits a response signal to the access control device. In this way, the fact and time information of the construction vehicle passing through the gate can be confirmed through the universal unique identifier.

A circuit breaker or the like that restricts the passage of a gate at a construction site gate is not essential, and may be additionally installed to restrict the passage of a vehicle under the control of a vehicle access management device. That is, the vehicle access control device may additionally check the access of various vehicles entering and exiting the construction site by using a camera installed at the gate, for example, a CCTV camera.

A smart on-site management method according to an embodiment of the present invention, a device using the same, and a system including the same are designed to pass through a gate to a vehicle and a driver whose license plate number or ID information is confirmed while temporarily limiting the entry and exit of a vehicle, or It can be designed to check license plate number and ID information about the vehicle and driver passing through the gate while allowing entry once.

2 is a network relationship diagram of a smart site management system according to an embodiment of the present invention.

Referring to Figure 2, the network relationship of the smart site management system 100 according to an embodiment of the present invention is depicted. The smart site management system 100 includes a vehicle access control device 110, a short-range communication device 130, a user terminal 141 and 142, a server 150, a gate breaker 160, and a display device 170 as components. Including, these components may be configured to be communicatively connected to each other through the network 180.

The vehicle access management device 110 checks the user terminal of the vehicle driver using the signal transmitted by the short-range communication device 130 installed at the gate through which the vehicle enters and exits, performs authentication of the vehicle driver, and additionally performs construction site It is possible to perform a function of collecting information about the vehicle using a CCTV camera installed in and using this to store and manage the vehicle's exit information.

The short-range communication device 130 may provide location information to the vehicle access management device 110 through communication with the user terminal 141 of the vehicle driver arriving at the gate of the construction site. The user terminal 141 may receive confirmation from the vehicle access management device 110 of the fact of visiting the construction site using the provided location information.

Among the short-range communication devices 130, there is a device called a beacon based on a Bluetooth 4.0 protocol that can be used as an embodiment of the present invention. Beacon is a technology that enables message transmission and mobile payment by locating a user's location within a radius of 50 to 70 m.

When the short-range communication device 130, for example, the user terminal 141 comes within the signal range of the beacon, the beacon broadcasts a specific ID (UUID) value as a Bluetooth signal. The application of the user terminal 141 recognizes the ID value and transmits it to the vehicle access management device 110 . The vehicle access management device 110 having the ID may confirm the location and perform at least one of authentication for the individual vehicle driver and authentication for the user terminal.

The user terminal 140 may include a vehicle driver's user terminal 141 and a vehicle access system manager's user terminal 142 .

The vehicle driver's user terminal 141 may transmit gate arrival information to the vehicle access management device 110 through communication with a short-range communication device installed at a gate of a construction site.

The user terminal 141 using the signal of the beacon needs an app for receiving the signal of the beacon and transmitting the information to the vehicle access control device 110 in order to receive information or content. This app is an embodiment of the present invention. It may be configured to include a vehicle access method according to.

The manager's user terminal 142 corresponds to a client capable of accessing the vehicle access control device 110 corresponding to the server. The manager's user terminal 142 can access the vehicle access control device 110 through the network 270 and check the image captured by the camera 112 in real time.

In addition, when the vehicle license plate recognition by the LPR module 122 fails, the administrator's user terminal 142 may play a role of supplementing this. When the vehicle license plate primary recognition result by the LPR module 122 is less than a threshold probability, for example, if the probability value is less than 50%, the LPR module 122 makes a request to the control unit 111 so that the communication device 116 can use the user Through communication with the terminal 142, it is possible to receive a license plate secondary recognition result.

Various embodiments of the user terminals 141 and 142 include a cellular phone, a smart phone with a wireless communication function, a personal digital assistant (PDA) with a wireless communication function, a wireless modem, a portable computer with a wireless communication function, and a wireless communication function. It integrates a photographing device such as a digital camera, a gaming device with wireless communication function, a music storage and playback home appliance with wireless communication function, and an Internet appliance capable of wireless Internet access and browsing, as well as combinations of such functions. It may include, but is not limited to, portable units or terminals.

The server 150 may provide various services to the vehicle access control device 110 . For example, the server 150 may correspond to a device that manages a plurality of vehicle access management devices 110 at a local level in a cloud level. When a specialized vehicle access management service company manages vehicle access systems of multiple construction sites, the server 150 manages the vehicle access management devices 110 of multiple construction sites, and the sensing data collected through the camera 112. can be used for integrated control. The server 150 may be implemented using a computing device, that is, a computer. In addition, the server 150 may provide an artificial intelligence API, a vehicle registration database, and an LPR function to the vehicle access management device 110 .

The vehicle access management device 110 may control opening and closing of the gate breaker 160 by using an opening and closing command according to a license plate recognition result based on pre-registered vehicle ID information.

The display device 170 corresponds to a device that displays information about vehicles entering and exiting a gate of a construction site, for example, license plates and the number of vehicles through the control of the vehicle access management device 110 .

The network 180 includes wired and wireless networks, for example, serial communication such as RS422, a local area network (LAN), a wide area network (WAN), the Internet of TCP/IP, an intranet, and an extranet ( extranet), and mobile networks such as cellular, 3G, LTE, WiFi networks, ad hoc networks, and combinations thereof.

Network 180 may include connections of network elements such as hubs, bridges, routers, switches, and gateways. Network 180 may include one or more connected networks, such as a multi-network environment, including a public network such as the Internet and a private network such as a secure corporate private network. Access to network 180 may be provided via one or more wired or wireless access networks.

When the smart site management system 100 is implemented using an IP camera including a communication device and an embedded system, the camera 112 acts as the Internet of Things and is connected to the network 180 through Ethernet and uses the Internet protocol. Thus, it is possible to communicate with the vehicle access control device 110, the server 150, and the manager's user terminal 142.

3 is a block diagram of a vehicle access control device according to an embodiment of the present invention.

The vehicle access management device 110 is a subject that executes the smart on-site management method, and may be implemented to include hardware or hardware and software configurations. That is, the vehicle access management device 110 may be configured to include a program that the computer device can read and execute, including instructions for executing the smart on-site management method in a general-purpose computer hardware device. That is, the program including the instructions for executing the smart site management method may be executed through interaction of the memory and the control unit, for example, a processor, in a state loaded into a volatile memory or stored in a non-volatile memory as software.

Referring to FIG. 3 , the vehicle access management device 110 includes a controller 111, a camera 112, an input device 113, an output device 114, a storage device 115, a communication device 116, and a memory. (117). The memory 117 is configured to store the vehicle recognition unit 121, the LPR module 122, the departure management unit 123, the terminal management module 124, the search/playback module 125, and the alarm module 126. It can be.

The vehicle recognition unit 121, the LPR module 122, the departure management unit 123, and the user terminal management module 124, the search unit 125, the playback unit 126, and the alarm unit 127 (hereinafter, the command execution module) (command execution modules) may be implemented in a software form, for example, in a module form included in a vehicle access management program, loaded into the memory 170 from the storage device 150, and loaded into the memory 170. In the state, the control unit 111 may execute the command constituting the smart site management method (S100).

That is, the instruction execution modules may be implemented in hardware form, for example, in the form of an integrated circuit using a semiconductor device, and may be configured to include an electronic circuit configured to execute the smart site management method (S100).

The control unit 110 performs a function of driving the command execution modules 121 to 126 . The controller 110 may be implemented in the form of a central processing unit corresponding to a processor, and performs a function of executing a command set constituting a smart on-site management method. The control unit 110 basically controls the operations of the CCTV camera 110, the input device 130, the output device 140, the storage device 150, and the communication device 160 through data transmission and data reception from them. can be controlled with

The camera 112 corresponds to a sensing device characteristically constituting the smart site management system according to an embodiment of the present invention. On the other hand, according to the prior art, a CCTV camera and a vehicle access management camera are distinguished from each other. In other words, the video captured by the CCTV camera was stored in a storage device called a DVR (Digital Video Recorder) or NVR (Network Video Recorder), and the video collected using the LPR camera in the smart site management system was used only for recognizing the license plate number. has been used However, the camera 112 according to an embodiment of the present invention is installed for use as a CCTV system, but may also be used for vehicle access management. That is, the camera 112 can perform the vehicle recognition function performed by the roof buried in the ground in the prior art, and in addition, vehicle number recognition can also perform the CCTV original vehicle monitoring function with water.

The camera 112 according to an embodiment of the present invention may be selected from an analog camera, a digital camera, eg, an IP camera and an LPR camera, that is, a camera having an LPR function. When an analog camera is selected as a camera, the LPR process may be performed by a local LPR device, for example, the vehicle access management device 110 . When a digital camera, eg, an IP camera, is selected as the camera, the LPR process may be performed by a local LPR device, eg, the vehicle access control device 110 or the server 150 in the cloud. When an LPR camera is selected as a camera, the LPR process may be performed by the LPR camera.

An LPR camera is a camera capable of performing an LPR function, and may include hardware and software in the form of a module for reading vehicle license plates using collected images. Therefore, the LPR camera may output the vehicle number and counting information as video data and read data as outputs, and transmit them to the vehicle access management 110 device. The LPR camera can recognize and track a moving object in an image and recognize a vehicle license plate using an edge-end built-in artificial intelligence model, for example, convolutional neural networks.

The camera 112 may be implemented in various forms depending on the presence or absence of an image processing function other than image collection. In addition, when the camera 112 is a camera assigned an IP within the network 180, for example, an IP camera, the camera 112 transmits collected images, processed images, and judgment result data to the vehicle without going through a separate controller. It can be directly transmitted to the access control device 110 and the server 150.

The input device 113 performs a function of receiving various user inputs necessary for the execution of the smart on-site management method (S100), for example, text and numeric inputs.

The output device 114 performs a function of displaying various data and information, for example, vehicle number, appearance information, situation information, etc. to the user through a user interface or outputting them through sound in the execution of the smart site management method. do.

The storage device 115 performs a function of storing various data and information, for example, vehicle number, appearance information, situation information, etc., in the execution of the smart site management method.

The communication device 116 performs a function of transmitting and receiving data through various external devices and various protocols, including the camera 112, in the execution of the smart on-site management method. Therefore, the communication device 116 internally includes a communication module corresponding to various protocols, for example, a parallel communication module, a serial communication module, a short-distance communication module, a cellular communication module, a wireless LAN communication module, and an Internet communication module. can be configured.

The communication device 116 includes various communication modules enabling connection to the network 180 of FIG. 2, for example, a parallel communication module, a serial communication module, a short-distance communication module, a cellular communication module, a wireless LAN communication module, and an Internet communication module. It may be configured to include the like.

The memory 117 may be implemented using a non-volatile or volatile semiconductor device in which stored data is maintained or lost according to power ON/OFF. The memory 117 loads command execution modules implemented in software form and performs a function of storing them.

The vehicle recognition unit 121, as one of the command execution modules constituting the smart site management method (S100), recognizes a vehicle trying to enter the gate using CCTV images collected from a distance through a CCTV camera installed at the construction site. perform the function of Specifically, the vehicle recognition unit 121 may be configured to recognize the vehicle itself based on an object identification algorithm and at the same time recognize the type of vehicle, for example, special purpose vehicles such as taxis and trucks and electric vehicles. have.

The LPR module 122, as one of the command execution modules constituting the smart site management method (S100), uses CCTV images collected through CCTV cameras installed at the gate of the construction site according to the type of vehicle entering the vehicle. Performs the function of recognizing the license plate of a vehicle with Hereinafter, a license plate recognition process by the LPR module 122 will be described.

Vehicle license plate recognition may be configured to include license plate region recognition, license plate region character recognition, license plate region list extraction, and number and character recognition processes.

In recognizing the license plate area, the image gray scale threshold is measured through processing on the collected original image, and the expected character area is output through the search for the expected character area in the image. Next, through matching character list search, the matching character list in the image is listed, and finally, license plate area tracking area is determined through license plate area extraction.

In the license plate area character recognition, the image gray scale threshold is measured through processing using the license plate available area list, the character possible area list in the license plate area is output through the search for the possible character area in the license plate area, and the matching character list search The character matching list in the license plate is output, the matching character list in the license plate is verified through internal redundant character removal, the longest matching character string in the license plate is derived through the estimation of the actual character list in the license plate available area, and finally, the algorithm interlocks and the license plate Through character string recognition, license plate available area characters are recognized.

In the license plate area list extraction, the best matching character in the actual license plate is determined, and license plate recognition is completed.

In the vehicle license plate recognition process according to an embodiment of the present invention, vehicle license plates may be classified by type. For example, the type of license plate is classified using the horizontal and vertical ratio of the license plate firstly, the type of the license plate is classified based on the background color of the license plate secondly, and the number of rows is thirdly Types of license plates can be classified. This type classification is based on recognizing the type of vehicle and also based on recognizing letters and numbers on vehicle license plates.

The departure management unit 123 checks the departure of the user by using the ID information of the vehicle driver's user terminal and the arrival information of the vehicle's entrance gate, and performs a function of generating and storing information on the departure history of the vehicle.

The user terminal management module 124 includes the vehicle driver's user terminal 141 transmitting the location information generated by the short-range wireless communication device 130 and the manager's user terminal 142 as an alternative in case of a primary LPR failure. It is responsible for managing communication with

The search / playback module 125 is one of the command execution modules constituting the smart site management method (S100), and various information extracted through analysis of various CCTV images collected through CCTV cameras installed at the construction site, eg For example, it performs a function of searching for a vehicle using vehicle number, appearance information, unloading information, etc., and reproducing an image in which a target vehicle to be searched appears.

The alarm module 126 is one of the command execution modules constituting the smart site management method (S100), and the vehicle's exit information confirmed through the short-range communication device 130, collected through the CCTV camera installed at the construction site It performs a function of notifying the manager of information about the vehicle identified in the CCTV image, for example, vehicle number, appearance information, and unloading information.

4 is a flowchart of a smart on-site management method according to an embodiment of the present invention.

The smart on-site management method (S100) according to an embodiment of the present invention may be performed through the vehicle access management device 110 or system 100.

Referring to FIG. 4, the smart on-site management method (S100) stores ID information related to a user terminal of a registered vehicle driver (S100), performs authentication on the vehicle driver (S120), and access gate arrival information transmitted by the user terminal. It may be configured to include reception (S130), management of the user's departure and departure using ID information and arrival information (S140), and storage of vehicle departure and departure information including entry and exit times of the vehicle (S150).

In step S110, the vehicle access control device 110 may store ID information about the user terminal of the registered vehicle driver. ID information can be used to confirm the arrival and departure of the vehicle along with information on the arrival of the vehicle.

In step S120 , the vehicle access management device 110 may perform authentication for the vehicle driver using pre-registered driver information. In the vehicle access method S100 according to an embodiment of the present invention, authentication of a vehicle entering and exiting a construction site may be performed based on the identity of a vehicle driver entering and exiting a construction site. Accordingly, information of a driver who drives a vehicle must be registered in advance, and based on the registered driver information, authentication of an individual driver may be performed through the user terminal 141 of the driver. Authentication may be performed through communication between an application for driver authentication installed in the user terminal 141 and the vehicle access control device 110 .

In step S130, the vehicle access control device 110 may receive the access gate arrival information transmitted by the user terminal based on the ID signal generated by the short-range communication device installed at the access gate. The user terminal 141 recognizes the ID signal broadcast by the short-range communication device 130 installed at the gate of the construction site, transmits the arrival information to the vehicle access control device 110, and the vehicle access control device 110 can receive this arrival information.

In step S140, the vehicle access management device 110 may check the user's exit by using the ID information and the arrival information. This step is a step of determining whether arrival information received for security is received from the user terminal 141 having pre-registered ID information.

In step S150 , the vehicle access control device 110 may store vehicle entry/exit information including entry/exit times of the vehicle. The process of entering the vehicle may be performed as it is when leaving the vehicle. The vehicle entry/exit management device 110 may generate and store vehicle exit/exit information including the time the vehicle passes through the gate when entering/exiting.

The smart site management system 100 according to an embodiment of the present invention may perform a smart site management method (S200) based on a CCTV camera separately from the smart site management method (S100). The reliability of the results of the former can be increased by the latter.

5 is a flowchart of a smart on-site management method according to an embodiment of the present invention.

Referring to FIG. 5, the smart site management method (S200) includes vehicle entry recognition using a camera installed at a construction site (S210), vehicle license plate recognition using an incoming image based on vehicle recognition (S220), and vehicle unloading process. It may be configured to include photographing (S230) and photographing the process of taking out the vehicle (S240).

The vehicle access management device 110 may collect information about the user terminal 142 of the manager to perform the second LPR through communication.

The vehicle access management device 110 may recognize the entry of a vehicle using a camera installed at a construction site (S220). Recognition of vehicle entry is a previous step for recognizing the vehicle license plate. After the entry of the vehicle is recognized, the vehicle access management device 110 uses a camera 112 installed at the gate separately from the camera used for vehicle entry to enter the vehicle. Get ready to recognize your license plate. In a parking management system installed in a parking lot, entry of a vehicle is recognized through a roof coil installed under the ground, but in the present invention, the vehicle recognition module 121 and the camera 112 can replace this.

In step S240, the vehicle access management device 100 may record the vehicle unloading process using a CCTV camera installed at the construction site. Vehicle appearance information is extracted from CCTV images captured during the unloading process, and the vehicle appearance information may be used to search for a video section in which the vehicle appeared during a vehicle search.

In step S250 , the vehicle access control device 100 may photograph the vehicle exit process using a CCTV camera installed at the construction site. Similarly, appearance information is extracted through CCTV images taken during the vehicle exit process, and the appearance information may be recorded in exit information.

Recognizing the entry of the vehicle (S220) according to an embodiment of the present invention includes a preprocessing step, a feature point extraction step, and an object recognition algorithm, for example, Canny Edge Detector, Harris Corner Detector, Haar-like Feature, HOG (Histogram) It may be configured to include a classification step using at least one of Oriented Gradient (SIFT), Scale Invariant Feature Transform (SIFT), Local Binary Pattern (LBP), and Modified Census Transform (MCT). In addition, as an artificial intelligence algorithm, an artificial neural network, for example, CNN, YOLO, SSD, or the like may be used.

6 is a flowchart of a smart on-site management method according to an embodiment of the present invention.

Referring to FIG. 6, the LPR step of recognizing the vehicle license plate (S230) includes the first LPR (License Plate Recognition) by a machine based on a character recognition algorithm (S231), determination of success or failure of recognition (S232), and It may be configured to include secondary LPR (S233) and license plate information extraction (S244) by

In step S231, the vehicle access management device 110 may be configured to perform a primary LPR by a machine. The vehicle access device 110 may determine whether the primary LPR is successful by using the probability value of the recognition result (S232). If the primary LPR fails, the vehicle access management device 110 may perform the secondary LPR through communication with the manager's user terminal 142 .

The administrator's user terminal 142 required for the secondary LPR may be registered in advance. The administrator can recognize the letters and numbers of the vehicle license plate transmitted in the form of a pop-up using the user terminal 142 on which the application is installed, and transmit information about the recognized vehicle license plate to the vehicle access control device 110 through text input. have. The access control device 110 receiving the information on the license plate through the secondary LPR extracts the license plate information using this (S234).

7 is a flowchart of a smart on-site management method according to an embodiment of the present invention.

Referring to FIG. 7, the LPR method performed by the smart site management system 100 when a visiting vehicle exits a construction site is depicted. Similar to when entering a vehicle, there may be a case in which a vehicle for which primary recognition by LPR cannot be newly recognized and a vehicle for which primary recognition by LPR cannot be newly recognized when entering a vehicle must be recognized.

When the vehicle that has completed the unloading process leaves the vehicle, the vehicle license plate first LPR process is performed by a machine using the image of the vehicle exiting (S310). According to the recognition result (S321), if the recognition by the LPR module 122 succeeds, the vehicle can be safely taken out. However, if the primary recognition by the LPR module 122 fails, the vehicle access control device 110 checks the existence of the vehicle entrance information (S322). If the vehicle is recognized through secondary recognition at the time of entering the vehicle, the information is stored, and a vehicle exit recognition process is performed using the stored information about entering the vehicle (S324). If the vehicle does not have entering information, that is, the vehicle is newly unrecognizable, the vehicle access management device 110 proceeds with the third LPR through communication with the manager's user terminal 142 (S323).

Hereinafter, by using the vehicle recognition by the vehicle recognition module 121, vehicle license plate recognition by the LPR module 122, and the departure information collected by the departure management module 122, among a plurality of CCTV images, the target vehicle to be searched An example of a method of confirming the original photographed image for the image will be described.

8 is an exemplary view of vehicle access management according to an embodiment of the present invention.

Referring to FIG. 8, CCTV cameras (#1, #2, #3) installed at a construction site managed by the smart site management system 100 according to an embodiment of the present invention are depicted. Depending on the purpose of the construction site, for example, a CCTV camera (#1) for filming the loading situation, a CCTV camera (#2) for filming the unloading process, and a CCTV camera (#3) for filming the unloading process may be installed. . The number of CCTV cameras that can be installed is not limited to the number of cameras in FIG. 6 .

Referring to FIG. 8 , under each CCTV camera, a vehicle in an entry situation, a vehicle in an unloading situation, and a vehicle in an exit situation are depicted. The three vehicles depicted represent the movement of vehicles and the passage of time.

Under the three vehicles, the time information of the section where the vehicle appeared in the entry video taken by camera (#1), the unloading video taken by camera (#2), and the exit video taken by camera (#3) is illustrated as an example.

Referring to FIG. 8 , a vehicle entering and exiting a construction site is depicted as entering the vehicle at a reference time (0:00) in the entry image. That is, it can be known that the vehicle license plate is recognized at the reference time. An incoming/outgoing vehicle is recognized in an image captured by the vehicle recognition module 121 and the LPR module 122, and vehicle appearance information, ie, appearance time information, may be extracted based on the recognition result.

Based on the appearance information, in the entry video taken by the CCTV camera (#1) installed at the gate of the construction site, the entering and exiting vehicle appears for 5 seconds and then disappears, and the unloading video taken by the CCTV camera (#2) that recorded the unloading situation. In and out vehicles appear for about 30 minutes. In addition, it can be seen that the entering and exiting vehicle appears for 15 seconds in the exiting image taken by the CCTV camera (#3) that recorded the exiting situation.

From the input image, unloading image, and unloading image collected in this way, the section where the entering and exiting vehicle appeared, that is, fade-in time and fade-out time information of the vehicle may be collected.

Based on the appearance information of the entering and exiting vehicle, it is possible to search the entry and exit records of the entering and exiting vehicle through the search. In addition, it is possible to continuously reproduce images in which vehicles entering and exiting are photographed using the search results.

When a vehicle enters and exits a gate at a construction site and exits the vehicle after loading and unloading, when a series of situations are captured over time through a plurality of cameras, each image may be configured such that overlapping portions are captured. Accordingly, when a plurality of images are continuously reproduced according to the movement of a target vehicle to be searched for, the original image from which the overlapped image section is extracted may vary according to the method for determining the starting point of reproduction of the image.

That is, the same time as the vehicle's fade-out time in the previous image may be selected as the playback time of the next image, or the same time as the fade-in time of the next image may be selected as the playback end point of the previous image.

That is, the vehicle access management device 110 may replay so that the sections of the CCTV image are seamlessly connected based on the vehicle appearance information so that overlapping time sections are not included between sections of the CCTV image in which the vehicle appears.

Alternatively, the reproduction start time may be selected so that all of the captured appearance sections are reproduced by connecting the fade-in and fade-out rejections in each image so that all overlapping sections in a series of images can be reproduced.

That is, the vehicle access management device 110 may connect and reproduce sections of a plurality of CCTV images based on vehicle appearance information so that all appearance sections overlapped between sections of the CCTV image in which the vehicle appears are included. The selection of the playback start point can be determined through environment settings.

The smart site management method and system according to an embodiment of the present invention may constitute part of a smart safety (smart safety) integrated management system. The smart safety integrated management system is a solution that applies Internet of Things (IoT)-based smart technology to identify threat factors at construction sites in real time and enable safety measures. It is characterized by being able to preemptively respond to safety accidents that may occur in the field by applying an IoT sensor-based integrated solution and enabling immediate action when a situation occurs.

There are many existing IoT-based safety management solutions, but construction safety platforms that can integrate, operate, and manage them are rare. According to the prior art, safety accidents due to initial response and control tower member are repeated. The solution that is the basis of the present invention has the advantage of being able to detect threat factors through real-time control as it enables integration and convergence of IoT devices throughout the construction site.

Through the smart site management system according to an embodiment of the present invention, it is possible to manage the departure and departure of construction vehicles using a user terminal and short-range communication.

In addition, the smart on-site management system according to an embodiment of the present invention makes it possible to use an existing CCTV camera for vehicle access management while supplementing the LPR algorithm by a machine using a user terminal of a manager connected through a network.

In addition, since the smart on-site management system according to an embodiment of the present invention uses a CCTV camera, vehicle recognition and vehicle number recognition using the camera of the CCTV system in a place where it is difficult to embed a loop coil according to the prior art. By doing so, it is characterized in that it is a smart on-site management system using a CCTV system that can replace the loop coil required for separate vehicle access management. That is, a CCTV camera constituting a smart site management system can replace a conventional loop coil and a separate LPR camera.

In addition, the smart site management system according to an embodiment of the present invention, rather than simply integrating the CCTV system and the smart site management system, discloses an organic relationship between the CCTV system and the smart site management system. For example, in the smart field management system, a person directly searches for images stored in the conventional technology, and according to the search results, a number of images that are expected to be traversed are played by a person and freed from the work of checking with the naked eye, CCTV The images collected through the system are analyzed using the smart field management system, and based on the analysis, vehicle situation information corresponding to comprehensive information about the vehicle is extracted, and the target vehicle is driven from beginning to end using the situation information. It allows seamless monitoring.

As such, according to an embodiment of the present invention, it is possible to prevent an error that vehicle license plate recognition is not possible in vehicle access management.

In addition, the CCTV system can be used for vehicle access management through supplementation of software.

In addition, compared to the conventional CCTV system in which the monitoring target was mainly a person, monitoring and vehicle access management can be simultaneously performed using the CCTV system for people, vehicles, and accidents related thereto.

In addition, it is possible to seamlessly reproduce images of entering, entering, parking, exiting, and exiting situations of the target vehicle through vehicle search using situation information of the vehicle extracted using the CCTV system.

In the above, various preferred embodiments of the present invention have been described with some examples, but the description of various embodiments described in the "Specific Contents for Carrying Out the Invention" section is only exemplary, and the present invention Those skilled in the art will understand from the above description that the present invention can be practiced with various modifications or equivalent implementations of the present invention can be performed.

In addition, since the present invention can be implemented in various other forms, the present invention is not limited by the above description, and the above description is intended to complete the disclosure of the present invention and is common in the technical field to which the present invention belongs. It is only provided to completely inform those skilled in the art of the scope of the present invention, and it should be noted that the present invention is only defined by each claim of the claims.

100: smart field management system
110: vehicle access management device
111: control unit
112: camera
113: input device
114: output device
115: storage device
116: communication device
117: memory
121: vehicle recognition unit
122: LPR module
123: departure management department
124: user terminal management module
130: short-range communication device
141: driver's user terminal
142: Administrator's user terminal
150: server
160: gate breaker
170: display device
180: network

Claims (16)

As a method performed by the smart site management system,
Storing ID information about a user terminal of a vehicle driver pre-registered for vehicle access;
receiving gate arrival information transmitted by the user terminal based on an ID signal generated by a short-range communication device installed at the gate; and
It is configured to include the step of confirming the departure of the user using the ID information and the arrival information.
Smart field management method. The method of claim 1,
It is configured to further include the step of performing authentication for the vehicle driver using pre-registered driver information.
Smart field management method. The method of claim 1,
It is configured to further include the step of storing the exit information of the vehicle including the entry and exit times of the vehicle,
Smart field management method. The method of claim 1,
Recognizing the entry of a vehicle using a camera installed at a construction site;
Based on the recognition, it is configured to further include the step of recognizing the vehicle license plate using the entry image captured at the entrance gate,
Smart field management method. The method of claim 4,
The step of recognizing the license plate is configured to include primary recognition by a machine based on a character recognition algorithm and secondary recognition by an administrator's user terminal through a network when vehicle number recognition fails in the primary recognition ,
Smart field management method. The method of claim 5,
For secondary recognition by the manager's user terminal, further comprising the step of collecting information about the manager's user terminal that will participate in license plate recognition,
Smart field management method. The method of claim 5,
The second recognition,
Transmitting data necessary for license plate recognition to at least one of a plurality of user terminals; and
It is configured to include the step of receiving a recognition result according to vehicle license plate recognition,
Smart field management method. The method of claim 5,
It is configured to further include determining failure of the primary recognition according to a threshold value related to recognition probability.
Smart field management method. The method of claim 8,
The threshold is,
Characterized in that it is preset differently according to at least one of the type and condition of the vehicle at the time of license plate recognition, weather conditions, time zone, and illumination,
Smart field management method. The method of claim 5,
Secondary recognition by the user terminal,
It is configured to be based on the comprehensive recognition result by a plurality of user terminals,
Smart field management method. The method of claim 5,
The first recognition,
Recognizing the horizontal/vertical ratio, number of rows, background color, and arrangement structure of letters and numbers of the license plate by using the recognized vehicle type, and recognizing the letters and numbers of the license plate using this made up,
Smart field management method. The method of claim 4,
photographing the unloading process of the vehicle using a camera installed at the construction site;
photographing the process of leaving the vehicle; and
Further comprising the step of extracting vehicle appearance information including time information on fade-in and fade-out of the vehicle for each captured image,
Smart field management method. The method of claim 12,
Based on the vehicle appearance information, it is configured to further include the step of continuously reproducing so that the section of the image in which the vehicle appears is temporally continuous.
Smart field management method. In vehicle access management,
a storage device for storing information about a user terminal of the vehicle driver pre-registered for vehicle access;
a communication device for receiving arrival information transmitted by the user terminal at the gate based on an ID signal generated by a short-range communication device installed at the gate;
Departure management unit for storing information on departure details of the vehicle; and
It is configured to include a control unit for controlling the output management unit based on information on the user terminal of the driver and arrival information.
Smart field management system. The method of claim 14,
A vehicle recognition unit for recognizing the entry of a vehicle using a camera photographing a construction site; and
Further comprising a license plate recognition (LPR) module for recognizing the license plate of the vehicle,
The control unit,
Based on the recognition, controlling the LPR module to recognize the license plate using the entry image taken at the entrance gate,
Smart field management system. The method of claim 15
Further comprising a mobile communication management module for managing communication with the manager's user terminal for secondary recognition through a network when the primary recognition fails by the LPR module,
The control unit,
Is configured to determine vehicle license plate recognition failure, switch from primary recognition to secondary recognition and control the user terminal management module,
Smart field management system.

Images