WO2019132852A1 - Caméra intelligente, système d'information et procédé de découverte de places de stationnement libres dans des lieux de stationnement comprnant cette caméra - Google Patents

Caméra intelligente, système d'information et procédé de découverte de places de stationnement libres dans des lieux de stationnement comprnant cette caméra Download PDF

Info

Publication number
WO2019132852A1
WO2019132852A1 PCT/UA2018/000008 UA2018000008W WO2019132852A1 WO 2019132852 A1 WO2019132852 A1 WO 2019132852A1 UA 2018000008 W UA2018000008 W UA 2018000008W WO 2019132852 A1 WO2019132852 A1 WO 2019132852A1
Authority
WO
WIPO (PCT)
Prior art keywords
parking
camera
parking spaces
central server
smart camera
Prior art date
Application number
PCT/UA2018/000008
Other languages
English (en)
Russian (ru)
Inventor
Олэг Лэонидовыч ДЫВИНЭЦЬ
Олэг Володымыровыч МОИСЭЕНКО
Виталий Гэоргийовыч ЧЭНЦОВ
Егор Вадымовыч КОЛОДЯЖНЫЙ
Олэксандр Васыльовыч ДЭСЯТНЫЧЭНКО
Original Assignee
Олэг Лэонидовыч ДЫВИНЭЦЬ
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Олэг Лэонидовыч ДЫВИНЭЦЬ filed Critical Олэг Лэонидовыч ДЫВИНЭЦЬ
Publication of WO2019132852A1 publication Critical patent/WO2019132852A1/fr

Links

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/14—Traffic control systems for road vehicles indicating individual free spaces in parking areas

Definitions

  • the invention generally relates to video surveillance systems, in particular to any outdoor parking facilities, such as small street parking, large parking lots and parking garages with a ceiling height of 10 meters.
  • the invention also relates to smart cameras that are used in such systems.
  • the smart camera is a nodal object of the system, since it takes on the task of recognizing vehicles and transferring data to a central server.
  • a known smart camera which includes a housing in which a camera is installed to receive an image of an object, an image processing functional unit connected to the camera, a rear panel connected to the functional unit, the camera housing having one or more sockets, each of which contains a connector for electrical connection to the rear panel (application US 20030193571, prototype).
  • the disadvantages of the well-known smart camera is that the camera in the patent is connected directly to a personal computer, it works in a room environment and is engaged in the detection of completely identical objects.
  • the said system analyzes the parking space according to the “busy / unoccupied” principle.
  • the system periodically compares the image of the space of a particular place according to the standard, and the standard mentioned is the image of the place mentioned when the specified place is not occupied or occupied, and generates a vacancy signal for the said place.
  • a disadvantage of the known system and method is that it has a smart camera installed that can detect low-lying cameras in garage-type parking lots and is not designed to recognize a large number of parking spaces.
  • One camera in these systems recognizes up to 3 cars.
  • the system uses a comparison algorithm for a non-empty parking place with a previously prepared image of an empty parking space, which may cause collisions when weather conditions change.
  • the system is most suitable for indoor parking spaces and ideal conditions, such as constant lighting, lack of wind and the presence of wired communication lines between its elements.
  • the invention is based on the task of introducing new nodes and connections with the system into a smart camera to ensure the ability not only to detect objects, but also to search for objects in the video camera's scope and classify them by type with high accuracy.
  • With additional training of the neural network it is possible to provide a classification of objects by type, for example, freight, passenger, motorcycles.
  • a smart camera which includes a housing in which a camera is installed to receive an image of an object, a functional unit for image processing connected to the camera, a rear panel connected to the functional unit, the camera body having one or more sockets, each of which contains a connector for electrical connection with the rear panel, according to the invention, an additional computing unit is installed with a software complex using a deep neural network th training.
  • the central server for posting information regarding the busy status of parking spaces is at least one a smart camera that can make a conclusion about the state of availability of free parking spaces relative to employment, which has a wired or wireless connection to the central server
  • a smart camera is installed in the system, which additionally contains a computing unit with a software package using a deep learning neural network.
  • the task is also solved by the fact that in the information system to identify free parking spaces in a parking facility, which has many parking spaces, several of which cannot be visually detected by the user, according to which information regarding the employment status of parking spaces is fed to the central server of the system, at least one smart camera via wired or wireless communication with the central server, according to the invention, the detection of free parking spaces in the parking th object is performed using a pre-trained neural network, with additional training under a certain geographic location, and sends information regarding the busy / idle on a central server for storage and onward transmission to users.
  • FIG. 1 shows a block diagram of a smart camera
  • FIG. 2 is a parking plan containing one camera with direct visibility
  • FIG. 3 is a side view of FIG. 2
  • FIG. 4 is a parking plan containing several cameras with indirect visibility
  • FIG. 5 is a side view of FIG. four
  • FIG. 6 is a diagram of a multi-compartment parking with cameras located on lighting poles.
  • FIG. 7 block diagram of the entire system (cameras, central server, light panel, mobile phones)
  • the smart camera 1 the block diagram of which is shown in FIG. 1, is a key object of the system.
  • the block diagram conventionally shows lens 2, video camera 3, mini-computer 4, antennas 5, power supply 6, and network cable 7.
  • the smart camera takes on the task of recognizing vehicles and transferring data to a central server. To ensure this functionality, the smart camera is equipped with a high-performance minicomputer 4 and a communication controller (not shown in the drawing).
  • the central part of the smart camera 1 is the mini-computer 4. It receives the video from the video camera 3 and analyzes them for the presence of vehicles with a frequency of 3 frames per minute.
  • the system uses a 6th nuclear ARM server-type processor that operates at a frequency of 2 Hz and has a low power consumption of 12V - 4 A.
  • Computer software uses image processing algorithms and uses a unique neural network for object recognition.
  • the neural network is pre-trained on 10 thousand car images. It is possible to recognize not only cars, but also any other objects (people, animals, etc.) after prior training of the neural network.
  • the software of the smart camera interacts with the central server 8 (Fig. 7), after which the neural network and its parameters are updated.
  • the system uses an HD camera with a varifocal lens for ease of setting it up for a specific parking space.
  • the lens has a focal length of 5 to 50 mm.
  • the matrix includes a photosensitive element with a minimum illumination of 00.1 lux. This is enough for her work in low light.
  • the camera is connected to the microcomputer via a USB interface that allows you to transfer an image with a HD resolution (1920x1280) using H.264 compression.
  • 3G GSM connections to the Internet, via antenna 5, or via available WiFi are used to transfer them.
  • Ethernet connections are used to provide a 3G connection.
  • an external 3G modem and MiniPci Express connector are used. This makes it easy to replace it with a modem that is most suitable for mobile networks in a specific geographic location.
  • the cooling of the smart camera 1 consists of a passive radiator (not shown in the drawing) located on its case, which is sufficient to cool this type of central processor.
  • the camera used the wireless connection.
  • the invention has the versatility of installation and works independently of other objects of the system, both online and offline.
  • FIG. 2 shows a plan of a street parking lot that was developed to implement this invention.
  • the area shown in FIG. 2 is exemplary only in the sense that it is one of many mechanisms in which the basic elements of the invention described in this application may be applicable.
  • This parking is equipped with one smart camera 1, which captures cars in line of sight (located so that the cars do not overlap each other).
  • FIG. 3 position 9 shows a separate parking space, which corresponds to a pre-marked grid. As can be seen from the figure, a smart camera can capture a lot of parking spaces - it depends on how it is installed and pre-configured.
  • FIG. 3 position 10 shows the carriageway.
  • FIG. 2 and 3 position 1 shows a smart camera (IC), and position 1 1 shows the angle of view of a smart camera.
  • FIG. Figures 4 and 5 show a plan view and a side view of a parking area equipped with several cameras located so that some cars overlap each other. Positions 12 and 13 show how one car partially overlaps another car. If it is impossible to establish an IC with direct visibility to vehicles when they do not overlap, it is necessary to complete the system for a specific parking space, after which the system will begin to “see” the vehicles partially blocked.
  • Each SC analyzes its part of the parking lot, information from several cameras is grouped and displayed either in aggregate or by zone.
  • FIG. 6 shows a plan view of a multi-sectional parking lot with IC 1 located on the lighting pillars. Cameras cover the entire parking space and transmit information on a predetermined grid. Positions 14 and 15 show entry and exit respectively.
  • FIG. 6 parking spaces 16, 17, 18 and 19 are controlled by smart camera 1. The camera analyzes each image for empty and occupied places and does not use the previous images as described in US patent 6,107,942 A, which allows to get rid of collisions and loss of accuracy. There is no need to have a previously saved image of empty spaces, which changes when the time of day changes, or when precipitation falls. There is no comparison of two images to assess the employment of parking spaces. In the event of a collision, the system self-restores at the next iteration of the algorithm.
  • the method of detection using a deep neural network is that the network is pre-studied by tens of thousands of images, and the general properties of objects, for example, wheels, headlights, etc., are highlighted. Based on this information, an assumption is made whether the object is in the zone of interest (parking space). This avoids such collisions as temporary overlapping of the zone of interest (for example, a heavy vehicle), precipitation, camera vibration, day and night change.
  • the system analyzes the features of the object and compares them with the already known features of the prototype, which increases the accuracy of the system and makes it universal for various geolocations.
  • FIG. 7 shows a block diagram of the entire system.
  • Positions 1 show smart cameras located on specific parking lots and tied to specific GPS coordinates and physical parking addresses. Cameras are connected to the Internet in one of 3 ways: wired (Ethrenet) or wireless (WiFi, GSM). In the case of a wired connection, you need to lay a twisted pair cable to the nearest Internet access point 20. This type of connection will allow you to use the IC as a video surveillance system. The ability to transmit the video signal in its pure form is configured using the central server software 8. Also, the smart camera has the ability to save the video signal to external media when motion is detected in the area of interest. Any actions in the parking lot, including collisions between two cars, can be monitored 24 hours a day, which can help system owners in finding the cause of accidents, or in the event of car theft. To work the UK you need to apply power. All its settings, maintenance are performed by the central server operator, that is, there is no need for physical access to an already installed smart camera.
  • this system has the ease of installing components and does not require special knowledge to administer it.
  • the smart camera works offline and with the presence of the Internet in online modes.
  • offline mode the camera stores statistics in its own database, followed by synchronization of data with the server in online mode.
  • no important information is stored on the camera media.
  • the advantage is that the main storage medium is located in a secure cloud storage and not in a smart camera.
  • Important information is stored offline. In case of loss of information in the SC, it can be easily recovered from the central server. All data can be synchronized.
  • the smart camera contains only current data that is transmitted and stored on a central server. In offline mode, it accumulates data and then transmits it at the time the link is restored.
  • reference numeral 20 shows the global Internet, which is the main transport hub for communication between system devices. All data between the devices of the system are protected with a password and can be encrypted, which prevents unauthorized access to the system.
  • Position 7 shows the central server containing statistical information coming from SC 1 and transferring it to clients: light boards, mobile devices, WEB statistics website 21.
  • the central server can be located both on a physical computer and on a virtual one in a cloud service. There is a need to ensure fast access and reliable Internet connection. In another, the server does not require high computing power, since it receives and sends the data generated by the smart camera already prepared.
  • One of the main functions of the server is to manage the settings of the smart camera, which are synchronized with it on request.
  • the smart camera After the physical installation of the smart camera, it registers on the central server and sends images to it.
  • the server operator sets the world coordinates (GPS) for the SC, the physical address and makes grid markings based on the received image. After these presets, the camera is ready for use. Sending images is disabled.
  • GPS world coordinates
  • the normal operation of the system involves the exchange of statistical information about the employment of parking spaces, eliminates the high load on the system communication lines.
  • the central server 7 has an interface for transmitting data to clients and uses the REST (https://wikipedia.org/wiki/REST) protocol for interaction.
  • REST https://wikipedia.org/wiki/REST
  • Web server interface reflects the digital map of the world based on Google Mar, displays on it parking spaces and statistical information about employment.
  • the web interface and the central server can be located physically on different computers.
  • the manager can generate reports on the time during which monitored spaces were occupied and when the state of objects changes. Such data can be compared with cash receipts for the same period.
  • the time of status change is saved and can be used to create reports, and can also be used to calculate the fee that needed to be collected.
  • Information can be displayed and / or printed and used to generate data or reports on the time during which the monitored spaces were occupied, the number of times in a certain period when the state of the monitored objects changed from unoccupied to occupied and back to vacant. Such data can be compared with actual cash receipts over the same period and can be used, for example, to check the accuracy of such receipts to determine if a leak has been made.
  • the statistics also allows drivers to see the free and busy places directly in the mobile application and pave the way to the nearest free parking online.
  • Smart cameras come with an already trained neural network. It is also possible to learn using the server software. To do this, the smart camera is transferred to the mode of sending images to the server at a certain interval (1 - 3 min), after the formation of the image database using them, the existing neural network is re-trained with augmented images. After synchronization of the camera with the server, the camera receives the file of the new neural network.
  • OS Linux is used which is highly reliable, for the operation of the server OS Linux or Windows by the owner.
  • Position 22 shows information panels associated with specific GPS coordinates and physical address. Each information panel is configured with a unique ID key for a specific parking space, or for several spaces and reflects the number of occupied and free parking spaces. It is possible to supply information panels with the ability to display advertising, which can reduce the final cost of the system.
  • Position 23 reflects Android and IOS mobile devices, in which special software is installed that interacts with the central server.
  • the user can search for the nearest free parking and pave the way for the vehicle to move to it. Also obtain information on the number of free parking places and the number of the parking zone, if it is multi-zone.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Studio Devices (AREA)
  • Traffic Control Systems (AREA)

Abstract

l'invention concerne dans son ensemble des systèmes de vidéosurveillance, notamment de quelconques lieux de stationnement ouverts, ainsi que des petites aires de stationnement dans la rue, des aires de stationnement importante et des garages dont la hauteur de plafond peut atteindre 10 mètres. L'invention concerne également une caméra intelligente que l'on utilise dans de tels systèmes. L'invention concerne notamment une caméra intelligente, un système d'information et un procédé de découverte de places de stationnement libres dans des lieux de stationnement comprnant cette caméra; selon l'invention, grâce à une unité informatique supplémentaire monté dans la caméra intelligente et comprenant un système logiciel utilisant un réseau neuronal à apprentissage profond, le système d'information pour découvrir des places de stationnement libres dans des lieux de stationnement peut découvrir les places de stationnement libres dans le lieu de stationnement en utilisant le réseau neuronal préalablement instruit et capable d'apprentissage supplémentaire concernant un lieu géographique déterminé, et transmettre des informations concernant l'occupation/la vacance vers un serveur central pour le stockage et le traitement ultérieur par un utilisateur.
PCT/UA2018/000008 2017-12-29 2018-02-08 Caméra intelligente, système d'information et procédé de découverte de places de stationnement libres dans des lieux de stationnement comprnant cette caméra WO2019132852A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
UAA201713165 2017-12-29
UA201713165 2017-12-29

Publications (1)

Publication Number Publication Date
WO2019132852A1 true WO2019132852A1 (fr) 2019-07-04

Family

ID=67064009

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/UA2018/000008 WO2019132852A1 (fr) 2017-12-29 2018-02-08 Caméra intelligente, système d'information et procédé de découverte de places de stationnement libres dans des lieux de stationnement comprnant cette caméra

Country Status (1)

Country Link
WO (1) WO2019132852A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110751850A (zh) * 2019-08-30 2020-02-04 的卢技术有限公司 一种基于深度神经网络的车位识别方法和系统
RU2775022C1 (ru) * 2021-12-06 2022-06-27 Общество с ограниченной ответственностью фирма "Интерсвязь" Система обнаружения, мониторинга свободных парковочных мест и виртуальной охраны припаркованного транспортного средства "Купол"

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5617490A (en) * 1994-06-27 1997-04-01 Sanyo Electric Co., Ltd. Camera system with neural network compensator for measuring 3-D position
US7791671B2 (en) * 2002-04-10 2010-09-07 National Instruments Corporation Smart camera with modular expansion capability including a function module that performs image processing
RU2607043C1 (ru) * 2012-08-06 2017-01-10 Клаудпарк, Инк. Управление использованием одного парковочного пространства для нескольких транспортных средств посредством применения множества камер
CN103473950B (zh) * 2012-06-06 2017-04-12 刘鉵 一种停车场车位监控方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5617490A (en) * 1994-06-27 1997-04-01 Sanyo Electric Co., Ltd. Camera system with neural network compensator for measuring 3-D position
US7791671B2 (en) * 2002-04-10 2010-09-07 National Instruments Corporation Smart camera with modular expansion capability including a function module that performs image processing
CN103473950B (zh) * 2012-06-06 2017-04-12 刘鉵 一种停车场车位监控方法
RU2607043C1 (ru) * 2012-08-06 2017-01-10 Клаудпарк, Инк. Управление использованием одного парковочного пространства для нескольких транспортных средств посредством применения множества камер

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
PAPULOVSKAYA N.V. ET AL.: "Sistema videoregistratsii avtotransporta dlya obespecheniya komfortnoi parkovkiFUNCTIONAL SOLUTION FOR COMFORTABLE PARKING OF THE PERSONAL MOTOR TRANSPORT", ELAR.URFU.RU, pages 186 - 188, XP055622763, Retrieved from the Internet <URL:http://elar.urfu.ru/handle/10995/43753> [retrieved on 20180830] *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110751850A (zh) * 2019-08-30 2020-02-04 的卢技术有限公司 一种基于深度神经网络的车位识别方法和系统
CN110751850B (zh) * 2019-08-30 2023-03-07 的卢技术有限公司 一种基于深度神经网络的车位识别方法和系统
RU2775022C1 (ru) * 2021-12-06 2022-06-27 Общество с ограниченной ответственностью фирма "Интерсвязь" Система обнаружения, мониторинга свободных парковочных мест и виртуальной охраны припаркованного транспортного средства "Купол"

Similar Documents

Publication Publication Date Title
US11592833B2 (en) Method for updating a localization map for a fleet of autonomous vehicles
CN109686109B (zh) 一种基于人工智能的停车场安全监控管理系统及方法
US10582163B2 (en) Monitoring an area using multiple networked video cameras
US9791766B2 (en) Portable license plate reader, speed sensor and face recognition system
US11200756B2 (en) Method for detecting parked vehicles and billing parking charges
KR102007140B1 (ko) 스마트 시티를 구현하기 위한 통합 교통 정보 관리 시스템
US10643471B2 (en) Method for detecting parked vehicles
US20150294567A1 (en) Automatic regulated parking system and method
JP6994203B2 (ja) コネクテッド自動運転車のハイウエイシステムとそれを用いた方法
JP2007504551A (ja) 駐車場において車両の位置を特定し、認識し、および追跡するための装置および方法
WO2014031563A2 (fr) Système et procédé pour contrôle de voisinage de véhicule
JP2011503696A (ja) 交通監視システム
KR101626377B1 (ko) Cctv와 차량내 블랙박스를 활용한 빅데이터 기반의 불법 주정차 단속 시스템
JPWO2020100922A1 (ja) データ配信システム、センサデバイス及びサーバ
CN111785030A (zh) 交通监控终端和交通监控系统
KR101394201B1 (ko) 버스장착 무선cctv 촬영단속시스템
KR20240008966A (ko) 주차공간 이용효율 극대화를 위한 주차공유시스템
KR100785759B1 (ko) 차량 탑재형 카메라를 이용한 자동 불법 주정차 단속시스템 및 방법
JP7401292B2 (ja) 駐車場管制システム、駐車場管制方法、及びプログラム
Telles et al. SParkSys: a framework for smart parking systems
WO2019132852A1 (fr) Caméra intelligente, système d&#39;information et procédé de découverte de places de stationnement libres dans des lieux de stationnement comprnant cette caméra
CN109671291B (zh) 一种基于智能传感器的全景监控方法
Buntić et al. ITS supported parking lot management
Kawthankar et al. A survey on smart automobiles using Internet of Things for digital India
KR102499885B1 (ko) 단속 기능을 갖는 무인 주차 관리 장치

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18894165

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18894165

Country of ref document: EP

Kind code of ref document: A1