WO2020211691A1 - Vehicle monitoring method, apparatus, device and system - Google Patents

Vehicle monitoring method, apparatus, device and system Download PDF

Info

Publication number
WO2020211691A1
WO2020211691A1 PCT/CN2020/083869 CN2020083869W WO2020211691A1 WO 2020211691 A1 WO2020211691 A1 WO 2020211691A1 CN 2020083869 W CN2020083869 W CN 2020083869W WO 2020211691 A1 WO2020211691 A1 WO 2020211691A1
Authority
WO
WIPO (PCT)
Prior art keywords
camera
vehicle
license plate
plate number
parking space
Prior art date
Application number
PCT/CN2020/083869
Other languages
French (fr)
Chinese (zh)
Inventor
张民英
神克乐
邵斌
段洪涛
邓耀
尹宁
陶永亮
罗日健
庄耀
林达
汪亮
杜浔
龙一民
Original Assignee
阿里巴巴集团控股有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 阿里巴巴集团控股有限公司 filed Critical 阿里巴巴集团控股有限公司
Publication of WO2020211691A1 publication Critical patent/WO2020211691A1/en

Links

Images

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/14Traffic control systems for road vehicles indicating individual free spaces in parking areas
    • G08G1/141Traffic control systems for road vehicles indicating individual free spaces in parking areas with means giving the indication of available parking spaces
    • G08G1/142Traffic control systems for road vehicles indicating individual free spaces in parking areas with means giving the indication of available parking spaces external to the vehicles
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07BTICKET-ISSUING APPARATUS; FARE-REGISTERING APPARATUS; FRANKING APPARATUS
    • G07B15/00Arrangements or apparatus for collecting fares, tolls or entrance fees at one or more control points
    • G07B15/02Arrangements or apparatus for collecting fares, tolls or entrance fees at one or more control points taking into account a variable factor such as distance or time, e.g. for passenger transport, parking systems or car rental systems
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/14Traffic control systems for road vehicles indicating individual free spaces in parking areas
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/14Traffic control systems for road vehicles indicating individual free spaces in parking areas
    • G08G1/145Traffic control systems for road vehicles indicating individual free spaces in parking areas where the indication depends on the parking areas
    • G08G1/146Traffic control systems for road vehicles indicating individual free spaces in parking areas where the indication depends on the parking areas where the parking area is a limited parking space, e.g. parking garage, restricted space
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/14Traffic control systems for road vehicles indicating individual free spaces in parking areas
    • G08G1/149Traffic control systems for road vehicles indicating individual free spaces in parking areas coupled to means for restricting the access to the parking space, e.g. authorization, access barriers, indicative lights

Definitions

  • the present invention relates to the field of Internet technology, and in particular to a vehicle monitoring method, device, equipment and system.
  • detectors such as infrared, ultrasonic, geomagnetism, etc. are installed in each parking space to detect whether there is a vehicle parked in the corresponding parking space, thereby guiding users who need to park to go to Free parking spaces for parking. Deploying detectors in each parking space will cost a lot in terms of cost, wiring, and data processing.
  • the embodiments of the present invention provide a vehicle monitoring method, device, equipment, and system to realize intelligent management of vehicles entering a parking lot.
  • an embodiment of the present invention provides a vehicle monitoring system, including:
  • the server corresponding to the first barrier in the direction of entry, is deployed at the first barrier and used to photograph the first camera of the entering vehicle, and the shooting range covers at least the first of the preset range at the first barrier A second camera, and a third camera whose shooting range covers multiple parking spaces; the overall shooting range of the second camera and the multiple third cameras covers the parking lot;
  • the first camera is configured to detect the license plate number of the driving-in vehicle in the collected image, and send the license plate number to the server;
  • the server is configured to send a first notification message containing the license plate number to the second camera, and determine parking space recommendation information according to the current images collected by the second camera and the multiple third cameras , Notify the vehicle of the parking space recommendation information;
  • the second camera is configured to detect the vehicle located at the first barrier in the collected image in response to the first notification message, associate the license plate number for the vehicle, and Track the vehicle;
  • the third camera is configured to track the vehicle according to a predetermined homography matrix between cameras
  • the second camera and the third camera are further configured to send a second notification message to the server if it is detected that the vehicle has parked in a target parking space, and the second notification message includes the license plate number And the identification of the target parking space.
  • an embodiment of the present invention provides a vehicle monitoring system, including:
  • the server corresponding to the barrier gate in the driving direction, is deployed at the barrier gate and used to photograph the first camera of the entering vehicle, and the shooting range covers multiple second cameras in the parking lot.
  • the shooting range of at least one second camera covers the preset range at the barrier, and adjacent second cameras have overlapping areas;
  • the first camera is configured to detect the license plate number of the entering vehicle in the collected image, and send the license plate number to the server;
  • the server is configured to send a first notification message containing the license plate number to the at least one second camera, so that the at least one second camera detects the entering vehicle in the collected images, and is The vehicle entering the vehicle is associated with the license plate number;
  • the multiple second cameras are used to track the entering vehicle, and when detecting that the entering vehicle has stopped at the target parking space, send a second notification message to the server, and the second The notification message includes the license plate number and the identification of the target parking space.
  • an embodiment of the present invention provides a vehicle monitoring method applied to a server, and the method includes:
  • the shooting range of the second camera at least covers a preset range outside the first barrier
  • the second notification message includes the license plate number and the identifier of the target parking space where the incoming vehicle stops; wherein, the third camera
  • an embodiment of the present invention provides a vehicle monitoring device, including:
  • a receiving module configured to receive the license plate number of the entering vehicle sent by the first camera, the first camera being deployed at the first barrier in the entering direction of the parking lot;
  • the sending module is configured to send a first notification message containing the license plate number to a second camera, so that after the second camera detects the entering vehicle in the collected images, it is associated with the entering vehicle
  • the license plate number; the shooting range of the second camera covers at least a preset range outside the first barrier;
  • the receiving module is further configured to receive a second notification message sent by the second camera or the third camera, where the second notification message includes the license plate number and the identification of the target parking space where the incoming vehicle stops Wherein, the shooting range of the third camera covers multiple parking spaces, and the second camera and the third camera track the entering vehicle to determine the identification of the target parking space.
  • an embodiment of the present invention provides an electronic device, including: a first memory and a first processor; wherein executable code is stored in the first memory, and when the executable code is When the processor is executed, the first processor can at least implement the vehicle monitoring method described in the third aspect.
  • the embodiment of the present invention provides a non-transitory machine-readable storage medium having executable code stored on the non-transitory machine-readable storage medium, and when the executable code is executed by a processor of an electronic device,
  • the processor can at least implement the vehicle monitoring method described in the third aspect.
  • an embodiment of the present invention provides a vehicle monitoring method applied to a server, and the method includes:
  • the shooting range of the second camera covers the preset range outside the barrier and each parking space in the parking lot;
  • the second notification message includes the license plate number and the identification of the target parking space where the incoming vehicle parks, wherein the second camera responds to the driving Enter the vehicle for tracking to determine the identification of the target parking space.
  • an embodiment of the present invention provides a vehicle monitoring device, including:
  • the receiving module is configured to receive the license plate number of the entering vehicle sent by the first camera, the first camera being deployed at the barrier of the entering direction of the parking lot;
  • the sending module is configured to send a first notification message containing the license plate number to a second camera, so that after the second camera detects the entering vehicle in the collected images, it is associated with the entering vehicle
  • the license plate number the shooting range of the second camera covers the preset range outside the barrier and each parking space in the parking lot;
  • the receiving module is further configured to receive a second notification message sent by the second camera, the second notification message including the license plate number and the identification of the target parking space where the incoming vehicle parks, wherein The second camera tracks the entering vehicle to determine the identification of the target parking space.
  • an embodiment of the present invention provides an electronic device, including: a second memory and a second processor; wherein executable code is stored in the second memory, and when the executable code is When the processor is executed, the second processor is caused to execute the vehicle monitoring method described in the sixth aspect.
  • the first camera detects that a vehicle has entered, it detects the license plate number of the vehicle in the collected images, and then informs the server.
  • the server further informs the second camera covering the first barrier to lock and track the incoming vehicle, and the server recognizes the currently free parking spaces in the parking lot based on the images currently collected by the second camera and the third camera, In order to recommend a parking space for the entering vehicle to realize parking guidance for the vehicle.
  • the second camera Based on the notification from the server, the second camera recognizes the vehicle at the first barrier in the currently captured image, which is the current vehicle, and compares the license plate number recognized by the first camera with the image captured by itself The vehicle in the link is associated, so that the second camera knows the license plate number of the currently entering vehicle. If the incoming vehicle moves within the shooting range of the second camera, the second camera can track the vehicle, and if the vehicle moves out of the shooting range of the second camera and enters the shooting range of a third camera Range, then the third camera can obtain the license plate number of the vehicle based on the homography matrix between the third camera and the second camera, so that the third camera can also track the vehicle within its own shooting range.
  • a camera (may be the second camera or the third camera) finds that the vehicle has entered a certain parking space, then the camera sends the vehicle's license plate number and the parking space identification to the server , So that the server records the parking information of the vehicle, so that subsequent users can query the location of the vehicle.
  • FIG. 1 is a schematic diagram of the composition of a vehicle monitoring system provided by an embodiment of the present invention
  • FIG. 2 is a schematic diagram of the working process of a vehicle monitoring system provided by an embodiment of the present invention
  • Fig. 3 is a schematic diagram of a camera coverage scenario for a parking lot provided by an embodiment of the present invention.
  • FIG. 4 is a flowchart of a vehicle monitoring method provided by an embodiment of the present invention.
  • FIG. 5 is a flowchart of another vehicle monitoring method provided by an embodiment of the present invention.
  • FIG. 6 is a schematic diagram of the composition of another vehicle monitoring system provided by an embodiment of the present invention.
  • FIG. 7 is a flowchart of another vehicle monitoring method provided by an embodiment of the present invention.
  • FIG. 8 is a schematic diagram of a principle of identifying a vehicle contact phenomenon according to an embodiment of the present invention.
  • FIG. 9 is a flowchart of another vehicle monitoring method provided by an embodiment of the present invention.
  • FIG. 10 is a schematic structural diagram of a vehicle monitoring device provided by an embodiment of the present invention.
  • FIG. 11 is a schematic structural diagram of electronic equipment corresponding to the vehicle monitoring device provided by the embodiment shown in FIG. 10;
  • FIG. 12 is a schematic structural diagram of another vehicle monitoring device provided by an embodiment of the present invention.
  • FIG. 13 is a schematic structural diagram of an electronic device corresponding to the vehicle monitoring device provided in the embodiment shown in FIG. 12.
  • the words “if” and “if” as used herein can be interpreted as “when” or “when” or “in response to determination” or “in response to detection”.
  • the phrase “if determined” or “if detected (statement or event)” can be interpreted as “when determined” or “in response to determination” or “when detected (statement or event) )” or “in response to detection (statement or event)”.
  • FIG. 1 is a schematic diagram of the composition of a vehicle monitoring system provided by an embodiment of the present invention. As shown in Figure 1, the vehicle monitoring system includes:
  • a server corresponding to the first barrier in the direction of entry, a first camera deployed at the first barrier for shooting entering vehicles, and the shooting range at least covers the second camera with a preset range at the first barrier, and A third camera covering multiple parking spaces.
  • the above-mentioned server may be a server deployed locally in the parking lot, or a server located in the cloud, or both.
  • the local server can be used to receive information sent by locally deployed devices, such as cameras, and send the received information to a server in the cloud for processing.
  • the overall shooting range of the second camera and the multiple third cameras covers the parking lot.
  • the above-mentioned parking lot may be an outdoor parking lot.
  • some indoor parking lots may also be applicable.
  • This embodiment mainly introduces the scene of guiding the vehicle to enter the parking lot.
  • the first camera used to take pictures of entering vehicles is deployed at the first barrier at the entrance of the parking lot.
  • the first camera may have a communication module to realize a communication connection with the server.
  • one or more cameras that can monitor the entire parking lot are also deployed, that is, the second camera and the third camera described above.
  • a higher support pole can be erected at a suitable position in the parking lot, and a camera can be placed on the support pole to form the above-mentioned second camera or third camera.
  • the combination of the second camera and the third camera Adjusting the angle of the field of view can enable the second camera and the third camera to have a wider shooting range, such as covering multiple parking spaces. In this way, in fact, it is generally only necessary to deploy cameras far less than the number of parking spaces at high altitudes to form full coverage of the parking lot.
  • the aforementioned third camera may not exist in the parking lot, that is, only the first camera and the second camera are deployed. For example, if the parking lot is very small, or the shooting range of the second camera covers the entire parking lot, the third camera does not need to be deployed at this time. In addition, it is also possible to deploy only one third camera. In this case, one second camera and one third camera can achieve full coverage of the parking lot.
  • a second camera can be deployed (of course, more than one second camera can also be deployed) to cover at least the preset range outside the first barrier.
  • the second camera covers the preset Outside the scope, it can also cover multiple parking spaces or other areas in the parking lot.
  • the reason for deploying a second camera covering the preset range at the first barrier is to lock the vehicle at the entrance when a vehicle intends to enter the parking lot.
  • the locking of a vehicle means that when a vehicle enters the field of view of the second camera, the second camera can identify the vehicle in the captured image and associate the vehicle with a unique identifier—the license plate number.
  • a solution is provided to assist the second camera to obtain the license plate number of the vehicle through the first camera at the first barrier.
  • the roles of the first camera, the second camera, the third camera, and the server in the parking guidance process may be:
  • the first camera is used to detect the license plate number of the approaching vehicle in the collected images and send the license plate number to the server.
  • the server is configured to send a first notification message containing the license plate number to the second camera, and determine the parking space recommendation information according to the respective images currently collected by the second camera and the multiple third cameras, and notify the parking space recommendation information to the vehicle.
  • the second camera is used to respond to the first notification message to detect a vehicle located at the first barrier in the collected image, associate the vehicle with the license plate number, and track the vehicle.
  • the third camera is used to track the vehicle according to a predetermined homography matrix between cameras.
  • the second camera and the third camera are also used to send a second notification message to the server if it is detected that the vehicle has stopped at the target parking space.
  • the second notification message includes the license plate number and the identification of the target parking space.
  • FIG. 2 is a schematic diagram of the working process of a vehicle monitoring system provided by an embodiment of the present invention. As shown in FIG. 2, it may include the following steps:
  • the first camera detects the license plate number of the approaching vehicle in the collected image.
  • the first camera sends the recognized license plate number to the server.
  • the first camera continues to capture images, and detects whether there is a vehicle that wants to enter the parking lot in the currently captured image. When it detects that there is an entering vehicle in the captured image, it further identifies the entry of the vehicle. number plate.
  • the method of vehicle and license plate number recognition can adopt the method in the prior art.
  • the license plate number of the entering vehicle is recognized, the license plate number is sent to the server.
  • the server sends a first notification message containing the license plate number of the vehicle to the second camera.
  • the server controls the opening of the first barrier.
  • the server determines the parking space recommendation information according to the images currently collected by the second camera and the multiple third cameras, and notifies the parking space recommendation information to the vehicle.
  • the server After the server receives the license plate number sent by the first camera, on the one hand, it sends the first notification message containing the license plate number to the second camera. On the other hand, it can control the opening of the first barrier to allow the vehicle to enter. On the one hand, in order to realize parking guidance for the entering vehicle, the server also needs to determine the free parking space in the current parking lot, so as to provide parking space recommendation information for the entering vehicle.
  • the determination of the parking space recommendation information can be achieved in the following ways:
  • the homography matrix between the cameras splice the images collected by the second camera and multiple third cameras at the same time, determine the free parking space from the spliced images, and determine the parking space recommendation information according to the free parking space .
  • the second camera and the multiple third cameras often have a certain overlap area between the two adjacent cameras, such as the second camera shown in Figure 3 (Indicated by camera A) and a third camera (indicated by camera B), the respective shooting ranges have overlapping areas.
  • the index for measuring the overlap area between cameras can be a homography matrix. Therefore, after the cameras are initially deployed, the homography matrix between the cameras can be calibrated.
  • the method of homography matrix calibration can adopt the method of the prior art. It is only emphasized here that when camera A and camera B have overlapping areas, taking camera A as an example, camera B and the homography matrix corresponding to camera B can be recorded in camera A and the server that have overlapping areas.
  • the server After the server obtains the images captured by camera A and camera B at the current moment, it learns the homography matrix between camera A and camera B according to the above-mentioned records.
  • the matrix can realize the stitching of the images taken by the two cameras. Specifically, the image captured by camera A can be projected onto the image captured by camera B through the homography matrix to complete the image stitching.
  • the result of image splicing is the global image of the current parking lot, from which the server can identify free parking spaces. Specifically, the server only needs to identify whether there are vehicle characteristics in the image area corresponding to each parking space from the stitched image to realize the identification of the idle parking space.
  • the server can filter out the parking spaces closest to the currently entering vehicle from the free parking spaces, and generate parking space recommendation information corresponding to the selected parking spaces.
  • the parking space recommendation information may be, for example, how many vacancies are in a certain area, etc.
  • the server notifies the parking space recommendation information to the vehicle, it actually notifies the user corresponding to the vehicle, namely the driver.
  • the vehicle monitoring system may further include: at least one guide screen, so that the server may display parking space recommendation information through the at least one guide screen, so as to implement parking guidance for the user.
  • the vehicle can be guided to a certain free parking space by controlling the guide light on the path to a certain free parking space to flash or keep on.
  • the parking space recommendation information can also be sent to the user's terminal device (such as a mobile phone) or a vehicle-mounted terminal.
  • the parking space recommendation information can also be sent to the prompt terminal allocated to the user when the user enters the parking lot.
  • the user information and the license plate number can be uploaded to the server together, so that the server can establish the corresponding relationship between the license plate number and the user information.
  • the second camera In response to the first notification message, the second camera detects a vehicle located at the first barrier in the collected image, associates the vehicle with the license plate number in the first notification message, and tracks the vehicle.
  • the third camera obtains the license plate number of the vehicle from the second camera according to the homography matrix between the second camera and the collected image Middle is the vehicle's license plate number, and the vehicle is tracked.
  • the third camera determines the homography matrix corresponding to the vehicle based on the locally stored homography matrix (for example, the homography matrix with the second camera) and the first coordinate of the vehicle in the local coordinate system.
  • Another camera ie, the second camera
  • the third camera detects that the vehicle has parked at the target parking space, it sends a second notification message to the server.
  • the second notification message includes the license plate number of the vehicle and the target parking space identifier.
  • the third camera finds that the vehicle has entered a certain parking space in the process of tracking the above-mentioned vehicle, and this parking space is called the target parking space. Then the third camera and the identification of the target parking space The license plate number of the vehicle is sent to the server.
  • the second camera and the third camera are deployed, their shooting range is fixed.
  • the third camera can be turned on to collect an image.
  • the image contains each parking space within the shooting range of the third camera ,
  • the position coordinates of each parking space in the image can be determined, and the corresponding parking space identifier can be associated with each position coordinate, so that the third camera knows the position of each parking space within its coverage. Based on this, the third camera can learn the identification of the target parking space where the vehicle is parked.
  • the server generates a parking record, and the parking record includes a license plate number, a target parking spot identifier, and a parking start time.
  • the parking start time may be the time when the server generates the parking record.
  • the parking record can be used to calculate parking fees when the vehicle leaves the parking lot.
  • the server can recommend parking space information for the vehicle when it enters the parking lot.
  • the recommendation result at this time is obtained based on the current parking space availability in the parking lot.
  • a certain parking space a is recommended for the vehicle at time T1
  • T2 a short time later
  • other vehicles in the parking lot leave another parking space b, and the parking space b
  • the server can update the parking space recommendation information sent to the vehicle and recommend parking space b to the vehicle.
  • the server performs splicing according to the images collected by the second camera and each third camera at time T2, and determines the free parking space b in the spliced images.
  • the server recommends parking spaces for incoming vehicles.
  • the vehicle monitoring system may include:
  • the server corresponding to the barrier gate in the direction of entry (that is, the first barrier in the previous article), is deployed at the barrier gate to capture the first camera of the entering vehicle, and the shooting range covers multiple second cameras in the parking lot.
  • the shooting range of at least one second camera among the plurality of second cameras covers a preset range at the barrier, and adjacent second cameras have overlapping areas.
  • the camera whose shooting range does not cover the preset range outside the barrier gate among the plurality of second cameras is the third camera in the foregoing embodiment.
  • the first camera is used to detect the license plate number of the entering vehicle in the collected images and send the license plate number to the server.
  • the server is configured to send a first notification message containing the license plate number to the at least one second camera, so that the at least one second camera detects an entering vehicle in the collected images, and associates the license plate with the entering vehicle number.
  • a plurality of second cameras are used to track the entering vehicle, and when it is detected that the entering vehicle has stopped at the target parking space, a second notification message is sent to the server.
  • the second notification message includes the license plate number and the target parking space Bit identification.
  • FIG. 4 is a flowchart of a vehicle monitoring method provided by an embodiment of the present invention, which may be executed by the server in the foregoing embodiment. As shown in FIG. 4, the method may include the following steps:
  • FIG. 5 is a flowchart of another vehicle monitoring method provided by an embodiment of the present invention, which may be executed by the server in the foregoing embodiment. As shown in FIG. 5, the method may include the following steps:
  • the server can determine the parking space recommendation information according to the following methods: according to the homography matrix between the cameras, splicing the images collected by the second camera and the third camera at the same time; determining the free ones from the spliced images Parking space; according to the free parking space to determine the recommended parking space.
  • the server can notify the parking space recommendation information to the incoming vehicle in the following manner:
  • the parking space recommendation information is displayed through at least one guide screen, or the parking space recommendation information is sent to the user terminal corresponding to the entering vehicle.
  • the server sends the aforementioned parking space recommendation information to the entering vehicle, if at a certain time, it can determine the free parking space closer to the entering vehicle from the stitched image corresponding to that time. Then the parking space recommendation information is updated according to the closer free parking space, and the updated parking space recommendation information is sent to the incoming vehicle.
  • the user may send a vehicle query request to the server through the query device, assuming that the vehicle query request includes the license plate number of the vehicle that has entered in the foregoing.
  • the server determines the identifier of the target parking space corresponding to the license plate number, and outputs the identifier of the target parking space or the navigation route to the target parking space to the query device.
  • the server records the correspondence between the license plate number of the vehicle and the target parking space. Based on this, the server can query and obtain the identification of the target parking space.
  • the vehicle monitoring system may also include a query device.
  • the aforementioned query device may be a terminal device of a user corresponding to the vehicle, or may also be a terminal device deployed in a parking lot.
  • the user can install the client provided by the parking lot in his mobile phone, or there is a startup item of a small program provided by the parking lot in the mobile phone, so that he can enter his license plate number in the client or the small program To query the location of his vehicle.
  • a public query terminal may be provided in the parking lot, and each user may enter his license plate number in the query terminal to query the location of his vehicle.
  • the starting point of the above-mentioned navigation route is determined according to the positioning information of the user's terminal device.
  • the positioning information can be obtained through the positioning module (such as a GPS module) in the user's terminal device. .
  • the current location of the user is included in the query request.
  • the starting point of the navigation route is the location of the public query terminal device.
  • the server may pre-store the location information, or the location information may be based on the public query in advance. Obtained by a positioning module (such as a GPS module) deployed at the terminal device.
  • a positioning module such as a GPS module deployed at the terminal device.
  • the location information of the public query terminal device may also be determined based on the analysis of the collected images of the public query terminal device.
  • the navigation route can be sent to the public query device, and for the convenience of the user, the navigation route can also be sent to the user’s In the terminal equipment.
  • the identification information of the user’s terminal equipment can be a mobile phone number, etc., when the user drives into the parking lot, the corresponding relationship between the user’s terminal equipment identification and the license plate number can be obtained, thus, based on the user’s terminal equipment identification that has been obtained, The navigation route is sent to the user's terminal device.
  • the server when the parking lot is a paid parking lot, the server also needs to calculate the parking fee. Specifically, the server determines the parking fee according to the parking duration of the vehicle, sends the parking fee to the query device for the user to pay the fee, and when the user completes the payment of the parking fee, the payment completion mark can be associated with the license plate number.
  • the vehicle monitoring system further includes: a second barrier corresponding to the driving direction and a fourth camera deployed at the second barrier for photographing the exiting vehicle.
  • the fourth camera detects the license plate number of the driving out vehicle in the collected image, it sends the detected license plate number to the server.
  • the server determines that the license plate number has been associated with a payment completion mark, it controls the second barrier to open so that the vehicle can drive out.
  • FIG. 7 is a flowchart of another vehicle monitoring method provided by an embodiment of the present invention, which may be executed by the server in the foregoing embodiment.
  • the query processing logic shown in FIG. 7 may also be included, which may specifically include the following step:
  • the payment completion mark is associated with the license plate number.
  • the fourth camera is a camera deployed at the second barrier in the exit direction, and the fourth camera detects the license plate number of the entering vehicle in the collected images.
  • the query device is a terminal device of a user corresponding to the entering vehicle, or the query device is a terminal device deployed in a parking lot.
  • the above describes the parking guidance and driving-off process of the vehicle based on the above-mentioned vehicle monitoring system. Based on the vehicle monitoring system, other behaviors of vehicles in the parking lot can also be recorded and identified. Since the second camera and the third camera continue to work, a global monitoring screen of the parking lot can be formed to record various behaviors of the vehicle.
  • the server may also find that two cars are in contact in the parking lot, which often indicates that the two cars have collided or struck each other.
  • the means to determine whether two vehicles are in contact are as follows:
  • the ratio of the intersection area of the image areas corresponding to the two vehicles to the union area of the image areas corresponding to the two vehicles is greater than the preset value.
  • the target camera is any one of the aforementioned second camera and third camera.
  • FIG. 9 is a flowchart of another vehicle monitoring method provided by an embodiment of the present invention, which may be executed by the server in the foregoing embodiment. As shown in FIG. 9, it may specifically include the following steps:
  • the server can also execute processing procedures such as parking space recommendation and vehicle parking space query similar to those in the foregoing embodiment.
  • processing procedures such as parking space recommendation and vehicle parking space query similar to those in the foregoing embodiment.
  • vehicle monitoring device of one or more embodiments of the present invention will be described in detail below. Those skilled in the art can understand that these vehicle monitoring devices can all be configured using commercially available hardware components through the steps taught in this solution.
  • FIG. 10 is a schematic structural diagram of a vehicle monitoring device provided by an embodiment of the present invention. As shown in FIG. 10, the device includes: a receiving module 11 and a sending module 12.
  • the receiving module 11 is configured to receive the license plate number of the entering vehicle sent by the first camera, the first camera being deployed at the first barrier in the entering direction of the parking lot.
  • the sending module 12 is configured to send a first notification message containing the license plate number to a second camera, so that after the second camera detects the entering vehicle in the collected images, it associates the entering vehicle with The above license plate number; the shooting range of the second camera at least covers the preset range outside the first barrier.
  • the receiving module 11 is also configured to receive a second notification message sent by the second camera or the third camera, and the second notification message includes the license plate number and the information of the target parking space where the incoming vehicle stops. Identification; wherein the shooting range of the third camera covers multiple parking spaces, and the second camera and the third camera track the entering vehicle to determine the identification of the target parking space.
  • the device may further include: a processing module, configured to determine parking space recommendation information according to the images currently collected by the second camera and the third camera; Position recommendation information is notified to the incoming vehicle.
  • a processing module configured to determine parking space recommendation information according to the images currently collected by the second camera and the third camera; Position recommendation information is notified to the incoming vehicle.
  • the processing module may be specifically used to display the parking space recommendation information through at least one guide screen, or through the sending module 12 Send the parking space recommendation information to the user terminal corresponding to the entering vehicle.
  • the processing module may determine the parking space recommendation information in the following manner: according to the homography matrix between the cameras, stitching the images collected by the second camera and the third camera at the same time; Determine free parking spaces from the stitched images; determine the parking space recommendation information according to the free parking spaces.
  • the processing module may be further configured to: for a time after the parking space recommendation information is notified to the vehicle, if the distance to the driving distance is determined from the stitched image corresponding to the time When entering a free parking space that is closer to the vehicle, the parking space recommendation information is updated according to the more recent free parking space.
  • the receiving module 11 is further configured to receive a vehicle query request sent by the query device, and the vehicle query request includes the license plate number.
  • the processing module is also used to determine the identifier of the target parking space corresponding to the license plate number, and output the identifier of the target parking space to the query device through the sending module 12 or to go to the target parking Bit navigation route.
  • the query device is a terminal device of the user corresponding to the entering vehicle, or the query device is a terminal device deployed in the parking lot.
  • the processing module is further configured to determine the parking fee according to the parking duration of the entering vehicle, and send the parking fee to the query device through the sending module 12 for fee payment, if completed The payment of the parking fee is associated with the payment completion mark on the license plate number.
  • the receiving module 11 is further configured to: receive the license plate number sent by a fourth camera, the fourth camera being a camera deployed at the second barrier in the exit direction, and the fourth camera is collecting The license plate number of the entering vehicle is detected in the image.
  • the processing module is further configured to control the opening of the second barrier when it is determined that the license plate number has been associated with a payment completion mark.
  • the processing module is further configured to: acquire an image collected by a target camera, and if there are two vehicles in the image that meet the following conditions, determine that the two vehicles are in contact:
  • the ratio of the intersection area of the image areas corresponding to the two vehicles to the union area of the image areas corresponding to the two vehicles is greater than a preset value; the target cameras are the second camera and the third camera. Any one of the cameras.
  • the device shown in FIG. 10 can execute each step executed by the server in the foregoing embodiment.
  • the detailed execution process and technical effects please refer to the description in the foregoing embodiment, and will not be repeated here.
  • the structure of the communication device shown in FIG. 10 may be implemented as an electronic device, and the electronic device may be a server.
  • the electronic device may include: a first processor 21, a first Storage 22.
  • executable code is stored on the first memory 22, and when the executable code is executed by the first processor 21, the first processor 21 can at least implement the execution of the server in the foregoing embodiment The various steps.
  • the electronic device may further include: a first communication interface 23 for communicating with other devices.
  • an embodiment of the present invention provides a non-transitory machine-readable storage medium having executable code stored on the non-transitory machine-readable storage medium, and when the executable code is executed by the processor of the above electronic device At this time, the processor can at least implement the steps executed by the above server.
  • FIG. 12 is a schematic structural diagram of another vehicle monitoring device provided by an embodiment of the present invention. As shown in FIG. 12, the device includes: a receiving module 31 and a sending module 32.
  • the receiving module 31 is configured to receive the license plate number of the entering vehicle sent by the first camera, and the first camera is deployed at a barrier in the entering direction of the parking lot.
  • the sending module 32 is configured to send a first notification message containing the license plate number to a second camera, so that after the second camera detects the entering vehicle in the collected images, it associates the entering vehicle with The license plate number above; the shooting range of the second camera covers the preset range outside the barrier and each parking space in the parking lot.
  • the receiving module 31 is further configured to receive a second notification message sent by the second camera, the second notification message including the license plate number and the identification of the target parking space where the incoming vehicle parks, wherein: The second camera tracks the entering vehicle to determine the identity of the target parking space.
  • the device shown in FIG. 12 can execute the steps executed by the server in the embodiment shown in FIG. 9.
  • For the detailed execution process please refer to the description in the foregoing embodiment, which will not be repeated here.
  • the structure of the communication device shown in FIG. 12 may be implemented as an electronic device, and the electronic device may be a server.
  • the electronic device may include: a second processor 41, a second Storage 42.
  • executable code is stored on the second memory 42, and when the executable code is executed by the second processor 41, the second processor 41 can at least implement the embodiment shown in FIG. 9 The various steps performed by the server.
  • the electronic device may further include: a second communication interface 43 for communicating with other devices.
  • the vehicle monitoring method provided by the embodiments of the present invention can be executed by one or more programs/software, and the program/software can be provided by the network side.
  • the cameras and servers mentioned in the foregoing embodiments can install the required programs/software.
  • the software is downloaded to the local non-volatile storage medium, and when it needs to execute the aforementioned vehicle monitoring solution, the required program/software is read into the memory through the CPU, and then the program/software is executed by the CPU to realize the aforementioned
  • the implementation process of the vehicle monitoring solution provided in the embodiment refer to the description in the foregoing vehicle monitoring system embodiment and the vehicle monitoring method embodiment shown in FIG. 2, FIG. 4, FIG. 5, FIG. 7, and FIG. 9.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • Finance (AREA)
  • Engineering & Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Traffic Control Systems (AREA)

Abstract

A vehicle monitoring method, apparatus, device and system. The system comprises: a server, a first camera at an entrance, a second camera having a photographing range covering at least a first barrier gate, and a third camera having a photographing range covering a plurality of parking spaces. The first camera detects, in an acquired image, a license plate number of an incoming vehicle, and sends the license plate number to the server. The server sends a first notification message containing the license plate number to the second camera, determines parking space recommendation information according to images acquired by the second camera and the third camera, and notifies the vehicle of the parking space recommendation information. The second camera detects, from the acquired images, the vehicle located at the first barrier gate, and associates the license plate number with the vehicle and tracks the vehicle. The third camera tracks the vehicle according to the homography matrix between cameras. If the camera detects that the vehicle is stopped at a target parking space, a second notification message indicating a parking position of the vehicle is sent to the server to guide the parking of the vehicle.

Description

车辆监控方法、装置、设备和系统Vehicle monitoring method, device, equipment and system
本申请要求2019年04月17日递交的申请号为201910310436.3、发明名称为“车辆监控方法、装置、设备和系统”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application filed on April 17, 2019 with the application number 201910310436.3 and the invention title "Vehicle monitoring method, device, equipment and system", the entire content of which is incorporated into this application by reference.
技术领域Technical field
本发明涉及互联网技术领域,尤其涉及一种车辆监控方法、装置、设备和系统。The present invention relates to the field of Internet technology, and in particular to a vehicle monitoring method, device, equipment and system.
背景技术Background technique
随着人们经济水平的提高,越来越多的人选择了自驾出行的方式,道路上车辆数量的增长速度迅速攀升。伴随而来的问题就是停车问题,为了满足人们的停车需求,各种室内、室外停车场被建立。With the improvement of people's economic level, more and more people choose to travel by car, and the growth rate of the number of vehicles on the road is rapidly increasing. The accompanying problem is parking. In order to meet people's parking needs, various indoor and outdoor parking lots have been established.
为了满足广大民众的停车需求,停车场中会设置很多的停车位。目前,为便于用户停车,会在每个停车位上设置诸如红外、超声波、地磁等探测器,以用于探测相应的停车位上是否有车辆停靠,由此,可以引导需要停车的用户去往空闲停车位进行停靠。每个停车位上部署探测器,在成本、布线、数据处理等方面的开销都将很大。In order to meet the parking needs of the general public, many parking spaces will be set up in the parking lot. At present, in order to facilitate users to park, detectors such as infrared, ultrasonic, geomagnetism, etc. are installed in each parking space to detect whether there is a vehicle parked in the corresponding parking space, thereby guiding users who need to park to go to Free parking spaces for parking. Deploying detectors in each parking space will cost a lot in terms of cost, wiring, and data processing.
发明内容Summary of the invention
本发明实施例提供一种车辆监控方法、装置、设备和系统,用以实现对车辆进入停车场的智能管理。The embodiments of the present invention provide a vehicle monitoring method, device, equipment, and system to realize intelligent management of vehicles entering a parking lot.
第一方面,本发明实施例提供一种车辆监控系统,包括:In the first aspect, an embodiment of the present invention provides a vehicle monitoring system, including:
服务器,对应于驶入方向的第一道闸,部署在所述第一道闸处用于拍摄驶入车辆的第一摄像机,拍摄范围至少覆盖所述第一道闸处的预设范围的第二摄像机,以及拍摄范围覆盖多个停车位的第三摄像机;所述第二摄像机和多个所述第三摄像机的整体拍摄范围覆盖停车场;The server, corresponding to the first barrier in the direction of entry, is deployed at the first barrier and used to photograph the first camera of the entering vehicle, and the shooting range covers at least the first of the preset range at the first barrier A second camera, and a third camera whose shooting range covers multiple parking spaces; the overall shooting range of the second camera and the multiple third cameras covers the parking lot;
所述第一摄像机,用于在采集到的图像中检测驶入的车辆的车牌号,并将所述车牌号发送至所述服务器;The first camera is configured to detect the license plate number of the driving-in vehicle in the collected image, and send the license plate number to the server;
所述服务器,用于向所述第二摄像机发送包含所述车牌号的第一通知消息,以及根据所述第二摄像机和多个所述第三摄像机当前各自采集的图像确定出停车位推荐信息,将所述停车位推荐信息通知至所述车辆;The server is configured to send a first notification message containing the license plate number to the second camera, and determine parking space recommendation information according to the current images collected by the second camera and the multiple third cameras , Notify the vehicle of the parking space recommendation information;
所述第二摄像机,用于响应于所述第一通知消息,在采集到的图像中检测出位于所述第一道闸处的所述车辆,为所述车辆关联上所述车牌号,并对所述车辆进行跟踪;The second camera is configured to detect the vehicle located at the first barrier in the collected image in response to the first notification message, associate the license plate number for the vehicle, and Track the vehicle;
所述第三摄像机,用于根据预先确定的摄像机之间的单应性矩阵,对所述车辆进行跟踪;The third camera is configured to track the vehicle according to a predetermined homography matrix between cameras;
所述第二摄像机和所述第三摄像机,还用于若检测到所述车辆停到目标停车位,则向所述服务器发送第二通知消息,所述第二通知消息中包括所述车牌号和所述目标停车位的标识。The second camera and the third camera are further configured to send a second notification message to the server if it is detected that the vehicle has parked in a target parking space, and the second notification message includes the license plate number And the identification of the target parking space.
第二方面,本发明实施例提供一种车辆监控系统,包括:In the second aspect, an embodiment of the present invention provides a vehicle monitoring system, including:
服务器,对应于驶入方向的道闸,部署在所述道闸处用于拍摄驶入车辆的第一摄像机,拍摄范围覆盖停车场的多个第二摄像机,所述多个第二摄像机中的至少一个第二摄像机的拍摄范围覆盖所述道闸处的预设范围,相邻的第二摄像机具有重叠区域;The server, corresponding to the barrier gate in the driving direction, is deployed at the barrier gate and used to photograph the first camera of the entering vehicle, and the shooting range covers multiple second cameras in the parking lot. Among the multiple second cameras The shooting range of at least one second camera covers the preset range at the barrier, and adjacent second cameras have overlapping areas;
所述第一摄像机,用于在采集到的图像中检测驶入车辆的车牌号,并将所述车牌号发送至所述服务器;The first camera is configured to detect the license plate number of the entering vehicle in the collected image, and send the license plate number to the server;
所述服务器,用于向所述至少一个第二摄像机发送包含所述车牌号的第一通知消息,以使所述至少一个第二摄像机在采集的图像中检测出所述驶入车辆,并为所述驶入车辆关联上所述车牌号;The server is configured to send a first notification message containing the license plate number to the at least one second camera, so that the at least one second camera detects the entering vehicle in the collected images, and is The vehicle entering the vehicle is associated with the license plate number;
所述多个第二摄像机,用于对所述驶入车辆进行跟踪,并在检测到所述驶入车辆停到目标停车位时,则向所述服务器发送第二通知消息,所述第二通知消息中包括所述车牌号和所述目标停车位的标识。The multiple second cameras are used to track the entering vehicle, and when detecting that the entering vehicle has stopped at the target parking space, send a second notification message to the server, and the second The notification message includes the license plate number and the identification of the target parking space.
第三方面,本发明实施例提供一种车辆监控方法,应用于服务器,所述方法包括:In a third aspect, an embodiment of the present invention provides a vehicle monitoring method applied to a server, and the method includes:
接收第一摄像机发送的驶入车辆的车牌号,所述第一摄像机部署在停车场的驶入方向的第一道闸处;Receiving the license plate number of the entering vehicle sent by the first camera, the first camera being deployed at the first barrier in the entering direction of the parking lot;
向第二摄像机发送包含所述车牌号的第一通知消息,以使所述第二摄像机在采集的图像中检测出所述驶入车辆后,为所述驶入车辆关联上所述车牌号;所述第二摄像机的拍摄范围至少覆盖所述第一道闸外的预设范围;Sending a first notification message containing the license plate number to a second camera, so that after the second camera detects the entering vehicle in the collected images, it associates the entering vehicle with the license plate number; The shooting range of the second camera at least covers a preset range outside the first barrier;
接收所述第二摄像机或第三摄像机发送的第二通知消息,所述第二通知消息中包括所述车牌号和所述驶入车辆停靠的目标停车位的标识;其中,所述第三摄像机的拍摄范围覆盖多个停车位,所述第二摄像机和所述第三摄像机对所述驶入车辆进行跟踪以确定所述目标停车位的标识。Receive a second notification message sent by the second camera or the third camera, where the second notification message includes the license plate number and the identifier of the target parking space where the incoming vehicle stops; wherein, the third camera The shooting range of covers multiple parking spaces, and the second camera and the third camera track the entering vehicle to determine the identification of the target parking space.
第四方面,本发明实施例提供一种车辆监控装置,包括:In a fourth aspect, an embodiment of the present invention provides a vehicle monitoring device, including:
接收模块,用于接收第一摄像机发送的驶入车辆的车牌号,所述第一摄像机部署在停车场的驶入方向的第一道闸处;A receiving module, configured to receive the license plate number of the entering vehicle sent by the first camera, the first camera being deployed at the first barrier in the entering direction of the parking lot;
发送模块,用于向第二摄像机发送包含所述车牌号的第一通知消息,以使所述第二摄像机在采集的图像中检测出所述驶入车辆后,为所述驶入车辆关联上所述车牌号;所述第二摄像机的拍摄范围至少覆盖所述第一道闸外的预设范围;The sending module is configured to send a first notification message containing the license plate number to a second camera, so that after the second camera detects the entering vehicle in the collected images, it is associated with the entering vehicle The license plate number; the shooting range of the second camera covers at least a preset range outside the first barrier;
所述接收模块,还用于接收所述第二摄像机或第三摄像机发送的第二通知消息,所述第二通知消息中包括所述车牌号和所述驶入车辆停靠的目标停车位的标识;其中,所述第三摄像机的拍摄范围覆盖多个停车位,所述第二摄像机和所述第三摄像机对所述驶入车辆进行跟踪以确定所述目标停车位的标识。The receiving module is further configured to receive a second notification message sent by the second camera or the third camera, where the second notification message includes the license plate number and the identification of the target parking space where the incoming vehicle stops Wherein, the shooting range of the third camera covers multiple parking spaces, and the second camera and the third camera track the entering vehicle to determine the identification of the target parking space.
第五方面,本发明实施例提供一种电子设备,包括:第一存储器、第一处理器;其中,所述第一存储器上存储有可执行代码,当所述可执行代码被所述第一处理器执行时,使所述第一处理器至少可以实现如第三方面所述的车辆监控方法。In a fifth aspect, an embodiment of the present invention provides an electronic device, including: a first memory and a first processor; wherein executable code is stored in the first memory, and when the executable code is When the processor is executed, the first processor can at least implement the vehicle monitoring method described in the third aspect.
本发明实施例提供了一种非暂时性机器可读存储介质,所述非暂时性机器可读存储介质上存储有可执行代码,当所述可执行代码被电子设备的处理器执行时,使所述处理器至少可以实现如第三方面所述的车辆监控方法。The embodiment of the present invention provides a non-transitory machine-readable storage medium having executable code stored on the non-transitory machine-readable storage medium, and when the executable code is executed by a processor of an electronic device, The processor can at least implement the vehicle monitoring method described in the third aspect.
第六方面,本发明实施例提供一种车辆监控方法,应用于服务器,所述方法包括:In a sixth aspect, an embodiment of the present invention provides a vehicle monitoring method applied to a server, and the method includes:
接收第一摄像机发送的驶入车辆的车牌号,所述第一摄像机部署在停车场的驶入方向的道闸处;Receiving the license plate number of the entering vehicle sent by the first camera, the first camera being deployed at the barrier of the entering direction of the parking lot;
向第二摄像机发送包含所述车牌号的第一通知消息,以使所述第二摄像机在采集的图像中检测出所述驶入车辆后,为所述驶入车辆关联上所述车牌号;所述第二摄像机的拍摄范围覆盖所述道闸外的预设范围以及停车场内的各停车位;Sending a first notification message containing the license plate number to a second camera, so that after the second camera detects the entering vehicle in the collected images, it associates the entering vehicle with the license plate number; The shooting range of the second camera covers the preset range outside the barrier and each parking space in the parking lot;
接收所述第二摄像机发送的第二通知消息,所述第二通知消息中包括所述车牌号和所述驶入车辆停靠的目标停车位的标识,其中,所述第二摄像机对所述驶入车辆进行跟踪以确定所述目标停车位的标识。Receive a second notification message sent by the second camera, where the second notification message includes the license plate number and the identification of the target parking space where the incoming vehicle parks, wherein the second camera responds to the driving Enter the vehicle for tracking to determine the identification of the target parking space.
第七方面,本发明实施例提供一种车辆监控装置,包括:In a seventh aspect, an embodiment of the present invention provides a vehicle monitoring device, including:
接收模块,用于接收第一摄像机发送的驶入车辆的车牌号,所述第一摄像机部署在停车场的驶入方向的道闸处;The receiving module is configured to receive the license plate number of the entering vehicle sent by the first camera, the first camera being deployed at the barrier of the entering direction of the parking lot;
发送模块,用于向第二摄像机发送包含所述车牌号的第一通知消息,以使所述第二摄像机在采集的图像中检测出所述驶入车辆后,为所述驶入车辆关联上所述车牌号;所述第二摄像机的拍摄范围覆盖所述道闸外的预设范围以及停车场内的各停车位;The sending module is configured to send a first notification message containing the license plate number to a second camera, so that after the second camera detects the entering vehicle in the collected images, it is associated with the entering vehicle The license plate number; the shooting range of the second camera covers the preset range outside the barrier and each parking space in the parking lot;
所述接收模块,还用于接收所述第二摄像机发送的第二通知消息,所述第二通知消息中包括所述车牌号和所述驶入车辆停靠的目标停车位的标识,其中,所述第二摄像机对所述驶入车辆进行跟踪以确定所述目标停车位的标识。The receiving module is further configured to receive a second notification message sent by the second camera, the second notification message including the license plate number and the identification of the target parking space where the incoming vehicle parks, wherein The second camera tracks the entering vehicle to determine the identification of the target parking space.
第八方面,本发明实施例提供一种电子设备,包括:第二存储器、第二处理器;其中,所述第二存储器上存储有可执行代码,当所述可执行代码被所述第二处理器执行时,使所述第二处理器执行如第六方面所述的车辆监控方法。In an eighth aspect, an embodiment of the present invention provides an electronic device, including: a second memory and a second processor; wherein executable code is stored in the second memory, and when the executable code is When the processor is executed, the second processor is caused to execute the vehicle monitoring method described in the sixth aspect.
由上述方案可知,为实现对车辆在停车场内的停车引导,仅需要在入口的第一道闸处部署检测驶入车辆的第一摄像机以及在高空部署少量的用于监控停车场全局的摄像机(即为上述第二摄像机和第三摄像机)即可。具体地,当第一摄像机检测到有车辆驶入时,在采集的图像中检测出该车辆的车牌号,进而告知服务器。服务器进而通知覆盖第一道闸的第二摄像机对该驶入的车辆进行锁定及跟踪,并且,服务器基于第二摄像机和第三摄像机当前采集的图像,识别得到停车场内当前空闲的停车位,以便为该驶入的车辆推荐停车位,以实现对车辆的停车引导。第二摄像机基于服务器的通知,在当前采集的图像中识别出位于第一道闸处的车辆,该车辆即为当前驶入的车辆,并将第一摄像机识别出的车牌号与自身采集的图像中的该车辆进行关联,从而第二摄像机知道了当前驶入车辆的车牌号。如果该驶入的车辆在第二摄像机的拍摄范围内移动,那么第二摄像机可以实现对该车辆的跟踪,而如果该车辆移出了第二摄像机的拍摄范围而进入到了某个第三摄像机的拍摄范围,那么第三摄像机可以基于与第二摄像机之间的单应性矩阵得到该车辆的车牌号,从而,第三摄像机也可以实现对该车辆在自身拍摄范围内的跟踪。如果某时刻,某个摄像机(可能是第二摄像机也可能是第三摄像机)发现该车辆驶入进了某个停车位,那么该摄像机将该车辆的车牌号与其停靠的停车位标识发送至服务器,从而服务器记录该车辆的停车信息,以便于后续用户查询其车辆所在的位置。It can be seen from the above scheme that in order to realize parking guidance for vehicles in the parking lot, it is only necessary to deploy the first camera to detect entering vehicles at the first gate of the entrance and a small number of cameras to monitor the overall situation of the parking lot at high altitude. (That is, the above-mentioned second camera and third camera). Specifically, when the first camera detects that a vehicle has entered, it detects the license plate number of the vehicle in the collected images, and then informs the server. The server further informs the second camera covering the first barrier to lock and track the incoming vehicle, and the server recognizes the currently free parking spaces in the parking lot based on the images currently collected by the second camera and the third camera, In order to recommend a parking space for the entering vehicle to realize parking guidance for the vehicle. Based on the notification from the server, the second camera recognizes the vehicle at the first barrier in the currently captured image, which is the current vehicle, and compares the license plate number recognized by the first camera with the image captured by itself The vehicle in the link is associated, so that the second camera knows the license plate number of the currently entering vehicle. If the incoming vehicle moves within the shooting range of the second camera, the second camera can track the vehicle, and if the vehicle moves out of the shooting range of the second camera and enters the shooting range of a third camera Range, then the third camera can obtain the license plate number of the vehicle based on the homography matrix between the third camera and the second camera, so that the third camera can also track the vehicle within its own shooting range. If at a certain moment, a camera (may be the second camera or the third camera) finds that the vehicle has entered a certain parking space, then the camera sends the vehicle's license plate number and the parking space identification to the server , So that the server records the parking information of the vehicle, so that subsequent users can query the location of the vehicle.
综上,在本发明实施例中,仅需部署少量的几个拍摄范围较广(至少可以覆盖多个停车位)的摄像机即可实现对车辆的停车引导、车辆跟踪、停车位置记录等功能,实现简单、成本低廉。In summary, in the embodiment of the present invention, only a few cameras with a wide shooting range (at least covering multiple parking spaces) need to be deployed to realize the functions of parking guidance, vehicle tracking, and parking position recording of the vehicle. Simple to implement and low cost.
附图说明Description of the drawings
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作一简单地介绍,显而易见地,下面描述中的附图是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可 以根据这些附图获得其他的附图。In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the following will briefly introduce the drawings used in the description of the embodiments or the prior art. Obviously, the drawings in the following description These are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work.
图1为本发明实施例提供的一种车辆监控系统的组成示意图;FIG. 1 is a schematic diagram of the composition of a vehicle monitoring system provided by an embodiment of the present invention;
图2为本发明实施例提供的一种车辆监控系统的工作过程的示意图;2 is a schematic diagram of the working process of a vehicle monitoring system provided by an embodiment of the present invention;
图3为本发明实施例提供的一种摄像机对停车场的覆盖场景的示意图;Fig. 3 is a schematic diagram of a camera coverage scenario for a parking lot provided by an embodiment of the present invention;
图4为本发明实施例提供的一种车辆监控方法的流程图;4 is a flowchart of a vehicle monitoring method provided by an embodiment of the present invention;
图5为本发明实施例提供的另一种车辆监控方法的流程图;Figure 5 is a flowchart of another vehicle monitoring method provided by an embodiment of the present invention;
图6为本发明实施例提供的另一种车辆监控系统的组成示意图;6 is a schematic diagram of the composition of another vehicle monitoring system provided by an embodiment of the present invention;
图7为本发明实施例提供的又一种车辆监控方法的流程图;FIG. 7 is a flowchart of another vehicle monitoring method provided by an embodiment of the present invention;
图8为本发明实施例提供的一种车辆接触现象识别的原理示意图;FIG. 8 is a schematic diagram of a principle of identifying a vehicle contact phenomenon according to an embodiment of the present invention;
图9为本发明实施例提供的再一种车辆监控方法的流程图;FIG. 9 is a flowchart of another vehicle monitoring method provided by an embodiment of the present invention;
图10为本发明实施例提供的一种车辆监控装置的结构示意图;10 is a schematic structural diagram of a vehicle monitoring device provided by an embodiment of the present invention;
图11为与图10所示实施例提供的车辆监控装置对应的电子设备的结构示意图;FIG. 11 is a schematic structural diagram of electronic equipment corresponding to the vehicle monitoring device provided by the embodiment shown in FIG. 10;
图12为本发明实施例提供的另一种车辆监控装置的结构示意图;FIG. 12 is a schematic structural diagram of another vehicle monitoring device provided by an embodiment of the present invention;
图13为与图12所示实施例提供的车辆监控装置对应的电子设备的结构示意图。FIG. 13 is a schematic structural diagram of an electronic device corresponding to the vehicle monitoring device provided in the embodiment shown in FIG. 12.
具体实施方式detailed description
为使本发明实施例的目的、技术方案和优点更加清楚,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。In order to make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be described clearly and completely in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of the embodiments of the present invention, not all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.
在本发明实施例中使用的术语是仅仅出于描述特定实施例的目的,而非旨在限制本发明。在本发明实施例和所附权利要求书中所使用的单数形式的“一种”、“所述”和“该”也旨在包括多数形式,除非上下文清楚地表示其他含义,“多种”一般包含至少两种。The terms used in the embodiments of the present invention are only for the purpose of describing specific embodiments, and are not intended to limit the present invention. The singular forms of "a", "said" and "the" used in the embodiments of the present invention and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings, "multiple" Generally contains at least two.
取决于语境,如在此所使用的词语“如果”、“若”可以被解释成为“在……时”或“当……时”或“响应于确定”或“响应于检测”。类似地,取决于语境,短语“如果确定”或“如果检测(陈述的条件或事件)”可以被解释成为“当确定时”或“响应于确定”或“当检测(陈述的条件或事件)时”或“响应于检测(陈述的条件或事件)”。Depending on the context, the words "if" and "if" as used herein can be interpreted as "when" or "when" or "in response to determination" or "in response to detection". Similarly, depending on the context, the phrase "if determined" or "if detected (statement or event)" can be interpreted as "when determined" or "in response to determination" or "when detected (statement or event) )" or "in response to detection (statement or event)".
还需要说明的是,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性 的包含,从而使得包括一系列要素的商品或者系统不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种商品或者系统所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括所述要素的商品或者系统中还存在另外的相同要素。It should also be noted that the terms "include", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a commodity or system that includes a series of elements not only includes those elements, but also includes those elements that are not explicitly listed. Other elements of, or also include elements inherent to this commodity or system. If there are no more restrictions, the element defined by the sentence "includes a..." does not exclude the existence of other identical elements in the commodity or system that includes the element.
另外,下述各方法实施例中的步骤时序仅为一种举例,而非严格限定。In addition, the sequence of steps in the following method embodiments is only an example, and is not strictly limited.
图1为本发明实施例提供的一种车辆监控系统的组成示意图,如图1所示,该车辆监控系统包括:Figure 1 is a schematic diagram of the composition of a vehicle monitoring system provided by an embodiment of the present invention. As shown in Figure 1, the vehicle monitoring system includes:
服务器,对应于驶入方向的第一道闸,部署在第一道闸处用于拍摄驶入车辆的第一摄像机,拍摄范围至少覆盖第一道闸处的预设范围的第二摄像机,以及拍摄范围覆盖多个停车位的第三摄像机。A server, corresponding to the first barrier in the direction of entry, a first camera deployed at the first barrier for shooting entering vehicles, and the shooting range at least covers the second camera with a preset range at the first barrier, and A third camera covering multiple parking spaces.
其中,上述服务器可以是部署在停车场本地的服务器,也可以是位于云端的服务器,或者二者兼而有之。当二者兼而有之时,可选地,本地的服务器可以用于接收本地部署的设备比如摄像机等设备发送的信息,并将接收到的信息发送至云端的服务器进行处理。Among them, the above-mentioned server may be a server deployed locally in the parking lot, or a server located in the cloud, or both. When both are used, optionally, the local server can be used to receive information sent by locally deployed devices, such as cameras, and send the received information to a server in the cloud for processing.
实际上,第二摄像机和多个第三摄像机的整体拍摄范围覆盖停车场。In fact, the overall shooting range of the second camera and the multiple third cameras covers the parking lot.
本实施例中,上述停车场可以是室外停车场,当然,一些室内停车场亦可以适用。In this embodiment, the above-mentioned parking lot may be an outdoor parking lot. Of course, some indoor parking lots may also be applicable.
本实施例中主要介绍的是引导车辆进入停车场停车的场景。This embodiment mainly introduces the scene of guiding the vehicle to enter the parking lot.
为实现对车辆的停车引导功能,在停车场入口位置的第一道闸处,部署用于拍摄驶入车辆的第一摄像机。该第一摄像机可以具有通信模块,以实现与服务器的通信连接。In order to realize the parking guidance function for vehicles, the first camera used to take pictures of entering vehicles is deployed at the first barrier at the entrance of the parking lot. The first camera may have a communication module to realize a communication connection with the server.
除了第一摄像机外,在停车场内的合适位置处,还部署可以监控停车场全局的一个或多个摄像机,即为上述第二摄像机和第三摄像机。In addition to the first camera, at a suitable location in the parking lot, one or more cameras that can monitor the entire parking lot are also deployed, that is, the second camera and the third camera described above.
在室外停车场的场景中,可以在停车场的合适位置竖立较高的支撑杆,在支撑杆上安放摄像机以形成上述第二摄像机或第三摄像机,另外,结合对第二摄像机、第三摄像机的视场角度的调整,可以使得第二摄像机、第三摄像机具有较广的拍摄范围,比如可以覆盖多个停车位。这样,实际上,一般仅需在高空位置部署远远小于停车位数量的摄像机即可对停车场形成全覆盖。In the outdoor parking lot scene, a higher support pole can be erected at a suitable position in the parking lot, and a camera can be placed on the support pole to form the above-mentioned second camera or third camera. In addition, the combination of the second camera and the third camera Adjusting the angle of the field of view can enable the second camera and the third camera to have a wider shooting range, such as covering multiple parking spaces. In this way, in fact, it is generally only necessary to deploy cameras far less than the number of parking spaces at high altitudes to form full coverage of the parking lot.
也就是说,在本发明实施例中,除了部署在停车场的道闸处的摄像机外,其他覆盖停车场内场景的摄像机比如第二摄像机、第三摄像机的部署位置均较高,远高于道闸处部署的摄像机比如第一摄像机。That is to say, in the embodiment of the present invention, in addition to the cameras deployed at the barriers of the parking lot, other cameras covering scenes in the parking lot, such as the second camera and the third camera, are deployed at higher positions, much higher than The cameras deployed at the barriers are like the first camera.
值得说明的是,在一种特殊情形下,停车场内可能不存在上述第三摄像机,即仅部署第一摄像机和第二摄像机。比如如果停车场很小,或者,第二摄像机的拍摄范围即覆 盖了整个停车场,此时,可以不用部署第三摄像机。另外,也可能仅部署一个第三摄像机,此时,一个第二摄像机和一个第三摄像机即可实现对停车场的全覆盖。It is worth noting that in a special situation, the aforementioned third camera may not exist in the parking lot, that is, only the first camera and the second camera are deployed. For example, if the parking lot is very small, or the shooting range of the second camera covers the entire parking lot, the third camera does not need to be deployed at this time. In addition, it is also possible to deploy only one third camera. In this case, one second camera and one third camera can achieve full coverage of the parking lot.
在较为普遍的应用场景下,可以部署一个第二摄像机(当然,也可以部署不止一个第二摄像机),以至少覆盖第一道闸外预设范围,当然,该第二摄像机除了覆盖该预设范围外,还可以覆盖多个停车位或停车场内的其他区域。之所以部署一个覆盖第一道闸处预设范围的第二摄像机,是为了在一车辆意欲驶入停车场内时,在入口处即能够实现对该车辆的锁定。In a more common application scenario, a second camera can be deployed (of course, more than one second camera can also be deployed) to cover at least the preset range outside the first barrier. Of course, the second camera covers the preset Outside the scope, it can also cover multiple parking spaces or other areas in the parking lot. The reason for deploying a second camera covering the preset range at the first barrier is to lock the vehicle at the entrance when a vehicle intends to enter the parking lot.
对车辆的锁定,是指当某车辆进入第二摄像机的视野内时,第二摄像机能够在拍得的图像中识别出该车辆,并为该车辆关联上唯一标识——车牌号。The locking of a vehicle means that when a vehicle enters the field of view of the second camera, the second camera can identify the vehicle in the captured image and associate the vehicle with a unique identifier—the license plate number.
但是,由于第二摄像机的部署位置较高,且拍摄范围较大,因此,如果在第二摄像机采集到的图像中进行当前驶入车辆的车牌号的识别,难度较大。为此,提供了通过第一道闸处的第一摄像机来辅助第二摄像机获得该车辆的车牌号的方案。However, because the second camera has a high deployment position and a large shooting range, it is more difficult to identify the license plate number of the currently approaching vehicle in the image collected by the second camera. To this end, a solution is provided to assist the second camera to obtain the license plate number of the vehicle through the first camera at the first barrier.
在一可选实施例中,第一摄像机、第二摄像机、第三摄像机以及服务器在停车引导过程中的作用可以是:In an optional embodiment, the roles of the first camera, the second camera, the third camera, and the server in the parking guidance process may be:
第一摄像机,用于在采集到的图像中检测驶入的车辆的车牌号,并将车牌号发送至服务器。The first camera is used to detect the license plate number of the approaching vehicle in the collected images and send the license plate number to the server.
服务器,用于向第二摄像机发送包含车牌号的第一通知消息,以及根据第二摄像机和多个第三摄像机当前各自采集的图像确定出停车位推荐信息,将停车位推荐信息通知至车辆。The server is configured to send a first notification message containing the license plate number to the second camera, and determine the parking space recommendation information according to the respective images currently collected by the second camera and the multiple third cameras, and notify the parking space recommendation information to the vehicle.
第二摄像机,用于响应于第一通知消息,在采集到的图像中检测出位于第一道闸处的车辆,为该车辆关联上上述车牌号,并对该车辆进行跟踪。The second camera is used to respond to the first notification message to detect a vehicle located at the first barrier in the collected image, associate the vehicle with the license plate number, and track the vehicle.
第三摄像机,用于根据预先确定的摄像机之间的单应性矩阵,对该车辆进行跟踪。The third camera is used to track the vehicle according to a predetermined homography matrix between cameras.
第二摄像机和第三摄像机,还用于若检测到该车辆停到目标停车位,则向服务器发送第二通知消息,第二通知消息中包括车牌号和目标停车位的标识。The second camera and the third camera are also used to send a second notification message to the server if it is detected that the vehicle has stopped at the target parking space. The second notification message includes the license plate number and the identification of the target parking space.
下面结合图2对上述实施例下,第一摄像机、第二摄像机、第三摄像机以及服务器在停车引导过程中的详细工作过程进行说明。The detailed working process of the first camera, the second camera, the third camera, and the server in the parking guidance process in the above embodiment will be described below in conjunction with FIG. 2.
图2为本发明实施例提供的一种车辆监控系统的工作过程的示意图,如图2所示,可以包括如下步骤:FIG. 2 is a schematic diagram of the working process of a vehicle monitoring system provided by an embodiment of the present invention. As shown in FIG. 2, it may include the following steps:
201、第一摄像机在采集到的图像中检测驶入的车辆的车牌号。201. The first camera detects the license plate number of the approaching vehicle in the collected image.
202、第一摄像机将识别出的车牌号发送至服务器。202. The first camera sends the recognized license plate number to the server.
第一摄像机持续进行图像拍摄,并在当前拍得的图像中检测是否有想要驶入停车场的车辆,当检测到采集的图像中存在驶入车辆时,进一步从中识别出该驶入车辆的车牌号。其中,车辆及车牌号识别的方法可以采用现有技术中的方法。当识别出驶入车辆的车牌号时,将该车牌号发送至服务器。The first camera continues to capture images, and detects whether there is a vehicle that wants to enter the parking lot in the currently captured image. When it detects that there is an entering vehicle in the captured image, it further identifies the entry of the vehicle. number plate. Among them, the method of vehicle and license plate number recognition can adopt the method in the prior art. When the license plate number of the entering vehicle is recognized, the license plate number is sent to the server.
203、服务器向第二摄像机发送包含车辆的车牌号的第一通知消息。203. The server sends a first notification message containing the license plate number of the vehicle to the second camera.
204、服务器控制第一道闸开启。204. The server controls the opening of the first barrier.
205、服务器根据第二摄像机和多个第三摄像机当前各自采集的图像确定出停车位推荐信息,将停车位推荐信息通知至车辆。205. The server determines the parking space recommendation information according to the images currently collected by the second camera and the multiple third cameras, and notifies the parking space recommendation information to the vehicle.
服务器接收到第一摄像机发送的车牌号之后,一方面,将包含该车牌号的第一通知消息发送至第二摄像机,另一方面,可以控制第一道闸开启,以使车辆驶入,再一方面,为了实现对驶入车辆的停车引导,服务器还需要确定出当前停车场内的空闲停车位,以便为该驶入车辆提供停车位推荐信息。After the server receives the license plate number sent by the first camera, on the one hand, it sends the first notification message containing the license plate number to the second camera. On the other hand, it can control the opening of the first barrier to allow the vehicle to enter. On the one hand, in order to realize parking guidance for the entering vehicle, the server also needs to determine the free parking space in the current parking lot, so as to provide parking space recommendation information for the entering vehicle.
其中,停车位推荐信息的确定可以通过如下方式实现:Among them, the determination of the parking space recommendation information can be achieved in the following ways:
根据摄像机彼此之间的单应性矩阵,拼接同一时间第二摄像机和多个第三摄像机各自采集的图像,从拼接后的图像中确定空闲的停车位,根据空闲的停车位确定停车位推荐信息。According to the homography matrix between the cameras, splice the images collected by the second camera and multiple third cameras at the same time, determine the free parking space from the spliced images, and determine the parking space recommendation information according to the free parking space .
实际应用中,为了实现对停车场的全覆盖,第二摄像机和多个第三摄像机中,相邻的两个摄像机之间往往具有一定的重叠区域,比如图3中所示意的一个第二摄像机(以摄像机A表示)和一个第三摄像机(以摄像机B表示),各自的拍摄范围之间具有重叠区域。而度量摄像机之间的重叠区域的指标可以是单应性矩阵,因此,在初始部署好各个摄像机之后,可以标定好各个摄像机之间的单应性矩阵。In practical applications, in order to achieve full coverage of the parking lot, the second camera and the multiple third cameras often have a certain overlap area between the two adjacent cameras, such as the second camera shown in Figure 3 (Indicated by camera A) and a third camera (indicated by camera B), the respective shooting ranges have overlapping areas. The index for measuring the overlap area between cameras can be a homography matrix. Therefore, after the cameras are initially deployed, the homography matrix between the cameras can be calibrated.
单应性矩阵标定的方法可以采用现有技术的方法。这里仅强调的是,当摄像机A与摄像机B具有重叠区域时,以摄像机A为例,摄像机A以及服务器中可以记录与其具有重叠区域的是摄像机B以及与摄像机B对应的单应性矩阵。The method of homography matrix calibration can adopt the method of the prior art. It is only emphasized here that when camera A and camera B have overlapping areas, taking camera A as an example, camera B and the homography matrix corresponding to camera B can be recorded in camera A and the server that have overlapping areas.
基于此,以图3为例,服务器在获得摄像机A和摄像机B各自在当前时刻拍得的图像后,根据上述记录得知摄像机A与摄像机B之间的单应性矩阵,根据该单应性矩阵可以实现这两个摄像机拍得的图像的拼接。具体地,可以将摄像机A拍得的图像通过该单应性矩阵投影到摄像机B拍得的图像上,以完成了图像的拼接。Based on this, taking Fig. 3 as an example, after the server obtains the images captured by camera A and camera B at the current moment, it learns the homography matrix between camera A and camera B according to the above-mentioned records. The matrix can realize the stitching of the images taken by the two cameras. Specifically, the image captured by camera A can be projected onto the image captured by camera B through the homography matrix to complete the image stitching.
图像拼接的结果即为当前停车场的全局影像,服务器可以从中识别出空闲的停车位。具体地,服务器仅需从拼接后的图像中识别各个停车位对应的图像区域中是否具有车辆 特征即可实现空闲的停车位的识别。The result of image splicing is the global image of the current parking lot, from which the server can identify free parking spaces. Specifically, the server only needs to identify whether there are vehicle characteristics in the image area corresponding to each parking space from the stitched image to realize the identification of the idle parking space.
在识别出空闲的停车位之后,服务器可以从空闲的停车位中筛选出距离当前驶入的车辆最近的停车位,生成与筛选出的停车位对应的停车位推荐信息。该停车位推荐信息比如可以是某某区域有多少个空位等内容。After identifying the free parking spaces, the server can filter out the parking spaces closest to the currently entering vehicle from the free parking spaces, and generate parking space recommendation information corresponding to the selected parking spaces. The parking space recommendation information may be, for example, how many vacancies are in a certain area, etc.
可以理解的是,服务器将停车位推荐信息通知至车辆,其实就是通知至车辆对应的用户即驾驶者。It is understandable that when the server notifies the parking space recommendation information to the vehicle, it actually notifies the user corresponding to the vehicle, namely the driver.
在一可选实施例中,车辆监控系统还可以包括:至少一个引导屏,从而,服务器可以通过该至少一个引导屏显示停车位推荐信息,以实现对用户的停车引导。In an optional embodiment, the vehicle monitoring system may further include: at least one guide screen, so that the server may display parking space recommendation information through the at least one guide screen, so as to implement parking guidance for the user.
可选地,还可以通过控制去往某空闲停车位的路径上的引导灯闪烁或长亮的方式引导车辆去往某空闲停车位。Optionally, the vehicle can be guided to a certain free parking space by controlling the guide light on the path to a certain free parking space to flash or keep on.
可选地,还可以将该车位推荐信息发送至用户的终端设备(比如手机)或者车载终端中。还可以将该车位推荐信息发送至用户进入停车场时分配给该用户的提示终端中。基于此,实际应用中,在用户开车到达停车场的入口处时,还可以通过相应的硬件设备采集或输入用户的相关信息,比如用户的手机号码、分配给用户的提示终端的标识等等,这些用户信息与车牌号可以一并上传至服务器,以供服务器建立车牌号与这些用户信息间的对应关系。Optionally, the parking space recommendation information can also be sent to the user's terminal device (such as a mobile phone) or a vehicle-mounted terminal. The parking space recommendation information can also be sent to the prompt terminal allocated to the user when the user enters the parking lot. Based on this, in practical applications, when the user arrives at the entrance of the parking lot by car, he can also collect or input user related information through the corresponding hardware device, such as the user’s mobile phone number, the identification of the prompt terminal assigned to the user, etc. The user information and the license plate number can be uploaded to the server together, so that the server can establish the corresponding relationship between the license plate number and the user information.
206、响应于第一通知消息,第二摄像机在采集到的图像中检测出位于第一道闸处的车辆,为该车辆关联上第一通知消息中的车牌号,并对该车辆进行跟踪。206. In response to the first notification message, the second camera detects a vehicle located at the first barrier in the collected image, associates the vehicle with the license plate number in the first notification message, and tracks the vehicle.
207、若该车辆驶入第二摄像机与第三摄像机的重叠区域,第三摄像机根据与第二摄像机之间的单应性矩阵,从第二摄像机获得该车辆的车牌号,并在采集的图像中为该车辆关联上车牌号,并对该车辆进行跟踪。207. If the vehicle enters the overlapping area of the second camera and the third camera, the third camera obtains the license plate number of the vehicle from the second camera according to the homography matrix between the second camera and the collected image Middle is the vehicle's license plate number, and the vehicle is tracked.
具体地,当车辆驶入第二摄像机与第三摄像机的重叠区域时,对于第三摄像机而言,由于其之前未获得该车辆的车牌号信息,因此,在第三摄像机采集的图像中,该车辆并未关联上车牌号信息。所以,当第三摄像机检测到采集的图像中包含一个新进入其拍摄范围的且未关联上车牌号的车辆时,确定其需要锁定该车辆并对该车辆进行跟踪。此时,第三摄像机根据本地存储的单应性矩阵(比如是与第二摄像机之间的单应性矩阵)和车辆在本地坐标系中的第一坐标确定车辆在该单应性矩阵对应的另一摄像机(即为第二摄像机)下对应的第二坐标,进而从另一摄像机中查询第二坐标对应的车辆的车牌号,之后在本地坐标系中为该车辆关联上车牌号。Specifically, when the vehicle enters the overlapping area between the second camera and the third camera, for the third camera, since it has not obtained the license plate information of the vehicle before, in the image collected by the third camera, the The vehicle is not associated with license plate information. Therefore, when the third camera detects that the captured image contains a vehicle that has newly entered its shooting range and is not associated with a license plate number, it is determined that it needs to lock the vehicle and track the vehicle. At this time, the third camera determines the homography matrix corresponding to the vehicle based on the locally stored homography matrix (for example, the homography matrix with the second camera) and the first coordinate of the vehicle in the local coordinate system. Another camera (ie, the second camera) corresponds to the second coordinate, and then queries the license plate number of the vehicle corresponding to the second coordinate from the other camera, and then associates the license plate number for the vehicle in the local coordinate system.
208、第三摄像机若检测到该车辆停到目标停车位,则向服务器发送第二通知消息, 第二通知消息中包括车辆的车牌号和目标停车位的标识。208. If the third camera detects that the vehicle has parked at the target parking space, it sends a second notification message to the server. The second notification message includes the license plate number of the vehicle and the target parking space identifier.
本实施例中假设第三摄像机在对上述车辆进行跟踪的过程中发现该车辆驶入到了某个停车位,该停车位称为目标停车位,则第三摄像机将该目标停车位的标识与该车辆的车牌号发送至服务器。In this embodiment, it is assumed that the third camera finds that the vehicle has entered a certain parking space in the process of tracking the above-mentioned vehicle, and this parking space is called the target parking space. Then the third camera and the identification of the target parking space The license plate number of the vehicle is sent to the server.
实际应用中,第二摄像机和第三摄像机部署完毕之后,其拍摄范围即固定了。以上述第三摄像机为例,部署完毕之后,停车场内没有任何车辆停靠,此时可以开启第三摄像机采集一张图像,此时,该图像中包含位于第三摄像机拍摄范围内的各个停车位,可以测定每个停车位在该图像中的位置坐标,并为每个位置坐标关联上对应的停车位标识,从而,第三摄像机得知其覆盖范围内的各个停车位的位置。基于此,第三摄像机可以得知车辆停靠的目标停车位的标识。In practical applications, after the second camera and the third camera are deployed, their shooting range is fixed. Take the above-mentioned third camera as an example. After the deployment is completed, there are no vehicles parked in the parking lot. At this time, the third camera can be turned on to collect an image. At this time, the image contains each parking space within the shooting range of the third camera , The position coordinates of each parking space in the image can be determined, and the corresponding parking space identifier can be associated with each position coordinate, so that the third camera knows the position of each parking space within its coverage. Based on this, the third camera can learn the identification of the target parking space where the vehicle is parked.
209、服务器生成停车记录,停车记录中包括车牌号、目标停车位标识以及停车起始时间。209. The server generates a parking record, and the parking record includes a license plate number, a target parking spot identifier, and a parking start time.
其中,停车起始时间可以是服务器生成停车记录的时间。该停车记录可以用于在车辆驶离停车场时,计算停车费用。Wherein, the parking start time may be the time when the server generates the parking record. The parking record can be used to calculate parking fees when the vehicle leaves the parking lot.
综上可见,通过在停车场内部署位于较高位置的少量的摄像机以及在停车场入口道闸处部署用于检测驶入车辆的摄像机,通过高空的摄像机与入口道闸处的摄像机的联动,即可简便地实现对车辆的停车引导。In summary, by deploying a small number of cameras at a higher position in the parking lot, and deploying cameras to detect incoming vehicles at the entrance barrier of the parking lot, through the linkage of the high-altitude camera and the camera at the entrance barrier, It can easily realize the parking guidance of the vehicle.
在前述实施例中,由步骤201-205可知,服务器可以在车辆驶入停车场时便为其推荐停车位信息,此时的推荐结果是根据当前停车场内的车位空闲情况而得到的。但是实际上存在这样的一种情形:在时刻T1为该车辆推荐某停车位a,很短时间后的某时刻T2,停车场内有其他车辆驶离另一停车位b,而该停车位b相比之前的停车位a来说,距离该驶入的车辆更近,此时,服务器可以更新向该车辆发送的车位推荐信息,将停车位b推荐给该车辆。In the foregoing embodiment, it can be seen from steps 201-205 that the server can recommend parking space information for the vehicle when it enters the parking lot. The recommendation result at this time is obtained based on the current parking space availability in the parking lot. However, there is actually a situation where a certain parking space a is recommended for the vehicle at time T1, and at a certain time T2 a short time later, other vehicles in the parking lot leave another parking space b, and the parking space b Compared with the previous parking space a, it is closer to the vehicle that has entered. At this time, the server can update the parking space recommendation information sent to the vehicle and recommend parking space b to the vehicle.
当然,可以理解的是,服务器根据T2时刻第二摄像机和各第三摄像机各自采集的图像进行拼接,在拼接得到的图像中确定出空闲的停车位b。Of course, it can be understood that the server performs splicing according to the images collected by the second camera and each third camera at time T2, and determines the free parking space b in the spliced images.
以上各实施例中介绍了服务器为驶入车辆推荐停车位的情形,实际上,在另一可选实施例中,也可以不为驶入车辆进行停车位的推荐,此时,也可以只是跟踪驶入车辆,以识别出其所停靠的停车位。基于该识别结果,可以在用户需要驶离停车场时引导用户快速定位到其车辆的停靠位置。In the above embodiments, the server recommends parking spaces for incoming vehicles. In fact, in another optional embodiment, it is not necessary to recommend parking spaces for incoming vehicles. Drive into the vehicle to identify the parking space where it is parked. Based on the recognition result, the user can be guided to quickly locate the parking position of his vehicle when the user needs to leave the parking lot.
相应地,在该实施例中,车辆监控系统可以包括:Accordingly, in this embodiment, the vehicle monitoring system may include:
服务器,对应于驶入方向的道闸(即为前文的第一道闸),部署在该道闸处用于拍摄驶入车辆的第一摄像机,拍摄范围覆盖停车场的多个第二摄像机,其中,多个第二摄像机中的至少一个第二摄像机的拍摄范围覆盖道闸处的预设范围,相邻的第二摄像机具有重叠区域。The server, corresponding to the barrier gate in the direction of entry (that is, the first barrier in the previous article), is deployed at the barrier gate to capture the first camera of the entering vehicle, and the shooting range covers multiple second cameras in the parking lot. Wherein, the shooting range of at least one second camera among the plurality of second cameras covers a preset range at the barrier, and adjacent second cameras have overlapping areas.
可以理解的是,多个第二摄像机中拍摄范围不覆盖道闸外的预设范围的摄像机即为前述实施例中的第三摄像机。It can be understood that the camera whose shooting range does not cover the preset range outside the barrier gate among the plurality of second cameras is the third camera in the foregoing embodiment.
在本实施例中,以上各组成部分的作用如下:In this embodiment, the functions of the above components are as follows:
第一摄像机,用于在采集到的图像中检测驶入车辆的车牌号,并将车牌号发送至服务器。The first camera is used to detect the license plate number of the entering vehicle in the collected images and send the license plate number to the server.
服务器,用于向上述至少一个第二摄像机发送包含该车牌号的第一通知消息,以使该至少一个第二摄像机在采集的图像中检测出驶入车辆,并为驶入车辆关联上该车牌号。The server is configured to send a first notification message containing the license plate number to the at least one second camera, so that the at least one second camera detects an entering vehicle in the collected images, and associates the license plate with the entering vehicle number.
多个第二摄像机,用于对驶入车辆进行跟踪,并在检测到驶入车辆停到目标停车位时,则向服务器发送第二通知消息,第二通知消息中包括该车牌号和目标停车位的标识。A plurality of second cameras are used to track the entering vehicle, and when it is detected that the entering vehicle has stopped at the target parking space, a second notification message is sent to the server. The second notification message includes the license plate number and the target parking space Bit identification.
其中,多个摄像机对驶入车辆进行跟踪的过程可以参见前述实施例中的说明,在此不赘述。Wherein, the process of multiple cameras tracking the entering vehicle can refer to the description in the foregoing embodiment, which is not repeated here.
图4为本发明实施例提供的一种车辆监控方法的流程图,可以由前述实施例中的服务器执行,如图4所示,该方法可以包括如下步骤:FIG. 4 is a flowchart of a vehicle monitoring method provided by an embodiment of the present invention, which may be executed by the server in the foregoing embodiment. As shown in FIG. 4, the method may include the following steps:
401、接收第一摄像机发送的驶入车辆的车牌号,第一摄像机部署在停车场的驶入方向的第一道闸处。401. Receive the license plate number of the entering vehicle sent by the first camera, and the first camera is deployed at the first barrier in the entering direction of the parking lot.
402、向第二摄像机发送包含车牌号的第一通知消息,以使第二摄像机在采集的图像中检测出驶入车辆后,并为驶入车辆关联上车牌号;第二摄像机的拍摄范围至少覆盖第一道闸外的预设范围。402. Send a first notification message containing the license plate number to the second camera, so that after the second camera detects an entering vehicle in the collected images, it associates the entering vehicle with the license plate number; the shooting range of the second camera is at least Cover the preset range outside the first barrier.
403、接收第二摄像机或第三摄像机发送的第二通知消息,第二通知消息中包括车牌号和驶入车辆停靠的目标停车位的标识;其中,第三摄像机的拍摄范围覆盖多个停车位,第二摄像机和第三摄像机对驶入车辆进行跟踪以确定目标停车位的标识。403. Receive a second notification message sent by the second camera or the third camera, where the second notification message includes the license plate number and the identification of the target parking space where the incoming vehicle stops; wherein the shooting range of the third camera covers multiple parking spaces , The second camera and the third camera track the incoming vehicle to determine the identification of the target parking space.
图5为本发明实施例提供的另一种车辆监控方法的流程图,可以由前述实施例中的服务器执行,如图5所示,该方法可以包括如下步骤:FIG. 5 is a flowchart of another vehicle monitoring method provided by an embodiment of the present invention, which may be executed by the server in the foregoing embodiment. As shown in FIG. 5, the method may include the following steps:
501、接收第一摄像机发送的驶入车辆的车牌号,第一摄像机部署在停车场的驶入方向的第一道闸处。501. Receive the license plate number of the entering vehicle sent by the first camera, and the first camera is deployed at the first barrier in the entering direction of the parking lot.
502、向第二摄像机发送包含车牌号的第一通知消息,以使第二摄像机在采集的图像 中检测出驶入车辆后,并为驶入车辆关联上车牌号;第二摄像机的拍摄范围至少覆盖第一道闸外的预设范围。502. Send a first notification message containing the license plate number to the second camera, so that the second camera detects an entering vehicle in the collected images, and associates the entering vehicle with the license plate number; the shooting range of the second camera is at least Cover the preset range outside the first barrier.
503、根据第二摄像机和第三摄像机当前各自采集的图像确定出停车位推荐信息,将停车位推荐信息通知至驶入车辆,其中,第三摄像机的拍摄范围覆盖多个停车位。503. Determine parking space recommendation information according to the images currently collected by the second camera and the third camera, and notify the parking space recommendation information to the incoming vehicle, where the shooting range of the third camera covers multiple parking spaces.
具体地,服务器可以根据如下方式确定出停车位推荐信息:根据摄像机彼此之间的单应性矩阵,拼接同一时间第二摄像机和第三摄像机各自采集的图像;从拼接后的图像中确定空闲的停车位;根据空闲的停车位确定停车位推荐信息。Specifically, the server can determine the parking space recommendation information according to the following methods: according to the homography matrix between the cameras, splicing the images collected by the second camera and the third camera at the same time; determining the free ones from the spliced images Parking space; according to the free parking space to determine the recommended parking space.
其中,服务器可以通过如下方式将停车位推荐信息通知至驶入车辆:Among them, the server can notify the parking space recommendation information to the incoming vehicle in the following manner:
通过至少一个引导屏显示停车位推荐信息,或者,将停车位推荐信息发送至驶入车辆对应的用户终端。The parking space recommendation information is displayed through at least one guide screen, or the parking space recommendation information is sent to the user terminal corresponding to the entering vehicle.
另外,可选地,当服务器将上述停车位推荐信息发送至驶入车辆后,若在某时间,能够从该时间对应的拼接后的图像中确定出距离驶入车辆更近的空闲停车位,则根据该更近的空闲停车位更新停车位推荐信息,将更新后的停车位推荐信息发送至驶入车辆。In addition, optionally, after the server sends the aforementioned parking space recommendation information to the entering vehicle, if at a certain time, it can determine the free parking space closer to the entering vehicle from the stitched image corresponding to that time. Then the parking space recommendation information is updated according to the closer free parking space, and the updated parking space recommendation information is sent to the incoming vehicle.
504、接收第二摄像机或第三摄像机发送的第二通知消息,第二通知消息中包括车牌号和驶入车辆停靠的目标停车位的标识,其中,第二摄像机和第三摄像机对驶入车辆进行跟踪以确定目标停车位的标识。504. Receive a second notification message sent by the second camera or the third camera, where the second notification message includes the license plate number and the identification of the target parking space where the entering vehicle is parked, where the second camera and the third camera pair the entering vehicle Perform tracking to determine the identity of the target parking spot.
以上图4至图5所示实施例中服务器的详细执行过程可以参见前述相关实施例中的说明,在此不赘述。For the detailed execution process of the server in the embodiments shown in FIG. 4 to FIG. 5, reference may be made to the description in the foregoing related embodiments, which is not repeated here.
基于上述实施例可以实现对驶入的车辆在停车场内所停靠的停车位的识别,下面结合以下实施例对车辆驶离停车场的过程进行介绍。Based on the foregoing embodiment, it is possible to realize the identification of the parking space where the entering vehicle stops in the parking lot. The following describes the process of the vehicle leaving the parking lot in conjunction with the following embodiments.
在一可选实施例中,用户可以通过查询设备向服务器发送车辆查询请求,假设该车辆查询请求中包括前文中驶入的车辆的车牌号。服务器接收到该查询请求后,确定与该车牌号对应的目标停车位的标识,向查询设备输出目标停车位的标识或去往目标停车位的导航路线。其中,如前文所述,服务器中记录了该车辆的车牌号与目标停车位的对应关系,基于此,服务器可以查询获得该目标停车位的标识。In an optional embodiment, the user may send a vehicle query request to the server through the query device, assuming that the vehicle query request includes the license plate number of the vehicle that has entered in the foregoing. After receiving the query request, the server determines the identifier of the target parking space corresponding to the license plate number, and outputs the identifier of the target parking space or the navigation route to the target parking space to the query device. Among them, as mentioned above, the server records the correspondence between the license plate number of the vehicle and the target parking space. Based on this, the server can query and obtain the identification of the target parking space.
基于此,如图6中所示,车辆监控系统中还可以包括查询设备。Based on this, as shown in Figure 6, the vehicle monitoring system may also include a query device.
实际应用中,上述查询设备可以为车辆对应的用户的终端设备,或者,也可以为部署在停车场内的终端设备。In actual applications, the aforementioned query device may be a terminal device of a user corresponding to the vehicle, or may also be a terminal device deployed in a parking lot.
也就是说,用户可以在自己的诸如手机中安装停车场提供的客户端,或者手机中存在停车场提供的某个小程序的启动项,从而,在该客户端或小程序内输入其车牌号,以 查询其车辆所在的位置。In other words, the user can install the client provided by the parking lot in his mobile phone, or there is a startup item of a small program provided by the parking lot in the mobile phone, so that he can enter his license plate number in the client or the small program To query the location of his vehicle.
或者,停车场内可以设置有公用的查询终端,各个用户可以在该查询终端内输入其车牌号,以查询其车辆所在的位置。Alternatively, a public query terminal may be provided in the parking lot, and each user may enter his license plate number in the query terminal to query the location of his vehicle.
在查询设备实现为用户自己的终端设备时,上述导航路线的起点是根据用户的终端设备的定位信息确定的,该定位信息可以是通过用户的终端设备中的定位模块(比如GPS模块)获得的。此时,查询请求中包括用户当前的位置。When the query device is implemented as the user's own terminal device, the starting point of the above-mentioned navigation route is determined according to the positioning information of the user's terminal device. The positioning information can be obtained through the positioning module (such as a GPS module) in the user's terminal device. . At this time, the current location of the user is included in the query request.
在查询设备实现为停车场内设置的公用查询终端设备时,上述导航路线的起点是该公用查询终端设备的位置,服务器中可以预先存储有该位置信息,该位置信息也可以是预先基于公用查询终端设备处部署的定位模块(比如GPS模块)获得的。当然,当第二摄像机或第三摄像机的拍摄范围覆盖该公用查询终端设备时,也可以基于对采集到该公用查询终端设备的图像的分析,确定公用查询终端设备的位置信息。When the query device is implemented as a public query terminal device installed in a parking lot, the starting point of the navigation route is the location of the public query terminal device. The server may pre-store the location information, or the location information may be based on the public query in advance. Obtained by a positioning module (such as a GPS module) deployed at the terminal device. Of course, when the shooting range of the second camera or the third camera covers the public query terminal device, the location information of the public query terminal device may also be determined based on the analysis of the collected images of the public query terminal device.
另外,值得说明的是,当查询设备实现为停车场内设置的公用查询终端设备时,导航路线除了可以发送至该公用查询设备外,为方便用户使用,还可以将该导航路线发送至用户的终端设备中。用户的终端设备的标识信息可以是手机号等,可以在用户驾车进入停车场时,便获得了用户的终端设备标识与车牌号的对应关系,从而,基于已经获得的用户的终端设备标识,将导航路线发送至用户的终端设备中。In addition, it is worth noting that when the query device is implemented as a public query terminal device installed in the parking lot, the navigation route can be sent to the public query device, and for the convenience of the user, the navigation route can also be sent to the user’s In the terminal equipment. The identification information of the user’s terminal equipment can be a mobile phone number, etc., when the user drives into the parking lot, the corresponding relationship between the user’s terminal equipment identification and the license plate number can be obtained, thus, based on the user’s terminal equipment identification that has been obtained, The navigation route is sent to the user's terminal device.
另外,在一可选实施例中,当停车场是收费的停车场时,服务器还需要进行停车费用的计算。具体地,服务器根据车辆的停车时长确定停车费用,将停车费用发送至查询设备以供用户进行费用支付,并在用户完成停车费用的支付时,可以为上述车牌号关联上支付完成标记。In addition, in an optional embodiment, when the parking lot is a paid parking lot, the server also needs to calculate the parking fee. Specifically, the server determines the parking fee according to the parking duration of the vehicle, sends the parking fee to the query device for the user to pay the fee, and when the user completes the payment of the parking fee, the payment completion mark can be associated with the license plate number.
与此相适应地,如图6所示,该车辆监控系统中还包括:对应于驶出方向的第二道闸以及部署在第二道闸处用于拍摄驶出车辆的第四摄像机。Correspondingly, as shown in FIG. 6, the vehicle monitoring system further includes: a second barrier corresponding to the driving direction and a fourth camera deployed at the second barrier for photographing the exiting vehicle.
其中,当用户驾驶上述车辆行驶到位于出口处的第二道闸时,第四摄像机若在采集的图像中检测出驶出的车辆的车牌号,将检测到的车牌号发送至服务器。服务器在确定该车牌号已经关联有支付完成标记时,控制第二道闸开启,以便车辆能够驶出。Wherein, when the user drives the vehicle to the second barrier located at the exit, if the fourth camera detects the license plate number of the driving out vehicle in the collected image, it sends the detected license plate number to the server. When the server determines that the license plate number has been associated with a payment completion mark, it controls the second barrier to open so that the vehicle can drive out.
图7为本发明实施例提供的又一种车辆监控方法的流程图,可以由前述实施例中的服务器执行。在图4或图5所示实施例的基础上,基于服务器获得了驶入车辆最终停靠的目标停车位的标识这一结果,还可以包括如图7所示的查询处理逻辑,具体可以包括如下步骤:FIG. 7 is a flowchart of another vehicle monitoring method provided by an embodiment of the present invention, which may be executed by the server in the foregoing embodiment. On the basis of the embodiment shown in FIG. 4 or FIG. 5, based on the result that the server obtains the identification of the target parking space where the incoming vehicle finally stops, the query processing logic shown in FIG. 7 may also be included, which may specifically include the following step:
701、接收查询设备发送的车辆查询请求,车辆查询请求中包括车牌号。701. Receive a vehicle query request sent by the query device, where the vehicle query request includes a license plate number.
702、确定与车牌号对应的目标停车位的标识。702. Determine the identification of the target parking space corresponding to the license plate number.
703、根据驶入车辆的停车时长确定停车费用。703. Determine the parking fee according to the parking time of the entering vehicle.
704、向查询设备输出目标停车位的标识或去往目标停车位的导航路线,以及停车费用。704. Output the identification of the target parking space or the navigation route to the target parking space, and the parking fee to the query device.
705、若完成停车费用的支付,则为车牌号关联上支付完成标记。705. If the payment of the parking fee is completed, the payment completion mark is associated with the license plate number.
706、接收第四摄像机发送的车牌号,第四摄像机是部署在驶出方向的第二道闸的摄像机,第四摄像机在采集的图像中检测出驶入车辆的车牌号。706. Receive the license plate number sent by the fourth camera. The fourth camera is a camera deployed at the second barrier in the exit direction, and the fourth camera detects the license plate number of the entering vehicle in the collected images.
707、在确定车牌号已经关联有支付完成标记时,控制第二道闸开启。707. When it is determined that the license plate number has been associated with a payment completion mark, control the second barrier to open.
本实施例中,查询设备为驶入车辆对应的用户的终端设备,或者,查询设备为部署在停车场内的终端设备。In this embodiment, the query device is a terminal device of a user corresponding to the entering vehicle, or the query device is a terminal device deployed in a parking lot.
以上图7所示实施例中服务器的详细执行过程可以参见前述图6所示实施例中的说明,在此不赘述。For the detailed execution process of the server in the embodiment shown in FIG. 7 above, reference may be made to the description in the embodiment shown in FIG. 6, which is not repeated here.
以上对基于上述车辆监控系统对车辆的停车引导和驶离过程进行了介绍。基于该车辆监控系统,还可以对车辆在停车场内的其他行为进行记录和识别。由于第二摄像机和第三摄像机持续工作,从而可以形成停车场的全局监控画面,以记录车辆的各种行为。The above describes the parking guidance and driving-off process of the vehicle based on the above-mentioned vehicle monitoring system. Based on the vehicle monitoring system, other behaviors of vehicles in the parking lot can also be recorded and identified. Since the second camera and the third camera continue to work, a global monitoring screen of the parking lot can be formed to record various behaviors of the vehicle.
在另一可选实施例中,服务器还可以发现停车场内两车相接触的现象,该现象往往表明两辆车发生了碰撞或剐蹭。确定两辆车是否发生接触现象的手段如下:In another optional embodiment, the server may also find that two cars are in contact in the parking lot, which often indicates that the two cars have collided or struck each other. The means to determine whether two vehicles are in contact are as follows:
获取目标摄像机采集的图像,若图像中存在满足如下条件的两个车辆,则确定两个车辆存在接触现象:Acquire the image collected by the target camera. If there are two vehicles in the image that meet the following conditions, it is determined that the two vehicles are in contact:
两个车辆各自对应的图像区域的交集面积与两个车辆各自对应的图像区域的并集面积的比值大于预设值。The ratio of the intersection area of the image areas corresponding to the two vehicles to the union area of the image areas corresponding to the two vehicles is greater than the preset value.
其中,目标摄像机为上述第二摄像机和第三摄像机中的任一个。Wherein, the target camera is any one of the aforementioned second camera and third camera.
其中,两个车辆各自对应的图像区域的交集面积与两个车辆各自对应的图像区域的并集面积的含义如图8所示。图8中,以IoU表示上述比值。Among them, the meaning of the intersection area of the image areas corresponding to the two vehicles and the union area of the image areas corresponding to the two vehicles is as shown in FIG. 8. In Figure 8, the above ratio is represented by IoU.
前述各实施例中假设的是要覆盖停车场内的各停车位以及停车场入口处道闸外的预设范围,需要多个摄像机,但是,在一种实际应用场景下,可能存在仅需要一个摄像机便可以实现对入口道闸外的预设范围以及停车场内的各停车位的覆盖,假设这个摄像机称为第二摄像机。那么在该场景下,车辆监控方法的执行过程可以参见图9所示。In the foregoing embodiments, it is assumed to cover each parking space in the parking lot and the preset range outside the barrier at the entrance of the parking lot. Multiple cameras are required. However, in a practical application scenario, there may be only one The camera can cover the preset range outside the entrance barrier and the parking spaces in the parking lot. Suppose this camera is called the second camera. Then, in this scenario, the execution process of the vehicle monitoring method can be seen in FIG. 9.
图9为本发明实施例提供的再一种车辆监控方法的流程图,可以由前述实施例中的服务器执行,如图9所示,具体可以包括如下步骤:FIG. 9 is a flowchart of another vehicle monitoring method provided by an embodiment of the present invention, which may be executed by the server in the foregoing embodiment. As shown in FIG. 9, it may specifically include the following steps:
901、接收第一摄像机发送的驶入车辆的车牌号,第一摄像机部署在停车场的驶入方向的道闸处。901. Receive the license plate number of the entering vehicle sent by the first camera, and the first camera is deployed at a barrier in the entering direction of the parking lot.
902、向第二摄像机发送包含车牌号的第一通知消息,以使第二摄像机在采集的图像中检测出驶入车辆后,为驶入车辆关联上车牌号,第二摄像机的拍摄范围覆盖道闸外的预设范围以及停车场内的各停车位。902. Send a first notification message containing the license plate number to the second camera, so that after the second camera detects an entering vehicle in the collected images, it associates the license plate number for the entering vehicle, and the shooting range of the second camera covers the road. The preset range outside the gate and the parking spaces in the parking lot.
903、接收第二摄像机发送的第二通知消息,第二通知消息中包括车牌号和驶入车辆停靠的目标停车位的标识,其中,第二摄像机对驶入车辆进行跟踪以确定目标停车位的标识。903. Receive a second notification message sent by the second camera, where the second notification message includes the license plate number and the identification of the target parking space where the entering vehicle is parked. The second camera tracks the entering vehicle to determine the target parking space. Logo.
可以理解的是,除了上述步骤外,服务器还可以执行与前述实施例中相似的停车位推荐、车辆停车位查询等处理过程,详细的执行过程可以参见前述相关实施例中的介绍,在此不赘述。It is understandable that, in addition to the above steps, the server can also execute processing procedures such as parking space recommendation and vehicle parking space query similar to those in the foregoing embodiment. For the detailed execution process, please refer to the introduction in the foregoing related embodiments. Repeat.
以下将详细描述本发明的一个或多个实施例的车辆监控装置。本领域技术人员可以理解,这些车辆监控装置均可使用市售的硬件组件通过本方案所教导的步骤进行配置来构成。The vehicle monitoring device of one or more embodiments of the present invention will be described in detail below. Those skilled in the art can understand that these vehicle monitoring devices can all be configured using commercially available hardware components through the steps taught in this solution.
图10为本发明实施例提供的一种车辆监控装置的结构示意图,如图10所示,该装置包括:接收模块11、发送模块12。FIG. 10 is a schematic structural diagram of a vehicle monitoring device provided by an embodiment of the present invention. As shown in FIG. 10, the device includes: a receiving module 11 and a sending module 12.
接收模块11,用于接收第一摄像机发送的驶入车辆的车牌号,所述第一摄像机部署在停车场的驶入方向的第一道闸处。The receiving module 11 is configured to receive the license plate number of the entering vehicle sent by the first camera, the first camera being deployed at the first barrier in the entering direction of the parking lot.
发送模块12,用于向第二摄像机发送包含所述车牌号的第一通知消息,以使所述第二摄像机在采集的图像中检测出所述驶入车辆后,为所述驶入车辆关联上所述车牌号;所述第二摄像机的拍摄范围至少覆盖所述第一道闸外的预设范围。The sending module 12 is configured to send a first notification message containing the license plate number to a second camera, so that after the second camera detects the entering vehicle in the collected images, it associates the entering vehicle with The above license plate number; the shooting range of the second camera at least covers the preset range outside the first barrier.
所述接收模块11,还用于接收所述第二摄像机或第三摄像机发送的第二通知消息,所述第二通知消息中包括所述车牌号和所述驶入车辆停靠的目标停车位的标识;其中,所述第三摄像机的拍摄范围覆盖多个停车位,所述第二摄像机和所述第三摄像机对所述驶入车辆进行跟踪以确定所述目标停车位的标识。The receiving module 11 is also configured to receive a second notification message sent by the second camera or the third camera, and the second notification message includes the license plate number and the information of the target parking space where the incoming vehicle stops. Identification; wherein the shooting range of the third camera covers multiple parking spaces, and the second camera and the third camera track the entering vehicle to determine the identification of the target parking space.
可选地,该装置中还可以包括:处理模块,用于根据所述第二摄像机和所述第三摄像机当前各自采集的图像确定出停车位推荐信息;通过所述发送模块12将所述停车位推荐信息通知至所述驶入车辆。Optionally, the device may further include: a processing module, configured to determine parking space recommendation information according to the images currently collected by the second camera and the third camera; Position recommendation information is notified to the incoming vehicle.
其中,在将所述停车位推荐信息通知至所述驶入车辆的过程中,所述处理模块具体可以用于:通过至少一个引导屏显示所述停车位推荐信息,或者,通过所述发送模块12 将所述停车位推荐信息发送至所述驶入车辆对应的用户终端。Wherein, in the process of notifying the parking space recommendation information to the entering vehicle, the processing module may be specifically used to display the parking space recommendation information through at least one guide screen, or through the sending module 12 Send the parking space recommendation information to the user terminal corresponding to the entering vehicle.
其中,具体地,所述处理模块可以通过如下方式确定出停车位推荐信息:根据摄像机彼此之间的单应性矩阵,拼接同一时间所述第二摄像机和所述第三摄像机各自采集的图像;从拼接后的图像中确定空闲的停车位;根据所述空闲的停车位确定所述停车位推荐信息。Specifically, the processing module may determine the parking space recommendation information in the following manner: according to the homography matrix between the cameras, stitching the images collected by the second camera and the third camera at the same time; Determine free parking spaces from the stitched images; determine the parking space recommendation information according to the free parking spaces.
可选地,所述处理模块还可以用于:对于将所述停车位推荐信息通知至所述车辆之后的一时间,若从与所述时间对应的拼接后的图像中确定出距离所述驶入车辆更近的空闲停车位,则根据所述更近的空闲停车位更新所述停车位推荐信息。Optionally, the processing module may be further configured to: for a time after the parking space recommendation information is notified to the vehicle, if the distance to the driving distance is determined from the stitched image corresponding to the time When entering a free parking space that is closer to the vehicle, the parking space recommendation information is updated according to the more recent free parking space.
可选地,所述接收模块11还用于:接收查询设备发送的车辆查询请求,所述车辆查询请求中包括所述车牌号。所述处理模块还用于:确定与所述车牌号对应的所述目标停车位的标识,通过所述发送模块12向所述查询设备输出所述目标停车位的标识或去往所述目标停车位的导航路线。Optionally, the receiving module 11 is further configured to receive a vehicle query request sent by the query device, and the vehicle query request includes the license plate number. The processing module is also used to determine the identifier of the target parking space corresponding to the license plate number, and output the identifier of the target parking space to the query device through the sending module 12 or to go to the target parking Bit navigation route.
其中,所述查询设备为所述驶入车辆对应的用户的终端设备,或者,所述查询设备为部署在所述停车场内的终端设备。Wherein, the query device is a terminal device of the user corresponding to the entering vehicle, or the query device is a terminal device deployed in the parking lot.
可选地,所述处理模块还用于:根据所述驶入车辆的停车时长确定停车费用,通过所述发送模块12将所述停车费用发送至所述查询设备以供进行费用支付,若完成所述停车费用的支付,则为所述车牌号关联上支付完成标记。Optionally, the processing module is further configured to determine the parking fee according to the parking duration of the entering vehicle, and send the parking fee to the query device through the sending module 12 for fee payment, if completed The payment of the parking fee is associated with the payment completion mark on the license plate number.
可选地,所述接收模块11还用于:接收第四摄像机发送的所述车牌号,所述第四摄像机是部署在驶出方向的第二道闸的摄像机,所述第四摄像机在采集的图像中检测出所述驶入车辆的所述车牌号。所述处理模块还用于:在确定所述车牌号已经关联有支付完成标记时,控制所述第二道闸开启。Optionally, the receiving module 11 is further configured to: receive the license plate number sent by a fourth camera, the fourth camera being a camera deployed at the second barrier in the exit direction, and the fourth camera is collecting The license plate number of the entering vehicle is detected in the image. The processing module is further configured to control the opening of the second barrier when it is determined that the license plate number has been associated with a payment completion mark.
可选地,所述处理模块还用于:获取目标摄像机采集的图像,若所述图像中存在满足如下条件的两个车辆,则确定所述两个车辆存在接触现象:Optionally, the processing module is further configured to: acquire an image collected by a target camera, and if there are two vehicles in the image that meet the following conditions, determine that the two vehicles are in contact:
所述两个车辆各自对应的图像区域的交集面积与所述两个车辆各自对应的图像区域的并集面积的比值大于预设值;所述目标摄像机为所述第二摄像机和所述第三摄像机中的任一个。The ratio of the intersection area of the image areas corresponding to the two vehicles to the union area of the image areas corresponding to the two vehicles is greater than a preset value; the target cameras are the second camera and the third camera. Any one of the cameras.
图10所示装置可以执行前述实施例中服务器执行的各步骤,详细的执行过程和技术效果参见前述实施例中的描述,在此不再赘述。The device shown in FIG. 10 can execute each step executed by the server in the foregoing embodiment. For the detailed execution process and technical effects, please refer to the description in the foregoing embodiment, and will not be repeated here.
在一个可能的设计中,上述图10所示通信装置的结构可实现为一电子设备,该电子设备可以为服务器,如图11所示,该电子设备可以包括:第一处理器21、第一存储器 22。其中,所述第一存储器22上存储有可执行代码,当所述可执行代码被所述第一处理器21执行时,使所述第一处理器21至少可以实现前述实施例中服务器所执行的各个步骤。In a possible design, the structure of the communication device shown in FIG. 10 may be implemented as an electronic device, and the electronic device may be a server. As shown in FIG. 11, the electronic device may include: a first processor 21, a first Storage 22. Wherein, executable code is stored on the first memory 22, and when the executable code is executed by the first processor 21, the first processor 21 can at least implement the execution of the server in the foregoing embodiment The various steps.
可选地,该电子设备中还可以包括:第一通信接口23,用于与其他设备进行通信。Optionally, the electronic device may further include: a first communication interface 23 for communicating with other devices.
另外,本发明实施例提供了一种非暂时性机器可读存储介质,所述非暂时性机器可读存储介质上存储有可执行代码,当所述可执行代码被上述电子设备的处理器执行时,使所述处理器至少可以实现以上服务器所执行的各步骤。In addition, an embodiment of the present invention provides a non-transitory machine-readable storage medium having executable code stored on the non-transitory machine-readable storage medium, and when the executable code is executed by the processor of the above electronic device At this time, the processor can at least implement the steps executed by the above server.
图12为本发明实施例提供的另一种车辆监控装置的结构示意图,如图12所示,该装置包括:接收模块31、发送模块32。FIG. 12 is a schematic structural diagram of another vehicle monitoring device provided by an embodiment of the present invention. As shown in FIG. 12, the device includes: a receiving module 31 and a sending module 32.
接收模块31,用于接收第一摄像机发送的驶入车辆的车牌号,所述第一摄像机部署在停车场的驶入方向的道闸处。The receiving module 31 is configured to receive the license plate number of the entering vehicle sent by the first camera, and the first camera is deployed at a barrier in the entering direction of the parking lot.
发送模块32,用于向第二摄像机发送包含所述车牌号的第一通知消息,以使所述第二摄像机在采集的图像中检测出所述驶入车辆后,为所述驶入车辆关联上所述车牌号;所述第二摄像机的拍摄范围覆盖所述道闸外的预设范围以及停车场内的各停车位。The sending module 32 is configured to send a first notification message containing the license plate number to a second camera, so that after the second camera detects the entering vehicle in the collected images, it associates the entering vehicle with The license plate number above; the shooting range of the second camera covers the preset range outside the barrier and each parking space in the parking lot.
所述接收模块31,还用于接收所述第二摄像机发送的第二通知消息,所述第二通知消息中包括所述车牌号和所述驶入车辆停靠的目标停车位的标识,其中,所述第二摄像机对所述驶入车辆进行跟踪以确定所述目标停车位的标识。The receiving module 31 is further configured to receive a second notification message sent by the second camera, the second notification message including the license plate number and the identification of the target parking space where the incoming vehicle parks, wherein: The second camera tracks the entering vehicle to determine the identity of the target parking space.
图12所示装置可以执行前述图9所示实施例中服务器执行的各步骤,详细的执行过程参见前述实施例中的描述,在此不再赘述。The device shown in FIG. 12 can execute the steps executed by the server in the embodiment shown in FIG. 9. For the detailed execution process, please refer to the description in the foregoing embodiment, which will not be repeated here.
在一个可能的设计中,上述图12所示通信装置的结构可实现为一电子设备,该电子设备可以为服务器,如图13所示,该电子设备可以包括:第二处理器41、第二存储器42。其中,所述第二存储器42上存储有可执行代码,当所述可执行代码被所述第二处理器41执行时,使所述第二处理器41至少可以实现前述图9所示实施例中服务器所执行的各个步骤。In a possible design, the structure of the communication device shown in FIG. 12 may be implemented as an electronic device, and the electronic device may be a server. As shown in FIG. 13, the electronic device may include: a second processor 41, a second Storage 42. Wherein, executable code is stored on the second memory 42, and when the executable code is executed by the second processor 41, the second processor 41 can at least implement the embodiment shown in FIG. 9 The various steps performed by the server.
可选地,该电子设备中还可以包括:第二通信接口43,用于与其他设备进行通信。Optionally, the electronic device may further include: a second communication interface 43 for communicating with other devices.
本发明实施例提供的车辆监控方法可以由某一个或多个程序/软件来执行,该程序/软件可以由网络侧提供,前述实施例中提及的各个摄像机、服务器可以将所需的程序/软件下载到本地的非易失性存储介质中,并在其需要执行前述车辆监控方案时,通过CPU将所需的程序/软件读取到内存中,进而由CPU执行该程序/软件以实现前述实施例中所提供的车辆监控方案,执行过程可以参见前述车辆监控系统实施例以及图2、图4、图5、 图7、图9所示的车辆监控方法实施例中的说明。The vehicle monitoring method provided by the embodiments of the present invention can be executed by one or more programs/software, and the program/software can be provided by the network side. The cameras and servers mentioned in the foregoing embodiments can install the required programs/software. The software is downloaded to the local non-volatile storage medium, and when it needs to execute the aforementioned vehicle monitoring solution, the required program/software is read into the memory through the CPU, and then the program/software is executed by the CPU to realize the aforementioned For the implementation process of the vehicle monitoring solution provided in the embodiment, refer to the description in the foregoing vehicle monitoring system embodiment and the vehicle monitoring method embodiment shown in FIG. 2, FIG. 4, FIG. 5, FIG. 7, and FIG. 9.
最后应说明的是:以上实施例仅用以说明本发明的技术方案,而非对其限制;尽管参照前述实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本发明各实施例技术方案的精神和范围。Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: The technical solutions recorded in the foregoing embodiments are modified, or some of the technical features are equivalently replaced; these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims (27)

  1. 一种车辆监控系统,其特征在于,包括:A vehicle monitoring system is characterized in that it comprises:
    服务器,对应于驶入方向的第一道闸,部署在所述第一道闸处用于拍摄驶入车辆的第一摄像机,拍摄范围至少覆盖所述第一道闸处的预设范围的第二摄像机,以及拍摄范围覆盖多个停车位的第三摄像机;所述第二摄像机和多个所述第三摄像机的整体拍摄范围覆盖停车场;The server, corresponding to the first barrier in the direction of entry, is deployed at the first barrier and used to photograph the first camera of the entering vehicle, and the shooting range covers at least the first of the preset range at the first barrier A second camera, and a third camera whose shooting range covers multiple parking spaces; the overall shooting range of the second camera and the multiple third cameras covers the parking lot;
    所述第一摄像机,用于在采集到的图像中检测驶入的车辆的车牌号,并将所述车牌号发送至所述服务器;The first camera is configured to detect the license plate number of the driving-in vehicle in the collected image, and send the license plate number to the server;
    所述服务器,用于向所述第二摄像机发送包含所述车牌号的第一通知消息,以及根据所述第二摄像机和多个所述第三摄像机当前各自采集的图像确定出停车位推荐信息,将所述停车位推荐信息通知至所述车辆;The server is configured to send a first notification message containing the license plate number to the second camera, and determine parking space recommendation information according to the current images collected by the second camera and the multiple third cameras , Notify the vehicle of the parking space recommendation information;
    所述第二摄像机,用于响应于所述第一通知消息,在采集到的图像中检测出位于所述第一道闸处的所述车辆,为所述车辆关联上所述车牌号,并对所述车辆进行跟踪;The second camera is configured to detect the vehicle located at the first barrier in the collected image in response to the first notification message, associate the license plate number for the vehicle, and Track the vehicle;
    所述第三摄像机,用于根据预先确定的摄像机之间的单应性矩阵,对所述车辆进行跟踪;The third camera is configured to track the vehicle according to a predetermined homography matrix between cameras;
    所述第二摄像机和所述第三摄像机,还用于若检测到所述车辆停到目标停车位,则向所述服务器发送第二通知消息,所述第二通知消息中包括所述车牌号和所述目标停车位的标识。The second camera and the third camera are further configured to send a second notification message to the server if it is detected that the vehicle has parked in a target parking space, and the second notification message includes the license plate number And the identification of the target parking space.
  2. 根据权利要求1所述的系统,其特征在于,所述服务器还用于:The system according to claim 1, wherein the server is further used for:
    在发送所述第一通知消息后,控制所述第一道闸开启。After sending the first notification message, control the opening of the first barrier.
  3. 根据权利要求1所述的系统,其特征在于,所述系统还包括:至少一个引导屏;The system according to claim 1, wherein the system further comprises: at least one guide screen;
    所述服务器还用于:通过所述至少一个引导屏显示所述停车位推荐信息。The server is further configured to: display the parking space recommendation information through the at least one guide screen.
  4. 根据权利要求1所述的系统,其特征在于,所述服务器还用于:The system according to claim 1, wherein the server is further used for:
    根据摄像机彼此之间的单应性矩阵,拼接同一时间所述第二摄像机和多个所述第三摄像机各自采集的图像,从拼接后的图像中确定空闲的停车位,根据所述空闲的停车位确定所述停车位推荐信息。According to the homography matrix between the cameras, the images collected by the second camera and the multiple third cameras at the same time are spliced, the free parking space is determined from the spliced images, and the free parking space is determined according to the free parking space. The parking space recommendation information is determined.
  5. 根据权利要求4所述的系统,其特征在于,所述服务器还用于:The system according to claim 4, wherein the server is further used for:
    对于将所述停车位推荐信息通知至所述车辆之后的一时间,若从与所述时间对应的拼接后的图像中确定出距离所述车辆更近的空闲停车位,则根据所述更近的空闲停车位更新所述停车位推荐信息。For a time after the parking space recommendation information is notified to the vehicle, if a free parking space closer to the vehicle is determined from the stitched image corresponding to the time, then according to the closer Update the parking space recommendation information.
  6. 根据权利要求1所述的系统,其特征在于,所述第三摄像机,具体用于若在采集的图像中检测到未关联上车牌号的车辆,则根据本地存储的单应性矩阵和所述车辆在本地坐标系中的第一坐标确定所述车辆在所述单应性矩阵对应的另一摄像机下对应的第二坐标,从所述另一摄像机中查询所述第二坐标对应的所述车辆的车牌号,在所述本地坐标系中为所述车辆关联上所述车牌号。The system according to claim 1, wherein the third camera is specifically configured to detect a vehicle that is not associated with a license plate number in the collected image according to the locally stored homography matrix and the The first coordinate of the vehicle in the local coordinate system determines the second coordinate of the vehicle corresponding to another camera corresponding to the homography matrix, and the second coordinate corresponding to the second coordinate is queried from the other camera. The license plate number of the vehicle is associated with the license plate number for the vehicle in the local coordinate system.
  7. 根据权利要求1所述的系统,其特征在于,所述服务器还用于:The system according to claim 1, wherein the server is further used for:
    接收查询设备发送的车辆查询请求,所述车辆查询请求中包括所述车牌号,确定与所述车牌号对应的所述目标停车位的标识,向所述查询设备输出所述目标停车位的标识或去往所述目标停车位的导航路线。Receive a vehicle query request sent by a query device, the vehicle query request includes the license plate number, determine the identification of the target parking space corresponding to the license plate number, and output the identification of the target parking space to the query device Or a navigation route to the target parking spot.
  8. 根据权利要求7所述的系统,其特征在于,所述查询设备为所述车辆对应的用户的终端设备,或者,所述查询设备为部署在所述停车场内的终端设备。The system according to claim 7, wherein the query device is a terminal device of a user corresponding to the vehicle, or the query device is a terminal device deployed in the parking lot.
  9. 根据权利要求7所述的系统,其特征在于,所述服务器还用于:The system according to claim 7, wherein the server is further used for:
    根据所述车辆的停车时长确定停车费用,将所述停车费用发送至所述查询设备以供进行费用支付;若完成所述停车费用的支付,则为所述车牌号关联上支付完成标记。The parking fee is determined according to the parking duration of the vehicle, and the parking fee is sent to the query device for fee payment; if the payment of the parking fee is completed, a payment completion mark is associated with the license plate number.
  10. 根据权利要求9所述的系统,其特征在于,所述系统还包括:对应于驶出方向的第二道闸以及部署在所述第二道闸处用于拍摄驶出车辆的第四摄像机;The system according to claim 9, characterized in that the system further comprises: a second barrier corresponding to the driving direction and a fourth camera deployed at the second barrier for photographing the exiting vehicle;
    所述第四摄像机,用于在采集的图像中检测出驶出的所述车辆的所述车牌号,将所述车牌号发送至所述服务器;The fourth camera is configured to detect the license plate number of the driving out vehicle in the collected image, and send the license plate number to the server;
    所述服务器,还用于在确定所述车牌号已经关联有支付完成标记时,控制所述第二道闸开启。The server is further configured to control the opening of the second barrier when it is determined that the license plate number has been associated with a payment completion mark.
  11. 根据权利要求1至10中任一项所述的系统,其特征在于,所述服务器还用于:The system according to any one of claims 1 to 10, wherein the server is further configured to:
    获取目标摄像机采集的图像,若所述图像中存在满足如下条件的两个车辆,则确定所述两个车辆存在接触现象:Acquire the image collected by the target camera, and if there are two vehicles in the image that meet the following conditions, it is determined that the two vehicles are in contact:
    所述两个车辆各自对应的图像区域的交集面积与所述两个车辆各自对应的图像区域的并集面积的比值大于预设值;The ratio of the intersection area of the respective image areas corresponding to the two vehicles to the union area of the respective image areas corresponding to the two vehicles is greater than a preset value;
    所述目标摄像机为所述第二摄像机和多个所述第三摄像机中的任一个。The target camera is any one of the second camera and the plurality of third cameras.
  12. 一种车辆监控系统,其特征在于,包括:A vehicle monitoring system is characterized in that it comprises:
    服务器,对应于驶入方向的道闸,部署在所述道闸处用于拍摄驶入车辆的第一摄像机,拍摄范围覆盖停车场的多个第二摄像机,所述多个第二摄像机中的至少一个第二摄像机的拍摄范围覆盖所述道闸处的预设范围,相邻的第二摄像机具有重叠区域;The server, corresponding to the barrier gate in the driving direction, is deployed at the barrier gate and used to photograph the first camera of the entering vehicle, and the shooting range covers multiple second cameras in the parking lot. Among the multiple second cameras The shooting range of at least one second camera covers the preset range at the barrier, and adjacent second cameras have overlapping areas;
    所述第一摄像机,用于在采集到的图像中检测驶入车辆的车牌号,并将所述车牌号发送至所述服务器;The first camera is configured to detect the license plate number of the entering vehicle in the collected image, and send the license plate number to the server;
    所述服务器,用于向所述至少一个第二摄像机发送包含所述车牌号的第一通知消息,以使所述至少一个第二摄像机在采集的图像中检测出所述驶入车辆,并为所述驶入车辆关联上所述车牌号;The server is configured to send a first notification message containing the license plate number to the at least one second camera, so that the at least one second camera detects the entering vehicle in the collected images, and is The vehicle entering the vehicle is associated with the license plate number;
    所述多个第二摄像机,用于对所述驶入车辆进行跟踪,并在检测到所述驶入车辆停到目标停车位时,则向所述服务器发送第二通知消息,所述第二通知消息中包括所述车牌号和所述目标停车位的标识。The multiple second cameras are used to track the entering vehicle, and when detecting that the entering vehicle has stopped at the target parking space, send a second notification message to the server, and the second The notification message includes the license plate number and the identification of the target parking space.
  13. 一种车辆监控方法,其特征在于,应用于服务器,所述方法包括:A vehicle monitoring method, characterized in that it is applied to a server, and the method includes:
    接收第一摄像机发送的驶入车辆的车牌号,所述第一摄像机部署在停车场的驶入方向的第一道闸处;Receiving the license plate number of the entering vehicle sent by the first camera, the first camera being deployed at the first barrier in the entering direction of the parking lot;
    向第二摄像机发送包含所述车牌号的第一通知消息,以使所述第二摄像机在采集的图像中检测出所述驶入车辆后,为所述驶入车辆关联上所述车牌号;所述第二摄像机的拍摄范围至少覆盖所述第一道闸外的预设范围;Sending a first notification message containing the license plate number to a second camera, so that after the second camera detects the entering vehicle in the collected images, it associates the entering vehicle with the license plate number; The shooting range of the second camera at least covers a preset range outside the first barrier;
    接收所述第二摄像机或第三摄像机发送的第二通知消息,所述第二通知消息中包括所述车牌号和所述驶入车辆停靠的目标停车位的标识;其中,所述第三摄像机的拍摄范围覆盖多个停车位,所述第二摄像机和所述第三摄像机对所述驶入车辆进行跟踪以确定所述目标停车位的标识。Receive a second notification message sent by the second camera or the third camera, where the second notification message includes the license plate number and the identifier of the target parking space where the incoming vehicle stops; wherein, the third camera The shooting range of covers multiple parking spaces, and the second camera and the third camera track the entering vehicle to determine the identification of the target parking space.
  14. 根据权利要求13所述的方法,其特征在于,所述方法还包括:The method of claim 13, wherein the method further comprises:
    根据所述第二摄像机和所述第三摄像机当前各自采集的图像确定出停车位推荐信息;Determining the parking space recommendation information according to the images currently collected by the second camera and the third camera;
    将所述停车位推荐信息通知至所述驶入车辆。Notifying the parking space recommendation information to the entering vehicle.
  15. 根据权利要求14所述的方法,其特征在于,所述将所述停车位推荐信息通知至所述驶入车辆,包括:The method according to claim 14, wherein said notifying said parking space recommendation information to said incoming vehicle comprises:
    通过至少一个引导屏显示所述停车位推荐信息,或者,Display the parking space recommendation information through at least one guide screen, or,
    将所述停车位推荐信息发送至所述驶入车辆对应的用户终端。The parking space recommendation information is sent to the user terminal corresponding to the entering vehicle.
  16. 根据权利要求14所述的方法,其特征在于,所述根据所述第二摄像机和所述第三摄像机当前各自采集的图像确定出停车位推荐信息,包括:The method according to claim 14, wherein the determining the parking space recommendation information according to the images currently collected by the second camera and the third camera respectively comprises:
    根据摄像机彼此之间的单应性矩阵,拼接同一时间所述第二摄像机和所述第三摄像机各自采集的图像;Splicing the images respectively collected by the second camera and the third camera at the same time according to the homography matrix between the cameras;
    从拼接后的图像中确定空闲的停车位;Determine free parking spaces from the stitched images;
    根据所述空闲的停车位确定所述停车位推荐信息。The parking space recommendation information is determined according to the free parking space.
  17. 根据权利要求16所述的方法,其特征在于,所述方法还包括:The method of claim 16, wherein the method further comprises:
    对于将所述停车位推荐信息通知至所述车辆之后的一时间,若从与所述时间对应的拼接后的图像中确定出距离所述驶入车辆更近的空闲停车位,则根据所述更近的空闲停车位更新所述停车位推荐信息。For a time after the parking space recommendation information is notified to the vehicle, if a free parking space that is closer to the entering vehicle is determined from the stitched image corresponding to the time, then according to the The more recent free parking space updates the parking space recommendation information.
  18. 根据权利要求14至17中任一项所述的方法,其特征在于,所述方法还包括:The method according to any one of claims 14 to 17, wherein the method further comprises:
    接收查询设备发送的车辆查询请求,所述车辆查询请求中包括所述车牌号;Receiving a vehicle query request sent by a query device, where the vehicle query request includes the license plate number;
    确定与所述车牌号对应的所述目标停车位的标识;Determining the identification of the target parking space corresponding to the license plate number;
    向所述查询设备输出所述目标停车位的标识或去往所述目标停车位的导航路线。Outputting the identification of the target parking space or the navigation route to the target parking space to the query device.
  19. 根据权利要求18所述的方法,其特征在于,所述查询设备为所述驶入车辆对应的用户的终端设备,或者,所述查询设备为部署在所述停车场内的终端设备。The method according to claim 18, wherein the query device is a terminal device of a user corresponding to the entering vehicle, or the query device is a terminal device deployed in the parking lot.
  20. 根据权利要求18所述的方法,其特征在于,所述方法还包括:The method of claim 18, wherein the method further comprises:
    根据所述驶入车辆的停车时长确定停车费用;Determine the parking fee according to the parking time of the entering vehicle;
    将所述停车费用发送至所述查询设备以供进行费用支付;Sending the parking fee to the query device for fee payment;
    若完成所述停车费用的支付,则为所述车牌号关联上支付完成标记。If the payment of the parking fee is completed, a payment completion mark is associated with the license plate number.
  21. 根据权利要求20所述的方法,其特征在于,所述方法还包括:The method of claim 20, wherein the method further comprises:
    接收第四摄像机发送的所述车牌号,所述第四摄像机是部署在驶出方向的第二道闸的摄像机,所述第四摄像机在采集的图像中检测出所述驶入车辆的所述车牌号;Receive the license plate number sent by the fourth camera, the fourth camera is a camera deployed at the second barrier in the exit direction, and the fourth camera detects the entry of the entering vehicle in the collected images number plate;
    在确定所述车牌号已经关联有支付完成标记时,控制所述第二道闸开启。When it is determined that the license plate number has been associated with a payment completion mark, the second barrier is controlled to open.
  22. 根据权利要求13所述的方法,其特征在于,所述方法还包括:The method of claim 13, wherein the method further comprises:
    获取目标摄像机采集的图像,若所述图像中存在满足如下条件的两个车辆,则确定所述两个车辆存在接触现象:Acquire the image collected by the target camera, and if there are two vehicles in the image that meet the following conditions, it is determined that the two vehicles are in contact:
    所述两个车辆各自对应的图像区域的交集面积与所述两个车辆各自对应的图像区域的并集面积的比值大于预设值;The ratio of the intersection area of the respective image areas corresponding to the two vehicles to the union area of the respective image areas corresponding to the two vehicles is greater than a preset value;
    所述目标摄像机为所述第二摄像机和所述第三摄像机中的任一个。The target camera is any one of the second camera and the third camera.
  23. 一种车辆监控装置,其特征在于,包括:A vehicle monitoring device, characterized in that it comprises:
    接收模块,用于接收第一摄像机发送的驶入车辆的车牌号,所述第一摄像机部署在停车场的驶入方向的第一道闸处;A receiving module, configured to receive the license plate number of the entering vehicle sent by the first camera, the first camera being deployed at the first barrier in the entering direction of the parking lot;
    发送模块,用于向第二摄像机发送包含所述车牌号的第一通知消息,以使所述第二 摄像机在采集的图像中检测出所述驶入车辆后,为所述驶入车辆关联上所述车牌号;所述第二摄像机的拍摄范围至少覆盖所述第一道闸外的预设范围;The sending module is configured to send a first notification message containing the license plate number to a second camera, so that after the second camera detects the entering vehicle in the collected images, it is associated with the entering vehicle The license plate number; the shooting range of the second camera covers at least a preset range outside the first barrier;
    所述接收模块,还用于接收所述第二摄像机或第三摄像机发送的第二通知消息,所述第二通知消息中包括所述车牌号和所述驶入车辆停靠的目标停车位的标识;其中,所述第三摄像机的拍摄范围覆盖多个停车位,所述第二摄像机和所述第三摄像机对所述驶入车辆进行跟踪以确定所述目标停车位的标识。The receiving module is further configured to receive a second notification message sent by the second camera or the third camera, where the second notification message includes the license plate number and the identification of the target parking space where the incoming vehicle stops Wherein, the shooting range of the third camera covers multiple parking spaces, and the second camera and the third camera track the entering vehicle to determine the identification of the target parking space.
  24. 一种电子设备,其特征在于,包括:存储器、处理器;其中,所述存储器上存储有可执行代码,当所述可执行代码被所述处理器执行时,使所述处理器执行如权利要求13至22中任一项所述的车辆监控方法。An electronic device, comprising: a memory and a processor; wherein executable code is stored in the memory, and when the executable code is executed by the processor, the processor is caused to execute The vehicle monitoring method described in any one of 13 to 22 is required.
  25. 一种车辆监控方法,其特征在于,应用于服务器,所述方法包括:A vehicle monitoring method, characterized in that it is applied to a server, and the method includes:
    接收第一摄像机发送的驶入车辆的车牌号,所述第一摄像机部署在停车场的驶入方向的道闸处;Receiving the license plate number of the entering vehicle sent by the first camera, the first camera being deployed at the barrier of the entering direction of the parking lot;
    向第二摄像机发送包含所述车牌号的第一通知消息,以使所述第二摄像机在采集的图像中检测出所述驶入车辆后,为所述驶入车辆关联上所述车牌号;所述第二摄像机的拍摄范围覆盖所述道闸外的预设范围以及停车场内的各停车位;Sending a first notification message containing the license plate number to a second camera, so that after the second camera detects the entering vehicle in the collected images, it associates the entering vehicle with the license plate number; The shooting range of the second camera covers the preset range outside the barrier and each parking space in the parking lot;
    接收所述第二摄像机发送的第二通知消息,所述第二通知消息中包括所述车牌号和所述驶入车辆停靠的目标停车位的标识,其中,所述第二摄像机对所述驶入车辆进行跟踪以确定所述目标停车位的标识。Receive a second notification message sent by the second camera, where the second notification message includes the license plate number and the identification of the target parking space where the incoming vehicle parks, wherein the second camera responds to the driving Enter the vehicle for tracking to determine the identification of the target parking space.
  26. 一种车辆监控装置,其特征在于,包括:A vehicle monitoring device, characterized in that it comprises:
    接收模块,用于接收第一摄像机发送的驶入车辆的车牌号,所述第一摄像机部署在停车场的驶入方向的道闸处;The receiving module is configured to receive the license plate number of the entering vehicle sent by the first camera, the first camera being deployed at the barrier of the entering direction of the parking lot;
    发送模块,用于向第二摄像机发送包含所述车牌号的第一通知消息,以使所述第二摄像机在采集的图像中检测出所述驶入车辆后,为所述驶入车辆关联上所述车牌号;所述第二摄像机的拍摄范围覆盖所述道闸外的预设范围以及停车场内的各停车位;The sending module is configured to send a first notification message containing the license plate number to a second camera, so that after the second camera detects the entering vehicle in the collected images, it is associated with the entering vehicle The license plate number; the shooting range of the second camera covers the preset range outside the barrier and each parking space in the parking lot;
    所述接收模块,还用于接收所述第二摄像机发送的第二通知消息,所述第二通知消息中包括所述车牌号和所述驶入车辆停靠的目标停车位的标识,其中,所述第二摄像机对所述驶入车辆进行跟踪以确定所述目标停车位的标识。The receiving module is further configured to receive a second notification message sent by the second camera, the second notification message including the license plate number and the identification of the target parking space where the incoming vehicle parks, wherein The second camera tracks the entering vehicle to determine the identification of the target parking space.
  27. 一种电子设备,其特征在于,包括:存储器、处理器;其中,所述存储器上存储有可执行代码,当所述可执行代码被所述处理器执行时,使所述处理器执行如权利要求25所述的车辆监控方法。An electronic device, comprising: a memory and a processor; wherein executable code is stored in the memory, and when the executable code is executed by the processor, the processor is caused to execute The vehicle monitoring method described in claim 25.
PCT/CN2020/083869 2019-04-17 2020-04-09 Vehicle monitoring method, apparatus, device and system WO2020211691A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910310436.3A CN111833637A (en) 2019-04-17 2019-04-17 Vehicle monitoring method, device, equipment and system
CN201910310436.3 2019-04-17

Publications (1)

Publication Number Publication Date
WO2020211691A1 true WO2020211691A1 (en) 2020-10-22

Family

ID=72838004

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/083869 WO2020211691A1 (en) 2019-04-17 2020-04-09 Vehicle monitoring method, apparatus, device and system

Country Status (2)

Country Link
CN (1) CN111833637A (en)
WO (1) WO2020211691A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20220292836A1 (en) * 2021-03-10 2022-09-15 FlashParking, Inc. Method and system for vehicle authentication

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113781827A (en) * 2021-09-10 2021-12-10 深圳市凯博百通信息技术有限公司 Video data management method of cloud platform and cloud platform
CN117275106B (en) * 2023-11-22 2024-02-06 浙江宇视科技有限公司 Intelligent management method and device for vehicle, electronic equipment and storage medium

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080101656A1 (en) * 2006-10-30 2008-05-01 Thomas Henry Barnes Method and apparatus for managing parking lots
KR101146583B1 (en) * 2011-11-11 2012-05-16 아이티에스엔지니어링 주식회사 Smart computer camera for identifying vehicles in parking area
CN106384532A (en) * 2015-07-31 2017-02-08 富士通株式会社 Video data analysis method and apparatus thereof, and parking space monitoring system
CN107146468A (en) * 2017-07-12 2017-09-08 中国地质大学(武汉) The recognition methods of parking position and system and management method and system
CN107657832A (en) * 2017-11-15 2018-02-02 吉林大学 A kind of parking stall bootstrap technique and system
CN107978172A (en) * 2017-11-30 2018-05-01 邓敏智 Parking lot localization method and device
CN108399782A (en) * 2018-02-11 2018-08-14 广州广电物业管理有限公司 Method, apparatus, system, equipment and the storage medium of outdoor reversed guide-car
CN108510787A (en) * 2018-05-07 2018-09-07 北京悦畅科技有限公司 Vehicle positioning method in parking lot and parking lot
CN108694853A (en) * 2018-05-31 2018-10-23 京东方科技集团股份有限公司 A kind of method that realizing the service of parking, terminal, server-side and system

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101877132B (en) * 2009-11-27 2014-03-26 北京中星微电子有限公司 Interactive event processing method and device used for motion tracking
KR20170000110A (en) * 2015-06-23 2017-01-02 (주)모가씨앤디 System and method for parking management by tracking position of vehicle
CN106469518B (en) * 2015-08-21 2019-10-22 中国电信股份有限公司 Method, server and the system of intelligent parking guidance based on video tracking identification
CN106846870A (en) * 2017-02-23 2017-06-13 重庆邮电大学 The intelligent parking system and method for the parking lot vehicle collaboration based on centralized vision
CN108389421B (en) * 2018-02-28 2020-12-22 大连海事大学 Parking lot accurate induction system and method based on image re-identification
CN109410623A (en) * 2018-10-22 2019-03-01 浙江宇视科技有限公司 Parking navigation method and device

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080101656A1 (en) * 2006-10-30 2008-05-01 Thomas Henry Barnes Method and apparatus for managing parking lots
KR101146583B1 (en) * 2011-11-11 2012-05-16 아이티에스엔지니어링 주식회사 Smart computer camera for identifying vehicles in parking area
CN106384532A (en) * 2015-07-31 2017-02-08 富士通株式会社 Video data analysis method and apparatus thereof, and parking space monitoring system
CN107146468A (en) * 2017-07-12 2017-09-08 中国地质大学(武汉) The recognition methods of parking position and system and management method and system
CN107657832A (en) * 2017-11-15 2018-02-02 吉林大学 A kind of parking stall bootstrap technique and system
CN107978172A (en) * 2017-11-30 2018-05-01 邓敏智 Parking lot localization method and device
CN108399782A (en) * 2018-02-11 2018-08-14 广州广电物业管理有限公司 Method, apparatus, system, equipment and the storage medium of outdoor reversed guide-car
CN108510787A (en) * 2018-05-07 2018-09-07 北京悦畅科技有限公司 Vehicle positioning method in parking lot and parking lot
CN108694853A (en) * 2018-05-31 2018-10-23 京东方科技集团股份有限公司 A kind of method that realizing the service of parking, terminal, server-side and system

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20220292836A1 (en) * 2021-03-10 2022-09-15 FlashParking, Inc. Method and system for vehicle authentication

Also Published As

Publication number Publication date
CN111833637A (en) 2020-10-27

Similar Documents

Publication Publication Date Title
WO2020211691A1 (en) Vehicle monitoring method, apparatus, device and system
KR102223572B1 (en) Parking management system using intelligent image analysis and management method thereof
KR101698026B1 (en) Police enfoforcement system of illegal stopping and parking vehicle by moving vehicle tracking
JP6815262B2 (en) Traffic violation detectors, systems, traffic violation detection methods and programs
JP6503218B2 (en) Driving support system, driving support device and driving support method
US7821423B2 (en) Parking control system and method
CN106781675A (en) A kind of system and method for collecting parking lot information
KR20200025247A (en) Managemnet system of parking by moving vehicle tracking
JP2011197728A (en) Shared vehicle management device
KR100725669B1 (en) Moving car recognition system
KR102227288B1 (en) parking imaging guidance management, emergency bell and security integrated system
KR20210072213A (en) Apparatus for controlling a parking, system having the same and method thereof
RU149201U1 (en) COMPLEX OF PICTURE AND VIDEO FIXATION OF VIOLATIONS OF ROAD TRAFFIC AND PARKING RULES
CN114863690B (en) Method, device, medium and electronic equipment for identifying solid line lane change
JP2017096635A (en) Destination setting system, method and program
JP7011640B2 (en) Search system
KR100839590B1 (en) System of parking control and computation method
KR102121423B1 (en) Server and method for recognizing road line using camera image
JPH0916897A (en) Method and system for parking lot management
TWM461270U (en) Vehicle entry and exist system
KR102667443B1 (en) Parking management method for residence
KR102672131B1 (en) A location-based vehicle breaker control system
JP7265611B2 (en) search system
WO2023248776A1 (en) Remote support device, remote support method, and remote support program
KR100845777B1 (en) Parking lot management system using a wide angle camera

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20791767

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20791767

Country of ref document: EP

Kind code of ref document: A1