CN106846870A - The intelligent parking system and method for the parking lot vehicle collaboration based on centralized vision - Google Patents

The intelligent parking system and method for the parking lot vehicle collaboration based on centralized vision Download PDF

Info

Publication number
CN106846870A
CN106846870A CN201710100828.8A CN201710100828A CN106846870A CN 106846870 A CN106846870 A CN 106846870A CN 201710100828 A CN201710100828 A CN 201710100828A CN 106846870 A CN106846870 A CN 106846870A
Authority
CN
China
Prior art keywords
vehicle
parking lot
intelligent
parking
service centre
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710100828.8A
Other languages
Chinese (zh)
Inventor
岑明
胡适
曾素华
李银国
孔令上
冯明驰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chongqing University of Post and Telecommunications
Original Assignee
Chongqing University of Post and Telecommunications
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chongqing University of Post and Telecommunications filed Critical Chongqing University of Post and Telecommunications
Priority to CN201710100828.8A priority Critical patent/CN106846870A/en
Publication of CN106846870A publication Critical patent/CN106846870A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/09Arrangements for giving variable traffic instructions
    • G08G1/0962Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
    • G08G1/0968Systems involving transmission of navigation instructions to the vehicle
    • G08G1/096805Systems involving transmission of navigation instructions to the vehicle where the transmitted instructions are used to compute a route
    • G08G1/096811Systems involving transmission of navigation instructions to the vehicle where the transmitted instructions are used to compute a route where the route is computed offboard
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/14Traffic control systems for road vehicles indicating individual free spaces in parking areas
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10004Still image; Photographic image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30248Vehicle exterior or interior
    • G06T2207/30252Vehicle exterior; Vicinity of vehicle

Abstract

The present invention is claimed the intelligent parking system and method for a kind of parking lot vehicle collaboration based on centralized vision.The system is made up of parking lot service centre, intelligent vehicle mobile unit and customer mobile terminal.Parking lot service centre includes vision sensor group, vehicle tracking, path planning, data management and communication module.All traffic areas in the observation scope covering parking lot of vision sensor group;The image of vehicle tracking module fusion vision sensor group collection, the position of the vehicle target in detection traffic areas and attitude;Path planning module cooks up driving path according to current vehicle position, attitude and parking stall.Mobile unit includes communication module and vehicle control module.Vehicle control module receives the path of service centre's planning, and control vehicle is by the path automatic Pilot to terminal.Customer mobile terminal is used to be sent to parking lot service centre the solicited message for sailing/rolling away from parking lot into.The present invention realizes the intellectually and automatically in vehicle discrepancy parking lot.

Description

The intelligent parking system and method for the parking lot based on centralized vision-vehicle collaboration
Technical field
The invention belongs to intelligent transportation and automation field, and in particular to a kind of parking lot based on centralized vision- The intelligent parking system and method for vehicle collaboration.
Background technology
Traditional parking lot only realizes the infrastructure service functions such as metered, parking stall inquiry, Car license recognition, automation and intelligence Level can be changed not high.Compared with motor pool, parking garage often has that environment is complicated, road is narrow, the visual field is not open The features such as, cause searching of the vehicle when sailing into idle parking stall and the searching when rolling away to vehicle all more to bother.This Outward, the solution currently for intelligent vehicle parking problem generally only focuses on single intelligent vehicle in itself so that intelligent vehicle It is limited to the global perception in parking lot, effective conspiracy relation is lacked between parking lot and vehicle, it is impossible to provide more high-quality The parking service of amount.
Chinese patent application:Method (the application number of vision-aided system and guiding vehicle:200580045956.2) it is open A kind of method of vision-aided system and guiding vehicle, the system includes that the location confirmation for collecting position data for vehicle is received Machine, the vision module that vision data is collected for vehicle.The patent is proposed using the thought of vision sensor auxiliary positioning, by GPS The visual position data weighting for obtaining position data and vision sensor acquisition obtains vehicle location, so as to aid in wagon control. Based on GPS, machine vision is auxiliary to the patent, is suitable only for being obtained in that the motor pool of gps data, and do not apply to In parking garage automatic stopping demand.Chinese patent application:A kind of auxiliary based on system of getting a bird's eye view is parked method (application number: 201310109884.X) disclose a kind of machine vision that is based on and aid in method of parking, the method is by before and after vehicle four The video camera in individual orientation carries out IMAQ come the environment to surrounding, by image processing techniques, the environment of vehicle periphery is believed Breath returns to driver in the way of image so that output result has certain intuitive.The system only relies upon vehicle-mounted sensing Device, not by between vehicle and parking lot cooperate with realize parking.Chinese patent application:A kind of full-automatic parking system (Shen Please number:CN201410215303.5 a kind of full-automatic parking system) is disclosed, is passed using the ultrasonic wave of environment information acquisition system Sensor and video camera obtain information of parking, and cook up feasible parking path, make dependent instruction, and instruction is sent into each execution machine Structure, and the actual feedback signal for obtaining carries out amendment constantly to the parking path planned, realizes the closed-loop control to vehicle.Should System equally only relies upon onboard sensor, not by between vehicle and parking lot cooperate with realize parking.Chinese patent Shen Please:A kind of intelligent vehicle automated driving system and method (application number with intelligent parking field coordination:201610107483.4) it is public A kind of and intelligent vehicle automated driving system and method for intelligent parking field coordination have been opened, vehicle and parking lot has been the method achieve Between collaboration, but background service system only carries out position distribution and Map, and environment measuring with path planning by vehicle Carry out, depend on the support of onboard sensor.Chinese patent application:Parking lot based on distributed vision-vehicle cooperative intelligent Shutdown system and method (application number:201610228232.1) a kind of parking lot based on distributed vision-vehicle association is disclosed With intelligent parking system and method, detected by distributed visual sensing device covering car park areas by parking lot service centre Target state and barrier, distribute parking spot and plan vehicle running path.The method uses distributed frame, each Vision sensor is required for a local tracker module, and when vision sensor quantity is more, cost can be higher.
The present invention sails/rolls away from demand into automatically for the vehicle of parking garage, proposes a kind of based on centralized vision Intelligent parking system and method that parking lot cooperates with vehicle, reduce the difficulty of the car that stops under complicated parking lot environment, seeks, real Show the intellectually and automatically in vehicle discrepancy parking lot, and reduce the requirement to system configuration.
The content of the invention
Present invention seek to address that above problem of the prior art.Stop under proposing one kind and reducing complicated parking lot environment Car, the difficulty for seeking car, realize the intellectually and automatically in vehicle discrepancy parking lot, and reduce requirement, drop to system configuration The intelligent parking system and method for the parking lot based on centralized vision of low cost-vehicle collaboration.Technical scheme It is as follows:
A kind of intelligent parking system of the parking lot based on centralized vision-vehicle collaboration, including parking lot service centre, Intelligent vehicle mobile unit and customer mobile terminal,
Described parking lot service centre includes vision sensor group, vehicle tracking module, path planning module, data pipe Reason module and parking lot communication module, the image sequence that the vision sensor group is used to gather parking lot traffic areas are simultaneously real When be transferred to vehicle tracking module;The vehicle tracking module receives the image sequence from vision sensor group, by inverse throwing Shadow conversion, registration and splicing, obtain the global image in parking lot, and the vehicle of parking lot traffic areas is detected on global image Target location and obstacle information, obtain parking lot real-time map;The path planning module is used for current according to intelligent vehicle Position, terminal and parking lot real-time map cook up the driving path of vehicle in real time;Data management module is used for parking stall number According to being inquired about, distributed and updated, and store parking lot real-time map, moving vehicle target location and its driving path;It is described Parking lot communication module is used to receive sails/rolls away from request into from customer mobile terminal, and path planning module is planned Driving path is sent to intelligent vehicle;
Described intelligent vehicle mobile unit includes vehicle communication module and vehicle control module two parts, and the vehicle leads to Letter module is used to receive the driving path of the path planning module planning from parking lot service centre;Vehicle control module according to The path of the parking lot service centre planning for receiving, control intelligent vehicle is by the path automatic Pilot to terminal;
Described customer mobile terminal has user terminal communication module, realize being sent to parking lot service centre sail into/ Roll the solicited message in parking lot away from, and the result of parking lot service centre transmission can be received.
Further, the vehicle tracking module is received and processes the image sequence from vision sensor group, specific bag Include following steps:
2.1 receive the real-time image sequences from vision sensor group;
Each image of 2.2 pairs of different vision sensors acquisitions for receiving is utilized respectively correspondence vision sensor and passes through parameter Demarcating the inner parameter for obtaining carries out distortion correction, then carries out Inverse projection, and the unification of each image aspects is transformed into vertical view Angle;
2.3 pairs carry out registration and splicing by each image after step 2.2 correction process and Inverse projection, are stopped Global image in;
2.4 detect target vehicle from global image and calculate its position and attitude angle, are tracked filtering and obtain target The optimal estimation of state of motion of vehicle;Barrier is detected from global image, according to target vehicle and barrier generation parking lot Real-time map.
Further, when intelligent vehicle sails parking lot into, the terminal of the path planning module planning is parking lot clothes Business center is the parking stall position of vehicle distribution;When intelligent vehicle rolls parking lot away from, the end of the path planning module planning Point is the EXIT position of user's request.
Further, during vehicle sails parking lot into, data management module is according to given parking stall distribution method (such as nearest apart from destination), searches distance and waits stop nearest idle parking stall and its a coordinate, and completed in task of sailing into Idle parking space information is updated afterwards;During vehicle rolls parking lot away from, data management module is according to target vehicle information searching phase Storing cycle position is answered, coordinate of the outlet in real-time map is searched according to outlet port, and updated after the completion of task is rolled away from empty Not busy parking space information.
A kind of intelligent parking method of the parking lot based on centralized vision of system-vehicle collaboration, works as intelligent vehicle Comprised the following steps when sailing parking lot into:
5.1 when intelligent vehicle drives to Entrance, and car owner is using customer mobile terminal to parking lot service centre Send current vehicle position and sail request into;
5.2 parking lot service centres are by sailing that customer mobile terminal in parking lot communication module receiving step 5.1 sends Enter request, after carrying out authentication, by current vehicle position information and sail request into and be transmitted to data management module, by data The idle parking stall of management module distribution, it is determined that idle parking stall position;
5.3 parking lot service centre vision sensor groups gather the image sequence of parking lot traffic areas, are real-time transmitted to Vehicle tracking module is processed, and detects the position of the position, attitude and barrier of the vehicle target of parking lot traffic areas, and Construction parking lot real-time map;
5.4 parking lot service centre path planning modules with intelligent vehicle current location as starting point, with distribute parking stall position Terminal is set to, the parking lot real-time map planning intelligent vehicle driving path according to step 5.3;
5.5 parking lot service centre communication modules travel the vehicle of the current location of intelligent vehicle, attitude and planning Path is sent to intelligent vehicle, and intelligent vehicle current location is sent into customer mobile terminal with the parking stall position of distribution;
The current location of the intelligent vehicle in 5.6 intelligent vehicle vehicle equipment communication module receiving steps 5.5, attitude and The vehicle running path of planning;
The information control that 5.7 intelligent vehicle mobile unit vehicle control modules are received according to communication module in step 5.6 Intelligent vehicle automatic Pilot;
5.8 repeat steps 5.3~5.7, until intelligent vehicle sails specified parking stall into, the task of sailing into terminates.
Further, the method when intelligent vehicle is rolled away from is comprised the following steps:
6.1 car owners send testing vehicle register, roll request away from and export using customer mobile terminal to parking lot service centre Position;
6.2 parking lot service centre communication modules are received rolls request away from, after carrying out authentication, by testing vehicle register, sails Go out request and exits location information is transmitted to data management module, search storing cycle position;
6.3 parking lot service centre vision sensor groups gather the image sequence of parking lot traffic areas, are real-time transmitted to Vehicle tracking module is processed, and detects the position of the position, attitude and barrier of the vehicle target of parking lot traffic areas, and Construction parking lot real-time map;
6.4 parking lot service centre path planning modules, with intelligent vehicle current location as starting point, are end with outlet port Point, the parking lot real-time map planning intelligent vehicle driving path according to step 6.3;
6.5 parking lot service centre communication modules travel the vehicle of the current location of intelligent vehicle, attitude and planning Path is sent to intelligent vehicle, and intelligent vehicle current location is sent into customer mobile terminal;
The current location of the intelligent vehicle in 6.6 intelligent vehicle vehicle equipment communication module receiving steps 6.5, attitude and The vehicle running path of planning;
The information control that 6.7 intelligent vehicle mobile unit vehicle control modules are received according to communication module in step 6.6 Intelligent vehicle automatic Pilot;
6.8 repeat steps 4.3~6.7, export until intelligent vehicle is reached, and the task of rolling away from terminates.
Further, step 2.2 Inverse projection, depression angle is transformed to by the unification of each image aspects;Including step Suddenly:Image coordinate geometric transformation is completed using the external parameter of video camera, is allowed to be converted into top view, the external parameter Have:The α of video camera vertical angle of view 2, the β of camera horizon visual angle 2, video camera pitching angle theta, video camera setting height(from bottom) h, make dividing for camera Resolution is m*n, then under the road surface coordinate (x, y, 0) and image coordinate system of the road surface coordinate under world coordinate system and image coordinate system Image coordinate (u, v) between relation be:
Above-mentioned formula is negated by the origin of coordinates of picture centre, is had:
Geometric transformation is carried out to source images using formula of negating and can obtain Inverse projection image.
Further, the parking lot service centre vehicle tracking module has vehicle location and multiple target tracking module, Comprise the following steps:
(1) background model is set up using the global image of continuous multiple frames;
(2) vehicle target is detected with background subtraction, search window is initialized according to testing result;
(3) initialization of Kalman filter;
(4) the target position of current time vehicle is predicted using the status information of init state information or last moment Put;
(5) vehicle target is iterated with self adaptation mean shift algorithm in certain limit near predicted value and is searched Rope, until searching best match target;
(6) Utilization assessment parameter is estimated to Search Results, judges tracking target with the presence or absence of blocking or color is dry Disturb, if Search Results mistake, Search Results are substituted using predicted value;Otherwise, using Search Results as tracking result;
(7) if the pixel value difference that continuous N frame occurs between tracking target and prediction target is more than the T situation of pixel, Fresh target is then marked as, and for fresh target distributes new search box and Kalman filter, so as to realize multiple target tracking;
(8) above-mentioned image coordinate is transformed into world coordinates, is saved in data management module, and send to path planning mould Block;
(9) state of Kalman filter is updated using tracking result, repeat step (4), (5), (6), (7), (8), Continuation is tracked to vehicle target.
Advantages of the present invention and have the beneficial effect that:
The present invention proposes the intelligent parking system and method for a kind of parking lot based on centralized vision-vehicle collaboration.This System realizes intelligent vehicle with background service center, customer mobile terminal and background service center using mobile communications network Interconnection, each state of motion of vehicle, planning vehicle running path are detected using parking lot background service center, combined with intelligent vehicle Function for Automatic Pilot, realizes vehicle and comes in and goes out the intellectually and automatically in parking lot, reduce parking under complicated parking lot environment, Seek the difficulty of car.Focused on by by the image of multiple vision sensors, reduce shutdown system configuration requirement.
Brief description of the drawings
The intelligent parking system general frame of parking lot of Fig. 1 present invention based on centralized vision-vehicle collaboration;
Fig. 2 present invention realizes that intelligent vehicle sails the flow in parking lot into automatically;
Fig. 3 present invention realizes that intelligent vehicle rolls the flow in parking lot away from automatically;
The vision sensor group of Fig. 4 parking lot service centres of the present invention sets effect;
Single vision sensor scheme of installation in Fig. 5 parking lot service centre vision sensor groups of the present invention;
The global image product process of Fig. 6 parking lot service centre vehicle tracking modules of the present invention;
The moving vehicles detection and tracking flow of Fig. 7 parking lot service centre vehicle tracking modules of the present invention.
Specific embodiment
Below in conjunction with accompanying drawing, the invention will be further described:
The present invention proposes the intelligent parking system and method for a kind of parking lot based on centralized vision-vehicle collaboration, profit Realize that intelligent vehicle-parking lot service centre, customer mobile terminal-parking lot service centre interconnect with mobile communications network, profit Each state of motion of vehicle is detected with the vision sensor group and vehicle tracking module of parking lot service centre, plan each intelligent vehicle Driving path, the Function for Automatic Pilot of combined with intelligent vehicle guides intelligent vehicle automatic Pilot, finally realizes that intelligent vehicle is automatic Sail into/roll parking lot away from.
Specific embodiment of the invention is described below in conjunction with accompanying drawing and instantiation.
It is as shown in Figure 1 a kind of intelligent parking of parking lot based on centralized vision proposed by the present invention-vehicle collaboration The general frame of system.The system is by parking lot service centre, intelligent vehicle mobile unit and the part group of customer mobile terminal three Into.
Described parking lot service centre includes vision sensor group, vehicle tracking module, path planning module, data pipe Reason module and communication module.Vision sensor group is used to gather the image sequence of parking lot traffic areas and be real-time transmitted to car Tracking module.Vehicle tracking module is received and processes the image sequence from vision sensor group, and real-time detection parking lot leads to The position of the position, attitude and barrier of the vehicle target in row region, constructs parking lot real-time map.Path planning module according to Parking lot real-time map, intelligent vehicle current location and terminal cook up driving path, wherein, intelligent vehicle sails parking lot into When terminal be parking lot service centre be the vehicle distribution parking stall position, terminal when intelligent vehicle rolls parking lot away from be use The EXIT position of family request.Data management module is used to that parking stall data to be inquired about, distributed and updated, and storage stops Parking lot real-time map, the position of moving vehicle target and its driving path.When vehicle sails parking lot into, data management module root Suitable free time parking stall and its coordinate are searched according to given parking stall distribution method, and updates idle parking space information;Rolled away from vehicle During parking lot, data management module searches stand according to information of vehicles, and outlet is searched in real-time map according to outlet port Coordinate, and idle parking space information is updated after the completion of task is rolled away from.Communication module is used to receive from customer mobile terminal Sail/roll away from request into, the driving path of planning is sent to intelligent vehicle, and intelligent vehicle current location and final position are sent out Give customer mobile terminal.
The intelligent vehicle mobile unit includes communication module and vehicle control module.Communication module is used to receive carrys out automatic stop This car driving path of the planning of parking lot service centre;Vehicle control module is planned according to the parking lot service centre for receiving Path, control intelligent vehicle is by the path automatic Pilot to terminal.
The customer mobile terminal is used to be sent to parking lot service centre the solicited message for sailing/rolling away from parking lot into, and Receive the result that parking lot service centre sends:It is intelligent vehicle current location and the parking stall position of distribution when sailing into, It is intelligent vehicle current location and exits location information when rolling away from.
It is illustrated in figure 2 the present invention and realizes that intelligent vehicle sails the flow in parking lot into automatically, comprises the following steps:
(1) when intelligent vehicle drives to Entrance, car owner is using customer mobile terminal to parking lot service centre Send current vehicle position and sail request into;
(2) parking lot service centre sails request into by what customer mobile terminal in communication module receiving step (1) sent, After carrying out authentication, by current vehicle position information and sail request into and be transmitted to data management module, by data management mould The idle parking stall of block distribution, it is determined that idle parking stall position;
(3) parking lot service centre vision sensor group gathers the image sequence of parking lot traffic areas, is real-time transmitted to Vehicle tracking module is processed, and detects the position of the position, attitude and barrier of the vehicle target of parking lot traffic areas, and Construction parking lot real-time map;
(4) parking lot service centre path planning module is with intelligent vehicle current location as starting point, with the parking stall position distributed Terminal is set to, the parking lot real-time map planning intelligent vehicle driving path according to step (3);
(5) parking lot service centre communication module travels the vehicle of the current location of intelligent vehicle, attitude and planning Path is sent to intelligent vehicle, and intelligent vehicle current location is sent into customer mobile terminal with the parking stall position of distribution;
(6) current location of the intelligent vehicle in intelligent vehicle vehicle equipment communication module receiving step (5), attitude and The vehicle running path of planning;
(7) the information control that intelligent vehicle mobile unit vehicle control module is received according to communication module in step (6) Intelligent vehicle automatic Pilot;
(8) repeat step (3)~(7), until intelligent vehicle sails specified parking stall into, the task of sailing into terminates.
It is illustrated in figure 3 the present invention and realizes that intelligent vehicle rolls the flow in parking lot away from automatically, comprises the following steps:
(1) car owner sends testing vehicle register, rolls request away from and export using customer mobile terminal to parking lot service centre Position;
(2) parking lot service centre communication module is received and rolls request away from, after carrying out authentication, by testing vehicle register, is sailed Go out request and exits location information is transmitted to data management module, search storing cycle position;
(3) parking lot service centre vision sensor group gathers the image sequence of parking lot traffic areas, is real-time transmitted to Vehicle tracking module is processed, and detects the position of the position, attitude and barrier of the vehicle target of parking lot traffic areas, and Construction parking lot real-time map;
(4) parking lot service centre path planning module, with intelligent vehicle current location as starting point, is end with outlet port Point, the parking lot real-time map planning intelligent vehicle driving path according to step (3);
(5) parking lot service centre communication module travels the vehicle of the current location of intelligent vehicle, attitude and planning Path is sent to intelligent vehicle, and intelligent vehicle current location and outlet port are sent into customer mobile terminal;
(6) current location of the intelligent vehicle in intelligent vehicle vehicle equipment communication module receiving step (5), attitude and The vehicle running path of planning;
(7) the information control that intelligent vehicle mobile unit vehicle control module is received according to communication module in step (6) Intelligent vehicle automatic Pilot;
(8) repeat step (3)~(7), export until intelligent vehicle is reached, and the task of rolling away from terminates.
The vision sensor group for being illustrated in figure 4 parking lot service centre of the present invention sets effect example.
Comprising the multiple vision sensors installed in different location in parking lot, each vision in the vision sensor group The observation scope of sensor overlaps, but the whole in the union covering parking lot of multiple vision sensor observation scopes comes in and goes out Mouth region domain and traffic areas.This example is only used for description vision sensor group and sets effect, is not only limited in this kind of field in figure Scape.
Fig. 5 show single vision sensor scheme of installation in parking lot service centre vision sensor group of the present invention. If the origin of parking lot global coordinate system is O (0,0,0), the coordinate of vision sensor C as an example is (xc,yc,h).Vision Sensor C includes external parameter:2 α (vertical angle of view), 2 β (horizontal view angle), θ (angle of pitch), h (height).Wherein, setting height(from bottom) H is fixed, and remaining parameter can be obtained by demarcating.
Fig. 6 show the global image product process of parking lot service centre vehicle tracking module of the present invention, including following Step:
(1) image of vision sensor group collection is received, line distortion is entered respectively to the image from each vision sensor Correction;
(2) Inverse projection is carried out respectively to the image from each vision sensor, is allowed to be converted into top view.If The resolution ratio of vision sensor C is m*n, according to vision sensor image-forming principle, corresponding to the world coordinate system of vision sensor C Under coordinate (x, y, 0) and image coordinate system under coordinate (u, v) between relation be:
Inverse projection relation can be solved from above-mentioned formula (1)-(2):
(3) homography matrix between the top view image for being obtained according to Inverse projection, maps an image to stop one by one Parking lot global coordinate system, carries out fusion and edge smoothing treatment, obtains global image.
Fig. 7 show the moving vehicles detection and tracking flow of parking lot service centre vehicle tracking module of the present invention, including with Lower step:
(1) initialize:Set up background model using the global image of continuous multiple frames, setting vehicle attitude angle from -90 ° to [180/R] is individual altogether for 90 ° of template, and wherein R is template group resolution ratio, and initializes Kalman filter;
(2) vehicle target is detected using background subtraction, search window is initialized according to testing result;
(3) using the status information of init state information or last moment according to Kalman filter to predict current when Carve the position of vehicle target;
(4) continuous adaptive mean shift algorithm (Continuously is used in certain limit near predicted value Adaptive Mean-SHIFT, CamShift) search is iterated to vehicle target, until searching best match target;
(5) Utilization assessment parameter is estimated to Search Results, judge tracking target block with the presence or absence of serious or Color is disturbed, if Search Results mistake, Search Results is substituted using predicted value;Otherwise, using Search Results as tracking As a result;
(6) if the pixel value difference that continuous N frame occurs between tracking target and prediction target is more than the T situation of pixel, Fresh target is then marked as, and for fresh target distributes new search box and Kalman filter, so as to realize many vehicle targets Tracking;
(7) image of each vehicle target to detecting, is matched, then best match template pair with attitude Angle formwork The angle the answered as current attitude angle of the vehicle;
(8) state of Kalman filter is updated using tracking result,
(9) repeat step (3)-(9), continuation is tracked to vehicle target.
The above embodiment is interpreted as being merely to illustrate the present invention rather than limits the scope of the invention. Read after the content of record of the invention, technical staff can make various changes or modifications to the present invention, these equivalent changes Change and modification equally falls into the scope of the claims in the present invention.

Claims (5)

1. the intelligent parking system that a kind of parking lot based on centralized vision-vehicle is cooperateed with, it is characterised in that:Including parking lot Service centre, intelligent vehicle mobile unit and the part of customer mobile terminal three, wherein
The parking lot service centre includes vision sensor group, vehicle tracking module, path planning module, data management module And communication module, vision sensor group is for gathering the image sequence of parking lot traffic areas and being real-time transmitted to vehicle tracking Module;The vehicle tracking module receives the image sequence from vision sensor group, by Inverse projection, registration and spelling Connect, obtain the global image in parking lot, position, the attitude of the vehicle target of parking lot traffic areas are detected on global image And the position of barrier, construct parking lot real-time map;Path planning module is current according to parking lot real-time map, intelligent vehicle Position and terminal cook up driving path;Data management module is used to that parking stall data to be inquired about, distributed and updated, and deposits Storage parking lot real-time map, the position of moving vehicle target and its driving path;Communication module is used to receive from user's movement Request is sailed/rolled away to terminal into, and the driving path of planning is sent into intelligent vehicle;
The intelligent vehicle mobile unit includes communication module and vehicle control module, and communication module is used to receive from parking lot This car driving path of the planning of service centre;Vehicle control module controls intelligent vehicle according to the path of the planning for receiving By the path automatic Pilot to terminal;
The customer mobile terminal is used to be sent to parking lot service centre the solicited message for sailing/rolling away from parking lot into, and receives The result that parking lot service centre sends.
2. the intelligent parking system that the parking lot based on centralized vision according to claim 1-vehicle is cooperateed with, its feature It is:Can realize that intelligent vehicle sails the specified location in parking lot into from parking automatically outside the venue, and be sailed automatically from parking lot Go out to specified outlet.
3. the intelligent parking system that the parking lot based on the centralized vision-vehicle of system according to claim 1,2 is cooperateed with, Characterized in that, the intelligent vehicle method of sailing into is comprised the following steps:
3.1 when intelligent vehicle drives to Entrance, and car owner is sent using customer mobile terminal to parking lot service centre Current vehicle position and sail request into;
3.2 parking lot service centres sail request into by what customer mobile terminal in communication module receiving step 3.1 sent, carry out After authentication, by current vehicle position information and sail request into and be transmitted to data management module, by data management module point With idle parking stall, it is determined that idle parking stall position;
3.3 parking lot service centre vision sensor groups gather the image sequence of parking lot traffic areas, are real-time transmitted to vehicle Tracking module is processed, and detects the position of the position, attitude and barrier of the vehicle target of parking lot traffic areas, and is constructed Parking lot real-time map;
With intelligent vehicle current location as starting point, the parking stall position with distribution is 3.4 parking lot service centre path planning modules Terminal, the parking lot real-time map planning intelligent vehicle driving path according to step 3.3;
3.5 parking lot service centre communication modules are by the vehicle running path of the current location of intelligent vehicle, attitude and planning Intelligent vehicle is sent to, and intelligent vehicle current location is sent to customer mobile terminal with the parking stall position of distribution;
The current location of the intelligent vehicle in 3.6 intelligent vehicle vehicle equipment communication module receiving steps 3.5, attitude and planning Vehicle running path;
The information that 3.7 intelligent vehicle mobile unit vehicle control modules are received according to communication module in step 3.6 controls intelligence Vehicular automatic driving;
3.8 repeat steps 3.3~3.7, until intelligent vehicle sails specified parking stall into, the task of sailing into terminates.
4. the intelligent parking system that the parking lot based on the centralized vision-vehicle of system according to claim 1,2 is cooperateed with, Characterized in that, intelligent vehicle rolls method away from comprising the following steps:
4.1 car owners send testing vehicle register, roll request and outlet port away from using customer mobile terminal to parking lot service centre;
4.2 parking lot service centre communication modules are received rolls request away from, and after carrying out authentication, by testing vehicle register, rolling away from please Ask and exits location information is transmitted to data management module, search storing cycle position;
4.3 parking lot service centre vision sensor groups gather the image sequence of parking lot traffic areas, are real-time transmitted to vehicle Tracking module is processed, and detects the position of the position, attitude and barrier of the vehicle target of parking lot traffic areas, and is constructed Parking lot real-time map;
4.4 parking lot service centre path planning modules with intelligent vehicle current location as starting point, with outlet port as terminal, root According to the parking lot real-time map planning intelligent vehicle driving path of step 4.3;
4.5 parking lot service centre communication modules are by the vehicle running path of the current location of intelligent vehicle, attitude and planning Intelligent vehicle is sent to, and intelligent vehicle current location and outlet port are sent to customer mobile terminal;
The current location of the intelligent vehicle in 4.6 intelligent vehicle vehicle equipment communication module receiving steps 4.5, attitude and planning Vehicle running path;
The information that 4.7 intelligent vehicle mobile unit vehicle control modules are received according to communication module in step 4.6 controls intelligence Vehicular automatic driving;
4.8 repeat steps 4.3~4.7, export until intelligent vehicle is reached, and the task of rolling away from terminates.
5. according to claim 1 and 2 the parking lot service centre vehicle tracking module of system method for tracking target, it is special Levy and be, comprised the following steps in each process cycle:
5.1 receive the real-time image sequences from vision sensor group;
Each image of 5.2 pairs of different vision sensors acquisitions for receiving is utilized respectively correspondence vision sensor and passes through parameter calibration The inner parameter of acquisition carries out distortion correction, then carries out Inverse projection, and the unification of each image aspects is transformed into depression angle;
5.3 pairs carry out registration and splicing by each image after step 5.2 correction process and Inverse projection, obtain in parking lot Global image;
5.4 detect target vehicle from global image, are tracked the optimal estimation that filtering obtains target vehicle motion state;From Barrier is detected in global image, the real-time map in parking lot is generated according to target vehicle and barrier.
CN201710100828.8A 2017-02-23 2017-02-23 The intelligent parking system and method for the parking lot vehicle collaboration based on centralized vision Pending CN106846870A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710100828.8A CN106846870A (en) 2017-02-23 2017-02-23 The intelligent parking system and method for the parking lot vehicle collaboration based on centralized vision

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710100828.8A CN106846870A (en) 2017-02-23 2017-02-23 The intelligent parking system and method for the parking lot vehicle collaboration based on centralized vision

Publications (1)

Publication Number Publication Date
CN106846870A true CN106846870A (en) 2017-06-13

Family

ID=59134825

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710100828.8A Pending CN106846870A (en) 2017-02-23 2017-02-23 The intelligent parking system and method for the parking lot vehicle collaboration based on centralized vision

Country Status (1)

Country Link
CN (1) CN106846870A (en)

Cited By (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107146468A (en) * 2017-07-12 2017-09-08 中国地质大学(武汉) The recognition methods of parking position and system and management method and system
CN107633694A (en) * 2017-09-04 2018-01-26 浙江省邮电工程建设有限公司 A kind of parking management system of pilotless automobile
CN108045377A (en) * 2017-12-12 2018-05-18 途客思科技(天津)有限公司 The method and system of intelligent mobile vehicle
CN108198450A (en) * 2017-12-26 2018-06-22 佛山市道静科技有限公司 A kind of intelligent parking system based on wireless telecommunications
CN108230708A (en) * 2018-01-25 2018-06-29 贵州宜行智通科技有限公司 Vehicle is driven out to Pathfinding system and method
CN108399785A (en) * 2018-03-15 2018-08-14 斑马网络技术有限公司 Find the method, apparatus and storage medium of vehicle
CN109631896A (en) * 2018-07-23 2019-04-16 同济大学 A kind of parking lot autonomous parking localization method based on vehicle vision and motion information
CN109817013A (en) * 2018-12-19 2019-05-28 新大陆数字技术股份有限公司 Parking stall state identification method and device based on video flowing
CN109859260A (en) * 2017-11-30 2019-06-07 华为技术有限公司 Determine the method, apparatus and computer readable storage medium of parking stall position
CN110032195A (en) * 2019-05-06 2019-07-19 广东工业大学 A kind of Vehicular automatic driving system
CN110126817A (en) * 2018-12-16 2019-08-16 初速度(苏州)科技有限公司 A kind of method and system parked or recalled between adaptive arbitrary point and fixed point
CN110271540A (en) * 2018-03-15 2019-09-24 罗伯特·博世有限公司 Method for controlling a vehicle and system for guiding vehicle
CN110444044A (en) * 2019-08-27 2019-11-12 纵目科技(上海)股份有限公司 Vehicle pose detection system, terminal and storage medium based on ultrasonic sensor
CN110689761A (en) * 2019-12-11 2020-01-14 上海赫千电子科技有限公司 Automatic parking method
CN110706501A (en) * 2018-07-09 2020-01-17 上海擎感智能科技有限公司 Off-vehicle intelligent service interaction method, on-vehicle terminal and storage medium
CN110874950A (en) * 2018-09-03 2020-03-10 上海博泰悦臻电子设备制造有限公司 Navigation system/method for parking of user, computer readable storage medium and device
CN111311952A (en) * 2020-02-27 2020-06-19 平安国际智慧城市科技股份有限公司 Control method and device for vehicle parking, computer equipment and storage medium
CN111326001A (en) * 2020-02-26 2020-06-23 中国联合网络通信集团有限公司 Method and device for automatic driving
CN111397611A (en) * 2020-03-05 2020-07-10 北京百度网讯科技有限公司 Path planning method and device and electronic equipment
CN111833637A (en) * 2019-04-17 2020-10-27 阿里巴巴集团控股有限公司 Vehicle monitoring method, device, equipment and system
CN111845714A (en) * 2019-04-26 2020-10-30 东莞潜星电子科技有限公司 Automatic parking system based on intelligent visual deep learning
CN111862609A (en) * 2020-07-27 2020-10-30 湖南汽车工程职业学院 Parking lot parking path selection method based on 5G technology
CN111951598A (en) * 2019-05-17 2020-11-17 杭州海康威视数字技术股份有限公司 Vehicle tracking monitoring method, device and system
CN112002032A (en) * 2019-05-07 2020-11-27 孙占娥 Method, device, equipment and computer readable storage medium for guiding vehicle driving
CN112863213A (en) * 2020-12-26 2021-05-28 武汉光庭信息技术股份有限公司 Unmanned parking system and method based on automatic driving
CN112863225A (en) * 2019-11-28 2021-05-28 长城汽车股份有限公司 Method and device for passenger-replacing parking
CN112908016A (en) * 2020-12-24 2021-06-04 南京酷朗电子有限公司 Method for guiding vehicle driving based on parking space monitoring camera shooting
CN113129640A (en) * 2019-12-31 2021-07-16 北京四维图新科技股份有限公司 Automatic parking method and equipment
CN113324552A (en) * 2021-05-28 2021-08-31 上海国际汽车城(集团)有限公司 Intelligent automobile high-precision map system based on edge calculation
CN113401116A (en) * 2020-03-16 2021-09-17 哥白尼汽车有限责任公司 Method and system for autonomous driving of a vehicle
WO2021203868A1 (en) * 2020-04-08 2021-10-14 华为技术有限公司 Data processing method and device
CN114360278A (en) * 2021-11-29 2022-04-15 江铃汽车股份有限公司 Parking control method and system
CN115126312A (en) * 2022-04-11 2022-09-30 上海萃钛智能科技有限公司 Intelligent stereo garage and unmanned parking and warehousing method
CN115273531A (en) * 2022-07-15 2022-11-01 孙楚 Intelligent parking management system based on Internet of things
CN115424468A (en) * 2022-06-01 2022-12-02 星即科技(上海)有限公司 Parking stall detecting system based on many cameras fuse
CN115909795A (en) * 2023-03-09 2023-04-04 斯润天朗(北京)科技有限公司 Autonomous parking system and method based on parking lot cooperation

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030122687A1 (en) * 2001-12-27 2003-07-03 Philips Electronics North America Corportion Computer vision based parking assistant
KR20050078676A (en) * 2004-01-31 2005-08-08 엄두섭 Parking management system
CN102819965A (en) * 2012-08-27 2012-12-12 红门智能科技股份有限公司 Parking guidance and searching system for parking lot
CN103871271A (en) * 2014-03-26 2014-06-18 陕西科技大学 Underground parking lot intelligent guiding system and guiding method thereof
CN204258976U (en) * 2014-12-10 2015-04-08 泉州市宇云电子科技有限公司 A kind of vehicle-mounted panoramic visible system
CN105702083A (en) * 2016-04-13 2016-06-22 重庆邮电大学 Distributed vision-based parking lot-vehicle cooperative intelligent parking system and method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030122687A1 (en) * 2001-12-27 2003-07-03 Philips Electronics North America Corportion Computer vision based parking assistant
KR20050078676A (en) * 2004-01-31 2005-08-08 엄두섭 Parking management system
CN102819965A (en) * 2012-08-27 2012-12-12 红门智能科技股份有限公司 Parking guidance and searching system for parking lot
CN103871271A (en) * 2014-03-26 2014-06-18 陕西科技大学 Underground parking lot intelligent guiding system and guiding method thereof
CN204258976U (en) * 2014-12-10 2015-04-08 泉州市宇云电子科技有限公司 A kind of vehicle-mounted panoramic visible system
CN105702083A (en) * 2016-04-13 2016-06-22 重庆邮电大学 Distributed vision-based parking lot-vehicle cooperative intelligent parking system and method

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
刘敬坤: "室内移动机器人的动态路径规划", 《中国优秀硕士学位论文全文数据库 信息科技辑》 *
孟庆斌: "基于单目视觉的智能小车障碍物检测研究", 《中国优秀硕士学位论文全文数据库》 *
张宝龙 等: "一种针对车载全景系统的图像拼接算法的仿真", 《电子与信息学报》 *
杨钰超: "汽车全景图像主动安全系统的设计与实现", 《中国优秀硕士学位论文全文数据库 信息科技辑》 *
王鹏程: "基于多图像传感器融合的全景泊车辅助系统研究", 《中国优秀硕士学位论文全文数据库 工程科技Ⅱ辑》 *

Cited By (43)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107146468A (en) * 2017-07-12 2017-09-08 中国地质大学(武汉) The recognition methods of parking position and system and management method and system
CN107633694A (en) * 2017-09-04 2018-01-26 浙江省邮电工程建设有限公司 A kind of parking management system of pilotless automobile
CN109859260B (en) * 2017-11-30 2021-02-12 华为技术有限公司 Method and device for determining parking position and computer readable storage medium
CN109859260A (en) * 2017-11-30 2019-06-07 华为技术有限公司 Determine the method, apparatus and computer readable storage medium of parking stall position
CN108045377A (en) * 2017-12-12 2018-05-18 途客思科技(天津)有限公司 The method and system of intelligent mobile vehicle
CN108198450A (en) * 2017-12-26 2018-06-22 佛山市道静科技有限公司 A kind of intelligent parking system based on wireless telecommunications
CN108230708A (en) * 2018-01-25 2018-06-29 贵州宜行智通科技有限公司 Vehicle is driven out to Pathfinding system and method
CN110271540A (en) * 2018-03-15 2019-09-24 罗伯特·博世有限公司 Method for controlling a vehicle and system for guiding vehicle
CN108399785A (en) * 2018-03-15 2018-08-14 斑马网络技术有限公司 Find the method, apparatus and storage medium of vehicle
CN110706501A (en) * 2018-07-09 2020-01-17 上海擎感智能科技有限公司 Off-vehicle intelligent service interaction method, on-vehicle terminal and storage medium
CN109631896B (en) * 2018-07-23 2020-07-28 同济大学 Parking lot autonomous parking positioning method based on vehicle vision and motion information
CN109631896A (en) * 2018-07-23 2019-04-16 同济大学 A kind of parking lot autonomous parking localization method based on vehicle vision and motion information
CN110874950A (en) * 2018-09-03 2020-03-10 上海博泰悦臻电子设备制造有限公司 Navigation system/method for parking of user, computer readable storage medium and device
CN110126817A (en) * 2018-12-16 2019-08-16 初速度(苏州)科技有限公司 A kind of method and system parked or recalled between adaptive arbitrary point and fixed point
CN110126817B (en) * 2018-12-16 2023-01-06 魔门塔(苏州)科技有限公司 Method and system for self-adapting to parking or recalling between any point and fixed point
CN109817013A (en) * 2018-12-19 2019-05-28 新大陆数字技术股份有限公司 Parking stall state identification method and device based on video flowing
CN111833637A (en) * 2019-04-17 2020-10-27 阿里巴巴集团控股有限公司 Vehicle monitoring method, device, equipment and system
CN111845714A (en) * 2019-04-26 2020-10-30 东莞潜星电子科技有限公司 Automatic parking system based on intelligent visual deep learning
CN110032195A (en) * 2019-05-06 2019-07-19 广东工业大学 A kind of Vehicular automatic driving system
CN112002032A (en) * 2019-05-07 2020-11-27 孙占娥 Method, device, equipment and computer readable storage medium for guiding vehicle driving
CN111951598B (en) * 2019-05-17 2022-04-26 杭州海康威视数字技术股份有限公司 Vehicle tracking monitoring method, device and system
CN111951598A (en) * 2019-05-17 2020-11-17 杭州海康威视数字技术股份有限公司 Vehicle tracking monitoring method, device and system
CN110444044A (en) * 2019-08-27 2019-11-12 纵目科技(上海)股份有限公司 Vehicle pose detection system, terminal and storage medium based on ultrasonic sensor
CN112863225A (en) * 2019-11-28 2021-05-28 长城汽车股份有限公司 Method and device for passenger-replacing parking
CN110689761A (en) * 2019-12-11 2020-01-14 上海赫千电子科技有限公司 Automatic parking method
CN113129640A (en) * 2019-12-31 2021-07-16 北京四维图新科技股份有限公司 Automatic parking method and equipment
CN111326001A (en) * 2020-02-26 2020-06-23 中国联合网络通信集团有限公司 Method and device for automatic driving
CN111311952A (en) * 2020-02-27 2020-06-19 平安国际智慧城市科技股份有限公司 Control method and device for vehicle parking, computer equipment and storage medium
CN111397611A (en) * 2020-03-05 2020-07-10 北京百度网讯科技有限公司 Path planning method and device and electronic equipment
CN113401116A (en) * 2020-03-16 2021-09-17 哥白尼汽车有限责任公司 Method and system for autonomous driving of a vehicle
WO2021203868A1 (en) * 2020-04-08 2021-10-14 华为技术有限公司 Data processing method and device
CN111862609A (en) * 2020-07-27 2020-10-30 湖南汽车工程职业学院 Parking lot parking path selection method based on 5G technology
CN112908016B (en) * 2020-12-24 2022-06-03 南京酷朗电子有限公司 Method for guiding vehicle driving based on parking space monitoring camera shooting
CN112908016A (en) * 2020-12-24 2021-06-04 南京酷朗电子有限公司 Method for guiding vehicle driving based on parking space monitoring camera shooting
CN112863213A (en) * 2020-12-26 2021-05-28 武汉光庭信息技术股份有限公司 Unmanned parking system and method based on automatic driving
CN113324552A (en) * 2021-05-28 2021-08-31 上海国际汽车城(集团)有限公司 Intelligent automobile high-precision map system based on edge calculation
CN113324552B (en) * 2021-05-28 2023-03-14 上海国际汽车城(集团)有限公司 Intelligent automobile high-precision map system based on edge calculation
CN114360278A (en) * 2021-11-29 2022-04-15 江铃汽车股份有限公司 Parking control method and system
CN115126312A (en) * 2022-04-11 2022-09-30 上海萃钛智能科技有限公司 Intelligent stereo garage and unmanned parking and warehousing method
CN115424468A (en) * 2022-06-01 2022-12-02 星即科技(上海)有限公司 Parking stall detecting system based on many cameras fuse
CN115273531A (en) * 2022-07-15 2022-11-01 孙楚 Intelligent parking management system based on Internet of things
WO2024012604A1 (en) * 2022-07-15 2024-01-18 孙楚 Intelligent parking management system based on internet of things
CN115909795A (en) * 2023-03-09 2023-04-04 斯润天朗(北京)科技有限公司 Autonomous parking system and method based on parking lot cooperation

Similar Documents

Publication Publication Date Title
CN106846870A (en) The intelligent parking system and method for the parking lot vehicle collaboration based on centralized vision
CN105702083B (en) Parking lot based on distributed vision-vehicle cooperative intelligent shutdown system and method
CN106846892A (en) Parking lot vehicle cooperative intelligent shutdown system and method based on machine vision
CN105946853B (en) The system and method for long range automatic parking based on Multi-sensor Fusion
CN105539430B (en) A kind of people's car mutual intelligent parking method based on handheld terminal
CN103465906B (en) A kind of parking area automatic train stop implementation method based on telepresenc
CN107093328A (en) Parking ground navigation system and method based on machine vision
CN103473951B (en) A kind of Automatic Carpark Control System based on telepresenc
US20170267233A1 (en) Method for autonomous vehicle parking
CN105679068A (en) Intelligent vehicle automatic driving system and method in cooperation with intelligent parking lot
CN107745710B (en) A kind of automatic parking method and system based on machine vision and machine learning
CN109733384A (en) Parking path setting method and system
CN109741617A (en) A kind of parking lot is parked air navigation aid and device
CN107605219B (en) A kind of adaptive indoor parking navigation and automated parking system and method based on BLE
CN105654773A (en) Intelligent guide system of vehicle-mounted flight-accompanying unmanned plane
CN110310500A (en) A kind of autonomous valet parking system and method based on GRNN network
CN103386975A (en) Vehicle obstacle avoidance method and system based on machine vision
CN106680290A (en) Multifunctional detection vehicle in narrow space
CN107389084A (en) Planning driving path planing method and storage medium
CN106584451A (en) Visual navigation based transformer substation automatic composition robot and method
CN206623754U (en) Lane detection device
CN113071518B (en) Automatic unmanned driving method, minibus, electronic equipment and storage medium
CN110264727A (en) Multi-mode autonomous intelligence unmanned systems and method towards intelligence community parking application
CN109094556A (en) A kind of automatic parking method and system based on parking stall characteristic point
CN107578483A (en) A kind of electric non-stop toll method of commerce, server and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20170613

RJ01 Rejection of invention patent application after publication