US10214206B2 - Parking assist system for vehicle - Google Patents
Parking assist system for vehicle Download PDFInfo
- Publication number
- US10214206B2 US10214206B2 US15/206,801 US201615206801A US10214206B2 US 10214206 B2 US10214206 B2 US 10214206B2 US 201615206801 A US201615206801 A US 201615206801A US 10214206 B2 US10214206 B2 US 10214206B2
- Authority
- US
- United States
- Prior art keywords
- vehicle
- travel
- path
- assist system
- parking
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012545 processing Methods 0.000 claims description 23
- 238000004422 calculation algorithm Methods 0.000 claims description 16
- 238000000034 method Methods 0.000 claims description 13
- 230000008859 change Effects 0.000 claims description 11
- 238000005457 optimization Methods 0.000 claims description 11
- 230000001133 acceleration Effects 0.000 claims description 7
- 230000008569 process Effects 0.000 claims description 6
- 230000036461 convulsion Effects 0.000 claims description 5
- 238000003384 imaging method Methods 0.000 description 26
- 238000001514 detection method Methods 0.000 description 9
- 230000001960 triggered effect Effects 0.000 description 5
- 238000004364 calculation method Methods 0.000 description 4
- 238000004891 communication Methods 0.000 description 4
- 238000010276 construction Methods 0.000 description 4
- 238000007726 management method Methods 0.000 description 3
- 238000013459 approach Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 230000000903 blocking effect Effects 0.000 description 2
- 230000000593 degrading effect Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000009499 grossing Methods 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 239000013598 vector Substances 0.000 description 2
- 241001465754 Metazoa Species 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 239000010426 asphalt Substances 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 231100001261 hazardous Toxicity 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000002372 labelling Methods 0.000 description 1
- 239000003550 marker Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000013139 quantization Methods 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
- 238000002604 ultrasonography Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W30/00—Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units, or advanced driver assistance systems for ensuring comfort, stability and safety or drive control systems for propelling or retarding the vehicle
- B60W30/06—Automatic manoeuvring for parking
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B62—LAND VEHICLES FOR TRAVELLING OTHERWISE THAN ON RAILS
- B62D—MOTOR VEHICLES; TRAILERS
- B62D15/00—Steering not otherwise provided for
- B62D15/02—Steering position indicators ; Steering position determination; Steering aids
- B62D15/027—Parking aids, e.g. instruction means
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B62—LAND VEHICLES FOR TRAVELLING OTHERWISE THAN ON RAILS
- B62D—MOTOR VEHICLES; TRAILERS
- B62D15/00—Steering not otherwise provided for
- B62D15/02—Steering position indicators ; Steering position determination; Steering aids
- B62D15/027—Parking aids, e.g. instruction means
- B62D15/0285—Parking performed automatically
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2420/00—Indexing codes relating to the type of sensors based on the principle of their operation
- B60W2420/40—Photo or light sensitive means, e.g. infrared sensors
- B60W2420/403—Image sensing, e.g. optical camera
-
- B60W2420/408—
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2420/00—Indexing codes relating to the type of sensors based on the principle of their operation
- B60W2420/42—Image sensing, e.g. optical camera
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2420/00—Indexing codes relating to the type of sensors based on the principle of their operation
- B60W2420/52—Radar, Lidar
-
- B60W2550/10—
-
- B60W2550/20—
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2554/00—Input parameters relating to objects
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2554/00—Input parameters relating to objects
- B60W2554/40—Dynamic objects, e.g. animals, windblown objects
- B60W2554/402—Type
- B60W2554/4029—Pedestrians
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2554/00—Input parameters relating to objects
- B60W2554/40—Dynamic objects, e.g. animals, windblown objects
- B60W2554/408—Traffic behavior, e.g. swarm
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2554/00—Input parameters relating to objects
- B60W2554/60—Traversable objects, e.g. speed bumps or curbs
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2720/00—Output or target parameters relating to overall vehicle dynamics
- B60W2720/10—Longitudinal speed
- B60W2720/106—Longitudinal acceleration
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2720/00—Output or target parameters relating to overall vehicle dynamics
- B60W2720/12—Lateral speed
- B60W2720/125—Lateral acceleration
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2720/00—Output or target parameters relating to overall vehicle dynamics
- B60W2720/24—Direction of travel
Definitions
- the present invention relates generally to a parking assist system for a vehicle and, more particularly, to a parking assist system that utilizes a plurality of sensors at a vehicle.
- the present invention provides a parking assist system or vision system or imaging system for a vehicle that utilizes one or more cameras (preferably one or more CMOS cameras) and/or other sensors to capture data representative of objects and roads exterior of the vehicle, and determines a path of travel for the vehicle from its initial or current location to a determined target parking space.
- the system may determine the target parking space responsive to information received from a remote source (such as a parking lot management system or the like) or based on sensor data captured by one or more sensors of the vehicle.
- the system may then determine the path of travel for the vehicle based on the steering capabilities of the vehicle and based on other parameters, including preferred acceleration and deceleration parameters and obstacles and the like that are determined to be in the path of travel (such as responsive to data processing of data captured by the vehicle cameras or sensors).
- FIG. 1 is a plan view of a vehicle with a vision system that incorporates sensors in accordance with the present invention
- FIG. 2 is a plan view of an environment having parking spaces at which a vehicle may be parked via the automated parking assist system of the present invention
- FIG. 3A is a schematic showing minimum turning radii for a vehicle at a parking space
- FIG. 3B are schematics showing different parking slots and entry/exit nodes or knots having different directions which are given by the turning radii of the vehicle of FIG. 3A , with the parking space in FIG. 3A having no bordering lines while in FIG. 3B there are some (solid) borderlines that limit the entry and exit nodes;
- FIGS. 4A-I are flow charts showing operational steps of the automated parking assist system of the present invention.
- FIG. 5A shows the entry/exit path of a parallel parking spot constructed using straight driving path sections and circles which represent the maximum turning circle for the automated parking assist system of the present invention, where the black dots along the path can be used as nodes of the path's sections which are subject of optimization by optimal control by using a cost function and borderline constraints;
- FIG. 5B shows the entry/exit path with its nodes using straight driving path sections (in between the nodes) and circles which represent the maximum turning circle for the automated parking assist system of the present invention, whereby, with addition of another straight path section and another path construction circle, a full S-shape exit/entry—path can be constructed which can also be optimized by optimal control in accordance with the present invention;
- FIG. 5C shows parking strategies for a parallel parking slot for the automated parking assist system of the present invention, showing the turning points (or reversal nodes), where the narrower the parking lot gets the more maneuvers have to be executed (and the more nodes have to be set), with the path of the top strategy in FIG. 5C comprising consecutive s-shape paths similar to those shown in FIG. 5B ;
- FIG. 6 shows a sequence of maneuvers for a vehicle to park via the automated parking assist system of the present invention
- FIG. 7 shows options for how a vehicle may be reversed by the automated parking assist system of the present invention
- FIG. 8 shows the start end entry point (nodes) of a parking lot having both left hand and right hand minimal vehicle turning circles drawn tangent to the start end entry nodes and with both nodes having a center line drawn in direction of their heading;
- FIG. 9 shows the parking lot entry/exit path construction of FIG. 8 , additionally having the tangential lines drawn from the starting nodes circles to the entry nodes circles;
- FIG. 10 shows the parking lot entry/exit path construction of FIGS. 8 and 9 , showing all circles with minimum turning radius plus a margin tangent to two of the following: [start circle or straight], [one end circle or straight], and center line;
- FIGS. 11A-11D are schematics showing possible paths A, B, C and D for a vehicle controlled by the automated parking assist system of the present invention
- FIG. 11E shows the resulting path of processing the possible parking lot entry/exit path D from FIG. 11D via an OCA in accordance with the present invention
- FIG. 12 is a schematic showing the angles used in the equations used in determining how a vehicle controlled by the automated parking assist system of the present invention may be controlled when a curb is present;
- FIG. 13A shows the determined path from the starting point to a desired parking spot before optimizing the path for entering curbs, shown with the vehicle backing up;
- FIG. 13B shows there is a sharp angle ⁇ of the rear right tire of a vehicle before optimizing (section of the path in FIG. 13A );
- FIG. 13C shows that the angle ⁇ has increased by setting a way point in short before the curb and one short behind for optimizing (section of the path in FIG. 13D ) for the rear tire to enter the curb;
- FIG. 13D shows the entering path of parking spot optimized for overcoming the curb
- FIGS. 14 and 15 are schematics showing how a vehicle controlled by the automated parking assist system of the present invention may be reversed.
- a parking assist system and/or vehicle vision system and/or driver assist system and/or object detection system and/or alert system operates to capture data exterior of the vehicle and may process the captured data to detect objects at or near the vehicle and in a predicted path of the vehicle, such as to assist a driver of the vehicle in maneuvering the vehicle in a rearward direction or such as to control the vehicle along a determined or selected path of travel.
- the system may include a plurality of cameras or image sensors and an image processor or image processing system that is operable to receive image data from one or more of the cameras and optionally other sensors and processing systems to determine objects or obstacles and the like along the determined path of travel.
- a vehicle 10 includes an imaging system or vision system 12 that includes at least one exterior facing imaging sensor or camera, such as a rearward facing imaging sensor or camera 14 a (and the system may optionally include multiple exterior facing imaging sensors or cameras, such as a forwardly facing camera 14 b at the front (or at the windshield) of the vehicle, and a sidewardly/rearwardly facing camera 14 c , 14 d at respective sides of the vehicle), which captures images exterior of the vehicle, with the camera having a lens for focusing images at or onto an imaging array or imaging plane or imager of the camera ( FIG. 1 ).
- an imaging system or vision system 12 that includes at least one exterior facing imaging sensor or camera, such as a rearward facing imaging sensor or camera 14 a (and the system may optionally include multiple exterior facing imaging sensors or cameras, such as a forwardly facing camera 14 b at the front (or at the windshield) of the vehicle, and a sidewardly/rearwardly facing camera 14 c , 14 d at respective sides of the vehicle), which captures images
- a forward viewing camera may be disposed at the windshield of the vehicle and view through the windshield and forward of the vehicle, such as for a machine vision system (such as for traffic sign recognition, headlamp control, pedestrian detection, collision avoidance, lane marker detection and/or the like).
- the vision system 12 includes a control or electronic control unit (ECU) or processor 18 that is operable to process image data captured by the camera or cameras and may detect objects or the like and/or provide displayed images at a display device 16 for viewing by the driver of the vehicle (although shown in FIG. 1 as being part of or incorporated in or at an interior rearview mirror assembly 20 of the vehicle, the control and/or the display device may be disposed elsewhere at or in the vehicle).
- the data transfer or signal communication from the camera to the ECU may comprise any suitable data or communication link, such as a vehicle network bus or the like of the equipped vehicle.
- the system While driving autonomously, the system may not have an exact measurement of the whole situation from start to finish or may have just a portion of it, it only knows the rough task of where to go. But the system (responsive to data processing of data captured by the vehicle sensors) has knowledge about the near surroundings that are of interest. Therefore, the system can derive a rough plan of where to drive considering obstacles, driveways, and the like, but typically plans for the next few meters only (inside the area well known).
- the system may first find a possible way to head in direction of the target, then define a distant knot or node (a node may be an inter-waypoint, turning point or target point) on this path in known areas, and then plan a precise path to this node and drive the vehicle along the path section in between the nodes and repeat the steps with gained knowledge while driving.
- a distant knot or node a node may be an inter-waypoint, turning point or target point
- OCA Optimal Control algorithms
- Optimal Control algorithms are of additional interest as they are able to define an enhanced or optimal standard. However, if it turns out that the calculation costs are too high some kind of geometrical construction for the path could be thought of as well. But these normally struggle with the non-holonomic characteristics of a vehicle.
- the vehicle should stay to the right when the traffic is a right hand traffic, and on the left when the traffic is left hand traffic, but with a certain distance to parking vehicles—if the surroundings allow this. In narrow passages it is best to stay in the middle. This task may be part of automated driving.
- FIG. 3A shows all three six entry points, from these on the right the vehicle will have to back up in.
- FIG. 3B the entry points are limited by (solid) parking spot borderlines. Examples are for parallel parking, perpendicular parking and unclassified parking (which can be understood as either parallel or perpendicular depending on which side the parking slot gets approached). See FIGS. 3A, 3B and 5A -C for strategies for parallel parking situations. Since parking slots are not always rectangular parking slots, they can be interpreted as quadrangles, and diagonal parking spaces can be interpreted as perpendicular parking spaces.
- the extreme entry nodes for approaches from the far left or right can be found by assuming circles the outline of a vehicle take by driving the minimum radius (at maximum steering angle) as shown in FIG. 5A (the minimum turning radius of the vehicle may be provided to the control or system as an input or preprogrammed therein for the particular vehicle equipped with the parking assist system or any suitable means).
- the minimum turning radius of the vehicle may be provided to the control or system as an input or preprogrammed therein for the particular vehicle equipped with the parking assist system or any suitable means.
- circled and straight path elements to an entry path such as shown in FIG. 5B , eventually with changing the driving direction path trajectories can be found which lead the parking entry point in the desired vehicle orientation.
- the system does not intend the vehicle to end up right at the front or rear border of a parking slot but at a defined position in the middle, by that straight driving elements may be added to the driving path (last stroke) (see dotted arrow in FIG.
- FIGS. 3B and 5C see FIGS. 3B and 5C (lowest).
- the system can move the turning circles to avoid sweeps inside the parking slot.
- FIG. 5C the middle and the highest examples show more narrow parking slots. For entering lower ones more direction changes will be necessary. It is possible to also construct these trajectories by adding straight and circled path elements to one another.
- the system includes a simple set of rules which works in situations where the vehicle needs to turn and/or shift.
- the objectives include:
- An ego vehicle with inherent environmental sensors such as, for example, visual cameras, infrared cameras, ultrasound sensors, time of flight (TOF) sensors, LIDAR sensors, RADAR sensors or gray level transition sensors (such as described in U.S. Publication No. US-2016-0096477, which is hereby incorporated herein by reference in its entirety) and sensor processing system may be given.
- the vehicle may have devices for remote data communication (radio waves, optically, acoustically).
- a rough road scene map may be generated or input.
- It may have been transmitted from remote (such as, for example, from a parking lot management system, parking house management system, remote parking spot providing server system, or the like) or may be generated by processing of a scene understanding system of a vehicle sensor processing system, such as by utilizing aspects of the systems described in U.S. Publication No. US-2015-0344028, which is hereby incorporated herein by reference in its entirety.
- the scene may have been detected and stored while the vehicle was driving along a parking area such as a city road side, parking lot or such like passing occupied and free parking spaces.
- the free parking spaces (PS) may have been entered to the scene map such as shown in FIG. 2 and one of the spaces may have been chosen (given) as a target parking lot (such as, for example, P 2 in the example of FIG. 2 ) for the automated parking assist system (APAS) of the present invention.
- APAS automated parking assist system
- the system may have a rough scene map with a current position the (ego-) vehicle V 0 is within and a target position.
- the map may also contain at least the ‘non drivable space’ (OS), the ‘drivable free space’ (FS), ‘unknown, so far not detected space supposedly free’ (UF), ‘unknown, so far not detected space supposedly not drivable’ (UO).
- the map may contain additionally the heights of the space components (3 rd dimension), timestamp and scoring parameters (availability, reliability) of each grid element (alternatively the may map may be vector based instead of grid based, by that the third dimension may than be expressed in the vectors), a labeling of the drivable terrain (for example, ‘interlocking pavement type 1, 2, 3 . . . ’, ‘asphalt’, ‘gravel’ and the like) and of the non-drivable terrain or obstacles (such as ‘man made structure’, ‘nature’, ‘human’, ‘animal’ or ‘vehicle’ or the like).
- the system may first calculate (or plan) and simulate the general parking path before executing the parking maneuver.
- the simulation may be split into a (rough) geometrically constructed path (strategy) planning and a consecutive smoothing phase based on a numerical minimization algorithm called optimal control [algorithm] (OCA) specified further below.
- OCA optimal control [algorithm]
- the remaining path may become newly replanned, updated or revised as parts of the prior unknown or roughly detected scene elements may come into sensor range and by that be detected or determined more precisely, or the scene may change during execution.
- the park planner may have to react by altering the planned path upon such a scene change (such as, for example, when a neighboring parking lot gets occupied, and by that time the scene is not drivable any more (the free space (FS) changes to occupied space (OS)) and the planner has to reflect this new restriction in the path planning.
- FS free space
- OS occupied space
- the path gets likely more complicated than less by such changes.
- the chosen or target parking space will become unreachable.
- the driving task then will have to be aborted.
- the system may not replan the entering path, but just stop and wait (for a certain duration) until the pedestrians have left the parking space or path to it.
- Automated Parking is a sub-functionality of autonomous driving. Every driving task can be defined as driving from A to B. With autonomous driving, the system separates the whole task in steps, still driving from A to B, but then to C and so on. This leads to a chain of nodes on your way A 0 , A 1 , . . . A f , with A 0 being the start position and A f the final position. Because the system only needs to find its way to the next A k , it still just needs to drive “from A to B”.
- the system may use two algorithms: planning of a path from A to B while considering the drivable area and the vehicle's abilities; and setting nodes to guide the vehicle around major obstacles while still considering the drivable area and the vehicle's abilities (these nodes can also be used to define a necessary direction of travel).
- the given parking spot may be classified and a preferred entry point (EP) and entry orientation may be determined, see FIGS. 3 and 4A -C.
- EP entry point
- the classification may also state whether a specific driving scheme shall be selected for maneuvering within the parking lot (for accurate orientation and positioning). Since driving tasks within a parking lot have a high similarity the use of pre-optimized trajectory templates appears more effective than drafting and optimizing that paths (within a parking lot) always freely (as alternative firstly option), see FIG. 5 .
- the entering and turning around may be done at once (see (1) in FIG. 6 ).
- the turning around may utilize a pre-optimized trajectory template such as shown in FIG. 7 , or in an alternative option the turning around may be planned freely. In all cases a narrowing to the parking lot will be planned to be done then.
- an entering maneuver or as optional alternative (from first) a maneuver towards the entering point (EP) may then be required. This may be done by entering directly (comparably easy case), see (2), (3), (4) in FIG. 3 or (the comparably complicated case) may require one or several strokes (which may affect a full or partial turn around (again)), see (1) in FIG. 3 .
- the result will be a general driving strategy for reaching and entering the parking spot or the result will be that the parking task was mistakenly given since the parking spot isn't enterable and is to be aborted.
- the general driving strategies path may be given into a OCA which task it is to smoothen the path drafted by the driving strategy planner, see FIG. 4I .
- the OCA will maintain the turning points (number of strokes) drafted by the strategy planner.
- the drive controller may be of a type of cascade control with subordinate speed control, setpoint feedforward, and anti-reset wind up.
- the path planning procedure may be redone from time to time to adapt the planning to either driving control deviations (being derived from the planned path or speed profile), scene detection deviations (when the scene turns out to be different than earlier detections or scene data transmissions (from remote)) or path planning deviations (mistakes or errors occurred (such as, for example, quantization errors)).
- the path planning may be redone time triggered (such as redone as often as possible, or in a time scheme), driving distance triggered (at, for example, certain way markers such as described in U.S. provisional application Ser. No. 62/330,558, filed May 2, 2016, and U.S. Publication No. US-2016-0162747, and such as by utilizing aspects of U.S. provisional application Ser. No. 62/222,268, filed Sep. 23, 2015, and/or Ser. No. 62/266,734, filed Dec.
- threshold triggered such as exceeding deviation threshold such of one of these mentioned above, such as, for example, when the drive control deviation may exceed a value higher in lateral driving than driving longitudinal between every way point
- event triggered such as by being reinduced from higher prioritized control
- change of context such as, for example, when the user may have changed a parameter setting such as taking away the limitation ‘don't plan to cross or enter curbs’ or the like).
- a general parking lot entering path or a path to the EP can be geometrically constructed by the procedure described in the chart:
- cost map or cost function For choosing one preferred path out of all possible constructed paths a cost map or cost function may be used:
- an OCA may optionally be used for smoothen the prior drafted path D, such as shown in FIG. 11E .
- the path in FIG. 11E may be the result of optimizing the prior constructed Path D (shown in FIG. 11D ) by the OCA according the invention as specified below.
- the resulting strokes may be neither circled nor straight.
- the heading at the turning direction node prior and part of the turn may be mostly identical.
- the OCA may use a discrete solution method since these imply that these have finite dimensions that can be solved by a sequential quadratic programming (SQP).
- SQL sequential quadratic programming
- SQP requires a starting solution (of the general path). This is given by the prior geometrical planning done in the fourth step above.
- the nodes have to be set to guide the vehicle around major obstacles while still considering the drivable area and the vehicle's abilities (These nodes can also be used to define a necessary direction of travel).
- the OCA is capable to reflect these constraints while optimizing to (minimization-) objectives which characterize a ‘good’ path. These may include:
- the objectives can be expressed as a cost function (CF), additionally there are constraints and boundary conditions.
- CF cost function
- the parameters to control the vehicle accordingly along the path such as the acceleration ratio at the beginning and the deceleration ratio at the ending of a stroke (so that there is no overshooting).
- the processing may abort as being sufficient when a path optimization underruns a certain CF threshold.
- the input should be set as best as possible in the beginning, by that the nodes should be set in a way that the obstacle avoidance is already quite well.
- the path should have an as lowest complexity as possible and the distance between nodes should be short for keeping the optimizing complexity low.
- the OCA may find local minima only. To find the global minimum, several starting conditions should be tried. But as stated before, the system does not need to find the absolute (global) optimum but just a feasible solution is sufficient. It has not been proven yet whether the optimal control problem is always stable. But these kind of algorithms have been used successfully for path planning frequently. Especially when the OCA starts from an already semi optimized path which generally leads from one node to another.
- the system may optionally be able to solve special path planning tasks given by certain additional constrains: for example, for entering a curb (half way or with the full extension of the vehicle) of a substantial height it is to desire that the path of every involved vehicle wheel is above a certain angle ⁇ uncritically to damage the tire or the rim, see FIG. 12 .
- the APAS of the invention has to add two extra nodes into the planned park space entering path, one short before the specific wheel is entering the curb one short behind which lead to a stump angle across the curb. This measure may lead to slight altering of the outcome of the driving strategy (see examples of FIG. 13A before and FIG.
- FIGS. 13B and 13C show the angle of the rear tire in example.
- the optimization is also done for the front tire using the optimized path of FIG. 13D ). It may happen that additional strokes are required to enter a parking slot.
- the angle constraint may not be implemented by setting two close nodes close to the curb but by adding a boundary condition as additional input to the minimization task when invoking the OCA starting on a prior geometrically drafted path (as usual) without having the curb angle constrain reflected during that drafting.
- the speed profile may also be optimized for overcoming a curb.
- the initial speed may be chosen in a way that the kinetic energy of the moving vehicle is slightly above the required energy for lifting the vehicle over the curb's slope.
- the APAS of the present invention may typically have the task to enter a specific parking lot with a specific heading out of a position with a given heading.
- templates for turning around were presented.
- the algorithm of the APAS system of the present invention may check whether one of the turning around templates—‘patches’ may fit into the given free space, see FIG. 14 .
- the turning around for entering the specific parking lot at a different heading as the vehicle is actually in is not possible due to the drivable space is to narrow. In such situations, it may be decided that the vehicle is driving towards an area large enough for turning, for coming back in another heading direction, see FIG. 15 .
- the present invention provides a parking assist system that determines a path for the vehicle to follow from a current or initial location to a parked location at a selected or target parking space.
- the parking assist system determines the path by selecting from possible paths available to the controlled vehicle, with the possible paths being determined in accordance with the turning capabilities of the vehicle and other parameters.
- the system adjusts the path as the vehicle moves along the initial path and as more details are obtained via the sensors of the vehicle (such as exterior viewing cameras or TOF sensors or RADAR sensors or LIDAR sensors or the like).
- the parking assist system of the present invention may utilize aspects of the systems described in U.S. Pat. No. 8,874,317 and/or U.S. Publication Nos. US-2015-0344028; US-2015-0251599; US-2015-0158499; US-2015-0124096 and/or US-2014-0375476, which are all hereby incorporated herein by reference in their entireties.
- the parking assist system of the present invention thus may initially conduct an environment detection using its sensors, and then may conduct a context analysis to determine which free spaces may be parking spots.
- the system may then approximate a path towards an entry node of a chosen parking spot using circled and straight path sections.
- the system then is operable to smooth the path of travel of the vehicle, which equates to making it more comfortable for the passenger by employing an optimal control algorithm (OCA) under use of a cost function (minimization function).
- OCA optimal control algorithm
- Minimization function cost function
- the camera or sensor may comprise any suitable camera or sensor.
- the camera may comprise a “smart camera” that includes the imaging sensor array and associated circuitry and image processing circuitry and electrical connectors and the like as part of a camera module, such as by utilizing aspects of the vision systems described in International Publication Nos. WO 2013/081984 and/or WO 2013/081985, which are hereby incorporated herein by reference in their entireties.
- the system includes an image processor operable to process image data captured by the camera or cameras, such as for detecting objects or other vehicles or pedestrians or the like in the field of view of one or more of the cameras.
- the image processor may comprise an image processing chip selected from the EyeQ family of image processing chips available from Mobileye Vision Technologies Ltd. of Jerusalem, Israel, and may include object detection software (such as the types described in U.S. Pat. Nos. 7,855,755; 7,720,580 and/or 7,038,577, which are hereby incorporated herein by reference in their entireties), and may analyze image data to detect vehicles and/or other objects.
- the system may generate an alert to the driver of the vehicle and/or may generate an overlay at the displayed image to highlight or enhance display of the detected object or vehicle, in order to enhance the driver's awareness of the detected object or vehicle or hazardous condition during a driving maneuver of the equipped vehicle.
- the vehicle may include any type of sensor or sensors, such as imaging sensors or radar sensors or lidar sensors or ladar sensors or ultrasonic sensors or the like.
- the imaging sensor or camera may capture image data for image processing and may comprise any suitable camera or sensing device, such as, for example, a two dimensional array of a plurality of photosensor elements arranged in at least 640 columns and 480 rows (at least a 640 ⁇ 480 imaging array, such as a megapixel imaging array or the like), with a respective lens focusing images onto respective portions of the array.
- the photosensor array may comprise a plurality of photosensor elements arranged in a photosensor array having rows and columns.
- the imaging array has at least 300,000 photosensor elements or pixels, more preferably at least 500,000 photosensor elements or pixels and more preferably at least 1 million photosensor elements or pixels.
- the imaging array may capture color image data, such as via spectral filtering at the array, such as via an RGB (red, green and blue) filter or via a red/red complement filter or such as via an RCC (red, clear, clear) filter or the like.
- the logic and control circuit of the imaging sensor may function in any known manner, and the image processing and algorithmic processing may comprise any suitable means for processing the images and/or image data.
- the vision system and/or processing and/or camera and/or circuitry may utilize aspects described in U.S. Pat. Nos. 8,694,224; 7,005,974; 5,760,962; 5,877,897; 5,796,094; 5,949,331; 6,302,545; 6,396,397; 6,498,620; 6,523,964; 6,611,202; 6,201,642; 6,690,268; 6,717,610; 6,757,109; 6,802,617; 6,806,452; 6,822,563; 6,891,563; 6,946,978; 7,859,565; 5,550,677; 5,670,935; 7,881,496; 7,720,580; 7,038,577; 6,882,287; 5,929,786 and/or 5,786,772, and/or International Publication Nos.
- the system may communicate with other communication systems via any suitable means, such as by utilizing aspects of the systems described in International Publication Nos. WO/2010/144900; WO 2013/043661 and/or WO 2013/081985, and/or U.S. Publication No. US-2012-0062743, which are hereby incorporated herein by reference in their entireties.
- the imaging device and control and image processor and any associated illumination source may comprise any suitable components, and may utilize aspects of the cameras (such as various imaging sensors or imaging array sensors or cameras or the like, such as a CMOS imaging array sensor, a CCD sensor or other sensors or the like) and vision systems described in U.S. Pat. Nos.
- the camera module and circuit chip or board and imaging sensor may be implemented and operated in connection with various vehicular vision-based systems, and/or may be operable utilizing the principles of such other vehicular systems, such as a vehicle headlamp control system, such as the type disclosed in U.S. Pat. Nos. 5,796,094; 6,097,023; 6,320,176; 6,559,435; 6,831,261; 7,004,606; 7,339,149 and/or 7,526,103, which are all hereby incorporated herein by reference in their entireties, a rain sensor, such as the types disclosed in commonly assigned U.S. Pat. Nos.
- a vehicle vision system such as a forwardly, sidewardly or rearwardly directed vehicle vision system utilizing principles disclosed in U.S. Pat. Nos.
- a reverse or sideward imaging system such as for a lane change assistance system or lane departure warning system or for a blind spot or object detection system, such as imaging or detection systems of the types disclosed in U.S. Pat. Nos. 7,881,496; 7,720,580; 7,038,577; 5,929,786 and/or 5,786,772, which are hereby incorporated herein by reference in their entireties, a video device for internal cabin surveillance and/or video telephone function, such as disclosed in U.S. Pat. Nos. 5,760,962; 5,877,897; 6,690,268 and/or 7,370,983, and/or U.S. Publication No.
- the circuit board or chip may include circuitry for the imaging array sensor and or other electronic accessories or features, such as by utilizing compass-on-a-chip or EC driver-on-a-chip technology and aspects such as described in U.S. Pat. Nos. 7,255,451 and/or 7,480,149 and/or U.S. Publication Nos. US-2010-0097469 and/or US-2006-0061008, which are hereby incorporated herein by reference in their entireties.
- the vision system may include a display for displaying images captured by one or more of the imaging sensors for viewing by the driver of the vehicle while the driver is normally operating the vehicle.
- the vision system may include a video display device utilizing aspects of the display systems described in U.S. Pat. Nos.
- the vision system (utilizing the forward facing camera and a rearward facing camera and other cameras disposed at the vehicle with exterior fields of view) may be part of or may provide a display of a top-down view or birds-eye view system of the vehicle or a surround view at the vehicle, such as by utilizing aspects of the vision systems described in International Publication Nos. WO 2010/099416; WO 2011/028686; WO 2012/075250; WO 2013/019795; WO 2012/075250; WO 2012/145822; WO 2013/081985; WO 2013/086249 and/or WO 2013/109869, and/or U.S. Publication No. US-2012-0162427, which are hereby incorporated herein by reference in their entireties.
Abstract
A parking assist system of a vehicle includes a plurality of sensors disposed at a vehicle and having respective fields of sensing exterior of the vehicle. A vehicle control is operable to determine a target parking space responsive to the processor. The control (i) uses two intersecting lines, with one passing through a start node and one passing through an end node, (ii) uses circles that are tangent to respective ones of the intersecting lines, with each circle having a radius that approximates a minimum turning radius of the vehicle, and (iii) determines possible paths of travel using straight path sections tangent to one or more of the circles and curved path sections that follow a curvature of one or more of the circles. The control selects a target path of travel in accordance with a plurality of objectives for the path of travel of the vehicle.
Description
The present application claims the filing benefits of U.S. provisional application Ser. No. 62/191,683, filed Jul. 13, 2015, which is hereby incorporated herein by reference in its entirety.
The present invention relates generally to a parking assist system for a vehicle and, more particularly, to a parking assist system that utilizes a plurality of sensors at a vehicle.
Use of imaging sensors in vehicle imaging systems is common and known. Examples of such known systems are described in U.S. Pat. Nos. 5,949,331; 5,670,935 and/or 5,550,677, which are hereby incorporated herein by reference in their entireties.
The present invention provides a parking assist system or vision system or imaging system for a vehicle that utilizes one or more cameras (preferably one or more CMOS cameras) and/or other sensors to capture data representative of objects and roads exterior of the vehicle, and determines a path of travel for the vehicle from its initial or current location to a determined target parking space. The system may determine the target parking space responsive to information received from a remote source (such as a parking lot management system or the like) or based on sensor data captured by one or more sensors of the vehicle. The system may then determine the path of travel for the vehicle based on the steering capabilities of the vehicle and based on other parameters, including preferred acceleration and deceleration parameters and obstacles and the like that are determined to be in the path of travel (such as responsive to data processing of data captured by the vehicle cameras or sensors).
These and other objects, advantages, purposes and features of the present invention will become apparent upon review of the following specification in conjunction with the drawings.
A parking assist system and/or vehicle vision system and/or driver assist system and/or object detection system and/or alert system operates to capture data exterior of the vehicle and may process the captured data to detect objects at or near the vehicle and in a predicted path of the vehicle, such as to assist a driver of the vehicle in maneuvering the vehicle in a rearward direction or such as to control the vehicle along a determined or selected path of travel. The system may include a plurality of cameras or image sensors and an image processor or image processing system that is operable to receive image data from one or more of the cameras and optionally other sensors and processing systems to determine objects or obstacles and the like along the determined path of travel.
Referring now to the drawings and the illustrative embodiments depicted therein, a vehicle 10 includes an imaging system or vision system 12 that includes at least one exterior facing imaging sensor or camera, such as a rearward facing imaging sensor or camera 14 a (and the system may optionally include multiple exterior facing imaging sensors or cameras, such as a forwardly facing camera 14 b at the front (or at the windshield) of the vehicle, and a sidewardly/rearwardly facing camera 14 c, 14 d at respective sides of the vehicle), which captures images exterior of the vehicle, with the camera having a lens for focusing images at or onto an imaging array or imaging plane or imager of the camera (FIG. 1 ). Optionally, a forward viewing camera may be disposed at the windshield of the vehicle and view through the windshield and forward of the vehicle, such as for a machine vision system (such as for traffic sign recognition, headlamp control, pedestrian detection, collision avoidance, lane marker detection and/or the like). The vision system 12 includes a control or electronic control unit (ECU) or processor 18 that is operable to process image data captured by the camera or cameras and may detect objects or the like and/or provide displayed images at a display device 16 for viewing by the driver of the vehicle (although shown in FIG. 1 as being part of or incorporated in or at an interior rearview mirror assembly 20 of the vehicle, the control and/or the display device may be disposed elsewhere at or in the vehicle). The data transfer or signal communication from the camera to the ECU may comprise any suitable data or communication link, such as a vehicle network bus or the like of the equipped vehicle.
While driving autonomously, the system may not have an exact measurement of the whole situation from start to finish or may have just a portion of it, it only knows the rough task of where to go. But the system (responsive to data processing of data captured by the vehicle sensors) has knowledge about the near surroundings that are of interest. Therefore, the system can derive a rough plan of where to drive considering obstacles, driveways, and the like, but typically plans for the next few meters only (inside the area well known). For example, the system may first find a possible way to head in direction of the target, then define a distant knot or node (a node may be an inter-waypoint, turning point or target point) on this path in known areas, and then plan a precise path to this node and drive the vehicle along the path section in between the nodes and repeat the steps with gained knowledge while driving.
Optimal Control algorithms (OCA) find local minima only, to find the global minimum, several starting conditions would need to be tried. However, as discussed above, the system does not need to find the global optimum, but just a feasible solution.
Optimal Control algorithms are of additional interest as they are able to define an enhanced or optimal standard. However, if it turns out that the calculation costs are too high some kind of geometrical construction for the path could be thought of as well. But these normally struggle with the non-holonomic characteristics of a vehicle.
Assuming that the system knows how to drive to the next node without a change of driving direction while avoiding all static obstacles (for moving obstacles it probably just has to wait for them to disappear or set additional nodes to get around them), all the system needs is a concept to place those nodes in a useful manner:
-
- Change of direction
- Separation of path into small parts
- Positioning of vehicle to get better measurements of surroundings by the sensors
- Guidance along obstacles like bottlenecks, curbs, parking space boundaries, traffic (for example avoiding traffic on two-lane road) and/or the like.
It seems useful to break down the drive into different parts to be able to place nodes in the right manner—this reflects the behavior of a human driver. Some general rules include:
-
- Determine traffic flow in direction of parking spot;
- If the parking space is far away: Get in traffic flow and drive towards parking space (doing this might require to turn (reverse) the vehicle);
- If the park slot is narrow, it has a predefined entry node;
- Get the vehicle to the parking slot entry node; and
- If necessary the vehicle should be reversed as near to the parking slot as possible.
If the vehicle initially is far away from the parking spot it may be necessary to get into the traffic flow to approach it. For a parking lot the vehicle should stay to the right when the traffic is a right hand traffic, and on the left when the traffic is left hand traffic, but with a certain distance to parking vehicles—if the surroundings allow this. In narrow passages it is best to stay in the middle. This task may be part of automated driving.
It is useful to classify parking slots by the open sides from which the slot can be approached. The dotted parking spot in FIG. 3A shows all three six entry points, from these on the right the vehicle will have to back up in. In FIG. 3B the entry points are limited by (solid) parking spot borderlines. Examples are for parallel parking, perpendicular parking and unclassified parking (which can be understood as either parallel or perpendicular depending on which side the parking slot gets approached). See FIGS. 3A, 3B and 5A -C for strategies for parallel parking situations. Since parking slots are not always rectangular parking slots, they can be interpreted as quadrangles, and diagonal parking spaces can be interpreted as perpendicular parking spaces.
The extreme entry nodes for approaches from the far left or right can be found by assuming circles the outline of a vehicle take by driving the minimum radius (at maximum steering angle) as shown in FIG. 5A (the minimum turning radius of the vehicle may be provided to the control or system as an input or preprogrammed therein for the particular vehicle equipped with the parking assist system or any suitable means). By adding circled and straight path elements to an entry path such as shown in FIG. 5B , eventually with changing the driving direction path trajectories can be found which lead the parking entry point in the desired vehicle orientation. The system does not intend the vehicle to end up right at the front or rear border of a parking slot but at a defined position in the middle, by that straight driving elements may be added to the driving path (last stroke) (see dotted arrow in FIG. 5A ). As the parking slot is open at the front or back, it is easy to correct the end-position and end-orientation within the spot, see FIGS. 3B and 5C (lowest). The system can move the turning circles to avoid sweeps inside the parking slot. As shown in FIG. 5C , the middle and the highest examples show more narrow parking slots. For entering lower ones more direction changes will be necessary. It is possible to also construct these trajectories by adding straight and circled path elements to one another.
It is only necessary to analytically place an entry node if the parking slot is narrow (to make sure the system can find a way in without too much routing inside the parking slot) depending on the side that the vehicle is approaching it from. But even if it is possible to plan a path directly to the final parking position it is beneficial to define an entry node. This can be located on the calculated path in a defined distance to the final parking position.
In tight spaces and while reversing a vehicle it is necessary to understand some basics regarding vehicle maneuverability (such as by determining circles representative of the vehicle's turning radius or minimum turning radius):
-
- To find out whether a vehicle can turn without hitting an obstacle the system can assume the minimum turning radius, calculate the inner and outer circle for the outline of the vehicle and check or determine whether an obstacle is too near or too far away.
- The minimum turning radius would not allow to react on control deviations, so it should be widened a little. This also helps with smoothening of paths which gets done by the optimal control algorithms.
- An easy path (nothing more than a simple S-turn) is not available if one node is inside the minimum radius (rmin) turning circle of its predecessor. But normally one or more complex paths can be found.
- If the minimum distance dmin of each two centers of the minimum radius turning circles is at least 2×rmin an easy path between these two nodes exists.
- If the minimum distance dmin of each two centers of the minimum radius turning circles is between rmin and 2 rmin, the angle of easily reachable nodes is dependent on its position and the distance of the node from the center of the minimum turning circle.
If an easy path can be found to drive from A to B it should be taken. If not, the system includes a simple set of rules which works in situations where the vehicle needs to turn and/or shift. The objectives include:
-
- Avoid traffic if possible;
- Minimize the number of sweeps;
- Minimize the maneuvering zone;
- Minimize steering;
- Avoid curbs;
- Maximize distance to obstacles.
An ego vehicle with inherent environmental sensors (such as, for example, visual cameras, infrared cameras, ultrasound sensors, time of flight (TOF) sensors, LIDAR sensors, RADAR sensors or gray level transition sensors (such as described in U.S. Publication No. US-2016-0096477, which is hereby incorporated herein by reference in its entirety) and sensor processing system may be given. Optionally, the vehicle may have devices for remote data communication (radio waves, optically, acoustically). A rough road scene map may be generated or input. It may have been transmitted from remote (such as, for example, from a parking lot management system, parking house management system, remote parking spot providing server system, or the like) or may be generated by processing of a scene understanding system of a vehicle sensor processing system, such as by utilizing aspects of the systems described in U.S. Publication No. US-2015-0344028, which is hereby incorporated herein by reference in its entirety.
The scene may have been detected and stored while the vehicle was driving along a parking area such as a city road side, parking lot or such like passing occupied and free parking spaces. The free parking spaces (PS) may have been entered to the scene map such as shown in FIG. 2 and one of the spaces may have been chosen (given) as a target parking lot (such as, for example, P2 in the example of FIG. 2 ) for the automated parking assist system (APAS) of the present invention. By that the system may have a rough scene map with a current position the (ego-) vehicle V0 is within and a target position. The map may also contain at least the ‘non drivable space’ (OS), the ‘drivable free space’ (FS), ‘unknown, so far not detected space supposedly free’ (UF), ‘unknown, so far not detected space supposedly not drivable’ (UO). Optionally, the map may contain additionally the heights of the space components (3rd dimension), timestamp and scoring parameters (availability, reliability) of each grid element (alternatively the may map may be vector based instead of grid based, by that the third dimension may than be expressed in the vectors), a labeling of the drivable terrain (for example, ‘interlocking pavement type 1, 2, 3 . . . ’, ‘asphalt’, ‘gravel’ and the like) and of the non-drivable terrain or obstacles (such as ‘man made structure’, ‘nature’, ‘human’, ‘animal’ or ‘vehicle’ or the like).
As a preferred option, the system may first calculate (or plan) and simulate the general parking path before executing the parking maneuver. Optionally, the simulation may be split into a (rough) geometrically constructed path (strategy) planning and a consecutive smoothing phase based on a numerical minimization algorithm called optimal control [algorithm] (OCA) specified further below. Though the path planning without smoothing may be sub-optimally sufficient but requires less processing resources, these geometrically constructed solutions normally struggle with the non-holonomic characteristics of the vehicle and feel quite artificial or uncomfortable to the vehicles' passengers (passively getting driven into the parking space).
During parking-driving execution, the remaining path may become newly replanned, updated or revised as parts of the prior unknown or roughly detected scene elements may come into sensor range and by that be detected or determined more precisely, or the scene may change during execution. The park planner may have to react by altering the planned path upon such a scene change (such as, for example, when a neighboring parking lot gets occupied, and by that time the scene is not drivable any more (the free space (FS) changes to occupied space (OS)) and the planner has to reflect this new restriction in the path planning.
Typically, the path gets likely more complicated than less by such changes. In some cases the chosen or target parking space will become unreachable. The driving task then will have to be aborted. In case pedestrians are within the parking space or in the way to it, the system may not replan the entering path, but just stop and wait (for a certain duration) until the pedestrians have left the parking space or path to it.
In cases where the vehicle needs to drive a longer way to a parking space without driver interaction, Automated Parking is a sub-functionality of autonomous driving. Every driving task can be defined as driving from A to B. With autonomous driving, the system separates the whole task in steps, still driving from A to B, but then to C and so on. This leads to a chain of nodes on your way A0, A1, . . . Af, with A0 being the start position and Af the final position. Because the system only needs to find its way to the next Ak, it still just needs to drive “from A to B”. Thus, the system may use two algorithms: planning of a path from A to B while considering the drivable area and the vehicle's abilities; and setting nodes to guide the vehicle around major obstacles while still considering the drivable area and the vehicle's abilities (these nodes can also be used to define a necessary direction of travel).
In some simpler cases some of the following procedures may not apply: In general the parking task starting on a position A, having any ego speed and heading, and ending on a parking spot B in a specific orientation with the end speed zero may be solved by splitting the task in five steps:
First, as a preferred option the given parking spot may be classified and a preferred entry point (EP) and entry orientation may be determined, see FIGS. 3 and 4A -C. It is only necessary to analytically place an entry node if the parking slot is narrow (to make sure the system can find a way in without too much routing inside the parking slot) depending on the side that the vehicle is approaching it from. But even if it is possible to plan a path directly to the final parking position it is beneficial to define an entry node. This can be located on the calculated path in a defined distance to the final parking position. The reason being that the system needs to calculate with better accuracy inside a parking slot.
The classification may also state whether a specific driving scheme shall be selected for maneuvering within the parking lot (for accurate orientation and positioning). Since driving tasks within a parking lot have a high similarity the use of pre-optimized trajectory templates appears more effective than drafting and optimizing that paths (within a parking lot) always freely (as alternative firstly option), see FIG. 5 .
Second, determining whether the entry point is in close distance or whether the vehicle has to enter the traffic flow to narrow to the parking spots entry point.
Third, if above is ‘yes’ it is to decide whether the vehicle has to turn around before entering the traffic flow for not driving backwardly in traffic (see FIG. 6 and flow chart of FIG. 4A ). Optionally, the entering and turning around may be done at once (see (1) in FIG. 6 ). Optionally, the turning around may utilize a pre-optimized trajectory template such as shown in FIG. 7 , or in an alternative option the turning around may be planned freely. In all cases a narrowing to the parking lot will be planned to be done then.
Fourth, assuming in all cases the ego vehicle is now close to the dedicated parking spot, an entering maneuver or as optional alternative (from first) a maneuver towards the entering point (EP) may then be required. This may be done by entering directly (comparably easy case), see (2), (3), (4) in FIG. 3 or (the comparably complicated case) may require one or several strokes (which may affect a full or partial turn around (again)), see (1) in FIG. 3 .
The result will be a general driving strategy for reaching and entering the parking spot or the result will be that the parking task was mistakenly given since the parking spot isn't enterable and is to be aborted.
Fifth, when enterable, the general driving strategies path may be given into a OCA which task it is to smoothen the path drafted by the driving strategy planner, see FIG. 4I . The OCA will maintain the turning points (number of strokes) drafted by the strategy planner.
As soon the OCA outputs an optimized path, the ego vehicle will be able to execute the parking maneuver, see FIG. 4I , by transmitting the actual driving path to the drive controller. The drive controller may be of a type of cascade control with subordinate speed control, setpoint feedforward, and anti-reset wind up. As discussed above, the path planning procedure may be redone from time to time to adapt the planning to either driving control deviations (being derived from the planned path or speed profile), scene detection deviations (when the scene turns out to be different than earlier detections or scene data transmissions (from remote)) or path planning deviations (mistakes or errors occurred (such as, for example, quantization errors)). The path planning may be redone time triggered (such as redone as often as possible, or in a time scheme), driving distance triggered (at, for example, certain way markers such as described in U.S. provisional application Ser. No. 62/330,558, filed May 2, 2016, and U.S. Publication No. US-2016-0162747, and such as by utilizing aspects of U.S. provisional application Ser. No. 62/222,268, filed Sep. 23, 2015, and/or Ser. No. 62/266,734, filed Dec. 14, 2015, which are all hereby incorporated herein by reference in their entireties), threshold triggered (such as exceeding deviation threshold such of one of these mentioned above, such as, for example, when the drive control deviation may exceed a value higher in lateral driving than driving longitudinal between every way point), event triggered (such as by being reinduced from higher prioritized control) or triggered by the change of context (such as, for example, when the user may have changed a parameter setting such as taking away the limitation ‘don't plan to cross or enter curbs’ or the like).
In the fourth step above, it was said that it will be required to have a general driving strategy for entering the parking spot or alternatively reaching the EP. For the following it does not matter whether the ego vehicle has narrowed towards the EP from a remote position earlier or whether it was close right from start. Such as shown in the flow chart of FIG. 4D a general parking lot entering path or a path to the EP can be geometrically constructed by the procedure described in the chart:
-
- Draw straight lines from start and end position in direction of vehicle heading;
- Draw (an angle dividing) center line between the two straight lines;
- Draw circles with minimum turning radius plus a margin tangent to the straights touching the start and end position (see
FIG. 8 ); - Draw all feasible tangents from a starting circle to an end circle (see
FIG. 9 ); - Draw all circles with minimum turning radius plus a margin tangent to two of the following: [start circle or straight], [one end circle or straight], center line (see
FIG. 10 ).
For choosing one preferred path out of all possible constructed paths a cost map or cost function may be used:
-
- Evaluate all constructed trajectories regarding the following objectives;
- Avoid traffic if possible, minimize the number of sweeps, minimize the maneuvering zone, minimize steering, avoid curbs, and maximize distance to obstacles (see the flow chart of
FIG. 4D and the possible paths solutions A, B C and D shown inFIGS. 11A-11D ). While the possible path B may be the fastest, it may be the one that requires the most space, whereas path A may require the least space. The paths C and D may be the most economic considering the objectives.
In the fifth step above it was stated that an OCA may optionally be used for smoothen the prior drafted path D, such as shown in FIG. 11E . The path in FIG. 11E may be the result of optimizing the prior constructed Path D (shown in FIG. 11D ) by the OCA according the invention as specified below. The resulting strokes may be neither circled nor straight. The heading at the turning direction node prior and part of the turn may be mostly identical. Preferably, the OCA may use a discrete solution method since these imply that these have finite dimensions that can be solved by a sequential quadratic programming (SQP). The methods to discretize, to structure, to reduce to form the conditions and to determine the gradients presented there may be used for the optimal control algorithm implementation of the APAS of the present invention. SQP requires a starting solution (of the general path). This is given by the prior geometrical planning done in the fourth step above. The path may be defined to the OCA by the end way points of every path section or segment (a long stroke may be segmented into smaller path segments, for being optimized single) or stroke (trajectory), called nodes Ak (with A0 being the start position and Af the final position) which may be defined by tuples which include beside the position X-position: x; Y-position: y also the Velocity: v; Steering angle: δ; Heading angle: ψ and the Driving direction: D, summarized in Ak=(xk, yk, vk, δk, ψk, Dk).
As always in vehicle path planning from a point A to B, the drivable area (free space) (see FIG. 2 ) and the vehicle's kinematic abilities have to be considered, such as:
-
- Current condition of vehicle Ai=(xi, yi, vi, δi, ψi, Di);
- Planned condition of vehicle at next node: Ak=(xk, yk, vk, δk, ψk, Dk);
- Drivable area;
- Dynamic capabilities of the vehicle (maximum speed and acceleration);
- Capability of the steering system (maximum steering angle and steering rate);
- Geometry of the vehicle (outline, steering system geometry, tire distances).
The nodes have to be set to guide the vehicle around major obstacles while still considering the drivable area and the vehicle's abilities (These nodes can also be used to define a necessary direction of travel). The OCA is capable to reflect these constraints while optimizing to (minimization-) objectives which characterize a ‘good’ path. These may include:
-
- Comfort of the vehicle occupants (maximum speed, acceleration and jerk may be subject of optimization) which may correspond to minimized vehicle degrading
- Time needed to finish driving, by optimizing the driving maneuver towards a fast execution (for example one should avoid to spent too much time blocking the road while maneuvering into a parking gap)
- Steering in standstill should be avoided (for minimizing tire degrading), which may be done by minimizing nodes with vehicle speed equating to zero while having different input and output steering angles (the change of steering direction may be prepared before a vehicle comes to a stop at a reversing node)
- Slow steering (abrupt or fast steering is considered unpleasant), by minimizing the change of steering angle between consecutive nodes, also higher harmonics may be reflected by this optimization (this will lead to smooth, elegant curves of the path)
The objectives can be expressed as a cost function (CF), additionally there are constraints and boundary conditions. By using these numerical methods not only is an optimal path found but also the parameters to control the vehicle accordingly along the path such as the acceleration ratio at the beginning and the deceleration ratio at the ending of a stroke (so that there is no overshooting). By parameterizing the CF the nature of a path can be tuned so it comes close to human driving behavior.
While this may lead to high calculation costs, these can be reduced in several ways:
-
- The system does not need the very best path, so is can abort the optimization algorithm before finding the optimum;
- By setting the nodes in a good manner the system can reduce the complexity of the task, for example it can avoid obstacles blocking most of the path;
- Keeping the distance between nodes short reduces calculation complexity.
The minimization objectives named above lead to the cost functions:
-
- Journey time: tf
- Steering angle: ∫t
0 tf δ(t)2dt2 instead of ∥ eases calculation - Steering rate: ∫t
0 tf ω(t)2dt - Steering rate (standstill):
constant to avoid division by 0
-
- Jerk: ∫t
0 tf j(t)2dt
The cost function with tuning parameters would therefore be:
- Jerk: ∫t
To reduce the processing resource demand of the OCA, the processing may abort as being sufficient when a path optimization underruns a certain CF threshold. Furthermore, the input should be set as best as possible in the beginning, by that the nodes should be set in a way that the obstacle avoidance is already quite well. The path should have an as lowest complexity as possible and the distance between nodes should be short for keeping the optimizing complexity low. The OCA may find local minima only. To find the global minimum, several starting conditions should be tried. But as stated before, the system does not need to find the absolute (global) optimum but just a feasible solution is sufficient. It has not been proven yet whether the optimal control problem is always stable. But these kind of algorithms have been used successfully for path planning frequently. Especially when the OCA starts from an already semi optimized path which generally leads from one node to another.
As implementation of a slightly more advanced APAS according to the present invention, the system may optionally be able to solve special path planning tasks given by certain additional constrains: for example, for entering a curb (half way or with the full extension of the vehicle) of a substantial height it is to desire that the path of every involved vehicle wheel is above a certain angle α uncritically to damage the tire or the rim, see FIG. 12 . To address this restraint, the APAS of the invention has to add two extra nodes into the planned park space entering path, one short before the specific wheel is entering the curb one short behind which lead to a stump angle across the curb. This measure may lead to slight altering of the outcome of the driving strategy (see examples of FIG. 13A before and FIG. 13D after optimizing the path for entering a curb). The examples of FIGS. 13B and 13C show the angle of the rear tire in example. The optimization is also done for the front tire using the optimized path of FIG. 13D ). It may happen that additional strokes are required to enter a parking slot. As an alternative implementation for entering curbs on a stump angle always the angle constraint may not be implemented by setting two close nodes close to the curb but by adding a boundary condition as additional input to the minimization task when invoking the OCA starting on a prior geometrically drafted path (as usual) without having the curb angle constrain reflected during that drafting.
|δ+ψ−β|>α for P(x,y)∈A;
with α being the threshold for entering the curb, which has an angle β to the base system, ψ is the heading angle of the vehicle to the curb, and δ is the vehicle's steering angle.
|δ+ψ−β|>α for P(x,y)∈A;
with α being the threshold for entering the curb, which has an angle β to the base system, ψ is the heading angle of the vehicle to the curb, and δ is the vehicle's steering angle.
Optionally, the speed profile may also be optimized for overcoming a curb. The initial speed may be chosen in a way that the kinetic energy of the moving vehicle is slightly above the required energy for lifting the vehicle over the curb's slope.
The APAS of the present invention may typically have the task to enter a specific parking lot with a specific heading out of a position with a given heading. In FIG. 7 , templates for turning around were presented. The algorithm of the APAS system of the present invention may check whether one of the turning around templates—‘patches’ may fit into the given free space, see FIG. 14 . In some of these cases the turning around for entering the specific parking lot at a different heading as the vehicle is actually in is not possible due to the drivable space is to narrow. In such situations, it may be decided that the vehicle is driving towards an area large enough for turning, for coming back in another heading direction, see FIG. 15 .
Thus, the present invention provides a parking assist system that determines a path for the vehicle to follow from a current or initial location to a parked location at a selected or target parking space. The parking assist system determines the path by selecting from possible paths available to the controlled vehicle, with the possible paths being determined in accordance with the turning capabilities of the vehicle and other parameters. The system adjusts the path as the vehicle moves along the initial path and as more details are obtained via the sensors of the vehicle (such as exterior viewing cameras or TOF sensors or RADAR sensors or LIDAR sensors or the like). The parking assist system of the present invention may utilize aspects of the systems described in U.S. Pat. No. 8,874,317 and/or U.S. Publication Nos. US-2015-0344028; US-2015-0251599; US-2015-0158499; US-2015-0124096 and/or US-2014-0375476, which are all hereby incorporated herein by reference in their entireties.
The parking assist system of the present invention thus may initially conduct an environment detection using its sensors, and then may conduct a context analysis to determine which free spaces may be parking spots. The system may then approximate a path towards an entry node of a chosen parking spot using circled and straight path sections. The system then is operable to smooth the path of travel of the vehicle, which equates to making it more comfortable for the passenger by employing an optimal control algorithm (OCA) under use of a cost function (minimization function). The OCA works best when the entry is already plausible (so the path or section of a path from start to end already works but is improvable), and then optimizes the path via the given objectives and regarding the given constraints. Since the error in primarily scene detection is comparably high and the resolution is often quite low, just the general path should be planned, but not optimized significantly. The to-be-driven next path section in the near field of the sensors (high resolution, low error, real time) should be subject of optimization by the OCA.
The camera or sensor may comprise any suitable camera or sensor. Optionally, the camera may comprise a “smart camera” that includes the imaging sensor array and associated circuitry and image processing circuitry and electrical connectors and the like as part of a camera module, such as by utilizing aspects of the vision systems described in International Publication Nos. WO 2013/081984 and/or WO 2013/081985, which are hereby incorporated herein by reference in their entireties.
The system includes an image processor operable to process image data captured by the camera or cameras, such as for detecting objects or other vehicles or pedestrians or the like in the field of view of one or more of the cameras. For example, the image processor may comprise an image processing chip selected from the EyeQ family of image processing chips available from Mobileye Vision Technologies Ltd. of Jerusalem, Israel, and may include object detection software (such as the types described in U.S. Pat. Nos. 7,855,755; 7,720,580 and/or 7,038,577, which are hereby incorporated herein by reference in their entireties), and may analyze image data to detect vehicles and/or other objects. Responsive to such image processing, and when an object or other vehicle is detected, the system may generate an alert to the driver of the vehicle and/or may generate an overlay at the displayed image to highlight or enhance display of the detected object or vehicle, in order to enhance the driver's awareness of the detected object or vehicle or hazardous condition during a driving maneuver of the equipped vehicle.
The vehicle may include any type of sensor or sensors, such as imaging sensors or radar sensors or lidar sensors or ladar sensors or ultrasonic sensors or the like. The imaging sensor or camera may capture image data for image processing and may comprise any suitable camera or sensing device, such as, for example, a two dimensional array of a plurality of photosensor elements arranged in at least 640 columns and 480 rows (at least a 640×480 imaging array, such as a megapixel imaging array or the like), with a respective lens focusing images onto respective portions of the array. The photosensor array may comprise a plurality of photosensor elements arranged in a photosensor array having rows and columns. Preferably, the imaging array has at least 300,000 photosensor elements or pixels, more preferably at least 500,000 photosensor elements or pixels and more preferably at least 1 million photosensor elements or pixels. The imaging array may capture color image data, such as via spectral filtering at the array, such as via an RGB (red, green and blue) filter or via a red/red complement filter or such as via an RCC (red, clear, clear) filter or the like. The logic and control circuit of the imaging sensor may function in any known manner, and the image processing and algorithmic processing may comprise any suitable means for processing the images and/or image data.
For example, the vision system and/or processing and/or camera and/or circuitry may utilize aspects described in U.S. Pat. Nos. 8,694,224; 7,005,974; 5,760,962; 5,877,897; 5,796,094; 5,949,331; 6,302,545; 6,396,397; 6,498,620; 6,523,964; 6,611,202; 6,201,642; 6,690,268; 6,717,610; 6,757,109; 6,802,617; 6,806,452; 6,822,563; 6,891,563; 6,946,978; 7,859,565; 5,550,677; 5,670,935; 7,881,496; 7,720,580; 7,038,577; 6,882,287; 5,929,786 and/or 5,786,772, and/or International Publication Nos. WO 2011/028686; WO 2010/099416; WO 2012/061567; WO 2012/068331; WO 2012/075250; WO 2012/103193; WO 2012/0116043; WO 2012/0145313; WO 2012/0145501; WO 2012/145818; WO 2012/145822; WO 2012/158167; WO 2012/075250; WO 2012/0116043; WO 2012/0145501; WO 2012/154919; WO 2013/019707; WO 2013/016409; WO 2013/019795; WO 2013/067083; WO 2013/070539; WO 2013/043661; WO 2013/048994; WO 2013/063014, WO 2013/081984; WO 2013/081985; WO 2013/074604; WO 2013/086249; WO 2013/103548; WO 2013/109869; WO 2013/123161; WO 2013/126715; WO 2013/043661; WO 2013/158592 and/or WO 2014/204794, which are all hereby incorporated herein by reference in their entireties. The system may communicate with other communication systems via any suitable means, such as by utilizing aspects of the systems described in International Publication Nos. WO/2010/144900; WO 2013/043661 and/or WO 2013/081985, and/or U.S. Publication No. US-2012-0062743, which are hereby incorporated herein by reference in their entireties.
The imaging device and control and image processor and any associated illumination source, if applicable, may comprise any suitable components, and may utilize aspects of the cameras (such as various imaging sensors or imaging array sensors or cameras or the like, such as a CMOS imaging array sensor, a CCD sensor or other sensors or the like) and vision systems described in U.S. Pat. Nos. 5,760,962; 5,715,093; 6,922,292; 6,757,109; 6,717,610; 6,590,719; 6,201,642; 5,796,094; 6,559,435; 6,831,261; 6,822,563; 6,946,978; 7,720,580; 8,542,451; 7,965,336; 7,480,149; 5,550,677; 5,877,897; 6,498,620; 5,670,935; 5,796,094; 6,396,397; 6,806,452; 6,690,268; 7,005,974; 7,937,667; 7,123,168; 7,004,606; 6,946,978; 7,038,577; 6,353,392; 6,320,176; 6,313,454 and/or 6,824,281, and/or International Publication Nos. WO 2009/036176; WO 2009/046268; WO 2010/099416; WO 2011/028686 and/or WO 2013/016409, and/or U.S. Pat. Publication Nos. US 2010-0020170 and/or US-2009-0244361, which are all hereby incorporated herein by reference in their entireties.
The camera module and circuit chip or board and imaging sensor may be implemented and operated in connection with various vehicular vision-based systems, and/or may be operable utilizing the principles of such other vehicular systems, such as a vehicle headlamp control system, such as the type disclosed in U.S. Pat. Nos. 5,796,094; 6,097,023; 6,320,176; 6,559,435; 6,831,261; 7,004,606; 7,339,149 and/or 7,526,103, which are all hereby incorporated herein by reference in their entireties, a rain sensor, such as the types disclosed in commonly assigned U.S. Pat. Nos. 6,353,392; 6,313,454; 6,320,176 and/or 7,480,149, which are hereby incorporated herein by reference in their entireties, a vehicle vision system, such as a forwardly, sidewardly or rearwardly directed vehicle vision system utilizing principles disclosed in U.S. Pat. Nos. 5,550,677; 5,670,935; 5,760,962; 5,877,897; 5,949,331; 6,222,447; 6,302,545; 6,396,397; 6,498,620; 6,523,964; 6,611,202; 6,201,642; 6,690,268; 6,717,610; 6,757,109; 6,802,617; 6,806,452; 6,822,563; 6,891,563; 6,946,978 and/or 7,859,565, which are all hereby incorporated herein by reference in their entireties, a trailer hitching aid or tow check system, such as the type disclosed in U.S. Pat. No. 7,005,974, which is hereby incorporated herein by reference in its entirety, a reverse or sideward imaging system, such as for a lane change assistance system or lane departure warning system or for a blind spot or object detection system, such as imaging or detection systems of the types disclosed in U.S. Pat. Nos. 7,881,496; 7,720,580; 7,038,577; 5,929,786 and/or 5,786,772, which are hereby incorporated herein by reference in their entireties, a video device for internal cabin surveillance and/or video telephone function, such as disclosed in U.S. Pat. Nos. 5,760,962; 5,877,897; 6,690,268 and/or 7,370,983, and/or U.S. Publication No. US-2006-0050018, which are hereby incorporated herein by reference in their entireties, a traffic sign recognition system, a system for determining a distance to a leading or trailing vehicle or object, such as a system utilizing the principles disclosed in U.S. Pat. Nos. 6,396,397 and/or 7,123,168, which are hereby incorporated herein by reference in their entireties, and/or the like.
Optionally, the circuit board or chip may include circuitry for the imaging array sensor and or other electronic accessories or features, such as by utilizing compass-on-a-chip or EC driver-on-a-chip technology and aspects such as described in U.S. Pat. Nos. 7,255,451 and/or 7,480,149 and/or U.S. Publication Nos. US-2010-0097469 and/or US-2006-0061008, which are hereby incorporated herein by reference in their entireties.
Optionally, the vision system may include a display for displaying images captured by one or more of the imaging sensors for viewing by the driver of the vehicle while the driver is normally operating the vehicle. Optionally, for example, the vision system may include a video display device utilizing aspects of the display systems described in U.S. Pat. Nos. 7,370,983; 7,329,013; 7,308,341; 7,289,037; 7,249,860; 7,004,593; 6,690,268; 4,546,551; 5,699,044; 4,953,305; 5,576,687; 5,632,092; 5,677,851; 5,708,410; 5,737,226; 5,802,727; 5,878,370; 6,087,953; 6,173,508; 6,222,460; 6,513,252 and/or 6,642,851, and/or European patent application, published Oct. 11, 2000 under Publication No. EP 0 1043566, and/or U.S. Publication No. US-2006-0061008, which are all hereby incorporated herein by reference in their entireties.
Optionally, the vision system (utilizing the forward facing camera and a rearward facing camera and other cameras disposed at the vehicle with exterior fields of view) may be part of or may provide a display of a top-down view or birds-eye view system of the vehicle or a surround view at the vehicle, such as by utilizing aspects of the vision systems described in International Publication Nos. WO 2010/099416; WO 2011/028686; WO 2012/075250; WO 2013/019795; WO 2012/075250; WO 2012/145822; WO 2013/081985; WO 2013/086249 and/or WO 2013/109869, and/or U.S. Publication No. US-2012-0162427, which are hereby incorporated herein by reference in their entireties.
Changes and modifications in the specifically described embodiments can be carried out without departing from the principles of the invention, which is intended to be limited only by the scope of the appended claims, as interpreted according to the principles of patent law including the doctrine of equivalents.
Claims (20)
1. A parking assist system of a vehicle, said parking assist system comprising:
a plurality of sensors disposed at a vehicle and having respective fields of sensing exterior of the vehicle;
a processor operable to process data captured by said sensors;
a vehicle control operable to determine a target parking space responsive to processing by said processor of data captured by said sensors;
wherein said vehicle control is operable to determine a plurality of possible paths of travel from a current location of the vehicle to the target parking space;
wherein the plurality of possible paths of travel is determined by said control approximating possible turns of the vehicle between a start node outside of the target parking space and an end node in the target parking space via an algorithm that (i) uses two intersecting lines, with one passing through the start node and one passing through the end node, (ii) uses circles that are tangent to respective ones of the intersecting lines, wherein each circle has a radius that approximates a minimum turning radius of the vehicle, and (iii) determines possible paths of travel using straight path sections tangent to one or more of the circles and curved path sections that follow a curvature of one or more of the circles;
wherein said control selects a target path of travel of the vehicle from the determined plurality of possible paths of vehicles in accordance with a plurality of objectives for the path of travel of the vehicle; and
wherein said control controls steering of the vehicle to maneuver the vehicle along the selected target path of travel from the current location of the vehicle to the target parking space.
2. The parking assist system of claim 1 , wherein said control evaluates multiple possible path approximations and selects the target path of travel based at least in part on traffic, number of maneuvers, curbs, obstacles and pedestrians in the possible paths.
3. The parking assist system of claim 1 , wherein the target path of travel is selected based on one or more objectives selected from the group consisting of (i) avoiding traffic, (ii) minimizing the number of turns, (iii) minimizing the area required for maneuvering the vehicle, (iv) avoiding curbs, and (v) avoiding objects.
4. The parking assist system of claim 1 , wherein said control determines control parameters for controlling the vehicle along the target path of travel of the vehicle.
5. The parking assist system of claim 1 , wherein selection of the target path of travel is based on an optimization procedure based on a prior approximated path of travel.
6. The parking assist system of claim 5 , wherein optimization of the prior approximated path of travel is done in sections between the start node and end nodes.
7. The parking assist system of claim 6 , wherein optimization of the prior approximated path of travel is done in sections between the start node and end nodes and at least one node between the start node and end node.
8. The parking assist system of claim 7 , wherein the circles are tangent to the determined path of travel at the nodes.
9. The parking assist system of claim 7 , wherein optimization of path sections is done by an optimal control algorithm using a cost function.
10. The parking assist system of claim 9 , wherein said cost function has at least one of the objectives of (i) comfort ride of the vehicle occupants by optimizing the speed, acceleration and jerk of the vehicle, (ii) a time needed to complete the parking maneuver by minimizing the time for executing the driving maneuvers, (iii) avoiding steering in standstill by minimizing nodes where the vehicle speed is zero, and (iv) avoiding abrupt or fast steering by minimizing a change of steering angle between consecutive nodes.
11. The parking assist system of claim 10 , wherein said cost function comprises at least one constraint selected from the group consisting of (i) the current condition of vehicle, (ii) the planned condition of vehicle at a next node, (iii) the drivable area, (iv) the dynamic capabilities of the vehicle, (v) the capability of the steering system of the vehicle, and (vi) the geometry of the vehicle.
12. The parking assist system of claim 1 , wherein one of the intersecting lines passes through the start node in a direction of travel of the vehicle at the start node and the other of the intersecting lines passes through the end node in the direction of travel of the vehicle at the end node.
13. The parking assist system of claim 12 , wherein said control uses a third intersecting line that bisects an angle between the two intersecting lines, and wherein said control applies circles that are tangent to the third intersecting line.
14. A parking assist system of a vehicle, said parking assist system comprising:
a plurality of sensors disposed at a vehicle and having respective fields of sensing exterior of the vehicle;
a processor operable to process data captured by said sensors;
a vehicle control operable to determine a target parking space responsive to processing by said processor of data captured by said sensors;
wherein said vehicle control is operable to determine a plurality of possible paths of travel from a current location of the vehicle to the target parking space;
wherein the plurality of possible paths of travel is determined by said control approximating possible turns of the vehicle between a start node outside of the target parking space and an end node in the target parking space via an algorithm that (i) uses two intersecting lines, with one passing through the start node in a direction of travel of the vehicle at the start node and one passing through the end node in a direction of travel of the vehicle at the end node, (ii) uses circles that are tangent to respective ones of the intersecting lines, wherein each circle has a radius that approximates a minimum turning radius of the vehicle, and (iii) determines possible paths of travel using straight path sections tangent to one or more of the circles and curved path sections that follow a curvature of one or more of the circles;
wherein said control selects a target path of travel of the vehicle from the determined plurality of possible paths of vehicles in accordance with a plurality of objectives for the path of travel of the vehicle;
wherein the target path of travel is selected based on one or more objectives selected from the group consisting of (i) avoiding traffic, (ii) minimizing the number of turns, (iii) minimizing the area required for maneuvering the vehicle, (iv) avoiding curbs, and (v) avoiding objects; and
wherein said control controls steering of the vehicle to maneuver the vehicle along the selected target path of travel from the current location of the vehicle to the target parking space.
15. The parking assist system of claim 14 , wherein multiple nodes are determined along one of the intersecting lines and between the start node and the end node, and wherein said algorithm uses circles tangent to the respective intersecting line at each of the nodes.
16. The parking assist system of claim 14 , wherein said control selects a target path of travel of the vehicle from the determined plurality of possible paths of vehicles in accordance with a cost function.
17. The parking assist system of claim 16 , wherein said cost function has at least one of the objectives of (i) comfort ride of the vehicle occupants by optimizing the speed, acceleration and jerk of the vehicle, (ii) a time needed to complete the parking maneuver by minimizing the time for executing the driving maneuvers, (iii) avoiding steering in standstill by minimizing nodes where the vehicle speed is zero, and (iv) avoiding abrupt or fast steering by minimizing a change of steering angle between consecutive nodes.
18. The parking assist system of claim 16 , wherein said cost function comprises at least one constraint selected from the group consisting of (i) the current condition of vehicle, (ii) the planned condition of vehicle at a next node, (iii) the drivable area, (iv) the dynamic capabilities of the vehicle, (v) the capability of the steering system of the vehicle, and (vi) the geometry of the vehicle.
19. A parking assist system of a vehicle, said parking assist system comprising:
a plurality of sensors disposed at a vehicle and having respective fields of sensing exterior of the vehicle;
a processor operable to process data captured by said sensors;
a vehicle control operable to determine a target parking space responsive to processing by said processor of data captured by said sensors;
wherein said vehicle control is operable to determine a plurality of possible paths of travel from a current location of the vehicle to the target parking space;
wherein the plurality of possible paths of travel is determined by said control approximating possible turns of the vehicle between a start node outside of the target parking space and an end node in the target parking space via an algorithm that (i) uses three intersecting lines, with a first line passing through the start node in a direction of travel of the vehicle at the start node, a second line passing through the end node in a direction of travel of the vehicle at the end node and a third line passing through the intersection of the first and second lines and bisecting an angle between the first and second lines, (ii) uses circles that are tangent to respective ones of the intersecting lines, wherein each circle has a radius that approximates a minimum turning radius of the vehicle, and (iii) determines possible paths of travel using straight path sections tangent to one or more of the circles and curved path sections that follow a curvature of one or more of the circles;
wherein said control selects a target path of travel of the vehicle from the determined plurality of possible paths of vehicles in accordance with a plurality of objectives for the path of travel of the vehicle;
wherein said control selects a target path of travel of the vehicle from the determined plurality of possible paths of vehicles in accordance with a cost function;
wherein said cost function has at least one of the objectives of (i) comfort ride of the vehicle occupants by optimizing the speed, acceleration and jerk of the vehicle, (ii) a time needed to complete the parking maneuver by minimizing the time for executing the driving maneuvers, (iii) avoiding steering in standstill by minimizing nodes where the vehicle speed is zero, and (iv) avoiding abrupt or fast steering by minimizing a change of steering angle between consecutive nodes; and
wherein said control controls steering of the vehicle to maneuver the vehicle along the selected target path of travel from the current location of the vehicle to the target parking space.
20. The parking assist system of claim 19 , wherein said cost function comprises at least one constraint selected from the group consisting of (i) the current condition of vehicle, (ii) the planned condition of vehicle at a next node, (iii) the drivable area, (iv) the dynamic capabilities of the vehicle, (v) the capability of the steering system of the vehicle, and (vi) the geometry of the vehicle.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/206,801 US10214206B2 (en) | 2015-07-13 | 2016-07-11 | Parking assist system for vehicle |
US16/283,978 US11104327B2 (en) | 2015-07-13 | 2019-02-25 | Method for automated parking of a vehicle |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201562191683P | 2015-07-13 | 2015-07-13 | |
US15/206,801 US10214206B2 (en) | 2015-07-13 | 2016-07-11 | Parking assist system for vehicle |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/283,978 Continuation US11104327B2 (en) | 2015-07-13 | 2019-02-25 | Method for automated parking of a vehicle |
Publications (2)
Publication Number | Publication Date |
---|---|
US20170015312A1 US20170015312A1 (en) | 2017-01-19 |
US10214206B2 true US10214206B2 (en) | 2019-02-26 |
Family
ID=57774761
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/206,801 Active US10214206B2 (en) | 2015-07-13 | 2016-07-11 | Parking assist system for vehicle |
US16/283,978 Active 2036-11-24 US11104327B2 (en) | 2015-07-13 | 2019-02-25 | Method for automated parking of a vehicle |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/283,978 Active 2036-11-24 US11104327B2 (en) | 2015-07-13 | 2019-02-25 | Method for automated parking of a vehicle |
Country Status (1)
Country | Link |
---|---|
US (2) | US10214206B2 (en) |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20180215382A1 (en) * | 2017-02-01 | 2018-08-02 | Magna Electronics Inc. | Vehicle trailer hitch assist system |
US11104327B2 (en) * | 2015-07-13 | 2021-08-31 | Magna Electronics Inc. | Method for automated parking of a vehicle |
US20220026904A1 (en) * | 2016-09-29 | 2022-01-27 | Magna Electronics Inc. | Vehicular control system with handover procedure for driver of controlled vehicle |
US11332124B2 (en) | 2019-01-10 | 2022-05-17 | Magna Electronics Inc. | Vehicular control system |
US11453393B2 (en) | 2017-10-09 | 2022-09-27 | Magna Electronics Inc. | Autonomous vehicle with path planning system |
US11498494B2 (en) | 2019-11-27 | 2022-11-15 | Magna Electronics Inc. | Vehicular camera monitoring system |
US11560143B2 (en) | 2020-05-26 | 2023-01-24 | Magna Electronics Inc. | Vehicular autonomous parking system using short range communication protocols |
Families Citing this family (60)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8300798B1 (en) | 2006-04-03 | 2012-10-30 | Wai Wu | Intelligent communication routing system and method |
DE102013020315A1 (en) * | 2013-12-05 | 2015-06-11 | Valeo Schalter Und Sensoren Gmbh | Method for carrying out an at least semi-autonomous parking operation of a motor vehicle, parking assistance system and motor vehicle |
DE102015203619A1 (en) * | 2015-02-28 | 2016-09-01 | Bayerische Motoren Werke Aktiengesellschaft | Parking assistance system with detection of a universal parking space |
US10078789B2 (en) | 2015-07-17 | 2018-09-18 | Magna Electronics Inc. | Vehicle parking assist system with vision-based parking space detection |
JP6569362B2 (en) * | 2015-07-31 | 2019-09-04 | アイシン精機株式会社 | Parking assistance device |
DE102015220449A1 (en) * | 2015-10-20 | 2017-04-20 | Robert Bosch Gmbh | Method and device for operating at least one partially or highly automated vehicle |
KR102464484B1 (en) * | 2015-12-08 | 2022-11-07 | 현대모비스 주식회사 | Assistant system and assistant method for backward driving of vehicle |
KR101714273B1 (en) * | 2015-12-11 | 2017-03-08 | 현대자동차주식회사 | Method and apparatus for controlling path of autonomous driving system |
US10160437B2 (en) | 2016-02-29 | 2018-12-25 | Magna Electronics Inc. | Vehicle control system with reverse assist |
US20170253237A1 (en) | 2016-03-02 | 2017-09-07 | Magna Electronics Inc. | Vehicle vision system with automatic parking function |
KR102513745B1 (en) * | 2016-04-15 | 2023-03-24 | 주식회사 에이치엘클레무브 | Driving assistance device |
US11636348B1 (en) | 2016-05-30 | 2023-04-25 | Apple Inc. | Adaptive training of neural network models at model deployment destinations |
US11468285B1 (en) * | 2016-05-30 | 2022-10-11 | Apple Inc. | Analysis of objects of interest in sensor data using deep neural networks |
US20210295384A1 (en) | 2016-06-23 | 2021-09-23 | State Farm Mutual Automobile Insurance Company | Systems and methods for environmental analysis based upon vehicle sensor data |
US10486742B2 (en) | 2016-08-01 | 2019-11-26 | Magna Electronics Inc. | Parking assist system using light projections |
JP6761708B2 (en) * | 2016-09-05 | 2020-09-30 | パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカPanasonic Intellectual Property Corporation of America | Parking position identification method, parking position learning method, parking position identification system, parking position learning device and program |
US10481609B2 (en) * | 2016-12-09 | 2019-11-19 | Ford Global Technologies, Llc | Parking-lot-navigation system and method |
JP6544348B2 (en) | 2016-12-22 | 2019-07-17 | トヨタ自動車株式会社 | Vehicle driving support device |
JP6515912B2 (en) * | 2016-12-22 | 2019-05-22 | トヨタ自動車株式会社 | Vehicle driving support device |
US11034295B2 (en) | 2017-02-02 | 2021-06-15 | Magna Electronics Inc. | Vehicle vision system using at least two cameras |
US10409283B2 (en) * | 2017-03-31 | 2019-09-10 | Mitsubishi Electric Research Laboratories, Inc. | Vehicle motion control system and method |
EP3413082B1 (en) * | 2017-06-09 | 2020-01-01 | Veoneer Sweden AB | A vehicle system for detection of oncoming vehicles |
IT201700073722A1 (en) * | 2017-06-30 | 2018-12-30 | Magneti Marelli Spa | "Route planning procedure for calculating optimal parking maneuvers for road vehicles and the corresponding system" |
US11067993B2 (en) | 2017-08-25 | 2021-07-20 | Magna Electronics Inc. | Vehicle and trailer maneuver assist system |
JP7095968B2 (en) * | 2017-10-02 | 2022-07-05 | トヨタ自動車株式会社 | Management device |
US10583779B2 (en) | 2017-10-02 | 2020-03-10 | Magna Electronics Inc. | Parking assist system using backup camera |
US10744941B2 (en) | 2017-10-12 | 2020-08-18 | Magna Electronics Inc. | Vehicle vision system with bird's eye view display |
US10899385B2 (en) | 2017-10-23 | 2021-01-26 | Magna Electronics Inc. | Vehicle and trailer backup guidance system |
KR102060070B1 (en) * | 2017-10-24 | 2019-12-27 | 엘지전자 주식회사 | Device for automatically parking vehicle and method for controlling the same |
CN109849913B (en) * | 2017-11-29 | 2022-07-22 | 奥迪股份公司 | System and method for assisting parking of vehicle on curb |
US10836379B2 (en) * | 2018-03-23 | 2020-11-17 | Sf Motors, Inc. | Multi-network-based path generation for vehicle parking |
JP7203826B2 (en) * | 2018-03-30 | 2023-01-13 | フォルシアクラリオン・エレクトロニクス株式会社 | parking assist device |
JP7133336B2 (en) * | 2018-04-06 | 2022-09-08 | 日立Astemo株式会社 | parking assist device |
DE102018207964A1 (en) * | 2018-05-22 | 2019-11-28 | Zf Friedrichshafen Ag | Method and control device for controlling a vehicle |
US11066067B2 (en) * | 2018-06-29 | 2021-07-20 | Baidu Usa Llc | Planning parking trajectory for self-driving vehicles |
US11273868B2 (en) | 2018-07-16 | 2022-03-15 | Magna Electronics Inc. | Vehicular trailer assist system |
KR102496660B1 (en) * | 2018-08-28 | 2023-02-06 | 현대자동차주식회사 | Apparatus for controlling a parking of vehicle, system having the same and method thereof |
US10300851B1 (en) * | 2018-10-04 | 2019-05-28 | StradVision, Inc. | Method for warning vehicle of risk of lane change and alarm device using the same |
US10800412B2 (en) * | 2018-10-12 | 2020-10-13 | GM Global Technology Operations LLC | System and method for autonomous control of a path of a vehicle |
KR20200046156A (en) | 2018-10-16 | 2020-05-07 | 주식회사 만도 | Vehicle control system and vehicle control method |
CN110045727B (en) * | 2018-12-03 | 2022-08-05 | 江西洪都航空工业集团有限责任公司 | Park unmanned vehicle path planning and control method |
DE102018222531A1 (en) * | 2018-12-20 | 2020-06-25 | Volkswagen Aktiengesellschaft | Method for at least partially automated control of the motor vehicle during a parking or parking process, control device and motor vehicle |
US11567514B2 (en) * | 2019-02-11 | 2023-01-31 | Tesla, Inc. | Autonomous and user controlled vehicle summon to a target |
DE102019107414A1 (en) * | 2019-03-22 | 2020-09-24 | Zf Automotive Germany Gmbh | Method and control device for a system for controlling a motor vehicle |
DE102019206210A1 (en) * | 2019-04-30 | 2020-11-05 | Ford Global Technologies, Llc | Method for operating a motor vehicle with a self-parking function |
CN110304049B (en) * | 2019-06-24 | 2020-11-24 | 浙江大学 | Environment active sensing type automatic parking system for parking lot |
US11550324B2 (en) * | 2019-09-30 | 2023-01-10 | Zoox, Inc. | Parking zone detection for vehicles |
US11815891B2 (en) * | 2019-10-22 | 2023-11-14 | Baidu Usa Llc | End dynamics and constraints relaxation algorithm on optimizing an open space trajectory |
JP7176651B2 (en) * | 2020-02-10 | 2022-11-22 | 日産自動車株式会社 | Parking assistance method and parking assistance device |
CN111137280B (en) * | 2020-03-06 | 2021-05-04 | 北京百度网讯科技有限公司 | Control method, device and equipment for autonomous parking and storage medium |
DE102020205354A1 (en) * | 2020-04-28 | 2021-10-28 | Continental Automotive Gmbh | Parking assistance system |
CN112102648B (en) * | 2020-09-04 | 2022-02-15 | 中国第一汽车股份有限公司 | Vacant parking space pushing method, device, equipment and storage medium |
US11721113B2 (en) | 2020-10-09 | 2023-08-08 | Magna Electronics Inc. | Vehicular driving assist system with lane detection using rear camera |
CN112339747A (en) * | 2020-10-30 | 2021-02-09 | 上海欧菲智能车联科技有限公司 | Automatic parking track generation method and device, electronic equipment and storage medium |
US20220134951A1 (en) * | 2020-11-04 | 2022-05-05 | Magna Electronics Inc. | Vehicular trailer hitching assist system with hitch ball location estimation |
CN112389421B (en) * | 2020-11-17 | 2022-02-18 | 湖南三一智能控制设备有限公司 | Control method and control system for parallel positioning of engineering vehicle and engineering vehicle |
JP2022100774A (en) * | 2020-12-24 | 2022-07-06 | トヨタ自動車株式会社 | Parking support device |
US11820395B2 (en) | 2021-06-28 | 2023-11-21 | Magna Electronics Inc. | Vehicular driving assist system with unparking alert |
US20230311854A1 (en) * | 2022-03-29 | 2023-10-05 | Continental Autonomous Mobility US, LLC | Autonomous vehicle garage parking |
CN115512571B (en) * | 2022-09-28 | 2023-12-19 | 上汽通用五菱汽车股份有限公司 | Reversing environment monitoring method, device, equipment and storage medium |
Citations (220)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5355118A (en) | 1991-07-11 | 1994-10-11 | Nissan Motor Co., Ltd. | Vehicle collision alert system |
US5416478A (en) | 1992-03-12 | 1995-05-16 | Funai Electric Co., Ltd. | Car navigation system |
US5424952A (en) | 1993-03-26 | 1995-06-13 | Mitsubishi Denki Kabushiki Kaisha | Vehicle-surroundings monitoring apparatus |
US5426294A (en) | 1992-05-27 | 1995-06-20 | Koito Manufacturing Co., Ltd. | Glare sensor for a vehicle |
US5430431A (en) | 1994-01-19 | 1995-07-04 | Nelson; Louis J. | Vehicle protection system and method |
US5434407A (en) | 1993-08-23 | 1995-07-18 | Gentex Corporation | Automatic rearview mirror incorporating light pipe |
US5440428A (en) | 1993-09-30 | 1995-08-08 | Hughes Aircraft Company | Automotive instrument 3-D virtual image display |
US5444478A (en) | 1992-12-29 | 1995-08-22 | U.S. Philips Corporation | Image processing method and device for constructing an image from adjacent images |
US5451822A (en) | 1991-03-15 | 1995-09-19 | Gentex Corporation | Electronic control system |
US5457493A (en) | 1993-09-15 | 1995-10-10 | Texas Instruments Incorporated | Digital micro-mirror based image simulation system |
US5461357A (en) | 1992-01-29 | 1995-10-24 | Mazda Motor Corporation | Obstacle detection device for vehicle |
US5461361A (en) | 1994-03-11 | 1995-10-24 | Chrysler Corporation | Automotive instrument panel apparatus |
US5469298A (en) | 1991-08-14 | 1995-11-21 | Prince Corporation | Reflective display at infinity |
US5471515A (en) | 1994-01-28 | 1995-11-28 | California Institute Of Technology | Active pixel sensor with intra-pixel charge transfer |
US5475494A (en) | 1992-12-22 | 1995-12-12 | Mitsubishi Denki Kabushiki Kaisha | Driving environment surveillance apparatus |
US5498866A (en) | 1993-06-01 | 1996-03-12 | Leopold Kostal Gmbh & Co. Kg | Optoelectronic sensor for detecting moisture on a windshield with means to compensate for a metallic layer in the windshield |
US5500766A (en) | 1995-05-04 | 1996-03-19 | Stonecypher; Bob | Blind spot side mirror |
US5510983A (en) | 1992-11-13 | 1996-04-23 | Yazaki Corporation | On-vehicle display |
US5515448A (en) | 1992-07-28 | 1996-05-07 | Yazaki Corporation | Distance measuring apparatus of a target tracking type |
US5521633A (en) | 1992-09-25 | 1996-05-28 | Yazaki Corporation | Motor vehicle obstacle monitoring system using optical flow processing |
US5528698A (en) | 1995-03-27 | 1996-06-18 | Rockwell International Corporation | Automotive occupant sensing device |
US5530240A (en) | 1992-12-15 | 1996-06-25 | Donnelly Corporation | Display for automatic rearview mirror |
US5529138A (en) | 1993-01-22 | 1996-06-25 | Shaw; David C. H. | Vehicle collision avoidance system |
US5530420A (en) | 1993-12-27 | 1996-06-25 | Fuji Jukogyo Kabushiki Kaisha | Running guide apparatus for vehicle capable of keeping safety at passing through narrow path and the method thereof |
US5535314A (en) | 1991-11-04 | 1996-07-09 | Hughes Aircraft Company | Video image processor and method for detecting vehicles |
US5537003A (en) | 1994-04-08 | 1996-07-16 | Gentex Corporation | Control system for automotive vehicle headlamps and other vehicle equipment |
US5539397A (en) | 1993-03-26 | 1996-07-23 | Honda Giken Kogyo Kabushiki Kaisha | Driving control system for vehicle |
US5541590A (en) | 1992-08-04 | 1996-07-30 | Takata Corporation | Vehicle crash predictive and evasive operation system by neural networks |
US5550677A (en) | 1993-02-26 | 1996-08-27 | Donnelly Corporation | Automatic rearview mirror system using a photosensor array |
US5670935A (en) | 1993-02-26 | 1997-09-23 | Donnelly Corporation | Rearview vision system for vehicle including panoramic view |
US5724316A (en) | 1995-09-26 | 1998-03-03 | Delco Electronics Corporation | GPS based time determining system and method |
US5737226A (en) | 1995-06-05 | 1998-04-07 | Prince Corporation | Vehicle compass system with automatic calibration |
US5761094A (en) | 1996-01-18 | 1998-06-02 | Prince Corporation | Vehicle compass system |
US5760931A (en) | 1992-12-14 | 1998-06-02 | Nippondenso Co., Ltd. | Image display unit |
US5760828A (en) | 1994-06-03 | 1998-06-02 | Idesa Accesorios, S.A. | Back-vision system for vehicles |
US5760826A (en) | 1996-05-10 | 1998-06-02 | The Trustees Of Columbia University | Omnidirectional imaging apparatus |
US5765116A (en) | 1993-08-28 | 1998-06-09 | Lucas Industries Public Limited Company | Driver assistance system for a vehicle |
US5781437A (en) | 1992-04-21 | 1998-07-14 | Ibp Pietzsch Gmbh | Control system for controlling vehicles |
US5786772A (en) | 1996-03-22 | 1998-07-28 | Donnelly Corporation | Vehicle blind spot detection display system |
US5790403A (en) | 1994-07-12 | 1998-08-04 | Honda Giken Kogyo Kabushiki Kaisha | Lane image processing system for vehicle |
US5790973A (en) | 1995-12-19 | 1998-08-04 | Prince Corporation | Last exit warning system |
US5793420A (en) | 1994-10-28 | 1998-08-11 | Schmidt; William P. | Video recording system for vehicle |
US5793308A (en) | 1992-07-02 | 1998-08-11 | Sensorvision Technologies, L.L.C. | Vehicular position monitoring system with integral mirror video display |
US5796094A (en) | 1993-02-26 | 1998-08-18 | Donnelly Corporation | Vehicle headlight control using imaging sensor |
US5798575A (en) | 1996-07-11 | 1998-08-25 | Donnelly Corporation | Vehicle mirror digital network and dynamically interactive mirror system |
US5835255A (en) | 1986-04-23 | 1998-11-10 | Etalon, Inc. | Visible spectrum modulator arrays |
US5837994A (en) | 1997-04-02 | 1998-11-17 | Gentex Corporation | Control system to automatically dim vehicle head lamps |
US5845000A (en) | 1992-05-05 | 1998-12-01 | Automotive Technologies International, Inc. | Optical identification and monitoring system using pattern recognition for use with vehicles |
US5844682A (en) | 1994-03-25 | 1998-12-01 | Omron Corporation | Optical sensor device |
US5844505A (en) | 1997-04-01 | 1998-12-01 | Sony Corporation | Automobile navigation system |
US5850254A (en) | 1994-07-05 | 1998-12-15 | Hitachi, Ltd. | Imaging system for a vehicle which compares a reference image which includes a mark which is fixed to said vehicle to subsequent images |
US5850176A (en) | 1996-07-10 | 1998-12-15 | Fuji Jukogyo Kabushiki Kaisha | Drive assist system for vehicle |
US5848802A (en) | 1992-05-05 | 1998-12-15 | Automotive Technologies International, Inc. | Vehicle occupant position and velocity sensor |
US5867591A (en) | 1995-04-21 | 1999-02-02 | Matsushita Electric Industrial Co., Ltd. | Method of matching stereo images and method of measuring disparity between these image |
US5878370A (en) | 1995-12-01 | 1999-03-02 | Prince Corporation | Vehicle compass system with variable resolution |
US5877707A (en) | 1997-01-17 | 1999-03-02 | Kowalick; Thomas M. | GPS based seat belt monitoring system & method for using same |
US5877897A (en) | 1993-02-26 | 1999-03-02 | Donnelly Corporation | Automatic rearview mirror, vehicle lighting control and vehicle interior monitoring system using a photosensor array |
US5884212A (en) | 1994-04-15 | 1999-03-16 | Thomson-Csf | Process for monitoring traffic for automatic vehicle incident detection |
US5883739A (en) | 1993-10-04 | 1999-03-16 | Honda Giken Kogyo Kabushiki Kaisha | Information display device for vehicle |
US5890021A (en) | 1996-12-05 | 1999-03-30 | Canon Kabushiki Kaisha | Distance detecting device, focus state detecting device and camera having same |
US5896085A (en) | 1995-09-07 | 1999-04-20 | Toyota Jidosha Kabushiki Kaisha | Apparatus for controlling light distributions of head lamps |
US5899956A (en) | 1998-03-31 | 1999-05-04 | Advanced Future Technologies, Inc. | Vehicle mounted navigation device |
US5914815A (en) | 1997-08-29 | 1999-06-22 | Donnelly Corporation | Optical rearview system for vehicle |
US5923027A (en) | 1997-09-16 | 1999-07-13 | Gentex Corporation | Moisture sensor and windshield fog detector using an image sensor |
US5940120A (en) | 1995-10-20 | 1999-08-17 | Prince Corporation | Vanity console |
US5956181A (en) | 1997-07-18 | 1999-09-21 | Lin; William | Two way mirror with dual functions of rear view mirror and video displayer |
US5959555A (en) | 1996-08-23 | 1999-09-28 | Furuta; Yoshihisa | Apparatus for checking blind spots of vehicle |
US5963247A (en) | 1994-05-31 | 1999-10-05 | Banitt; Shmuel | Visual display systems and a system for producing recordings for visualization thereon and methods therefor |
US5971552A (en) | 1995-12-08 | 1999-10-26 | Donnelly Corporation | Vehicle global positioning system |
US5990469A (en) | 1997-04-02 | 1999-11-23 | Gentex Corporation | Control circuit for image array sensors |
US5990649A (en) | 1997-07-01 | 1999-11-23 | Murakami Corporation | Control device for quick angle adjustment of rearview mirror |
US6001486A (en) | 1994-07-29 | 1999-12-14 | Donnelly Corporation | Transparent substrate with diffuser surface |
US6020704A (en) | 1997-12-02 | 2000-02-01 | Valeo Electrical Systems, Inc. | Windscreen sensing and wiper control system |
US6049171A (en) | 1998-09-18 | 2000-04-11 | Gentex Corporation | Continuously variable headlamp control |
US6066933A (en) | 1998-10-02 | 2000-05-23 | Ponziana; Richard L. | Rain sensing system and method having automatically registered and oriented rain sensor |
US6084519A (en) | 1993-05-07 | 2000-07-04 | Control Devices, Inc. | Multi-function light sensor for vehicle |
US6087953A (en) | 1998-02-18 | 2000-07-11 | Donnelly Corporation | Rearview mirror support incorporating vehicle information display |
US6116743A (en) | 1999-09-20 | 2000-09-12 | Donnelly Corporation | Extendable exterior rearview mirror assembly for vehicles |
US6124647A (en) | 1998-12-16 | 2000-09-26 | Donnelly Corporation | Information display in a rearview mirror |
US6124886A (en) | 1997-08-25 | 2000-09-26 | Donnelly Corporation | Modular rearview mirror assembly |
US6139172A (en) | 1994-12-30 | 2000-10-31 | Donnelly Corporation | Interior mirror assembly for a vehicle incorporating a solid-state light source |
US6144022A (en) | 1999-03-15 | 2000-11-07 | Valeo Electrical Systems, Inc. | Rain sensor using statistical analysis |
US6172613B1 (en) | 1998-02-18 | 2001-01-09 | Donnelly Corporation | Rearview mirror assembly incorporating vehicle information display |
US6175300B1 (en) | 1998-09-03 | 2001-01-16 | Byron K. Kendrick | Blind spot viewing system |
US6201642B1 (en) | 1999-07-27 | 2001-03-13 | Donnelly Corporation | Vehicular vision system with a wide angle lens including a diffractive element |
US6243003B1 (en) | 1999-08-25 | 2001-06-05 | Donnelly Corporation | Accessory module for vehicle |
US6250148B1 (en) | 1998-01-07 | 2001-06-26 | Donnelly Corporation | Rain sensor mount for use in a vehicle |
US6259412B1 (en) | 1998-09-23 | 2001-07-10 | Bernard Duroux | Vehicle exterior mirror with antenna |
US6266082B1 (en) | 1995-12-19 | 2001-07-24 | Canon Kabushiki Kaisha | Communication apparatus image processing apparatus communication method and image processing method |
US6266442B1 (en) | 1998-10-23 | 2001-07-24 | Facet Technology Corp. | Method and apparatus for identifying objects depicted in a videostream |
US6285393B1 (en) | 1993-09-08 | 2001-09-04 | Sumitomo Electric Industries, Ltd. | Object recognition apparatus and method |
US6294989B1 (en) | 1998-12-16 | 2001-09-25 | Donnelly Corporation | Tire inflation assistance monitoring system |
US6297781B1 (en) | 1999-02-16 | 2001-10-02 | Gentex Corporation | Rearview mirror with integrated microwave receiver |
US6310611B1 (en) | 1996-12-10 | 2001-10-30 | Touchsensor Technologies, Llc | Differential touch sensor and control circuit therefor |
US6313454B1 (en) | 1999-07-02 | 2001-11-06 | Donnelly Corporation | Rain sensor |
US6317057B1 (en) | 2000-04-03 | 2001-11-13 | Hyundai Motor Company | Method for detecting lane deviation of vehicle |
US6320282B1 (en) | 1999-01-19 | 2001-11-20 | Touchsensor Technologies, Llc | Touch switch with integral control circuit |
US6326613B1 (en) | 1998-01-07 | 2001-12-04 | Donnelly Corporation | Vehicle interior mirror assembly adapted for containing a rain sensor |
US6329925B1 (en) | 1999-11-24 | 2001-12-11 | Donnelly Corporation | Rearview mirror assembly with added feature modular display |
US6333759B1 (en) | 1999-03-16 | 2001-12-25 | Joseph J. Mazzilli | 360 ° automobile video camera system |
US6353392B1 (en) | 1997-10-30 | 2002-03-05 | Donnelly Corporation | Rain sensor with fog discrimination |
US6370329B1 (en) | 1999-01-20 | 2002-04-09 | Zeiss Optronik Gmbh | Stabilized camera |
US6396397B1 (en) | 1993-02-26 | 2002-05-28 | Donnelly Corporation | Vehicle imaging system with stereo imaging |
US6411328B1 (en) | 1995-12-01 | 2002-06-25 | Southwest Research Institute | Method and apparatus for traffic incident detection |
US6411204B1 (en) | 1999-11-15 | 2002-06-25 | Donnelly Corporation | Deceleration based anti-collision safety light control for vehicle |
US6420975B1 (en) | 1999-08-25 | 2002-07-16 | Donnelly Corporation | Interior rearview mirror sound processing system |
US6424273B1 (en) | 2001-03-30 | 2002-07-23 | Koninklijke Philips Electronics N.V. | System to aid a driver to determine whether to change lanes |
US6428172B1 (en) | 1999-11-24 | 2002-08-06 | Donnelly Corporation | Rearview mirror assembly with utility functions |
US6430303B1 (en) | 1993-03-31 | 2002-08-06 | Fujitsu Limited | Image processing apparatus |
US20020113873A1 (en) | 2001-02-20 | 2002-08-22 | Williams Michael R. | Rear vision system for large vehicles |
US6442465B2 (en) | 1992-05-05 | 2002-08-27 | Automotive Technologies International, Inc. | Vehicular component control systems and methods |
US6477464B2 (en) | 2000-03-09 | 2002-11-05 | Donnelly Corporation | Complete mirror-based global-positioning system (GPS) navigation solution |
US6476730B2 (en) | 2000-02-29 | 2002-11-05 | Aisin Seiki Kabushiki Kaisha | Assistant apparatus and method for a vehicle in reverse motion |
US6483429B1 (en) | 1999-10-21 | 2002-11-19 | Matsushita Electric Industrial Co., Ltd. | Parking assistance system |
US6485155B1 (en) | 2001-07-06 | 2002-11-26 | Bernard Duroux | Multiplexing mirror |
US6498620B2 (en) | 1993-02-26 | 2002-12-24 | Donnelly Corporation | Vision system for a vehicle including an image capture device and a display system having a long focal length |
US6497503B1 (en) | 2001-06-21 | 2002-12-24 | Ford Global Technologies, Inc. | Headlamp system with selectable beam pattern |
US20020198634A1 (en) * | 2001-06-22 | 2002-12-26 | Kazunori Shimazaki | Parking assisting device |
US6513252B1 (en) | 1999-04-08 | 2003-02-04 | Donnelly Corporation | Vehicle compass compensation |
US6539306B2 (en) | 2001-06-15 | 2003-03-25 | Gentex Corporation | Automotive mirror with integrated Loran components |
US6547133B1 (en) | 1998-04-08 | 2003-04-15 | Donnelly Corporation | Vehicle mounted remote transaction interface system |
US6553130B1 (en) | 1993-08-11 | 2003-04-22 | Jerome H. Lemelson | Motor vehicle warning and control system and method |
US20030080877A1 (en) | 2001-10-31 | 2003-05-01 | Makoto Takagi | Device for monitoring area around vehicle |
US6574033B1 (en) | 2002-02-27 | 2003-06-03 | Iridigm Display Corporation | Microelectromechanical systems device and method for fabricating same |
US6589625B1 (en) | 2001-08-01 | 2003-07-08 | Iridigm Display Corporation | Hermetic seal and method to create the same |
US6594583B2 (en) | 2000-01-31 | 2003-07-15 | Yazaki Corporation | Side-monitoring apparatus for motor vehicle |
US20030137586A1 (en) | 2002-01-22 | 2003-07-24 | Infinite Innovations, Inc. | Vehicle video switching system and method |
US6611610B1 (en) | 1997-04-02 | 2003-08-26 | Gentex Corporation | Vehicle lamp control |
US6627918B2 (en) | 2000-09-22 | 2003-09-30 | Donnelly Corporation | Spacer elements for interactive information devices and method for making same |
US6636258B2 (en) | 2001-10-19 | 2003-10-21 | Ford Global Technologies, Llc | 360° vision system for a vehicle |
US6648477B2 (en) | 2000-07-06 | 2003-11-18 | Donnelly Corporation | Rearview mirror assembly with information display |
US6650455B2 (en) | 1994-05-05 | 2003-11-18 | Iridigm Display Corporation | Photonic mems and structures |
US20030222982A1 (en) | 2002-03-28 | 2003-12-04 | Hamdan Majil M. | Integrated video/data information system and method for application to commercial vehicles to enhance driver awareness |
US6674562B1 (en) | 1994-05-05 | 2004-01-06 | Iridigm Display Corporation | Interferometric modulation of radiation |
US6672731B2 (en) | 2000-11-20 | 2004-01-06 | Donnelly Corporation | Vehicular rearview mirror with blind spot viewing system |
US6678056B2 (en) | 2000-07-27 | 2004-01-13 | Michael John Downs | Jamin-type interferometers and components therefor |
US6680792B2 (en) | 1994-05-05 | 2004-01-20 | Iridigm Display Corporation | Interferometric modulation of radiation |
US6690268B2 (en) | 2000-03-02 | 2004-02-10 | Donnelly Corporation | Video mirror systems incorporating an accessory module |
US6700605B1 (en) | 1998-05-15 | 2004-03-02 | Matsushita Electric Industrial Co., Ltd. | Apparatus for monitoring |
US6704621B1 (en) | 1999-11-26 | 2004-03-09 | Gideon P. Stein | System and method for estimating ego-motion of a moving vehicle using successive images recorded along the vehicle's path of motion |
US6703925B2 (en) | 2000-01-28 | 2004-03-09 | Reitter & Schefenacker Gmbh & Co. Kg | Monitoring device for vehicles, in particular, motor vehicles |
US6711474B1 (en) | 2000-01-24 | 2004-03-23 | G. Victor Treyz | Automobile personal computer systems |
US6710908B2 (en) | 1994-05-05 | 2004-03-23 | Iridigm Display Corporation | Controlling micro-electro-mechanical cavities |
US6714331B2 (en) | 2001-04-20 | 2004-03-30 | Microvision, Inc. | Scanned imaging apparatus with switched feeds |
US6717610B1 (en) | 1998-11-25 | 2004-04-06 | Donnelly Corporation | Wide angle image capture system for vehicle |
US6735506B2 (en) | 1992-05-05 | 2004-05-11 | Automotive Technologies International, Inc. | Telematics system |
US6741377B2 (en) | 2002-07-02 | 2004-05-25 | Iridigm Display Corporation | Device having a light-absorbing mask and a method for fabricating same |
US6744353B2 (en) | 1999-12-15 | 2004-06-01 | Sjoenell Goeran | Blind spot detector |
US6757109B2 (en) | 1999-07-27 | 2004-06-29 | Donnelly Corporation | Plastic lens system for vehicle imaging system |
US20040130464A1 (en) | 2002-10-25 | 2004-07-08 | Schindler Benno Tobias | Method of operating a display system in a vehicle for finding a parking place |
US6762867B2 (en) | 1999-08-05 | 2004-07-13 | Microvision, Inc. | Scanned display with plurality of scanning assemblies |
US20040153243A1 (en) | 2003-01-29 | 2004-08-05 | Kazunori Shimazaki | Parking assisting device |
US6794119B2 (en) | 2002-02-12 | 2004-09-21 | Iridigm Display Corporation | Method for fabricating a structure for a microelectromechanical systems (MEMS) device |
US6795221B1 (en) | 1999-08-05 | 2004-09-21 | Microvision, Inc. | Scanned display with switched feeds and distortion correction |
US6823241B2 (en) | 2000-10-02 | 2004-11-23 | Nissan Motor Co., Ltd. | Lane recognition apparatus for vehicle |
US6822563B2 (en) | 1997-09-22 | 2004-11-23 | Donnelly Corporation | Vehicle imaging system with accessory control |
US6825880B2 (en) | 1999-12-28 | 2004-11-30 | Kabushiki Kaisha Toyoda Jidoshokki Seisakusho | Arrangement for guiding steering to assist parallel parking |
US6824281B2 (en) | 2002-01-31 | 2004-11-30 | Donnelly Corporation | Vehicle accessory module |
US6847487B2 (en) | 2001-08-23 | 2005-01-25 | Donnelly Corporation | Vehicle information display |
US6882287B2 (en) | 2001-07-31 | 2005-04-19 | Donnelly Corporation | Automotive lane change aid |
US6889161B2 (en) | 2001-04-12 | 2005-05-03 | Robert Bosch Gmbh | Method for recognizing a change in lane of a vehicle |
US6898495B2 (en) | 2001-08-24 | 2005-05-24 | Aisin Seiki Kabushiki Kaisha | Parking assist system |
US6909753B2 (en) | 2001-12-05 | 2005-06-21 | Koninklijke Philips Electronics, N.V. | Combined MPEG-4 FGS and modulation algorithm for wireless video transmission |
US20050203704A1 (en) | 2004-03-12 | 2005-09-15 | Peter Frank | Method for operating a display system in a vehicle for driving into a parking space |
US6946978B2 (en) | 2002-04-25 | 2005-09-20 | Donnelly Corporation | Imaging system for vehicle |
US6947064B1 (en) | 1999-08-27 | 2005-09-20 | Daimlerchrysler Ag | Method for displaying a perspective image and display device for at least one passenger of a motor vehicle |
US6975775B2 (en) | 2002-03-06 | 2005-12-13 | Radiant Imaging, Inc. | Stray light correction method for imaging light and color measurement system |
US20050285758A1 (en) | 2004-06-23 | 2005-12-29 | Denso Corporation | Parking assistance system |
US7005974B2 (en) | 2002-04-19 | 2006-02-28 | Donnelly Corporation | Vehicle imaging system |
US7004593B2 (en) | 2002-06-06 | 2006-02-28 | Donnelly Corporation | Interior rearview mirror system with compass |
US7004606B2 (en) | 2002-04-23 | 2006-02-28 | Donnelly Corporation | Automatic headlamp control |
US20060050018A1 (en) | 2002-12-20 | 2006-03-09 | Hutzel Barry W | Accessory system for vehicle |
US7038577B2 (en) | 2002-05-03 | 2006-05-02 | Donnelly Corporation | Object detection system for vehicle |
US20060103727A1 (en) | 2004-11-17 | 2006-05-18 | Huan-Chin Tseng | Vehicle back up camera |
US7062300B1 (en) | 2000-11-09 | 2006-06-13 | Ki Il Kim | Cellular phone holder with charger mounted to vehicle dashboard |
US7065432B2 (en) | 2003-10-02 | 2006-06-20 | Daimlerchrysler Ag | Device for improving the visibility conditions in a motor vehicle |
US20060164230A1 (en) | 2000-03-02 | 2006-07-27 | Dewind Darryl P | Interior mirror assembly with display |
US7085637B2 (en) | 1997-10-22 | 2006-08-01 | Intelligent Technologies International, Inc. | Method and system for controlling a vehicle |
US7116246B2 (en) | 2001-10-03 | 2006-10-03 | Maryann Winter | Apparatus and method for sensing the occupancy status of parking spaces in a parking lot |
US7123168B2 (en) | 2002-04-25 | 2006-10-17 | Donnelly Corporation | Driving separation distance indicator |
US20060250501A1 (en) | 2005-05-06 | 2006-11-09 | Widmann Glenn R | Vehicle security monitor system and method |
US7149613B2 (en) | 2001-03-05 | 2006-12-12 | Gentex Corporation | Image processing system to control vehicle headlamps or other vehicle equipment |
US20060287825A1 (en) | 1999-06-25 | 2006-12-21 | Fujitsu Ten Limited | Vehicle drive assist system |
US7167796B2 (en) | 2000-03-09 | 2007-01-23 | Donnelly Corporation | Vehicle navigation system for use with a telematics system |
US20070021881A1 (en) | 2005-07-25 | 2007-01-25 | Aisin Aw Co., Ltd. | Parking assist devices, methods, and programs |
US7202776B2 (en) | 1997-10-22 | 2007-04-10 | Intelligent Technologies International, Inc. | Method and system for detecting objects external to a vehicle |
US20070104476A1 (en) | 2005-11-04 | 2007-05-10 | Konica Minolta Photo Imaging, Inc. | Camera system and controller |
US7227611B2 (en) | 2004-08-23 | 2007-06-05 | The Boeing Company | Adaptive and interactive scene illumination |
US7295227B1 (en) * | 1999-01-19 | 2007-11-13 | Kabushiki Kaisha Toyoda Jidoshokki Seisakusho | Apparatus for assisting steering of vehicle when backing |
US20080077294A1 (en) * | 2004-06-05 | 2008-03-27 | Christian Danz | Method And Device For The Assisted Parking Of A Motor Vehicle |
US20080211651A1 (en) * | 2003-06-02 | 2008-09-04 | Uwe Beutnagel-Buchner | Displaying Unit and Method for Displaying a Steering-Wheel Angle, to be Modified, of a Motor Vehicle |
US7526103B2 (en) | 2004-04-15 | 2009-04-28 | Donnelly Corporation | Imaging system for vehicle |
US20090113509A1 (en) | 2007-10-30 | 2009-04-30 | Av Tech Corporation | Video system, video transmitter, video receiver and control method for the same |
US20090157260A1 (en) * | 2007-12-12 | 2009-06-18 | Hyundai Motor Company | Automatic parking system for vehicle |
US7598887B2 (en) | 2005-12-28 | 2009-10-06 | Aisin Seiki Kabushiki Kaisha | Parking assist apparatus |
US7619508B2 (en) | 2001-01-23 | 2009-11-17 | Donnelly Corporation | Video mirror system for a vehicle |
US7639149B2 (en) | 2006-05-09 | 2009-12-29 | Denso Corporation | Automatic lighting device and method for controlling light |
US20100013670A1 (en) | 2005-07-26 | 2010-01-21 | Martin Hueppauff | Parking apparatus |
US20100039292A1 (en) * | 2005-06-13 | 2010-02-18 | Michael Scherl | Method and Device for Outputting Parking Instructions |
US7720580B2 (en) | 2004-12-23 | 2010-05-18 | Donnelly Corporation | Object detection system for vehicle |
US20100235053A1 (en) | 2006-12-12 | 2010-09-16 | Toyota Jidosha Kabushiki Kaisha | Parking assist device |
US20100286872A1 (en) | 2008-02-18 | 2010-11-11 | Toyota Jidosha Kabushiki Kaisha | Parking assisting apparatus |
US7914187B2 (en) | 2007-07-12 | 2011-03-29 | Magna Electronics Inc. | Automatic lighting system with adaptive alignment function |
US8285479B2 (en) | 2007-03-08 | 2012-10-09 | Toyota Jidosha Kabushiki Kaisha | Parking assist apparatus |
US20130046441A1 (en) | 2009-07-27 | 2013-02-21 | Magna Electronics Inc. | Parking assist system |
US20130103246A1 (en) * | 2010-04-28 | 2013-04-25 | Jochen STAACK | Parking system having longitudinal and transverse guidance |
US20130116859A1 (en) | 2011-10-27 | 2013-05-09 | Magna Electronics Inc. | Driver assist system with algorithm switching |
US8451107B2 (en) | 2007-09-11 | 2013-05-28 | Magna Electronics, Inc. | Imaging system for vehicle |
US20140067206A1 (en) | 2012-09-04 | 2014-03-06 | Magna Electronics Inc. | Driver assistant system using influence mapping for conflict avoidance path determination |
US20140354811A1 (en) | 2013-06-03 | 2014-12-04 | Magna Electronics Inc. | Vehicle vision system with enhanced low light capabilities |
US20140375476A1 (en) | 2013-06-24 | 2014-12-25 | Magna Electronics Inc. | Vehicle alert system |
US20150022664A1 (en) | 2012-01-20 | 2015-01-22 | Magna Electronics Inc. | Vehicle vision system with positionable virtual viewpoint |
US20150042808A1 (en) | 2013-08-12 | 2015-02-12 | Magna Electronics Inc. | Vehicle vision system with image classification |
US20150124096A1 (en) | 2013-10-25 | 2015-05-07 | Magna Electronics Inc. | Vehicle vision system utilizing communication system |
US20150158499A1 (en) | 2013-12-05 | 2015-06-11 | Magna Electronics Inc. | Vehicle monitoring system |
US20150251599A1 (en) | 2014-03-04 | 2015-09-10 | Magna Electronics Inc. | Vehicle alert system utilizing communication system |
US20150344028A1 (en) | 2014-06-02 | 2015-12-03 | Magna Electronics Inc. | Parking assist system with annotated map generation |
US20160096477A1 (en) | 2014-10-07 | 2016-04-07 | Magna Electronics Inc. | Vehicle vision system with gray level transition sensitive pixels |
US20160162747A1 (en) | 2014-12-05 | 2016-06-09 | Magna Electronics Inc. | Vehicle vision system with retroreflector pattern recognition |
US20170083774A1 (en) | 2015-09-23 | 2017-03-23 | Magna Electronics Inc. | Vehicle vision system with detection enhancement using light control |
Family Cites Families (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB0405014D0 (en) * | 2004-03-05 | 2004-04-07 | Qinetiq Ltd | Movement control system |
JP2007030700A (en) * | 2005-07-27 | 2007-02-08 | Aisin Seiki Co Ltd | Parking support device |
US8694195B2 (en) * | 2007-12-04 | 2014-04-08 | Volkswagen Ag | Motor vehicle having a wheel-view camera and method for controlling a wheel-view camera system |
DE102010031672A1 (en) * | 2010-07-22 | 2012-01-26 | Robert Bosch Gmbh | Method for assisting a driver of a motor vehicle |
US20140132767A1 (en) * | 2010-07-31 | 2014-05-15 | Eric Sonnabend | Parking Information Collection System and Method |
DE102010063133A1 (en) * | 2010-12-15 | 2012-06-21 | Robert Bosch Gmbh | Method and system for determining a self-motion of a vehicle |
DE102011003881A1 (en) * | 2011-02-09 | 2012-08-09 | Robert Bosch Gmbh | Method for assisting a driver of a motor vehicle |
US9429943B2 (en) * | 2012-03-05 | 2016-08-30 | Florida A&M University | Artificial intelligence valet systems and methods |
US10089537B2 (en) * | 2012-05-18 | 2018-10-02 | Magna Electronics Inc. | Vehicle vision system with front and rear camera integration |
KR102281914B1 (en) * | 2012-10-17 | 2021-07-27 | 타워-섹 리미티드 | A device for detection and prevention of an attack on a vehicle |
EP3514032B1 (en) * | 2013-12-04 | 2024-02-07 | Mobileye Vision Technologies Ltd. | Adjusting velocity of a vehicle for a curve |
US20170212511A1 (en) * | 2014-01-30 | 2017-07-27 | Universidade Do Porto | Device and method for self-automated parking lot for autonomous vehicles based on vehicular networking |
DE102014001554B4 (en) * | 2014-02-05 | 2016-07-14 | Audi Ag | Method for automatically parking a vehicle and associated control device |
US10089693B1 (en) * | 2014-05-20 | 2018-10-02 | State Farm Mutual Automobile Insurance Company | Fully autonomous vehicle insurance pricing |
US9628565B2 (en) * | 2014-07-23 | 2017-04-18 | Here Global B.V. | Highly assisted driving platform |
US10214206B2 (en) * | 2015-07-13 | 2019-02-26 | Magna Electronics Inc. | Parking assist system for vehicle |
-
2016
- 2016-07-11 US US15/206,801 patent/US10214206B2/en active Active
-
2019
- 2019-02-25 US US16/283,978 patent/US11104327B2/en active Active
Patent Citations (252)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5835255A (en) | 1986-04-23 | 1998-11-10 | Etalon, Inc. | Visible spectrum modulator arrays |
US5451822A (en) | 1991-03-15 | 1995-09-19 | Gentex Corporation | Electronic control system |
US5355118A (en) | 1991-07-11 | 1994-10-11 | Nissan Motor Co., Ltd. | Vehicle collision alert system |
US5469298A (en) | 1991-08-14 | 1995-11-21 | Prince Corporation | Reflective display at infinity |
US5535314A (en) | 1991-11-04 | 1996-07-09 | Hughes Aircraft Company | Video image processor and method for detecting vehicles |
US5461357A (en) | 1992-01-29 | 1995-10-24 | Mazda Motor Corporation | Obstacle detection device for vehicle |
US5416478A (en) | 1992-03-12 | 1995-05-16 | Funai Electric Co., Ltd. | Car navigation system |
US5781437A (en) | 1992-04-21 | 1998-07-14 | Ibp Pietzsch Gmbh | Control system for controlling vehicles |
US5845000A (en) | 1992-05-05 | 1998-12-01 | Automotive Technologies International, Inc. | Optical identification and monitoring system using pattern recognition for use with vehicles |
US5848802A (en) | 1992-05-05 | 1998-12-15 | Automotive Technologies International, Inc. | Vehicle occupant position and velocity sensor |
US6735506B2 (en) | 1992-05-05 | 2004-05-11 | Automotive Technologies International, Inc. | Telematics system |
US6442465B2 (en) | 1992-05-05 | 2002-08-27 | Automotive Technologies International, Inc. | Vehicular component control systems and methods |
US5426294A (en) | 1992-05-27 | 1995-06-20 | Koito Manufacturing Co., Ltd. | Glare sensor for a vehicle |
US5793308A (en) | 1992-07-02 | 1998-08-11 | Sensorvision Technologies, L.L.C. | Vehicular position monitoring system with integral mirror video display |
US5515448A (en) | 1992-07-28 | 1996-05-07 | Yazaki Corporation | Distance measuring apparatus of a target tracking type |
US5541590A (en) | 1992-08-04 | 1996-07-30 | Takata Corporation | Vehicle crash predictive and evasive operation system by neural networks |
US5521633A (en) | 1992-09-25 | 1996-05-28 | Yazaki Corporation | Motor vehicle obstacle monitoring system using optical flow processing |
US5510983A (en) | 1992-11-13 | 1996-04-23 | Yazaki Corporation | On-vehicle display |
US5760931A (en) | 1992-12-14 | 1998-06-02 | Nippondenso Co., Ltd. | Image display unit |
US5530240A (en) | 1992-12-15 | 1996-06-25 | Donnelly Corporation | Display for automatic rearview mirror |
US5475494A (en) | 1992-12-22 | 1995-12-12 | Mitsubishi Denki Kabushiki Kaisha | Driving environment surveillance apparatus |
US5444478A (en) | 1992-12-29 | 1995-08-22 | U.S. Philips Corporation | Image processing method and device for constructing an image from adjacent images |
US5529138A (en) | 1993-01-22 | 1996-06-25 | Shaw; David C. H. | Vehicle collision avoidance system |
US5796094A (en) | 1993-02-26 | 1998-08-18 | Donnelly Corporation | Vehicle headlight control using imaging sensor |
US7227459B2 (en) | 1993-02-26 | 2007-06-05 | Donnelly Corporation | Vehicle imaging system |
US6498620B2 (en) | 1993-02-26 | 2002-12-24 | Donnelly Corporation | Vision system for a vehicle including an image capture device and a display system having a long focal length |
US6396397B1 (en) | 1993-02-26 | 2002-05-28 | Donnelly Corporation | Vehicle imaging system with stereo imaging |
US5877897A (en) | 1993-02-26 | 1999-03-02 | Donnelly Corporation | Automatic rearview mirror, vehicle lighting control and vehicle interior monitoring system using a photosensor array |
US5550677A (en) | 1993-02-26 | 1996-08-27 | Donnelly Corporation | Automatic rearview mirror system using a photosensor array |
US5670935A (en) | 1993-02-26 | 1997-09-23 | Donnelly Corporation | Rearview vision system for vehicle including panoramic view |
US5949331A (en) | 1993-02-26 | 1999-09-07 | Donnelly Corporation | Display enhancements for vehicle vision system |
US5986796A (en) | 1993-03-17 | 1999-11-16 | Etalon Inc. | Visible spectrum modulator arrays |
US5424952A (en) | 1993-03-26 | 1995-06-13 | Mitsubishi Denki Kabushiki Kaisha | Vehicle-surroundings monitoring apparatus |
US5539397A (en) | 1993-03-26 | 1996-07-23 | Honda Giken Kogyo Kabushiki Kaisha | Driving control system for vehicle |
US6430303B1 (en) | 1993-03-31 | 2002-08-06 | Fujitsu Limited | Image processing apparatus |
US6084519A (en) | 1993-05-07 | 2000-07-04 | Control Devices, Inc. | Multi-function light sensor for vehicle |
US5498866A (en) | 1993-06-01 | 1996-03-12 | Leopold Kostal Gmbh & Co. Kg | Optoelectronic sensor for detecting moisture on a windshield with means to compensate for a metallic layer in the windshield |
US6553130B1 (en) | 1993-08-11 | 2003-04-22 | Jerome H. Lemelson | Motor vehicle warning and control system and method |
US5434407A (en) | 1993-08-23 | 1995-07-18 | Gentex Corporation | Automatic rearview mirror incorporating light pipe |
US5765116A (en) | 1993-08-28 | 1998-06-09 | Lucas Industries Public Limited Company | Driver assistance system for a vehicle |
US6285393B1 (en) | 1993-09-08 | 2001-09-04 | Sumitomo Electric Industries, Ltd. | Object recognition apparatus and method |
US5457493A (en) | 1993-09-15 | 1995-10-10 | Texas Instruments Incorporated | Digital micro-mirror based image simulation system |
US5440428A (en) | 1993-09-30 | 1995-08-08 | Hughes Aircraft Company | Automotive instrument 3-D virtual image display |
US5883739A (en) | 1993-10-04 | 1999-03-16 | Honda Giken Kogyo Kabushiki Kaisha | Information display device for vehicle |
US5530420A (en) | 1993-12-27 | 1996-06-25 | Fuji Jukogyo Kabushiki Kaisha | Running guide apparatus for vehicle capable of keeping safety at passing through narrow path and the method thereof |
US5430431A (en) | 1994-01-19 | 1995-07-04 | Nelson; Louis J. | Vehicle protection system and method |
US5471515A (en) | 1994-01-28 | 1995-11-28 | California Institute Of Technology | Active pixel sensor with intra-pixel charge transfer |
US5461361A (en) | 1994-03-11 | 1995-10-24 | Chrysler Corporation | Automotive instrument panel apparatus |
US5844682A (en) | 1994-03-25 | 1998-12-01 | Omron Corporation | Optical sensor device |
US5537003A (en) | 1994-04-08 | 1996-07-16 | Gentex Corporation | Control system for automotive vehicle headlamps and other vehicle equipment |
US5884212A (en) | 1994-04-15 | 1999-03-16 | Thomson-Csf | Process for monitoring traffic for automatic vehicle incident detection |
US6650455B2 (en) | 1994-05-05 | 2003-11-18 | Iridigm Display Corporation | Photonic mems and structures |
US6674562B1 (en) | 1994-05-05 | 2004-01-06 | Iridigm Display Corporation | Interferometric modulation of radiation |
US6680792B2 (en) | 1994-05-05 | 2004-01-20 | Iridigm Display Corporation | Interferometric modulation of radiation |
US6710908B2 (en) | 1994-05-05 | 2004-03-23 | Iridigm Display Corporation | Controlling micro-electro-mechanical cavities |
US5963247A (en) | 1994-05-31 | 1999-10-05 | Banitt; Shmuel | Visual display systems and a system for producing recordings for visualization thereon and methods therefor |
US5760828A (en) | 1994-06-03 | 1998-06-02 | Idesa Accesorios, S.A. | Back-vision system for vehicles |
US5850254A (en) | 1994-07-05 | 1998-12-15 | Hitachi, Ltd. | Imaging system for a vehicle which compares a reference image which includes a mark which is fixed to said vehicle to subsequent images |
US5790403A (en) | 1994-07-12 | 1998-08-04 | Honda Giken Kogyo Kabushiki Kaisha | Lane image processing system for vehicle |
US6001486A (en) | 1994-07-29 | 1999-12-14 | Donnelly Corporation | Transparent substrate with diffuser surface |
US5793420A (en) | 1994-10-28 | 1998-08-11 | Schmidt; William P. | Video recording system for vehicle |
US6139172A (en) | 1994-12-30 | 2000-10-31 | Donnelly Corporation | Interior mirror assembly for a vehicle incorporating a solid-state light source |
US5528698A (en) | 1995-03-27 | 1996-06-18 | Rockwell International Corporation | Automotive occupant sensing device |
US5867591A (en) | 1995-04-21 | 1999-02-02 | Matsushita Electric Industrial Co., Ltd. | Method of matching stereo images and method of measuring disparity between these image |
US5500766A (en) | 1995-05-04 | 1996-03-19 | Stonecypher; Bob | Blind spot side mirror |
US5737226A (en) | 1995-06-05 | 1998-04-07 | Prince Corporation | Vehicle compass system with automatic calibration |
US5896085A (en) | 1995-09-07 | 1999-04-20 | Toyota Jidosha Kabushiki Kaisha | Apparatus for controlling light distributions of head lamps |
US5724316A (en) | 1995-09-26 | 1998-03-03 | Delco Electronics Corporation | GPS based time determining system and method |
US5940120A (en) | 1995-10-20 | 1999-08-17 | Prince Corporation | Vanity console |
US5878370A (en) | 1995-12-01 | 1999-03-02 | Prince Corporation | Vehicle compass system with variable resolution |
US6411328B1 (en) | 1995-12-01 | 2002-06-25 | Southwest Research Institute | Method and apparatus for traffic incident detection |
US5971552A (en) | 1995-12-08 | 1999-10-26 | Donnelly Corporation | Vehicle global positioning system |
US5790973A (en) | 1995-12-19 | 1998-08-04 | Prince Corporation | Last exit warning system |
US6266082B1 (en) | 1995-12-19 | 2001-07-24 | Canon Kabushiki Kaisha | Communication apparatus image processing apparatus communication method and image processing method |
US5761094A (en) | 1996-01-18 | 1998-06-02 | Prince Corporation | Vehicle compass system |
US5929786A (en) | 1996-03-22 | 1999-07-27 | Donnelly Corporation | Vehicle blind spot detection display system |
US5786772A (en) | 1996-03-22 | 1998-07-28 | Donnelly Corporation | Vehicle blind spot detection display system |
US5760826A (en) | 1996-05-10 | 1998-06-02 | The Trustees Of Columbia University | Omnidirectional imaging apparatus |
US5850176A (en) | 1996-07-10 | 1998-12-15 | Fuji Jukogyo Kabushiki Kaisha | Drive assist system for vehicle |
US5959367A (en) | 1996-07-11 | 1999-09-28 | Donnelly Corporation | Vehicle mirror digital network and dynamically interactive mirror system |
US5798575A (en) | 1996-07-11 | 1998-08-25 | Donnelly Corporation | Vehicle mirror digital network and dynamically interactive mirror system |
US6175164B1 (en) | 1996-07-11 | 2001-01-16 | Donnelly Corporation | Vehicle mirror digital network and dynamically interactive mirror system |
US5959555A (en) | 1996-08-23 | 1999-09-28 | Furuta; Yoshihisa | Apparatus for checking blind spots of vehicle |
US5890021A (en) | 1996-12-05 | 1999-03-30 | Canon Kabushiki Kaisha | Distance detecting device, focus state detecting device and camera having same |
US6310611B1 (en) | 1996-12-10 | 2001-10-30 | Touchsensor Technologies, Llc | Differential touch sensor and control circuit therefor |
US5877707A (en) | 1997-01-17 | 1999-03-02 | Kowalick; Thomas M. | GPS based seat belt monitoring system & method for using same |
US5844505A (en) | 1997-04-01 | 1998-12-01 | Sony Corporation | Automobile navigation system |
US5990469A (en) | 1997-04-02 | 1999-11-23 | Gentex Corporation | Control circuit for image array sensors |
US20060091813A1 (en) | 1997-04-02 | 2006-05-04 | Stam Joseph S | Control system to automatically control vehicle headlamps |
US5837994A (en) | 1997-04-02 | 1998-11-17 | Gentex Corporation | Control system to automatically dim vehicle head lamps |
US5837994C1 (en) | 1997-04-02 | 2001-10-16 | Gentex Corp | Control system to automatically dim vehicle head lamps |
US6611610B1 (en) | 1997-04-02 | 2003-08-26 | Gentex Corporation | Vehicle lamp control |
US5990649A (en) | 1997-07-01 | 1999-11-23 | Murakami Corporation | Control device for quick angle adjustment of rearview mirror |
US5956181A (en) | 1997-07-18 | 1999-09-21 | Lin; William | Two way mirror with dual functions of rear view mirror and video displayer |
US6124886A (en) | 1997-08-25 | 2000-09-26 | Donnelly Corporation | Modular rearview mirror assembly |
US5914815A (en) | 1997-08-29 | 1999-06-22 | Donnelly Corporation | Optical rearview system for vehicle |
US5923027A (en) | 1997-09-16 | 1999-07-13 | Gentex Corporation | Moisture sensor and windshield fog detector using an image sensor |
US6097024A (en) | 1997-09-16 | 2000-08-01 | Gentex Corporation | Moisture sensor and windshield fog detector |
US6806452B2 (en) | 1997-09-22 | 2004-10-19 | Donnelly Corporation | Interior rearview mirror system including a forward facing video device |
US6822563B2 (en) | 1997-09-22 | 2004-11-23 | Donnelly Corporation | Vehicle imaging system with accessory control |
US7085637B2 (en) | 1997-10-22 | 2006-08-01 | Intelligent Technologies International, Inc. | Method and system for controlling a vehicle |
US7202776B2 (en) | 1997-10-22 | 2007-04-10 | Intelligent Technologies International, Inc. | Method and system for detecting objects external to a vehicle |
US6353392B1 (en) | 1997-10-30 | 2002-03-05 | Donnelly Corporation | Rain sensor with fog discrimination |
US6020704A (en) | 1997-12-02 | 2000-02-01 | Valeo Electrical Systems, Inc. | Windscreen sensing and wiper control system |
US6326613B1 (en) | 1998-01-07 | 2001-12-04 | Donnelly Corporation | Vehicle interior mirror assembly adapted for containing a rain sensor |
US6341523B2 (en) | 1998-01-07 | 2002-01-29 | Donnelly Corporation | Rain sensor mount for use in a vehicle |
US6250148B1 (en) | 1998-01-07 | 2001-06-26 | Donnelly Corporation | Rain sensor mount for use in a vehicle |
US6968736B2 (en) | 1998-01-07 | 2005-11-29 | Donnelly Corporation | Rain sensor mounting system |
US6516664B2 (en) | 1998-01-07 | 2003-02-11 | Donnelly Corporation | Rain sensor mount for use in a vehicle |
US6593565B2 (en) | 1998-01-07 | 2003-07-15 | Donnelly Corporation | Vehicle interior rearview mirror assembly including an accessory-containing housing |
US6366213B2 (en) | 1998-02-18 | 2002-04-02 | Donnelly Corporation | Rearview mirror assembly incorporating electrical accessories |
US6087953A (en) | 1998-02-18 | 2000-07-11 | Donnelly Corporation | Rearview mirror support incorporating vehicle information display |
US6222460B1 (en) | 1998-02-18 | 2001-04-24 | Donnelly Corporation | Interior rearview mirror system incorporating a supplemental inflatable restraint system status information display |
US6172613B1 (en) | 1998-02-18 | 2001-01-09 | Donnelly Corporation | Rearview mirror assembly incorporating vehicle information display |
US5899956A (en) | 1998-03-31 | 1999-05-04 | Advanced Future Technologies, Inc. | Vehicle mounted navigation device |
US6547133B1 (en) | 1998-04-08 | 2003-04-15 | Donnelly Corporation | Vehicle mounted remote transaction interface system |
US6700605B1 (en) | 1998-05-15 | 2004-03-02 | Matsushita Electric Industrial Co., Ltd. | Apparatus for monitoring |
US6175300B1 (en) | 1998-09-03 | 2001-01-16 | Byron K. Kendrick | Blind spot viewing system |
US6049171A (en) | 1998-09-18 | 2000-04-11 | Gentex Corporation | Continuously variable headlamp control |
US6259412B1 (en) | 1998-09-23 | 2001-07-10 | Bernard Duroux | Vehicle exterior mirror with antenna |
US6066933A (en) | 1998-10-02 | 2000-05-23 | Ponziana; Richard L. | Rain sensing system and method having automatically registered and oriented rain sensor |
US7092548B2 (en) | 1998-10-23 | 2006-08-15 | Facet Technology Corporation | Method and apparatus for identifying objects depicted in a videostream |
US6266442B1 (en) | 1998-10-23 | 2001-07-24 | Facet Technology Corp. | Method and apparatus for identifying objects depicted in a videostream |
US6717610B1 (en) | 1998-11-25 | 2004-04-06 | Donnelly Corporation | Wide angle image capture system for vehicle |
US6291906B1 (en) | 1998-12-16 | 2001-09-18 | Donnelly Corporation | Information display for vehicles |
US6294989B1 (en) | 1998-12-16 | 2001-09-25 | Donnelly Corporation | Tire inflation assistance monitoring system |
US6124647A (en) | 1998-12-16 | 2000-09-26 | Donnelly Corporation | Information display in a rearview mirror |
US6534884B2 (en) | 1998-12-16 | 2003-03-18 | Donnelly Corporation | Proximity sensing system for vehicles |
US6320282B1 (en) | 1999-01-19 | 2001-11-20 | Touchsensor Technologies, Llc | Touch switch with integral control circuit |
US7295227B1 (en) * | 1999-01-19 | 2007-11-13 | Kabushiki Kaisha Toyoda Jidoshokki Seisakusho | Apparatus for assisting steering of vehicle when backing |
US6370329B1 (en) | 1999-01-20 | 2002-04-09 | Zeiss Optronik Gmbh | Stabilized camera |
US6297781B1 (en) | 1999-02-16 | 2001-10-02 | Gentex Corporation | Rearview mirror with integrated microwave receiver |
US6144022A (en) | 1999-03-15 | 2000-11-07 | Valeo Electrical Systems, Inc. | Rain sensor using statistical analysis |
US6333759B1 (en) | 1999-03-16 | 2001-12-25 | Joseph J. Mazzilli | 360 ° automobile video camera system |
US6513252B1 (en) | 1999-04-08 | 2003-02-04 | Donnelly Corporation | Vehicle compass compensation |
US7366595B1 (en) | 1999-06-25 | 2008-04-29 | Seiko Epson Corporation | Vehicle drive assist system |
US20060287825A1 (en) | 1999-06-25 | 2006-12-21 | Fujitsu Ten Limited | Vehicle drive assist system |
US20060287826A1 (en) | 1999-06-25 | 2006-12-21 | Fujitsu Ten Limited | Vehicle drive assist system |
US6313454B1 (en) | 1999-07-02 | 2001-11-06 | Donnelly Corporation | Rain sensor |
US6757109B2 (en) | 1999-07-27 | 2004-06-29 | Donnelly Corporation | Plastic lens system for vehicle imaging system |
US6201642B1 (en) | 1999-07-27 | 2001-03-13 | Donnelly Corporation | Vehicular vision system with a wide angle lens including a diffractive element |
US6795221B1 (en) | 1999-08-05 | 2004-09-21 | Microvision, Inc. | Scanned display with switched feeds and distortion correction |
US6762867B2 (en) | 1999-08-05 | 2004-07-13 | Microvision, Inc. | Scanned display with plurality of scanning assemblies |
US6420975B1 (en) | 1999-08-25 | 2002-07-16 | Donnelly Corporation | Interior rearview mirror sound processing system |
US6650233B2 (en) | 1999-08-25 | 2003-11-18 | Donnelly Corporation | Mirror-based audio system for vehicle |
US6433676B2 (en) | 1999-08-25 | 2002-08-13 | Donnelly Corporation | Mirror-based audio system for a vehicle |
US6243003B1 (en) | 1999-08-25 | 2001-06-05 | Donnelly Corporation | Accessory module for vehicle |
US6947064B1 (en) | 1999-08-27 | 2005-09-20 | Daimlerchrysler Ag | Method for displaying a perspective image and display device for at least one passenger of a motor vehicle |
US6116743A (en) | 1999-09-20 | 2000-09-12 | Donnelly Corporation | Extendable exterior rearview mirror assembly for vehicles |
US6483429B1 (en) | 1999-10-21 | 2002-11-19 | Matsushita Electric Industrial Co., Ltd. | Parking assistance system |
US6411204B1 (en) | 1999-11-15 | 2002-06-25 | Donnelly Corporation | Deceleration based anti-collision safety light control for vehicle |
US6678614B2 (en) | 1999-11-24 | 2004-01-13 | Donnelly Corporation | Navigation system for a vehicle |
US6329925B1 (en) | 1999-11-24 | 2001-12-11 | Donnelly Corporation | Rearview mirror assembly with added feature modular display |
US6428172B1 (en) | 1999-11-24 | 2002-08-06 | Donnelly Corporation | Rearview mirror assembly with utility functions |
US6704621B1 (en) | 1999-11-26 | 2004-03-09 | Gideon P. Stein | System and method for estimating ego-motion of a moving vehicle using successive images recorded along the vehicle's path of motion |
US6744353B2 (en) | 1999-12-15 | 2004-06-01 | Sjoenell Goeran | Blind spot detector |
US6825880B2 (en) | 1999-12-28 | 2004-11-30 | Kabushiki Kaisha Toyoda Jidoshokki Seisakusho | Arrangement for guiding steering to assist parallel parking |
US6711474B1 (en) | 2000-01-24 | 2004-03-23 | G. Victor Treyz | Automobile personal computer systems |
US6703925B2 (en) | 2000-01-28 | 2004-03-09 | Reitter & Schefenacker Gmbh & Co. Kg | Monitoring device for vehicles, in particular, motor vehicles |
US6594583B2 (en) | 2000-01-31 | 2003-07-15 | Yazaki Corporation | Side-monitoring apparatus for motor vehicle |
US6476730B2 (en) | 2000-02-29 | 2002-11-05 | Aisin Seiki Kabushiki Kaisha | Assistant apparatus and method for a vehicle in reverse motion |
US6690268B2 (en) | 2000-03-02 | 2004-02-10 | Donnelly Corporation | Video mirror systems incorporating an accessory module |
US20060164230A1 (en) | 2000-03-02 | 2006-07-27 | Dewind Darryl P | Interior mirror assembly with display |
US6477464B2 (en) | 2000-03-09 | 2002-11-05 | Donnelly Corporation | Complete mirror-based global-positioning system (GPS) navigation solution |
US7167796B2 (en) | 2000-03-09 | 2007-01-23 | Donnelly Corporation | Vehicle navigation system for use with a telematics system |
US6317057B1 (en) | 2000-04-03 | 2001-11-13 | Hyundai Motor Company | Method for detecting lane deviation of vehicle |
US6648477B2 (en) | 2000-07-06 | 2003-11-18 | Donnelly Corporation | Rearview mirror assembly with information display |
US6678056B2 (en) | 2000-07-27 | 2004-01-13 | Michael John Downs | Jamin-type interferometers and components therefor |
US6627918B2 (en) | 2000-09-22 | 2003-09-30 | Donnelly Corporation | Spacer elements for interactive information devices and method for making same |
US6823241B2 (en) | 2000-10-02 | 2004-11-23 | Nissan Motor Co., Ltd. | Lane recognition apparatus for vehicle |
US7062300B1 (en) | 2000-11-09 | 2006-06-13 | Ki Il Kim | Cellular phone holder with charger mounted to vehicle dashboard |
US6672731B2 (en) | 2000-11-20 | 2004-01-06 | Donnelly Corporation | Vehicular rearview mirror with blind spot viewing system |
US7619508B2 (en) | 2001-01-23 | 2009-11-17 | Donnelly Corporation | Video mirror system for a vehicle |
US20020113873A1 (en) | 2001-02-20 | 2002-08-22 | Williams Michael R. | Rear vision system for large vehicles |
US7149613B2 (en) | 2001-03-05 | 2006-12-12 | Gentex Corporation | Image processing system to control vehicle headlamps or other vehicle equipment |
US6424273B1 (en) | 2001-03-30 | 2002-07-23 | Koninklijke Philips Electronics N.V. | System to aid a driver to determine whether to change lanes |
US6889161B2 (en) | 2001-04-12 | 2005-05-03 | Robert Bosch Gmbh | Method for recognizing a change in lane of a vehicle |
US6714331B2 (en) | 2001-04-20 | 2004-03-30 | Microvision, Inc. | Scanned imaging apparatus with switched feeds |
US6539306B2 (en) | 2001-06-15 | 2003-03-25 | Gentex Corporation | Automotive mirror with integrated Loran components |
US6497503B1 (en) | 2001-06-21 | 2002-12-24 | Ford Global Technologies, Inc. | Headlamp system with selectable beam pattern |
US20020198634A1 (en) * | 2001-06-22 | 2002-12-26 | Kazunori Shimazaki | Parking assisting device |
US6485155B1 (en) | 2001-07-06 | 2002-11-26 | Bernard Duroux | Multiplexing mirror |
US6882287B2 (en) | 2001-07-31 | 2005-04-19 | Donnelly Corporation | Automotive lane change aid |
US6589625B1 (en) | 2001-08-01 | 2003-07-08 | Iridigm Display Corporation | Hermetic seal and method to create the same |
US6847487B2 (en) | 2001-08-23 | 2005-01-25 | Donnelly Corporation | Vehicle information display |
US6898495B2 (en) | 2001-08-24 | 2005-05-24 | Aisin Seiki Kabushiki Kaisha | Parking assist system |
US7116246B2 (en) | 2001-10-03 | 2006-10-03 | Maryann Winter | Apparatus and method for sensing the occupancy status of parking spaces in a parking lot |
US6636258B2 (en) | 2001-10-19 | 2003-10-21 | Ford Global Technologies, Llc | 360° vision system for a vehicle |
US20030080877A1 (en) | 2001-10-31 | 2003-05-01 | Makoto Takagi | Device for monitoring area around vehicle |
US6940423B2 (en) | 2001-10-31 | 2005-09-06 | Toyota Jidosha Kabushiki Kaisha | Device for monitoring area around vehicle |
US6909753B2 (en) | 2001-12-05 | 2005-06-21 | Koninklijke Philips Electronics, N.V. | Combined MPEG-4 FGS and modulation algorithm for wireless video transmission |
US20030137586A1 (en) | 2002-01-22 | 2003-07-24 | Infinite Innovations, Inc. | Vehicle video switching system and method |
US6824281B2 (en) | 2002-01-31 | 2004-11-30 | Donnelly Corporation | Vehicle accessory module |
US6794119B2 (en) | 2002-02-12 | 2004-09-21 | Iridigm Display Corporation | Method for fabricating a structure for a microelectromechanical systems (MEMS) device |
US6574033B1 (en) | 2002-02-27 | 2003-06-03 | Iridigm Display Corporation | Microelectromechanical systems device and method for fabricating same |
US6975775B2 (en) | 2002-03-06 | 2005-12-13 | Radiant Imaging, Inc. | Stray light correction method for imaging light and color measurement system |
US20030222982A1 (en) | 2002-03-28 | 2003-12-04 | Hamdan Majil M. | Integrated video/data information system and method for application to commercial vehicles to enhance driver awareness |
US7005974B2 (en) | 2002-04-19 | 2006-02-28 | Donnelly Corporation | Vehicle imaging system |
US7004606B2 (en) | 2002-04-23 | 2006-02-28 | Donnelly Corporation | Automatic headlamp control |
US7123168B2 (en) | 2002-04-25 | 2006-10-17 | Donnelly Corporation | Driving separation distance indicator |
US6946978B2 (en) | 2002-04-25 | 2005-09-20 | Donnelly Corporation | Imaging system for vehicle |
US7038577B2 (en) | 2002-05-03 | 2006-05-02 | Donnelly Corporation | Object detection system for vehicle |
US7004593B2 (en) | 2002-06-06 | 2006-02-28 | Donnelly Corporation | Interior rearview mirror system with compass |
US6741377B2 (en) | 2002-07-02 | 2004-05-25 | Iridigm Display Corporation | Device having a light-absorbing mask and a method for fabricating same |
US20040130464A1 (en) | 2002-10-25 | 2004-07-08 | Schindler Benno Tobias | Method of operating a display system in a vehicle for finding a parking place |
US20060050018A1 (en) | 2002-12-20 | 2006-03-09 | Hutzel Barry W | Accessory system for vehicle |
US20040153243A1 (en) | 2003-01-29 | 2004-08-05 | Kazunori Shimazaki | Parking assisting device |
US7257486B2 (en) | 2003-01-29 | 2007-08-14 | Kabushiki Kaisha Toyota Jidoshokki | Parking assisting device |
US20080211651A1 (en) * | 2003-06-02 | 2008-09-04 | Uwe Beutnagel-Buchner | Displaying Unit and Method for Displaying a Steering-Wheel Angle, to be Modified, of a Motor Vehicle |
US7065432B2 (en) | 2003-10-02 | 2006-06-20 | Daimlerchrysler Ag | Device for improving the visibility conditions in a motor vehicle |
US7369940B2 (en) | 2004-03-12 | 2008-05-06 | Magna Donnelly Gmbh & Co. Kg | Method for operating a display system in a vehicle for driving into a parking space |
US20050203704A1 (en) | 2004-03-12 | 2005-09-15 | Peter Frank | Method for operating a display system in a vehicle for driving into a parking space |
US7616781B2 (en) | 2004-04-15 | 2009-11-10 | Donnelly Corporation | Driver assistance system for vehicle |
US20100045797A1 (en) | 2004-04-15 | 2010-02-25 | Donnelly Corporation | Imaging system for vehicle |
US7526103B2 (en) | 2004-04-15 | 2009-04-28 | Donnelly Corporation | Imaging system for vehicle |
US20080077294A1 (en) * | 2004-06-05 | 2008-03-27 | Christian Danz | Method And Device For The Assisted Parking Of A Motor Vehicle |
US20050285758A1 (en) | 2004-06-23 | 2005-12-29 | Denso Corporation | Parking assistance system |
US7227611B2 (en) | 2004-08-23 | 2007-06-05 | The Boeing Company | Adaptive and interactive scene illumination |
US20060103727A1 (en) | 2004-11-17 | 2006-05-18 | Huan-Chin Tseng | Vehicle back up camera |
US7720580B2 (en) | 2004-12-23 | 2010-05-18 | Donnelly Corporation | Object detection system for vehicle |
US20060250501A1 (en) | 2005-05-06 | 2006-11-09 | Widmann Glenn R | Vehicle security monitor system and method |
US20100039292A1 (en) * | 2005-06-13 | 2010-02-18 | Michael Scherl | Method and Device for Outputting Parking Instructions |
US7680570B2 (en) | 2005-07-25 | 2010-03-16 | Aisin Aw Co., Ltd. | Parking assist devices, methods, and programs |
US20070021881A1 (en) | 2005-07-25 | 2007-01-25 | Aisin Aw Co., Ltd. | Parking assist devices, methods, and programs |
US20100013670A1 (en) | 2005-07-26 | 2010-01-21 | Martin Hueppauff | Parking apparatus |
US20070104476A1 (en) | 2005-11-04 | 2007-05-10 | Konica Minolta Photo Imaging, Inc. | Camera system and controller |
US7598887B2 (en) | 2005-12-28 | 2009-10-06 | Aisin Seiki Kabushiki Kaisha | Parking assist apparatus |
US7639149B2 (en) | 2006-05-09 | 2009-12-29 | Denso Corporation | Automatic lighting device and method for controlling light |
US20100235053A1 (en) | 2006-12-12 | 2010-09-16 | Toyota Jidosha Kabushiki Kaisha | Parking assist device |
US8285479B2 (en) | 2007-03-08 | 2012-10-09 | Toyota Jidosha Kabushiki Kaisha | Parking assist apparatus |
US7914187B2 (en) | 2007-07-12 | 2011-03-29 | Magna Electronics Inc. | Automatic lighting system with adaptive alignment function |
US8451107B2 (en) | 2007-09-11 | 2013-05-28 | Magna Electronics, Inc. | Imaging system for vehicle |
US20090113509A1 (en) | 2007-10-30 | 2009-04-30 | Av Tech Corporation | Video system, video transmitter, video receiver and control method for the same |
US20090157260A1 (en) * | 2007-12-12 | 2009-06-18 | Hyundai Motor Company | Automatic parking system for vehicle |
US20100286872A1 (en) | 2008-02-18 | 2010-11-11 | Toyota Jidosha Kabushiki Kaisha | Parking assisting apparatus |
US20150081174A1 (en) | 2009-07-27 | 2015-03-19 | Magna Electronics Inc. | Parking assist system |
US20130046441A1 (en) | 2009-07-27 | 2013-02-21 | Magna Electronics Inc. | Parking assist system |
US8874317B2 (en) | 2009-07-27 | 2014-10-28 | Magna Electronics Inc. | Parking assist system |
US20130103246A1 (en) * | 2010-04-28 | 2013-04-25 | Jochen STAACK | Parking system having longitudinal and transverse guidance |
US20130116859A1 (en) | 2011-10-27 | 2013-05-09 | Magna Electronics Inc. | Driver assist system with algorithm switching |
US20150022664A1 (en) | 2012-01-20 | 2015-01-22 | Magna Electronics Inc. | Vehicle vision system with positionable virtual viewpoint |
US20140067206A1 (en) | 2012-09-04 | 2014-03-06 | Magna Electronics Inc. | Driver assistant system using influence mapping for conflict avoidance path determination |
US20140354811A1 (en) | 2013-06-03 | 2014-12-04 | Magna Electronics Inc. | Vehicle vision system with enhanced low light capabilities |
US20140375476A1 (en) | 2013-06-24 | 2014-12-25 | Magna Electronics Inc. | Vehicle alert system |
US20150042808A1 (en) | 2013-08-12 | 2015-02-12 | Magna Electronics Inc. | Vehicle vision system with image classification |
US20150124096A1 (en) | 2013-10-25 | 2015-05-07 | Magna Electronics Inc. | Vehicle vision system utilizing communication system |
US20150158499A1 (en) | 2013-12-05 | 2015-06-11 | Magna Electronics Inc. | Vehicle monitoring system |
US20150251599A1 (en) | 2014-03-04 | 2015-09-10 | Magna Electronics Inc. | Vehicle alert system utilizing communication system |
US20150344028A1 (en) | 2014-06-02 | 2015-12-03 | Magna Electronics Inc. | Parking assist system with annotated map generation |
US20160096477A1 (en) | 2014-10-07 | 2016-04-07 | Magna Electronics Inc. | Vehicle vision system with gray level transition sensitive pixels |
US20160162747A1 (en) | 2014-12-05 | 2016-06-09 | Magna Electronics Inc. | Vehicle vision system with retroreflector pattern recognition |
US20170083774A1 (en) | 2015-09-23 | 2017-03-23 | Magna Electronics Inc. | Vehicle vision system with detection enhancement using light control |
Cited By (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11104327B2 (en) * | 2015-07-13 | 2021-08-31 | Magna Electronics Inc. | Method for automated parking of a vehicle |
US11550319B2 (en) * | 2016-09-29 | 2023-01-10 | Magna Electronics Inc. | Vehicular control system with handover procedure for driver of controlled vehicle |
US11927954B2 (en) | 2016-09-29 | 2024-03-12 | Magna Electronics Inc. | Vehicular control system with handover procedure for driver of controlled vehicle |
US20220026904A1 (en) * | 2016-09-29 | 2022-01-27 | Magna Electronics Inc. | Vehicular control system with handover procedure for driver of controlled vehicle |
US11634136B2 (en) | 2017-02-01 | 2023-04-25 | Magna Electronics Inc. | Vehicular trailer hitching assist system |
US20180215382A1 (en) * | 2017-02-01 | 2018-08-02 | Magna Electronics Inc. | Vehicle trailer hitch assist system |
US11014561B2 (en) * | 2017-02-01 | 2021-05-25 | Magna Electronics Inc. | Vehicle trailer hitch assist system |
US11453393B2 (en) | 2017-10-09 | 2022-09-27 | Magna Electronics Inc. | Autonomous vehicle with path planning system |
US11814045B2 (en) | 2017-10-09 | 2023-11-14 | Magna Electronics Inc. | Autonomous vehicle with path planning system |
US11332124B2 (en) | 2019-01-10 | 2022-05-17 | Magna Electronics Inc. | Vehicular control system |
US11753002B2 (en) | 2019-01-10 | 2023-09-12 | Magna Electronics Inc. | Vehicular control system |
US11498494B2 (en) | 2019-11-27 | 2022-11-15 | Magna Electronics Inc. | Vehicular camera monitoring system |
US11560143B2 (en) | 2020-05-26 | 2023-01-24 | Magna Electronics Inc. | Vehicular autonomous parking system using short range communication protocols |
Also Published As
Publication number | Publication date |
---|---|
US20190184982A1 (en) | 2019-06-20 |
US11104327B2 (en) | 2021-08-31 |
US20170015312A1 (en) | 2017-01-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11104327B2 (en) | Method for automated parking of a vehicle | |
US11814045B2 (en) | Autonomous vehicle with path planning system | |
US11318928B2 (en) | Vehicular automated parking system | |
US20200348667A1 (en) | Control system for semi-autonomous control of vehicle along learned route | |
US11222544B2 (en) | Lane change system for platoon of vehicles | |
US9507345B2 (en) | Vehicle control system and method | |
US9708004B2 (en) | Method for assisting a driver in driving an ego vehicle and corresponding driver assistance system | |
JP2022552413A (en) | Lateral position controller that follows the leading vehicle based on vision | |
US11345365B2 (en) | Control device, getting-into/out facility, control method, and storage medium | |
US11535271B2 (en) | Methods and systems for monitoring vehicle motion with driver safety alerts | |
CN112537295A (en) | Driving support device | |
CN112046481B (en) | Automatic driving device and method | |
WO2022232777A1 (en) | Methods and systems for asserting right of way for traversing an intersection | |
JP7035408B2 (en) | Vehicle driving control method and equipment | |
WO2022232776A1 (en) | Methods and systems for generating trajectory of an autonomous vehicle for traversing an intersection | |
JP6669267B2 (en) | Vehicle traveling control method and traveling control device | |
JP2016037098A (en) | Vehicular imaging system | |
CN116674557B (en) | Vehicle autonomous lane change dynamic programming method and device and domain controller | |
US8681219B2 (en) | System and method for driving assistance at road intersections | |
JP7258677B2 (en) | Operation control method and operation control device | |
JP7176651B2 (en) | Parking assistance method and parking assistance device | |
RU2791347C1 (en) | Parking assistance method and a parking assistance device | |
WO2024069689A1 (en) | Driving assistance method and driving assistance device | |
US20230152807A1 (en) | Vehicle control system and vehicle driving method using the vehicle control system | |
JP7475951B2 (en) | Vehicle driving support method and driving support device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |