EP1726513A1 - Driving assistance system for lane keeping support, for lane change assistance, and for driver status monitoring for a vehicle - Google Patents
Driving assistance system for lane keeping support, for lane change assistance, and for driver status monitoring for a vehicle Download PDFInfo
- Publication number
- EP1726513A1 EP1726513A1 EP06113299A EP06113299A EP1726513A1 EP 1726513 A1 EP1726513 A1 EP 1726513A1 EP 06113299 A EP06113299 A EP 06113299A EP 06113299 A EP06113299 A EP 06113299A EP 1726513 A1 EP1726513 A1 EP 1726513A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- lane
- vehicle
- driver
- module
- steering
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 25
- 230000008859 change Effects 0.000 title description 10
- 238000012545 processing Methods 0.000 claims description 24
- 238000000034 method Methods 0.000 claims description 19
- 230000008569 process Effects 0.000 claims description 16
- 230000006870 function Effects 0.000 claims description 13
- 206010041349 Somnolence Diseases 0.000 claims description 12
- 230000004913 activation Effects 0.000 claims description 10
- 238000013459 approach Methods 0.000 claims description 8
- 230000000007 visual effect Effects 0.000 claims description 8
- 238000004590 computer program Methods 0.000 claims description 5
- 230000001133 acceleration Effects 0.000 claims description 4
- 230000003213 activating effect Effects 0.000 claims description 4
- 238000004891 communication Methods 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 7
- 238000011156 evaluation Methods 0.000 description 5
- 230000005693 optoelectronics Effects 0.000 description 5
- 238000001514 detection method Methods 0.000 description 4
- 102100025579 Calmodulin-2 Human genes 0.000 description 3
- 101001077352 Homo sapiens Calcium/calmodulin-dependent protein kinase type II subunit beta Proteins 0.000 description 3
- 230000009471 action Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 3
- 230000003044 adaptive effect Effects 0.000 description 2
- 230000004397 blinking Effects 0.000 description 2
- 230000001149 cognitive effect Effects 0.000 description 2
- 230000009849 deactivation Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000001939 inductive effect Effects 0.000 description 2
- 101100118004 Arabidopsis thaliana EBP1 gene Proteins 0.000 description 1
- 101150052583 CALM1 gene Proteins 0.000 description 1
- 102100025580 Calmodulin-1 Human genes 0.000 description 1
- 101100459256 Cyprinus carpio myca gene Proteins 0.000 description 1
- 238000004378 air conditioning Methods 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000002547 anomalous effect Effects 0.000 description 1
- 101150091339 cam-1 gene Proteins 0.000 description 1
- 239000000470 constituent Substances 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 230000035807 sensation Effects 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B62—LAND VEHICLES FOR TRAVELLING OTHERWISE THAN ON RAILS
- B62D—MOTOR VEHICLES; TRAILERS
- B62D15/00—Steering not otherwise provided for
- B62D15/02—Steering position indicators ; Steering position determination; Steering aids
- B62D15/025—Active steering aids, e.g. helping the driver by actively influencing the steering system after environment evaluation
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B62—LAND VEHICLES FOR TRAVELLING OTHERWISE THAN ON RAILS
- B62D—MOTOR VEHICLES; TRAILERS
- B62D15/00—Steering not otherwise provided for
- B62D15/02—Steering position indicators ; Steering position determination; Steering aids
- B62D15/025—Active steering aids, e.g. helping the driver by actively influencing the steering system after environment evaluation
- B62D15/0265—Automatic obstacle avoidance by steering
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B62—LAND VEHICLES FOR TRAVELLING OTHERWISE THAN ON RAILS
- B62D—MOTOR VEHICLES; TRAILERS
- B62D15/00—Steering not otherwise provided for
- B62D15/02—Steering position indicators ; Steering position determination; Steering aids
- B62D15/029—Steering assistants using warnings or proposing actions to the driver without influencing the steering system
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/06—Alarms for ensuring the safety of persons indicating a condition of sleep, e.g. anti-dozing alarms
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W30/00—Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
- B60W30/10—Path keeping
- B60W30/12—Lane keeping
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W30/00—Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
- B60W30/18—Propelling the vehicle
- B60W30/18009—Propelling the vehicle related to particular drive situations
- B60W30/18163—Lane change; Overtaking manoeuvres
Definitions
- the main aim of the module LKSM is to provide assistance for lane keeping, by supplying a torque-request signal TR to the decision control module DCM, on the basis of one or more of the following criteria:
- a steering-actuation unit SAU is preferably provided on commercial vehicles by means of an electrical power-steering unit EPS associated to the steering column S and coupled to a hydraulic power-steering unit HPS.
- the steering system includes an electric motor and sensor devices for supplying electrical signals of the steering angle AS and of the steering torque ST that the driver applies to the steering column.
- the reference SW designates the driver's steering wheel, and W designates the wheels that steer the vehicle.
- a processing unit ECU of the driving assistance system forming the subject of the invention is connected to the steering-angle sensor AS, associated to the steering column S, to the direction-indicator sensor DI, to the lane-tracking system LTS, to the vehicle-speed sensor W, to the lateral-acceleration sensor and yaw-velocity sensor YS.
- the processing of the lane-keeping-support module LKSM can be performed by the main microprocessor in the decision control system ECU, in common with the modules LCAM and DSMM, but can be performed also by a separate microprocessor.
- the active torque that it would be necessary to apply on the steering column S is preferably calculated according to the transverse position and instantaneous direction of the vehicle within the traffic lane.
- a further parameter that the processing unit can use for calculating the active steering torque is the camber of the portion of road on which the vehicle is travelling.
- the camber can be calculated on the basis of signals of transverse acceleration, or by means of an inclinometer IN, or by means of information coming from a satellite global positioning system GPS and an appropriate digital map provided with this detailed information.
- the flowchart of Figure 4 shows the logical sequence of the main operations carried out by the module LKSM. It may be noted that the module LKSM in the step 401 verifies whether an alarm of a "blind spot" type, described in the following, has been issued by the module LCAM, or whether, in step 402, a "state of distraction or drowsiness" alarm has been detected by the module DSMM.
- the module LKSM processes the information regarding the presence of the hands of the driver on the steering wheel.
- the information that the driver has taken his hands off the steering wheel for a certain time can be used by the module DCM to generate a specific alarm for the driver.
- the function of the module LCAM is to assist the driver in lane-change manoeuvres, by warning of risk conditions generated by the approach of another vehicle in the adjacent lane without the driver realizing it (alarm of a "blind spot” type, as mentioned previously), so as to prevent the driver from performing a lane-change manoeuvre in conditions of risk and hence preventing possible collision.
- the area supervised by the opto-electronic sensor is illustrated in Figure 7 , where also illustrated are the areas supervised by the rearview mirrors driver side of a heavy vehicle 71, namely a class-IV wide-angle mirror (area 72) and a class-II rearview mirror (area 73), as prescribed by the European directive 2003/97/EC.
- the module LCAM uses the following parameters:
- the sensors typically consist of a digital video camera CAM2 preferably a colour one.
- a colour video camera renders the signal stronger and improves the capacity of operating correctly in all environmental conditions to eliminate any disturbance due, for instance, to shadows of other surrounding objects.
- the current technology of digital cameras enables their integration in the rearview mirror of the vehicle or in any case in the body of the mirror or else on its support.
- said electronic processing means may be completely digital.
- the device can be connected to the on-board network to simplify the electrical connections.
- the electronic processing means may comprise various other functions such as, for example, warning of other vehicles that are overtaking the stationary vehicle or else warning of other vehicles that are overtaking at a low speed, for example, less than 25 km/h, or else detection of vehicles that are approaching from behind at night and automatic activation or deactivation of the vehicle lights.
- the functions described above, provided by the lane-keeping-support module LKSM, lane-change-assistance module LCAM, driver-status-monitoring module DSMM, and decision control module DCM, can be obtained via computer programs, which can reside in one or more electronic processing units, for example of the types described above, integrated together or else distributed over a number of different co-operating units.
- Said computer programs comprise encoding means for implementing one or more steps of the functions described above, when these programs are run on a computer.
Landscapes
- Engineering & Computer Science (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Transportation (AREA)
- Mechanical Engineering (AREA)
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Traffic Control Systems (AREA)
Abstract
Description
- The present invention relates to a driving assistance system for vehicles and more in particular to a driving assistance system for vehicles both during normal driving along a reference lane and during lane-change manoeuvres.
- Driving assistance systems for vehicles are known in the art.
- For example, the patents Nos.
EP-1336550 andEP-806336 - The patent No.
EP-1312506 , instead, describes a driving assistance system designed to assist the driver in lane-change manoeuvres by warning of potential danger, for example vehicles that are approaching in the adjacent traffic lanes, with which the assisted vehicle could come into collision during the lane-change manoeuvre. - Said known solutions, which will be described in greater detail in the following, afford limited levels of assistance to driving and hence are insufficient to guarantee a complete assistance in all risky driving situations.
- Consequently, the purpose of the present invention is to indicate a complete driving assistance system for vehicles obtained by means of implementation of a decision control module (DCM), namely a system for assisting the driver of a vehicle both during normal driving along a given lane, and during lane-change manoeuvres, in which the assistance can be supplied by applying a given steering torque, which is processed, when the vehicle is proceeding along a certain lane, by means of a lane-keeping-support module (LKSM), which processes the information coming from a lane-tracking system (LTS) based upon a front video camera, whilst in the case of lane-change manoeuvres, the assistance is supplied by means of a lane-change-assistance module (LCAM), which processes the information coming from a lateral-lane-monitoring system (LLMS) based upon a video camera facing the lateral lane.
- Furthermore, in order to improve the effectiveness and functionality of the system, this can be extended by means of a driver-status-monitoring module (DSMM), which processes the information coming from a driver-eye-monitoring system (DEMS) inside the cab or the passenger compartment, which frames the eyes of the driver, detecting the direction of his glance in order to recognize the state of drowsiness or distraction of the driver so that the decision module DCM of the driving assistance system will be able to implement different types of intervention, for example automatically activate the function of aid to lane-keeping (LKSM). Instead, when it is necessary, the system can automatically deactivate other systems, such as for example adaptive control of the cruising speed (adaptive cruise control - ACC).
- Preferably, the lane-keeping-support module (LKSM) can prevent unintended deviations of the vehicle from the lane of travel by supplying an appropriate steering intervention, which enables the driver to correct the path of the vehicle when there is detected an imminent exit from the traffic lane, whereas the lane-change-assistance module (LCAM) enables prevention of the condition of emergency generated by the approach of another vehicle along the lane, towards which the vehicle performing the lane change is moving, by means of an appropriate steering intervention, i.e., by applying an active steering torque that inhibits the driver from performing a lane-change manoeuvre in dangerous conditions.
- The active steering torque is preferably applied by means of electronic-control steering systems, and, for applications on heavy lorries, is preferably supplied by a servo electric power-steering unit (EPS) coupled to a servo hydraulic power-steering unit (HPS).
- A particular subject of the present invention is a driving assistance system for vehicles as described in greater detail in the annexed claims, which form an integral part of the present description.
- The purposes and advantages of the present invention will emerge clearly from the ensuing detailed description of an example of embodiment thereof (and of its variants) and from the annexed plate of drawings, which is provided purely by way of explanatory and non-limiting example and in which:
- Figure 1 represents a block diagram of the driving assistance system forming the subject of the present invention;
- Figure 2 represents a functional block diagram of the lane-keeping-support module LKSM;
- Figure 3 illustrates a block diagram of the electrical/electronic and mechanical architecture of the system LKS;
- Figure 4 illustrates the operative flow of the module LKSM;
- Figure 5 illustrates the input and output variables of the algorithm of the module LKSM;
- Figure 6 illustrates a functional block diagram of the module DSMM;
- Figure 7 illustrates a diagram of the field of vision typical of the module LCAM;
- Figure 8 illustrates an example of a rearview mirror modified in accordance with the invention;
- Figure 9 illustrates a functional block diagram of the module LCAM; and
- Figure 10 illustrates a functional block diagram of the decision control module DCM.
- The same reference numbers and wordings in the various figures identify the same components or functionally equivalent components, elements or quantities.
- The system forming the subject of the invention is now described in detail with reference to its principal constituent modules.
- With reference to Figures 1 and 2, the lane-keeping-support module LKSM performs the function of providing assistance to the driver so as to prevent involuntary lane change due for example to lack of attention, i.e., distraction or drowsiness on the part of the driver. This part of the system is strictly integrated with the other two modules of the system, i.e., the lane-change assistance module LCAM and the driver-state-monitoring module DSMM.
- The main aim of the module LKSM is to provide assistance for lane keeping, by supplying a torque-request signal TR to the decision control module DCM, on the basis of one or more of the following criteria:
- using the information on the instantaneous position and direction of the vehicle regarding the lane markings, or the road borders, detected by a lane-tracking system LTS, which processes images supplied by a front camera, preferably installed within the cab behind the area of the windscreen swept by the windscreen wipers;
- using sensors for detecting activation of the direction indicators;
- processing the information referred to above so as to calculate an appropriate active torque to be applied by means of a steering actuator when the signals issued by the system LTS indicate that the vehicle is about to leave the lane and the direction indicators are not activated;
- using the information coming from the module LCAM so as to establish whether a lane-change manoeuvre can be undertaken in a safe way; and
- processing the information from the module LCAM and calculating an appropriate active torque to be applied by means of the steering actuator, thus inducing the driver to keep on the lane where he is travelling, even though the direction indicators have been activated, in the case where the module LCAM has detected a condition that is dangerous for the lane-change manoeuvre.
- With reference to Figures 2 and 3, a steering-actuation unit SAU is preferably provided on commercial vehicles by means of an electrical power-steering unit EPS associated to the steering column S and coupled to a hydraulic power-steering unit HPS. The steering system includes an electric motor and sensor devices for supplying electrical signals of the steering angle AS and of the steering torque ST that the driver applies to the steering column. The reference SW designates the driver's steering wheel, and W designates the wheels that steer the vehicle.
- In a known way, the vehicle has direction indicators DI, which can be activated in a selective way, for example by means of a manual lever, so as to indicate a change of direction. The direction-indicator device DI includes a sensor for supplying electrical signals that indicate whether the direction lights are activated or not. The sensor can be shared with other control systems installed on the vehicle.
- The vehicle is equipped with a driving assistance system according to the invention, which includes a lane-tracking system LTS for supplying electrical signals that can be used to identify the instantaneous position and direction of the vehicle in relation to the lane markings, or the road borders, which limit laterally or define the lane or the road along which the vehicle is travelling. The system comprises a lane vision system VS, which includes a camera facing the road in front of the vehicle, in association with an electronic device for processing the images generated by the camera.
- The driving assistance system moreover comprises a sensor VV for supplying electrical signals indicating the speed of the vehicle. Said sensor can be shared with other on-board systems.
- A processing unit ECU of the driving assistance system forming the subject of the invention is connected to the steering-angle sensor AS, associated to the steering column S, to the direction-indicator sensor DI, to the lane-tracking system LTS, to the vehicle-speed sensor W, to the lateral-acceleration sensor and yaw-velocity sensor YS.
- The processing unit ECU can, for example, be connected to these sensors by means of a communication network N, such as for example a network that operates with the CAN protocol.
- The processing of the lane-keeping-support module LKSM can be performed by the main microprocessor in the decision control system ECU, in common with the modules LCAM and DSMM, but can be performed also by a separate microprocessor.
- Sensors and transducers YS for measuring the lateral dynamics of the vehicle, comprising a lateral-acceleration sensor and a yaw-velocity sensor, are also connected to the processing unit by means of the network N. These sensors can be shared with other control systems installed on the vehicle.
- The processing unit of the module LKSM controls the steering-actuation unit SAU in such a way as to apply an active torque of a given value to the steering actuator when the signals issued by the lane-tracking system LTS and by the other sensors indicate that the vehicle is about to leave the lane in which it is travelling and the direction indicators are not activated.
- Similarly, when the module LCAM, described in the following, detects a dangerous situation, even though the direction indicators are activated, an active torque of a given value is applied to the steering actuator, by means of the processing unit, so as to induce the driver to keep on the same lane, thus preventing a dangerous lane change.
- Application of this active torque gives the driver a sensation of resistance to the deviation from the lane in terms of a resisting torque on the steering wheel. The active torque likewise provides an intuitive indication of the steering action requested to get the vehicle to return within the limits of the desired lane.
- On the other hand, the function performed by the module LKSM is disabled, albeit ready for use, if the driver activates a direction indicator with the deliberate intention of changing lane. Instead, the function is not disabled, even though the driver activates an indicator, when the module LCAM detects an imminent danger in lane change.
- The processing unit calculates the radius of curvature of the portion of road on which the vehicle is travelling. This operation is performed using signals issued by the vision system VS. On the basis of this information, the unit ECU of the module LKSM calculates the active torque to be applied to the steering column S, on the basis of various methods, according to whether the portion of road along which the vehicle V is travelling is basically straight or curved.
- The unit ECU can also be pre-arranged not only to analyse the signals issued by the vision system VS, which is able to recognize multiple lanes, also including the adjacent lanes, but also to receive information from a satellite global positioning system GPS, and process the information of the maps of the GPS system regarding the types of road along which the vehicle is travelling (motorway, trunk road, main and secondary roads, etc.) and the number of lanes. In this case, it is advantageous if the resisting torque that would have to be applied to the steering column S is calculated on the basis of a variety of methods, depending upon which lane the vehicle is travelling along (intermediate, left-hand, right-hand).
- In each of these cases, the active torque that it would be necessary to apply on the steering column S is preferably calculated according to the transverse position and instantaneous direction of the vehicle within the traffic lane.
- In calculating the value of active torque to be applied to the steering actuator, it is preferable to take into account at least one set of parameters comprising the speed of the vehicle, the yaw velocity and the transverse acceleration. For commercial vehicles it is preferable to take into account also the value of the load, and for heavy commercial vehicles it is preferable to take into account also the presence of a trailer or semitrailer. This information can be supplied by sensors shared with other control systems of the vehicle and accessible by means of a network operating, for example, with the CAN protocol.
- It is also preferable if the active torque to be applied to the steering actuator is calculated according to the value of the maximum torque set by the driver using an interface SEL, such as for example a selector, a push-button or the like, to enable the driver to personalize the level of torque for intervention on the steering.
- A further parameter that the processing unit can use for calculating the active steering torque is the camber of the portion of road on which the vehicle is travelling. The camber can be calculated on the basis of signals of transverse acceleration, or by means of an inclinometer IN, or by means of information coming from a satellite global positioning system GPS and an appropriate digital map provided with this detailed information. The flowchart of Figure 4 shows the logical sequence of the main operations carried out by the module LKSM. It may be noted that the module LKSM in the
step 401 verifies whether an alarm of a "blind spot" type, described in the following, has been issued by the module LCAM, or whether, instep 402, a "state of distraction or drowsiness" alarm has been detected by the module DSMM. If no alarms have been issued, the system verifies, instep 403, the condition of "intention to change lane" of the driver, or more generally of leaving the lane on which he is travelling. This is done by verifying whether the direction indicators have been activated or not. Furthermore, the intention of the driver to change lane can also be identified by a system for monitoring the eyes and face of the driver DEMS (Figures 1 and 6), which is able to detect the direction of his glance, and in particular his glance when he is facing the rearview mirrors. - If the module LKSM recognizes that it is necessary to intervene in the case of intention not to change lane, then, in
step 404, it selects a different strategy of control depending upon whether the vehicle is travelling along a rectilinear or a curved stretch of road. If the portion of road comprises a plurality of lanes, the system determines, instep 405 or step 406, in which lane the vehicle is travelling (for example, right-hand lane, left-hand lane or central lane), and then determines the torque to be applied to the steering wheel, in one of the corresponding steps from 407 to 412. Next, instep 413, it processes and sends to the module DCM (Figures 1 and 2) a request of active torque TR to be applied on the steering. - The active steering torque is calculated according to other parameters or values, such as:
- instantaneous position and direction of the vehicle with respect to lane marking or road border signs detected;
- speed of the vehicle;
- radius of curvature of the lane;
- camber of the portion of road on which the vehicle is travelling;
- signals regarding the lateral dynamics of the vehicle, comprising yaw velocity and lateral acceleration;
- mass of the load and presence of a trailer;
- maximum active torque set by the driver for actuation of the steering unit;
- instantaneous steering torque applied by the driver; and
- number of lanes and information on the type of road on which the vehicle is travelling, if available by means of a navigation system.
- Figure 5 shows the input and output variables of the algorithm for processing the active steering torque of the module LKSM.
- In addition, the module LKSM processes the information regarding the presence of the hands of the driver on the steering wheel. The information that the driver has taken his hands off the steering wheel for a certain time can be used by the module DCM to generate a specific alarm for the driver.
- The possibility of detecting the presence of hands on the steering wheel also enables an improvement in the strategies of actuation of active steering.
- The above detection can be made from a comparison of the steering torque applied by the driver and its time derivative with an appropriate torque threshold value and torque-derivative threshold value, respectively. The absence of the hands from the steering wheel is detected in the case where the torque applied by the driver and its time derivative remain both simultaneously below the aforesaid threshold values for a certain pre-set period of time. Unlike the systems according to the prior art, in which the presence of the driver's hands on the steering wheel is recognized by sensors of various types (pressure sensors, contact sensors, optical sensors, etc.) set on the crown of the steering wheel, the invention is of simpler implementation and entails modest additional costs. Processing of the values of steering torque moreover enables recognition also that particular situations of danger have arisen, such as execution of emergency manoeuvres or sudden release of the steering wheel by the driver.
- Finally, the module LKSM, on the basis of the information coming from the lane-tracking system LTS, processes information regarding the "driving style " of the driver, identifying improper behaviour, such as for example an excessively imprecise style of driving; said evaluation can be carried out, for example, by observing a frequent number of interventions of the LKS in a given time interval.
- It is known that lack of attention, which comprises both distraction and drowsiness, is a common cause of accidents. The problem is normally classified as visual distraction or else cognitive distraction and drowsiness.
- Visual distraction occurs, for instance, when the driver must read or write a long SMS message on the phone. Cognitive distraction may arise during an important telephone conversation, or if the driver is seriously involved in solving a problem. In both cases, the camera for the driver monitoring can detect when the level of lack of attention becomes dangerous. For example, the system can detect that the driver is busy too long or too often with the radio and is paying little attention to the road, or else that he is gazing in front of himself without really seeing, because for example he is mentally concentrating on a problem and his attention has been distracted from driving.
- The state of the art of systems for monitoring driver drowsiness consists in supplying a signal warning of danger when a dangerous condition is detected. The danger warning may be acoustic or else supplied by vibration devices, for example, causing vibration of the seat, or else visual by means of LEDs, or else light icons, or messages flashing on the dashboard.
- The subject of this part of the invention is a driver-status-monitoring module DSMM, which supervises lack of attention of the driver from his driving task, so as to supply to the decision module DCM a signal LAT regarding an evaluation of the level of attention of the driver. On the basis of said information, the module DCM can decide to intervene to recall the driver's attention or else to assist him by activating or deactivating other on-board systems. The purpose of the module DSMM is to prevent certain situations of danger caused by lack of attention, for example involuntary exit from the traffic lane or lane changes performed in conditions of danger due to the risk of collision with vehicles in adjacent lanes. The module DSMM is integrated with the other two modules LKSM and LCAM (Figure 1).
- With reference to Figure 6, the module DSMM receives information from the system for monitoring the driver's eyes and face DEMS, which is able to follow the movements of the driver's eyes or the direction of his glance and blinking rate so as to detect drowsiness. On the basis of this information, the module can supply a danger signal if the driver is not paying sufficient attention to driving or can supply an alarm if it recognizes a state of drowsiness. The system is based upon a camera CAM1 inside the cab, which recognizes the movement of the driver's eyes.
- In addition, the module DSMM receives other information (block ICB), for example available via a communication network (CAN network) of the vehicle, regarding the use of on-board devices, such as primary and secondary commands, navigation system, radio, telephone, computer, etc., which may distract the driver.
- Whereas known methods for detecting the state of drowsiness of the driver are based only upon recognition of the duration of closing or frequency of blinking of the eyes, the system forming the subject of the invention integrates three different sources:
- 1) recognition of the direction of the face and of the glance;
- 2) information available on the CAN communication network of the vehicle, on which messages are available regarding the possible use of any on-board device; and
- 3) information coming from the lane-tracking system LTS, via the block LKSM, which can also be used for recognizing improper driving behaviour, such as an excessively imprecise style of driving, which can be detected by observing, for instance, the frequency of interventions of the LKSM, and comparing it with an
appropriate threshold value. - The advantage of this new approach is a more reliable and more complete recognition of the lack of attention of the driver. In particular, the information that derives from the lane-tracking system LTS, via the block LKSM, can provide a reliable evaluation on the driver's driving style, and hence recognize anomalous, improper or dangerous driving behaviour. On the other hand, the systems based only upon a telecamera for monitoring the driver can be insufficient in certain conditions, for example in difficult conditions of lighting of the cab or else when the driver is wearing spectacles.
- Following upon detection by the module DSMM of a state of lack of attention, the decision control module DCM, as specified in greater detail in the following, can intervene both by generating acoustic or visual warnings of danger AVW, and by activating or deactivating other on-board systems, thus inducing the driver to recover his concentration on the task of driving.
- In practice, the present driving assistance system can intervene with different modalities, as explained in greater detail hereinafter in the description of the decision control module DCM. This multiplicity of modalities of intervention constitutes a distinctive element of the present invention.
- The function of the module LCAM is to assist the driver in lane-change manoeuvres, by warning of risk conditions generated by the approach of another vehicle in the adjacent lane without the driver realizing it (alarm of a "blind spot" type, as mentioned previously), so as to prevent the driver from performing a lane-change manoeuvre in conditions of risk and hence preventing possible collision.
- The module LCAM is functionally interfaced with the other two modules DSMM and LKSM.
- In order to provide a lateral-lane-monitoring system, an external opto-electronic sensor is used, preferably integrated in the rearview mirror driver side, which supplies an output signal designed to detect the presence and movement of another vehicle in the adjacent lane and to detect the lateral movements of the vehicle with respect to the lane demarcation lines.
- The area supervised by the opto-electronic sensor is illustrated in Figure 7, where also illustrated are the areas supervised by the rearview mirrors driver side of a
heavy vehicle 71, namely a class-IV wide-angle mirror (area 72) and a class-II rearview mirror (area 73), as prescribed by the European directive 2003/97/EC. - With reference to Figure 8, a vehicle has an external
rearview mirror 81 in which an opto-electronic sensor is incorporated consisting of adigital camera CAM2 82 in CMOS technology. Thecamera 82 may be integrated in the body of themirror 83 or in itssupport 84. The camera has a field of vision defined by thearea 74 of Figure 7, which has a wider field of vision than the conventional rearview mirrors, designated by 72 and 73 in the figure. - With reference to Figure 9, the module LCAM uses the information supplied by the lateral-lane-monitoring system LLMS and by the lane-tracking system LTS. After correlating this information with parameters regarding the dynamics of the vehicle, the module determines a signal LRC regarding a level of risk of lateral collision with possible vehicles in the overtaking lane and supplies it to the block DCM.
- The module LCAM uses the following parameters:
- position and direction of the vehicle with respect to the lane of travel L1;
- presence and relative speed of another vehicle that is approaching on the adjacent lane L2;
- longitudinal speed of the vehicle VV;
- steering angle AS and steering angular velocity;
- activation of the direction indicators DI; and
- steering torque ST applied by the driver.
- When the lateral-lane-monitoring system LLMS detects simultaneously a lateral approach of the vehicle to the lane marking M and also the approach of another vehicle along the adjacent lane L2, the module LCAM processes the level of risk of lateral collision and sends this information to the module DCM, which decides on the appropriate interventions, which range from a simple acoustic or visual warning to active intervention on the steering, according to the level of risk.
- This device improves the driving safety as compared to what can be obtained using traditional rearview mirrors, which leave a part of the area at the side of the vehicle, the so-called blind angle, out of the field of vision. The device uses a video camera integrated in the rearview mirror as opto-electronic sensor, which, as compared to traditional rearview mirrors, achieves a better lateral monitoring in so far as it also carries out detection of obstacles and makes it possible an active intervention.
- The module LCAM assists the lane-change manoeuvres, warning of the condition of risk generated by the approach of another vehicle along the same lane as the one into which the vehicle would move by changing lane, and has the following characteristics:
- it is equipped with opto-electronic sensor means, for example a telecamera of a CMOS type, on the external rearview mirror of the vehicle;
- it processes the signals issued by the sensors to detect a set of variables, amongst which the position of the vehicle with respect to the closest side of the lane of travel;
- it processes the signals issued by the sensors to detect when a vehicle that is following is approaching on the lane adjacent to the one on which the vehicle is travelling; and
- it determines the level of risk of collision with the vehicle in the adjacent lane.
- The sensors typically consist of a digital video camera CAM2 preferably a colour one. The use of a colour video camera renders the signal stronger and improves the capacity of operating correctly in all environmental conditions to eliminate any disturbance due, for instance, to shadows of other surrounding objects. The current technology of digital cameras enables their integration in the rearview mirror of the vehicle or in any case in the body of the mirror or else on its support. A further advantage is that said electronic processing means may be completely digital. The device can be connected to the on-board network to simplify the electrical connections.
- As a further degree of functionality, the electronic processing means may comprise various other functions such as, for example, warning of other vehicles that are overtaking the stationary vehicle or else warning of other vehicles that are overtaking at a low speed, for example, less than 25 km/h, or else detection of vehicles that are approaching from behind at night and automatic activation or deactivation of the vehicle lights.
- The signals issued by the sensor CAM2 are supplied to the electronic processing circuit LLMS. The circuit executes a series of operations, such as, for example, estimation of the distance between the vehicle itself and a vehicle that is arriving behind, during overtaking. According to the invention, the electronic processing means LLMS are moreover able to estimate the lateral distance between the vehicle itself and the adjacent side M of the lane L1 on which the vehicle is travelling, by means of appropriate image processing.
- The modules LKSM, LCAM and DSMM described previously are integrated with a further module called decision control module (DCM), which has a higher hierarchical level and is responsible for all the decisions taken by the system, whether in the form of warnings or in the form of active interventions.
- The decision control module DCM constitutes the heart of the driving assistance system and is responsible for all the possible interventions of the system, which can assume either the form of (acoustic and/or visual) warnings or the form of actuation of the steering system or of other on-board systems.
- The module DCM is interfaced with the following modules described above:
- module LKSM, from which it receives a request for active steering torque;
- module LCAM, from which it receives an evaluation of the level of risk of lateral collision; and
- module DSMM, from which it receives an evaluation of the level of attention of the driver.
- Furthermore, since the module DCM is responsible for all the interventions of the driving assistance system, it contributes to determining operation of one or more of the following on-board systems, as shown in Figure 10:
- active steering system SAU;
- adaptive-cruise-control system ACC;
- heating-ventilation-air-conditioning-control system HVAC;
- electrical-safety-belt-pretensioning system SBP;
- infotainment system (radio, hi-fi, handsfree-talking telephone, etc.) INF; and
- acoustic-and-visual-warning devices AVW.
- On the basis of the information received, in addition to being able to issue appropriate warning signals of an acoustic or visual nature, the module DCM can take the decision of activating or deactivating some on-board systems and in particular it can intervene by enabling or disabling the support supplied to the driver by the modules LKSM and LCAM, according to a series of pre-defined rules. By way of non-limiting example, listed in Table 1 below are some of the most important decisions of intervention that the module DCM can make to increase the level of vehicle safety.
- For example, described in the first row of the table is the type of decision taken by the module DCM in the following situation: the module LKSM is not active, i.e., the function lane-keeping-support LKS has not been activated by the driver; the module LCAM has not detected any dangerous vehicle on the left-hand side, whereas the module DSMM warns of a state of distraction of the driver. In this case, the module DCM decides to activate the function LKS automatically and to display the message "Lane-keeping Support ON".
LKSM LCAM DSMM Decision of the DCM OFF - Distraction detected LKS activated automatically. Displays message "Lane-keeping Support ON" OFF - Fatigue detected LKS activated. Assigns value Max to Torque LKS. Displays message "DROWSINESS Detected" ON - Distraction detected Assigns value Max to Torque LKS. Displays message "LKS Value Max" ON - Fatigue detected Assigns value Max to Torque LKS. Displays message "DROWSINESS Detected" OFF Vehicle on left side, low risk - Turns on Yellow LED OFF Vehicle on left side, medium risk - Turns on Red LED. Issues Acoustic warning OFF Vehicle on left side high risk - Turns on Red LED. Issues Acoustic warning. LKS activated automatically, sets max Torque. ... ... ... ... - In practice, the system is able to intervene by using a wide range of interventions in order to maintain the vehicle in safety conditions.
- Given in what follows are some significant examples of possible interventions by the system:
- generation of a combination of messages, icons or LEDs flashing on the dashboard as a warning;
- intervention on the system ACC (if active), deactivating it in order to prevent any lowering of attention of the driver at the safety distance; alternatively, in order to guarantee maintenance of the highest safety condition, the system DCM can vary the "headway" value of the system ACC, temporarily increasing the safety distance to the maximum value;
- intervention on the module LKSM in order to increase the level of intervention of the active steering torque to the maximum value. In this way, the driver can perceive the active steering torque better, in the case of involuntary exit from the lane or lane change in dangerous conditions;
- automatic turning-off of the audio systems, such as radio or hi-fi devices or handsfree-talking telephone, or else lowering of the volume, thus reducing a possible source of distraction;
- regulation of the air-conditioning system to a lower temperature, or else activation of the fan at a higher speed, to alert the driver on the risk of lack of attention; and
- activation of the electrical safety-belt pretensioner SBP, so as to grip the driver more securely to the seat, preparing him for a possible impact and at the same time warning him of the risk of collision.
- Of course, all the aforementioned interventions constitute just a few examples of the possible actions that the module DCM can undertake; other interventions of activation or deactivation can constitute countermeasures useful for increasing the level of safety, as the level of lack of attention detected varies.
- The functions described above, provided by the lane-keeping-support module LKSM, lane-change-assistance module LCAM, driver-status-monitoring module DSMM, and decision control module DCM, can be obtained via computer programs, which can reside in one or more electronic processing units, for example of the types described above, integrated together or else distributed over a number of different co-operating units. Said computer programs comprise encoding means for implementing one or more steps of the functions described above, when these programs are run on a computer. Consequently, it is understood that the scope of protection of the present invention extends to said computer programs and moreover to computer-readable media, which comprise a stored message, said computer-readable media comprising program-encoding means for implementation of one or more steps of the functions described above, when said program is run on a computer.
- Variant embodiments to the non-limiting example described herein are possible, without thereby departing from the sphere of protection of the present invention, including all the embodiments that for a person skilled in the branch are equivalent.
- From the foregoing description the person skilled in the art is able to carry out the invention without introducing any further constructional details. In particular, implementation of the computer programs may be performed on the basis of programming languages which are in themselves known, of any type used in the field of application of the present invention.
Claims (16)
- Driving assistance system for vehicles both when travelling along a reference lane and during lane-change manoeuvres, said system comprising:- a lane-keeping-support module (LKSM), which processes the information coming from a lane-tracking system (LTS), which comprises a front-vision system (VS) and is designed to supply signals indicating assistance when the vehicle is travelling along a lane;- a lane-change-assistance module (LCAM), which processes the information coming from a lateral-lane-monitoring system (LLMS), which comprises a lateral-vision system (CAM2), and is designed to supply signals indicating assistance when the vehicle carries out lane-change manoeuvres; and- a decision control module (DCM), which processes said signals that it receives from said lane-keeping-support module (LKSM) and lane-change-assistance module (LCAM), for applying an active steering torque, or for supplying warning signals in the case of onset of situations of emergency.
- Driving assistance system for vehicles according to claim 1, characterized in that it moreover comprises a driver-status-monitoring module (DSMM), which processes information coming from a driver-monitoring system (DEMS), which comprises a vision system (CAM1) inside the cab of the vehicle, and is able to generate signals regarding conditions of drowsiness or distraction of the driver; said signals generated by said driver-status-monitoring module (DSMM) being supplied to said decision control module (DCM).
- Driving assistance system for vehicles according to claim 1, characterized in that said lane-keeping-support module (LKSM) comprises means of processing able to determine said assistance when the vehicle is travelling along a lane, on the basis of one or more of the following criteria:- using the information of the instantaneous position and direction of the vehicle with respect to the lane markings or to the road borders, detected by a lane-tracking system LTS, which processes images supplied by a front camera, preferably installed within the cab or passenger compartment behind the area of the windscreen swept by the windscreen wipers;- using sensors for detecting activation of the direction indicators;- processing the information referred to above so as to calculate an appropriate active torque to be applied by means of a steering actuator when the signals issued by the system LTS indicate that the vehicle is about to leave the lane and the direction indicators are not activated;- using the information coming from the lane-change-assistance module (LCAM) so as to establish whether a lane-change manoeuvre can be undertaken in a safe way; and- processing the information from the lane-change-assistance module (LCAM) and calculating an appropriate active torque applied by means of the steering actuator, thus assisting the driver to keep on the lane where the vehicle is travelling, even though the direction indicators have been activated, in the case where the lane-change-assistance module (LCAM) has detected a condition that is dangerous for the lane-change manoeuvre.
- Driving assistance system for vehicles according to claim 3, characterized in that said lane-keeping-support module (LKSM) is able to receive information from a satellite global positioning system (GPS), regarding the types of road on which the vehicle is travelling (motorway, trunk road, country road, etc.) and the number of traffic lanes, said lane-keeping-support module (LKSM) comprising means for calculating said active torque to be applied by said steering-actuation unit (SAU) also on the basis of one or more of the following parameters:- instantaneous position and direction of the vehicle with respect to lane marking or road border signs detected;- speed of the vehicle;- radius of curvature of the lane;- camber of the portion of road on which the vehicle is travelling;- signals regarding the lateral dynamics of the vehicle that comprise yaw velocity and lateral acceleration;- weight of the load and presence of trailer;- maximum active torque set by the driver for actuation of the steering unit;- instantaneous steering torque applied by the driver; and- number of lanes and information on the type of road on which the vehicle is travelling, if available, via navigation system.
- Driving assistance system for vehicles according to claim 3, characterized in that said lane-keeping-support module (LKSM) moreover comprises means for processing information regarding the presence or absence of the hands of the driver on the steering wheel, supplied to said decision control module (DCM).
- Driving assistance system for vehicles according to claim 5, characterized in that said information regarding the presence or absence of the hands of the driver on the steering wheel is derived from means for comparing a steering torque applied by the driver and its time derivative with a torque threshold value and a torque-derivative threshold value, respectively; the absence of the hands from the steering wheel being recognized in the case where the torque applied by the driver and its time derivative remain both simultaneously below said threshold values for a certain period of time.
- Driving assistance system for vehicles according to claim 3, characterized in that said lane-keeping-support module (LKSM), comprises means for processing information regarding the "driving style" of the driver, on the basis of the information coming from the lane-tracking system (LTS), identifying improper behaviour, such as for example an excessively imprecise style of driving, depending on the number of interventions for lane keeping in a certain time interval.
- Driving assistance system for vehicles according to claim 1, characterized in that said lane-change-assistance module (LCAM) comprises means for using the information supplied by said lateral-lane-monitoring system (LLMS) and by said lane-tracking system (LTS), for correlating said information with parameters regarding the dynamics of the vehicle, and if it detects a situation of danger it acts on a steering-actuation unit (SAU) and issues visual and acoustic warning signals, said parameters regarding the dynamics of the vehicle being one or more of the following:- position and direction of the vehicle with respect to the lane of travel;- presence and relative speed of another vehicle that is approaching on an adjacent lane;- longitudinal speed of the vehicle;- steering angle and angular steering velocity;- activation of direction indicators; and- steering torque applied by the driver;said situation of danger being detected when there occurs a lateral approach of the vehicle to the lane marking (M) and also the approach of another vehicle along an adjacent lane.
- Driving assistance system for vehicles according to claim 8, characterized in that said position of the vehicle with respect to the lane of travel comprises a lateral distance between the vehicle and said lane marking (M).
- Driving assistance system for vehicles according to claim 8, characterized in that said lateral-vision system (CAM2) in said lane-change-assistance module (LCAM) comprises a digital colour video camera (CAM2) positioned in a rearview mirror driver side (71) or on its support.
- Driving assistance system for vehicles according to claim 2, characterized in that said driver-status-monitoring module (DSMM) comprises means for integrating said information coming from a driver-monitoring system (DEMS) with information on the use of on-board devices available via messages on an internal communication network (CAN) and with information coming from said lane-tracking system (LTS), and for identifying improper behaviour, such as for instance an excessively imprecise way of driving, depending on the number of interventions for lane keeping in a certain time interval.
- Driving assistance system for vehicles according to claim 2, characterized in that said decision control module (DCM) contributes to determining the operation of one or more of the following systems on board the vehicle:- active steering system (SAU);- adaptive-cruise-control system (ACC);- heating-ventilation-air-conditioning-control system (HVAC);- electrical-safety-belt-pretensioning system (SBP);- infotainment system (INF); and- acoustic-and-visual-warning devices (AVW).
- Driving assistance system for vehicles according to claim 12, characterized in that said decision control module (DCM), comprises means for taking decisions of activating or deactivating on-board systems, on the basis of the information received, as well as means for determining intervention for enabling or disabling a support supplied to the driver by said lane-keeping-support module (LKSM) and lane-change-assistance module (LCAM).
- Driving assistance system for vehicles according to claim 13, characterized in that said decision control module (DCM) comprises means for causing one or more of the following interventions:- generation of a combination of messages, icons or LEDs flashing on a dashboard as a warning;- intervention on said adaptive-cruise-control system (ACC), if active, deactivating it in order to prevent lowering of attention of the driver at the safety distance; or else in order to guarantee a condition of greater safety, varying a "headway" value of said adaptive-cruise-control system (ACC), increasing temporarily a safety distance to the maximum value;- intervention on said lane-keeping-support module (LKSM) in order to increase to the maximum value the level of intervention of the active steering torque;- automatic turning-off of the audio systems, such as radio or hi-fi devices or handsfree-talking telephone, or else lowering of the volume, of said infotainment system (INF);- regulation of said heating-ventilation-air-conditioning-control system (HVAC) at a lower temperature, or else activation of a fan of said system at a higher speed; and- activation of said electrical-safety-belt-pretensioning system (SBP) so as to grip the driver more securely to the seat and warn him of an imminent danger.
- Computer program comprising program-encoding means able to carry out the functions of claims 1 to 14, when said program is run on a computer.
- Computer-readable medium, comprising a recorded program, said computer-readable medium comprising program-encoding means able to carry out the functions of claims 1 to 14, when said program is run on a computer.
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
IT000788A ITMI20050788A1 (en) | 2005-05-02 | 2005-05-02 | RIDING AID SYSTEM TO SUPPORT THE CORSA MAINTENANCE TO ASSIST THE CHANGE OF SLIDES AND MONITOR THE STATE OF THE DRIVER OF A VEHICLE |
Publications (3)
Publication Number | Publication Date |
---|---|
EP1726513A1 true EP1726513A1 (en) | 2006-11-29 |
EP1726513B1 EP1726513B1 (en) | 2014-04-09 |
EP1726513B2 EP1726513B2 (en) | 2017-09-13 |
Family
ID=35583401
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP06113299.9A Active EP1726513B2 (en) | 2005-05-02 | 2006-04-28 | Driving assistance system for lane keeping support, for lane change assistance, and for driver status monitoring for a vehicle |
Country Status (3)
Country | Link |
---|---|
EP (1) | EP1726513B2 (en) |
ES (1) | ES2476995T5 (en) |
IT (1) | ITMI20050788A1 (en) |
Cited By (38)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1867542A1 (en) | 2006-06-13 | 2007-12-19 | Robert Bosch Gmbh | Lane keeping assistant with lane change function |
WO2008080681A1 (en) * | 2007-01-04 | 2008-07-10 | Robert Bosch Gmbh | Method and device for controlling a driver assistance system |
DE102008044075A1 (en) | 2008-11-26 | 2010-05-27 | Robert Bosch Gmbh | Method for adapting steering characteristics of vehicle, involves considering attention of driver by attention monitoring system, where driver carries out steering movement during phase of low attention |
ES2344880A1 (en) * | 2008-12-18 | 2010-09-08 | Cion De Galicia Fundacion Para La Promocion De Innovacion, Investigacion Y Desarrollo Tecnolog. En La Ind. De Automo | System and method of assistance to the change of lane with adaptive evaluation area. (Machine-translation by Google Translate, not legally binding) |
EP2253499A1 (en) * | 2009-05-20 | 2010-11-24 | Audi AG | Car with a driver assistance system for transverse guidance of the car and procedure for assisting a driver of a car while keeping to a lane |
DE102009050404A1 (en) * | 2009-10-22 | 2011-05-05 | Audi Ag | Method for controlling the operation of a fully automatic, designed for independent vehicle management driver assistance system of a motor vehicle and motor vehicle |
US8046002B2 (en) | 2008-07-29 | 2011-10-25 | Xerox Corporation | Apparatus for broadcasting real time information to GPS systems |
EP2426034A3 (en) * | 2010-09-03 | 2012-08-29 | Scania CV AB | Control system and control method for vehicles |
CN103303306A (en) * | 2012-03-07 | 2013-09-18 | 奥迪股份公司 | A method of warning the driver of a motor vehicle of an impending hazardous situation |
FR2993847A1 (en) * | 2012-07-25 | 2014-01-31 | Peugeot Citroen Automobiles Sa | CHANNEL CHANGE ASSISTANCE SYSTEM FOR A VEHICLE |
CN104108391A (en) * | 2013-04-17 | 2014-10-22 | 福特全球技术公司 | Method And Device For Controlling The Driving Dynamics Of Vehicle Having Track Groove Compensation |
EP2819408A2 (en) | 2013-06-27 | 2014-12-31 | Robert Bosch Gmbh | Method and device for adapting the representation of an image on a screen |
US9187117B2 (en) | 2012-01-17 | 2015-11-17 | Ford Global Technologies, Llc | Autonomous lane control system |
FR3027418A1 (en) * | 2014-10-20 | 2016-04-22 | Peugeot Citroen Automobiles Sa | DEVICE FOR CONTROLLING DEACTIVATION OF A SYSTEM FOR MONITORING THE TRACK OF A VEHICLE, BASED ON THE DRIVER'S EYE OBSERVATION DIRECTION |
DE102006051930B4 (en) * | 2006-11-03 | 2017-04-06 | Robert Bosch Gmbh | Method and device for driver status detection |
CN108053616A (en) * | 2018-01-18 | 2018-05-18 | 北京中宇安路科技有限公司 | A kind of hazardous materials transportation vehicle driving safe early warning auxiliary system |
WO2018127430A1 (en) * | 2017-01-04 | 2018-07-12 | Robert Bosch Gmbh | Reducing lateral position deviation during an automated lane change |
US10215436B1 (en) | 2011-05-02 | 2019-02-26 | John M. Rawski | Full spectrum universal controller |
CN109421726A (en) * | 2017-08-29 | 2019-03-05 | 福特全球技术公司 | Reactivate driver assistance mode |
CN109606346A (en) * | 2018-12-29 | 2019-04-12 | 武汉超控科技有限公司 | A kind of Lane Keeping System of automatic Pilot |
CN110481551A (en) * | 2019-08-16 | 2019-11-22 | 中国第一汽车股份有限公司 | A kind of control method, device and the vehicle of automatic lane-change |
CN110633653A (en) * | 2018-10-09 | 2019-12-31 | 黄宇恒 | Doubling auxiliary system based on streaming media inside rearview mirror |
DE102012207524B4 (en) * | 2011-05-05 | 2020-03-19 | GM Global Technology Operations, LLC (n.d. Ges. d. Staates Delaware) | System and method for detecting the end of the steering override for automated lane centering |
CN110962831A (en) * | 2018-09-28 | 2020-04-07 | 现代自动车株式会社 | Device for controlling vehicle, system having the device, and control method |
CN111591305A (en) * | 2019-02-19 | 2020-08-28 | 奥迪股份公司 | Control method, system, computer device and storage medium for driving assistance system |
CN111717192A (en) * | 2019-03-18 | 2020-09-29 | 长城汽车股份有限公司 | Control method and system for automatically driving vehicle |
CN112512901A (en) * | 2018-07-17 | 2021-03-16 | 克诺尔商用车制动系统有限公司 | Adaptive lane keeping system |
CN112758094A (en) * | 2021-01-04 | 2021-05-07 | 重庆长安汽车股份有限公司 | Safe parking device and method for driving assistance system |
CN113085853A (en) * | 2021-04-26 | 2021-07-09 | 中汽研(天津)汽车工程研究院有限公司 | Auxiliary driving system for actively dodging large-scale vehicle in lane |
CN113119967A (en) * | 2021-04-30 | 2021-07-16 | 东风汽车集团股份有限公司 | Intelligent driving assisting method, device, equipment and storage medium |
US11091194B2 (en) | 2018-02-02 | 2021-08-17 | Ford Global Technologies, Llc | Operating motor vehicle electrically assisted steering |
CN113271332A (en) * | 2020-02-14 | 2021-08-17 | 通用汽车有限责任公司 | Method and apparatus for edge-based notification through crowd-sourced real-time fleet flow communication |
CN113548047A (en) * | 2021-06-08 | 2021-10-26 | 重庆大学 | Personalized lane keeping auxiliary method and device based on deep learning |
US11186293B2 (en) | 2018-06-07 | 2021-11-30 | Here Global B.V. | Method and system for providing assistance to a vehicle or driver thereof |
CN114084160A (en) * | 2020-07-29 | 2022-02-25 | 奥迪股份公司 | Driving assistance device, and corresponding vehicle, method, computer device, and medium |
WO2022113468A1 (en) * | 2020-11-26 | 2022-06-02 | 株式会社日立製作所 | Vehicle control device, information processing device, and vehicle control system production method |
CN114968428A (en) * | 2021-02-20 | 2022-08-30 | 上海博泰悦臻网络技术服务有限公司 | Method, system, medium, and apparatus for setting silent mode of virtual role |
CN115946710A (en) * | 2023-03-14 | 2023-04-11 | 北京航空航天大学 | Driving feature data processing method and device and storage medium |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11169520B2 (en) | 2019-03-07 | 2021-11-09 | Ford Global Technologies, Llc | Enhanced vehicle operation |
CN111144311A (en) * | 2019-12-27 | 2020-05-12 | 武汉理工大学 | Auxiliary speed control method, device and system based on attention of driver |
FR3125003B1 (en) * | 2021-07-08 | 2024-08-30 | Jtekt Europe Sas | METHOD FOR DETERMINING FRICTION TORQUE |
EP4393784A1 (en) * | 2022-12-27 | 2024-07-03 | Zenseact AB | Methods and systems for controlling a vehicle having a lane support system |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0806336A2 (en) | 1996-05-09 | 1997-11-12 | Honda Giken Kogyo Kabushiki Kaisha | Steering assist system in a vehicle |
EP1312506A2 (en) | 2001-11-07 | 2003-05-21 | C.R.F. Società Consortile per Azioni | A method and system for assisting the driver of a motor vehicle in a lane-change manoeuvre |
EP1336550A2 (en) | 2002-02-15 | 2003-08-20 | C.R.F. Società Consortile per Azioni | A driving assistance system for a motor vehicle |
US20040061596A1 (en) | 2002-09-27 | 2004-04-01 | Nissan Motor Co., Ltd. | Driving assist system |
US20040215393A1 (en) * | 2003-04-23 | 2004-10-28 | Nissan Motor Co. Ltd. | Automotive lane deviation prevention apparatus |
US20040262063A1 (en) * | 2003-06-11 | 2004-12-30 | Kaufmann Timothy W. | Steering system with lane keeping integration |
EP1500574A2 (en) * | 2003-07-25 | 2005-01-26 | Fuji Jukogyo Kabushiki Kaisha | Vehicle driving aid apparatus |
EP1508819A1 (en) * | 2003-08-19 | 2005-02-23 | Volkswagen Aktiengesellschaft | Driving assist system for a vehicle |
WO2005025917A1 (en) * | 2003-09-10 | 2005-03-24 | Robert Bosch Gmbh | Driver assistance system |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030096593A1 (en) † | 2001-10-24 | 2003-05-22 | Naboulsi Mouhamad Ahmad | Safety control system for vehicles |
DE10212985A1 (en) † | 2002-03-22 | 2003-10-02 | Bosch Gmbh Robert | Method and device for signaling dangerous situations in a motor vehicle |
US7639148B2 (en) † | 2003-06-06 | 2009-12-29 | Volvo Technology Corporation | Method and arrangement for controlling vehicular subsystems based on interpreted driver activity |
-
2005
- 2005-05-02 IT IT000788A patent/ITMI20050788A1/en unknown
-
2006
- 2006-04-28 ES ES06113299.9T patent/ES2476995T5/en active Active
- 2006-04-28 EP EP06113299.9A patent/EP1726513B2/en active Active
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0806336A2 (en) | 1996-05-09 | 1997-11-12 | Honda Giken Kogyo Kabushiki Kaisha | Steering assist system in a vehicle |
EP1312506A2 (en) | 2001-11-07 | 2003-05-21 | C.R.F. Società Consortile per Azioni | A method and system for assisting the driver of a motor vehicle in a lane-change manoeuvre |
EP1336550A2 (en) | 2002-02-15 | 2003-08-20 | C.R.F. Società Consortile per Azioni | A driving assistance system for a motor vehicle |
US20040061596A1 (en) | 2002-09-27 | 2004-04-01 | Nissan Motor Co., Ltd. | Driving assist system |
US20040215393A1 (en) * | 2003-04-23 | 2004-10-28 | Nissan Motor Co. Ltd. | Automotive lane deviation prevention apparatus |
US20040262063A1 (en) * | 2003-06-11 | 2004-12-30 | Kaufmann Timothy W. | Steering system with lane keeping integration |
EP1500574A2 (en) * | 2003-07-25 | 2005-01-26 | Fuji Jukogyo Kabushiki Kaisha | Vehicle driving aid apparatus |
EP1508819A1 (en) * | 2003-08-19 | 2005-02-23 | Volkswagen Aktiengesellschaft | Driving assist system for a vehicle |
WO2005025917A1 (en) * | 2003-09-10 | 2005-03-24 | Robert Bosch Gmbh | Driver assistance system |
Cited By (60)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1867542A1 (en) | 2006-06-13 | 2007-12-19 | Robert Bosch Gmbh | Lane keeping assistant with lane change function |
DE102006051930B4 (en) * | 2006-11-03 | 2017-04-06 | Robert Bosch Gmbh | Method and device for driver status detection |
WO2008080681A1 (en) * | 2007-01-04 | 2008-07-10 | Robert Bosch Gmbh | Method and device for controlling a driver assistance system |
US8046002B2 (en) | 2008-07-29 | 2011-10-25 | Xerox Corporation | Apparatus for broadcasting real time information to GPS systems |
DE102008044075A1 (en) | 2008-11-26 | 2010-05-27 | Robert Bosch Gmbh | Method for adapting steering characteristics of vehicle, involves considering attention of driver by attention monitoring system, where driver carries out steering movement during phase of low attention |
ES2344880A1 (en) * | 2008-12-18 | 2010-09-08 | Cion De Galicia Fundacion Para La Promocion De Innovacion, Investigacion Y Desarrollo Tecnolog. En La Ind. De Automo | System and method of assistance to the change of lane with adaptive evaluation area. (Machine-translation by Google Translate, not legally binding) |
EP2253499A1 (en) * | 2009-05-20 | 2010-11-24 | Audi AG | Car with a driver assistance system for transverse guidance of the car and procedure for assisting a driver of a car while keeping to a lane |
DE102009050404A1 (en) * | 2009-10-22 | 2011-05-05 | Audi Ag | Method for controlling the operation of a fully automatic, designed for independent vehicle management driver assistance system of a motor vehicle and motor vehicle |
EP2426034A3 (en) * | 2010-09-03 | 2012-08-29 | Scania CV AB | Control system and control method for vehicles |
US10215436B1 (en) | 2011-05-02 | 2019-02-26 | John M. Rawski | Full spectrum universal controller |
DE102012207524B4 (en) * | 2011-05-05 | 2020-03-19 | GM Global Technology Operations, LLC (n.d. Ges. d. Staates Delaware) | System and method for detecting the end of the steering override for automated lane centering |
US9616924B2 (en) | 2012-01-17 | 2017-04-11 | Ford Global Technologies, Llc | Autonomous lane control system |
US9616925B2 (en) | 2012-01-17 | 2017-04-11 | Ford Global Technologies, Llc | Autonomous lane control system |
US9187117B2 (en) | 2012-01-17 | 2015-11-17 | Ford Global Technologies, Llc | Autonomous lane control system |
CN103303306B (en) * | 2012-03-07 | 2016-05-04 | 奥迪股份公司 | The unsafe condition just occurring is made warning method to vehicle driver |
CN103303306A (en) * | 2012-03-07 | 2013-09-18 | 奥迪股份公司 | A method of warning the driver of a motor vehicle of an impending hazardous situation |
WO2014016486A3 (en) * | 2012-07-25 | 2014-03-27 | Peugeot Citroen Automobiles Sa | Lane changing support system for vehicles |
FR2993847A1 (en) * | 2012-07-25 | 2014-01-31 | Peugeot Citroen Automobiles Sa | CHANNEL CHANGE ASSISTANCE SYSTEM FOR A VEHICLE |
CN104718125A (en) * | 2012-07-25 | 2015-06-17 | 标致·雪铁龙汽车公司 | Lane changing support system for vehicles |
CN104108391B (en) * | 2013-04-17 | 2018-04-10 | 福特全球技术公司 | The method and apparatus of the drive propulsion of vehicle of the control with rut compensation |
CN104108391A (en) * | 2013-04-17 | 2014-10-22 | 福特全球技术公司 | Method And Device For Controlling The Driving Dynamics Of Vehicle Having Track Groove Compensation |
DE102013212374A1 (en) | 2013-06-27 | 2014-12-31 | Robert Bosch Gmbh | Method and apparatus for adjusting a representation of an image on a screen |
EP2819408A2 (en) | 2013-06-27 | 2014-12-31 | Robert Bosch Gmbh | Method and device for adapting the representation of an image on a screen |
WO2016062936A1 (en) * | 2014-10-20 | 2016-04-28 | Peugeot Citroen Automobiles Sa | Device for controlling the deactivation of a system for monitoring the path of a vehicle, according to the direction in which the eyes of a driver are looking |
CN107074237A (en) * | 2014-10-20 | 2017-08-18 | 标致·雪铁龙汽车公司 | According to the control device that direction is controlled to the deactivation of track of vehicle monitoring system of watching of driver's eyes |
FR3027418A1 (en) * | 2014-10-20 | 2016-04-22 | Peugeot Citroen Automobiles Sa | DEVICE FOR CONTROLLING DEACTIVATION OF A SYSTEM FOR MONITORING THE TRACK OF A VEHICLE, BASED ON THE DRIVER'S EYE OBSERVATION DIRECTION |
WO2018127430A1 (en) * | 2017-01-04 | 2018-07-12 | Robert Bosch Gmbh | Reducing lateral position deviation during an automated lane change |
US10150474B2 (en) | 2017-01-04 | 2018-12-11 | Robert Bosch Gmbh | Reducing lateral position deviation during an automated lane change |
JP2020506837A (en) * | 2017-01-04 | 2020-03-05 | ローベルト ボツシユ ゲゼルシヤフト ミツト ベシユレンクテル ハフツングRobert Bosch Gmbh | Reduction of lateral position deviation while changing lanes |
CN110114254A (en) * | 2017-01-04 | 2019-08-09 | 罗伯特·博世有限公司 | Reduce lateral position deviation during automatic lane change |
CN110114254B (en) * | 2017-01-04 | 2022-04-29 | 罗伯特·博世有限公司 | Reducing lateral position deviation during automatic lane change |
CN109421726A (en) * | 2017-08-29 | 2019-03-05 | 福特全球技术公司 | Reactivate driver assistance mode |
CN108053616A (en) * | 2018-01-18 | 2018-05-18 | 北京中宇安路科技有限公司 | A kind of hazardous materials transportation vehicle driving safe early warning auxiliary system |
US11091194B2 (en) | 2018-02-02 | 2021-08-17 | Ford Global Technologies, Llc | Operating motor vehicle electrically assisted steering |
US11186293B2 (en) | 2018-06-07 | 2021-11-30 | Here Global B.V. | Method and system for providing assistance to a vehicle or driver thereof |
US11691622B2 (en) | 2018-07-17 | 2023-07-04 | Knorr-Bremse Systeme Fuer Nutzfahrzeuge Gmbh | Adaptive lane-keeping assistant |
CN112512901B (en) * | 2018-07-17 | 2023-06-13 | 克诺尔商用车制动系统有限公司 | Adaptive lane keeping system |
CN112512901A (en) * | 2018-07-17 | 2021-03-16 | 克诺尔商用车制动系统有限公司 | Adaptive lane keeping system |
CN110962831A (en) * | 2018-09-28 | 2020-04-07 | 现代自动车株式会社 | Device for controlling vehicle, system having the device, and control method |
US12065133B2 (en) | 2018-09-28 | 2024-08-20 | Hyundai Motor Company | Apparatus for controlling vehicle, system having same and method thereof |
CN110633653A (en) * | 2018-10-09 | 2019-12-31 | 黄宇恒 | Doubling auxiliary system based on streaming media inside rearview mirror |
CN110633653B (en) * | 2018-10-09 | 2023-04-18 | 黄宇恒 | Doubling auxiliary system based on streaming media inside rearview mirror |
CN109606346A (en) * | 2018-12-29 | 2019-04-12 | 武汉超控科技有限公司 | A kind of Lane Keeping System of automatic Pilot |
CN111591305B (en) * | 2019-02-19 | 2023-09-22 | 奥迪股份公司 | Control method, system, computer device and storage medium for driving assistance system |
CN111591305A (en) * | 2019-02-19 | 2020-08-28 | 奥迪股份公司 | Control method, system, computer device and storage medium for driving assistance system |
CN111717192A (en) * | 2019-03-18 | 2020-09-29 | 长城汽车股份有限公司 | Control method and system for automatically driving vehicle |
CN111717192B (en) * | 2019-03-18 | 2022-01-28 | 毫末智行科技有限公司 | Control method and system for automatically driving vehicle |
CN110481551A (en) * | 2019-08-16 | 2019-11-22 | 中国第一汽车股份有限公司 | A kind of control method, device and the vehicle of automatic lane-change |
CN113271332B (en) * | 2020-02-14 | 2024-03-19 | 通用汽车有限责任公司 | Edge notification-based method and apparatus for real-time fleet communication through crowd sourcing |
CN113271332A (en) * | 2020-02-14 | 2021-08-17 | 通用汽车有限责任公司 | Method and apparatus for edge-based notification through crowd-sourced real-time fleet flow communication |
CN114084160A (en) * | 2020-07-29 | 2022-02-25 | 奥迪股份公司 | Driving assistance device, and corresponding vehicle, method, computer device, and medium |
WO2022113468A1 (en) * | 2020-11-26 | 2022-06-02 | 株式会社日立製作所 | Vehicle control device, information processing device, and vehicle control system production method |
CN112758094A (en) * | 2021-01-04 | 2021-05-07 | 重庆长安汽车股份有限公司 | Safe parking device and method for driving assistance system |
CN114968428A (en) * | 2021-02-20 | 2022-08-30 | 上海博泰悦臻网络技术服务有限公司 | Method, system, medium, and apparatus for setting silent mode of virtual role |
CN113085853B (en) * | 2021-04-26 | 2022-05-17 | 中汽研(天津)汽车工程研究院有限公司 | Auxiliary driving system for actively dodging large-scale vehicle in lane |
CN113085853A (en) * | 2021-04-26 | 2021-07-09 | 中汽研(天津)汽车工程研究院有限公司 | Auxiliary driving system for actively dodging large-scale vehicle in lane |
CN113119967B (en) * | 2021-04-30 | 2022-07-15 | 东风汽车集团股份有限公司 | Intelligent driving assisting method, device, equipment and storage medium |
CN113119967A (en) * | 2021-04-30 | 2021-07-16 | 东风汽车集团股份有限公司 | Intelligent driving assisting method, device, equipment and storage medium |
CN113548047A (en) * | 2021-06-08 | 2021-10-26 | 重庆大学 | Personalized lane keeping auxiliary method and device based on deep learning |
CN115946710A (en) * | 2023-03-14 | 2023-04-11 | 北京航空航天大学 | Driving feature data processing method and device and storage medium |
Also Published As
Publication number | Publication date |
---|---|
EP1726513B2 (en) | 2017-09-13 |
ES2476995T5 (en) | 2018-01-26 |
ES2476995T3 (en) | 2014-07-15 |
EP1726513B1 (en) | 2014-04-09 |
ITMI20050788A1 (en) | 2006-11-03 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP1726513B1 (en) | Driving assistance system for lane keeping support, for lane change assistance, and for driver status monitoring for a vehicle | |
US20200324764A1 (en) | Vehicular control system with pedestrian avoidance | |
CN110539750B (en) | Lane departure early warning system method based on driving state and road condition information | |
US7777619B2 (en) | System and method for implementing active safety counter measures for an impaired driver | |
JP3390289B2 (en) | Alarm device | |
EP2295311B1 (en) | Lane changing assistance method for controlling a vehicle driving aid system for lane changing assistance | |
US9150194B2 (en) | Method for controlling a reversible belt tensioner of a safety belt in a motor vehicle | |
CN107209850B (en) | Method for determining a driver-specific blind spot of a driver assistance system, driver assistance system and motor vehicle | |
US20170349175A1 (en) | Adaptive cruise control system and vehicle comprising an adaptive cruise control system | |
CN105408181B (en) | Method for running the driver assistance system of automobile and the driver assistance system for automobile | |
CN112292718B (en) | Information, warning and braking request generation for steering assist functions | |
CN107428374A (en) | Driver assistance system in motor vehicle | |
MX2013009434A (en) | System and method for responding to driver behavior. | |
CN101588757A (en) | Anti-drowsing device and anti-drowsing method | |
JP3890996B2 (en) | Driving assistance device | |
CN112158204B (en) | L2-level automatic driving vehicle take-over alarm system and method | |
CN111016923B (en) | Abnormal driving judgment method | |
US12084052B2 (en) | System and method of predicting and displaying a side blind zone entry alert | |
JPH11120498A (en) | Obstacle alarming device for vehicle | |
US20230234500A1 (en) | Alert detection system | |
CN108705972A (en) | A kind of vehicle lateral control information display system | |
JP2000194997A (en) | Obstacle alarm device for vehicle | |
TWI798082B (en) | Driving behavior warning system and method | |
US20230271604A1 (en) | Automatic driver assist system for a vehicle | |
EP4375963A1 (en) | Notification method for vehicle driver, notification system and vehicle |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL BA HR MK YU |
|
17P | Request for examination filed |
Effective date: 20070528 |
|
AKX | Designation fees paid |
Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR |
|
17Q | First examination report despatched |
Effective date: 20070904 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R079 Ref document number: 602006040981 Country of ref document: DE Free format text: PREVIOUS MAIN CLASS: B62D0015020000 Ipc: B60W0030120000 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
INTG | Intention to grant announced |
Effective date: 20140214 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: B60W 30/12 20060101AFI20140131BHEP Ipc: B62D 15/02 20060101ALI20140131BHEP Ipc: B60W 30/18 20120101ALI20140131BHEP |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 661185 Country of ref document: AT Kind code of ref document: T Effective date: 20140415 Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602006040981 Country of ref document: DE Effective date: 20140522 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: NV Representative=s name: KEMIA SA, CH |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: T3 |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FG2A Ref document number: 2476995 Country of ref document: ES Kind code of ref document: T3 Effective date: 20140715 |
|
REG | Reference to a national code |
Ref country code: SE Ref legal event code: TRGR |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140710 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140809 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140709 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140409 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140409 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140409 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140409 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140811 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R026 Ref document number: 602006040981 Country of ref document: DE |
|
PLBI | Opposition filed |
Free format text: ORIGINAL CODE: 0009260 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140409 Ref country code: BE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140409 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140409 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140409 Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140409 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140409 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140409 |
|
26 | Opposition filed |
Opponent name: SCANIA CV AB Effective date: 20150109 |
|
PLAX | Notice of opposition and request to file observation + time limit sent |
Free format text: ORIGINAL CODE: EPIDOSNOBS2 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R026 Ref document number: 602006040981 Country of ref document: DE Effective date: 20150109 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 10 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20140428 |
|
PLBB | Reply of patent proprietor to notice(s) of opposition received |
Free format text: ORIGINAL CODE: EPIDOSNOBS3 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140409 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 11 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140409 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: NV Representative=s name: IPWAY DI FRANCESCO FABIO AND CO., CH |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20140428 Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140409 Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20060428 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 12 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: LU Payment date: 20170922 Year of fee payment: 14 Ref country code: CH Payment date: 20170412 Year of fee payment: 12 |
|
PUAH | Patent maintained in amended form |
Free format text: ORIGINAL CODE: 0009272 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: PATENT MAINTAINED AS AMENDED |
|
27A | Patent maintained in amended form |
Effective date: 20170913 |
|
AK | Designated contracting states |
Kind code of ref document: B2 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R102 Ref document number: 602006040981 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: AELC |
|
REG | Reference to a national code |
Ref country code: SE Ref legal event code: RPEO |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: FP |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: DC2A Ref document number: 2476995 Country of ref document: ES Kind code of ref document: T5 Effective date: 20180126 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 13 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MM01 Ref document number: 661185 Country of ref document: AT Kind code of ref document: T Effective date: 20180428 |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20180428 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180428 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180430 Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180428 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180430 |
|
P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230523 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: NL Payment date: 20240425 Year of fee payment: 19 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20240429 Year of fee payment: 19 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: ES Payment date: 20240517 Year of fee payment: 19 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: IT Payment date: 20240412 Year of fee payment: 19 Ref country code: FR Payment date: 20240430 Year of fee payment: 19 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: SE Payment date: 20240429 Year of fee payment: 19 |