WO2008046667A1 - Système et procédé pour fournir un matériel de divertissement ou d'auto-apprentissage personnalisé adaptés aux voyageurs - Google Patents

Système et procédé pour fournir un matériel de divertissement ou d'auto-apprentissage personnalisé adaptés aux voyageurs Download PDF

Info

Publication number
WO2008046667A1
WO2008046667A1 PCT/EP2007/054292 EP2007054292W WO2008046667A1 WO 2008046667 A1 WO2008046667 A1 WO 2008046667A1 EP 2007054292 W EP2007054292 W EP 2007054292W WO 2008046667 A1 WO2008046667 A1 WO 2008046667A1
Authority
WO
WIPO (PCT)
Prior art keywords
route
traveller
conditions
physical
determining
Prior art date
Application number
PCT/EP2007/054292
Other languages
English (en)
Inventor
Ossama Emam
Dimitri Kanevsky
Original Assignee
International Business Machines Corporation
Compagnie Ibm France
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by International Business Machines Corporation, Compagnie Ibm France filed Critical International Business Machines Corporation
Publication of WO2008046667A1 publication Critical patent/WO2008046667A1/fr

Links

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34—Route searching; Route guidance
    • G01C21/36—Input/output arrangements for on-board computers

Definitions

  • the present invention relates generally to the field of education and more specifically to a method, system and computer programs for providing customized self learning and/or entertainment materials adapted to travel environments and more particularly adapted to road traffic and physical and mental conditions of car drivers.
  • US patent application US20050221268 Charr et al. entitled "Self-service system for education” discloses an adaptive system for enabling providers to customize educational objects and support services in order to maximize user engagement.
  • the system is a self-service system for education for providers that includes a learning environment with interfaces for stakeholders, metrics for measuring the level of user engagement, and a customizable service configured to maximize user engagement.
  • the system may operate in many domains, such as higher education, retail, government, test preparation and certification services, negotiations, and others. More particularly this invention discloses a method for adapting presentations depending on attention, interest, tiredness etc... of students.
  • the learning materials can be presented in different forms depending on the capacity of students to understand the course.
  • the present invention discloses a system and method for automatically adapting learning materials according to the driver's (or passenger) situation. This is particularly useful for people who spend a significant amount of their time travelling or driving cars.
  • the present invention is directed to a method, system and computer program as defined in the independent claims.
  • a method to be executed in a vehicle for providing customized content to a traveller comprises the steps of:
  • This invention has many advantages as will be explained further below.
  • Figure 1 is a logic view of different components part of the learning/entertainment system according to the present invention.
  • Figure 2 is a logic view of the different information systems used by the traffic manager according to the present invention.
  • Figure 3 is the Workload Representational Surface of the workload manager according to the present invention.
  • Figure 4 is a logic view of the different information systems used by the learning/entertainment system according to the present invention.
  • Figure 5 shows the steps of the method according to the present invention.
  • the present invention discloses a method, system and computer program for dynamically providing to a driver/passenger of a car (or more generally to a traveller) learning or entertainment materials according to traffic conditions and travel plans.
  • the learning system according to the present invention has the capacity to transform itself into different kind of presentations.
  • a summarization system, an audio processing system, biometrics sensors, external traffic sensors and a traffic manager can also be used to adapt the present system to external conditions.
  • An advantage of the present invention is that people who spend a significant amount of time travelling or driving, can advantageously use this time to learn or to listen to stories or music.
  • the learning system according to the present invention can adapt the course of the lesson or lecture depending on the route and traffic conditions and the driver's capacity to assimilate the information (personal condition of the driver).
  • the learning system can :
  • the learning system knows that the driver will travel 15 minutes (between his home and work). If the driver requests the learning system to teach him/her French language, the learning system will choose a few new words in French and will play several examples including these words. The number of words and examples is chosen so that this special course will not exceed 15 minutes.
  • the learning system will decide to teach the driver complex grammatical rules that require longer time and more practice (just enough for one hour).
  • the learning system will present a course so that the driver's distraction and tiredness is minimized. For instance, the learning system can make pauses if the driver is busy (e.g. presses brakes etc.).
  • the learning system can be informed about traffic lights and can adapt the course to these traffic lights. For instance, the learning system can prepare a quiz when the driver stops at a red traffic light.
  • an entertainment system can tell stories that can be adapted to the route and to the traffic conditions.
  • the entertainment system according to the present invention can read a short story which does not exceeds 15 minutes or a a novel during one hour depending on the expected duration of the travel.
  • the Learning System (LS) 100 receives:
  • the Learning System delivers in output leaning materials adapted to the driver/passenger and adapted to the expected route and to the traffic conditions.
  • Traffic Manager 102
  • Figure 2 shows the various systems and information that are used with the Traffic Manager 102 according to the present invention.
  • the main function of the Traffic Manager is to determine the travel characteristics such as the travel route, the travel duration and the traffic lights.
  • the Route Planner 200 receives:
  • the Route Planner delivers in output information about the travel characteristics (the travel plans) 205 (travel route, travel duration, traffic lights, ).
  • the Route Planner 200 is connected to External Sensors 206 reflecting the traffic.
  • the Route Planner delivers in output the traffic situation 207.
  • the Route Planner 200 uses some particular techniques to estimate the time which is necessary for a car to travel through certain routes.
  • the Route Planner can also determine for instance when the car will reach traffic lights located along the route.
  • the Route Planner can use the routing decision module described in US patent 6,724,320 Basson et al. entitled "System and method for controlling a traffic light” which discloses a system and method for controlling at least one traffic light.
  • the routing decision module selects a street route between the vehicle and the destination, and determines an indication of traffic flow on the street route, and an indication of the number and status of traffic lights along the street route.
  • the system further comprises: • a global positioning system for determining a location of the vehicle; and
  • the Route Planner 200 can make use of US patent 6,919,866 Kanevsky et al. entitled "Vehicular navigation system” which discloses a vehicular navigation system which utilizes an optical arrangement installed in eyeglasses or on the vehicle window or windshield so as to impart improved guiding directions to the vehicle. It describes how a positioning system like the GPS (Global Positioning System) can be correlated with external objects located on a driver planned route and with a navigation map located in a car.
  • GPS Global Positioning System
  • the Route Planner 200 can also make use of US patent application 2001/0001848 Oshizawa et al., entitled "Vehicle Navigation System Providing Traffic Advisories Based on Traffic Information and Learned Route”.
  • This US patent discloses an on-board automobile navigation system provides advisory information to the driver based on real-time traffic information and a learned commute route.
  • the system empirically determines a commute route based on historical travel data of the vehicle.
  • the system further receives real-time traffic information via a wireless link.
  • the real-time traffic information may include information relating to traffic accidents, construction, and other traffic problems and the locations of such problems.
  • the system automatically determines whether the present day and time are within a previously defined commute time window and, if so, prompts the driver to accept or decline a previously defined commute destination.
  • the system automatically receives the real-time traffic information and compares the location information associated with any traffic problems to the commute route. If the system determines that the location of a traffic problem falls on or near the commute route, then the system outputs an appropriate notification to the user and, if possible, computes an alternative route.
  • the Route Planner 200 can also take advantage of US European patent EP 0 594 495 Marichalar et al., entitled "Driving aid method and device by reception and processing of traffic information" .
  • This European patent discloses a method for assistance with driving for a motor vehicle, based on receiving road information by a radio channel, as well interpretation of it in real time by the driver, characterised, on the one hand, in that the latter simultaneously monitors the choice of a route or of a predefined geographical area and listens to or consults information relating to this route or to this area, and, on the other hand, in that he continuously controls the interpretation, simultaneous or otherwise, of other modes of communication and the corresponding use of common reproduction units.
  • Car Workload Manager 103 A Workload Manager 103 is described in the publication entitled " Safety Driver Manager” Kanevsky et al. - IBM T. J. Watson Research Center, Yorktown Heights, NY, USA - SPECOM'2004: 9th Conference, Speech and Computer, St. Russia, September 20-22, 2004, ISCA Archive (http://www.isca-speech.org/archive). This publication addresses some aspects of voice user interface in cars, as a mechanism to increase driver safety.
  • an object of the Workload Manager 103 is to determine a moment-to-moment analysis of the user's cognitive workload.
  • driver characteristics e.g. speaking speed, eyelid status.
  • the Workload Manager must be designed in a way it can correlate sensor information and information (for instance distracting information) delivered to the driver. This can be represented as a "Workload Representational Surface (as shown in Figure 3).
  • One axis of the surface represents stress on the vehicle which can be measured using the external sensors input of the traffic conditions and local events (e.g. heavy rain), and • Another orthogonally distinct axis, represents stress on the driver which can be measured using the internal sensors input of the driver actions (e.g. application of brakes, changing lanes), and driver characterstics (e.g. speaking speed, eyelid status).
  • Values on each axis can be defined between zero to one.
  • a maximum load (beyond which there is an "overload") is represented by the position where there is both a maximum vehicle stress and a maximum driver stress.
  • Biometric Sensors are used to measure the driver's attention (personal condition of the learner, such as degree of tiredness).
  • An example of a biometric sensor is the image monitor described in US patent 6,792 339 Basson et al. entitled "Artificial passenger with condition sensors” which discloses a situation controller for a vehicle.
  • the situation controller includes a processing device and an image monitor coupled to the processing device, for monitoring images associated with one or more items within the vehicle.
  • the situation controller also includes a device for communicating a message relating to the one or more monitored items wherein the content of the message is determined by the processing device based at least in part on the one or more monitored items.
  • a controller coupled to the processing device, for controlling at least one function of the vehicle in response to the one or more monitored items within the vehicle is included.
  • the present invention can make use of US patent application US 2003/0097047 entitled “Personalized Driver Stress Prediction Using Geographical Database” Woltermann et al., which discloses a system installed in a motor vehicle for inferring a vehicle operator's stress level from body sensors and from environmental data related to the position and operation of the vehicle.
  • the system functions in a training phase using machine learning techniques to derive a model of an individual operators stress reaction to the environment in which the vehicle is operated and, using the results of this training phase, the system is subsequently used to predict stress levels to be expected when certain traffic conditions are imminent based on a projection of the driver's physiolocial state.
  • the result of this prediction of stress level for the individual driver is used to control or warn the driver with respect to operation and scheduling of attention diverting devices such as cellular phones.
  • Event Manager The Workload Manager 103 is closely related to the Event Manager 104.
  • the Event Manager detects events and, based on the occurrence of specific events, triggers specific actions and/or make decisions about potential actions.
  • the Event Manager uses a set of rules for starting and stopping the interactions with the driver (or interventions). It controls the interruption of dialogues between the driver and the car dashboard. For instance, the Event Manager can interrupt a conversation to deliver an urgent message about traffic conditions on the route.
  • the Even Manager can use the driver's answers and/or data from the Workload Manager 103 to compute for instance how often the driver has correctly answered and the average delay in the answers etc. ...
  • the Event Manager determines the driver's alertness, based on his/her answers and on information provided by the Workload Manager. It takes decisions based on whether or not the driver needs additional stimuli and determines what type of stimuli must be provided (e.g. verbal stimuli via speech applications or physical stimuli such as a bright light, loud noise, etc.).
  • the Even Manager can also suggest to the driver to stop for rest.
  • the Even Manager permits the use and testing of different statistical models for interpreting the driver's answers and its physical and intellectual condition.
  • the Learning System 100 provides in output the adapted learning materials 105.
  • the Course Planner 106 keeps track of the status of progress of the materials delivered to the driver to prevent repetition or loss of any part of the materials and also to smooth the transition between delivered parts of the materials (e.g. repeat a meaningful segment of an interrupted delivered part of the materials).
  • the system includes the following components:
  • a Learning System Manager 400 evaluates data provided by the Traffic Manager component 102 and the Workload Manager 103 and communicates this data to the Course Planner 106.
  • the Course Planner 106 splits educational materials into segments. Each segment is defined according to a specific intensity and particular characteristics. The Course Planner determines how much attention and time a driver can give to the materials contained in each segment depending on the intensity and characteristics of the segment but also on the traffic conditions (e.g. the segment can be labelled to indicate that it is best being delivered during vehicle stops at a traffic light or when road is straight and speed is fixed).
  • the Learning System Manager 400 decides which methods to use to adapt educational materials contained in each segment. For this, the Learning System Manager 400 uses the services of the Indexing component 403. These adaptation methods can include tools that are described below. These tools either transform educational materials dynamically in real time or use pre-stored variants of the educational materials.
  • a system for playing tapes or CDs at different speeds 402 without compromising the audio quality e.g. playing an audio tape/CD faster and using a speech enhancement technique to provide the same audio quality for speeded-up speech).
  • Simplification tools 404 transform learning materials into a simplified form if the driver cannot pay full attention to a presentation at this moment.
  • Video Transformation tools 405 display video images (that are related to the learning materials being delivered) to the driver when his/her car is stopped.
  • Figure 5 shows the different steps of the method according to the present invention.
  • the method comprises the following steps:
  • Step 500 the traffic manager 102 checks if the driver has explicitly defined his/her route.
  • Step 501 if the driver has explicitly defined his/her route, then the traffic manager 102 tries to estimate the traffic on this route and the characteristics of this route.
  • Step 502 If the driver has not explicitly defined a route, then the traffic manager 102 finds from the driver's history what is the driver's route. Then the system estimates the traffic on this route.
  • Step 503 Once the traffic on the route is estimated, then the workload manager 103 tries to predict the driver's physical and mental conditions along the route (using the driver's profile and history on how the traffic influences the driver's physical and mental conditions - e.g. receptiveness, attention, concentration, tiredness ).
  • Step 504 The driver's physical and mental conditions along the route are predicted.
  • Step 505 If the driver's physical and intellectual conditions along the route cannot be predicted, the driver's physical and mental conditions are detected/measured using previously described Biometric Sensors.
  • Step 506 the learning system through the course planner 106 determines how the educational/entertainment materials must be adapted to the route, to estimated traffic, to external conditions and to the predicted or measured driver's physical and mental conditions.
  • Step 507 the learning system 100 checks if educational/entertainment materials corresponding to the route, to the estimated traffic, to the external conditions and to the driver's conditions already exists.
  • Step 508 if such educational/entertainment materials already exist, the system preferably uses these materials.
  • Step 509 if not such educational/entertainment materials exist, the system dynamically adapts the educational/entertainment materials using the previously described transformation tools :
  • Simplification tools 404 to transform educational/entertainment materials into a simplified form
  • Video Transformation tools 405 to display images to the driver when he/she stops his/her car.

Landscapes

  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Automation & Control Theory (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Traffic Control Systems (AREA)

Abstract

La présente invention concerne de façon générale le domaine de l'éducation et plus particulièrement un procédé, un système et des programmes informatiques destinés à fournir un matériel de divertissement et/ou d'auto-apprentissage personnalisé conçu pour les environnements de voyage et conçu plus particulièrement pour le trafic routier et l'état physique et mental des conducteurs de véhicules. Le procédé à exécuter dans un véhicule pour fournir un contenu personnalisé à un voyageur comprend les étapes de : détermination d'une route et des caractéristiques de ladite route; détermination des conditions externes le long de la route; détermination de l'état physique et/ou mental du voyageur le long de la route; adaptation et séquençage du contenu en fonction des caractéristiques de la route, des conditions externes et de l'état physique et/ou mental du voyageur le long de la route; mise à disposition du contenu adapté et séquencé le long de la route pour le voyageur.
PCT/EP2007/054292 2006-10-16 2007-05-03 Système et procédé pour fournir un matériel de divertissement ou d'auto-apprentissage personnalisé adaptés aux voyageurs WO2008046667A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP06122360.8 2006-10-16
EP06122360 2006-10-16

Publications (1)

Publication Number Publication Date
WO2008046667A1 true WO2008046667A1 (fr) 2008-04-24

Family

ID=38329951

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2007/054292 WO2008046667A1 (fr) 2006-10-16 2007-05-03 Système et procédé pour fournir un matériel de divertissement ou d'auto-apprentissage personnalisé adaptés aux voyageurs

Country Status (1)

Country Link
WO (1) WO2008046667A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018106400A1 (fr) * 2016-12-09 2018-06-14 Intel Corporation Routage de navigation basé sur le stress

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10288532A (ja) * 1997-04-15 1998-10-27 Toyota Motor Corp 車両用音声案内装置
US20030182028A1 (en) * 2002-03-22 2003-09-25 Nissan Motor Co., Ltd. Information presentation controlling apparatus and method
US20040036601A1 (en) * 2000-09-21 2004-02-26 Obradovich Michael L Technique for operating a vehicle effectively and safely
DE10343683A1 (de) * 2003-09-20 2005-04-21 Daimler Chrysler Ag Informationssystem für Kraftfahrzeuge

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10288532A (ja) * 1997-04-15 1998-10-27 Toyota Motor Corp 車両用音声案内装置
US20040036601A1 (en) * 2000-09-21 2004-02-26 Obradovich Michael L Technique for operating a vehicle effectively and safely
US20030182028A1 (en) * 2002-03-22 2003-09-25 Nissan Motor Co., Ltd. Information presentation controlling apparatus and method
DE10343683A1 (de) * 2003-09-20 2005-04-21 Daimler Chrysler Ag Informationssystem für Kraftfahrzeuge

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018106400A1 (fr) * 2016-12-09 2018-06-14 Intel Corporation Routage de navigation basé sur le stress

Similar Documents

Publication Publication Date Title
US11597390B2 (en) Method and system for driving mode switching based on driver's state in hybrid driving
US7292152B2 (en) Method and apparatus for classifying vehicle operator activity state
CN106335513B (zh) 具有先进驾驶员辅助和自主驾驶的车上时间智能使用的方法和系统
US7269504B2 (en) System and method for assigning a level of urgency to navigation cues
Ranney et al. Effects of voice technology on test track driving performance: Implications for driver distraction
JP6948110B2 (ja) 運転者にメッセージを提供する適切な時を決定するシステムおよび方法
US20190187701A1 (en) Method and system for driving mode switching based on self-aware capability parameters in hybrid driving
JP4307833B2 (ja) ドライバ能力向上のためのシステム及び方法
EP1330377B1 (fr) Procede de synthese de reponse dans un systeme d'assistance au conducteur
US6925425B2 (en) Method and apparatus for vehicle operator performance assessment and improvement
JP2004171060A (ja) 運転支援装置、運転支援システム及び運転支援プログラム
KR20030070889A (ko) 차량 오퍼레이터 수행을 향상시키는 방법 및 장치
KR20030055282A (ko) 콘텍스트 인식 무선 통신 장치 및 방법
JP4903505B2 (ja) ナビゲーション装置及び方法、ナビゲーションプログラム、並びに記憶媒体。
JP2003075175A (ja) ナビゲーション装置及びナビゲーション方法
WO2019122967A1 (fr) Procédé et système de commutation de mode de conduite basée sur le risque en conduite hybride
EP2391996A1 (fr) Dispositif de gestion d'information trafic, procédé de gestion d'information trafic, et programme de gestion d'information trafic
WO2008046667A1 (fr) Système et procédé pour fournir un matériel de divertissement ou d'auto-apprentissage personnalisé adaptés aux voyageurs
EP4198455A1 (fr) Navigation de véhicule basée sur des modalités dynamiques
JP2020160826A (ja) エージェント装置、エージェント装置の制御方法、およびプログラム
Andreone et al. Beyond context-awareness: driver-vehicle-environment adaptivity. from the comunicar project to the aide concept
JP5388706B2 (ja) 発呼タイミング制御装置および発呼タイミング制御方法
JP4316997B2 (ja) 車両監視装置及び車両監視方法
JP2023069028A (ja) アンケート装置、評価装置、アンケート方法、プログラム
JP2019184358A (ja) ナビゲーション装置、ナビゲーション装置の制御方法、ナビゲーション装置の制御プログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07728745

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 07728745

Country of ref document: EP

Kind code of ref document: A1