WO2018134198A1 - Communication control apparatus and method - Google Patents

Communication control apparatus and method Download PDF

Info

Publication number
WO2018134198A1
WO2018134198A1 PCT/EP2018/051001 EP2018051001W WO2018134198A1 WO 2018134198 A1 WO2018134198 A1 WO 2018134198A1 EP 2018051001 W EP2018051001 W EP 2018051001W WO 2018134198 A1 WO2018134198 A1 WO 2018134198A1
Authority
WO
WIPO (PCT)
Prior art keywords
output
dialogue
dialogue component
communication controller
component
Prior art date
Application number
PCT/EP2018/051001
Other languages
French (fr)
Inventor
Harpreet Singh
Francesco BIONDI
Ben ANYASODO
Original Assignee
Jaguar Land Rover Limited
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jaguar Land Rover Limited filed Critical Jaguar Land Rover Limited
Publication of WO2018134198A1 publication Critical patent/WO2018134198A1/en

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/0098Details of control systems ensuring comfort, safety or stability not otherwise provided for
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Arrangement of adaptations of instruments
    • B60K35/20
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K37/00Dashboards
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W50/16Tactile feedback to the driver, e.g. vibration or force feedback to the driver on the steering wheel or the accelerator pedal
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016Input arrangements with force or tactile feedback as computer generated output to the user
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/143Alarm means
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/146Display means
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2520/00Input parameters relating to overall vehicle dynamics
    • B60W2520/10Longitudinal speed
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00Input parameters relating to occupants
    • B60W2540/12Brake pedal position
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00Input parameters relating to occupants
    • B60W2540/18Steering angle
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00Input parameters relating to occupants
    • B60W2540/22Psychological state; Stress level or workload
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00Input parameters relating to occupants
    • B60W2540/26Incapacity
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2554/00Input parameters relating to objects
    • B60W2554/80Spatial relation or speed relative to objects
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2555/00Input parameters relating to exterior conditions, not covered by groups B60W2552/00, B60W2554/00
    • B60W2555/20Ambient conditions, e.g. wind or rain

Definitions

  • the present disclosure relates to a communication control apparatus and method.
  • the present disclosure relates to a communication controller, to a vehicle and to a method.
  • a virtual agent it is known to incorporate a virtual agent into a traditional consumer device, such as a laptop, a tablet computer, a cellular telephone and a personal computer. It is also known to implement a virtual agent in a standalone device to function as a digital assistant.
  • the device may provide a visual indication of the status of the agent, for example to indicate that the agent is active, listening or off. For example, an icon may be displayed on a display screen. The shape and/or colour of the icon may change to indicate different system states.
  • agents With increasingly complex interfaces on vehicles, it is expected that agents will be incorporated into vehicle interfaces. However, it is envisaged that this will present unique challenges not encountered in existing consumer device applications.
  • the agent may be responsible for communicating critical information to the driver of the vehicle.
  • the driver workload varies depending on the situation.
  • the capacity of the driver to receive and comprehend new information may be limited if their workload is high at that time.
  • Known agents do not assess a user's situation when communicating information. It is against this backdrop that the present invention(s) have been conceived.
  • At least one processor configured to control output of said at least one dialogue component
  • a memory connected to the at least one processor
  • the at least one processor being configured to:
  • the at least one processor is configured to control output of said dialogue component in dependence on the determined driver workload.
  • the at least one processor may be configured to pause and/or resume output of said dialogue component in dependence on the determined driver workload. For example, output of said dialogue component may be paused when an increase in the determined driver workload is detected; and/or output of said dialogue component may be resumed when a decrease in the determined driver workload is detected.
  • At least one processor configured to control output of said at least one dialogue component
  • a memory connected to the at least one processor
  • the at least one processor being configured to:
  • a communication controller for controlling a vehicle dialogue including at least one dialogue component, the communication controller comprising:
  • At least one processor configured to control output of said at least one dialogue component
  • a memory connected to the at least one processor
  • the at least one processor being configured to:
  • the at least one processor is configured to control output of said dialogue component in dependence on the determined driver workload, wherein the at least one processor is configured to pause output of said dialogue component when the determined driver workload is greater than or equal to an upper workload threshold, and wherein the at least one processor is configured to update the dialogue component prior to resuming output thereof.
  • the communication controller as described above, wherein the processor is a control unit and the output means is an electrical output for outputting electronic data, which may represent dialogue to be output to the one or more occupants of the vehicle.
  • the communication controller provides a communication interface between the driver and the vehicle. At least in certain embodiments, the communication controller may reduce distraction for the driver when the driver workload is high, for example while performing a vehicle manoeuvre. At least in certain embodiments the communication controller may provide a more natural communication interface.
  • the communication controller may control output of the dialogue components in dependence on driver requirements and/or preferences and/or the current driver situation. The communication controller monitors the situation and if a high driver workload is detected, the dialogue session in progress is paused. The communication controller may establish if information is available to reduce the driver workload.
  • the vehicle dialogue may be a vehicle-initiated dialogue (VID).
  • the communication controller may initiate a driver dialogue, i.e. output a dialogue component without a driver prompt or input.
  • the dialogue comprises one or more dialogue components.
  • the dialogue components each comprise information to be communicated to the driver of the vehicle.
  • Each dialogue component may comprise an audio and/or visual component for communicating with the driver.
  • the dialogue may optionally comprise a haptic feedback, for example to provide a driver alert.
  • the communication controller may be configured to implement a pause before the dialogue component is output and/or during output of the dialogue component.
  • the at least one processor may determine the driver workload in dependence on one or more data signals received from vehicle systems. Alternatively, or in addition, the at least one processor may determine the driver workload in dependence on a signal received from a workload monitor.
  • the communication controller monitors the driver workload and may pause output of the dialogue component.
  • a priority rating may be defined for each dialogue component. The priority rating may, for example, categorise each dialogue component as a high, medium or low priority.
  • a dialogue component which is categorised as a high priority may, for example, comprise information which is deemed critical to operation of the vehicle.
  • the communication controller may be configured to convey any such critical information irrespective of the current driver workload or even if the additional information may further increase the driver workload.
  • the communication controller may be configured to inhibit a pause function if the dialogue component to be output has a particular priority rating.
  • the communication controller may be configured to identify when an event is complete. If the communication controller determines that the paused dialogue component relates to an event which is complete, for example an event completed while output of the dialogue component is paused, the communication controller may be configured to cancel output of the dialogue component.
  • the communication controller may be configured to check the relevance of previous dialogues and proposed dialogue components. If the dialogue component is no longer relevant, the dialogue component may be discarded.
  • a time threshold may be defined, for example in relation to diary events.
  • a distance travelled threshold may be used, for example in relation to traffic events and/or points of interest and/or navigation instructions.
  • the communication controller may be configured to resume output of all other types of dialogue components.
  • the at least one processor may be configured to pause output of said dialogue component when the determined driver workload is greater than or equal to an upper workload threshold.
  • the upper workload threshold may be predefined. Alternatively, the upper workload threshold may be dynamic. For example, the upper workload threshold may be determined in dependence on a priority rating of the identified dialogue component. The lower workload threshold may be directly proportional to the priority rating of the identified dialogue component. The upper workload threshold may be higher for a dialogue component having a high priority than for a dialogue component having a low priority.
  • the at least one processor may be configured to resume output of said dialogue component when the determined driver workload is less than or equal to a lower workload threshold.
  • the lower workload threshold may be predefined. Alternatively, the lower workload threshold may be dynamic. For example, the lower workload threshold may be determined in dependence on the priority rating of the paused dialogue component. The lower workload threshold may be inversely proportional to the priority rating of the paused dialogue component. For example, the lower workload threshold may be higher for a dialogue component having a high priority than for a dialogue component having a low priority.
  • the at least one processor may be configured to update the dialogue component prior to resuming output of said dialogue component.
  • the dialogue component may be updated to include the current information or the latest available information.
  • the updated dialogue component may, for example, indicate a revised speed limit information, updated navigation information or new vehicle system information.
  • the communication controller may also be configured to control external communication, for example to control output of an electronic communication with a contact stored in an address book.
  • the communication controller may be configured automatically to update a message, such as a Short Messaging Service (SMS) text message, for example to include an updated estimated time of arrival.
  • SMS Short Messaging Service
  • the communication controller may continue to identify one or more additional dialogue component to be output while the dialogue component is paused. When output of the paused dialogue component is resumed, the communication controller may schedule more than one dialogue component to be output. The communication controller may sequence said dialogue components in dependence on the priority rating. The dialogue component having the highest priority rating will be scheduled for output first.
  • the at least one processor may be configured to perform a validity test to determine the validity of the paused dialogue component prior to resuming output of the paused dialogue component.
  • the validity test determines whether the dialogue component comprises information which is still relevant to the current situation.
  • the dialogue component is classed as valid if it is still relevant; but invalid if it is no longer relevant.
  • the at least one processor may be configured to cancel output of the paused dialogue component if the validity test determines that the paused dialogue component is invalid.
  • the at least one processor may be configured to resume output of the paused dialogue component if the validity test determines that the paused dialogue component is valid. However, if the information is no longer relevant, the communication controller may be configured to clear the dialogue component.
  • the communication controller may provide a driver update once the driver workload decreases.
  • the communication controller may resume the dialogue when the driver workload decreases.
  • the communication controller may enable the driver to pause output of the dialogue component if the driver is not ready to receive information.
  • the at least one processor may be configured to update the dialogue component prior to resuming output thereof.
  • the at least one processor may be configured to receive one or more data signals from respective vehicle systems.
  • the dialogue component to be output may be identified in dependence on one or more of said data signals.
  • a vehicle comprising a communication controller as described herein.
  • a vehicle dialogue including at least one dialogue component, the method comprising:
  • the method may comprise pausing and/or resuming output of said dialogue component in dependence on the determined driver workload.
  • the method may comprise pausing output of said dialogue component when the determined driver workload increases.
  • the method may comprise pausing output of said dialogue component when the determined driver workload is greater than or equal to an upper workload threshold.
  • the upper workload threshold may be predefined.
  • the upper workload threshold may be determined in dependence on a priority rating of the identified dialogue component.
  • the method may comprise resuming output of the paused dialogue component when the determined driver workload decreases.
  • the method may comprise resuming output of said dialogue component when the determined driver workload is less than or equal to a lower workload threshold.
  • the lower workload threshold may be determined in dependence on a priority rating of the paused dialogue component.
  • the method may comprise updating the dialogue component prior to resuming output thereof.
  • the method may comprise testing the validity of the paused dialogue component prior to resuming output of the paused dialogue component. Output of the paused dialogue component may be cancelled if the test determines that the paused dialogue component is invalid. Output of the paused dialogue may be resumed if the test determines that the paused dialogue component is valid.
  • the method may comprise monitoring the status of one or more vehicle systems and identifying the dialogue component to be output in dependence on the status of said one or more vehicle systems.
  • a non-transitory computer readable media comprising a set of computational instructions which, when executed, cause a computer to implement the method described herein.
  • control unit or controller described herein may suitably comprise a computational device having one or more electronic processors.
  • the system may comprise a single control unit or electronic controller or alternatively different functions of the controller may be embodied in, or hosted in, different control units or controllers.
  • controller or “control unit” will be understood to include both a single control unit or controller and a plurality of control units or controllers collectively operating to provide any stated control functionality.
  • a suitable set of instructions may be provided which, when executed, cause said control unit or computational device to implement the control techniques specified herein.
  • the set of instructions may suitably be embedded in said one or more electronic processors.
  • the set of instructions may be provided as software saved on one or more memory associated with said controller to be executed on said computational device.
  • the control unit or controller may be implemented in software run on one or more processors.
  • One or more other control unit or controller may be implemented in software run on one or more processors, optionally the same one or more processors as the first controller. Other suitable arrangements may also be used.
  • Figure 1 shows a schematic representation of a vehicle incorporating a communication controller in accordance with an embodiment of the present invention
  • Figure 2 shows the categories of the dialogue components to be output to a driver of the vehicle
  • Figure 3 illustrates the prioritisation of each of the categories shown in Figure 2; and Figure 4 shows a flow diagram representing operation of the communication controller according to an embodiment of the present invention.
  • the communication system 1 comprises a communication controller 2.
  • the communication controller 2 in the present embodiment is adapted to control communication with a driver of the vehicle V, but it will be understood that communication with other occupants of the vehicle V is also possible.
  • the communication controller 2 is configured to provide an agent which implements a human machine dialogue for communicating information to the vehicle driver.
  • the agent implements a vehicle-initiated dialogue (VID).
  • VID is operative to initiate communication with the vehicle driver, for example to start a dialogue with the vehicle driver to convey system information.
  • the VID may, for example, be configured to convey one or more of the following categories of information to the vehicle driver:
  • Warning i.e. Major/Minor vehicle warning, external warnings, safety advance notifications
  • the communication controller 2 implements a VID to interact with the driver to help improve vehicle performance, to improve the driving experience and to help reduce distraction.
  • the communication controller 2 comprises a first electronic processor 3 configured to execute a set of computational instructions stored on a non- transitory computer readable media.
  • the computational instructions are stored in a first system memory 4 connected to the first electronic processor 3.
  • the first system memory 4 may, for example, comprise a memory device.
  • the first electronic processor 3 is configured to implement the VID function of the communication controller 2.
  • the first electronic processor 3 is configured to identify information to be output to the vehicle driver and to schedule the output of that information.
  • the first electronic processor 3 communicates with a plurality of vehicle systems 5-n over a communication network 6.
  • the vehicle systems 5-n each publish one or more data signal S-n to the communication network 6.
  • the data signals S-n each comprise information relating to an onboard vehicle system, for example vehicle speed data and/or fault data; or an external system, such as local traffic.
  • the first system memory 4 comprises a plurality of dialogue components 7 for communicating information to the vehicle driver.
  • the dialogue components 7 may be adapted to convey information derived from one or more of said data signals S-n.
  • the first electronic processor 3 is configured to select one or more of said dialogue components 7 in dependence on the data signals S-n received from the vehicle systems 5-n.
  • the selected dialogue component(s) 7 is then output to communicate information to the vehicle driver.
  • the first electronic processor 3 may select and output a plurality of said dialogue components 7, for example to be output in a sequence.
  • the dialogue components 7 may be arranged in a dialogue tree which is traversed in dependence on one or more user inputs.
  • the dialogue components 7 may each comprise or consist of an audio output and/or a visual output.
  • the dialogue components 7 are categorised as: a warning dialogue component 7-1 ; a reminder dialogue component 7-2; a recommendation dialogue component 7-3; or a feedback dialogue component 7-4.
  • the warning dialogue component 7- 1 may, for example, comprise one or more of the following: instructions relevant to safety, for example instructions to fasten a seatbelt; legal ramifications, for example a change in the statutory speed limit; and information relating to vehicle performance, for example a low fuel warning.
  • the reminder dialogue components 7-2 may, for example, comprise one or more of the following: a message based on a timeline assessment, for example a deadline for performing scheduled servicing, maintenance or testing of the vehicle (such as a Ministry of Transport (MOT) test in the United Kingdom); calendar events, for example to provide a reminder of a scheduled meeting, a reminder of a general diary entry, or a reminder of a programme or event.
  • the recommendation dialogue components 7-3 may, for example, comprise one or more of the following: a suggestion based on user conditioning, for example messaging from a navigation system.
  • the feedback dialogue components 7 may, for example, comprise one or more of the following: conveying information, for example to advise that a vehicle system, such as an off-road mode of Terrain Response®, has been activated.
  • Some of the dialogue components may require a driver input, for example to acknowledge a reminder or a recommendation. Other components, may not require a driver input, for example it may not be necessary to acknowledge receipt of feedback.
  • a priority rating is defined for each of the dialogue components 7.
  • the priority rating is determined in dependence on how quickly the driver must react to the information (the urgency); and how relevant the information is to a particular situation (the importance).
  • a chart representing the relationship between urgency and importance of the information to be conveyed to the driver is illustrated in Figure 3A.
  • the priority rating is not necessarily the order in which the dialogue components 7 are presented.
  • the warning dialogue components 7-1 have the highest priority and the feedback dialogue components 7-4 have the lowest priority rating.
  • the warning dialogue component 7-1 is given a priority rating of one (1 );
  • the reminder dialogue component 7-2 is given a priority rating of two (2);
  • the recommendation dialogue component 7-3 is given a priority rating of three (3); and
  • the feedback dialogue component 7-4 is given a priority rating of four (4).
  • the communication controller 2 is connected to a workload monitor 8 comprising a second electronic processor 9 configured to execute a set of computational instructions stored on a non-transitory computer readable media.
  • the computational instructions are stored in a second system memory 10 connected to the second electronic processor 9.
  • the second system memory 10 may, for example, comprise a memory device.
  • the second electronic processor 9 is configured to monitor driver workload.
  • the second electronic processor 9 reads the one or more data signal S-n published to the communication network 6 by the vehicle systems 5-n.
  • the second electronic processor 9 is configured to categorise driver workload in dependence on said data signals S-n.
  • the second electronic processor 9 may determine the driver workload in dependence on one or more dynamic vehicle parameters, such as vehicle speed and/or steering angle and/or brake pressure.
  • One or more bands may be defined for each of said dynamic vehicle parameters and a workload value (for example an integer score) defined for each band.
  • the workload values may be determined for the current dynamic vehicle parameters and the total used to provide an indication of the driver workload.
  • the second electronic processor 9 may categorise driver workload, for example as high, medium, or low.
  • the total of the workload values based on current vehicle dynamic parameters may be compared to one or more workload thresholds. For example, an upper workload threshold may be defined to categorise a high driver workload; and a lower workload threshold may be defined to categorise a low driver workload.
  • the second electronic processor 9 is configured to output a driver workload signal SWL to the communication controller 2.
  • the driver workload signal SWL may comprise the total of the workload values based on current vehicle dynamic parameters and/or a categorisation determined in dependence on said workload values.
  • the second electronic processor 9 may analyse image data from a driver-facing camera (not shown) to determine the driver workload.
  • the second electronic processor 9 may analyse audio data to determine the driver workload, for example to identify when the driver is talking to a passenger in the vehicle. It will be understood that other factors may also be used to determine driver workload.
  • the workload monitor 8 may consider external factors, such as the local traffic and/or the time of day; and/or environmental factors, such as local weather conditions. The workload monitor 8 may also identify when the driver is making a telephone call.
  • the communication controller 2 is configured to control output of the dialogue components 7 in dependence on the determined driver workload.
  • the communication controller 2 is configured to receive the driver workload signal SWL from the workload monitor 8 and to pause output of a dialogue component 7 when an increase in the driver workload is detected.
  • the first electronic processor 4 is configured to pause output of the dialogue component(s) 7 when the driver workload signal SWL indicates that the sum of the workload values is greater than the upper workload threshold defining a high driver workload.
  • the pause in output of the dialogue component(s) 7 may comprise postponing or delaying output of one or more of said dialogue components 7 that have been scheduled for output. In certain cases, it may be appropriate to interrupt output of a dialogue component 7, for example in dependence on detection of a spike in the driver workload.
  • the communication controller 2 is operative to resume output of the dialogue component(s) 7 when the workload monitor 8 identifies a decrease in the driver workload. For example, the communication controller 2 may resume output of the dialogue component(s) 7 when the driver workload signal SWL indicates that the sum of the workload values is less than the lower workload threshold defining a low driver workload.
  • the first electronic processor 4 is configured to perform a validity test to determine the validity of the dialogue component 7 prior to resuming output. In particular, when the determined driver workload decreases, for example below the lower workload threshold, the electronic processor 4 is configured to reevaluate the data signals S-n received from the vehicle systems 5-n and to perform a check that the paused dialogue component 7 remains valid.
  • the communication controller 2 will cancel output of that dialogue component 7 rather than resume output. If the paused dialogue component 7 is still valid, the communication controller 2 will resume output of that dialogue component 7
  • a priority rating is defined for each of the dialogue components 7.
  • the communication controller 2 may be configured to define a plurality of workload thresholds for determining when to pause output of a dialogue component 7. For example, a different workload threshold may be defined for each of the priority ratings of the dialogue component 7.
  • a low driver workload threshold may be applied to prompt a pause in output of a dialogue component 7 having a low priority rating, such as a recommendation dialogue component 7- 3 or a feedback dialogue component 7-4.
  • a high driver workload threshold may be applied to prompt a pause in output of a dialogue component 7 having a high priority rating, such as a warning dialogue component 7-1 or a reminder dialogue component 7-2.
  • a flow chart 100 is shown in Figure 4 to illustrate the operating states of the communication controller 2.
  • the communication controller 2 switches between an idle state ST1 ; an initiate communication state ST2; a communicating information state ST3; and a finish dialogue state ST4.
  • the communication controller 2 defaults to the idle state ST1 when activated.
  • the operating state of the communication controller 2 may be indicated to the driver.
  • an icon (not shown) may provide a visual indication of the operating state of the communication controller 2.
  • the first electronic processor 3 is configured to read the data signals S-n published to the communication network 5 and to identify information to be communicated to the vehicle driver.
  • the first electronic processor 3 may identify information to be output to the vehicle driver based on predefined criteria.
  • the first electronic processor 3 may monitor the data signals S-n published to the communication network 5 to determine operating conditions of that vehicle system 5-n outside predefined operating parameters, for example above an upper threshold and/or below a lower threshold. Upon identification of information to be communicated to the vehicle driver, the operating status of the communication controller 2 changes to the initiate communication state ST2.
  • the first electronic processor 3 identifies one or more dialogue component 7 for output in dependence on the data signals S-n.
  • the first electronic processor 3 then schedules output of said one or more selected dialogue component 7. The scheduling may, for example, depend on the criticality of the information to be conveyed to the vehicle driver, as determined by the priority ratings defined for each of the dialogue components 7.
  • the dialogue components 7 having a higher priority rating will be identified for output sooner than information having a lower priority rating.
  • the communication controller 2 then changes to the initiate communication state ST2 and the first electronic processor 3 is configured to generate an advance notification signal ANS which provides a signal to the driver that the communication controller 2 is preparing to initiate a new dialogue.
  • the operating status of the communication controller 2 is held in the initiate communication state ST2 for a predetermined time period following output of the advance notification signal ANS.
  • the predetermined time period can be calibrated, but a time period of between five (5) and eleven (1 1 ) seconds inclusive is envisaged. Other time periods are useful.
  • the delay provides the driver an opportunity to delay output of the dialogue component 7, for example if they do not wish to receive new information due to current workload.
  • the first electronic processor 3 checks for a user input signal SIN and output of the dialogue component 7 may be controlled in dependence on any such user input signal.
  • the user input signal SIN may be generated when the vehicle driver actuates an input device 13, such as a button, a switch, a capacitive sensor, or other suitable input means.
  • the input device 13 may be disposed on a steering wheel, in a centre console, or a control panel.
  • the user input signal SIN may, for example, comprise a cancellation request to cancel output of the dialogue component 7; and/or a postpone request to delay or postpone output of the dialogue component 7.
  • the user input signal may comprise an expedite request to reduce or remove any time period in output of the dialogue component 7.
  • the communication controller 2 changes to the communicating information state ST3.
  • the first electronic processor 3 is configured to output the dialogue component 7 and any subsequent dialogue components 7.
  • the dialogue components 7 may comprise a visual output which is output to the display screen 14; and/or an audio output which is output over the audio entertainment system 15.
  • the first electronic processor 3 may output additional dialogue components 7, for example to provide additional information or to provide updated information.
  • the first electronic processor 3 may select and output additional dialogue components 7 in dependence on the user input signal SIN.
  • the first electronic processor 3 may traverse a dialogue tree comprising multiple dialogue components in dependence on one or more user input signals SIN.
  • the communication controller 2 uses the driver workload signal SWL from the driver monitor 8 to determine the driver workload.
  • the communication controller 2 monitors the driver workload signal SWL to detect changes in the driver workload. If the first electronic processor 3 identifies an increase in the driver workload, for example an increase in the driver workload above a predefined upper workload threshold, output of the dialogue component 7 is paused.
  • the pause may be implemented before the dialogue component 7 is output, thereby delaying or postponing output of the dialogue component 7. Alternatively, the pause may be implemented during output of the dialogue component 7, thereby interrupting the dialogue component 7.
  • the communication controller 2 continues to monitor the workload signal SWL to detect a decrease in the driver workload.
  • the communication controller 2 When the driver workload decreases, for example below a lower workload threshold, the communication controller 2 performs a validity test to determine whether the paused dialogue component 7 is valid. If the communication controller 2 determines that the dialogue component 7 is still valid, output of the dialogue component 7 is resumed. If the validity test determines that the dialogue component 7 is no longer valid, the first electronic processor 3 is configured to inhibit output of the dialogue component 7. The communication controller 2 remains in the information communicating state ST3 while communication with the driver is ongoing, including output of the dialogue components 7 and, if appropriate, waiting for a driver response. Once the driver has made a final decision, the communication controller 2 confirms this to the driver.
  • the first electronic processor 3 may be configured to determine that the current dialogue is finished when one or more of the following conditions is identified: a time-out condition, for example after a predetermined time period has elapsed; a user request provided in a user input signal SIN; no further dialogue components 7 for output, for example upon completion of a traversal of a dialogue tree; and determination that the information relating to said one or more vehicle systems 5-n is no longer relevant, for example a speed limit warning may be removed when the vehicle speed decreases below the speed limit.
  • the first electronic processor 3 determines that the current dialogue is complete and the communication controller 2 switches to the finish dialogue state ST4.
  • the first electronic processor 3 may optionally output a conclusion notification signal CNS.
  • the communication controller 2 described herein resumes output of the dialogue component 7 when the determined driver workload decreases provided the paused dialogue component is still valid.
  • output of the dialogue component may be paused for a predetermined time period.
  • the communication controller 2 may determine the driver workload and also perform a validity test to determine whether the paused dialogue component is valid. If the driver workload remains above the driver workload threshold and the paused dialogue component is still valid, the communication controller 2 may pause output of a dialogue component for another predetermined period of time. If the driver workload is below the driver workload threshold and the paused dialogue component is still valid, the communication controller 2 will resume output of the dialogue component for another predetermined period of time. If the paused dialogue component is invalid, the communication controller 2 will cancel output of the dialogue component.
  • the communication controller 2 and the workload monitor 8 have been described herein as being implemented by first and second electronic processor 3, 9 respectively. It will be understood that the communication controller 2 and the workload monitor 8 could be combined into a single module which may be implemented by the same electronic processor.

Abstract

The present disclosure relates to a communication controller (2) for controlling a vehicle dialogue including at least one dialogue component, The communication controller (2) includes at least one processor (3) configured to control the output of said at least one dialogue component; and a memory (4) connected to the at least one processor (3). The at least one processor (3) is configured to identify a dialogue component (7) to be output; and determine a driver workload. The at least one processor is configured to pause the output of the dialogue component (7) in dependence on detection of an increase in the determined driver workload. The present disclosure also relates to a vehicle incorporating a communication controller (2); and a related method of controlling a vehicle dialogue.

Description

COMMUNICATION CONTROL APPARATUS AND METHOD
TECHNICAL FIELD
The present disclosure relates to a communication control apparatus and method. In particular, but not exclusively, the present disclosure relates to a communication controller, to a vehicle and to a method.
BACKGROUND
It is known to incorporate a virtual agent into a traditional consumer device, such as a laptop, a tablet computer, a cellular telephone and a personal computer. It is also known to implement a virtual agent in a standalone device to function as a digital assistant. The device may provide a visual indication of the status of the agent, for example to indicate that the agent is active, listening or off. For example, an icon may be displayed on a display screen. The shape and/or colour of the icon may change to indicate different system states. With increasingly complex interfaces on vehicles, it is expected that agents will be incorporated into vehicle interfaces. However, it is envisaged that this will present unique challenges not encountered in existing consumer device applications. For example, the agent may be responsible for communicating critical information to the driver of the vehicle. Furthermore, the driver workload varies depending on the situation. The capacity of the driver to receive and comprehend new information may be limited if their workload is high at that time. Known agents do not assess a user's situation when communicating information. It is against this backdrop that the present invention(s) have been conceived. SUMMARY OF THE INVENTION
Aspects of the present invention relate to a communication controller, to a method and a vehicle as claimed in the appended claims.
According to a further aspect of the present invention there is provided a communication controller for controlling a vehicle dialogue including at least one dialogue component, the communication controller comprising:
at least one processor configured to control output of said at least one dialogue component; and
a memory connected to the at least one processor;
the at least one processor being configured to:
identify a dialogue component to be output; and
determine a driver workload; wherein the at least one processor is configured to control output of said dialogue component in dependence on the determined driver workload. The at least one processor may be configured to pause and/or resume output of said dialogue component in dependence on the determined driver workload. For example, output of said dialogue component may be paused when an increase in the determined driver workload is detected; and/or output of said dialogue component may be resumed when a decrease in the determined driver workload is detected.
According to another aspect of the present invention there is provided a communication controller for controlling a vehicle dialogue including at least one dialogue component, the communication controller comprising:
at least one processor configured to control output of said at least one dialogue component; and
a memory connected to the at least one processor;
the at least one processor being configured to:
identify a dialogue component to be output; and
determine a driver workload;
wherein the at least one processor is configured to control output of said dialogue component in dependence on the determined driver workload, wherein the at least one processor is configured to pause output of said dialogue component when the determined driver workload is greater than or equal to an upper workload threshold, and wherein the upper workload threshold is determined in dependence on a priority rating of the identified dialogue component. According to another aspect of the present invention there is provided a communication controller for controlling a vehicle dialogue including at least one dialogue component, the communication controller comprising:
at least one processor configured to control output of said at least one dialogue component; and
a memory connected to the at least one processor;
the at least one processor being configured to:
identify a dialogue component to be output; and
determine a driver workload;
wherein the at least one processor is configured to control output of said dialogue component in dependence on the determined driver workload, wherein the at least one processor is configured to pause output of said dialogue component when the determined driver workload is greater than or equal to an upper workload threshold, and wherein the at least one processor is configured to update the dialogue component prior to resuming output thereof.
The communication controller as described above, wherein the processor is a control unit and the output means is an electrical output for outputting electronic data, which may represent dialogue to be output to the one or more occupants of the vehicle.
The communication controller provides a communication interface between the driver and the vehicle. At least in certain embodiments, the communication controller may reduce distraction for the driver when the driver workload is high, for example while performing a vehicle manoeuvre. At least in certain embodiments the communication controller may provide a more natural communication interface. The communication controller may control output of the dialogue components in dependence on driver requirements and/or preferences and/or the current driver situation. The communication controller monitors the situation and if a high driver workload is detected, the dialogue session in progress is paused. The communication controller may establish if information is available to reduce the driver workload.
The vehicle dialogue may be a vehicle-initiated dialogue (VID). In this arrangement, the communication controller may initiate a driver dialogue, i.e. output a dialogue component without a driver prompt or input. The dialogue comprises one or more dialogue components. The dialogue components each comprise information to be communicated to the driver of the vehicle. Each dialogue component may comprise an audio and/or visual component for communicating with the driver. The dialogue may optionally comprise a haptic feedback, for example to provide a driver alert.
The communication controller may be configured to implement a pause before the dialogue component is output and/or during output of the dialogue component. The at least one processor may determine the driver workload in dependence on one or more data signals received from vehicle systems. Alternatively, or in addition, the at least one processor may determine the driver workload in dependence on a signal received from a workload monitor. The communication controller monitors the driver workload and may pause output of the dialogue component. A priority rating may be defined for each dialogue component. The priority rating may, for example, categorise each dialogue component as a high, medium or low priority. A dialogue component which is categorised as a high priority may, for example, comprise information which is deemed critical to operation of the vehicle. The communication controller may be configured to convey any such critical information irrespective of the current driver workload or even if the additional information may further increase the driver workload. Thus, in certain embodiments, the communication controller may be configured to inhibit a pause function if the dialogue component to be output has a particular priority rating.
The communication controller may be configured to identify when an event is complete. If the communication controller determines that the paused dialogue component relates to an event which is complete, for example an event completed while output of the dialogue component is paused, the communication controller may be configured to cancel output of the dialogue component. The communication controller may be configured to check the relevance of previous dialogues and proposed dialogue components. If the dialogue component is no longer relevant, the dialogue component may be discarded. A time threshold may be defined, for example in relation to diary events. A distance travelled threshold may be used, for example in relation to traffic events and/or points of interest and/or navigation instructions. The communication controller may be configured to resume output of all other types of dialogue components.
The at least one processor may be configured to pause output of said dialogue component when the determined driver workload is greater than or equal to an upper workload threshold. The upper workload threshold may be predefined. Alternatively, the upper workload threshold may be dynamic. For example, the upper workload threshold may be determined in dependence on a priority rating of the identified dialogue component. The lower workload threshold may be directly proportional to the priority rating of the identified dialogue component. The upper workload threshold may be higher for a dialogue component having a high priority than for a dialogue component having a low priority.
The at least one processor may be configured to resume output of said dialogue component when the determined driver workload is less than or equal to a lower workload threshold. The lower workload threshold may be predefined. Alternatively, the lower workload threshold may be dynamic. For example, the lower workload threshold may be determined in dependence on the priority rating of the paused dialogue component. The lower workload threshold may be inversely proportional to the priority rating of the paused dialogue component. For example, the lower workload threshold may be higher for a dialogue component having a high priority than for a dialogue component having a low priority.
The at least one processor may be configured to update the dialogue component prior to resuming output of said dialogue component. For example, the dialogue component may be updated to include the current information or the latest available information. The updated dialogue component may, for example, indicate a revised speed limit information, updated navigation information or new vehicle system information. The communication controller may also be configured to control external communication, for example to control output of an electronic communication with a contact stored in an address book. The communication controller may be configured automatically to update a message, such as a Short Messaging Service (SMS) text message, for example to include an updated estimated time of arrival.
The communication controller may continue to identify one or more additional dialogue component to be output while the dialogue component is paused. When output of the paused dialogue component is resumed, the communication controller may schedule more than one dialogue component to be output. The communication controller may sequence said dialogue components in dependence on the priority rating. The dialogue component having the highest priority rating will be scheduled for output first.
The at least one processor may be configured to perform a validity test to determine the validity of the paused dialogue component prior to resuming output of the paused dialogue component. The validity test determines whether the dialogue component comprises information which is still relevant to the current situation. The dialogue component is classed as valid if it is still relevant; but invalid if it is no longer relevant. The at least one processor may be configured to cancel output of the paused dialogue component if the validity test determines that the paused dialogue component is invalid. The at least one processor may be configured to resume output of the paused dialogue component if the validity test determines that the paused dialogue component is valid. However, if the information is no longer relevant, the communication controller may be configured to clear the dialogue component. The communication controller may provide a driver update once the driver workload decreases. The communication controller may resume the dialogue when the driver workload decreases. The communication controller may enable the driver to pause output of the dialogue component if the driver is not ready to receive information. The at least one processor may be configured to update the dialogue component prior to resuming output thereof.
The at least one processor may be configured to receive one or more data signals from respective vehicle systems. The dialogue component to be output may be identified in dependence on one or more of said data signals.
According to a further aspect of the present invention there is provided a vehicle comprising a communication controller as described herein.
According to a still further aspect of the present invention there is provided a method of controlling a vehicle dialogue including at least one dialogue component, the method comprising:
identifying a dialogue component to be output; and
determining a driver workload;
wherein output of said dialogue component is controlled in dependence on the determined driver workload. The method may comprise pausing and/or resuming output of said dialogue component in dependence on the determined driver workload. The method may comprise pausing output of said dialogue component when the determined driver workload increases. The method may comprise pausing output of said dialogue component when the determined driver workload is greater than or equal to an upper workload threshold. The upper workload threshold may be predefined. The upper workload threshold may be determined in dependence on a priority rating of the identified dialogue component.
The method may comprise resuming output of the paused dialogue component when the determined driver workload decreases. The method may comprise resuming output of said dialogue component when the determined driver workload is less than or equal to a lower workload threshold. The lower workload threshold may be determined in dependence on a priority rating of the paused dialogue component.
The method may comprise updating the dialogue component prior to resuming output thereof.
The method may comprise testing the validity of the paused dialogue component prior to resuming output of the paused dialogue component. Output of the paused dialogue component may be cancelled if the test determines that the paused dialogue component is invalid. Output of the paused dialogue may be resumed if the test determines that the paused dialogue component is valid.
The method may comprise monitoring the status of one or more vehicle systems and identifying the dialogue component to be output in dependence on the status of said one or more vehicle systems.
According to a further aspect of the present invention there is provided a set of instructions which, when executed, cause a computational device to implement the method described herein.
According to a still further aspect of the present invention there is provided a non-transitory computer readable media comprising a set of computational instructions which, when executed, cause a computer to implement the method described herein.
Any control unit or controller described herein may suitably comprise a computational device having one or more electronic processors. The system may comprise a single control unit or electronic controller or alternatively different functions of the controller may be embodied in, or hosted in, different control units or controllers. As used herein the term "controller" or "control unit" will be understood to include both a single control unit or controller and a plurality of control units or controllers collectively operating to provide any stated control functionality. To configure a controller or control unit, a suitable set of instructions may be provided which, when executed, cause said control unit or computational device to implement the control techniques specified herein. The set of instructions may suitably be embedded in said one or more electronic processors. Alternatively, the set of instructions may be provided as software saved on one or more memory associated with said controller to be executed on said computational device. The control unit or controller may be implemented in software run on one or more processors. One or more other control unit or controller may be implemented in software run on one or more processors, optionally the same one or more processors as the first controller. Other suitable arrangements may also be used.
Within the scope of this application it is expressly intended that the various aspects, embodiments, examples and alternatives set out in the preceding paragraphs, in the claims and/or in the following description and drawings, and in particular the individual features thereof, may be taken independently or in any combination. That is, all embodiments and/or features of any embodiment can be combined in any way and/or combination, unless such features are incompatible. The applicant reserves the right to change any originally filed claim or file any new claim accordingly, including the right to amend any originally filed claim to depend from and/or incorporate any feature of any other claim although not originally claimed in that manner.
BRIEF DESCRIPTION OF THE DRAWINGS
One or more embodiments of the present invention will now be described, by way of example only, with reference to the accompanying figures, in which:
Figure 1 shows a schematic representation of a vehicle incorporating a communication controller in accordance with an embodiment of the present invention;
Figure 2 shows the categories of the dialogue components to be output to a driver of the vehicle;
Figure 3 illustrates the prioritisation of each of the categories shown in Figure 2; and Figure 4 shows a flow diagram representing operation of the communication controller according to an embodiment of the present invention.
DETAILED DESCRIPTION
A vehicle V incorporating a communication system 1 in accordance with an embodiment of the present invention will now be described with reference to the accompanying figures. The communication system 1 comprises a communication controller 2. The communication controller 2 in the present embodiment is adapted to control communication with a driver of the vehicle V, but it will be understood that communication with other occupants of the vehicle V is also possible. The communication controller 2 is configured to provide an agent which implements a human machine dialogue for communicating information to the vehicle driver. In the present embodiment, the agent implements a vehicle-initiated dialogue (VID). The VID is operative to initiate communication with the vehicle driver, for example to start a dialogue with the vehicle driver to convey system information. The VID may, for example, be configured to convey one or more of the following categories of information to the vehicle driver:
• Warning (i.e. Major/Minor vehicle warning, external warnings, safety advance notifications);
• Recommendations (i.e. Help and guidance, recommendation to use some features);
• Feedback (i.e. confirmation of actions, External messages, status message, information); and • Reminders (i.e. Configuration message, Events calendar reminder, scheduled maintenance or MOT and other external reminders).
At least in certain embodiments, the communication controller 2 implements a VID to interact with the driver to help improve vehicle performance, to improve the driving experience and to help reduce distraction.
With reference to Figure 1 , the communication controller 2 comprises a first electronic processor 3 configured to execute a set of computational instructions stored on a non- transitory computer readable media. In the present embodiment, the computational instructions are stored in a first system memory 4 connected to the first electronic processor 3. The first system memory 4 may, for example, comprise a memory device. The first electronic processor 3 is configured to implement the VID function of the communication controller 2. The first electronic processor 3 is configured to identify information to be output to the vehicle driver and to schedule the output of that information. The first electronic processor 3 communicates with a plurality of vehicle systems 5-n over a communication network 6. The vehicle systems 5-n each publish one or more data signal S-n to the communication network 6. The data signals S-n each comprise information relating to an onboard vehicle system, for example vehicle speed data and/or fault data; or an external system, such as local traffic.
The first system memory 4 comprises a plurality of dialogue components 7 for communicating information to the vehicle driver. The dialogue components 7 may be adapted to convey information derived from one or more of said data signals S-n. The first electronic processor 3 is configured to select one or more of said dialogue components 7 in dependence on the data signals S-n received from the vehicle systems 5-n. The selected dialogue component(s) 7 is then output to communicate information to the vehicle driver. The first electronic processor 3 may select and output a plurality of said dialogue components 7, for example to be output in a sequence. In certain embodiments, the dialogue components 7 may be arranged in a dialogue tree which is traversed in dependence on one or more user inputs. The dialogue components 7 may each comprise or consist of an audio output and/or a visual output.
With reference to Figure 2, the dialogue components 7 are categorised as: a warning dialogue component 7-1 ; a reminder dialogue component 7-2; a recommendation dialogue component 7-3; or a feedback dialogue component 7-4. The warning dialogue component 7- 1 may, for example, comprise one or more of the following: instructions relevant to safety, for example instructions to fasten a seatbelt; legal ramifications, for example a change in the statutory speed limit; and information relating to vehicle performance, for example a low fuel warning. The reminder dialogue components 7-2 may, for example, comprise one or more of the following: a message based on a timeline assessment, for example a deadline for performing scheduled servicing, maintenance or testing of the vehicle (such as a Ministry of Transport (MOT) test in the United Kingdom); calendar events, for example to provide a reminder of a scheduled meeting, a reminder of a general diary entry, or a reminder of a programme or event. The recommendation dialogue components 7-3 may, for example, comprise one or more of the following: a suggestion based on user conditioning, for example messaging from a navigation system. The feedback dialogue components 7 may, for example, comprise one or more of the following: conveying information, for example to advise that a vehicle system, such as an off-road mode of Terrain Response®, has been activated. Some of the dialogue components may require a driver input, for example to acknowledge a reminder or a recommendation. Other components, may not require a driver input, for example it may not be necessary to acknowledge receipt of feedback.
A priority rating is defined for each of the dialogue components 7. The priority rating is determined in dependence on how quickly the driver must react to the information (the urgency); and how relevant the information is to a particular situation (the importance). A chart representing the relationship between urgency and importance of the information to be conveyed to the driver is illustrated in Figure 3A. The priority rating is not necessarily the order in which the dialogue components 7 are presented. The warning dialogue components 7-1 have the highest priority and the feedback dialogue components 7-4 have the lowest priority rating. With reference to Figure 3B, the warning dialogue component 7-1 is given a priority rating of one (1 ); the reminder dialogue component 7-2 is given a priority rating of two (2); the recommendation dialogue component 7-3 is given a priority rating of three (3); and the feedback dialogue component 7-4 is given a priority rating of four (4).
The communication controller 2 is connected to a workload monitor 8 comprising a second electronic processor 9 configured to execute a set of computational instructions stored on a non-transitory computer readable media. In the present embodiment, the computational instructions are stored in a second system memory 10 connected to the second electronic processor 9. The second system memory 10 may, for example, comprise a memory device. The second electronic processor 9 is configured to monitor driver workload. The second electronic processor 9 reads the one or more data signal S-n published to the communication network 6 by the vehicle systems 5-n. The second electronic processor 9 is configured to categorise driver workload in dependence on said data signals S-n. The second electronic processor 9 may determine the driver workload in dependence on one or more dynamic vehicle parameters, such as vehicle speed and/or steering angle and/or brake pressure. One or more bands may be defined for each of said dynamic vehicle parameters and a workload value (for example an integer score) defined for each band. At any given time, the workload values may be determined for the current dynamic vehicle parameters and the total used to provide an indication of the driver workload. The second electronic processor 9 may categorise driver workload, for example as high, medium, or low. The total of the workload values based on current vehicle dynamic parameters may be compared to one or more workload thresholds. For example, an upper workload threshold may be defined to categorise a high driver workload; and a lower workload threshold may be defined to categorise a low driver workload. The second electronic processor 9 is configured to output a driver workload signal SWL to the communication controller 2. The driver workload signal SWL may comprise the total of the workload values based on current vehicle dynamic parameters and/or a categorisation determined in dependence on said workload values. In a variant, the second electronic processor 9 may analyse image data from a driver-facing camera (not shown) to determine the driver workload. Alternatively, or in addition, the second electronic processor 9 may analyse audio data to determine the driver workload, for example to identify when the driver is talking to a passenger in the vehicle. It will be understood that other factors may also be used to determine driver workload. By way of example, the workload monitor 8 may consider external factors, such as the local traffic and/or the time of day; and/or environmental factors, such as local weather conditions. The workload monitor 8 may also identify when the driver is making a telephone call.
The communication controller 2 is configured to control output of the dialogue components 7 in dependence on the determined driver workload. In particular, the communication controller 2 is configured to receive the driver workload signal SWL from the workload monitor 8 and to pause output of a dialogue component 7 when an increase in the driver workload is detected. In the present embodiment, the first electronic processor 4 is configured to pause output of the dialogue component(s) 7 when the driver workload signal SWL indicates that the sum of the workload values is greater than the upper workload threshold defining a high driver workload. The pause in output of the dialogue component(s) 7 may comprise postponing or delaying output of one or more of said dialogue components 7 that have been scheduled for output. In certain cases, it may be appropriate to interrupt output of a dialogue component 7, for example in dependence on detection of a spike in the driver workload.
The communication controller 2 is operative to resume output of the dialogue component(s) 7 when the workload monitor 8 identifies a decrease in the driver workload. For example, the communication controller 2 may resume output of the dialogue component(s) 7 when the driver workload signal SWL indicates that the sum of the workload values is less than the lower workload threshold defining a low driver workload. The first electronic processor 4 is configured to perform a validity test to determine the validity of the dialogue component 7 prior to resuming output. In particular, when the determined driver workload decreases, for example below the lower workload threshold, the electronic processor 4 is configured to reevaluate the data signals S-n received from the vehicle systems 5-n and to perform a check that the paused dialogue component 7 remains valid. If the paused dialogue component 7 is no longer valid, for example due to a change in the monitored parameters, the communication controller 2 will cancel output of that dialogue component 7 rather than resume output. If the paused dialogue component 7 is still valid, the communication controller 2 will resume output of that dialogue component 7
As outlined above, a priority rating is defined for each of the dialogue components 7. The communication controller 2 may be configured to define a plurality of workload thresholds for determining when to pause output of a dialogue component 7. For example, a different workload threshold may be defined for each of the priority ratings of the dialogue component 7. A low driver workload threshold may be applied to prompt a pause in output of a dialogue component 7 having a low priority rating, such as a recommendation dialogue component 7- 3 or a feedback dialogue component 7-4. Conversely, a high driver workload threshold may be applied to prompt a pause in output of a dialogue component 7 having a high priority rating, such as a warning dialogue component 7-1 or a reminder dialogue component 7-2.
A flow chart 100 is shown in Figure 4 to illustrate the operating states of the communication controller 2. The communication controller 2 switches between an idle state ST1 ; an initiate communication state ST2; a communicating information state ST3; and a finish dialogue state ST4. The communication controller 2 defaults to the idle state ST1 when activated. The operating state of the communication controller 2 may be indicated to the driver. In the present embodiment, an icon (not shown) may provide a visual indication of the operating state of the communication controller 2. When in said idle state ST1 , the first electronic processor 3 is configured to read the data signals S-n published to the communication network 5 and to identify information to be communicated to the vehicle driver. The first electronic processor 3 may identify information to be output to the vehicle driver based on predefined criteria. The first electronic processor 3 may monitor the data signals S-n published to the communication network 5 to determine operating conditions of that vehicle system 5-n outside predefined operating parameters, for example above an upper threshold and/or below a lower threshold. Upon identification of information to be communicated to the vehicle driver, the operating status of the communication controller 2 changes to the initiate communication state ST2. The first electronic processor 3 identifies one or more dialogue component 7 for output in dependence on the data signals S-n. The first electronic processor 3 then schedules output of said one or more selected dialogue component 7. The scheduling may, for example, depend on the criticality of the information to be conveyed to the vehicle driver, as determined by the priority ratings defined for each of the dialogue components 7. The dialogue components 7 having a higher priority rating will be identified for output sooner than information having a lower priority rating. The communication controller 2 then changes to the initiate communication state ST2 and the first electronic processor 3 is configured to generate an advance notification signal ANS which provides a signal to the driver that the communication controller 2 is preparing to initiate a new dialogue.
The operating status of the communication controller 2 is held in the initiate communication state ST2 for a predetermined time period following output of the advance notification signal ANS. The predetermined time period can be calibrated, but a time period of between five (5) and eleven (1 1 ) seconds inclusive is envisaged. Other time periods are useful. The delay provides the driver an opportunity to delay output of the dialogue component 7, for example if they do not wish to receive new information due to current workload. During the predetermined time period, the first electronic processor 3 checks for a user input signal SIN and output of the dialogue component 7 may be controlled in dependence on any such user input signal. The user input signal SIN may be generated when the vehicle driver actuates an input device 13, such as a button, a switch, a capacitive sensor, or other suitable input means. The input device 13 may be disposed on a steering wheel, in a centre console, or a control panel. The user input signal SIN may, for example, comprise a cancellation request to cancel output of the dialogue component 7; and/or a postpone request to delay or postpone output of the dialogue component 7. Alternatively, or in addition, the user input signal may comprise an expedite request to reduce or remove any time period in output of the dialogue component 7.
When the predetermined time period expires, the communication controller 2 changes to the communicating information state ST3. In the communicating information state, the first electronic processor 3 is configured to output the dialogue component 7 and any subsequent dialogue components 7. The dialogue components 7 may comprise a visual output which is output to the display screen 14; and/or an audio output which is output over the audio entertainment system 15. While the communication controller 2 is in said communicating information state ST3, the first electronic processor 3 may output additional dialogue components 7, for example to provide additional information or to provide updated information. The first electronic processor 3 may select and output additional dialogue components 7 in dependence on the user input signal SIN. The first electronic processor 3 may traverse a dialogue tree comprising multiple dialogue components in dependence on one or more user input signals SIN.
The communication controller 2 uses the driver workload signal SWL from the driver monitor 8 to determine the driver workload. The communication controller 2 monitors the driver workload signal SWL to detect changes in the driver workload. If the first electronic processor 3 identifies an increase in the driver workload, for example an increase in the driver workload above a predefined upper workload threshold, output of the dialogue component 7 is paused. The pause may be implemented before the dialogue component 7 is output, thereby delaying or postponing output of the dialogue component 7. Alternatively, the pause may be implemented during output of the dialogue component 7, thereby interrupting the dialogue component 7. The communication controller 2 continues to monitor the workload signal SWL to detect a decrease in the driver workload. When the driver workload decreases, for example below a lower workload threshold, the communication controller 2 performs a validity test to determine whether the paused dialogue component 7 is valid. If the communication controller 2 determines that the dialogue component 7 is still valid, output of the dialogue component 7 is resumed. If the validity test determines that the dialogue component 7 is no longer valid, the first electronic processor 3 is configured to inhibit output of the dialogue component 7. The communication controller 2 remains in the information communicating state ST3 while communication with the driver is ongoing, including output of the dialogue components 7 and, if appropriate, waiting for a driver response. Once the driver has made a final decision, the communication controller 2 confirms this to the driver. The first electronic processor 3 may be configured to determine that the current dialogue is finished when one or more of the following conditions is identified: a time-out condition, for example after a predetermined time period has elapsed; a user request provided in a user input signal SIN; no further dialogue components 7 for output, for example upon completion of a traversal of a dialogue tree; and determination that the information relating to said one or more vehicle systems 5-n is no longer relevant, for example a speed limit warning may be removed when the vehicle speed decreases below the speed limit. The first electronic processor 3 determines that the current dialogue is complete and the communication controller 2 switches to the finish dialogue state ST4. The first electronic processor 3 may optionally output a conclusion notification signal CNS.
It will be understood that various modifications may be made to the embodiment(s) described herein without departing from the scope of the appended claims. The communication controller 2 described herein resumes output of the dialogue component 7 when the determined driver workload decreases provided the paused dialogue component is still valid. In a variant, output of the dialogue component may be paused for a predetermined time period. Upon expiry of the predetermined time period, the communication controller 2 may determine the driver workload and also perform a validity test to determine whether the paused dialogue component is valid. If the driver workload remains above the driver workload threshold and the paused dialogue component is still valid, the communication controller 2 may pause output of a dialogue component for another predetermined period of time. If the driver workload is below the driver workload threshold and the paused dialogue component is still valid, the communication controller 2 will resume output of the dialogue component for another predetermined period of time. If the paused dialogue component is invalid, the communication controller 2 will cancel output of the dialogue component.
Furthermore, the communication controller 2 and the workload monitor 8 have been described herein as being implemented by first and second electronic processor 3, 9 respectively. It will be understood that the communication controller 2 and the workload monitor 8 could be combined into a single module which may be implemented by the same electronic processor.

Claims

CLAIMS:
A communication controller for controlling a vehicle dialogue including at least one dialogue component, the communication controller comprising:
at least one processor configured to control output of said at least one dialogue component; and
a memory connected to the at least one processor;
the at least one processor being configured to:
identify a dialogue component to be output; and
determine a driver workload;
wherein the at least one processor is configured to control output of said dialogue component in dependence on the determined driver workload.
A communication controller as claimed in claim 1 , wherein: the processor is a control unit; and comprising an output means, the output means comprising an electrical output for outputting electronic data representing dialogue to be output to the one or more occupants of the vehicle.
A communication controller as claimed in claim 1 or claim 2, wherein the at least one processor is configured to pause output of said dialogue component when the determined driver workload is greater than or equal to an upper workload threshold.
4. A communication controller as claimed in claim 3, wherein the upper workload threshold is determined in dependence on a priority rating of the identified dialogue component.
5. A communication controller as claimed in claim 3 or claim 4, wherein the at least one processor is configured to resume output of the paused dialogue component when the determined driver workload is less than or equal to a lower workload threshold.
6. A communication controller as claimed in claim 5, wherein the at least one processor is configured to update the dialogue component prior to resuming output thereof.
7. A communication controller as claimed in claim 5 or claim 6, wherein the at least one processor is configured to perform a validity test to determine the validity of the paused dialogue component prior to resuming output of the paused dialogue component.
8. A communication controller as claimed in claim 7, wherein the at least one processor is configured to cancel output of the paused dialogue component if the validity test determines that the paused dialogue component is invalid.
9. A communication controller as claimed in claim 7 or claim 8, wherein the at least one processor is configured to resume output of the paused dialogue component if the validity test determines that the paused dialogue component is valid.
10. A communication system comprising a communication controller as claimed in any one of the preceding claims. 1 1 . A vehicle comprising a communication controller as claimed in any one of claims 1 to 9.
12. A method of controlling a vehicle dialogue including at least one dialogue component, the method comprising:
identifying a dialogue component to be output; and
determining a driver workload;
wherein output of said dialogue component is controlled in dependence on the determined driver workload. 13. A method as claimed in claim 12, wherein output of said dialogue component is paused when the determined driver workload is greater than or equal to an upper workload threshold.
14. A method as claimed in claim 13, wherein the upper workload threshold is determined in dependence on a priority rating of the identified dialogue component.
15. A method as claimed in claim 13 or claim 14 comprising resuming output of the paused dialogue component when the determined driver workload is less than or equal to a lower workload threshold.
16. A method as claimed in claim 15 comprising updating the dialogue component prior to resuming output thereof.
17. A method as claimed in claim 15 or claim 16, comprising testing the validity of the paused dialogue component prior to resuming output of the paused dialogue component.
18. A method as claimed in claim 17 comprising cancelling output of the paused dialogue component if the test determines that the paused dialogue component is invalid.
19. A method as claimed in claims 17 or claim 18 comprising resuming output of the paused dialogue component if the test determines that the paused dialogue component is valid.
20. A set of instructions which, when executed, cause a computational device to implement the method claimed in any one of claims 12 to 19.
21 . A non-transitory computer readable media comprising a set of computational instructions which, when executed, cause a computer to implement the method claimed in any one of claims 12 to 19.
22. A communication controller substantially as herein described with reference to the accompanying figures.
23. A vehicle substantially as herein described with reference to the accompanying figures.
PCT/EP2018/051001 2017-01-17 2018-01-16 Communication control apparatus and method WO2018134198A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GB1700819.4A GB2558671B (en) 2017-01-17 2017-01-17 Communication control apparatus and method
GB1700819.4 2017-01-17

Publications (1)

Publication Number Publication Date
WO2018134198A1 true WO2018134198A1 (en) 2018-07-26

Family

ID=58463381

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2018/051001 WO2018134198A1 (en) 2017-01-17 2018-01-16 Communication control apparatus and method

Country Status (2)

Country Link
GB (1) GB2558671B (en)
WO (1) WO2018134198A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023210171A1 (en) * 2022-04-27 2023-11-02 日産自動車株式会社 Speech interaction device and speech interaction method

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102019217346B4 (en) * 2019-11-11 2023-12-07 Psa Automobiles Sa Method for displaying information on a human-machine interface of a motor vehicle, computer program product, human-machine interface and motor vehicle

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE10007169A1 (en) * 1999-02-19 2000-08-24 Renault Controlling presentation of information to motor vehicle driver involves controlling presentation of messages to driver so entire perception load is held below defined threshold value
US20070182529A1 (en) * 2003-05-16 2007-08-09 Daimlerchrysler Ag Method and apparatus for influencing the load of a driver in a motor vehicle
EP1914106A2 (en) * 2003-06-06 2008-04-23 Volvo Technology Corporation An attention management system and method
WO2015165811A1 (en) * 2014-05-01 2015-11-05 Jaguar Land Rover Limited Communication system and related method

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2492753A (en) * 2011-07-06 2013-01-16 Tomtom Int Bv Reducing driver workload in relation to operation of a portable navigation device
US9251704B2 (en) * 2012-05-29 2016-02-02 GM Global Technology Operations LLC Reducing driver distraction in spoken dialogue

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE10007169A1 (en) * 1999-02-19 2000-08-24 Renault Controlling presentation of information to motor vehicle driver involves controlling presentation of messages to driver so entire perception load is held below defined threshold value
US20070182529A1 (en) * 2003-05-16 2007-08-09 Daimlerchrysler Ag Method and apparatus for influencing the load of a driver in a motor vehicle
EP1914106A2 (en) * 2003-06-06 2008-04-23 Volvo Technology Corporation An attention management system and method
WO2015165811A1 (en) * 2014-05-01 2015-11-05 Jaguar Land Rover Limited Communication system and related method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
AMDITIS A ET AL: "Towards the Automotive HMI of the Future: Overview of the AIDE-Integrated Project Results", IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, IEEE, PISCATAWAY, NJ, USA, vol. 11, no. 3, 1 September 2010 (2010-09-01), pages 567 - 578, XP011312583, ISSN: 1524-9050, DOI: 10.1109/TITS.2010.2048751 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023210171A1 (en) * 2022-04-27 2023-11-02 日産自動車株式会社 Speech interaction device and speech interaction method

Also Published As

Publication number Publication date
GB2558671B (en) 2020-02-19
GB2558671A (en) 2018-07-18
GB201700819D0 (en) 2017-03-01

Similar Documents

Publication Publication Date Title
JP4286876B2 (en) Image display control device
US6892116B2 (en) Vehicle information and interaction management
US10259464B2 (en) Control for an electronic multi-function apparatus
US8301317B2 (en) Driver information device
US20180319408A1 (en) Method for operating a vehicle
US20190283764A1 (en) Vehicle driver state determination apparatus
WO2013029258A1 (en) System and method for managing incoming messages in a vehicle
CN108146438A (en) For enhancing driver attention's module of driving assistance system
WO2018134198A1 (en) Communication control apparatus and method
CN110861654A (en) Reminding method, reminding device, vehicle, equipment and storage medium
JP2018163613A (en) Electronic apparatus, program update method and computer program
JP2016177423A (en) Control system having multi-core microcontroller and control method thereof
WO2021024589A1 (en) Mobility control system, method, and program
US20200234224A1 (en) Information processing device, information processing method, and storage medium
CN115471983B (en) Alarm processing method, device, electronic equipment, vehicle and storage medium
WO2018134196A1 (en) Communication control apparatus and method
CN110435663B (en) Automobile gear reminding method, system and device and automobile
US10446018B1 (en) Controlled display of warning information
JP2021017109A (en) Remote driving system
US20230221964A1 (en) Display control device for vehicle, vehicle display device, vehicle, method and non-transitory storage medium
EP3606018A1 (en) Mobile body device, terminal device, information processing system, information processing method, mobile body device program, and terminal device program
US20180020183A1 (en) Electronic control unit and method for reproducing audio and/or video or holographic data
JP7456360B2 (en) information processing equipment
JP6354413B2 (en) Vehicle abnormality notification device
CN113830087B (en) Adaptive cruise control method, system, vehicle, and computer-readable storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18702133

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18702133

Country of ref document: EP

Kind code of ref document: A1