GB2583960A - Method and system using mapped emotions - Google Patents

Method and system using mapped emotions Download PDF

Info

Publication number
GB2583960A
GB2583960A GB1906900.4A GB201906900A GB2583960A GB 2583960 A GB2583960 A GB 2583960A GB 201906900 A GB201906900 A GB 201906900A GB 2583960 A GB2583960 A GB 2583960A
Authority
GB
United Kingdom
Prior art keywords
emotional
vehicle
geographical area
traffic network
processor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
GB1906900.4A
Other versions
GB201906900D0 (en
Inventor
Saradindubasu Saptarshi
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Continental Automotive GmbH
Original Assignee
Continental Automotive GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Continental Automotive GmbH filed Critical Continental Automotive GmbH
Priority to GB1906900.4A priority Critical patent/GB2583960A/en
Publication of GB201906900D0 publication Critical patent/GB201906900D0/en
Publication of GB2583960A publication Critical patent/GB2583960A/en
Withdrawn legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34Route searching; Route guidance
    • G01C21/3453Special cost functions, i.e. other than distance or default speed limit of road segments
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34Route searching; Route guidance
    • G01C21/3453Special cost functions, i.e. other than distance or default speed limit of road segments
    • G01C21/3461Preferred or disfavoured areas, e.g. dangerous zones, toll or emission zones, intersections, manoeuvre types, segments such as motorways, toll roads, ferries
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/38Electronic maps specially adapted for navigation; Updating thereof
    • G01C21/3804Creation or updating of map data
    • G01C21/3833Creation or updating of map data characterised by the source of data
    • G01C21/3841Data obtained from two or more sources, e.g. probe vehicles
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/59Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/597Recognising the driver's state or behaviour, e.g. attention or drowsiness
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/01Detecting movement of traffic to be counted or controlled
    • G08G1/0104Measuring and analyzing of parameters relative to traffic conditions
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/01Detecting movement of traffic to be counted or controlled
    • G08G1/0104Measuring and analyzing of parameters relative to traffic conditions
    • G08G1/0108Measuring and analyzing of parameters relative to traffic conditions based on the source of data
    • G08G1/0112Measuring and analyzing of parameters relative to traffic conditions based on the source of data from the vehicle, e.g. floating car data [FCD]
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/01Detecting movement of traffic to be counted or controlled
    • G08G1/0104Measuring and analyzing of parameters relative to traffic conditions
    • G08G1/0137Measuring and analyzing of parameters relative to traffic conditions for specific applications
    • G08G1/0141Measuring and analyzing of parameters relative to traffic conditions for specific applications for traffic information dissemination
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/09Arrangements for giving variable traffic instructions
    • G08G1/0962Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
    • G08G1/0967Systems involving transmission of highway information, e.g. weather, speed limits
    • G08G1/096708Systems involving transmission of highway information, e.g. weather, speed limits where the received information might be used to generate an automatic action on the vehicle control
    • G08G1/096725Systems involving transmission of highway information, e.g. weather, speed limits where the received information might be used to generate an automatic action on the vehicle control where the received information generates an automatic action on the vehicle control
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/09Arrangements for giving variable traffic instructions
    • G08G1/0962Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
    • G08G1/0967Systems involving transmission of highway information, e.g. weather, speed limits
    • G08G1/096733Systems involving transmission of highway information, e.g. weather, speed limits where a selection of the information might take place
    • G08G1/09675Systems involving transmission of highway information, e.g. weather, speed limits where a selection of the information might take place where a selection from the received information takes place in the vehicle
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/09Arrangements for giving variable traffic instructions
    • G08G1/0962Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
    • G08G1/0967Systems involving transmission of highway information, e.g. weather, speed limits
    • G08G1/096766Systems involving transmission of highway information, e.g. weather, speed limits where the system is characterised by the origin of the information transmission
    • G08G1/096791Systems involving transmission of highway information, e.g. weather, speed limits where the system is characterised by the origin of the information transmission where the origin of the information is another vehicle

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Remote Sensing (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Atmospheric Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Automation & Control Theory (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Traffic Control Systems (AREA)
  • Navigation (AREA)

Abstract

This system collects data relating to an emotional state of individuals associated with a traffic network, wherein the data comprises location of the individuals and time of the emotional state. An emotional value based on the data of each individual is determined, and a digital map layer 100 of the traffic network is generated having a representation of the emotional values displayed thereon. If the emotional value of a geographical area of the traffic network goes beyond a threshold value a message is sent to a vehicle in or going towards the geographical area of the traffic network to cause the at least one vehicle to lower the emotional value of the geographical area. The lowering of the emotional value of the area may be achieved by navigating away from the area (avoiding the area) or by increasing the comfort level of the operator. The comfort level may be improved by adjusting the temperature, playing soothing music or releasing a fragrance.

Description

Method and System Using Mapped Emotions
Field of Invention
[001] This invention generally relates to providing a map having an indication of individuals' emotional states displayed thereon. Particularly, the invention relates to a method and system that uses the map to reduce the possibility of traffic congestion and/or disperse the congestion.
Background of Invention
[2] In the current digital age, information is increasingly made available to the public. For example, many modern motor vehicles are currently able to receive real-time traffic information. While such information can possibly reduce accidents, an increase in information may cause distraction. With an increase in safety standards for vehicle systems, it may be more likely in the near future that accidents occur due to human error such as distractions, rather than because of vehicle failure. Furthermore, certain information that can be useful in supplementing decision making in traffic scenarios may have been untapped or may not have been tapped to its full potential. Consequently, the use of such information to ease the burden of decision making in traffic scenarios may have been untapped or may not have been tapped to its full potential.
[3] Therefore, there is a need to provide further or alternative intelligence to supplement decisions made on the road.
Summary
[004] It is therefore an object to provide intelligence on the mental or emotional state of humans in a traffic network, e.g. vehicle operators or pedestrians, so that the community is better equipped to avoid or at least reduce the occurrence of accidents.
[5] To accomplish this and other objects, there is provided, in a first aspect, a method comprising: collecting data relating to an emotional state of individuals associated with a traffic network, wherein the data comprises location of the individuals and time of the emotional state; determining an emotional value based on the data of each individual; generating, by a server remote from the traffic network, a digital map layer of the traffic network, wherein the digital map layer comprises a representation of the emotional values displayed thereon; if the emotional value of a geographical area of the traffic network goes beyond a threshold value, transmitting a message to at least one vehicle in or going towards the geographical area of the traffic network to cause the at least one vehicle to lower the emotional value of the geographical area.
[6] In another aspect, there is provided a navigation system for a vehicle, the system comprising: a processor; at least one non-transitory computer readable storage medium coupled to the processor and storing a plurality of instructions which, when executed by the processor, cause the processor to: receive a digital map and digital map layer of a traffic network, wherein the digital map layer comprises a representation of emotional values displayed thereon, wherein the emotional values are based on data relating to an emotional state of individuals associated with the traffic network, the data comprising location of the individuals and time of the emotional state; receive location of the vehicle; if the vehicle is in or going towards a geographical area of the traffic network having an emotional value beyond an emotional value, instruct the vehicle to lower the emotional value of the geographical area.
[7] Advantageously, the disclosed map layer aids in identifying geographical areas with particularly high emotional values, thereby providing insight as to possible congested areas and/or possible accident zones. The emotional state of the individuals 5 may be identified by various means such as sensors. Historical data that may be useful to predict an individual's emotional state, such as a driver's driving pattern, may advantageously be collected or aggregated to supplement the identification of the individual's emotional state.
Brief Description of Drawings
[8] Fig. 1 illustrates a digital map 100 having a map layer displaying emotional values at tile 104 according to an embodiment disclosed herein. The emotional values are represented by varying shades of colour superimposed onto the roads or road segments.
[9] Fig. 2 illustrates digital map 100 having two map layers 20 at tile 104. One map layer displays emotional values and another map layer displays traffic alerts.
[10] Fig. 3 illustrates a digital map 100 having a map layer displaying emotional values at tile 104 according to another embodiment disclosed herein. The emotional values are represented by location pins of individuals with their emotional values represented in varying shades.
Detailed Description
[11] There is provided a method comprising collecting data relating to an emotional state of individuals associated with a traffic network. The data comprises location of the individuals and time of the emotional state. The method comprises determining an emotional value based on the data of each individual; and generating, by a server remote from the traffic network, a digital map layer of the traffic network, wherein the digital map layer comprises a representation of the emotional values displayed 5 thereon. If the emotional value of a geographical area of the traffic network goes beyond a threshold value, the method comprises transmitting a message to at least one vehicle in or going towards the geographical area of the traffic network to cause the at least one vehicle to lower the emotional value of 10 the geographical area.
[012] Individuals associated with the traffic network or participants of the traffic network include occupants of the vehicles in the traffic network, such as drivers, operators, riders or passengers of vehicles on roads, highways, driveways or other paths that can be driven on or mapped out. The individuals or participants also include pedestrians in the traffic network or other individuals along the roads, highways, driveways or paths of the traffic network. The traffic network may be divided into segments, e.g. road segments. The geographical area going beyond a threshold value, referred to herein simply as a highly emotional geographical area, may comprise one or more road segments.
[013] Traffic congestions in an area or segment of the traffic network may cause participants of the traffic network to develop negative emotions. On the other hand, participants with negative emotions may cause accidents or conflicts between vehicles, thereby increasing the possibility of congestion. In any scenario, identifying geographical areas with particularly high emotional values may provide insight as to possible congested areas. Disseminating such information to participants and/or vehicles may aid in reducing the possibility of congestion or even dispersing the congestion. Thus, the disclosed method advantageously effects the reduction of the possibility of congestion and/or dispersion of the congestion by triggering the vehicles in these areas or the vehicles going towards these areas to act on lowering the emotional values of the areas. The message transmitted advantageously initiates technical actions to implement the lowering of the emotional value of the highly emotional area. The message transmitted may automatically trigger the vehicles in or going towards a highly emotional area to act on lowering the emotional value of the area or automatically initiate technical actions to implement the lowering of the emotional value of the highly emotional area. Further advantageously, the disclosed method may contribute to smart city initiatives, whereby information is communicated at a city-, town-, or even country-level, to increase efficiency.
[014] The method may be performed by a computing system such as a server remote from the traffic network, and/or a processor of an onboard computer or in-vehicle navigation system, or a processor of a user device such as a smart phone or a wearable.
In some implementations, the step of collecting data may be performed by the remote server. The remote server may be programmed to collect or retrieve data directly from individuals, or from other servers or sources of data, e.g. heart rate data collected from vehicles of a certain manufacturer may be retrieved from that manufacturer's database or server. The step of determining an emotional value based on the data of each individual maybe performed by the remote server; or the processor of the onboard computer, navigation system or user device; or shared between the remote server and the processor of the onboard computer, navigation system or user device. The step of generating a digital map layer may be performed by the remote server; or the processor of the onboard computer, navigation system or user device; or shared between the remote server and the processor of the onboard computer, navigation system or user device. InSol-reimplementations, the step of generating a digital map layer maybe performed by the remote server. The comparison of the emotional value of a geographical area against a predetermined threshold value may be performed by the same 5 computing system as the generating step for efficiency. Where the comparison is performed by the remote server, the remote server may perform the message transmission step, or the remote server may transmit the comparison result to the vehicle or user device which subsequently transmits the message to actuator(s) of the 10 vehicle or user device to effect lowering of the emotional value of the area.
[15] The message may be transmitted to vehicles, vehicle occupants and/or other participants of a highly emotional area to automatically trigger or cause lowering of the emotional value of the area. The transmitted message maybe a signal or data packet or the like that is suitable for any communication protocol. The transmitted message may have the requisite header or other information necessary to implement or trigger or cause the vehicle to lower the emotional value of the geographical area.
[16] The message transmitted may cause warnings to be provided to inform participants or vehicles of such areas, to thereby mitigate the crossing of the threshold value. Each participant or vehicle may receive an alert on an HMI interface advising them to divert away from the area or avoid the area. The alert maybe displayed on a display of a participant's user device. The alert maybe displayed on a display of the vehicle or on a display linked with the vehicle, e.g. a display of a user device wirelessly connected to a navigation system of the vehicle. In a specific implementation for the at least one vehicle in the highly emotional area, the message transmitted to each vehicle causes an alert to be displayed on a display of each vehicle in the area to divert away from the area. In another specific implementation for the at least one vehicle going towards the highly emotional area, the message transmitted to each vehicle causes an alert to be displayed on a display of each vehicle going towards the area to avoid the area. The alert may be a visual warning and/or an audible warning.
[017] In another example, navigation may be commenced or adjusted to guide participants or vehicles associated with a highly emotional area away from the area. In some implementations, participants may have activated a route generation option on a navigation system of the vehicle or user device to a destination location from a starting location, such as a current location or other selected location. In some implementations, the navigation system may automatically suggest or generate a route to a destination location based on the participant's preferences such as frequented destinations. In a specific implementation, the method may comprise generating a route for a vehicle from a starting location to a destination location. The traffic network maybe divided into segments and the route may comprise segments from the starting location to the destination locaTion. The process of generating the route between the starting and destination locations may consider the cost of routing through highly emotional areas, thereby generating routes that avoid or divert away from such areas or suggesting alternative routes that avoid or divert away from such areas for selection by the individual. Therefore, when a generated route comprises a geographical area having an emotional value going beyond the threshold value, the method may comprise: generating an alternative route to avoid or divert away from the geographical area. Several alternative routes may be generated for the user to select, taking into account emotional cost, time cost, distance cost, or other considerations. At least one of the alternative routes may include a route that minimizes the emotional cost. Other ways of generating route options are possible.
[18] Although a user may have selected a route based on a 5 criterion, the user may wish to receive alternative route options midway through traveling along the selected route. Accordingly, the method may comprise continuously updating the selected route by providing alternative routes or road segments to e.g. minimize time, distance or NOx exposure, as the vehicle travels along the 10 selected route. In such example, the starting location will be the current location of the vehicle, which may be updated periodically.
[19] Therefore, the vehicles in or going towards the highly 15 emotional area may be persuaded to alter or modify their driving route, thereby lowering the emotional value associated with the route.
[20] In the case of fully autonomous or semi-autonomous vehicles, upon receipt of the alternative route that avoids or diverts away from the highly emotional geographical area, such vehicles may autonomously travel along the alternative route. Thus, in a specific implementation, the message transmitted may cause at least one actuator of the vehicle to autonomously travel along the alternative route. Advantageously, the participants that avoided the highly emotional area may not have their emotional state affected by the highly emotional area, and therefore may not increase their emotional value or contribute to an increase in the emotional value of the area they are in.
Participants that are in the highly emotional area and are guided or diverted away from it may therefore not increase or contribute to the emotional value of the highly emotional area.
[021] In yet another example, the emotional state or body reactions of the participants, vehicle occupants, vehicle operators, or other individuals associated with a highly emotional area may be controlled or regulated to thereby lower the emotional value of the area. Regulating the emotions of a highly emotional individual may involve calming or settling his or her emotions or increasing the comfort level of the individual. Depending on the individual or the habits or preferences of the individual, soothing music or other calming means, e.g. meditation or breathing programs, maybe triggered or caused to be played in the vehicle or on a user device. In a specific implementation for the at least one vehicle in or going towards the highly emotional area, the message transmitted to each vehicle causes at least one of the following: temperature of a climate control system of the vehicle to be decreased; soothing music from an infotainment system of the vehicle to be played; or fragrance from an air freshener system of the vehicle to be released.
[022] A suitable remote server may comprise one or a plurality of servers in one or a plurality of locations to store and/or process the data collected. The remote server may be a central repository of the collected data and/or other data that may provide insight as to possible congested areas. The remote server may collect data directly from the data sources, e.g. heart rate data collected from heart rate sensors integrated into vehicles or user devices, or indirectly, e.g. heart rate data collected from a vehicle manufacturer's database or server. The remote server may be administered by a government body, e.g. a transportation authority or a home affairs ministry. The remote server may be administered by a private entity. In an example, the remote server may be administered by a vehicle manufacturer to generate and/or transmit such map, map layer or geographical information to its manufactured vehicles. In another example, the remote server maybe administered by an information aggregator, a service or data analytics provider, or a map provider. The server may comprise a valuable source of information, e.g. the location of individuals, their emotional data and cost, e.g. emotional cost, of road segments. If permitted, the information in the database may be provided to interested third parties or used to train data sets or systems, e.g. the drive actuator systems of autonomous vehicles. Parties that may be interested in such information may be for example a driving school to determine a suitable driving route for learner drivers. Another interested party may be insurance companies to determine a premium of an insurance policy of a road user. Yet another interested party may be a government body, e.g. a traffic authority or urban planning authority.
[023] The data collected may further include information that may affect the emotional state of individuals or participants associated with the traffic network. For example, the data may include traffic density of the traffic network as an increased number of vehicles on the road may cause stress or anxiety to the participants. The data may include the condition of vehicles and/or condition of the roads associated with the traffic network, for example an increased percentage of broken-down vehicles on the road or an increased percentage of potholes on the road, which may cause stress or anxiety to the participants.
The data may include weather, as adverse weather conditions like heavy rain or snowfall may result in heightened emotional states. The data may include historical habits or patterns of the individual, such as a driver's driving pattern, that can be used to predict his or her emotional state. The data may include the health or historical health data of the individual, such as heart rate and blood pressure, that may be collected from various means in an existing user device or vehicle or may be included as an aftermarket means to detect or measure health of an individual.
[24] The emotional state of an individual refers to a manifestation of the emotions of the individual, such as anxiety, fear, happiness, joy, surprise, anger, calmness, and tiredness.
Emotion may be manifested or expressed in many ways, for example by physical traits and/or physiological measurements. In an example, anxiety may be expressed by a frowning expression, an increased heart rate, an increased grip pressure and tense muscles. Examples of the manifestation of emotions generally include, but are not limited to, facial expression, eye movement, gaze direction, body movement, gestures, pressure of grip, heartbeat rate, dermal conductivity, sweat gland activity, hormones, scent, muscle tone, voice tone, and interaction between occupants.
[25] The emotional state may be detected or measured by various means, meters and/or sensors. Such means may be present in an existing user device or vehicle or may be included as an aftermarket means to detect or measure an emotional state. Such means may be the same as or different as or additional to those for detecting or measuring the health of the individual. For example, interior cameras or cameras focussing on the cabin of the vehicle or the vehicle operator may be used to detect physical traits of the occupants or operator of the vehicle, such as facial expression, eye movement, gaze direction, body movement, gestures, and interaction between occupants. Cameras of user devices may also be used to detect physical traits of individuals. Such cameras may include optical cameras, infrared or near infrared cameras or video cameras. Pressure sensors, e.g. on the steering wheel, levers or gear shift, maybe used to detect grip pressure. Electrodermal activity meters, electrocardiographs or similar sensors located at positions that can directly contact occupants, e.g. steering wheel, levers, gear shift, seats, headrest, etc, may be used to detect dermal conductivity, sweat gland activity, and rate and rhythm of heartbeats. Electromyographs or similar sensors also located at positions such as steering wheel, levers, gear shift, seats, headrest, etc maybe used to detect muscle tension or tone. Portable assays may 5 be integrated into the vehicle to draw blood or other body fluid for measurement and analysis of protein levels, e.g. hormone levels. Odour detectors or chemo sensors may also be integrated into the vehicle to detect scents or sweat emitted by the occupants, which can be correlated to different emotions. Voice 10 recognition systems may be used to detect voice tone and interaction between occupants.
[026] Data obtained from the detection or measurement of the emotional states of individuals may be reduced to a data point, such as an emotional value. In some implementations, data obtained from the detection or measurement of the emotional states of individuals may be processed to determine an emotional value. There may be a baseline or reference for each source of data. The baseline or reference may be derived from the data obtained from the detection or measurement of the emotional states of individuals. The data may be processed using an operation, e.g. a machine learning algorithm, a mathematical average, median, statistical probability or any other operation, to derive the baseline or reference emotional state of each unique individual. Alternatively, the baseline data may be based on a reference database. For example, an image of a calm expression maybe the baseline for the emotional state detected by a camera. The image captured of an individual may be matched against a reference image database of neutral or calm facial expressions.
If the captured image is determined to be matching to a neutral or calm facial expression, an emotional value for the baseline is assigned, e.g. a value of zero. Similarly, a captured image of a downturned mouth and/or furrowed brows may be compared against similar images in the reference image database and determined to match a negative emotional state, and therefore an emotional value for the negative emotional state is assigned, e.g. a value of positive 100. A positive emotional state maybe classified as a baseline emotional value or a value opposite to that for a negative emotional state, e.g. a value of negative 100. Alternatively, a percentage change or rate of change from the baseline data may be used to determine a deviation, positive or negative, from the baseline. Where there are multiple sources of data detecting or measuring the emotional state, an operation may be used to draw a conclusion on the emotional state, e.g. data fusion, a machine learning algorithm, a mathematical average or any other operation. For example, a calm facial expression may have a heavier weightage than an increase of grip pressure from a grip pressure baseline, and therefore a low emotional value or an emotional value around the emotional baseline is assigned, e.g. a value of zero according to the example above.
[027] Historical patterns associated with the emotional state of an individual or historical data relating to the habits or patterns of the individual may be combined, fused or otherwise aggregated with the detection or measurement data and/or the other data collected to draw a conclusion on the emotional state of the individual. The method may further comprise collecting travel patterns of the individual, such as for example one or more or all of historical travel routes of the vehicle, the associated timings that the travel routes were taken, the traffic density of the historical routes, the weather of the historical routes, the emotional state of the individual during each route, and the individual's historical driving pattern such as braking pressure and/or braking distance, acceleration timing, and tachometer data. The pattern information may be used to train a machine learning algorithm or any other operation to predict the patterns/behaviour of the individual. The baseline for the emotional state may take the individual's historical habits or patterns into consideration.
[028] The data obtained from the detection or measurement of the 5 emotional states of each individual may be transmitted, together with location of the emotional state and time of the emotional state, to the remote server or other data repositories, if permitted by the individual. The data transmitted may be raw data, e.g. blood pressure readings, or processed data, or the emotional 10 value of each individual. The data may be transmitted upon a trigger, for example based on time frequency, e.g. every minute, or based on circumstance or an event, e.g. upon a change in the detected state like an abrupt gesture or movement.
[029] If emotional data is unavailable, e.g. if an individual does not permit the use and/or transmission of his or her data or if detection or measurement techniques are not integrated into the computing device, the method may comprise predicting an emotional state or emotional value of the individual. The methodmayperform the prediction for vehicles in the traffic network that do not have a detected occupant emotional state, e.g. where a location of the vehicle is reported without any accompanying emotional state data. In some implementations, the emotional state maybe predicted based on data obtained from the detection or measurement of the emotional states of other individuals in the location the individual is in, e.g. within a predetermined radius as the individual or in the same road segment the individual is in, or alternatively, the emotional value of the individual may be predicted based on the determined emotional values of other individuals in the location the individual is in. The data or value used for prediction may be aggregated, averaged, or processed by other methods. In some implementations, to circumvent the use of sensitive data, data from a concerned individual may be transmitted but the data maybe anonymized. That is, the method may comprise anonymizing data obtained from the detection or measurement of the emotional states of individuals or anonymizing the determined emotional value. For example, data obtained from the detection or measurement of the emotional state of an individual may be aggregated, averaged, or otherwise processed together with the data obtained from other individuals in the location the individual is in. Such processed data may prevent the ability of tracing data to a specific individual. In some implementations, the emotional state or emotional value of certain individuals may be used to predict emotional states or emotional values of other individuals in the area. The emotional state or emotional value of an area with no emotional data at all maybe predicted based on the emotional states or emotional values of individuals in a similar area or similar situation, e.g. in an accident location. Data relating to traffic alerts or traffic density, e.g. from a traffic density map layer, may be used to determine an accident location and the emotional states or emotional values in or around the accident location may be used to predict or account for unavailable emotional data, thereby enabling the creation of a more complete or comprehensive emotional map layer.
[030] A representation of the emotional values may be displayed on a digital map. In some implementations, a representation of the emotional values is displayed on the digital map layer for ease of updating the emotional state map data. The representation of the emotional value of each individual may directly be displayed on the digital map layer. In some implementations, the emotional value of a geographical area may be determined based on a representation of the emotional values of each individual in the geographical area. For example, the data obtained from the detection or measurement of the emotional states of individuals at similar locations may be aggregated, averaged, or processed by other methods. An emotional value based on the grouped data of the individuals at that location may then be determined. Alternatively, the emotional values of individuals at similar locations may be aggregated, averaged, or processed by other methods. A "similar location" may refer to individuals within a 5 predetermined radius or in a road segment of the traffic network. The grouped emotional value or emotional value based on grouped data maybe displayed on the digital map layer as a representation of the emotional value of that road segment or as a representation of the emotional value of the traffic network within that 10 predetermined radius.
[31] Where a representation of the emotional value of each individual is directly displayed on the digital map layer, the location of the individual may be displayed with a pin or a point on the digital map layer. A representation of the emotional value maybe a value next to or near to the display of the individual's location. Alternatively, the emotional value maybe categorized into ranges, wherein each range is displayed differently, e.g. by colour, shape, etc. For example, an emotional value for a more negative emotional state maybe represented as a different colour to an emotional value of a less negative emotional state. An emotional value of a road segment or radial area may be displayed or represented in a shade of colour different from that of another road segment or radial area if the emotional values differ. An emotional value of a road segment or radial area may be displayed or represented in a shade of colour different from that of another road segment or radial area if the emotional values differ. The location pin may be coloured according to the range of the emotional value. Consequently, the emotional s.Tates of individuals may be graphically provided in real-time.
[32] Representations of the emotional values may be provided as a layer on a digital map. Different map layers display different types of data. For example, one layer may display traffic density, another layer may display emotional values, while yet another layer may display points of interest. Each layer maybe selectable upon user command, and upon selection, may be superimposed onto the digital map of the traffic network. Advantageously, as the 5 disclosed method may provide intelligence in layers, the disclosed method maybe provided to map providers to enhance the functionality of a digital map with information on emotional states of participants of the traffic network. Advantageously, a user may turn off the layer if such intelligence is not required 10 or if a default map is simply required.
[033] Fig. 1 illustrates a digital map 100 formed from tiles as demarcated by the dashed lines. Map 100 has a left tile 102 and a right tile 104. As an illustration, no map layer is selected for left tile 102, but a map layer displaying emotional values is selected for right tile 104. The map layer superimposes colour shades onto the road segments, whereby varying emotional values are represented in varying shades. Roads 112, 114, 116 and 118 are shown on map 100 and are located in a commercial centre. Road 116 is separated into road segment 116a which is before the junction of road 116 and road 112; road segment 116b which is between the junction of road 116 and road 112 and the turn-off to road 114; road segment 116c which is between the turn-off to road 114 and the turn-off to road 118; and road segment 116d which is after the turn-off to road 118. The emotional value for negative emotional states on road 114 is determined to be increasing towards 114b. Therefore, the shading gradient for road 114 ranges from the darkest at 114b to lighter at 114a. Because of the high emotional values indicating negative emotional states on road 114, road segment 116b going towards road 114 is shaded slightly darker than the unaffected road segments 116a, 116c, 116d and 112b. Fig. 2 illustrates two map layers selected for right tile 104, which are the map layer displaying emotional values as shown in Fig. 1, as well as a map layer displaying traffic alerts. It can be seen from Fig. 2 that the cause of the high emotional value at 114b is due to cows hindering the passage of vehicles along road 114. Fig. 3 illustrates another embodiment of that in Fig. 1, whereby the map layer in Fig. 3 displays locations of individuals with their emotional values represented in varying shades.
[34] The threshold value may be determined or revised as necessary. For example, the peripheral area around a highly emotional area may have a tighter threshold than the highly emotional area to discourage or pre-empt individuals from entering into the highly emotional area. A geographical area may be classified as a highly emotional area after crossing a specific threshold value. That is, the threshold value may be a specific emotional value. A geographical area maybe classified as a highly emotional area after crossing a specific rate of change value from a previous or resting emotional value. For example, if an emotional value of an area suddenly changes due to a new accident, the rate of change of the emotional value in such scenario may go beyond the threshold rate-of-change value.
[35] There is also provided a navigation system for a vehicle. The system comprises a processor and at least one non-transitory computer readable storage medium coupled to the processor. The at least one non-transitory computer readable storage medium stores a plurality of instructions which, when executed by the processor, cause the processor to receive a digital map and digital map layer of a traffic network. The digital map layer comprises a representation of emotional values displayed thereon. The emotional values are based on data relating to an emotional state of individuals associated with the traffic network, the data comprising location of the individuals and time of the emotional state. When executed by the processor, the plurality of instructions further causes the processor to receive the location of the vehicle. If the vehicle is in or going towards a geographical area of the traffic network having an emotional value beyond a threshold value, the plurality of instructions further causes the processor to instruct the vehicle to lower the emotional value of the geographical area.
[36] Whereas the disclosed method focusses on actions fully or partially performed by a server remote from the traffic network to impact one or more vehicles, the disclosed navigation system focusses on actions performed by an ego vehicle. Thus, the present disclosure provides technical effects of using data relating to the emotional states of participants by triggering a vehicle or a plurality of vehicles to act on lowering the emotional value of a highly emotional area, thereby reducing the possibility of congestion and/or dispersing the congestion. The disclosure above relating to a navigation system may apply to the disclosed navigation system. The disclosed navigation system may be an in-vehicle navigation unit or a navigation system that is part of an infotainment unit or head unit or may be a navigation system of a user device wirelessly connected to the infotainment unit or head unit.
[37] If the emotional value of a geographical area that the vehicle is in or going towards goes beyond a threshold value, the vehicle may be programmed to execute certain actions automatically to mitigate the crossing of the threshold. The message transmitted to the navigation system from the remote server may trigger the processor of the navigation system to instruct the vehicle. The message may be transmitted from an onboard computer of the vehicle to trigger the processor of the navigation system to instruct the vehicle. The plurality of instructions may further cause the processor to compare the emotional value of the geographical area the vehicle is in or going towards against a predetermined threshold value, and if the vehicle is in a highly emotional area, i.e. the emotional value goes beyond the threshold, the processor is triggered to instruct the vehicle. Alternatively, the plurality of instructions may cause the processor of the navigation system to transmit the location of the vehicle to the remote server, for comparison against the threshold, and if the vehicle is in a highly emotional area, the processor is configured to receive the comparison result and instruct the vehicle.
[038] The vehicle or specifically actuator(s) of the vehicle may be instructed to effect lowering of the emotional value of the highly emotional area. The processor of the navigation system may initiate the actions to implement the lowering of the emotional value of the highly emotional area.
[39] For example, the warnings or alerts disclosed above may be provided to inform the vehicle or occupants in the vehicle of such areas. If the vehicle is in the highly emotional geographical area, the instructions may cause the processor to instruct a display to display an alert to divert the vehicle away from the geographical area. If the vehicle is going towards the highly emotional geographical area, the instructions may cause the processor to instruct the display to display an alert to avoid the geographical area. A suitable display may be one disclosed above.
[40] In another example, the instructions may cause the processor to generate a route from the location of the vehicle to a destination location, or an alternative or diverted route if a route to a destination location has already been generated by the navigation system, so as to avoid or divert away from the geographical area. The route generation may consider the cost of routing through highly emotional areas, as disclosed above, thereby generating a route that avoids or diverts away from such areas or suggesting an alternative route that avoids or diverts away from such areas for selection by the vehicle operator. Where the navigation system is in a fully autonomous or semi-autonomous vehicle, the instructions may cause the processor to instruct at least one actuator of the vehicle to autonomously travel along the alternative or diverted route.
[041] In yet another example, the instructions may cause the processor to control the emotional state of the vehicle operator.
The processor of the navigation system may transmit a message to actuator(s) of the vehicle, e.g. a climate control system or other vehicle systems, to control or regulate the emotional state or body reaction of the vehicle operator and/or other vehicle occupants. As mentioned above, regulating the emotions of the vehicle operator may involve calming or settling his or her emotions or increasing his or her comfort level. Thus, in a specific implementation, the instructions may cause the processor to increase a comfort level of the operator. In some implementations, the instructions may cause the processor to perform at least one of the following: decrease temperature of a climate control system of the vehicle; play soothing music from an infotainment system of the vehicle; or release fragrance from an air freshener system of the vehicle.
[042] The digital map and/or digital map layer may be transmitted to the navigation system from the remote server if the step of generating the map and map layer is performed by the remote server. Alternatively, a relevant part of the digital map and/or digital map layer, e.g. a part where the vehicle frequently travels, may be stored in the non-transitory storage medium or cache memory or other suitable storage media of the navigation system. Thus, the digital map and/or digital map layer may be retrieved from the storage medium of the navigation system. When the location of the vehicle is received, the processor may correlate or plot the received location of the vehicle onto the digital map and/or digital map layer.

Claims (19)

  1. Patent claims 1.A method comprising: collecting data relating to an emotional state of 5 individuals associated with a traffic network, wherein the data comprises location of the individuals and time of the emotional state; determining an emotional value based on the data of each individual; generating, by a server remote from the traffic network, a digital map layer of the traffic network, wherein the digital map layer comprises a representation of the emotional values displayed thereon; if the emotional value of a geographical area of the traffic network goes beyond a threshold value, transmitting a message to at least one vehicle in or going towards the geographical area of the traffic network to cause the at least one vehicle to lower the emotional value of the geographical area.
  2. 2. The method of claim 1, further comprising determining the emotional value of a geographical area based on a representation of the emotional values of each individual in the geographical area.
  3. 3. The method of claim 1 or 2, wherein the message transmitted causes an alert to be displayed on a display of each vehicle in the geographical area to divert away from the geographical area.
  4. 4. The method of any preceding claim, wherein the message 30 transmitted causes an alert to be displayed on a display of each vehicle going towards the geographical area to avoid the geographical area.
  5. 5. The method of any preceding claim, further comprising generating a route for a vehicle in the traffic network from a starting location to a destination location.
  6. 6. The method of claim 5, wherein when the generated route comprises a geographical area having an emotional value going beyond the threshold value, the method comprises: generating an alternative route to avoid or divert away from the geographical area.
  7. 7. The method of claim 6, wherein the message transmitted causes at least one actuator of the vehicle to autonomously travel along the alternative route.
  8. 8. The method of any preceding claim, wherein the message transmittedcausestheemotionalstateofanoperatorofavenicle in or going towards the geographical area to be controlled.
  9. 9. The method of claim 8, wherein the message transmitted 20 causes a comfort level of the operator to be increased.
  10. 10. The method of claim 8 or 9, wherein the message transmitted causes at least one of the following: temperature of a climate control system of the vehicle to be decreased; soothing music from an infotainment system of the vehicle to be played; or fragrance from an air freshener system of the vehicle to be released.
  11. 11. The method of any preceding claim, wherein the data further comprises at least one of: traffic density of the traffic network; weather; condition of vehicles associated with the traffic network; condition of the roads associated with the traffic network; or historical patterns associated with the emotional state of each individual.
  12. 12. A navigation system for a vehicle, the system comprising: a processor; at least one non-transitory computer readable storage medium coupled to the processor and storing a plurality of instructions which, when executed by the processor, cause the processor to: receive a digital map and digital map layer of a traffic network, wherein the digital map layer comprises a representation of emotional values displayed thereon, wherein the emotional values are based on data relating to an emotional state of individuals associated with the traffic network, the data comprising location of the individuals and time of the emotional state; receive location of the vehicle; if the vehicle is in or going towards a geographical area of the traffic network having an emotional value beyond a threshold value, instruct the vehicle to lower the emotional 20 value of the geographical area.
  13. 13. The navigation system of claim 12, wherein if the vehicle is in the geographical area, the instructions cause the processor to instruct a display to display an alert to divert away 25 from the geographical area.
  14. 14. The navigation system of claim 12, wherein if the vehicle is going towards the geographical area, the instructions cause the processor to instruct a display to display an alert to 30 avoid the geographical area.
  15. 15. The navigation system of any one of claims 12-14, wherein the instructions cause the processor to generate a route from the location of the vehicle to a destination location in order to avoid or divert away from the geographical area.
  16. 16. The navigation system of any one of claims 12-15, wherein the instructions cause:he processor to instruct at least one actuator of the vehicle to autonomously travel along the alternative route.
  17. 17. The navigation system of any one of claims 12-16, wherein the instructions cause the processor to control the emotional state of an operator of the vehicle.
  18. 18. The navigation system of claim 17, wherein the instructions cause the processor to increase a comfort level of 15 the operator.
  19. 19. The navigation system of claim 17 or 18, wherein the instructions cause the processor to perform at least one of the following: decrease temperature of a climate control system of the vehicle; play soothing music from an infotainment system of the vehicle; or release fragrance from an air freshener system of the vehicle.
GB1906900.4A 2019-05-16 2019-05-16 Method and system using mapped emotions Withdrawn GB2583960A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
GB1906900.4A GB2583960A (en) 2019-05-16 2019-05-16 Method and system using mapped emotions

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
GB1906900.4A GB2583960A (en) 2019-05-16 2019-05-16 Method and system using mapped emotions

Publications (2)

Publication Number Publication Date
GB201906900D0 GB201906900D0 (en) 2019-07-03
GB2583960A true GB2583960A (en) 2020-11-18

Family

ID=67385161

Family Applications (1)

Application Number Title Priority Date Filing Date
GB1906900.4A Withdrawn GB2583960A (en) 2019-05-16 2019-05-16 Method and system using mapped emotions

Country Status (1)

Country Link
GB (1) GB2583960A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200223450A1 (en) * 2019-01-16 2020-07-16 Toyota Jidosha Kabushiki Kaisha Autonomous driving system

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115357073B (en) * 2022-08-15 2023-03-21 哈尔滨工业大学 Intelligent health environment regulation and control system based on micro-expression and behavior of old people

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007011060A1 (en) * 2005-07-20 2007-01-25 Toyota Jidosha Kabushiki Kaisha Mental condition regulating device
US20120150430A1 (en) * 2010-12-14 2012-06-14 International Business Machines Corporation Human Emotion Metrics for Navigation Plans and Maps
US20170030726A1 (en) * 2015-07-31 2017-02-02 International Business Machines Corporation Selective human emotion metrics for navigation plans and maps
US20170370736A1 (en) * 2015-01-15 2017-12-28 Pcms Holdings, Inc. Systems and methods for providing navigation directions based on emotions and activities
US20180172464A1 (en) * 2016-12-21 2018-06-21 Toyota Jidosha Kabushiki Kaisha In-vehicle device and route information presentation system
US10151594B1 (en) * 2017-01-19 2018-12-11 State Farm Mutual Automobile Insurance Company Technology for generating alternate navigation directions for vehicles
US20190018859A1 (en) * 2017-07-11 2019-01-17 Toyota Jidosha Kabushiki Kaisha Information providing system, information providing method, and non-transitory recording medium

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007011060A1 (en) * 2005-07-20 2007-01-25 Toyota Jidosha Kabushiki Kaisha Mental condition regulating device
US20120150430A1 (en) * 2010-12-14 2012-06-14 International Business Machines Corporation Human Emotion Metrics for Navigation Plans and Maps
US20170370736A1 (en) * 2015-01-15 2017-12-28 Pcms Holdings, Inc. Systems and methods for providing navigation directions based on emotions and activities
US20170030726A1 (en) * 2015-07-31 2017-02-02 International Business Machines Corporation Selective human emotion metrics for navigation plans and maps
US20180172464A1 (en) * 2016-12-21 2018-06-21 Toyota Jidosha Kabushiki Kaisha In-vehicle device and route information presentation system
US10151594B1 (en) * 2017-01-19 2018-12-11 State Farm Mutual Automobile Insurance Company Technology for generating alternate navigation directions for vehicles
US20190018859A1 (en) * 2017-07-11 2019-01-17 Toyota Jidosha Kabushiki Kaisha Information providing system, information providing method, and non-transitory recording medium

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200223450A1 (en) * 2019-01-16 2020-07-16 Toyota Jidosha Kabushiki Kaisha Autonomous driving system
US11628860B2 (en) * 2019-01-16 2023-04-18 Toyota Jidosha Kabushiki Kaisha Autonomous driving system that can eliminate a system distrust state of the driver

Also Published As

Publication number Publication date
GB201906900D0 (en) 2019-07-03

Similar Documents

Publication Publication Date Title
JP7288911B2 (en) Information processing device, mobile device, method, and program
US11993293B2 (en) Information processing apparatus, moving apparatus, and method, and program
Gaspar et al. The effect of partial automation on driver attention: A naturalistic driving study
KR102548697B1 (en) Passenger health screening and monitoring
JP6558732B2 (en) Driving support method, driving support device, driving control device, vehicle, and driving support program using the same
JP7324716B2 (en) Information processing device, mobile device, method, and program
WO2019202881A1 (en) Information processing device, moving device, information processing system and method, and program
JP7431223B2 (en) Information processing device, mobile device, method, and program
US11727451B2 (en) Implementing and optimizing safety interventions
EP4213124A1 (en) Information processing device, information processing method, and information processing program
EP4083960A1 (en) Information processing device, movement device, information processing system, method, and program
GB2583960A (en) Method and system using mapped emotions
US20220050445A1 (en) Method for operating a technical system that moves in an environment, with assignment of steering quality levels
CN117994929A (en) Method for automatically taking action when health risk occurs provided in car
WO2023277012A1 (en) Information processing system and information processing device
US10969240B2 (en) Systems and methods for controlling vehicle systems using experience attributes
Li et al. Development of Situational Awareness Enhancing System for Manual Takeover of AV
JP7462022B1 (en) Information processing device, information processing method, and information processing program
Li et al. Development of Situational Awareness Enhancing System for AV-to-Manual Handover and Other Tasks
Bulygin et al. Methodology for in-the-Wild Driver Monitoring Dataset Formation
Katrakazas et al. i-DREAMS: D3. 2 Toolbox of recommended data collection tools and monitoring methods and a conceptual definition of the Safety Tolerance Zone

Legal Events

Date Code Title Description
WAP Application withdrawn, taken to be withdrawn or refused ** after publication under section 16(1)