CN111783550B - Monitoring and adjusting method and system for emotion of driver - Google Patents
Monitoring and adjusting method and system for emotion of driver Download PDFInfo
- Publication number
- CN111783550B CN111783550B CN202010500507.9A CN202010500507A CN111783550B CN 111783550 B CN111783550 B CN 111783550B CN 202010500507 A CN202010500507 A CN 202010500507A CN 111783550 B CN111783550 B CN 111783550B
- Authority
- CN
- China
- Prior art keywords
- music
- vehicle
- playing
- condition information
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000008451 emotion Effects 0.000 title claims abstract description 98
- 238000000034 method Methods 0.000 title claims abstract description 52
- 238000012544 monitoring process Methods 0.000 title claims abstract description 46
- 238000012545 processing Methods 0.000 claims abstract description 77
- 230000004044 response Effects 0.000 claims description 41
- 230000008921 facial expression Effects 0.000 claims description 18
- 230000001815 facial effect Effects 0.000 claims description 16
- 230000008859 change Effects 0.000 claims description 13
- 210000000056 organ Anatomy 0.000 claims description 4
- 238000004364 calculation method Methods 0.000 claims description 3
- 238000004590 computer program Methods 0.000 description 13
- 230000036651 mood Effects 0.000 description 11
- 238000004891 communication Methods 0.000 description 10
- 238000001514 detection method Methods 0.000 description 10
- 230000002996 emotional effect Effects 0.000 description 7
- 230000033764 rhythmic process Effects 0.000 description 7
- 101150052583 CALM1 gene Proteins 0.000 description 5
- 101150095793 PICALM gene Proteins 0.000 description 5
- 101150014174 calm gene Proteins 0.000 description 5
- 230000006870 function Effects 0.000 description 5
- 206010041349 Somnolence Diseases 0.000 description 4
- 238000004458 analytical method Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 206010039203 Road traffic accident Diseases 0.000 description 3
- 230000004399 eye closure Effects 0.000 description 3
- 206010048909 Boredom Diseases 0.000 description 2
- 206010071299 Slow speech Diseases 0.000 description 2
- 238000013019 agitation Methods 0.000 description 2
- 210000003403 autonomic nervous system Anatomy 0.000 description 2
- 230000006399 behavior Effects 0.000 description 2
- 230000017531 blood circulation Effects 0.000 description 2
- 230000036760 body temperature Effects 0.000 description 2
- 230000000994 depressogenic effect Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 230000006866 deterioration Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000001544 dysphoric effect Effects 0.000 description 2
- 230000014509 gene expression Effects 0.000 description 2
- 238000010801 machine learning Methods 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 238000003909 pattern recognition Methods 0.000 description 2
- 230000004962 physiological condition Effects 0.000 description 2
- 230000036544 posture Effects 0.000 description 2
- 239000000932 sedative agent Substances 0.000 description 2
- 230000001624 sedative effect Effects 0.000 description 2
- 238000012549 training Methods 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000008030 elimination Effects 0.000 description 1
- 238000003379 elimination reaction Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 239000011435 rock Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
- G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
- G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
- G10L25/63—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination for estimating an emotional state
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/90—Pitch determination of speech signals
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/90—Pitch determination of speech signals
- G10L2025/906—Pitch tracking
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Acoustics & Sound (AREA)
- Computational Linguistics (AREA)
- Signal Processing (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Child & Adolescent Psychology (AREA)
- General Health & Medical Sciences (AREA)
- Hospice & Palliative Care (AREA)
- Psychiatry (AREA)
- Traffic Control Systems (AREA)
Abstract
The invention discloses a method and a system for monitoring and adjusting emotion of a driver, wherein the method comprises the following steps: monitoring local information; transmitting the local information to a music processing system, wherein the music processing system is used for processing the received local information so as to judge whether the condition information or road condition information of the vehicle belongs to a first appointed range; when the condition information or road condition information of the vehicle belongs to the first specified range, the music processing system generates an early warning prompt and scene music which are matched with the condition information or road condition information; receiving a play instruction from the music processing system, wherein the play instruction comprises scene music generated by the music processing system; and playing the early warning prompt and the scene music according to the playing instruction. The method has the technical effect of monitoring and adjusting the emotion of the driver to avoid accidents.
Description
Technical Field
The invention relates to the field of vehicles, in particular to a method and a system for monitoring and adjusting emotion of a driver in a vehicle.
Background
To date, many types of private vehicles such as motor vehicles and electric vehicles have been increasingly walked into thousands of households. The private vehicle is convenient to use in a traffic mode between two places, and the distance between people is shortened. In this way, vehicles are becoming an indispensable transportation means.
Behind the convenience, another set of data is hidden. It is counted that traffic accidents caused by speeding are very high in proportion each year, and most of such accidents once occur belong to large traffic accidents. In current vehicle systems, however, both active and passive safety will only initiate an intervening adjustment when a hazard occurs. The time for safe adjustment is rushed due to sudden dangerous and future accidents.
Disclosure of Invention
In order to solve the above-mentioned problems in the background art, the present invention provides a method and a system for monitoring and adjusting driver emotion, which includes a processing system for executing response to local information of a vehicle. In various configurations, local information of the vehicle (e.g., condition information, road condition information of a road, emotion information of a driver, etc.) is analyzed. In some embodiments, the processing system is responsive to musical instructions associated with the local information. The response of the vehicle to the local information may include: such as switching navigation, switching music play, etc.
In a first aspect of the invention, there is provided a method for determining the emotion of a driver of a vehicle and using that emotion to generate a vehicle response, comprising capturing the face of the driver by a camera of the vehicle; the camera is configured to capture facial images of a plurality of drivers over a period of time and analyze the plurality of images to identify facial expressions of the drivers and changes in facial expressions over the period of time. Still further, facial expressions include changes in facial organs, such as frowning, eye closure, and the like.
In some embodiments, the method of determining the emotion of the driver of the vehicle and using the emotion to generate a vehicle response may further comprise capturing, by a microphone of the vehicle, a voice input of the driver. The microphone is configured to capture voice input over a period of time. The voice input is analyzed to identify changes in the voice content and the driver's voice content over a period of time. The method processes, by a processor of the vehicle, one or a combination of facial images and speech content captured over a period of time to predict the emotion of the driver. Based on the emotion monitoring, the method generates a vehicle response responsive to the driver's emotion. The vehicle response may be at least one adjustment made to a setting of the vehicle. The adjustment is selected based on the emotion of the driver. The vehicle response may be used to more sedate the driver and/or reduce distraction.
In some embodiments, the vehicle response may include a reduced vehicle speed, a voice alert, and the like.
In some embodiments, the method further comprises: monitoring emotion information of a user on current playing music; wherein the music list of playing music includes a plurality of music items; when a refreshing operation of refreshing a current playing page by a user is received, sorting music items in the music list according to emotion information of a driver of the vehicle, condition information of the vehicle and road condition information of a road where the vehicle is located; when the information of the N music items of the first N bits is sent to the vehicle-mounted computer, a new music list comprising the N music items is generated on the vehicle-mounted computer of the vehicle. The emotion information of the user on the current playing music comprises the playing time of the current playing music; wherein, the longer the playing time is, the better the feedback of the vehicle driver to the playing music is. Preferably, in some embodiments, the vehicle response includes playing music within the vehicle, the music generated based on the driver emotion, adapted to the driver emotion.
In a second aspect of the invention, a system for driver emotion monitoring adjustment is provided. The system may be configured on a vehicle. The system comprises: a camera for capturing a face of a driver, the camera configured to capture a plurality of facial images of the driver over a period of time, and analyze the plurality of images to identify facial expressions of the driver and changes in facial expressions over the period of time; a microphone for capturing voice input, the microphone configured to analyze the voice input to identify voice content and changes in the presence of the driver's voice content over a period of time; a processor; and a memory. The processor is for processing facial images captured by the camera and voice inputs captured by the microphone, and the memory is for storing audio data received from the microphone and video data received from the camera. The system may also include a communication port for communication with an external device or server.
By monitoring the face and voice of the driver (driver), the present system is able to analyze and confirm the driving emotion of the driver more early and generate a corresponding vehicle response according to the driving emotion. The vehicle response includes an adjustment to the current setting of the vehicle, such as a reduction in vehicle speed. In the present invention, preferably, the vehicle response includes changing vehicle background music based on the emotion of the driver.
By vehicle response to emotion monitoring, early discovery and early elimination of hazards is achieved. Also, in the preferred embodiment, the driver is alerted by a change in background music, presumably because different music rhythms have a greater impact on the driver's emotion. In the invention, the emotion of the driver is confirmed through the information (audio, video, vehicle condition, road condition and the like) obtained by the current monitoring, and the emotion of the driver is changed and adjusted through the music corresponding to the emotion. For example, fast-paced music tends to make the driver more violent; and soft and relaxed music (the beat number per minute is equivalent to the heart rate of a person in calm) can relax the driver to reduce aggressiveness, thereby reducing the vehicle speed and reducing the possibility of traffic accidents.
Drawings
In the drawings, the same reference numerals refer to the same or similar parts or elements throughout the several views unless otherwise specified. The figures are not necessarily drawn to scale. It is appreciated that these drawings depict only some embodiments according to the disclosure and are not therefore to be considered limiting of its scope.
Fig. 1 is a flow chart of a driver emotion monitoring and adjusting method according to an embodiment of the present invention.
Fig. 2 is a schematic diagram of a driver emotion monitoring and adjusting system according to an embodiment of the present invention.
Detailed Description
Hereinafter, only certain exemplary embodiments are briefly described. As will be recognized by those of skill in the pertinent art, the described embodiments may be modified in various different ways without departing from the spirit or scope of the present invention. Accordingly, the drawings and description are to be regarded as illustrative in nature and not as restrictive.
The terms "first," "second," and the like herein are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature. In the description of the present invention, the meaning of "a plurality" is two or more, unless explicitly defined otherwise.
Embodiments of the present invention define methods and systems for use in a vehicle. The method and system include vehicle electronics driving a display device in a vehicle. In existing vehicles, the computer system and display are integrated with the vehicle and the vehicle electronics are capable of wirelessly communicating with the portable device (e.g., via bluetooth, wiFi, etc. wireless communication technology). Portable devices include cell phones, tablets, other computers, servers, etc. in other embodiments, portable devices and vehicle electronics work together to exchange information, driver interface data, application data, data for a display. The vehicle can use data and communication information from a portable device, a remote server, or a cloud server. It should be appreciated that the above-described embodiments may be combined specifically to implement the technical features defined and described. In each embodiment, the system provides physical technical results. These technical results need to be processed by the server system in order to provide intelligent data that can be used in an efficient manner by the connected vehicle.
In a first embodiment, the present invention provides a method for monitoring and adjusting emotion of a driver, as shown in fig. 1, the method for monitoring and adjusting comprising: s1, monitoring local information, wherein the local information comprises condition information of a vehicle, road condition information of a road where the vehicle is located and emotion information of a driver; s2, transmitting the local information to a music processing system, wherein the music processing system is used for processing the received local information so as to judge whether the condition information or road condition information of the vehicle belongs to a first appointed range; s3, when the condition information or road condition information of the vehicle belongs to the first designated range, the music processing system generates an early warning prompt and scene music matched with the condition information or road condition information; s4, receiving an early warning instruction and a playing instruction from the music processing system, wherein the early warning instruction comprises an early warning prompt generated by the music processing system, and the playing instruction comprises scene music generated by the music processing system; and S5, playing the early warning prompt and the scene music according to the early warning instruction and the playing instruction.
It should be understood that the music processing system described in the steps may be a cloud server, a portable terminal of the driver, or in some embodiments, a vehicle-mounted computer itself. For example, the cloud server is connected to an on-board computer on the vehicle via a data network (e.g., GSM, CDMA, 4G, 5G network). The local information is collected, voice input can be collected through a microphone, a face image of a driver can be collected through a camera, condition information (such as vehicle speed, running time and the like) of a vehicle can be collected through a vehicle-mounted computer, and road condition information near the vehicle can be collected through a GPS system of the vehicle. The GPS system may include a car navigator or may be a navigation application on a portable device (e.g., a smart phone) that communicates with a car computer (e.g., bluetooth). It can be understood that the microphone, the camera, the navigator or the portable device are all connected with the vehicle-mounted computer, can be connected with a hardware interface or can be connected with a communication, and the scheme of the invention can be realized as long as the data intercommunication can be realized.
In some embodiments, after the step of playing the early warning prompt and the scene music according to the early warning instruction and the playing instruction, the method further includes: monitoring the local information; transmitting the local information to the music processing system, wherein the music processing system is used for processing the received local information so as to judge whether the condition information or road condition information of the vehicle belongs to a second designated range; when the condition information or road condition information of the vehicle does not belong to the second designated range, the music processing system generates a stop instruction; and receiving a stop instruction of the music processing system, and ending playing music according to the stop instruction.
Further, the first specified range includes a vehicle speed range in the condition information and a congestion level in the road condition information; the second specified range includes a vehicle speed range in the condition information and a congestion level in the road condition information.
In one example, for example, the driver inadvertently pulls the vehicle faster because there is no one over the road (i.e., the road condition is excellent, the congestion condition is zero congestion). The accident is easy to occur when the vehicle runs. In the present invention, the face of the driver is captured by the camera, and its possible facial expression is calm, for example; the voice input captured by the microphone is zero (i.e., no voice input). The road condition information collected according to the GPS system is zero congestion, and the vehicle speed in the vehicle condition information determined according to the on-vehicle computer is overspeed (for example, 140 km/h). The vehicle-mounted computer collects the above-mentioned local information (including face information of the driver, voice input information, road condition information, status information of the vehicle, etc.), and transmits the local information to the music processing system. In this example, the music processing system may be a portable device (e.g., a smart phone) that is connected to the vehicle computer via bluetooth. After obtaining the local information, the portable device analyzes the current emotion of the driver and determines music matching the emotion. For example, the music is confirmed to be soft and relaxed by the calm expression of the driver, zero congestion of road conditions and overspeed. The matching method may be a machine learning training or a mapping generated by considering a preset condition. After determining soft and relaxed music, the portable device (music processing system) transmits a play instruction of the music back to the vehicle-mounted computer and plays by a play device on the vehicle-mounted computer.
Based on the above, the vehicle is responded to by the local information. The vehicle response may include some adjustments to the current settings of the vehicle. For example, the vehicle speed is adjusted, and the playing of the vehicle-mounted music is adjusted (the vehicle-mounted music can be played by a vehicle-mounted computer or a portable player connected through Bluetooth). To better determine the mood of the driver, the invention further provides a method for determining the mood of the driver of the vehicle and using the mood to generate a vehicle response. The method includes capturing, by a camera of the vehicle, a face of a driver; the camera is configured to capture facial images of a plurality of drivers over a period of time and analyze the plurality of images to identify facial expressions of the drivers and changes in facial expressions over the period of time. Still further, facial expressions include changes in facial organs, such as frowning, eye closure, and the like. In some embodiments, the method of determining the emotion of the driver of the vehicle and using the emotion to generate a vehicle response may further comprise capturing, by a microphone of the vehicle, a voice input of the driver. The microphone is configured to capture voice input over a period of time. The voice input is analyzed to identify changes in the voice content and the driver's voice content over a period of time. The method processes, by a processor of the vehicle, one or a combination of facial images and speech content captured over a period of time to predict the emotion of the driver. Based on the emotion monitoring, the method generates a vehicle response responsive to the driver's emotion. The vehicle response may be at least one adjustment made to a setting of the vehicle. The adjustment is selected based on the emotion of the driver. The vehicle response may be used to more sedate the driver and/or reduce distraction. In some embodiments, the vehicle response may further include a reduced vehicle speed, a voice alert, and the like.
In some embodiments, the driver's emotion may include: normal, depressed, dysphoric, impatient, tension, sedative, drowsiness, happy, excited, etc.
In further embodiments, driver information such as pressure, physiological conditions, heart rate, body temperature, etc. of the driver may also be collected by some wearable devices. In accordance with the above, such driver information may also be categorized as local information, which is then transmitted to the music processing system for analysis to confirm the driver's emotion and to adjust the vehicle response based on the determined emotion.
Based on the method, the invention can enable the vehicle-mounted computer or the music processing system to automatically play the music with a slow or slow rhythm when the vehicle speed is too high. And playing the aggressive or fast-paced music when the vehicle speed is lower than the minimum speed limit. Under normal road conditions, normal play is performed; and under the condition that the road conditions such as front congestion and the like which are easy to cause the emotion deterioration of the driver are monitored, the music with a slow or slow rhythm is played in advance. Meanwhile, the switching of music can also replace the voice prompt of the vehicle to a certain extent. For example, when a congested road condition exists in front of the vehicle, music in the vehicle is switched from a jolt to soft light music, and a driver can quickly learn that the music is a road condition reminder provided by the vehicle-mounted computer according to the style rhythm change of the music. Such a design also enables music within the vehicle to persist without being intermittently interrupted by voice prompts.
In a further embodiment, detecting emotional information may also use passive sensors that capture data about the physical state or behavior of the driver without interpreting the input. The data collected is similar to cues used by humans to perceive the emotion of others. For example, a camera may capture facial expressions, body gestures, and postures, while a microphone may capture speech. Other sensors may detect emotional cues by directly measuring physiological data, such as skin temperature and electrical current resistance. In some embodiments, a camera or infrared camera may detect temperature changes in a person's skin. For example, if the user feels tension, blood flow to the face of a person may rise or heat will be sensed from that person's face. In addition, the infrared camera can also identify the situation that the driver is trapped, such as long-time driving on high-speed road conditions or easy to be trapped when the driver needs to enter a long tunnel, and fast-paced music is matched according to the method so as to dispel the fatigue of the driver.
In some embodiments, the vehicle response may further include: monitoring emotion information of a user on current playing music; wherein the music list of playing music includes a plurality of music items; when a refreshing operation of refreshing a current playing page by a user is received, sorting music items in the music list according to emotion information of a driver of the vehicle, condition information of the vehicle and road condition information of a road where the vehicle is located; when the information of the N music items of the first N bits is sent to the vehicle-mounted computer, a new music list comprising the N music items is generated on the vehicle-mounted computer of the vehicle. The emotion information of the user on the current playing music comprises the playing time of the current playing music; wherein, the longer the playing time is, the better the feedback of the vehicle driver to the playing music is.
When receiving a refreshing operation of refreshing a current playing page by a user, sorting all thematic posts according to a music list generated by vehicle response, the operation of playing music currently by the user in a preset time and the emotion information change of the music currently played by the user in the preset time, wherein the method specifically comprises the following steps:
when a refreshing operation of refreshing the current playing page by a user is received, updating the heat of all the music items according to a preset heat calculation rule so as to sort all the music items according to the heat. Wherein the music items include music that the user accessed within a predetermined time and music that the user did not access within the predetermined time.
Wherein, for music which is not played by the user in the preset time, the heat is generated according to the accumulated play heat in the first preset time and the newly-increased play heat in the second preset time; wherein the accumulated playing heat is generated according to the accumulated playing number in a first preset time period, and the newly-increased playing heat is generated according to the newly-increased playing number in a second time period and a first weight.
For music played by a user in a preset time, generating heat according to the accumulated playing heat in the first preset time and the newly-increased playing heat in the second time period; wherein the accumulated playing heat is generated according to the accumulated playing number in a first preset time period, and the newly-increased playing heat is generated according to the newly-increased playing number in a second time period and a second weight; the second weight is greater than the first weight.
In a further embodiment, for music that the user has not played for a predetermined time, the heat r1=1/N (a×h1+b×h2). Wherein N is the number of consecutive times the music item is displayed on the user's music list without being played by the user; h1 is the accumulated play number in the first preset time period; h2 is the newly added play number in the second time period, a is a coefficient, and b is a first weight.
For music played by a user in a predetermined time, the heat r2=d (H2) (a×h1+c×h2); wherein when H2 is 0, D (H2) =0, and when H2 is not 0, D (H2) =1; c is a second weight. The c is generated according to the time when the user plays the music, wherein the longer the user plays the music, the larger c is.
In the embodiments described herein, the driver's emotion may be used to modify settings by the vehicle to provide a vehicle response, such as changing playing music within the vehicle in response to the driver's emotion. In one embodiment, the sensor may be used to detect changes in the autonomic nervous system revealed by the driver's voice. For example, the way the driver changes his voice may be used as local information to generate a vehicle response that can affect his emotion. For example, drivers are prone to faster speech and louder speech in fear, agitation, or pleasure. Other emotions such as fatigue, boredom, or pain tend to cause slow speech, bass, and blurry. Different emotions will correspondingly produce different speech patterns. In an embodiment of the invention, the processing system recognizes the emotional state of the driver by processing through analysis of the speech patterns. Sound parameters and prosodic features such as pitch variations and speech rates may be analyzed by pattern recognition, for example using one or more microphones of the vehicle.
As noted, in addition to detecting the driver's voice, one or more cameras may also detect facial patterns that may be used to detect and determine a particular mood of the vehicle driver. Different face pattern modes can be formed in the embodiment of the invention, so as to adaptively identify and confirm the emotion of the driver.
One or more cameras inside the vehicle may be used for face detection, gesture detection, motion monitoring, light detection, color detection. In one configuration, the camera may be embedded in the dashboard of the vehicle, on the display screen of the vehicle, on the headliner, or in several of these locations. In one embodiment, a stereo camera may be used to detect volume in a vehicle or monitor spatial volume in a vehicle. In one configuration, it may be located where gesture detection will occur. For example, one or more cameras may be positioned to monitor locations near a center console, display screen, or some driver interface. While monitoring, the camera may capture a plurality of video frames that may be analyzed to determine what gestures were made by the driver's hand or body. For example, a driver may make a face gesture, and the direction of the face gesture may be monitored by multiple cameras. In some habits, the face-slapping gestures are often considered to be related to drowsiness. The face is taken to be awake. In this case, the face-slapping gesture may be combined with other information local to the driver to confirm the emotional state of the driver in order to perform a corresponding vehicle response.
In some embodiments, the sensor may comprise a pressure sensor on the steering wheel. When the pressure sensor detects the change of the force of the driver for holding the steering wheel, the processing system can analyze the emotion change of the driver according to the change and other information. For example, when under tension, the force holding the steering wheel may become greater from smaller; and when the force is relaxed, the force on the steering wheel is stable and small.
In some embodiments, the driver's good mood may also be monitored by the methods described above. For example, when the driver is happy, the driver sits and the wheel gripping position is relaxed; the heart rate of the driver is at rest; the driver drives very normally compared to the history of driving; or a combination of two or more thereof.
As shown in fig. 2, the driver emotion monitoring and adjusting system according to an embodiment of the present invention may include a vehicle-mounted computer 1, a camera 2, a microphone 3, a display 4, a portable device 5 connected with bluetooth communication of the vehicle-mounted computer 1, and the like. The vehicle computer further includes a processor 11 and a memory 12. The camera 2, the microphone 3 and the display 4 are all connected with the vehicle-mounted computer 1 so that the vehicle-mounted computer 1 can collect local information. More specifically, the vehicle-mounted computer 1 is configured to monitor local information, where the local information includes status information of a vehicle, road condition information of a road on which the vehicle is located, and emotion information of the driver, and then transmit the local information to a music processing system, where the music processing system is configured to process the received local information to determine whether the status information or the road condition information of the vehicle belongs to a first specified range. When the condition information or the road condition information of the vehicle belongs to the first specified range, the music processing system generates an early warning prompt and scene music which are matched with the condition information or the road condition information. The vehicle-mounted computer 1 receives an early warning instruction and a playing instruction from the music processing system, wherein the early warning instruction comprises an early warning prompt generated by the music processing system, and the playing instruction comprises scene music generated by the music processing system. And the vehicle-mounted computer 1 plays the early warning prompt and the scene music according to the early warning instruction and the playing instruction.
It should be understood that the music processing system may be a cloud server (not shown in the figure) or may be the portable device 5 of the driver, for example, the cloud server (not shown in the figure) is connected to an on-board computer on the vehicle through a data network (for example, GSM, CDMA, 4G, 5G network). In some embodiments, the music processing system may also be the vehicle computer itself. The local information may be collected by collecting voice input through the microphone 3, collecting facial images of the driver through the camera 2, collecting condition information (e.g., vehicle speed, travel time, etc.) of the vehicle through the on-board computer 1, and collecting road condition information in the vicinity of the vehicle through a GPS system (not shown) of the vehicle. The GPS system may include a car navigator or may be a navigation application on a portable device (e.g., a smart phone) that communicates with a car computer (e.g., bluetooth). It will be appreciated that the microphone 3, the camera 2, the navigator or the portable device 5 are all connected to the vehicle-mounted computer 1, and may be a hardware interface connection or a communication connection, so long as data communication can be achieved, and the scheme of the present invention can be implemented.
In some embodiments, the vehicle-mounted computer is further configured to monitor the local information; transmitting the local information to the music processing system, wherein the music processing system is used for processing the received local information so as to judge whether the condition information or road condition information of the vehicle belongs to a second designated range; when the condition information or road condition information of the vehicle does not belong to the second designated range, the music processing system generates a stop instruction; and receiving a stop instruction of the music processing system, and ending playing music according to the stop instruction.
Further, the first specified range includes a vehicle speed range in the condition information and a congestion level in the road condition information; the second specified range includes a vehicle speed range in the condition information and a congestion level in the road condition information.
In one example, for example, the driver inadvertently pulls the vehicle faster because there is no one over the road (i.e., the road condition is excellent, the congestion condition is zero congestion). The accident is easy to occur when the vehicle runs. In the present invention, the face of the driver is captured by the camera 2, with possible facial expressions, for example, calm; the voice input captured by microphone 3 is zero (i.e., no voice input). The road condition information collected according to the GPS system is zero congestion, and the vehicle speed in the vehicle condition information determined according to the on-vehicle computer 1 is overspeed (for example, 140 km/h). The vehicle-mounted computer collects the above-mentioned local information (including face information of the driver, voice input information, road condition information, status information of the vehicle, etc.), and transmits the local information to the music processing system. In this example, the music processing system may be a portable device 5 (e.g., a smart phone), the portable device 5 being connected to the vehicle-mounted computer 1 through bluetooth. After obtaining the local information, the portable device 5 analyzes the current emotion of the driver and determines music matching the emotion. For example, the music is confirmed to be soft and relaxed by the calm expression of the driver, zero congestion of road conditions and overspeed. The matching method may be a machine learning training or a mapping generated by considering a preset condition. After determining soft and easy music, the portable device 5 (music processing system) transmits a play instruction of the music back to the in-vehicle computer 1 and plays by a play unit on the in-vehicle computer 1.
Based on the above, the vehicle is responded to by the local information. The vehicle response may include some adjustments to the current settings of the vehicle. For example, the vehicle speed is adjusted, and the playing of the vehicle-mounted music is adjusted (the vehicle-mounted music can be played by a vehicle-mounted computer or a portable player connected through Bluetooth). To better determine the mood of the driver, the invention further provides a method for determining the mood of the driver of the vehicle and using the mood to generate a vehicle response. The method includes capturing, by a camera of the vehicle, a face of a driver; the camera is configured to capture facial images of a plurality of drivers over a period of time and analyze the plurality of images to identify facial expressions of the drivers and changes in facial expressions over the period of time. Still further, facial expressions include changes in facial organs, such as frowning, eye closure, and the like. In some embodiments, the method of determining the emotion of the driver of the vehicle and using the emotion to generate a vehicle response may further comprise capturing, by a microphone of the vehicle, a voice input of the driver. The microphone is configured to capture voice input over a period of time. The voice input is analyzed to identify changes in the voice content and the driver's voice content over a period of time. The method processes, by a processor of the vehicle, one or a combination of facial images and speech content captured over a period of time to predict the emotion of the driver. Based on the emotion monitoring, the method generates a vehicle response responsive to the driver's emotion. The vehicle response may be at least one adjustment made to a setting of the vehicle. The adjustment is selected based on the emotion of the driver. The vehicle response may be used to more sedate the driver and/or reduce distraction. In some embodiments, the vehicle response may further include a reduced vehicle speed, a voice alert, and the like.
In some embodiments, the driver's emotion may include: normal, depressed, dysphoric, impatient, tension, sedative, drowsiness, happy, excited, etc.
In further embodiments, driver information such as pressure, physiological conditions, heart rate, body temperature, etc. of the driver may also be collected by some wearable devices. In accordance with the above, such driver information may also be categorized as local information, which is then transmitted to the music processing system for analysis to confirm the driver's emotion and to adjust the vehicle response based on the determined emotion.
Based on the method, the invention can enable the vehicle-mounted computer 1 or the music processing system to automatically play the music with a slow or slow rhythm when the vehicle speed is too high. And playing the aggressive or fast-paced music when the vehicle speed is lower than the minimum speed limit. Under normal road conditions, normal play is performed; and under the condition that the road conditions such as front congestion and the like which are easy to cause the emotion deterioration of the driver are monitored, the music with a slow or slow rhythm is played in advance. Meanwhile, the switching of music can also replace the voice prompt of the vehicle to a certain extent. For example, when there is a congested road condition in front, the music in the vehicle is switched from the aggressive rock to soft light music, and the driver can quickly learn that the music is a road condition reminder provided by the vehicle-mounted computer 1 according to the style rhythm change of the music. Such a design also enables music within the vehicle to persist without being intermittently interrupted by voice prompts.
In a further embodiment, passive sensors may also be used for detecting mood information. I.e. the monitoring system described in fig. 2 may also comprise passive sensors. The passive sensor captures data about the physical state or behavior of the driver without the need to interpret the input. The data collected is similar to cues used by humans to perceive the emotion of others. For example, the camera 2 may capture facial expressions, body gestures, and postures, while the microphone 3 may capture speech. Other sensors (not shown) may detect emotional cues by directly measuring physiological data, such as skin temperature and electrical current resistance. In some embodiments, a camera or infrared camera may detect temperature changes in a person's skin. For example, if the user feels tension, blood flow to the face of a person may rise or heat will be sensed from that person's face. In addition, the infrared camera can also identify the situation that the driver is trapped, such as long-time driving on high-speed road conditions or easy to be trapped when the driver needs to enter a long tunnel, and fast-paced music is matched according to the method so as to dispel the fatigue of the driver.
In the embodiments described herein, the driver's emotion may be used to modify settings by the vehicle to provide a vehicle response, such as changing playing music within the vehicle in response to the driver's emotion. In one embodiment, the sensor may be used to detect changes in the autonomic nervous system revealed by the driver's voice. For example, the way the driver changes his voice may be used as local information to generate a vehicle response that can affect his emotion. For example, drivers are prone to faster speech and louder speech in fear, agitation, or pleasure. Other emotions such as fatigue, boredom, or pain tend to cause slow speech, bass, and blurry. Different emotions will correspondingly produce different speech patterns. In an embodiment of the invention, the processing system recognizes the emotional state of the driver by processing through analysis of the speech patterns. Sound parameters and prosodic features such as pitch variations and speech rates may be analyzed by pattern recognition, for example using one or more microphones of the vehicle.
As noted, in addition to detecting the driver's voice, one or more cameras may also detect facial patterns that may be used to detect and determine a particular mood of the vehicle driver. Different face pattern modes can be formed in the embodiment of the invention, so as to adaptively identify and confirm the emotion of the driver.
One or more cameras 2 in the vehicle interior may be used for face detection, gesture detection, motion monitoring, light detection, color detection. In one configuration, the camera 2 may be embedded in the dashboard of the vehicle, on the display screen of the vehicle, on a headliner, or in several of these locations. In one embodiment, a stereo camera may be used to detect volume in a vehicle or monitor spatial volume in a vehicle. In one configuration, it may be located where gesture detection will occur. For example, one or more cameras may be positioned to monitor locations near a center console, display screen, or some driver interface. While monitoring, the camera 2 may capture a plurality of video frames that may be analyzed to determine what gestures the driver's hand or body has made. For example, a driver may make a face gesture, and the direction of the face gesture may be monitored by multiple cameras. In some habits, the face-slapping gestures are often considered to be related to drowsiness. The face is taken to be awake. In this case, the face-slapping gesture may be combined with other information local to the driver to confirm the emotional state of the driver in order to perform a corresponding vehicle response.
In some embodiments, the sensor may comprise a pressure sensor on the steering wheel. When the pressure sensor detects the change of the force of the driver for holding the steering wheel, the processing system can analyze the emotion change of the driver according to the change and other information. For example, when under tension, the force holding the steering wheel may become greater from smaller; and when the force is relaxed, the force on the steering wheel is stable and small.
In some embodiments, the driver's good mood may also be monitored by the methods described above. For example, when the driver is happy, the driver sits and the wheel gripping position is relaxed; the heart rate of the driver is at rest; the driver drives very normally compared to the history of driving; or a combination of two or more thereof.
The embodiment of the invention also provides a terminal device for realizing the monitoring and adjustment of the emotion of the driver of the vehicle, which comprises a processor, a memory and a computer program stored in the memory and configured to be executed by the processor, for example: the routine of the adjustment is monitored for the driver's emotion. The processor, when executing the computer program, implements the steps of the method for monitoring and adjusting the condition of the driver of the vehicle described in the above embodiments, such as steps S1 to S5 shown in fig. 1.
Illustratively, the computer program may be split into one or more modules that are stored in the memory and executed by the processor to perform the present invention. The one or more modules may be a series of computer program instruction segments capable of performing a specific function for describing the execution of the computer program in the terminal device for implementing the adjustment of the condition monitoring of the driver of the vehicle.
The terminal device may include, but is not limited to, a processor, memory, display. It will be appreciated by those skilled in the art that the schematic diagram is merely an example of a terminal device for implementing the vehicle driver emotion monitoring adjustment, and does not constitute a limitation of the terminal device for implementing the vehicle driver emotion monitoring adjustment, and may include more or less components than those illustrated, or may combine some components, or different components, for example, the terminal device for implementing the vehicle driver emotion monitoring adjustment may further include an input/output device, a network access device, a bus, and the like.
The processor may be a central processing unit (Central Processing Unit, CPU), other general purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), off-the-shelf programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or the like. The general processor may be a microprocessor or any conventional processor, etc., and the processor is a control center of the terminal device for implementing the monitoring and adjustment of the emotion of the driver of the vehicle, and connects various parts of the whole terminal device for implementing the monitoring and adjustment of the emotion of the driver of the vehicle by using various interfaces and lines.
The memory may be used to store the computer program and/or the module, and the processor may implement various functions of the terminal device for monitoring and adjusting the driver's emotion of the vehicle by running or executing the computer program and/or the module stored in the memory and invoking the data stored in the memory. The memory may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program (such as a sound playing function, a text conversion function, etc.) required for at least one function, and the like; the storage data area may store data (such as audio data, text message data, etc.) created according to the use of the cellular phone, etc. In addition, the memory may include high-speed random access memory, and may also include non-volatile memory, such as a hard disk, memory, plug-in hard disk, smart Media Card (SMC), secure Digital (SD) Card, flash Card (Flash Card), at least one disk storage device, flash memory device, or other volatile solid-state storage device.
The modules of the terminal device for realizing the monitoring and adjustment of the driver's emotion of the vehicle can be stored in a computer-readable storage medium if they are realized in the form of software functional units and sold or used as independent products. Based on this understanding, the present invention may implement all or part of the flow of the method of the above embodiment, or may be implemented by a computer program to instruct related hardware, where the computer program may be stored in a computer readable storage medium, and the computer program may implement the steps of each method embodiment described above when executed by a processor. Wherein the computer program comprises computer program code which may be in source code form, object code form, executable file or some intermediate form etc. The computer readable medium may include: any entity or device capable of carrying the computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer Memory, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), an electrical carrier signal, a telecommunications signal, a software distribution medium, and so forth. It should be noted that the computer readable medium contains content that can be appropriately scaled according to the requirements of jurisdictions in which such content is subject to legislation and patent practice, such as in certain jurisdictions in which such content is subject to legislation and patent practice, the computer readable medium does not include electrical carrier signals and telecommunication signals.
It should be noted that the above-described apparatus embodiments are merely illustrative, and the units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed over a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. In addition, in the drawings of the embodiment of the device provided by the invention, the connection relation between the modules represents that the modules have communication connection, and can be specifically implemented as one or more communication buses or signal lines. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
The foregoing is merely illustrative of the present invention, and the present invention is not limited thereto, and any person skilled in the art will readily recognize that various changes and substitutions are possible within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (6)
1. A method for monitoring and adjusting emotion of a driver, comprising:
monitoring local information, wherein the local information comprises condition information of a vehicle, road condition information of a road on which the vehicle is positioned and emotion information of a driver of the vehicle;
transmitting the local information to a music processing system, wherein the music processing system is used for processing the received local information so as to judge whether the condition information or road condition information of the vehicle belongs to a first appointed range; when the condition information or road condition information of the vehicle belongs to the first specified range, the music processing system generates an early warning prompt and scene music which are matched with the condition information or road condition information;
receiving an early warning instruction and a playing instruction from the music processing system, wherein the early warning instruction comprises an early warning prompt generated by the music processing system, and the playing instruction comprises scene music generated by the music processing system; and
playing the early warning prompt and the scene music according to the early warning instruction and the playing instruction;
the method further comprises the steps of:
monitoring emotion information of a user on current playing music; wherein the music list of playing music includes a plurality of music items;
When a refreshing operation of refreshing a current playing page by a user is received, sorting music items in the music list according to emotion information of a driver of the vehicle, condition information of the vehicle and road condition information of a road where the vehicle is located;
when the information of N music items of the first N bits is sent to the vehicle-mounted computer, generating a new music list comprising the N music items on the vehicle-mounted computer of the vehicle;
when receiving a refreshing operation of refreshing a current playing page by a user, sorting all thematic posts according to a music list generated by vehicle response, the operation of playing music currently by the user in a preset time and the emotion information change of the music currently played by the user in the preset time, wherein the method specifically comprises the following steps:
when a refreshing operation of refreshing a current playing page by a user is received, updating the heat of all the music items according to a preset heat calculation rule so as to sort all the music items according to the heat; wherein the music items include music accessed by the user within a predetermined time and music not accessed by the user within the predetermined time;
wherein, for music which is not played by the user in the preset time, the heat is generated according to the accumulated play heat in the first preset time and the newly-increased play heat in the second preset time; wherein the accumulated playing heat is generated according to the accumulated playing number in a first preset time period, and the newly-increased playing heat is generated according to the newly-increased playing number in a second time period and a first weight;
For music played by a user in a preset time, generating heat according to the accumulated playing heat in the first preset time and the newly-increased playing heat in the second time period; wherein the accumulated playing heat is generated according to the accumulated playing number in a first preset time period, and the newly-increased playing heat is generated according to the newly-increased playing number in a second time period and a second weight; the second weight is greater than the first weight;
wherein, for music which the user has not played in a predetermined time, the heat r1=1/N (a+h1+b H2); wherein N is the number of consecutive times the music item is displayed on the user's music list without being played by the user; h1 is the accumulated play number in the first preset time period; h2 is the newly added play number in the second time period, a is a coefficient, and b is a first weight;
for music played by a user in a predetermined time, the heat r2=d (H2) thereof
(a H1+ c H2); wherein when H2 is 0, D (H2) =0, and when H2 is not 0, D (H2) =1; c is a second weight; the c is generated according to the time when the user plays the music, wherein the longer the user plays the music, the larger c is.
2. The method of claim 1, further comprising, after the playing the alert cue and the scene music according to the alert instruction and the play instruction:
monitoring the local information;
transmitting the local information to the music processing system, wherein the music processing system is used for processing the received local information so as to judge whether the condition information or road condition information of the vehicle belongs to a second designated range; when the condition information or road condition information of the vehicle does not belong to the second designated range, the music processing system generates a stop instruction;
and receiving a stop instruction of the music processing system, and ending playing music according to the stop instruction.
3. The method of claim 2, wherein the first specified range includes a vehicle speed range in the condition information, a congestion level in the road condition information; the second specified range includes a vehicle speed range in the condition information and a congestion level in the road condition information.
4. The method of claim 1, wherein the method further comprises:
capturing the face of the vehicle driver through a camera; the camera is configured to capture facial images of a plurality of drivers over a period of time and analyze the plurality of images to identify facial expressions of the drivers and changes in facial expressions over the period of time; wherein the facial expression includes a change in facial organs.
5. The utility model provides a monitoring governing system of driver emotion, its characterized in that, the system includes on-vehicle computer, camera, GPS system, the camera with the GPS system all with on-vehicle computer is connected: the in-vehicle computer includes a processor and a memory, wherein the processor of the in-vehicle computer is configured to:
monitoring local information, wherein the local information comprises condition information of a vehicle, road condition information of a road on which the vehicle is positioned and emotion information of a driver of the vehicle;
transmitting the local information to a music processing system, wherein the music processing system is used for processing the received local information so as to judge whether the condition information or road condition information of the vehicle belongs to a first appointed range; when the condition information or road condition information of the vehicle belongs to the first specified range, the music processing system generates an early warning prompt and scene music which are matched with the condition information or road condition information;
receiving an early warning instruction and a playing instruction from the music processing system, wherein the early warning instruction comprises an early warning prompt generated by the music processing system, and the playing instruction comprises scene music generated by the music processing system; and
Playing the early warning prompt and the scene music according to the early warning instruction and the playing instruction;
the processor of the vehicle-mounted computer is further configured to:
monitoring emotion information of a user on current playing music; wherein the music list of playing music includes a plurality of music items;
when a refreshing operation of refreshing a current playing page by a user is received, sorting music items in the music list according to emotion information of a driver of the vehicle, condition information of the vehicle and road condition information of a road where the vehicle is located;
when the information of N music items of the first N bits is sent to the vehicle-mounted computer, generating a new music list comprising the N music items on the vehicle-mounted computer of the vehicle;
when receiving a refreshing operation of refreshing a current playing page by a user, sorting all themes according to a music list generated by vehicle response, the operation of the user on playing the music in a preset time and the emotion information change of the user on playing the music in the preset time, wherein the method specifically comprises the following steps:
when a refreshing operation of refreshing a current playing page by a user is received, updating the heat of all the music items according to a preset heat calculation rule so as to sort all the music items according to the heat; wherein the music items include music accessed by the user within a predetermined time and music not accessed by the user within the predetermined time;
Wherein, for music which is not played by the user in the preset time, the heat is generated according to the accumulated play heat in the first preset time and the newly-increased play heat in the second preset time; wherein the accumulated playing heat is generated according to the accumulated playing number in a first preset time period, and the newly-increased playing heat is generated according to the newly-increased playing number in a second time period and a first weight;
for music played by a user in a preset time, generating heat according to the accumulated playing heat in the first preset time and the newly-increased playing heat in the second time period; wherein the accumulated playing heat is generated according to the accumulated playing number in a first preset time period, and the newly-increased playing heat is generated according to the newly-increased playing number in a second time period and a second weight; the second weight is greater than the first weight;
wherein, for music which the user has not played in a predetermined time, the heat r1=1/N (a+h1+b H2); wherein N is the number of consecutive times the music item is displayed on the user's music list without being played by the user; h1 is the accumulated play number in the first preset time period; h2 is the newly added play number in the second time period, a is a coefficient, and b is a first weight;
For music played by a user in a predetermined time, the heat r2=d (H2) thereof
(a H1+ c H2); wherein when H2 is 0, D (H2) =0, and when H2 is not 0, D (H2) =1; c is a second weight; the c is generated according to the time when the user plays the music, wherein the longer the user plays the music, the larger c is.
6. The system of claim 5, wherein the processor of the vehicle-mounted computer is further configured to:
monitoring the local information;
transmitting the local information to the music processing system, wherein the music processing system is used for processing the received local information so as to judge whether the condition information or road condition information of the vehicle belongs to a second designated range; when the condition information or road condition information of the vehicle does not belong to the second designated range, the music processing system generates a stop instruction;
and receiving a stop instruction of the music processing system, and ending playing music according to the stop instruction.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010500507.9A CN111783550B (en) | 2020-06-04 | 2020-06-04 | Monitoring and adjusting method and system for emotion of driver |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010500507.9A CN111783550B (en) | 2020-06-04 | 2020-06-04 | Monitoring and adjusting method and system for emotion of driver |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111783550A CN111783550A (en) | 2020-10-16 |
| CN111783550B true CN111783550B (en) | 2023-12-01 |
Family
ID=72754028
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010500507.9A Active CN111783550B (en) | 2020-06-04 | 2020-06-04 | Monitoring and adjusting method and system for emotion of driver |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111783550B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104409085A (en) * | 2014-11-24 | 2015-03-11 | 惠州Tcl移动通信有限公司 | Vehicle-mounted intelligent music player and music playing method thereof |
| CN104417457A (en) * | 2013-08-20 | 2015-03-18 | 哈曼国际工业有限公司 | Driver assistance system |
| KR20160051922A (en) * | 2014-10-29 | 2016-05-12 | 현대자동차주식회사 | Music recommendation system for vehicle and method thereof |
| CN106302678A (en) * | 2016-08-08 | 2017-01-04 | 北京谱思科技有限公司 | A kind of music recommends method and device |
| CN108319635A (en) * | 2017-12-15 | 2018-07-24 | 海南智媒云图科技股份有限公司 | A kind of multi-platform music sources integrate method, electronic equipment and the storage medium of broadcasting |
| CN109446375A (en) * | 2018-10-29 | 2019-03-08 | 广州小鹏汽车科技有限公司 | Adaptive method for playing music and system applied to vehicle |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10170111B2 (en) * | 2017-01-19 | 2019-01-01 | Toyota Motor Engineering & Manufacturing North America, Inc. | Adaptive infotainment system based on vehicle surrounding and driver mood and/or behavior |
-
2020
- 2020-06-04 CN CN202010500507.9A patent/CN111783550B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104417457A (en) * | 2013-08-20 | 2015-03-18 | 哈曼国际工业有限公司 | Driver assistance system |
| KR20160051922A (en) * | 2014-10-29 | 2016-05-12 | 현대자동차주식회사 | Music recommendation system for vehicle and method thereof |
| CN104409085A (en) * | 2014-11-24 | 2015-03-11 | 惠州Tcl移动通信有限公司 | Vehicle-mounted intelligent music player and music playing method thereof |
| CN106302678A (en) * | 2016-08-08 | 2017-01-04 | 北京谱思科技有限公司 | A kind of music recommends method and device |
| CN108319635A (en) * | 2017-12-15 | 2018-07-24 | 海南智媒云图科技股份有限公司 | A kind of multi-platform music sources integrate method, electronic equipment and the storage medium of broadcasting |
| CN109446375A (en) * | 2018-10-29 | 2019-03-08 | 广州小鹏汽车科技有限公司 | Adaptive method for playing music and system applied to vehicle |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111783550A (en) | 2020-10-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20210268902A1 (en) | Driving assistance apparatus and driving assistance method | |
| US10493914B2 (en) | System and method for vehicle collision mitigation with vulnerable road user context sensing | |
| CN105270292B (en) | System and method for controlling access to human-machine interface in vehicle | |
| EP3067827A1 (en) | Driver distraction detection system | |
| US10259464B2 (en) | Control for an electronic multi-function apparatus | |
| CN106448259B (en) | A kind of method, apparatus and system of vehicle early warning | |
| JP6639444B2 (en) | Information providing apparatus and information providing method | |
| EP3675121A2 (en) | Two-way in-vehicle virtual personal assistant | |
| JP2016110449A (en) | Driving support system and driving support method | |
| EP3889740A1 (en) | Affective-cognitive load based digital assistant | |
| US9984298B2 (en) | Method for outputting a drowsiness warning and control unit | |
| CN110027567A (en) | The driving condition of driver determines method, apparatus and storage medium | |
| JP2018045303A (en) | Driving assist system | |
| US11532319B2 (en) | Techniques for separating driving emotion from media induced emotion using an additive/subtractive, conjunctive, disjunctive, or Bayesian technique in a driver monitoring system | |
| CN105383497B (en) | Vehicle-mounted system | |
| JP2019086805A (en) | In-vehicle system | |
| CN111783550B (en) | Monitoring and adjusting method and system for emotion of driver | |
| JP2015191429A (en) | Drive support device and drive support method | |
| KR101324082B1 (en) | Cognitive Workload Estimation System using Driving Performance and Physiological Data | |
| US11383640B2 (en) | Techniques for automatically reducing annoyance levels of drivers when using driver monitoring systems | |
| US11912267B2 (en) | Collision avoidance system for vehicle interactions | |
| US20200265252A1 (en) | Information processing apparatus and information processing method | |
| CN116248701A (en) | Prompt method and device, electronic equipment and vehicle | |
| CN116834749A (en) | Fatigue driving early warning method, device, equipment and storage medium | |
| JP2024026816A (en) | Information processing system, information processing device, information processing method, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |