CN111783550A - Method and system for monitoring and adjusting emotion of driver - Google Patents
Method and system for monitoring and adjusting emotion of driver Download PDFInfo
- Publication number
- CN111783550A CN111783550A CN202010500507.9A CN202010500507A CN111783550A CN 111783550 A CN111783550 A CN 111783550A CN 202010500507 A CN202010500507 A CN 202010500507A CN 111783550 A CN111783550 A CN 111783550A
- Authority
- CN
- China
- Prior art keywords
- music
- vehicle
- playing
- condition information
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000008451 emotion Effects 0.000 title claims abstract description 76
- 238000000034 method Methods 0.000 title claims abstract description 55
- 238000012544 monitoring process Methods 0.000 title claims abstract description 46
- 238000012545 processing Methods 0.000 claims abstract description 76
- 230000004044 response Effects 0.000 claims description 40
- 230000036651 mood Effects 0.000 claims description 33
- 230000008921 facial expression Effects 0.000 claims description 18
- 230000001815 facial effect Effects 0.000 claims description 17
- 230000008859 change Effects 0.000 claims description 12
- 210000000056 organ Anatomy 0.000 claims description 4
- 238000004364 calculation method Methods 0.000 claims description 3
- 238000001514 detection method Methods 0.000 description 13
- 238000004590 computer program Methods 0.000 description 12
- 230000002996 emotional effect Effects 0.000 description 9
- 238000004891 communication Methods 0.000 description 8
- 230000008569 process Effects 0.000 description 6
- 101150052583 CALM1 gene Proteins 0.000 description 5
- 101150095793 PICALM gene Proteins 0.000 description 5
- 101150014174 calm gene Proteins 0.000 description 5
- 230000006870 function Effects 0.000 description 5
- 230000033764 rhythmic process Effects 0.000 description 4
- 206010039203 Road traffic accident Diseases 0.000 description 3
- 206010039897 Sedation Diseases 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000036280 sedation Effects 0.000 description 3
- 206010048909 Boredom Diseases 0.000 description 2
- 206010049119 Emotional distress Diseases 0.000 description 2
- 206010041349 Somnolence Diseases 0.000 description 2
- 238000013019 agitation Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 2
- 210000003403 autonomic nervous system Anatomy 0.000 description 2
- 230000006399 behavior Effects 0.000 description 2
- 230000017531 blood circulation Effects 0.000 description 2
- 230000036760 body temperature Effects 0.000 description 2
- 206010007776 catatonia Diseases 0.000 description 2
- 238000012790 confirmation Methods 0.000 description 2
- 230000000994 depressogenic effect Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 230000009429 distress Effects 0.000 description 2
- 230000001544 dysphoric effect Effects 0.000 description 2
- 206010016256 fatigue Diseases 0.000 description 2
- 230000014509 gene expression Effects 0.000 description 2
- 238000010801 machine learning Methods 0.000 description 2
- 238000003909 pattern recognition Methods 0.000 description 2
- 230000004962 physiological condition Effects 0.000 description 2
- 230000002040 relaxant effect Effects 0.000 description 2
- 239000011435 rock Substances 0.000 description 2
- 230000001624 sedative effect Effects 0.000 description 2
- 230000003867 tiredness Effects 0.000 description 2
- 208000016255 tiredness Diseases 0.000 description 2
- 238000012549 training Methods 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000001186 cumulative effect Effects 0.000 description 1
- 230000008030 elimination Effects 0.000 description 1
- 238000003379 elimination reaction Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
- G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
- G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
- G10L25/63—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination for estimating an emotional state
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/90—Pitch determination of speech signals
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/90—Pitch determination of speech signals
- G10L2025/906—Pitch tracking
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Computational Linguistics (AREA)
- Acoustics & Sound (AREA)
- Human Computer Interaction (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Psychiatry (AREA)
- Hospice & Palliative Care (AREA)
- General Health & Medical Sciences (AREA)
- Child & Adolescent Psychology (AREA)
- General Physics & Mathematics (AREA)
- Traffic Control Systems (AREA)
Abstract
The invention discloses a method and a system for monitoring and adjusting the emotion of a driver, wherein the method comprises the following steps: monitoring local information; transmitting the local information to a music processing system, wherein the music processing system is used for processing the received local information so as to judge whether the condition information or the road condition information of the vehicle belongs to a first specified range; when the condition information or the road condition information of the vehicle belongs to the first designated range, the music processing system generates an early warning prompt and scene music which are matched with the condition information or the road condition information; receiving a playing instruction from the music processing system, wherein the playing instruction comprises scene music generated by the music processing system; and playing the early warning prompt and the scene music according to the playing instruction. The method has the technical effect of monitoring and adjusting the emotion of the driver to avoid accidents.
Description
Technical Field
The invention relates to the field of vehicles, in particular to a method and a system for monitoring and adjusting emotion of a driver in a vehicle.
Background
To date, many types of private vehicles, such as automobiles and electric vehicles, have increasingly entered thousands of households. The use of private vehicles facilitates the traffic mode between two places and shortens the distance between people. Accordingly, vehicles are becoming indispensable transportation means.
Behind the convenience, another set of data is hidden. According to statistics, the traffic accidents caused by overspeed driving are high in proportion every year, and once the accidents happen, most of the accidents belong to large traffic accidents. In current vehicle systems, active safety and passive safety are adjusted only when a danger occurs. However, the danger is often sudden, so that the time for safety adjustment is hasty.
Disclosure of Invention
In order to solve the problems in the background art, the invention provides a method and a system for monitoring and adjusting the emotion of a driver, which comprise a processing system for responding to local information of a vehicle. In various configurations, local information of the vehicle (e.g., condition information, road condition information of the road, emotional information of the driver, etc.) is analyzed. In some embodiments, the processing system is responsive to musical instructions associated with the local information. The vehicle's response to the local information may include: such as switching navigation, switching music playback, etc.
In a first aspect of the invention, there is provided a method for determining a vehicle driver's mood and using that mood to generate a vehicle response, comprising capturing by a camera of a vehicle a driver's face; the camera is configured to capture facial images of a plurality of drivers over a period of time and analyze the plurality of images to identify facial expressions of the drivers and changes in the facial expressions over the period of time. Further, the facial expression includes changes in facial organs, such as frowning, closing eyes, and the like.
In some embodiments, the method of determining a vehicle driver emotion and using the emotion to generate a vehicle response may further include capturing a driver's voice input by a microphone of the vehicle. The microphone is configured to capture voice input over a period of time. The speech input is analyzed to identify changes in the speech content and the driver's speech content over a period of time. The method processes, by a processor of the vehicle, one or a combination of a facial image and voice content captured over a period of time to predict an emotion of the driver. Based on the emotion monitoring, the method generates a vehicle response responsive to the driver's emotion. The vehicle response may be to make at least one adjustment to a setting of the vehicle. The adjustment is selected based on the mood of the driver. The vehicle response may be used to provide greater sedation to the driver and/or reduce distraction.
In some embodiments, the vehicle response may include a decrease in vehicle speed, a voice alert, and the like.
In some embodiments, the method further includes: monitoring emotion information of a user on currently played music; wherein the music list for playing music comprises a plurality of music entries; when a refreshing operation that a user refreshes a current playing page is received, sorting the music items in the music list according to emotion information of a vehicle driver, condition information of a vehicle and road condition information of a road where the vehicle is located; and sending information of the N music items of the first N-bit sequence to the vehicle-mounted computer so as to generate a new music list comprising the N music items on the vehicle-mounted computer of the vehicle. The emotion information of the user to the currently played music comprises the playing time of the currently played music; wherein the longer the playing time is, the better the feedback of the vehicle driver to the playing music is. Preferably, in some embodiments, the vehicle response comprises playing music within the vehicle, the music generated based on the driver emotion and adapted to the driver emotion.
In a second aspect of the invention, a system for driver mood monitoring adjustment is provided. The system may be configured on a vehicle. The system comprises: a camera for capturing a driver's face, the camera configured to capture facial images of a plurality of drivers over a period of time, and to analyze the plurality of images to identify facial expressions of the drivers and changes in the facial expressions over the period of time; a microphone for capturing voice input, the microphone configured to analyze the voice input to identify changes in voice content and the driver's voice content over a period of time; a processor; and a memory. The processor is configured to process facial images captured by the camera and voice inputs captured by the microphone, and the memory is configured to store audio data received from the microphone and video data received from the camera. The system may also include a communication port for communicating with an external device or server.
By face monitoring and voice monitoring of a driver (driver), the system can analyze and confirm the driving emotion of the driver in advance and generate corresponding vehicle response according to the driving emotion. The vehicle response includes an adjustment to the vehicle's current settings, such as reducing the vehicle speed. In the present invention, preferably, the vehicle response comprises changing the vehicle background music based on the mood of the driver.
Early detection and early elimination of danger are achieved by vehicle response to emotion monitoring. Also, in the preferred embodiment, the driver is alerted by a change in background music, presumably because different music tempos have a greater impact on the driver's mood. In the invention, the emotion of the driver is confirmed through the information (audio, video, vehicle condition, road condition and the like) obtained by current monitoring, and the emotion of the driver is changed and adjusted through the music corresponding to the emotion. For example, fast paced music tends to make the driver more jerky and jerky; while soft and easy music (beats per minute is equivalent to the heart rate of a calm person) can relax the driver to reduce the aggressiveness, further reduce the speed of the vehicle and reduce the possibility of traffic accidents.
Drawings
In the drawings, like reference numerals refer to the same or similar parts or elements throughout the several views unless otherwise specified. The figures are not necessarily to scale. It is appreciated that these drawings depict only some embodiments in accordance with the disclosure and are therefore not to be considered limiting of its scope.
Fig. 1 is a flow chart diagram of a driver emotion monitoring and adjusting method according to an embodiment of the present invention.
Fig. 2 is a schematic structural diagram of a driver emotion monitoring and adjusting system according to an embodiment of the present invention.
Detailed Description
In the following, only certain exemplary embodiments are briefly described. As those skilled in the art will recognize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. Accordingly, the drawings and description are to be regarded as illustrative in nature, and not as restrictive.
The terms "first", "second" and "first" are used herein for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the present invention, "a plurality" means two or more unless specifically defined otherwise.
Embodiments of the invention define methods and systems for use in a vehicle. The method and system include vehicle electronics driving a display device in a vehicle. In existing vehicles, where the computer system and display are integrated with the vehicle, the vehicle electronics can communicate wirelessly (e.g., via bluetooth, WiFi, etc. wireless communication technologies) with the portable device. Portable devices include cell phones, tablets, other computers, servers, etc. in other embodiments, the portable devices work with the vehicle's electronics to exchange information, driver interface data, application data, data for a display. The vehicle can use data and communication information from the portable device, a remote server, or a cloud server. It is to be understood that the above embodiments may be specifically combined to achieve the technical features defined and described. In each embodiment, the system provides a physical technical result. These technical results need to be processed by the server system in order to provide intelligent data that can be used in an efficient manner by the connected vehicle.
In a first embodiment, the present invention provides a monitoring and adjusting method of a driver's emotion, as shown in fig. 1, the monitoring and adjusting method including: s1, monitoring local information, wherein the local information comprises condition information of vehicles, road condition information of roads where the vehicles are located and emotion information of drivers; s2, transmitting the local information to a music processing system, wherein the music processing system is used for processing the received local information to judge whether the condition information or the road condition information of the vehicle belongs to a first specified range; s3, when the condition information or the road condition information of the vehicle belongs to the first designated range, the music processing system generates an early warning prompt and scene music matched with the condition information or the road condition information; s4, receiving an early warning instruction and a playing instruction from the music processing system, wherein the early warning instruction comprises an early warning prompt generated by the music processing system, and the playing instruction comprises scene music generated by the music processing system; and S5, playing the early warning prompt and the scene music according to the early warning instruction and the playing instruction.
It should be understood that the music processing system described in the step may be a cloud server, or may also be a portable terminal of a driver, or may also be a vehicle-mounted computer itself in some embodiments. For example, the cloud server is connected to the onboard computer in the vehicle via a data network (e.g., GSM, CDMA, 4G, 5G network). The collection of the local information can collect voice input through a microphone, collect facial images of a driver through a camera, collect condition information (such as speed, running time and the like) of the vehicle through an on-board computer, and collect road condition information near the vehicle through a GPS system of the vehicle. The GPS system may include a car navigator or may be a navigation application on a portable device (e.g., a smartphone) that communicates (e.g., bluetooth) with an on-board computer. It can be understood that the microphone, the camera, the navigator or the portable device described above are all connected to the vehicle-mounted computer, and may be connected to a hardware interface or a communication connection, as long as data intercommunication can be achieved, so that the solution described in the present invention can be implemented.
In some embodiments, after the step "playing the warning prompt and the scene music according to the warning instruction and the playing instruction", the method further includes: monitoring the local information; transmitting the local information to the music processing system, wherein the music processing system is used for processing the received local information so as to judge whether the condition information or the road condition information of the vehicle belongs to a second specified range; when the condition information or the road condition information of the vehicle does not belong to the second specified range, the music processing system generates a stop instruction; and receiving a stop instruction of the music processing system, and ending the music playing according to the stop instruction.
Further, the first designated range comprises a vehicle speed range in the condition information and a congestion level in the road condition information; the second specified range comprises a vehicle speed range in the condition information and a congestion level in the road condition information.
In one example, for example, the faster the driver inadvertently drives the vehicle away because there is no one on the road (i.e., the road conditions are excellent and the congestion condition is zero congestion). Accidents are easily caused by driving. In the invention, the face of the driver is collected by the camera, and the possible facial expression of the face is calm, for example; the voice input picked up by the microphone is zero (i.e., no voice input). The traffic information collected from the GPS system is zero congestion, while the vehicle speed is over speed (e.g., 140km/h) in the vehicle condition information determined from the vehicle-mounted computer. The vehicle-mounted computer collects the local information (including the face information of the driver, the voice input information, the road condition information, the vehicle condition information and the like), and transmits the local information to the music processing system. In this example, the music processing system may be a portable device (e.g., a smart phone) that is connected to the vehicle computer via bluetooth. After obtaining the local information, the portable device analyzes the current emotion of the driver and determines music matched with the emotion. For example, by the calm expression of the driver, zero congestion of road conditions, and speeding, music that is determined to be soft and relaxed is matched. The matching method may be machine learning training or may be a map generated by considering a predetermined condition. After determining the soft and relaxing music, the portable device (music processing system) transmits the playing instructions of the music back to the vehicle computer and is played by the playing device on the vehicle computer.
Based on the above, the vehicle responds by the local information. The vehicle response may include some adjustment to the current settings of the vehicle. For example, the vehicle speed is adjusted, and the playing of vehicle-mounted music (the vehicle-mounted music can be played by a vehicle-mounted computer, or can be played by a portable player connected through Bluetooth). To better determine the mood of the driver, the invention further provides a method for determining the mood of the driver of the vehicle and using the mood to generate a vehicle response. The method includes capturing a face of a driver by a camera of a vehicle; the camera is configured to capture facial images of a plurality of drivers over a period of time and analyze the plurality of images to identify facial expressions of the drivers and changes in the facial expressions over the period of time. Further, the facial expression includes changes in facial organs, such as frowning, closing eyes, and the like. In some embodiments, the method of determining a vehicle driver emotion and using the emotion to generate a vehicle response may further include capturing a driver's voice input by a microphone of the vehicle. The microphone is configured to capture voice input over a period of time. The speech input is analyzed to identify changes in the speech content and the driver's speech content over a period of time. The method processes, by a processor of the vehicle, one or a combination of a facial image and voice content captured over a period of time to predict an emotion of the driver. Based on the emotion monitoring, the method generates a vehicle response responsive to the driver's emotion. The vehicle response may be to make at least one adjustment to a setting of the vehicle. The adjustment is selected based on the mood of the driver. The vehicle response may be used to provide greater sedation to the driver and/or reduce distraction. In some embodiments, the vehicle response may also include a decrease in vehicle speed, a voice alert, and the like.
In some embodiments, the mood of the driver may include: normal, depressed, dysphoric, impatient, catatonic, sedating, drowsy, happy, excited, etc.
In a further embodiment, the pressure, the physiological condition, the heart rate, the body temperature and other driver information of the driver can be acquired through some wearable devices. As described above, the driver information may be categorized as local information and then transmitted to the music processing system for analysis and confirmation of the mood of the driver, and adjustment of the vehicle response based on the determined mood.
Based on the method, the invention can enable the vehicle-mounted computer or the music processing system to automatically play the slow or slow music when the vehicle speed is too fast. When the speed of the vehicle is lower than the lowest speed limit, the rapid or fast music is played. Normally playing under normal road conditions; and when the condition that the emotion of the driver is easily worsened, such as the condition of the congestion in the front, is monitored, the slow or slow music is played in advance. Meanwhile, the switching of music can also replace the voice prompt of the vehicle to a certain extent. For example, when there is a congested road condition in the front, the music in the vehicle is switched from sharp rock to soft light music, and the driver can quickly learn that the music is the road condition reminder provided by the vehicle-mounted computer according to the change of the style and rhythm of the music. The design can also enable music in the vehicle to be continuous without being interrupted intermittently by voice prompts.
In a further embodiment, detecting emotional information may also use a passive sensor that captures data about the physical state or behavior of the driver without requiring interpretation of the input. The data collected is similar to the cues that humans use to perceive the mood of others. For example, a camera may capture facial expressions, body gestures, and gestures, while a microphone may capture speech. Other sensors may detect emotional cues by directly measuring physiological data, such as skin temperature and current resistance. In some embodiments, a camera or infrared camera may detect temperature changes in a person's skin. For example, if the user feels stressed, blood flow to the person's face may rise or heat will be sensed from that person's face. In addition, the infrared camera can also identify the condition that the driver makes a trouble, for example, the driver is driven for a long time on a high-speed road condition or the driver is easy to make a trouble when the driver needs to enter a long tunnel, and the music with the fast rhythm is matched according to the method so as to disperse the tiredness of the driver.
In some embodiments, the vehicle response may further include: monitoring emotion information of a user on currently played music; wherein the music list for playing music comprises a plurality of music entries; when a refreshing operation that a user refreshes a current playing page is received, sorting the music items in the music list according to emotion information of a vehicle driver, condition information of a vehicle and road condition information of a road where the vehicle is located; and sending information of the N music items of the first N-bit sequence to the vehicle-mounted computer so as to generate a new music list comprising the N music items on the vehicle-mounted computer of the vehicle. The emotion information of the user to the currently played music comprises the playing time of the currently played music; wherein the longer the playing time is, the better the feedback of the vehicle driver to the playing music is.
When a refresh operation of refreshing a current playing page by a user is received, sorting all the subject posts according to a music list generated by vehicle response, an operation of the user on the current playing music within a preset time, and emotion information change of the current playing music by the user within the preset time, specifically comprising the following steps:
when a refreshing operation that a user refreshes a current playing page is received, the heat of all music items is updated according to a preset heat calculation rule, and all music items are sequenced according to the heat. Wherein the music items include music that the user has accessed within a predetermined time and music that the user has not accessed within a predetermined time.
The popularity of the music which is not played by the user within the preset time is generated according to the accumulated playing popularity within the first preset time and the newly added playing popularity within the second preset time; the accumulated playing heat is generated according to the accumulated playing number in a first preset time period, and the new increased playing heat is generated according to the new increased playing number in a second time period and the first weight.
For music played by a user within a preset time, generating the heat according to the accumulated playing heat within a first preset time and the newly added playing heat within a second time period; the accumulated playing heat is generated according to the accumulated playing number in a first preset time period, and the newly increased playing heat is generated according to the newly increased playing number in a second time period and a second weight; the second weight is greater than the first weight.
In a further embodiment, the music that the user has not played within the predetermined time is given a heat R1 of 1/N (a H1+ b H2). Wherein N is the number of consecutive times the music entry is displayed on the user's music list without being played by the user; h1 is the cumulative number of plays over a first predetermined period of time; h2 is the new number of plays in the second time period, a is the coefficient, and b is the first weight.
For music played by the user within a predetermined time, the popularity R2 ═ D (H2) × (a × H1+ c × H2); wherein when H2 is 0, D (H2) is 0, and when H2 is not 0, D (H2) is 1; c is a second weight. And c is generated according to the time of the user playing the music, wherein the longer the time of the user playing the music is, the larger c is.
In the embodiments described herein, the mood of the driver may be used to modify settings provided by the vehicle to provide a vehicle response, such as changing the playing music within the vehicle in response to the mood of the driver. In one embodiment, the sensor may be used to detect changes in the autonomic nervous system revealed by the driver's voice. For example, the way a driver changes his voice can be used as local information to generate a vehicle response that can affect his mood. For example, drivers are prone to faster speech rates and louder voices in fear, agitation, or pleasure. Other emotions such as fatigue, boredom or distress tend to cause slow down, bass and blurriness of speech. Different emotions will correspond to different speech patterns. In an embodiment of the invention, the processing system identifies the emotional state of the driver by processing by analyzing the speech patterns. The sound parameters and prosodic features such as pitch variation and speech rate may be analyzed by pattern recognition, for example using one or more microphones of the vehicle.
As noted, in addition to detecting the driver's voice, one or more cameras may also detect facial patterns, which may be used to detect and determine a particular mood of the vehicle driver. The embodiment of the invention can also form different face pattern modes so as to adaptively identify and confirm the emotion of the driver.
One or more cameras inside the vehicle may be used for face detection, pose detection, motion monitoring, light detection, color detection. In one configuration, the camera may be embedded in the dashboard of the vehicle, on the display screen of the vehicle, on the roof lining, or in several of these locations. In one embodiment, a stereo camera may be used to detect a volume in a vehicle or to monitor a volume of space in a vehicle. In one configuration, the gesture detection may be located where gesture detection will occur. For example, one or more cameras may be positioned to monitor locations near a center console, display screen, or some driver interface. While monitoring, the camera may capture a plurality of video frames that may be analyzed to determine what gesture the driver's hand or body has made. For example, the driver may make a clap gesture, and the direction of the clap gesture may be monitored by multiple cameras. In some habits, a clap gesture is often considered to be associated with drowsiness. The face is tapped to be awake. In this case, the clap gesture may be combined with other local information about the driver to confirm the emotional state of the driver in order to perform a corresponding vehicle response.
In some embodiments, the sensor may comprise a pressure sensor on the steering wheel. When the pressure sensor monitors the change of the force of the driver for gripping the steering wheel, the processing system can analyze the emotion change of the driver according to the change and by combining other information. For example, when stressed, the force for gripping the steering wheel may be increased from small to large; when the bicycle is relaxed, the force on the steering wheel is stable and small.
In some embodiments, the driver's mood can also be monitored by the above method. For example, when the driver is happy, the driver's seating and wheel gripping positions are relaxed; the driver has a rest in heart rate; the driver drives very normally compared to the historical driving; or a combination of two or more.
As shown in fig. 2, the system for monitoring and adjusting the emotion of the driver according to the embodiment of the present invention may include a vehicle-mounted computer 1, a camera 2, a microphone 3, a display 4, a portable device 5 connected to the vehicle-mounted computer 1 in bluetooth communication, and the like. The vehicle mount computer also includes a processor 11 and a memory 12. The camera 2, the microphone 3 and the display 4 are all connected with the vehicle-mounted computer 1, so that the vehicle-mounted computer 1 can collect local information. More specifically, the vehicle-mounted computer 1 is configured to monitor local information, where the local information includes status information of a vehicle, road condition information of a road where the vehicle is located, and emotion information of the driver, and then transmit the local information to the music processing system, where the music processing system is configured to process the received local information to determine whether the status information or the road condition information of the vehicle belongs to a first specified range. And when the condition information or the road condition information of the vehicle belongs to the first specified range, the music processing system generates an early warning prompt and scene music which are matched with the condition information or the road condition information. The vehicle-mounted computer 1 receives an early warning instruction and a playing instruction from the music processing system, the early warning instruction comprises an early warning prompt generated by the music processing system, and the playing instruction comprises scene music generated by the music processing system. And the vehicle-mounted computer 1 plays the early warning prompt and the scene music according to the early warning instruction and the playing instruction.
It should be understood that the music processing system may be a cloud server (not shown) or a portable device 5 of the driver, for example, the cloud server (not shown) is connected to the vehicle-mounted computer on the vehicle through a data network (e.g., GSM, CDMA, 4G, 5G network). In some embodiments, the music processing system may also be the vehicle computer itself. The collection of the local information may be performed by collecting voice input through the microphone 3, collecting facial images of the driver through the camera 2, collecting status information of the vehicle (for example, a vehicle speed, a driving time, and the like) through the vehicle-mounted computer 1, and collecting road condition information near the vehicle through a GPS system (not shown in the figure) of the vehicle. The GPS system may include a car navigator or may be a navigation application on a portable device (e.g., a smartphone) that communicates (e.g., bluetooth) with an on-board computer. It can be understood that the microphone 3, the camera 2, the navigator or the portable device 5 are all connected to the vehicle-mounted computer 1, and may be connected by a hardware interface or a communication connection, as long as data intercommunication can be achieved, so that the solution according to the present invention can be implemented.
In some embodiments, the vehicle-mounted computer is further configured to monitor the local information; transmitting the local information to the music processing system, wherein the music processing system is used for processing the received local information so as to judge whether the condition information or the road condition information of the vehicle belongs to a second specified range; when the condition information or the road condition information of the vehicle does not belong to the second specified range, the music processing system generates a stop instruction; and receiving a stop instruction of the music processing system, and ending the music playing according to the stop instruction.
Further, the first designated range comprises a vehicle speed range in the condition information and a congestion level in the road condition information; the second specified range comprises a vehicle speed range in the condition information and a congestion level in the road condition information.
In one example, for example, the faster the driver inadvertently drives the vehicle away because there is no one on the road (i.e., the road conditions are excellent and the congestion condition is zero congestion). Accidents are easily caused by driving. In the invention, the face of the driver is collected by the camera 2, and the possible facial expression of the face is calm, for example; the voice input picked up by the microphone 3 is zero (i.e., no voice input). The traffic information collected by the GPS system is zero congestion, and the vehicle speed is overspeed (e.g., 140km/h) in the vehicle condition information determined by the vehicle-mounted computer 1. The vehicle-mounted computer collects the local information (including the face information of the driver, the voice input information, the road condition information, the vehicle condition information and the like), and transmits the local information to the music processing system. In this example, the music processing system may be a portable device 5 (e.g., a smart phone), and the portable device 5 is connected to the in-vehicle computer 1 via bluetooth. After obtaining the local information, the portable device 5 analyzes the current emotion of the driver and determines music matching the emotion. For example, by the calm expression of the driver, zero congestion of road conditions, and speeding, music that is determined to be soft and relaxed is matched. The matching method may be machine learning training or may be a map generated by considering a predetermined condition. After determining the soft and relaxing music, the portable device 5 (music processing system) transmits a playback instruction of the music back to the vehicle mount computer 1 and is played back by a playback unit on the vehicle mount computer 1.
Based on the above, the vehicle responds by the local information. The vehicle response may include some adjustment to the current settings of the vehicle. For example, the vehicle speed is adjusted, and the playing of vehicle-mounted music (the vehicle-mounted music can be played by a vehicle-mounted computer, or can be played by a portable player connected through Bluetooth). To better determine the mood of the driver, the invention further provides a method for determining the mood of the driver of the vehicle and using the mood to generate a vehicle response. The method includes capturing a face of a driver by a camera of a vehicle; the camera is configured to capture facial images of a plurality of drivers over a period of time and analyze the plurality of images to identify facial expressions of the drivers and changes in the facial expressions over the period of time. Further, the facial expression includes changes in facial organs, such as frowning, closing eyes, and the like. In some embodiments, the method of determining a vehicle driver emotion and using the emotion to generate a vehicle response may further include capturing a driver's voice input by a microphone of the vehicle. The microphone is configured to capture voice input over a period of time. The speech input is analyzed to identify changes in the speech content and the driver's speech content over a period of time. The method processes, by a processor of the vehicle, one or a combination of a facial image and voice content captured over a period of time to predict an emotion of the driver. Based on the emotion monitoring, the method generates a vehicle response responsive to the driver's emotion. The vehicle response may be to make at least one adjustment to a setting of the vehicle. The adjustment is selected based on the mood of the driver. The vehicle response may be used to provide greater sedation to the driver and/or reduce distraction. In some embodiments, the vehicle response may also include a decrease in vehicle speed, a voice alert, and the like.
In some embodiments, the mood of the driver may include: normal, depressed, dysphoric, impatient, catatonic, sedating, drowsy, happy, excited, etc.
In a further embodiment, the pressure, the physiological condition, the heart rate, the body temperature and other driver information of the driver can be acquired through some wearable devices. As described above, the driver information may be categorized as local information and then transmitted to the music processing system for analysis and confirmation of the mood of the driver, and adjustment of the vehicle response based on the determined mood.
Based on the method, the invention can enable the vehicle-mounted computer 1 or the music processing system to automatically play the slow or slow music when the vehicle speed is too fast. When the speed of the vehicle is lower than the lowest speed limit, the rapid or fast music is played. Normally playing under normal road conditions; and when the condition that the emotion of the driver is easily worsened, such as the condition of the congestion in the front, is monitored, the slow or slow music is played in advance. Meanwhile, the switching of music can also replace the voice prompt of the vehicle to a certain extent. For example, when there is a traffic jam in the front, the music in the vehicle is switched from sharp rock to soft light music, and the driver can quickly learn that the music is the traffic condition reminder provided by the vehicle-mounted computer 1 according to the change of the style and rhythm of the music. The design can also enable music in the vehicle to be continuous without being interrupted intermittently by voice prompts.
In further embodiments, detecting emotional information may also use passive sensors. I.e. the monitoring system described in fig. 2 may also comprise passive sensors. The passive sensor captures data about the physical state or behavior of the driver without requiring interpretation of the input. The data collected is similar to the cues that humans use to perceive the mood of others. For example, camera 2 may capture facial expressions, body gestures, and gestures, while microphone 3 may capture speech. Other sensors (not shown in the figures) may detect emotional cues by directly measuring physiological data, such as skin temperature and current resistance. In some embodiments, a camera or infrared camera may detect temperature changes in a person's skin. For example, if the user feels stressed, blood flow to the person's face may rise or heat will be sensed from that person's face. In addition, the infrared camera can also identify the condition that the driver makes a trouble, for example, the driver is driven for a long time on a high-speed road condition or the driver is easy to make a trouble when the driver needs to enter a long tunnel, and the music with the fast rhythm is matched according to the method so as to disperse the tiredness of the driver.
In the embodiments described herein, the mood of the driver may be used to modify settings provided by the vehicle to provide a vehicle response, such as changing the playing music within the vehicle in response to the mood of the driver. In one embodiment, the sensor may be used to detect changes in the autonomic nervous system revealed by the driver's voice. For example, the way a driver changes his voice can be used as local information to generate a vehicle response that can affect his mood. For example, drivers are prone to faster speech rates and louder voices in fear, agitation, or pleasure. Other emotions such as fatigue, boredom or distress tend to cause slow down, bass and blurriness of speech. Different emotions will correspond to different speech patterns. In an embodiment of the invention, the processing system identifies the emotional state of the driver by processing by analyzing the speech patterns. The sound parameters and prosodic features such as pitch variation and speech rate may be analyzed by pattern recognition, for example using one or more microphones of the vehicle.
As noted, in addition to detecting the driver's voice, one or more cameras may also detect facial patterns, which may be used to detect and determine a particular mood of the vehicle driver. The embodiment of the invention can also form different face pattern modes so as to adaptively identify and confirm the emotion of the driver.
One or more cameras 2 inside the vehicle may be used for face detection, pose detection, motion monitoring, light detection, color detection. In one configuration, the camera 2 may be embedded in the dashboard of the vehicle, on the display screen of the vehicle, on the roof lining, or in several of these locations. In one embodiment, a stereo camera may be used to detect a volume in a vehicle or to monitor a volume of space in a vehicle. In one configuration, the gesture detection may be located where gesture detection will occur. For example, one or more cameras may be positioned to monitor locations near a center console, display screen, or some driver interface. While monitoring, camera 2 may capture a plurality of video frames that may be analyzed to determine what gesture the driver's hand or body has made. For example, the driver may make a clap gesture, and the direction of the clap gesture may be monitored by multiple cameras. In some habits, a clap gesture is often considered to be associated with drowsiness. The face is tapped to be awake. In this case, the clap gesture may be combined with other local information about the driver to confirm the emotional state of the driver in order to perform a corresponding vehicle response.
In some embodiments, the sensor may comprise a pressure sensor on the steering wheel. When the pressure sensor monitors the change of the force of the driver for gripping the steering wheel, the processing system can analyze the emotion change of the driver according to the change and by combining other information. For example, when stressed, the force for gripping the steering wheel may be increased from small to large; when the bicycle is relaxed, the force on the steering wheel is stable and small.
In some embodiments, the driver's mood can also be monitored by the above method. For example, when the driver is happy, the driver's seating and wheel gripping positions are relaxed; the driver has a rest in heart rate; the driver drives very normally compared to the historical driving; or a combination of two or more.
An embodiment of the present invention further provides a terminal device for implementing emotion monitoring and adjustment of a vehicle driver, including a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, for example: the vehicle driver emotion monitors and adjusts the procedure. The processor, when executing the computer program, implements the steps of the method for regulating emotion monitoring of a vehicle driver as described in the above embodiments, such as steps S1-S5 shown in fig. 1.
Illustratively, the computer program may be partitioned into one or more modules that are stored in the memory and executed by the processor to implement the invention. The one or more modules can be a series of instruction segments of a computer program capable of implementing specific functions, and the instruction segments are used for describing the execution process of the computer program in the terminal equipment for realizing the vehicle driving emotion monitoring and adjusting.
The terminal device may include, but is not limited to, a processor, a memory, and a display. It will be understood by those skilled in the art that the schematic diagram is merely an example of a terminal device for implementing vehicle driver emotion monitoring adjustment, and does not constitute a limitation on the terminal device for implementing vehicle driver emotion monitoring adjustment, and may include more or less components than those shown, or combine some components, or different components, for example, the terminal device for implementing vehicle driver emotion monitoring adjustment may further include an input-output device, a network access device, a bus, etc.
The Processor may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components, etc. The general processor can be a microprocessor or the processor can be any conventional processor, and the processor is a control center of the terminal equipment for realizing the vehicle driver emotion monitoring and adjusting, and various interfaces and lines are utilized to connect all parts of the terminal equipment for realizing the vehicle driver emotion monitoring and adjusting.
The memory can be used for storing the computer program and/or the module, and the processor can realize various functions of the terminal equipment for monitoring and adjusting the vehicle driving emotion by running or executing the computer program and/or the module stored in the memory and calling the data stored in the memory. The memory may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, a text conversion function, etc.), and the like; the storage data area may store data (such as audio data, text message data, etc.) created according to the use of the cellular phone, etc. In addition, the memory may include high speed random access memory, and may also include non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), at least one magnetic disk storage device, a Flash memory device, or other volatile solid state storage device.
The module of the terminal device for realizing the vehicle driver emotion monitoring and adjusting can be stored in a computer readable storage medium if the module is realized in the form of a software functional unit and sold or used as an independent product. Based on such understanding, all or part of the flow of the method according to the embodiments of the present invention may also be implemented by a computer program, which may be stored in a computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method embodiments may be implemented. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, and the like. It should be noted that the computer readable medium may contain content that is subject to appropriate increase or decrease as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable media does not include electrical carrier signals and telecommunications signals as is required by legislation and patent practice.
It should be noted that the above-described device embodiments are merely illustrative, where the units described as separate parts may or may not be physically separate, and the parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. In addition, in the drawings of the embodiment of the apparatus provided by the present invention, the connection relationship between the modules indicates that there is a communication connection between them, and may be specifically implemented as one or more communication buses or signal lines. One of ordinary skill in the art can understand and implement it without inventive effort.
The above description is only for the specific embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive various changes or substitutions within the technical scope of the present invention, and these should be covered by the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the appended claims.
Claims (10)
1. A monitoring and adjusting method for the emotion of a driver is characterized by comprising the following steps:
monitoring local information, wherein the local information comprises condition information of a vehicle, road condition information of a road where the vehicle is located and emotion information of a vehicle driver;
transmitting the local information to a music processing system, wherein the music processing system is used for processing the received local information so as to judge whether the condition information or the road condition information of the vehicle belongs to a first specified range; when the condition information or the road condition information of the vehicle belongs to the first designated range, the music processing system generates an early warning prompt and scene music which are matched with the condition information or the road condition information;
receiving an early warning instruction and a playing instruction from the music processing system, wherein the early warning instruction comprises an early warning prompt generated by the music processing system, and the playing instruction comprises scene music generated by the music processing system; and
and playing the early warning prompt and the scene music according to the early warning instruction and the playing instruction.
2. The method of claim 1, wherein after the step of playing the alert prompt and the scene music according to the alert instruction and the play instruction, further comprising:
monitoring the local information;
transmitting the local information to the music processing system, wherein the music processing system is used for processing the received local information so as to judge whether the condition information or the road condition information of the vehicle belongs to a second specified range; when the condition information or the road condition information of the vehicle does not belong to the second specified range, the music processing system generates a stop instruction;
and receiving a stop instruction of the music processing system, and ending the music playing according to the stop instruction.
3. The method according to claim 1, wherein the first specified range includes a vehicle speed range in the condition information, a congestion level in the road condition information; the second specified range comprises a vehicle speed range in the condition information and a congestion level in the road condition information.
4. The method of claim 1, wherein the method further comprises:
capturing, by the camera, a face of the vehicle driver; the camera is configured to capture facial images of a plurality of drivers over a period of time and analyze the plurality of images to identify facial expressions of the drivers and changes in the facial expressions over the period of time; wherein the facial expression includes changes in facial organs.
5. The method of claim 1, wherein the method further comprises:
monitoring emotion information of a user on currently played music; wherein the music list for playing music comprises a plurality of music entries;
when a refreshing operation that a user refreshes a current playing page is received, sorting the music items in the music list according to emotion information of a vehicle driver, condition information of a vehicle and road condition information of a road where the vehicle is located;
and sending information of the N music items of the first N-bit sequence to the vehicle-mounted computer so as to generate a new music list comprising the N music items on the vehicle-mounted computer of the vehicle.
6. The method as claimed in claim 5, wherein when receiving a refresh operation of refreshing the currently playing page by the user, sorting all the posts according to the music list generated by the vehicle response, the operation of the user on the currently playing music within the predetermined time, and the emotion information change of the currently playing music by the user within the predetermined time, specifically comprises:
when a refreshing operation that a user refreshes a current playing page is received, the heat of all music items is updated according to a preset heat calculation rule, and all music items are sequenced according to the heat; wherein the music items comprise music accessed by the user within a preset time and music not accessed by the user within a preset time;
the popularity of the music which is not played by the user within the preset time is generated according to the accumulated playing popularity within the first preset time and the newly added playing popularity within the second preset time; the accumulated playing heat is generated according to the accumulated playing number in a first preset time period, and the new playing amount increasing heat is generated according to the new added playing number in a second time period and the first weight;
for music played by a user within a preset time, generating the heat according to the accumulated playing heat within a first preset time and the newly added playing heat within a second time period; the accumulated playing heat is generated according to the accumulated playing number in a first preset time period, and the newly increased playing heat is generated according to the newly increased playing number in a second time period and a second weight; the second weight is greater than the first weight.
7. The utility model provides a control governing system of driver's mood, its characterized in that, the system includes on-vehicle computer, camera, GPS system, the camera with GPS system all with on-vehicle computer is connected: the vehicle mount computer comprising a processor and a memory, wherein the processor of the vehicle mount computer is configured to:
monitoring local information, wherein the local information comprises condition information of a vehicle, road condition information of a road where the vehicle is located and emotion information of a vehicle driver;
transmitting the local information to a music processing system, wherein the music processing system is used for processing the received local information so as to judge whether the condition information or the road condition information of the vehicle belongs to a first specified range; when the condition information or the road condition information of the vehicle belongs to the first designated range, the music processing system generates an early warning prompt and scene music which are matched with the condition information or the road condition information;
receiving an early warning instruction and a playing instruction from the music processing system, wherein the early warning instruction comprises an early warning prompt generated by the music processing system, and the playing instruction comprises scene music generated by the music processing system; and
and playing the early warning prompt and the scene music according to the early warning instruction and the playing instruction.
8. The system of claim 7, wherein the processor of the vehicle mount computer is further configured to:
monitoring the local information;
transmitting the local information to the music processing system, wherein the music processing system is used for processing the received local information so as to judge whether the condition information or the road condition information of the vehicle belongs to a second specified range; when the condition information or the road condition information of the vehicle does not belong to the second specified range, the music processing system generates a stop instruction;
and receiving a stop instruction of the music processing system, and ending the music playing according to the stop instruction.
9. The system of claim 7, wherein the processing of the on-board computer is further configured for:
monitoring emotion information of a user on currently played music; wherein the music list for playing music comprises a plurality of music entries;
when a refreshing operation that a user refreshes a current playing page is received, sorting the music items in the music list according to emotion information of a vehicle driver, condition information of a vehicle and road condition information of a road where the vehicle is located;
and sending information of the N music items of the first N-bit sequence to the vehicle-mounted computer so as to generate a new music list comprising the N music items on the vehicle-mounted computer of the vehicle.
10. The system of claim 9, wherein when a refresh operation of refreshing the currently playing page by the user is received, all the posts are sorted according to the music list generated by the vehicle response, the operation of the user on the currently playing music within the preset time, and the emotion information change of the currently playing music by the user within the preset time, and the method specifically comprises the following steps:
when a refreshing operation that a user refreshes a current playing page is received, the heat of all music items is updated according to a preset heat calculation rule, and all music items are sequenced according to the heat; wherein the music items comprise music accessed by the user within a preset time and music not accessed by the user within a preset time;
the popularity of the music which is not played by the user within the preset time is generated according to the accumulated playing popularity within the first preset time and the newly added playing popularity within the second preset time; the accumulated playing heat is generated according to the accumulated playing number in a first preset time period, and the new playing amount increasing heat is generated according to the new added playing number in a second time period and the first weight;
for music played by a user within a preset time, generating the heat according to the accumulated playing heat within a first preset time and the newly added playing heat within a second time period; the accumulated playing heat is generated according to the accumulated playing number in a first preset time period, and the newly increased playing heat is generated according to the newly increased playing number in a second time period and a second weight; the second weight is greater than the first weight.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010500507.9A CN111783550B (en) | 2020-06-04 | 2020-06-04 | Monitoring and adjusting method and system for emotion of driver |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010500507.9A CN111783550B (en) | 2020-06-04 | 2020-06-04 | Monitoring and adjusting method and system for emotion of driver |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111783550A true CN111783550A (en) | 2020-10-16 |
| CN111783550B CN111783550B (en) | 2023-12-01 |
Family
ID=72754028
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010500507.9A Active CN111783550B (en) | 2020-06-04 | 2020-06-04 | Monitoring and adjusting method and system for emotion of driver |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111783550B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104409085A (en) * | 2014-11-24 | 2015-03-11 | 惠州Tcl移动通信有限公司 | Vehicle-mounted intelligent music player and music playing method thereof |
| CN104417457A (en) * | 2013-08-20 | 2015-03-18 | 哈曼国际工业有限公司 | Driver assistance system |
| KR20160051922A (en) * | 2014-10-29 | 2016-05-12 | 현대자동차주식회사 | Music recommendation system for vehicle and method thereof |
| CN106302678A (en) * | 2016-08-08 | 2017-01-04 | 北京谱思科技有限公司 | A kind of music recommends method and device |
| US20180204570A1 (en) * | 2017-01-19 | 2018-07-19 | Toyota Motor Engineering & Manufacturing North America, Inc. | Adaptive infotainment system based on vehicle surrounding and driver mood and/or behavior |
| CN108319635A (en) * | 2017-12-15 | 2018-07-24 | 海南智媒云图科技股份有限公司 | A kind of multi-platform music sources integrate method, electronic equipment and the storage medium of broadcasting |
| CN109446375A (en) * | 2018-10-29 | 2019-03-08 | 广州小鹏汽车科技有限公司 | Adaptive method for playing music and system applied to vehicle |
-
2020
- 2020-06-04 CN CN202010500507.9A patent/CN111783550B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104417457A (en) * | 2013-08-20 | 2015-03-18 | 哈曼国际工业有限公司 | Driver assistance system |
| KR20160051922A (en) * | 2014-10-29 | 2016-05-12 | 현대자동차주식회사 | Music recommendation system for vehicle and method thereof |
| CN104409085A (en) * | 2014-11-24 | 2015-03-11 | 惠州Tcl移动通信有限公司 | Vehicle-mounted intelligent music player and music playing method thereof |
| CN106302678A (en) * | 2016-08-08 | 2017-01-04 | 北京谱思科技有限公司 | A kind of music recommends method and device |
| US20180204570A1 (en) * | 2017-01-19 | 2018-07-19 | Toyota Motor Engineering & Manufacturing North America, Inc. | Adaptive infotainment system based on vehicle surrounding and driver mood and/or behavior |
| CN108319635A (en) * | 2017-12-15 | 2018-07-24 | 海南智媒云图科技股份有限公司 | A kind of multi-platform music sources integrate method, electronic equipment and the storage medium of broadcasting |
| CN109446375A (en) * | 2018-10-29 | 2019-03-08 | 广州小鹏汽车科技有限公司 | Adaptive method for playing music and system applied to vehicle |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111783550B (en) | 2023-12-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20210268902A1 (en) | Driving assistance apparatus and driving assistance method | |
| US11249544B2 (en) | Methods and systems for using artificial intelligence to evaluate, correct, and monitor user attentiveness | |
| US10493914B2 (en) | System and method for vehicle collision mitigation with vulnerable road user context sensing | |
| US10399575B2 (en) | Cognitive load driving assistant | |
| US10046618B2 (en) | System and method for vehicle control integrating environmental conditions | |
| CN105488957B (en) | Method for detecting fatigue driving and device | |
| EP2857276B1 (en) | Driver assistance system | |
| US20180174457A1 (en) | Method and system using machine learning to determine an automotive driver's emotional state | |
| KR20200123183A (en) | Methods, devices and electronic devices for monitoring driver attention | |
| US20160267335A1 (en) | Driver distraction detection system | |
| US10259464B2 (en) | Control for an electronic multi-function apparatus | |
| US11702103B2 (en) | Affective-cognitive load based digital assistant | |
| US11211095B1 (en) | Modifying media content playback based on user mental state | |
| JP2018045303A (en) | Driving assist system | |
| WO2021067380A1 (en) | Methods and systems for using artificial intelligence to evaluate, correct, and monitor user attentiveness | |
| JP6267563B2 (en) | Driving support device and driving support method | |
| CN111783550B (en) | Monitoring and adjusting method and system for emotion of driver | |
| US11383640B2 (en) | Techniques for automatically reducing annoyance levels of drivers when using driver monitoring systems | |
| US20200298865A1 (en) | Vehicle Environmental Controlling | |
| CN111292493A (en) | Vibration reminding method, device, electronic equipment and system | |
| JP2024026816A (en) | Information processing system, information processing device, information processing method, and program | |
| CN116248701A (en) | Prompt method and device, electronic equipment and vehicle | |
| CN117719445A (en) | User emotion adjustment method, device, vehicle and storage medium | |
| CN110525443A (en) | Method and apparatus for identifying the fatigue of the driver of vehicle in a mobile device | |
| CN114386763A (en) | Vehicle interaction method, vehicle interaction device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |