CN117141512A - Control method and device for vehicle-mounted emotion regulation system - Google Patents

Abstract

This application relates to the field of automotive technology and provides a control method, device, electronic equipment and readable storage medium for a vehicle-mounted emotion regulation system. The method includes: obtaining the driving information of other vehicles through the camera of the target vehicle, wherein the other vehicles are located within a preset range of the target vehicle; determining whether the other vehicles are driving irregularly based on the driving information; When it is determined that the other vehicle is driving irregularly, the multi-modal information of the driver of the target vehicle and the capacitance value collected by the capacitive sensor installed at the steering wheel of the target vehicle are obtained. Based on the multi-modal The information and the capacitance value determine the current driver's emotion label; based on the emotion label, the vehicle-mounted emotion adjustment system is controlled. The embodiments of the present application solve the problem that the existing technology cannot adjust the driver's emotions.

Description

Control method and device for vehicle-mounted emotion regulation system

Technical field

The present application relates to the field of automobile safety technology, and in particular to a control method, device, electronic equipment and readable storage medium for a vehicle-mounted emotion regulation system.

Background technique

With the continuous improvement of the automobile industry and people's living standards, automobiles have become an indispensable travel tool in people's lives, which greatly facilitates daily life. However, with the increase in car ownership, some travel-related problems have also emerged, such as illegal driving on the road and some irrational driving behaviors of some surrounding vehicles, which can easily cause driving problems. Emotional changes of employees.

The existing technology generally uses the driver's naked eyes to determine whether other vehicles are driving erratically. Although this method is a common response method, it has some limitations. First of all, there are subjective and individual differences in driver's visual judgment. Different people may have different definitions and evaluation standards for irregular driving, leading to inconsistency in judgment results. Secondly, the driver's emotional reaction to the irregular driving of other vehicles may interfere with his decision-making and driving operations. Angry emotions while driving will also seriously affect the driving safety of the vehicle, and will also pose a threat to surrounding vehicles and pedestrians. posed a serious security threat.

It can be seen that there is a problem in the related technology that the driver's emotions cannot be adjusted.

Contents of the invention

In view of this, embodiments of the present application provide a control method, device, electronic device, and readable storage medium for a vehicle-mounted emotion adjustment system to solve the problem that the existing technology cannot adjust the driver's emotion.

A first aspect of the embodiment of the present application provides a control method for a vehicle-mounted emotion adjustment system, including:

Obtain the driving information of other vehicles within the preset range through the camera of the target vehicle; determine whether the other vehicles are driving irregularly based on the driving information; when it is determined that the other vehicles are driving irregularly, obtain all The multi-modal information of the driver of the target vehicle and the capacitance value collected by the capacitance sensor installed at the steering wheel of the target vehicle are used to determine the current driver's emotion tag based on the multi-modal information and the capacitance value; The emotion tag controls the vehicle-mounted emotion adjustment system, wherein the vehicle-mounted emotion adjustment system includes vehicle-mounted music and vehicle-mounted atmosphere lights.

A second aspect of the embodiment of the present application provides a control device for a vehicle-mounted emotion adjustment system, including:

The first acquisition module is configured to acquire the driving information of other vehicles within the preset range through the camera of the target vehicle; the determination module is configured to determine whether the other vehicles are driving irregularly based on the driving information; the second an acquisition module, configured to acquire the multi-modal information of the driver of the target vehicle and the capacitance value collected by the capacitance sensor installed at the steering wheel of the target vehicle when it is determined that the other vehicle is driving irregularly. , determining the current driver's emotion tag based on the multi-modal information and the capacitance value; the control module is configured to control the vehicle-mounted emotion adjustment system based on the emotion tag, wherein the vehicle-mounted emotion adjustment system Including car music and car ambient lighting.

A third aspect of the embodiment of the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the steps of the above method are implemented.

A fourth aspect of the embodiments of the present application provides a readable storage medium. The readable storage medium stores a computer program. When the computer program is executed by a processor, the steps of the above method are implemented.

Compared with the prior art, the beneficial effects of the embodiments of the present application are:

Obtain the driving information of other vehicles within the preset range through the camera of the target vehicle, and determine whether the other vehicles are driving irregularly based on the driving information; when it is determined that other vehicles are driving irregularly, obtain the number of drivers of the target vehicle. Modal information and the capacitance value collected by the capacitance sensor installed at the steering wheel of the target vehicle are used to determine the current driver's emotion label based on the multi-modal information and capacitance value; based on the emotion label, the vehicle-mounted emotion adjustment system is controlled, in which the vehicle-mounted emotion The adjustment system includes car music and car ambient lighting. It allows the car music and lights to be appropriately adjusted according to the driver's emotional state to create a better driving environment, which helps to alleviate the driver's anger and impulsive emotions, improve driving comfort and pleasure, and reduce the risk of accidents caused by other vehicles. Intense driving and illegal driving behaviors caused by irregular driving, thereby improving the smoothness and safety of the road and improving driving safety.

Description of the drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments or description of the prior art will be briefly introduced below. Obviously, the drawings in the following description are only for the purpose of the present application. For some embodiments, for those of ordinary skill in the art, other drawings can be obtained based on these drawings without exerting creative efforts.

Figure 1 is a schematic flowchart of a control method of a vehicle-mounted emotion adjustment system provided by an embodiment of the present application;

Figure 2 is a schematic diagram of the module working of a control method for a vehicle-mounted emotion regulation system provided by an embodiment of the present application;

Figure 3 is a schematic structural diagram of a control device of a vehicle-mounted emotion adjustment system provided by an embodiment of the present application.

FIG. 4 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.

Detailed ways

In the following description, for the purpose of explanation rather than limitation, specific details such as specific system structures and technologies are provided to provide a thorough understanding of the embodiments of the present application. However, it will be apparent to those skilled in the art that the present application may be practiced in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.

The terms "first", "second", etc. in the description and claims of this application are used to distinguish similar objects and are not used to describe a specific order or sequence. It is to be understood that data so used are interchangeable under appropriate circumstances so that the embodiments of the present application can be practiced in orders other than those illustrated or described herein, and that "first", "second", etc. are distinguished objects It is usually one type, and the number of objects is not limited. For example, the first object can be one or multiple. In addition, "and/or" in the description and claims indicates at least one of the connected objects, and the character "/" generally indicates that the related objects are in an "or" relationship.

Furthermore, it should be noted that the terms "comprising," "comprising," or any other variation thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that includes a list of elements not only includes those elements, but also includes Other elements are not expressly listed or are inherent to the process, method, article or equipment. Without further limitation, an element defined by the statement "including..." does not exclude the presence of additional identical elements in the process, method, article, or device that includes the element.

The control method, device, electronic device and readable storage medium of the vehicle-mounted emotion adjustment system according to the embodiment of the present application will be described in detail below with reference to the accompanying drawings.

Figure 1 is a schematic flowchart of a control method for a vehicle-mounted emotion adjustment system provided by an embodiment of the present application. The control method of the vehicle emotion regulation system in Figure 1 can be executed by the vehicle controller. As shown in Figure 1, the method includes:

S101, obtain the driving information of other vehicles within the preset range through the camera of the target vehicle;

Other vehicles are located within the preset range of the target vehicle (for example, within 10 meters around).

The target vehicle is a vehicle that is in normal driving condition on the road and can be used as a reference vehicle.

Through the camera installed on the front of the target vehicle, the driving conditions of other vehicles traveling within the preset range of the target vehicle can be captured in real time. By analyzing the image or video data, the location and movement information of other vehicles can be extracted, for example, Vehicle trajectory, speed information, etc. In addition, the global positioning system or inertial measurement unit can also be used to obtain the driving information of other vehicles. The acquisition method is not specifically limited here.

Driving information refers to the record of the vehicle's movement path over a period of time, which can include the vehicle's longitude and latitude coordinates, speed, acceleration, and time-related trajectory data.

In this way, this step uses the camera of the target vehicle to obtain the driving information of other vehicles within the preset range of the target vehicle, which can help the driver understand and predict the behavior of other vehicles so that corresponding measures can be taken to improve driving safety.

S102: Determine whether other vehicles are driving irregularly based on the driving information.

Irregular driving refers to the irregularity of the driving behavior of other vehicles, including unstable speed changes, frequent lane changes, sudden braking, sudden acceleration, etc. Irregular driving may indicate the driver's bad driving habits or abnormal current driving behavior. Safety hazards or violations of normal traffic behavior.

The determination of irregular driving can be used as an evaluation indicator of driving behavior to monitor traffic violations and driving safety conditions. In addition, irregular driving may also indicate the deliberate behavior of other vehicles. For example, the driver of other vehicles may be dissatisfied with the target. The driving speed or driving behavior of the vehicle, and intentionally trying to drive to the target vehicle to perform frequent lane changes, sudden braking and other driving behaviors will bring great safety risks.

In addition, to determine the irregular driving of the vehicle in front, the trajectory data of the vehicle can be compressed through the trajectory compression algorithm, reducing the amount of data stored and transmitted, while maintaining the important characteristics of the trajectory. The vehicle's driving trajectory can also be analyzed through the trajectory analysis algorithm, and the driving speed, acceleration, dwell time and other information of other vehicles can be extracted, which can be used to analyze and evaluate the driving behavior of other vehicles and help realize the analysis of the driving trajectories of other vehicles. For accurate acquisition and effective processing, it should be noted that different application scenarios and requirements may use different algorithm combinations, which are not specifically limited here.

In this way, by analyzing the driving information of other vehicles, this step can detect some irregular driving characteristics, such as drastic changes in speed, frequent lane changes, emergency braking, etc. These characteristics can be used to determine the stability and safety of driving behavior. characteristics, and further compare with the normal driving pattern to determine whether other vehicles have irregular driving characteristics.

S103, when it is determined that other vehicles are driving irregularly, obtain the multi-modal information of the driver of the target vehicle and the capacitance value collected by the capacitance sensor installed at the steering wheel of the target vehicle, and determine based on the multi-modal information and the capacitance value The current driver's emotion label.

Other vehicles are vehicles that are deemed to be driving erratically under certain circumstances and may violate traffic rules or exhibit other abnormal driving behaviors.

When it is determined that the driving behavior of the vehicle in front is irregular, multi-modal information of the driver of the target vehicle is obtained. This multi-modal information can include voice, posture, facial expressions, etc. By analyzing this information, possible emotional labels of the driver can be identified, such as anxiety, anger, calmness, etc.

In addition, a capacitive sensor installed on the steering wheel can detect the tightness of the hand holding the steering wheel. Changes in capacitance value can be measured by capacitive sensors, and the tightness of the hand holding the steering wheel will cause changes in capacitance value. By reading the value of the capacitive sensor, the system can determine how tightly the steering wheel is held.

During driving, sudden changes in emotions may cause some physical reactions. When people feel strong emotions such as anxiety, anger, tension, etc., the physical reactions may be strengthened, including the contraction and clenching of hand muscles. In this situation, the driver may subconsciously tighten his grip on the steering wheel to increase a sense of control and security.

In this step, when it is determined that other vehicles are driving erratically, by obtaining the multi-modal information of the driver of the target vehicle and the capacitance value collected by the capacitive sensor installed on the steering wheel of the target vehicle, the possible driving behavior of the driver can be more accurately determined. Emotional state to help drivers better cope with erratic driving behavior and thereby improve road safety.

S104: Control the vehicle-mounted emotion regulation system based on emotion tags.

Among them, the vehicle mood adjustment system includes vehicle music and vehicle atmosphere lighting.

The emotion tag indicates the real-time emotional state of the target vehicle driver.

The in-vehicle emotion regulation system can affect the driver's mood and emotional state through sound, color and other sensory elements, thereby improving the driving experience and safety. It can help the driver stay relaxed, focused, calm or boosted during driving. To better adapt to different driving conditions and scenarios, the system can use biofeedback, environmental perception and intelligent control technology to automatically adjust according to the driver's psychological state and environmental conditions. For example, when the driver feels angry or stressed, he can play soft music through the car music to help him relax and recover; when the driver needs to stay alert, he can provide energetic music and adjust the lighting through the car music and car atmosphere lights. effect to boost their mental state.

It should be noted that the vehicle-mounted emotion regulation system may include other devices with emotion regulation functions in the target vehicle, such as in-vehicle fragrance systems, massage systems, etc. in the target vehicle.

In this way, by determining the driver's emotional tag and controlling the on-board emotion adjustment system, the driver's emotional state can be adjusted accordingly to balance the driver's emotions and avoid the driver's failure due to the irregular driving behavior of other vehicles. bring about excessive driving behavior, thus improving driving safety.

This embodiment obtains the driving information of other vehicles through the camera of the target vehicle, determines whether it is driving irregularly, and further obtains the multi-modal information and capacitive sensor of the driver of the target vehicle when it is determined that it is driving irregularly. The collected capacitance value determines the current driver's emotional label based on the multi-modal information and capacitance value, and controls the in-vehicle music and in-vehicle ambient lighting, so that the in-vehicle music and in-vehicle lighting can be appropriately adjusted according to the driver's emotional state. Creating a better driving environment can help alleviate driver anger and impulsive emotions, improve driving comfort and pleasure, reduce violent driving and illegal driving behaviors caused by the irregular driving of other vehicles, thereby improving roads The smoothness and safety improve driving safety.

In some embodiments, before obtaining the driving information of other vehicles through the camera of the target vehicle, the method further includes:

Obtain the navigation information of the target vehicle;

According to the navigation information, when it is determined that there is no traffic jam scene on the road where the target vehicle is traveling, the driving information of other vehicles is obtained through the camera of the target vehicle.

Specifically, the navigation information is the target vehicle's driving route, destination and other related guidance information. It can also provide real-time traffic conditions, including traffic flow and congestion on the current road.

Driving roads may include city streets, highways, rural roads, etc., which are not specifically limited here.

In a traffic jam scenario, judging whether other vehicles have irregular driving behavior may be affected to some extent, because the driving characteristics and restrictions in a traffic jam environment are different from those on smooth roads. In a traffic jam scenario, due to the high traffic density and slow speed, driving Drivers often need to keep a small distance between the target vehicle and surrounding vehicles to comply with traffic flow, so that the irregular driving behavior of vehicles within the preset range (such as frequent lane changes or sudden braking) will have a smaller impact range, so In a traffic jam scenario, there is no need to detect whether vehicles within a preset range have irregular driving behavior.

This embodiment obtains the navigation information of the target vehicle, and based on the navigation information, when it is determined that there is no traffic jam scene on the road where the target vehicle is traveling, the driving information of other vehicles is obtained through the camera of the target vehicle, and other vehicles are also obtained in the avoided traffic jam scene. The vehicle's driving information is used to reduce the computational complexity of the target vehicle's judgment of the driving information of other vehicles.

In addition, in some embodiments, based on the driving information, it is determined whether other vehicles are driving irregularly, including three situations:

In the first case, if the driving position of other vehicles changes from behind the target vehicle to in front of the target vehicle within the first preset time, and the driving speed drops to the dangerous speed threshold, it is determined that the other vehicles are driving erratically.

Specifically, the first preset time refers to a specific time period that is set or assumed in advance and is used to determine the driving situation of the vehicle.

If the target vehicle's driving position within the preset time is in front of other vehicles, and the driving position of other vehicles changes from behind the target vehicle to in front of the target vehicle within the same time, then it can be judged that the driving position of the other vehicles has changed. While the driving position changes, if the driving speed of other vehicles drops below the dangerous speed threshold, that is, the speed is lower than a certain safety threshold, it can be determined that the other vehicles are driving erratically. Under normal circumstances, a normally driving vehicle will not frequently change its position during driving and will maintain a safe driving speed. Therefore, when the position of other vehicles changes and the driving speed drops below the dangerous speed threshold, it can be determined that other vehicles are moving at a safe speed. Abnormal vehicle driving will affect the driving safety of the target vehicle.

In the second case, if other vehicles do not turn on their turn indicators and continuously change lanes to the front of the target vehicle, and the separation distance is less than the preset safe driving distance, then the other vehicles are determined to be driving erratically.

Specifically, the turn indicator is used to remind traffic participants of the possible driving behavior of other vehicles. The number of lane changes is the number of times other vehicles switch lanes during driving, indicating the frequency of vehicles changing driving directions or selecting lanes.

The separation distance can be a preset specific distance, which is used to determine whether the distance between other vehicles and the target vehicle is less than the set safe driving distance to avoid collisions or dangerous situations with other vehicles.

It should be noted that the above preset values can be obtained based on the research and analysis of road traffic rules and driving behavior to ensure smooth and safe driving. The specific preset values are not specifically limited here.

As an example, to determine whether a vehicle continuously changes lanes, you can detect the vehicle's driving trajectory and position changes. Drivers who continuously change lanes will make multiple and continuous steering wheel turns, and the vehicle's trajectory will obviously appear from the original lane to the target lane. changes (the original lane and the target lane are separated by at least 2 lanes). In addition, drivers who change lanes continuously will have no significant buffer time between lane changes, i.e., one lane change will be completed immediately before the next lane change. By observing the interval between vehicle lane changes (for example, the interval is less than 3 seconds), it can be inferred whether there is a continuous change.

Turning on the turn indicator is a basic behavior of the driver when changing lanes. It is used to remind other vehicles of the driver's intention. If other vehicles do not turn on the turn indicator, it may mean that the driver did not signal in advance, and there may be improper driving operations. Under normal circumstances, other vehicles do not turn on their turn indicators and continuously change lanes to the front of the target vehicle, which may cause the target vehicle to be forced to slow down or the driver to take emergency evasive actions, which may cause the driver's emotions to be negatively affected by the driving behavior of other vehicles. Changes, this negative change may affect the driver's concentration, decision-making ability and driving behavior, adversely affecting driving safety and vehicle stability.

In the third case, if other vehicles meet at least one of the following: the number of times the brake indicator light is working is greater than the first preset threshold and the number of lane changes within the preset period is greater than the second preset threshold, and the distance between the other vehicle and the target vehicle is If the separation distance is less than the safe driving distance, other vehicles are determined to be driving irregularly.

Specifically, the brake indicator light is a light device on the vehicle that is used to convey the intention of braking action to other vehicles or pedestrians. The number of times the brake indicator light works indicates the number of times the brake indicator light is triggered or used within a period of time.

The first preset threshold and the second preset threshold are a preset value (for example, 4 times and 5 times), which are used to determine whether the number of brake light operations and the number of lane changes meet the standards for irregular driving. The specific values are in This is not specifically limited.

The number of operating times of the brake indicator light is greater than the first preset threshold, indicating that other vehicles brake frequently and have unstable driving behavior, such as sudden deceleration, emergency braking, etc., which will affect the driving of the target vehicle and cause varying degrees of damage to other vehicles. Impact, the number of lane changes within a preset period (for example, within 10 seconds) is greater than the second preset threshold, indicating that other vehicles frequently change lanes and have irregular driving behavior, which will bring an uncertain and dangerous driving environment to the target vehicle. . In addition, the distance between other vehicles and the target vehicle within the first preset time is less than the safe driving distance, indicating that the distance between the vehicle and the target vehicle is too close. If other vehicles apply emergency braking, a rear-end collision may occur.

By judging the number of times the brake lights of other vehicles work, the number of lane changes and the distance between the target vehicles, it is determined whether other vehicles are driving irregularly. When other vehicles meet the condition that the number of times the brake lights work is greater than the first preset threshold or When the number of lane changes within the preset period is greater than at least one of the second preset thresholds and the distance to the target vehicle is less than the safe driving distance, it means that the driving of other vehicles is irregular.

It should be noted that the judgment conditions in this embodiment can obtain relevant data through vehicle sensors, surveillance cameras and other equipment of the target vehicle, and determine whether there is irregular driving through computer algorithms or logical judgments.

In this embodiment, by judging the driving behavior and driving trajectories of other vehicles, it is determined that the driving of other vehicles is irregular, so as to provide an operational basis for subsequent intervention of the vehicle-mounted emotion management system.

In addition, in some embodiments, the multi-modal information includes image information and voice information; the multi-modal information of the driver of the target vehicle and the capacitance value collected by the capacitive sensor installed at the steering wheel of the target vehicle are obtained, based on the multi-modal information and capacitance value to determine the current driver's emotional label, including: obtaining image information within the spatial range corresponding to the driving position through the internal camera of the target vehicle, and obtaining the voice information of the driver of the target vehicle; using the corresponding image information and voice information The preset algorithm performs feature extraction to obtain the corresponding feature vectors, and performs feature splicing on the feature vectors to obtain the fusion feature vector; the preset weight coefficient is used to weight the average of the fusion feature vectors to obtain the fusion feature parameters; based on the fusion feature parameters, capacitance value and A rule set for emotion classification is preset, and a logical conditional function in the rule set is used to determine the driver's emotion label.

Specifically, the image information within the spatial range corresponding to the driver's seat refers to the image information obtained within the spatial range around the driver's seat. The input image information is processed and analyzed to extract key features, including facial expressions, body Posture, eyes and other visual features related to emotional expression.

In addition, the driver's voice information can also be captured by using a microphone or sound sensor to extract the voice features, including pitch, speech speed, voice quality and other acoustic features related to emotional expression. Then the features of the image information and the voice information are fused, and feature splicing, weighted averaging, etc. are used to generate fusion feature parameters.

Among them, fusion feature = w1*feature 1+w2*feature 2+...+wn*feature n

Feature 1, feature 2,..., feature n are the feature vectors to be fused, and w1, w2,..., wn are the corresponding weight coefficients. Fusion features can be obtained by weighted summation of different features.

Emotion classification formula (rule matching):

Sentiment label=argmax(R1*f1+R2*f2+...+Rn*fn)

Among them, R1, R2,..., Rn are the weight coefficients in the emotion classification rule set, and f1, f2,..., fn are the logical condition functions in the rule set. Each conditional function is judged based on the value of the characteristic parameter and returns 0 or 1. The argmax function selects the sentiment label with the maximum value.

As an example, feature splicing is to connect the features of image information and voice information in a certain dimension to generate a fused feature vector. Assume that the feature dimension of image information is n1 and the feature dimension of voice information is n2, then after splicing The fusion feature dimension is n1+n2. For example, for the feature vector of image information [1,2,3] and the feature vector of voice information [4,5], the fused feature vector after feature splicing is [1,2, 3,4,5].

Weighted average is a linear combination of feature vectors of image information and voice information, and weighted summation of each feature is performed using weight coefficients. The weight coefficient can be set according to actual needs and data analysis. For example, for the feature vectors [1,2,3] of image information and the feature vectors [4,5] of voice information, set the weight coefficients to 0.6 and 0.4. Then the fused feature vector after weighted averaging is [0.6*1+0.4*4, 0.6*2+0.4*5, 0.6*3], that is, [2.2, 3.4, 1.8].

Through feature splicing and weighted averaging, different types of features can be fused to produce more comprehensive fused feature parameters. Doing so helps to comprehensively utilize the characteristics of different information sources and improve the accuracy and robustness of tasks such as emotion recognition.

Additionally, the capacitance value is a feature picked up by the capacitive sensor on the steering wheel. To specifically determine the emotional state represented by the capacitance value, you can refer to the preset emotion classification rule set. For example, the output capacitance range is set between 0 and 100. When the capacitance value is low (for example, below 30), it can indicate that the driver's emotion is positive, while when the capacitance value is high (for example, above 70), it can indicate that the driver's emotion is negative, and at the median value ( For example, between 30 and 70) can indicate a neutral emotion for the driver.

It should be noted that different features can be given different weights and priorities. For example, fused feature parameters may be more accurate for emotional judgment results. A higher determination priority can be set for the fusion feature parameters. When there is a conflict between the capacitance value and the fusion feature parameter determination, the emotion label can be determined based on the priority order.

According to the preset emotion classification rule set, the fusion feature parameters and capacitance values are matched and compared with the emotion classification defined in the rule set. Based on the matching results and the emotion classification labels defined in the rule set, the emotion labels indicated by the fusion feature parameters and capacitance values are determined. For example, the emotion label may be a positive emotion (such as joy, satisfaction), a negative emotion (such as anger, sadness), or a neutral emotion (such as calm, neutral), etc.

This embodiment obtains the image information within the spatial range corresponding to the driving position and the voice information of the driver of the target vehicle, and obtains the rule set indicating the driver's current mood by fusing the characteristic parameters and the collected capacitance value with the preset emotion classification. Corresponding emotion tags can be used to identify and classify user emotions, and understand the driver's behavior and status, so as to carry out driving behavior assessment, driving safety monitoring, driver behavior reminder and other applications, providing a reference for subsequent judgment conditions.

In some embodiments, after it is determined that other vehicles are driving erratically, after obtaining multi-modal information of the driver of the target vehicle and determining the emotion label indicated by the multi-modal information, the method further includes:

Control the target vehicle to send a first prompt message to other vehicles, where the first prompt message is used to prompt other vehicles to drive irregularly;

If no response information sent by other vehicles based on the first prompt information is received within the second preset period, the first prompt information is sent again, and the driving speed is controlled to be less than the preset speed threshold.

Specifically, the first prompt message is a message used to remind other vehicles that their driving mode is irregular. It can be a sound, text or other form of notification, which is sent to the target vehicle to warn that there are problems or violations in its driving. Traffic rules.

The second preset time refers to a preset period of time, which is used to determine whether other vehicles respond to the first prompt message within this period. The specific preset period depends on the system or application settings, and can be a few seconds or a few minutes, and is not specifically limited here.

The preset speed threshold refers to a preset speed value, which is used to determine whether other vehicles need to reduce their driving speed and control the target vehicle's driving speed to remain below the preset speed threshold. The specific preset speed threshold can be determined according to system or user settings, or can be adjusted according to road conditions, traffic rules or other factors, and is not specifically limited here.

When other vehicles receive the first reminder message, the drivers of other vehicles will be aware of their irregular driving behavior, thereby reminding them to pay attention to driving safety and reduce possible dangers and accidents. Specifically, when other vehicles receive the first prompt message, they should take appropriate actions or responses based on the message content. The action or response can be that other vehicles return to normal driving status, other vehicles send response messages to the target vehicle, etc. If no response based on the first prompt message is received from other vehicles within the second preset time, it means that other vehicles are not aware of their irregular driving behavior, and the target vehicle will send the first prompt message again to respond to the irregular driving behavior of other vehicles. The driving behavior is reminded and the driving speed of the target vehicle is controlled to be less than the preset speed threshold.

This embodiment sends a first reminder message to other vehicles to remind them that they are driving irregularly. If no response information from other vehicles is received within the second preset time, the target vehicle will send another reminder message and control the target vehicle. The driving speed is less than the preset speed threshold to reduce the relative speed difference between the target vehicle and other vehicles driving irregularly, reduce the probability of accidents, and further reduce potential safety risks.

In addition, in some embodiments, after controlling the driving speed to be less than the preset speed threshold, the method further includes:

Obtain the identification information of other vehicles, and control the target vehicle to send a second prompt message to the alarm system, where the second prompt message includes the driving trajectory and identification information of other vehicles, and the second prompt message is used to prompt the irregular driving behavior of other vehicles.

Specifically, if no response information from other vehicles is received within the second preset time, after controlling the driving speed of the target vehicle to be less than the preset speed threshold, the identification information of other vehicles can be obtained. The identification information can include license plate number, vehicle Identification numbers, etc., are used to identify and distinguish information about different vehicles, and send a second prompt message to the alarm system to prompt the alarm system to pay attention to the irregular driving behavior of other vehicles, including the driving trajectories and identification information of other vehicles.

As an example, assume that the target vehicle is driving normally on the road, and other vehicles frequently change lanes and take braking measures within the preset range of the target vehicle, which brings potential dangers to the target vehicle and road safety. At this time, the target vehicle sends a first prompt message to other vehicles, requiring other vehicles to change their irregular driving behavior. If other vehicles ignore the first prompt message or do not take any response measures, the target vehicle will drive at a speed less than the preset speed threshold (for example, 15km/h), thereby maintaining a relatively safe speed difference with other vehicles. Separate distance to reduce potential hazards. At this time, the target vehicle will obtain the identification information of other vehicles (such as license plate number and vehicle identification number). Based on the obtained identification information, the target vehicle will provide the obtained identification information and the driving trajectory of other vehicles to the alarm system (such as traffic management departments or law enforcement agencies), so that the alarm system can promptly know the irregular driving behavior of other vehicles and take further measures to ensure the safety and order of road traffic.

In this embodiment, by obtaining identification information of other vehicles and sending prompt messages, relevant departments can learn about the behavior of the vehicle and take appropriate measures, such as inspecting or punishing the vehicle, thereby improving the overall safety of road traffic.

In addition, in some embodiments, the vehicle-mounted emotion regulation system is controlled based on emotion tags, including:

If the emotion tag indicates that the driver's emotion is a negative emotion, the vehicle music is controlled to play a preset type of music, and the vehicle atmosphere light is controlled to display a preset color.

Specifically, if the emotion tag indicates that the driver's emotion is a negative emotion, based on this emotion tag, the car music can be controlled to play a preset type of music. The preset type of music may be some soothing, relaxing or pleasant music (for example, Light music, natural music, etc.), designed to help drivers relieve stress and negative emotions, and at the same time, control the vehicle atmosphere lights to display preset colors. The preset colors may be soft warm colors or other pleasant colors (such as light green, light yellow ), can create a more peaceful and comfortable atmosphere, helping to ease the driver's mood.

When the emotion tag indicates that the driver's emotion is negative, this embodiment provides the driver with a more pleasant and comfortable driving environment by selecting appropriate music and ambient light colors to promote emotional regulation and improve driving safety. Prevent drivers from driving too aggressively due to the irregular driving behavior of other vehicles.

All the above optional technical solutions can be combined in any way to form optional embodiments of the present application, and will not be described again here.

It should be understood that the sequence number of each step in the above embodiment does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the process of the embodiment of the present application.

Figure 2 is a schematic diagram of the module working of a control method for a vehicle-mounted emotion regulation system provided by an embodiment of the present application, as shown in Figure 2:

Vehicle 2 is the target vehicle in this application.

Specifically, when it is determined that other vehicles are driving irregularly, the information acquisition module 22 will obtain the multi-modal information of the driver of the target vehicle and the capacitance value collected by the capacitance sensor installed at the steering wheel of the target vehicle, and based on the multi-modal information The modal information and capacitance value determine the current driver's emotion label.

After receiving the multi-modal information and the emotion tag indicated by the capacitance value, the system control module 21 will control the vehicle-mounted emotion management system 23 to perform corresponding logical operations.

The following are device embodiments of the present application, which can be used to execute method embodiments of the present application. For details not disclosed in the device embodiments of this application, please refer to the method embodiments of this application.

Figure 3 is a control device of a vehicle-mounted emotion adjustment system provided by an embodiment of the present application. As shown in Figure 3, the device includes:

The first acquisition module 301 is configured to acquire the driving information of other vehicles within the preset range through the camera of the target vehicle;

The determination module 302 is configured to determine whether other vehicles are driving irregularly based on the driving information;

The second acquisition module 303 is configured to acquire the multi-modal information of the driver of the target vehicle and the capacitance value collected by the capacitance sensor installed at the steering wheel of the target vehicle, based on the multi-mode information when it is determined that other vehicles are driving irregularly. The modal information and capacitance value determine the current driver’s emotion label;

The control module 304 is configured to control the vehicle-mounted emotion adjustment system based on the emotion tag, where the vehicle-mounted emotion adjustment system includes vehicle-mounted music and vehicle-mounted ambient lighting.

In some embodiments, the acquisition module 301 is also used to obtain the navigation information of the target vehicle; according to the navigation information, when it is determined that there is no traffic jam scene on the road where the target vehicle is traveling, obtain the driving information of other vehicles through the camera of the target vehicle.

In some embodiments, the determination module 302 is also used to determine that the other vehicle is driving irregularly if the driving position of the other vehicle changes from behind the target vehicle to in front of the target vehicle within the first preset time, and the driving speed drops to a dangerous speed threshold. ; If other vehicles do not turn on the turn indicator and continuously change lanes to the front of the target vehicle, and the separation distance is less than the preset safe driving distance, then the other vehicle is determined to be driving irregularly; if the number of times of the brake indicator of other vehicles is greater than the first If at least one of a preset threshold and the number of lane changes within a preset period is greater than a second preset threshold, and the distance between other vehicles and the target vehicle is less than a safe driving distance, it is determined that the other vehicles are driving irregularly.

In some embodiments, the multi-modal information includes image information and voice information. The second acquisition module 303 is also configured to acquire image information within the spatial range corresponding to the driving position through the internal camera of the target vehicle, and acquire the driver's information of the target vehicle. Voice information; use corresponding preset algorithms to perform feature extraction on image information and voice information to obtain corresponding feature vectors, and perform feature splicing on the feature vectors to obtain a fusion feature vector; use the preset weight coefficients to perform a weighted average of the fusion feature vectors to obtain Fusion of feature parameters; based on a rule set that fuses feature parameters, capacitance values and preset emotion classifications, determine the driver's emotion label using a logical conditional function in the rule set.

In some embodiments, the second acquisition module 303 is also used to control the target vehicle to send a first prompt message to other vehicles, where the first prompt message is used to prompt other vehicles to drive irregularly; within the second preset time If no response information sent by other vehicles based on the first prompt information is received, the first prompt information is sent again, and the driving speed is controlled to be less than the preset speed threshold.

In some embodiments, the second acquisition module 303 is also used to obtain the identification information of other vehicles, and control the target vehicle to send a second prompt message to the alarm system, where the second prompt message includes the driving trajectory and identification information of other vehicles. Alert messages are used to alert other vehicles of erratic driving behavior.

In some embodiments, the control module 304 is also used to control the vehicle-mounted music to play a preset type of music and control the vehicle-mounted ambient light to display a preset color if the emotion tag indicates that the driver's emotion is a negative emotion.

The device provided by the embodiment of the present application can implement all the method steps of the above method embodiment and can achieve the same technical effect, which will not be described again here.

FIG. 4 is a schematic diagram of the electronic device 4 provided by the embodiment of the present application. As shown in FIG. 4 , the electronic device 4 of this embodiment includes: a processor 401 , a memory 402 , and a computer program 404 stored in the memory 402 and executable on the processor 401 . When the processor 401 executes the computer program 403, the steps in each of the above method embodiments are implemented. Alternatively, when the processor 401 executes the computer program 403, the functions of each module/unit in each of the above device embodiments are implemented.

The electronic device 4 may be a desktop computer, a notebook, a handheld computer, a cloud server and other electronic devices. The electronic device 4 may include, but is not limited to, a processor 401 and a memory 402. Those skilled in the art can understand that FIG. 4 is only an example of the electronic device 4 and does not constitute a limitation on the electronic device 4. The electronic device 4 may include more or fewer components than shown in the figure, or different components.

The processor 401 can be a central processing unit (CPU), other general-purpose processor, digital signal processor (Digital Signal Processor, DSP), application specific integrated circuit (Application Specific Integrated Circuit, ASIC), or field-processable processor. Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.

The memory 402 may be an internal storage unit of the electronic device 4 , for example, a hard disk or memory of the electronic device 4 . The memory 402 can also be an external storage device of the electronic device 4, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (SD) card, a flash memory card ( Flash Card), etc. The memory 402 may also include both an internal storage unit of the electronic device 4 and an external storage device. Memory 402 is used to store computer programs and other programs and data required by the electronic device.

Those skilled in the art can clearly understand that for the convenience and simplicity of description, only the division of the above functional units and modules is used as an example. In actual applications, the above functions can be allocated to different functional units and modules according to needs. Module completion means dividing the internal structure of the device into different functional units or modules to complete all or part of the functions described above. Each functional unit and module in the embodiment can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above-mentioned integrated unit can be hardware-based. It can also be implemented in the form of software functional units.

Integrated modules/units can be stored in a readable storage medium if they are implemented in the form of software functional units and sold or used as independent products. Based on this understanding, this application can implement all or part of the processes in the methods of the above embodiments. It can also be completed by instructing relevant hardware through a computer program. The computer program can be stored in a readable storage medium. The computer program can be processed by a processor. When executed, the steps of each of the above method embodiments may be implemented. A computer program may include computer program code, and the computer program code may be in the form of source code, object code, executable file or some intermediate form. Readable storage media may include: any entity or device that can carry computer program code, recording media, USB flash drives, mobile hard drives, magnetic disks, optical disks, computer memory, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), electrical carrier signals, telecommunications signals, and software distribution media, etc.

The above embodiments are only used to illustrate the technical solutions of the present application, but are not intended to limit them. Although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments. Modifications are made to the recorded technical solutions, or equivalent substitutions are made to some of the technical features; these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and shall be included in this application. within the scope of protection.

Claims (10)

1. A control method for a vehicle-mounted emotion regulation system, characterized by comprising: Obtain the driving information of other vehicles within the preset range through the camera of the target vehicle; Determine whether the other vehicles are driving irregularly based on the driving information; When it is determined that the other vehicle is driving irregularly, the multi-modal information of the driver of the target vehicle and the capacitance value collected by the capacitive sensor installed at the steering wheel of the target vehicle are obtained. Based on the multi-modal The state information and the capacitance value determine the current driver's emotion label; Based on the emotion tag, the vehicle-mounted emotion adjustment system is controlled, wherein the vehicle-mounted emotion adjustment system includes vehicle-mounted music and vehicle-mounted ambient lighting. 2. The control method of the vehicle-mounted emotion adjustment system according to claim 1, characterized in that before obtaining the driving information of other vehicles through the camera of the target vehicle, it also includes: Obtain the navigation information of the target vehicle; According to the navigation information, when it is determined that there is no traffic jam scene on the road where the target vehicle is traveling, the driving information of other vehicles is obtained through the camera of the target vehicle. 3. The control method of the vehicle-mounted emotion adjustment system according to claim 1, wherein determining whether the other vehicle is driving irregularly according to the driving information includes: If the driving position of the other vehicle changes from behind the target vehicle to in front of the target vehicle within the first preset time, and the driving speed drops to the dangerous speed threshold, it is determined that the other vehicle is driving erratically; If the other vehicle does not turn on the turn indicator and continuously changes lanes to the front of the target vehicle, and the separation distance is less than the preset safe driving distance, it is determined that the other vehicle is driving irregularly; If the other vehicle satisfies at least one of the number of times the brake indicator light operates is greater than the first preset threshold and the number of lane changes within the preset period is greater than the second preset threshold, and the other vehicle is different from the target vehicle. The separation distance is less than the safe driving distance, then it is determined that the other vehicle is driving irregularly. 4. The control method of a vehicle-mounted emotion regulation system according to claim 1, wherein the multi-modal information includes image information and voice information; Obtain the multi-modal information of the driver of the target vehicle and the capacitance value collected by the capacitive sensor installed at the steering wheel of the target vehicle, and determine the current driver's emotion tag based on the multi-modal information and the capacitance value, include: Obtain image information within the spatial range corresponding to the driving position through the internal camera of the target vehicle, and obtain the voice information of the driver of the target vehicle; Use corresponding preset algorithms to perform feature extraction on the image information and voice information to obtain corresponding feature vectors, and perform feature splicing on the feature vectors to obtain a fusion feature vector; Perform a weighted average of the fusion feature vectors using preset weight coefficients to obtain fusion feature parameters; Based on the rule set that fuses feature parameters, capacitance values and preset emotion classifications, the driver's emotion label is determined using a logical conditional function in the rule set. 5. The control method of the vehicle-mounted emotion adjustment system according to claim 1, characterized in that, when it is determined that the other vehicle is driving irregularly, multi-modal information of the driver of the target vehicle is obtained. , and after determining the emotion label indicated by the multi-modal information, it also includes: Control the target vehicle to send a first prompt message to the other vehicles, wherein the first prompt message is used to prompt the other vehicles to drive irregularly; If the response information sent by the other vehicle based on the first prompt information is not received within the second preset time, the first prompt information is sent again, and the driving speed is controlled to be less than the preset speed threshold. 6. The control method of the vehicle-mounted emotion adjustment system according to claim 5, characterized in that after the controlling the driving speed is less than the preset speed threshold, it further includes: Obtain the identification information of the other vehicle, and control the target vehicle to send a second prompt message to the alarm system, where the second prompt message includes the driving trajectory and identification information of the other vehicle, and the second prompt message is used to Prompt the erratic driving behavior of other vehicles. 7. The control method of the vehicle-mounted emotion adjustment system according to claim 1, characterized in that, based on the emotion tag, controlling the vehicle-mounted emotion adjustment system includes: If the emotion tag indicates that the driver's emotion is a negative emotion, the vehicle-mounted music is controlled to play a preset type of music, and the vehicle-mounted atmosphere light is controlled to display a preset color. 8. A control device for a vehicle-mounted emotion regulation system, characterized by comprising: The first acquisition module is configured to acquire the driving information of other vehicles within the preset range through the camera of the target vehicle; a determination module configured to determine whether the other vehicle is driving irregularly based on the driving information; The second acquisition module is configured to acquire the multi-modal information of the driver of the target vehicle and the multi-modal information collected by the capacitive sensor installed at the steering wheel of the target vehicle when it is determined that the other vehicle is driving irregularly. Capacitance value, determining the current driver's emotion label based on the multi-modal information and the capacitance value; A control module configured to control the vehicle-mounted emotion adjustment system based on the emotion tag, wherein the vehicle-mounted emotion adjustment system includes vehicle-mounted music and vehicle-mounted atmosphere lights. 9. An electronic device, comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that when the processor executes the computer program, the processor implements the claims as claimed in The steps of the method of any one of 1 to 7. 10. A readable storage medium storing a computer program, characterized in that when the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.