CN117141512A

CN117141512A - Control method and device of vehicle-mounted emotion regulating system

Info

Publication number: CN117141512A
Application number: CN202311278879.1A
Authority: CN
Inventors: 刘怀熠; 陈志棋; 徐波; 刘佳
Original assignee: Chongqing Seres New Energy Automobile Design Institute Co Ltd
Current assignee: Chongqing Seres New Energy Automobile Design Institute Co Ltd
Priority date: 2023-09-28
Filing date: 2023-09-28
Publication date: 2023-12-01

Abstract

The application relates to the technical field of automobiles, and provides a control method and device of a vehicle-mounted emotion regulating system, electronic equipment and a readable storage medium. The method comprises the following steps: acquiring running information of other vehicles through a camera of a target vehicle, wherein the other vehicles are positioned in a preset range of the target vehicle; determining whether the other vehicles run irregularly according to the running information; under the condition that the other vehicles are determined to be irregularly driven, acquiring multi-modal information of a driver of the target vehicle and a capacitance value acquired by a capacitance sensor arranged at a steering wheel of the target vehicle, and determining an emotion tag of the current driver based on the multi-modal information and the capacitance value; and controlling the vehicle-mounted emotion regulating system based on the emotion tags. The embodiment of the application solves the problem that the emotion of the driver cannot be regulated in the prior art.

Description

Control method and device of vehicle-mounted emotion regulating system

Technical Field

The application relates to the technical field of automobile safety, in particular to a control method and device of a vehicle-mounted emotion regulating system, electronic equipment and a readable storage medium.

Background

With the continuous improvement of the living standard of the automobile industry and people, the automobile becomes an indispensable travel tool in the life of people, and the daily life is greatly facilitated. However, as the amount of vehicle maintenance increases, problems associated with travel, such as illegal vehicular events on the road, and some unintended driving behaviors of some surrounding vehicles during driving, are also likely to cause emotional changes in the driver.

The prior art generally judges whether other vehicles run irregularly through naked eyes of a driver, and the method is a common reaction means but has some limitations. First, the driver judges with naked eyes that there are subjectivity and individual differences, and different persons may have different definition and evaluation criteria for irregular running, resulting in inconsistency of judgment results. Secondly, the emotional response of the driver to the irregular running of other vehicles can interfere with the decision and driving operation of the driver, and the anger emotion occurs when the driver drives the vehicle, so that the driving safety of the vehicle can be seriously influenced, and meanwhile, serious safety threats are formed to surrounding vehicles and pedestrians.

As can be seen, there is a problem in the related art that the emotion of the driver cannot be adjusted.

Disclosure of Invention

In view of the above, the embodiments of the present application provide a control method, apparatus, electronic device and readable storage medium for a vehicle-mounted emotion adjustment system, so as to solve the problem that the emotion of a driver cannot be adjusted in the prior art.

In a first aspect of an embodiment of the present application, a control method of a vehicle-mounted emotion-adjustment system is provided, including:

acquiring running information of other vehicles in a preset range through a camera of a target vehicle; determining whether the other vehicles run irregularly according to the running information; under the condition that the other vehicles are determined to be irregularly driven, acquiring multi-modal information of a driver of the target vehicle and a capacitance value acquired by a capacitance sensor arranged at a steering wheel of the target vehicle, and determining an emotion tag of the current driver based on the multi-modal information and the capacitance value; and controlling the vehicle-mounted emotion regulating system based on the emotion tags, wherein the vehicle-mounted emotion regulating system comprises vehicle-mounted music and vehicle-mounted atmosphere lamps.

In a second aspect of the embodiment of the present application, there is provided a control device of a vehicle-mounted emotion-adjustment system, including:

the first acquisition module is configured to acquire driving information of other vehicles in a preset range through a camera of the target vehicle; the determining module is configured to determine whether the other vehicles run irregularly according to the running information; the second acquisition module is configured to acquire multi-modal information of a driver of the target vehicle and a capacitance value acquired by a capacitance sensor installed at a steering wheel of the target vehicle under the condition that the other vehicles are determined to be in irregular driving, and determine an emotion tag of the current driver based on the multi-modal information and the capacitance value; and the control module is configured to control the vehicle-mounted emotion regulating system based on the emotion tags, wherein the vehicle-mounted emotion regulating system comprises vehicle-mounted music and vehicle-mounted atmosphere lamps.

In a third aspect of the embodiments of the present application, there is provided an electronic device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, the processor implementing the steps of the above method when executing the computer program.

In a fourth aspect of the embodiments of the present application, there is provided a readable storage medium storing a computer program which, when executed by a processor, performs the steps of the above method.

Compared with the prior art, the embodiment of the application has the beneficial effects that:

acquiring running information of other vehicles in a preset range through a camera of the target vehicle, and determining whether the other vehicles run irregularly according to the running information; under the condition that other vehicles are determined to be irregularly driven, acquiring multi-modal information of a driver of a target vehicle and a capacitance value acquired by a capacitance sensor arranged at a steering wheel of the target vehicle, and determining an emotion tag of the current driver based on the multi-modal information and the capacitance value; and controlling a vehicle-mounted emotion regulating system based on the emotion tags, wherein the vehicle-mounted emotion regulating system comprises vehicle-mounted music and a vehicle-mounted atmosphere lamp. The vehicle-mounted music and the vehicle-mounted light can be properly adjusted according to the emotion state of the driver to create a better driving environment, so that anger and impulsive emotion of the driver can be relieved, driving comfort and pleasure are improved, violent driving and illegal driving behaviors caused by irregular driving of other vehicles are reduced, and accordingly smoothness and safety of a road are improved, and driving safety is improved.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the embodiments or the description of the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a schematic flow chart of a control method of a vehicle-mounted emotion-regulating system according to an embodiment of the present application;

fig. 2 is a schematic block diagram of a control method of a vehicle-mounted emotion-adjustment system according to an embodiment of the present application;

fig. 3 is a schematic structural diagram of a control device of a vehicle-mounted emotion-regulating system according to an embodiment of the present application

Fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

In the following description, for purposes of explanation and not limitation, specific details are set forth such as the particular system architecture, techniques, etc., in order to provide a thorough understanding of the embodiments of the present application. It will be apparent, however, to one skilled in the art that the present application may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.

The terms first, second and the like in the description and in the claims, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate, such that embodiments of the application may be practiced otherwise than as specifically illustrated and described herein, and that the objects identified by "first," "second," etc. are generally of the same type and are not limited to the number of objects, such as the first object may be one or more. Furthermore, in the description and claims, "and/or" means at least one of the connected objects, and the character "/", generally means that the associated object is an "or" relationship.

Furthermore, it should be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises an element.

The control method, apparatus, electronic device and readable storage medium of the on-vehicle emotion-adjustment system according to the embodiments of the present application will be described in detail below with reference to the accompanying drawings.

Fig. 1 is a flow chart of a control method of a vehicle-mounted emotion-regulating system according to an embodiment of the present application. The control method of the on-board mood adjustment system of fig. 1 may be performed by a vehicle overall controller. As shown in fig. 1, the method includes:

s101, acquiring running information of other vehicles in a preset range through a camera of a target vehicle;

wherein the other vehicles are located within a preset range of the target vehicle (e.g., within 10 meters of the surroundings).

The target vehicle is a vehicle in a normal running state on a road and can be used as a reference vehicle.

By a camera installed in the front of the target vehicle, the traveling condition of other vehicles traveling within a preset range of the target vehicle can be photographed in real time, and by analyzing the image or video data, the position and movement information of the other vehicles, for example, the track of the vehicle, speed information, etc., can be extracted. In addition, the driving information of other vehicles may be acquired using a global positioning system or an inertial measurement unit, and the acquisition method is not particularly limited herein.

Travel information refers to a record of the path of movement of a vehicle over a period of time and may include longitude and latitude coordinates, speed, acceleration, and time-dependent trajectory data of the vehicle.

In this way, the step obtains the driving information of other vehicles within the preset range of the target vehicle through the camera of the target vehicle, so that the driver can be helped to understand and predict the behaviors of the other vehicles, and corresponding measures can be taken to improve the driving safety.

S102, determining whether other vehicles run irregularly according to the running information.

Irregular running refers to irregularities of running behaviors of other vehicles, including unstable speed change, frequent lane change, sudden braking, sudden acceleration and the like, and irregular running may indicate poor driving habit of a driver or abnormal current driving behavior, have potential safety hazards or do not meet normal traffic behavior standards.

The determination of irregular driving may be used as an evaluation index of driving behavior for monitoring traffic violations and driving safety conditions, and in addition, irregular driving may also indicate that other vehicles have intentional other vehicle behaviors, for example, other vehicle drivers may intentionally attempt to drive to the target vehicle to perform frequent lane changing, sudden braking and other driving behaviors due to the driving speed or driving behavior of the target vehicle, which may bring about great potential safety hazards.

In addition, the irregular running of the front vehicle can be judged, the track data of the vehicle can be compressed through a track compression algorithm, the data quantity stored and transmitted is reduced, and meanwhile, the important characteristics of the track are maintained. The vehicle running track can be analyzed through a track analysis algorithm, information such as running speed, acceleration, residence time and the like of other vehicles is extracted and used for running behavior analysis and driving behavior evaluation of the other vehicles, accurate acquisition and effective processing of the running track of the other vehicles are facilitated, and different application scenes and requirements can be combined through different algorithms, so that specific limitation is not carried out.

In this way, the present step can detect some characteristics of irregular running, such as drastic speed change, frequent lane changing operation, emergency braking, etc., by analyzing running information of other vehicles, and these characteristics can be used to determine stability and safety of running behavior, and further determine whether other vehicles have irregular running characteristics by comparing with the normal running mode.

And S103, under the condition that the other vehicles are determined to be irregularly driven, acquiring multi-mode information of a driver of the target vehicle and a capacitance value acquired by a capacitance sensor arranged at a steering wheel of the target vehicle, and determining an emotion tag of the current driver based on the multi-mode information and the capacitance value.

Other vehicles are vehicles that are considered to be irregularly traveling under certain conditions, and may violate traffic rules or exhibit other abnormal driving behaviors.

In the case where it is determined that the driving behavior of the preceding vehicle is irregular, by acquiring multimodal information of the driver of the target vehicle, the multimodal information may include voice, posture, facial expression, and the like. By analyzing this information, a possible emotional signature of the driver, such as anxiety, anger, calm, etc., can be identified.

In addition, a capacitive sensor mounted at the steering wheel can detect the degree of tightness of the hand-held steering wheel. The change of the capacitance value can be measured through the capacitance sensor, and the degree of tightness of the hand-held steering wheel can cause the change of the capacitance value. By reading the value of the capacitive sensor, the system can determine how tight the steering wheel is being held.

During driving, sudden changes in emotion may lead to some physical reactions, which may be enhanced when people feel a strong emotion of anxiety, anger, tension, etc., including contraction and gripping of hand muscles. In this case, the driver may subconsciously grasp the steering wheel to increase the sense of control and the sense of safety.

According to the method, when the other vehicles are determined to be driving irregularly, the possible emotional states of the drivers can be judged more accurately by acquiring the multi-mode information of the drivers of the target vehicles and the capacitance values acquired by the capacitance sensors arranged at the steering wheels of the target vehicles, so that the drivers can be helped to better cope with the driving irregularity, and the road safety is improved.

S104, controlling the vehicle-mounted emotion regulating system based on the emotion tags.

The vehicle-mounted emotion regulating system comprises vehicle-mounted music and a vehicle-mounted atmosphere lamp.

The emotional tag indicates a real-time emotional condition of the driver of the target vehicle.

The vehicle-mounted emotion regulating system can influence the emotion and the emotion state of a driver through other sensory elements such as sound, color and the like, so that driving experience and safety are improved, the driver can be helped to keep relaxed, concentrate, calm or refresh in the driving process, different driving conditions and scenes are better adapted, and the system can utilize biofeedback, environment perception and intelligent control technology to automatically regulate according to the psychological state and the environment condition of the driver. For example, when the driver feels anger or pressure is excessive, soft music can be played through the vehicle-mounted music to help the driver relax and recover; when the driver needs to keep alert, the mental state of the driver can be promoted by providing vitality music and adjusting the lighting effect through the vehicle-mounted music and the vehicle-mounted atmosphere lamp.

It should be noted that the on-vehicle emotion adjustment system may include other devices having emotion adjustment functions in the target vehicle, for example, an on-vehicle fragrance system, a massage system, and the like in the target vehicle.

Therefore, the vehicle-mounted emotion regulating system is controlled by determining the emotion label of the driver, and the emotion of the driver can be regulated correspondingly according to the emotion state of the driver, so that the emotion of the driver is balanced, the driving behavior of the driver caused by irregular driving behaviors of other vehicles is avoided, and the driving safety is improved.

According to the method, the device and the system, the running information of other vehicles is obtained through the camera of the target vehicle, whether the vehicle runs irregularly is judged, the multi-mode information of the driver of the target vehicle and the capacitance value acquired by the capacitance sensor are further obtained under the condition that the vehicle runs irregularly, the emotion label of the current driver is determined based on the multi-mode information and the capacitance value, and the vehicle-mounted music and the vehicle-mounted atmosphere lamp are controlled, so that the vehicle-mounted music and the vehicle-mounted lamp can be properly regulated according to the emotion state of the driver to create a better driving environment, anger and impulsive emotion of the driver are relieved, driving comfort and pleasure are improved, violent driving and illegal driving behaviors caused by irregular running of the other vehicles are reduced, and therefore the smoothness and safety of a road are improved, and driving safety is improved.

In some embodiments, before acquiring the driving information of the other vehicle by the camera of the target vehicle, the method further includes:

acquiring navigation information of a target vehicle;

according to the navigation information, under the condition that a traffic jam scene does not exist on the running road of the target vehicle is determined, the running information of other vehicles is obtained through the camera of the target vehicle.

Specifically, the navigation information is information of a driving route, a destination and other related guides of the target vehicle, and can provide real-time traffic conditions including traffic flow and congestion of a current driving road.

The driving road may include city streets, expressways, rural roads, etc., and is not particularly limited herein.

In a traffic jam scene, because the driving characteristics and the restriction in the traffic jam environment are different from those of a smooth road, a driver often needs to keep a small distance between a target vehicle and surrounding vehicles to observe traffic flow, so that the influence range of irregular driving behaviors (such as frequent lane changing or sudden braking) of the vehicles in a preset range is small, and therefore, in the traffic jam scene, it is not necessary to detect whether the vehicles in the preset range have irregular driving behaviors.

According to the method, the navigation information of the target vehicle is obtained, and according to the navigation information, under the condition that a traffic jam scene does not exist on a running road of the target vehicle is determined, the running information of other vehicles is obtained through the camera of the target vehicle, and the running information of the other vehicles is also obtained under the avoided traffic jam scene, so that the calculation amount of the judgment of the running information of the target vehicle on the other vehicles is reduced.

Further, in some embodiments, it is determined whether the other vehicle is traveling irregularly based on the traveling information, including three situations:

in the first case, if the traveling position of the other vehicle is changed from the rear to the front of the target vehicle within the first preset time and the traveling speed is reduced to the dangerous speed threshold, determining that the other vehicle is traveling irregularly.

Specifically, the first preset time refers to a preset or assumed specific time period, and is used for judging the running condition of the vehicle.

If the traveling position of the target vehicle in the preset time is in front of the other vehicles and the traveling position of the other vehicles in the same time is changed from the rear to the front of the target vehicle, it can be judged that the other vehicles have changed in traveling position, and if the traveling speed of the other vehicles falls below a dangerous speed threshold value, namely, the speed is lower than a certain safety threshold value while the traveling position is changed, it can be determined that the other vehicles are irregularly traveling. Under normal conditions, a vehicle which is running normally does not change position frequently in the running process and keeps a safe running speed, so that when the position of other vehicles changes and the running speed falls below a dangerous speed threshold value, the driving abnormality of the other vehicles can be judged, and the running safety of the target vehicle can be influenced.

And in the second situation, if the other vehicles do not turn on the turn signal lamp to continuously change the lane to the front of the target vehicle and the interval distance is smaller than the preset safe driving distance, determining that the other vehicles are in irregular driving.

Specifically, the turn signal lamp is used for reminding a traffic participant of the driving behavior which can occur next to other vehicles, the number of lane changes is the number of lane changes of the other vehicles in the driving process, and the frequency of lane changes or lane selection of the vehicles is indicated.

The distance may be a predetermined specific distance, and is used to determine whether the distance between the other vehicle and the target vehicle is smaller than a predetermined safe driving distance, so as to avoid collision or danger with the other vehicle.

It should be noted that the above preset values may be obtained based on the study and analysis of the road traffic rules and driving behaviors to ensure the smoothness and safety of the driving, and the specific preset values are not particularly limited herein.

As an example, to determine whether a vehicle is continuously changing lanes, a driver who is continuously changing lanes may have multiple, continuous steering wheel rotations by detecting changes in the travel track and position of the vehicle, and the track of the vehicle may obviously exhibit a change from the original lane to the target lane (the original lane is at least 2 lanes apart from the target lane). In addition, a driver who continuously changes lanes may not have significant buffer time between lane changes, i.e., immediately after one lane change is completed, make the next lane change. By observing the time interval between vehicle lane changes (e.g., less than 3 seconds), it can be inferred whether a continuous change is made.

Turning on the turn signal lamp is a basic behavior of the driver when changing lanes, and is used for reminding the driver of other vehicles of own intention, if the turn signal lamp is not turned on by other vehicles, the driver may not indicate in advance, the situation that driving operation is not standard may exist, and the situation that the turn signal lamp is not turned on by other vehicles continuously changes lanes to the front of the target vehicle may cause forced deceleration of the target vehicle or the driver needs to take emergency avoidance action, so that the emotion of the driver is negatively changed due to the driving behavior of other vehicles, and the negative change may influence the concentration, decision capability and driving behavior of the driver, thereby adversely affecting driving safety and vehicle stability.

And in the third situation, if the other vehicles meet at least one of the working times of the brake indicator lamp being larger than a first preset threshold value and the lane change times in a preset period being larger than a second preset threshold value, and the interval distance between the other vehicles and the target vehicle is smaller than the safe driving distance, determining that the other vehicles are irregularly driven.

Specifically, the brake indicator light is a light device on a vehicle and is used for conveying the intention of braking action to other vehicles or pedestrians, and the working times of the brake indicator light indicate the times of triggering or using the brake indicator light in a period of time.

The first preset threshold value and the second preset threshold value are preset values (for example, 4 times and 5 times) for judging whether the operation times and the lane change times of the brake indicator lamp reach the irregular running standard or not, and specific values are not limited in detail herein.

The number of times of operation of the brake indicator lamp is larger than a first preset threshold value, so that the other vehicles are indicated to be frequently braked, driving behaviors are unstable, such as sudden deceleration, emergency braking and the like, the running of the target vehicle can be influenced, the other vehicles are influenced to different degrees, the number of times of lane change in a preset period (such as 10 seconds) is larger than a second preset threshold value, so that the other vehicles are indicated to be frequently changed to lanes, the driving behaviors are irregular, and uncertain and dangerous driving environments can be brought to the target vehicles. In addition, the distance between the other vehicles and the target vehicle in the first preset time is smaller than the safe driving distance, which indicates that the distance between the other vehicles and the target vehicle is too close. In the case of emergency braking of other vehicles, rear-end accidents may occur.

Determining whether the other vehicles run irregularly or not by judging the working times of the brake indicator lights of the other vehicles, the lane change times and the interval distance of the target vehicles, and when the other vehicles meet at least one of the working times of the brake indicator lights being larger than a first preset threshold value or the lane change times in a preset period being larger than a second preset threshold value and the interval distance of the other vehicles and the target vehicles being smaller than the safe driving distance, indicating that the running of the other vehicles run irregularly.

It should be noted that, the judgment condition in the present embodiment may acquire the related data through a vehicle sensor, a monitoring camera, and the like of the target vehicle, and determine whether there is an irregular running condition through a computer algorithm or logic judgment.

According to the method, the driving behaviors and the driving tracks of the other vehicles are judged, and the fact that the driving of the other vehicles is irregular is determined, so that operation basis is provided for the intervention of a follow-up vehicle-mounted emotion management system.

In addition, in some embodiments, the multimodal information includes image information and voice information; acquiring multi-modal information of a driver of a target vehicle and a capacitance value acquired by a capacitance sensor installed at a steering wheel of the target vehicle, and determining an emotion tag of a current driver based on the multi-modal information and the capacitance value, comprising: acquiring image information in a space range corresponding to a driving position through an internal camera of a target vehicle, and acquiring voice information of a driver of the target vehicle; carrying out feature extraction on the image information and the voice information by utilizing a corresponding preset algorithm to obtain corresponding feature vectors, and carrying out feature stitching on the feature vectors to obtain fusion feature vectors; carrying out weighted average on the fusion feature vector by using a preset weight coefficient to obtain a fusion feature parameter; and determining the emotion label of the driver by using a logic condition function in the rule set based on the rule set fusing the characteristic parameters, the capacitance values and the preset emotion classification.

Specifically, the image information pointer in the space range corresponding to the driver's seat processes and analyzes the image information acquired in the space range around the driver's seat, and extracts key features therein, including visual features related to emotion expression, such as facial expression, body posture, eye mind, and the like.

In addition, the voice information of the driver can be captured by using a microphone or a voice sensor, and the voice characteristics including acoustic characteristics such as tone, speech speed, voice quality and the like related to emotion expression can be extracted. And then fusing the features of the image information and the voice information, and generating fusion feature parameters by adopting modes of feature splicing, weighted average and the like.

Wherein fusion feature = w1 x feature 1+w2 x feature 2+ + wn x feature n

Feature 1, feature 2..feature n is the feature vector to be fused, w1, w 2..wn is the corresponding weight coefficient. By weighted summing of the different features, a fused feature can be obtained.

Emotion classification formula (rule matching):

emotion Label = argmax (R1+R2+F2+ & Rn+fn)

Where R1, R2,..rn is a weight coefficient in the emotion classification rule set, f1, f2,..fn is a logical condition function in the rule set. Each condition function is judged according to the value of the characteristic parameter, and returns to 0 or 1. The argmax function selects the emotion tag with the largest value.

As an example, feature stitching is to connect features of image information and voice information in a certain dimension to generate a fused feature vector, and assuming that the feature dimension of the image information is n1 and the feature dimension of the voice information is n2, the fused feature dimension after stitching is n1+n2, for example, for feature vector [1,2,3] of the image information and feature vector [4,5] of the voice information, the fused feature vector after feature stitching is [1,2,3,4,5].

The weighted average is to linearly combine feature vectors of image information and voice information, and weight and sum each feature by using a weight coefficient. The weight coefficient can be set according to actual requirements and data analysis. For example, the weight coefficients are set to 0.6 and 0.4 for the feature vector [1,2,3] of the image information and the feature vector [4,5] of the voice information. The fusion eigenvector after weighted averaging is [0.6×1+0.4×4,0.6×2+0.4×5,0.6×3], i.e., [2.2,3.4,1.8].

By means of the two modes of feature stitching and weighted average, different types of features can be fused to generate more comprehensive fused feature parameters. By the aid of the method, characteristics of different information sources are utilized comprehensively, and accuracy and robustness of tasks such as emotion recognition are improved.

Furthermore, the capacitance value is a characteristic that is captured by a capacitive sensor on the steering wheel. The specific judgment of the emotion state represented by the capacitance value can refer to a preset emotion classification rule set. For example, the capacitance value of the output is set to be between 0 and 100. A lower capacitance value (e.g., below 30) may indicate that the driver is in a positive emotion, while a higher capacitance value (e.g., above 70) may indicate that the driver is in a negative emotion, while a median value (e.g., between 30-70) may indicate that the driver is in a neutral emotion.

It should be noted that different features may be given different weights and priorities. For example, fusing feature parameters may be more accurate for the results of emotion judgment. Higher judgment priorities can be set for the fusion characteristic parameters, and emotion tags can be determined based on the priority order when the capacitance value contradicts the judgment of the fusion characteristic parameters.

And matching and comparing the fusion characteristic parameters and the capacitance values with emotion classification defined in the rule set according to a preset emotion classification rule set. And determining the emotion label indicated by the fusion characteristic parameter and the capacitance value according to the matching result and the emotion classification label defined in the rule set. For example, the emotion tags may be positive emotions (e.g., happy, satisfied), negative emotions (e.g., anger, sad), or neutral emotions (e.g., calm, neutral), etc.

According to the method, the device and the system, the image information in the space range corresponding to the driving position is obtained, the voice information of the driver of the target vehicle is obtained, the emotion labels indicating the current correspondence of the driver are obtained through fusion of the characteristic parameters, the collected capacitance value and the rule set of the preset emotion classification, so that the emotion of the user is identified and classified, the behavior and the state of the driver can be known, and therefore the applications such as driving behavior assessment, driving safety monitoring and driver behavior reminding are carried out, and reference is provided for subsequent judging conditions.

In some embodiments, after acquiring the multimodal information of the driver of the target vehicle and determining the emotion tag indicated by the multimodal information in the case that it is determined that the other vehicle is driving irregularly, the method further includes:

the control target vehicle sends a first prompt message to other vehicles, wherein the first prompt message is used for prompting the running of the other vehicles to be irregular running;

and under the condition that the response information sent by other vehicles based on the first prompt information is not received within the second preset period, the first prompt information is sent again, and the running speed is controlled to be smaller than the preset speed threshold value.

Specifically, the first prompting message is a message for reminding other vehicles of irregular running, and can be a sound, text or other forms of notification, and the notification is sent to the target vehicle to warn that the running of the target vehicle has problems or violates traffic rules.

The second preset time refers to a preset period of time, and is used for judging whether other vehicles respond to the first prompt message within the period of time. The specific preset period may be several seconds, several minutes, depending on the system or application settings, and is not particularly limited herein.

The preset speed threshold is a preset speed value for judging whether the other vehicle needs to reduce the running speed, and controlling the running speed of the target vehicle to be kept at a level lower than the preset speed threshold. The specific preset speed threshold may be determined according to a system or a user setting, or may be adjusted according to road conditions, traffic rules, or other factors, which are not specifically limited herein.

After the other vehicles receive the first prompt message, the drivers of the other vehicles can be made to realize the irregular running behaviors of the drivers, so that the drivers can be reminded of the drivers to pay attention to the driving safety, and possible danger and accident occurrence are reduced. Specifically, when the other vehicle receives the first prompt message, an appropriate action or response should be taken according to the message content, where the action or response may be that the other vehicle returns to the normal running state, the other vehicle sends a response message to the target vehicle, and so on. If the response of the other vehicles based on the first prompt message is not received within the second preset time, the other vehicles are not aware of the irregular running behaviors of the other vehicles, the target vehicle sends the first prompt message again to remind the irregular running behaviors of the other vehicles, and the running speed of the target vehicle is controlled to be smaller than the preset speed threshold value.

According to the method, the first prompt message is sent to the other vehicles to remind that the vehicle is in irregular running, if the response information of the other vehicles is not received within the second preset time, the target vehicle can send the prompt message again, and the running speed of the target vehicle is controlled to be smaller than the preset speed threshold value, so that the relative speed difference between the target vehicle and the other vehicles in irregular running is reduced, the probability of occurrence of accidents is reduced, and the potential safety risk is further reduced.

Further, in some embodiments, after controlling the travel speed to be less than the preset speed threshold, further comprising:

the method comprises the steps of obtaining identification information of other vehicles, and controlling a target vehicle to send a second prompt message to an alarm system, wherein the second prompt message comprises the running track and the identification information of the other vehicles and is used for prompting irregular running behaviors of the other vehicles.

Specifically, if no response information of other vehicles is received within the second preset time, after the running speed of the control target vehicle is smaller than the preset speed threshold, the identification information of the other vehicles can be obtained, the identification information can include license plate numbers, vehicle identification numbers and the like and is used for identifying and distinguishing information of different vehicles, and a second prompt message is sent to the alarm system and is used for prompting the alarm system to pay attention to irregular running behaviors of the other vehicles, including running tracks and identification information of the other vehicles.

As an example, assuming that the target vehicle is traveling normally on the road, other vehicles frequently change lanes and frequently take braking measures within a preset range of the target vehicle, bringing potential hazards to the target vehicle and road safety. At the moment, the target vehicle sends a first prompt message to other vehicles to request the other vehicles to change irregular running behaviors. If the other vehicles ignore the first prompt message or do not take any response measures, the target vehicle will run at a speed less than the preset speed threshold (e.g. 15 km/h), so as to maintain a relatively safe speed difference and distance with the other vehicles, thereby reducing the potential danger. At this time, the target vehicle acquires the identification information (such as license plate number and vehicle identification number) of the other vehicles, and provides the acquired identification information and the running track of the other vehicles to the alarm system (such as traffic management department or law enforcement agency) according to the acquired identification information, so that the alarm system can timely know the irregular running behavior of the other vehicles and take further measures to ensure the safety and order of road traffic.

According to the embodiment, related departments can know the behavior of the vehicle by acquiring other vehicle identification information and sending prompt messages, and appropriate measures such as checking or punishing the vehicle are adopted, so that the overall safety of road traffic is improved.

Additionally, in some embodiments, controlling the on-board mood adjustment system based on the mood tag includes:

if the emotion label indicates that the emotion of the driver is negative, controlling the vehicle-mounted music to play the preset type of music, and controlling the vehicle-mounted atmosphere lamp to display the preset color.

Specifically, if the emotion tag indicates that the emotion of the driver is negative, according to the emotion tag, the vehicle-mounted music can be controlled to play music of a preset type, wherein the music of the preset type may be some soothing, relaxing or pleasant music (such as light music, natural music and the like), so as to help the driver to relieve the stress and negative emotion, and meanwhile, the vehicle-mounted atmosphere lamp is controlled to display a preset color, which may be soft warm tone or other pleasant color (such as light green, light yellow), so that a more calm and comfortable atmosphere can be created, and the emotion of the driver can be relieved.

According to the embodiment, when the emotion labels indicate that the emotion of the driver is negative, a more pleasant and comfortable driving environment is provided for the driver by selecting proper music and atmosphere lamp colors, so that emotion adjustment is promoted, driving safety is improved, and excessively violent driving behaviors of the driver due to irregular driving behaviors of other vehicles are avoided.

Any combination of the above optional solutions may be adopted to form an optional embodiment of the present application, which is not described herein.

It should be understood that the sequence number of each step in the above embodiment does not mean the sequence of execution sequence, and the execution sequence of each process should be determined by the function and the internal logic of each process, and should not be construed as limiting the process in the embodiment of the present application.

Fig. 2 is a schematic block diagram of a control method of a vehicle-mounted emotion-adjustment system according to an embodiment of the present application, where fig. 2 shows:

the vehicle 2 is a target vehicle in the present application.

Specifically, in the event that it is determined that the other vehicle is traveling irregularly, the information acquisition module 22 will acquire multimodal information of the driver of the target vehicle and a capacitance value acquired by a capacitance sensor mounted at the steering wheel of the target vehicle, and determine an emotion tag of the current driver based on the multimodal information and the capacitance value.

After receiving the multimodal information and the emotion tags indicated by the capacitance values, the system control module 21 controls the vehicle-mounted emotion management system 23 to execute corresponding logic operations.

The following are examples of the apparatus of the present application that may be used to perform the method embodiments of the present application. For details not disclosed in the embodiments of the apparatus of the present application, please refer to the embodiments of the method of the present application.

Fig. 3 is a control device of a vehicle-mounted emotion adjustment system according to an embodiment of the present application, as shown in fig. 3, the device includes:

a first obtaining module 301 configured to obtain, through a camera of a target vehicle, traveling information of other vehicles within a preset range;

a determining module 302 configured to determine whether the other vehicle is traveling irregularly according to the traveling information;

a second obtaining module 303 configured to obtain, in a case where it is determined that the other vehicle is traveling irregularly, multimodal information of a driver of the target vehicle and a capacitance value collected by a capacitance sensor installed at a steering wheel of the target vehicle, and determine an emotion tag of the current driver based on the multimodal information and the capacitance value;

the control module 304 is configured to control an on-board emotion adjustment system based on the emotion tags, wherein the on-board emotion adjustment system includes on-board music and on-board mood lamps.

In some embodiments, the obtaining module 301 is further configured to obtain navigation information of the target vehicle; according to the navigation information, under the condition that a traffic jam scene does not exist on the running road of the target vehicle is determined, the running information of other vehicles is obtained through the camera of the target vehicle.

In some embodiments, the determining module 302 is further configured to determine that the other vehicle is traveling irregularly if the traveling position of the other vehicle within the first preset time is changed from the rear to the front of the target vehicle and the traveling speed decreases to the dangerous speed threshold; if the other vehicles do not turn on the turn indicator lamp to continuously change the lane to the front of the target vehicle and the interval distance is smaller than the preset safe driving distance, determining that the other vehicles are in irregular driving; if the other vehicles meet at least one of the working times of the brake indicator lamp being larger than a first preset threshold value and the lane change times in a preset period being larger than a second preset threshold value, and the interval distance between the other vehicles and the target vehicle is smaller than the safe driving distance, determining that the other vehicles are irregularly driven.

In some embodiments, the multimodal information includes image information and voice information, and the second obtaining module 303 is further configured to obtain, through an internal camera of the target vehicle, the image information in a spatial range corresponding to a driving position, and obtain voice information of a driver of the target vehicle; carrying out feature extraction on the image information and the voice information by utilizing a corresponding preset algorithm to obtain corresponding feature vectors, and carrying out feature stitching on the feature vectors to obtain fusion feature vectors; carrying out weighted average on the fusion feature vector by using a preset weight coefficient to obtain a fusion feature parameter; and determining the emotion label of the driver by using a logic condition function in the rule set based on the rule set fusing the characteristic parameters, the capacitance values and the preset emotion classification.

In some embodiments, the second obtaining module 303 is further configured to control the target vehicle to send a first prompting message to the other vehicle, where the first prompting message is used to prompt the other vehicle to travel irregularly; and under the condition that the response information sent by other vehicles based on the first prompt information is not received within the second preset time, the first prompt information is sent again, and the running speed is controlled to be smaller than the preset speed threshold value.

In some embodiments, the second obtaining module 303 is further configured to obtain identification information of the other vehicle, and control the target vehicle to send a second prompting message to the alarm system, where the second prompting message includes a driving track and the identification information of the other vehicle, and the second prompting message is used to prompt irregular driving behavior of the other vehicle.

In some embodiments, the control module 304 is further configured to control the vehicle-mounted music to play the preset type of music and control the vehicle-mounted atmosphere lamp to display the preset color if the emotion label indicates that the emotion of the driver is negative emotion.

The device provided by the embodiment of the application can realize all the method steps of the method embodiment and achieve the same technical effects, and is not described herein.

Fig. 4 is a schematic diagram of an electronic device 4 according to an embodiment of the present application. As shown in fig. 4, the electronic apparatus 4 of this embodiment includes: a processor 401, a memory 402 and a computer program 404 stored in the memory 402 and executable on the processor 401. The steps of the various method embodiments described above are implemented by processor 401 when executing computer program 403. Alternatively, the processor 401, when executing the computer program 403, performs the functions of the modules/units in the above-described apparatus embodiments.

The electronic device 4 may be a desktop computer, a notebook computer, a palm computer, a cloud server, or the like. The electronic device 4 may include, but is not limited to, a processor 401 and a memory 402. It will be appreciated by those skilled in the art that fig. 4 is merely an example of the electronic device 4 and is not limiting of the electronic device 4 and may include more or fewer components than shown, or different components.

The processor 401 may be a central processing unit (Central Processing Unit, CPU) or other general purpose processor, digital signal processor (Digital Signal Processor, DSP), application specific integrated circuit (Application Specific Integrated Circuit, ASIC), field programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, or the like.

The memory 402 may be an internal storage unit of the electronic device 4, for example, a hard disk or a memory of the electronic device 4. The memory 402 may also be an external storage device of the electronic device 4, for example, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash Card (Flash Card) or the like, which are provided on the electronic device 4. Memory 402 may also include both internal storage units and external storage devices of electronic device 4. The memory 402 is used to store computer programs and other programs and data required by the electronic device.

It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-described division of the functional units and modules is illustrated, and in practical application, the above-described functional distribution may be performed by different functional units and modules according to needs, i.e. the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-described functions. The functional units and modules in the embodiment may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit, where the integrated units may be implemented in a form of hardware or a form of a software functional unit.

The integrated modules/units may be stored in a readable storage medium if implemented in the form of software functional units and sold or used as stand-alone products. Based on such understanding, the present application may implement all or part of the flow of the method of the above embodiment, or may be implemented by a computer program to instruct related hardware, and the computer program may be stored in a readable storage medium, where the computer program may implement the steps of the method embodiments described above when executed by a processor. The computer program may comprise computer program code, which may be in source code form, object code form, executable file or in some intermediate form, etc. The readable storage medium may include: any entity or device capable of carrying computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer Memory, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), an electrical carrier signal, a telecommunications signal, a software distribution medium, and so forth.

The above embodiments are only for illustrating the technical solution of the present application, and are not limiting; although the application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present application, and are intended to be included in the scope of the present application.

Claims

1. A control method of an on-vehicle emotion-adjustment system, characterized by comprising:

acquiring running information of other vehicles in a preset range through a camera of a target vehicle;

determining whether the other vehicles run irregularly according to the running information;

under the condition that the other vehicles are determined to be irregularly driven, acquiring multi-modal information of a driver of the target vehicle and a capacitance value acquired by a capacitance sensor arranged at a steering wheel of the target vehicle, and determining an emotion tag of the current driver based on the multi-modal information and the capacitance value;

and controlling the vehicle-mounted emotion regulating system based on the emotion tags, wherein the vehicle-mounted emotion regulating system comprises vehicle-mounted music and vehicle-mounted atmosphere lamps.

2. The control method of the on-vehicle emotion-adjustment system according to claim 1, characterized by further comprising, before the acquisition of the travel information of the other vehicle by the camera of the target vehicle:

acquiring navigation information of the target vehicle;

and according to the navigation information, under the condition that the traffic jam scene does not exist on the running road of the target vehicle is determined, acquiring the running information of other vehicles through the camera of the target vehicle.

3. The control method of the on-vehicle emotion-adjustment system according to claim 1, characterized in that the determining whether the other vehicle is traveling irregularly according to the traveling information includes:

if the running position of the other vehicles in the first preset time is changed from the rear to the front of the target vehicle and the running speed is reduced to a dangerous speed threshold value, determining that the other vehicles run irregularly;

if the other vehicles do not turn on the turn signal lamp to continuously change lanes to the front of the target vehicle and the interval distance is smaller than the preset safe driving distance, determining that the other vehicles are irregularly driven;

and if the other vehicles meet at least one of the working times of the brake indicator lamp being larger than a first preset threshold value and the lane change times in a preset period being larger than a second preset threshold value, and the interval distance between the other vehicles and the target vehicle is smaller than the safe driving distance, determining that the other vehicles are irregularly driven.

4. The control method of an in-vehicle emotion-adjustment system according to claim 1, wherein the multimodal information includes image information and voice information;

Acquiring multi-modal information of a driver of the target vehicle and a capacitance value acquired by a capacitance sensor installed at a steering wheel of the target vehicle, and determining an emotion tag of a current driver based on the multi-modal information and the capacitance value, comprising:

acquiring image information in a space range corresponding to a driving position through an internal camera of the target vehicle, and acquiring voice information of a driver of the target vehicle;

carrying out feature extraction on the image information and the voice information by utilizing a corresponding preset algorithm to obtain corresponding feature vectors, and carrying out feature stitching on the feature vectors to obtain fusion feature vectors;

carrying out weighted average on the fusion feature vectors by using preset weight coefficients to obtain fusion feature parameters;

and determining the emotion label of the driver by using a logic condition function in the rule set based on the rule set fusing the characteristic parameters, the capacitance values and the preset emotion classification.

5. The control method of the on-vehicle emotion-adjustment system according to claim 1, wherein, when it is determined that the other vehicle is traveling irregularly, after acquiring the multimodal information of the driver of the target vehicle and determining the emotion tag indicated by the multimodal information, further comprising:

Controlling the target vehicle to send a first prompt message to the other vehicles, wherein the first prompt message is used for prompting the other vehicles to run irregularly;

and under the condition that the response information sent by the other vehicles based on the first prompt information is not received within a second preset time, the first prompt information is sent again, and the running speed is controlled to be smaller than a preset speed threshold value.

6. The control method of the on-vehicle emotion-adjustment system according to claim 5, characterized by further comprising, after the control travel speed is less than a preset speed threshold:

and acquiring the identification information of the other vehicles, and controlling the target vehicle to send a second prompt message to the alarm system, wherein the second prompt message comprises the running track and the identification information of the other vehicles and is used for prompting irregular running behaviors of the other vehicles.

7. The control method of the in-vehicle emotion adjustment system according to claim 1, characterized in that the controlling of the in-vehicle emotion adjustment system based on the emotion tag includes:

and if the emotion label indicates that the emotion of the driver is negative emotion, controlling the vehicle-mounted music to play the music of the preset type, and controlling the vehicle-mounted atmosphere lamp to display the preset color.

8. A control device of an on-vehicle emotion-adjustment system, characterized by comprising:

the first acquisition module is configured to acquire driving information of other vehicles in a preset range through a camera of the target vehicle;

the determining module is configured to determine whether the other vehicles run irregularly according to the running information;

the second acquisition module is configured to acquire multi-modal information of a driver of the target vehicle and a capacitance value acquired by a capacitance sensor installed at a steering wheel of the target vehicle under the condition that the other vehicles are determined to be in irregular driving, and determine an emotion tag of the current driver based on the multi-modal information and the capacitance value;

and the control module is configured to control the vehicle-mounted emotion regulating system based on the emotion tags, wherein the vehicle-mounted emotion regulating system comprises vehicle-mounted music and vehicle-mounted atmosphere lamps.

9. An electronic device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that the processor implements the steps of the method according to any of claims 1 to 7 when the computer program is executed.

10. A readable storage medium storing a computer program, characterized in that the computer program when executed by a processor implements the steps of the method according to any one of claims 1 to 7.