CN116394807A - Automobile intelligent adjusting seat with different mood scenes and control method thereof - Google Patents
Automobile intelligent adjusting seat with different mood scenes and control method thereof Download PDFInfo
- Publication number
- CN116394807A CN116394807A CN202310290999.7A CN202310290999A CN116394807A CN 116394807 A CN116394807 A CN 116394807A CN 202310290999 A CN202310290999 A CN 202310290999A CN 116394807 A CN116394807 A CN 116394807A
- Authority
- CN
- China
- Prior art keywords
- intelligent
- emotion
- seat
- mood
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000036651 mood Effects 0.000 title claims abstract description 70
- 238000000034 method Methods 0.000 title claims abstract description 46
- 238000004458 analytical method Methods 0.000 claims abstract description 48
- 230000008451 emotion Effects 0.000 claims description 129
- 238000012544 monitoring process Methods 0.000 claims description 48
- 230000002996 emotional effect Effects 0.000 claims description 28
- 238000000605 extraction Methods 0.000 claims description 15
- 230000033001 locomotion Effects 0.000 claims description 15
- 230000000875 corresponding effect Effects 0.000 claims description 13
- 238000012549 training Methods 0.000 claims description 12
- 230000001276 controlling effect Effects 0.000 claims description 11
- 238000010438 heat treatment Methods 0.000 claims description 11
- 230000001815 facial effect Effects 0.000 claims description 10
- 238000009423 ventilation Methods 0.000 claims description 10
- 230000003993 interaction Effects 0.000 claims description 9
- 230000009471 action Effects 0.000 claims description 8
- 238000005516 engineering process Methods 0.000 claims description 8
- 230000006855 networking Effects 0.000 claims description 7
- 230000008859 change Effects 0.000 claims description 6
- 238000013527 convolutional neural network Methods 0.000 claims description 6
- 230000005284 excitation Effects 0.000 claims description 6
- 210000004709 eyebrow Anatomy 0.000 claims description 6
- 239000004973 liquid crystal related substance Substances 0.000 claims description 6
- 230000008909 emotion recognition Effects 0.000 claims description 5
- 230000008921 facial expression Effects 0.000 claims description 5
- QVGXLLKOCUKJST-UHFFFAOYSA-N atomic oxygen Chemical compound [O] QVGXLLKOCUKJST-UHFFFAOYSA-N 0.000 claims description 4
- 239000008280 blood Substances 0.000 claims description 4
- 210000004369 blood Anatomy 0.000 claims description 4
- 230000036760 body temperature Effects 0.000 claims description 4
- 238000010801 machine learning Methods 0.000 claims description 4
- 229910052760 oxygen Inorganic materials 0.000 claims description 4
- 239000001301 oxygen Substances 0.000 claims description 4
- 230000036387 respiratory rate Effects 0.000 claims description 4
- 230000037007 arousal Effects 0.000 claims description 3
- 238000013135 deep learning Methods 0.000 claims description 3
- 238000001514 detection method Methods 0.000 claims description 3
- 238000001943 fluorescence-activated cell sorting Methods 0.000 claims description 3
- 238000009499 grossing Methods 0.000 claims description 3
- 230000007246 mechanism Effects 0.000 claims description 3
- 238000007781 pre-processing Methods 0.000 claims description 3
- 238000003672 processing method Methods 0.000 claims description 3
- 238000010183 spectrum analysis Methods 0.000 claims description 3
- 238000012706 support-vector machine Methods 0.000 claims description 3
- 230000009466 transformation Effects 0.000 claims description 3
- 239000013598 vector Substances 0.000 claims description 3
- 239000003205 fragrance Substances 0.000 claims 1
- 230000007935 neutral effect Effects 0.000 abstract description 9
- 230000008569 process Effects 0.000 abstract description 6
- 238000011161 development Methods 0.000 description 9
- 230000000694 effects Effects 0.000 description 8
- 230000006870 function Effects 0.000 description 8
- 238000000222 aromatherapy Methods 0.000 description 7
- 238000004590 computer program Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 239000006260 foam Substances 0.000 description 2
- 238000007306 functionalization reaction Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 239000002304 perfume Substances 0.000 description 2
- 230000035479 physiological effects, processes and functions Effects 0.000 description 2
- 239000000047 product Substances 0.000 description 2
- 238000011160 research Methods 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000004913 activation Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000007664 blowing Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000005485 electric heating Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 210000003195 fascia Anatomy 0.000 description 1
- 238000005187 foaming Methods 0.000 description 1
- 210000004247 hand Anatomy 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000002040 relaxant effect Effects 0.000 description 1
- 230000000284 resting effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 238000010792 warming Methods 0.000 description 1
- 210000000707 wrist Anatomy 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60N—SEATS SPECIALLY ADAPTED FOR VEHICLES; VEHICLE PASSENGER ACCOMMODATION NOT OTHERWISE PROVIDED FOR
- B60N2/00—Seats specially adapted for vehicles; Arrangement or mounting of seats in vehicles
- B60N2/02—Seats specially adapted for vehicles; Arrangement or mounting of seats in vehicles the seat or part thereof being movable, e.g. adjustable
- B60N2/0224—Non-manual adjustments, e.g. with electrical operation
- B60N2/0244—Non-manual adjustments, e.g. with electrical operation with logic circuits
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60H—ARRANGEMENTS OF HEATING, COOLING, VENTILATING OR OTHER AIR-TREATING DEVICES SPECIALLY ADAPTED FOR PASSENGER OR GOODS SPACES OF VEHICLES
- B60H3/00—Other air-treating devices
- B60H3/0007—Adding substances other than water to the air, e.g. perfume, oxygen
- B60H3/0035—Adding substances other than water to the air, e.g. perfume, oxygen characterised by the control methods for adding the substance
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60N—SEATS SPECIALLY ADAPTED FOR VEHICLES; VEHICLE PASSENGER ACCOMMODATION NOT OTHERWISE PROVIDED FOR
- B60N2/00—Seats specially adapted for vehicles; Arrangement or mounting of seats in vehicles
- B60N2/56—Heating or ventilating devices
- B60N2/5678—Heating or ventilating devices characterised by electrical systems
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60N—SEATS SPECIALLY ADAPTED FOR VEHICLES; VEHICLE PASSENGER ACCOMMODATION NOT OTHERWISE PROVIDED FOR
- B60N2/00—Seats specially adapted for vehicles; Arrangement or mounting of seats in vehicles
- B60N2/90—Details or parts not otherwise provided for
- B60N2/976—Details or parts not otherwise provided for massaging systems
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q3/00—Arrangement of lighting devices for vehicle interiors; Lighting devices specially adapted for vehicle interiors
- B60Q3/20—Arrangement of lighting devices for vehicle interiors; Lighting devices specially adapted for vehicle interiors for lighting specific fittings of passenger or driving compartments; mounted on specific fittings of passenger or driving compartments
- B60Q3/233—Seats; Arm rests; Head rests
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
- B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
- B60R16/037—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for occupant comfort, e.g. for automatic adjustment of appliances according to personal settings, e.g. seats, mirrors, steering wheel
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Abstract
The invention innovatively provides an intelligent automobile adjusting seat with different mood scenes and a control method thereof, wherein the mood state of an occupant on the seat is effectively identified based on a mood classification method selected by multi-type mood feature combination, intelligent adjustment of the seat under different mood scenes is realized in aspects of shape, sound, smell and touch through control analysis, compared with the traditional device, negative moods of the occupant are relieved or lightened to a certain extent, positive moods which are too high and excited are avoided in the driving process, the neutral calm mood is ensured to drive as much as possible, driving safety is improved, and the increasing intelligent seat scene adjusting requirement of people is met.
Description
Technical Field
The application relates to the field of automobile seats, in particular to an intelligent automobile adjusting seat with different mood scenes and a control method thereof.
Background
With the future development trend of electric, networking, intelligent and sharing in the automobile industry, the development of technology for replacing functionalization with sceneries gradually becomes one of important ways for realizing the new four. The extension and transition from functionalization to scenery makes a thorough change in the application of mobile interconnects for high frequency use from underlying logic to technology paths. In the process of functional development, a developer often starts from the developer to develop in the forward direction; the use scene, namely the reverse development of the user for guiding the landing result of the function in the corresponding actual environment, enables the function development to be a precondition service, enables the scene to be a new direction of the technical development nowadays, and extends to the automobile industry for checking the user body at the first place in the high-frequency use state.
On the one hand, an automobile is used as a transportation means, a driver and passengers are arranged on a seat, the emotion states of the automobile can directly influence driving safety, use feeling and comfortableness, for example, when the automobile is driven in anger mood, the driving emotion is easy to run away, other vehicles are deliberately blocked from entering a lane of the automobile, dangerous driving is heavy, and sudden braking or acceleration phenomena occur. On the other hand, automobile products increasingly shift to multifunctional sites of activation, recreation and entertainment, and more people are used to or like to regulate, release or relieve their own emotion in automobile seats, such as resting, meditation, relaxation and the like.
In the automobile cabin, as the most closely contacted part with passengers, the automobile seat at the present stage is mainly limited to the basic function of manually or electrically controlling the positions of the front, the rear, the different directions and the like, and most of the automobile seats lack of scene control of future development trend and are different from the increasingly-growing beautiful living needs of people, so that the intelligent adjustment seat with different mood scenes has important significance.
Disclosure of Invention
The intelligent automobile seat adjusting and controlling method based on the use scene develops automobile intelligent adjusting seats with different mood scenes and is used for solving the technical problem that in the prior art, the automobile seats are monotonous in function and cannot adjust the moods of drivers or passengers.
The embodiment of the application provides an automobile intelligent regulation seat with different mood scenes, includes: a control analysis system, an emotion monitoring system and an intelligent seat system;
the control analysis system is respectively connected with the emotion monitoring system and the intelligent seat system; wherein, the liquid crystal display device comprises a liquid crystal display device,
the emotion monitoring system collects emotion parameters of passengers and sends the parameters to the control analysis system;
the control analysis system analyzes the emotion parameters of the passengers and sends control commands to the intelligent seat system according to analysis results;
the intelligent seat system receives the control command to make corresponding actions.
Further, the intelligent seat system feeds back the action result to the control analysis system.
Further, the emotion monitoring system comprises a body monitoring module, an expression monitoring module and a sound monitoring module.
Further, the control analysis system comprises a database module, a voice interaction module and an intelligent cabin domain controller.
Further, the intelligent seat system comprises an intelligent light module, an intelligent sound module, an intelligent aromatherapy module, an intelligent massage module, an intelligent hug module, an intelligent ventilation module and an intelligent heating module.
The embodiment of the application also provides a control method of the intelligent automobile adjusting seat with different mood scenes, which comprises the following steps of:
s102, collecting emotion parameters; the passenger sits on the intelligent seat, the emotion monitoring system monitors emotion parameters of the passenger in real time by wearing an intelligent bracelet on the seat or a self-speaking mode of the passenger, wherein a body monitoring module monitors physiological parameters of heart rate, blood oxygen, pressure, body temperature and respiratory rate of the passenger, an emotion monitoring module monitors facial expression and characteristic action changes of the passenger, and a sound monitoring module collects voice signals containing speech speed, audio frequency and vocabulary when the passenger speaks and transmits the emotion parameters to a control analysis system;
s104, extracting emotion characteristics; extracting features of 6 emotion parameters, wherein the feature extraction comprises 2 physiological parameters including heart rate and heart rate variability, 3 facial motion parameters including mouth motion, eyebrow motion, eye opening and closing and 1 voice signal recorded in real time;
preprocessing the heart rate signals and heart rate variability signals by utilizing a continuous wavelet transformation and smoothing processing method aiming at the collected 2 physiological parameter signals, and obtaining a plurality of physiological parameter feature vectors with emotion feature differences by utilizing time domain, frequency domain, nonlinearity and time-frequency domain feature extraction methods; aiming at the collected 3 facial motion tracking, combining a face detection technology and a facial motion coding system FACS, obtaining expression time sequence change characteristics of mouth, eyebrow and eye motions of a plurality of key parts which are strongly related to emotion based on a geometric feature method or a feature extraction method based on a wavelet analysis mode; aiming at 1 collected real-time recording voice signals, a spectrogram with voice time domain and frequency domain characteristics is obtained through a short-time Fourier transform spectrum analysis method, and simultaneously, a attention mechanism is introduced, and a convolutional neural network method is adopted to extract a plurality of voice emotion characteristics from the spectrogram in a protruding mode;
s106, emotion feature combination and selection; emotional characteristic combination and selection; although the emotional characteristics are extracted and selected in the step S104, as the invention integrates three different types of emotional parameters of physiology, expression and voice, in order to further avoid the problem of dimension disaster and model overfitting, the comprehensiveness of the emotional characteristics and the emotion recognition effect are improved, a maximum information coefficient theory method is introduced, the association strength among the different types of emotional characteristics is measured, and the strongly associated emotional characteristics are combined to obtain an optimized emotional characteristic set covering the three different types of emotional parameters.
S108, emotion classification and identification based on intelligent networking cloud computing; the horizontal axis and the vertical axis of the arousal degree-valence emotion model represent the positive and negative of different emotions and the excitation degree of an emotion state of people respectively, the three types of emotion parameters are subjected to feature extraction, combination, selection and training by means of a machine learning method based on a support vector machine algorithm or a deep learning method based on a convolutional neural network algorithm by means of an automobile intelligent networking and computing technology, the recognition accuracy is used as a standard, a model which can classify the positive and negative of the emotion and the excitation degree of the emotion respectively and has higher accuracy is obtained, and the passenger emotion recognition is carried out by the model according to an optimized emotion feature set of a monitoring user in the step S106.
Further, the intelligent adjusting seats can be divided into three modes: non-driving mode, driving mode and custom mode.
Further, for passengers using the vehicle for a long time, basic information such as names, ages, sexes and the like of the passengers are input into a database module in advance, and emotion characteristics recorded under different emotions, especially calm and steady neutral emotion, are used as training sets of the database.
Further, the user can confirm and correct the recognized emotion at any time, the confirmed and corrected emotion features become a new training set to be added into the database, and the recognition model is customized and updated for the user, so that the accuracy is further improved.
The embodiment of the application also provides a readable storage medium, and a program is stored on the readable storage medium, and the program executes the control method of the intelligent automobile seat with different mood scenes.
The embodiment provided by the application has at least the following beneficial effects:
compared with the prior device, the invention creatively provides an intelligent automobile adjusting seat with different mood scenes and a control method thereof, and the intelligent automobile adjusting seat comprises the following steps: a control analysis system, an emotion monitoring system and an intelligent seat system; the emotion monitoring system monitors the emotion of the passenger, the control analysis system extracts emotion characteristics firstly, and then the emotion classification method based on combination selection of multiple types of emotion characteristics effectively identifies the emotion state of the passenger on the seat, intelligent adjustment is carried out on the seat under different emotion scenes through control analysis, the emotion of the passenger is adjusted to a certain extent, and the increasing intelligent seat scene adjustment requirement of people is met.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiments of the application and together with the description serve to explain the application and do not constitute an undue limitation to the application. In the drawings:
fig. 1 is a schematic diagram of an intelligent adjustment seat for an automobile with different mood scenes according to an embodiment of the present application;
FIG. 2 is a flow chart of a method of controlling an intelligent car seat with different mood scenes;
fig. 3 has key recognition method criteria and main logic diagram of different mood-scene car intelligent regulation seats with respect to mood recognition.
In fig. 1-3: 201. an intelligent light module; 202. an intelligent sound module; 203. an intelligent aromatherapy module; 204. an intelligent massage module; 205. an intelligent hug module; 206. an intelligent ventilation module; 207. and an intelligent heating module.
Detailed Description
For the purposes, technical solutions and advantages of the present application, the technical solutions of the present application will be clearly and completely described below with reference to specific embodiments of the present application and corresponding drawings. It will be apparent that the described embodiments are only some, but not all, of the embodiments of the present application. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are within the scope of the present disclosure.
As shown in fig. 1 and 2, an embodiment of the present application provides an intelligent adjustment seat for a vehicle with different mood scenes, including: a control analysis system, an emotion monitoring system and an intelligent seat system;
the control analysis system is respectively connected with the emotion monitoring system and the intelligent seat system; wherein, the liquid crystal display device comprises a liquid crystal display device,
the emotion monitoring system collects emotion parameters of passengers and sends the parameters to the control analysis system;
the control analysis system analyzes the emotion parameters of the passengers and sends control commands to the intelligent seat system according to analysis results;
the intelligent seat system receives the control command to make corresponding actions.
It should be noted that, the action is that the intelligent light module 201 turns on light; the intelligent sound module 202 plays music; the intelligent aromatherapy module 203 is used for fumigating; the intelligent massage module 204 performs massage; the intelligent hug module 205 hugs; the intelligent ventilation module 206 ventilates; the intelligent heating module 207 performs heating and the like.
It should be noted that, user emotion parameters collected in real time by the emotion monitoring system are transmitted to the control analysis system, the control analysis system performs emotion analysis, learning and recognition, the intelligent seat system is controlled by preset adjustment parameters in the matched mood scenes, meanwhile, specific adjustment conditions of the intelligent seat system can be fed back to the control analysis system to be convenient to monitor, and finally the intelligent automobile adjustment seat with different mood scenes is obtained.
The emotion monitoring system is composed of a body monitoring module, an expression monitoring module and a sound monitoring module, and is mainly used for collecting the body, face and sound characteristics of the passengers and providing the body, face and sound characteristics for the control analysis system to carry out algorithm analysis and comprehensive judgment on the emotion states of the passengers.
It should be noted that, the body monitoring module is used for monitoring and tracking physiological parameters such as heart rate, heart rate variability, blood oxygen, body temperature, respiratory rate and the like of the passenger and changes thereof in real time. Preferably, when the passenger sits on the intelligent seat, the seat can provide the intelligent bracelet at the position, the passenger at the position is reminded of wearing the intelligent bracelet at the wrist through the voice interaction module of the control analysis system, the operation is simple and convenient, the body monitoring module is integrated on the bracelet, the physiological parameters of the wearer are monitored in real time, and the physiological parameters are transmitted to the control analysis system in a wireless mode.
It should be noted that the expression monitoring module is used for monitoring and tracking the facial expression and the change of the facial expression of the passenger in real time. The camera is used for capturing the facial features of the passengers, and the device can be arranged at a position on the surface of the bracelet, which is convenient to monitor whether the hands are put down or lifted up, or can be fixedly arranged on the interior trim parts around the corresponding seat, such as a steering wheel or an instrument panel integrated on the front row.
The sound monitoring module is used for monitoring and collecting the voice signals and the changes of the voice signals of the speaking of the passengers. Preferably, the module may be disposed on a surface of the headrest of the intelligent seat that does not interfere with contact of the head of the occupant with the headrest, as close as possible to the sound emitting area of the occupant, to facilitate monitoring of the occupant's sound characteristics and changes thereto to a greater extent.
It should be noted that the control analysis system includes a database module, a voice interaction module and an intelligent cabin controller, and has functions of data storage, voice interaction, feature extraction, combination, selection and emotion classification recognition according to the collected emotion parameters, and controlling the intelligent seat system.
It should be noted that, the database module is not only used for recording and storing the physiological, expression and sound characteristics of the passenger under different emotion states, but also used for storing and periodically updating the known physiological, expression and sound characteristic changes under a certain number of learned and researched common emotion states, and is used as a training set for learning to provide the intelligent cabin controller for analysis and judgment, and meanwhile, the intelligent seat under different emotion states is stored in a reasonable state.
The voice interaction module is used for the voice information interaction between the passengers and the control analysis system, so that the user-defined control of the passengers is facilitated, and the control of opening, closing, switching and the like of mood scenes can be performed in real time through communication with the passengers.
It should be noted that, the intelligent cabin area controller (CDC, cockpit Domain Controller) may be used to perform feature extraction according to the monitored emotion parameters, and identify the emotional state of the occupant based on the machine learning method, thereby controlling the modules of the intelligent seat system.
It should be noted that the intelligent seat system includes, but is not limited to, an intelligent lighting module 201, an intelligent sound module 202, an intelligent aromatherapy module 203, an intelligent massage module 204, an intelligent hug module 205, an intelligent ventilation module 206, and an intelligent heating module 207.
From the visual point of view of the shape, it is noted that, according to the analyzed emotional state: the intelligent lighting module 201 is used to show the occupant the lighting effect of the seat and the color brightness variation in the shape, and may be disposed at a position that is peripheral to the intelligent seat and does not affect the normal adjustment and safety of the seat, for example, in the form of a color and brightness adjustable light belt disposed on both sides of the backrest and the seat cushion.
From the acoustic auditory perspective, the emotional state is analyzed by: the intelligent sound module 202 is used for providing more immersive sound effects for passengers when sitting on the seat, and is arranged on the left and right side wing surfaces of the backrest foam or the two side surfaces of the headrest foam in the form of sound boxes.
From the olfactory perspective, it is noted that, according to the analyzed emotional state: the intelligent aromatherapy module 203 is used for providing an odor effect conforming to an emotion state when a passenger sits on the seat, has odor selection corresponding to a certain class of emotion, and is arranged at a position which is convenient for perfume supplement, replacement and release.
It should be noted that, from the touch sense point of view, according to the analyzed emotional state:
the intelligent massage module 204 is used to provide a massage effect of relieving pressure to a certain extent when a passenger sits on the seat, for example, by controlling the analysis system to control the electronic oscillator to drive the pneumatic device installed in the seat to operate at a certain frequency so as to play a role of massage or relaxing similar to a fascia gun.
It should be noted that, when the intelligent hug module 205 is used for a passenger sitting on a seat, the wrapping property of the backrest side wings, the cushion side wings or the headrest side wings is changed to a certain extent, so as to provide a hug-like effect, for example, a certain number of air bags are arranged in the backrest side wings, the cushion side wings or the headrest side wings, and the wrapping degree of the side wings on the passenger is changed by controlling the air quantity.
It should be noted that the intelligent ventilation module 206 is used to provide a local ventilation effect when the passenger sits on the seat, for example, by injecting air into the seat and out of the foaming surface of the backrest or the cushion in the form of blowing or sucking air, thereby realizing the ventilation function.
The intelligent heating module 207 is used to provide a local heating function when a passenger sits on the seat, for example, by disposing a heating resistance wire in the seat back or cushion and performing a local warming function by using electric heating.
It should be noted that, when using the automobile product, the emotional states of the passengers are classified into three categories, namely positive emotion with positive happiness, neutral emotion with calm and steady weight, and negative emotion with anger and sad fear, and each category of emotional state corresponds to different types of preset mood scenes and custom mood scenes. For determining the emotional state of the occupant, as shown in fig. 3, the embodiment of the application further provides a control method for the intelligent automobile seat with different mood scenes, and the intelligent automobile seat with different mood scenes is used, which comprises the following steps:
s102, collecting emotion parameters; the passenger sits on the intelligent seat, the emotion monitoring system monitors emotion parameters of the passenger in real time by wearing an intelligent bracelet on the seat or a self-speaking mode of the passenger, wherein a body monitoring module monitors physiological parameters of heart rate, blood oxygen, pressure, body temperature and respiratory rate of the passenger, an emotion monitoring module monitors facial expression and characteristic action changes of the passenger, and a sound monitoring module collects voice signals containing speech speed, audio frequency and vocabulary when the passenger speaks and transmits the emotion parameters to a control analysis system;
s104, extracting emotion characteristics; in order to control the difficulty of emotion classification, 6 emotion parameters which are comprehensive, key and mature in research are selected for feature extraction, wherein the feature extraction comprises 2 physiological parameters (heart rate and heart rate variability) +3 facial action parameters (mouth action, eyebrow action and eye opening and closing) +1 voice signal which is recorded in real time.
Preprocessing the heart rate signals and heart rate variability signals by utilizing a continuous wavelet transformation and smoothing processing method aiming at the collected 2 physiological parameter signals, and obtaining a plurality of physiological parameter feature vectors with emotion feature differences by utilizing time domain, frequency domain, nonlinearity and time-frequency domain feature extraction methods; aiming at the collected 3 facial motion tracking, combining a face detection technology and a facial motion coding system FACS, obtaining expression time sequence change characteristics of mouth, eyebrow and eye motions of a plurality of key parts which are strongly related to emotion based on a geometric feature method or a feature extraction method based on a wavelet analysis mode; aiming at 1 collected real-time recording voice signals, a spectrogram with voice time domain and frequency domain characteristics is obtained through a short-time Fourier transform spectrum analysis method, and simultaneously, a attention mechanism is introduced, and a convolutional neural network method is adopted to extract a plurality of voice emotion characteristics from the spectrogram in a protruding mode;
s106, emotion feature combination and selection; emotional characteristics combination and selection. Although the emotional characteristics are extracted and selected in the step S104, as the invention integrates three different types of emotional parameters of physiology, expression and voice, in order to further avoid the problem of dimension disaster and model overfitting, the comprehensiveness of the emotional characteristics and the emotion recognition effect are improved, a maximum information coefficient theory method is introduced, the association strength among the different types of emotional characteristics is measured, and the strongly associated emotional characteristics are combined to obtain an optimized emotional characteristic set covering the three different types of emotional parameters.
S108, emotion classification recognition based on intelligent networking cloud computing. As the most commonly used emotion model, the horizontal axis and the vertical axis of the arousal degree-valence emotion model respectively represent the positive and negative of different emotions and the excitation degree of the emotional state of people, for example, positive pleasure degree is combined with high intensity degree to be a happy emotion, positive pleasure degree is combined with low intensity degree to be a calm neutral emotion, and the like. By means of the rapid development of intelligent networking and computing technology of automobiles at present, three types of emotion parameters which are relatively mature in academic research in a database are subjected to feature extraction, combination, selection and training through a machine learning method based on algorithms such as a support vector machine or a deep learning method based on a convolutional neural network algorithm, and an identification accuracy rate is used as a standard to obtain a model which can classify emotion positive and negative and excitation degrees in two dimensions respectively and has relatively high accuracy, and passenger emotion identification is carried out through the model according to an optimized emotion feature set of a monitored user in step S106. Preferably, for passengers and drivers using the vehicle for a long time, basic information such as names, ages, sexes and the like of the passengers and the drivers can be input in the database module in advance, and emotional characteristics under different emotions, especially calm and steady neutral emotions, can be recorded as a training set of the database. In addition, the user can confirm and correct the identified emotion at any time, the confirmed and corrected emotion features become a new training set to be added into the database, and the accuracy is further improved by customizing and updating the identification model for the user.
Further, the intelligent adjusting seats can be divided into three modes: non-driving mode, driving mode and custom mode.
Further, for passengers and drivers using the vehicle for a long time, basic information such as names, ages, sexes and the like of the passengers and the drivers are input into a database module in advance, and emotional characteristics recorded under different emotions, particularly calm and steady neutral emotions, are used as training sets of the database.
Further, the user can confirm and correct the recognized emotion at any time, the confirmed and corrected emotion features become a new training set to be added into the database, and the recognition model is customized and updated for the user, so that the accuracy is further improved.
As shown in tables 1 and 2, in practical applications, the intelligent adjustment seat can be divided into three modes: non-driving mode, driving mode and custom mode.
Non-driving mode: as automobiles are developed to living and leisure places, people are increasingly used or like to rest on automobile seats, meditation, relaxation and the like to regulate, release or relieve their own emotion. Therefore, when the vehicle is in a non-driving state in the mode, the passenger enters the cabin and takes the passenger in the seat, the mood scene at the moment can be selected through the voice interaction module in a voice control mode, and when the mood scene is not selected by the passenger, the corresponding mood scene is automatically selected according to the mood recognition results obtained by the mood monitoring system and the control analysis system. Aiming at different mood scenes, the intelligent cabin domain controller of the control analysis system can generate control signals for each module of the intelligent seat system, intelligently adjust and match corresponding mood scenes, share positive moods of active happiness of passengers, and relieve negative moods of anger sad fear of the relaxed passengers. For example, for a common mood scenario preset by the system, the modules of the intelligent seat system may be set with adjustment controls as shown in table 1.
Table 1 Regulation control setting table for each module of intelligent seat system under common mood scene
Driving mode: when the intelligent seat system is used for a vehicle in a driving state, passengers, especially drivers, should be kept in a neutral emotion with calm and stable weight or a front emotion with lower excitement as much as possible in order to further improve the driving safety, so that once the vehicle is driven, the intelligent seat system can be automatically switched into a calm mood scene, and then according to emotion recognition results obtained by an emotion monitoring system and a control analysis system, the physiological, the expression and the acoustic characteristics of the passengers monitored in real time are respectively compared with corresponding reference characteristics under the calm and stable weight neutral emotion recorded by a database module in the control analysis system through controlling and continuously adjusting each module of the intelligent seat system, so that the heart rate, the heart rate variability, the mouth expression and other emotion parameters of the passengers, especially the drivers, are calm as soon as possible, and the vehicle is driven in a concentrated manner. For example, when the driver is in anger emotion driving the vehicle, the intelligent sound module 202 plays mild light music at a small volume, the intelligent aromatherapy module 203 releases the smell for relieving the stress relaxation, the intelligent ventilation module 206 starts the fire reduction, the intelligent hug module 205 and the intelligent heating module 207 are not started in anger emotion, and the intelligent light module 201 and the intelligent massage module 204 are not started by default in the driving mode.
Custom mode: as shown in table 2, the automobile user can customize different mood scenes and control settings of the corresponding modules in the intelligent seat system, or modify the control settings of the intelligent modules of the seats in the existing mood scenes, and can open the corresponding mood scenes by controlling the voice interaction module in the analysis system, thereby meeting the development requirements of individuation and customization of the user. For example, the user may define a happy mood, set the intelligent lighting module 201 of the intelligent seat to a color and brightness that the user feels happy, set the intelligent sound module 202 to a happy song, change the intelligent aromatherapy module 203 to a favorite perfume smell, set the intelligent hug module 205 and the intelligent ventilation module 206 on, and set the intelligent heating module 207 off. When a user sits on the driver seat, the key word of the front-row main driving happy scene is shouted, and the control analysis module controls and adjusts the corresponding intelligent modules of the seats in the intelligent seat system according to user definition.
The embodiment of the application also provides a readable storage medium, and a program is stored on the readable storage medium, and the program executes the control method of the intelligent automobile seat with different mood scenes.
Compared with the prior device, the intelligent automobile adjusting seat with different mood scenes and the control method thereof are innovatively provided, the mood state of an occupant on the seat is effectively identified based on the mood classification method selected by the combination of the multi-type mood features, intelligent adjustment of the seat under different mood scenes is realized from the aspects of shape, sound, smell and touch through control analysis, negative moods of the occupant are relieved or lightened to a certain extent, positive moods which are too high and excited are avoided in the driving process, the neutral calm moods are ensured to drive as much as possible, driving safety is improved, and the increasing intelligent seat scene adjusting demands of people are met.
It is further noted that the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article or apparatus that comprises the element.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The foregoing is merely exemplary of the present application and is not intended to limit the present application. Various modifications and changes may be made to the present application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc. which are within the spirit and principles of the present application are intended to be included within the scope of the claims of the present application.
Claims (10)
1. An intelligent car seat with different mood scenes, comprising: a control analysis system, an emotion monitoring system and an intelligent seat system;
the control analysis system is respectively connected with the emotion monitoring system and the intelligent seat system; wherein, the liquid crystal display device comprises a liquid crystal display device,
the emotion monitoring system collects emotion parameters of passengers and sends the parameters to the control analysis system;
the control analysis system analyzes the emotion parameters of the passengers and sends control commands to the intelligent seat system according to analysis results;
the intelligent seat system receives the control command to make corresponding actions.
2. The intelligent car seat with different mood scenes according to claim 1, wherein the intelligent seat system feeds back the action results to the control analysis system.
3. The intelligent car seat with different mood scenes according to claim 2, wherein the mood monitoring system includes a body monitoring module, a mood monitoring module, and a sound monitoring module.
4. The intelligent car seat with different mood scenes according to claim 3, wherein the control analysis system comprises a database module, a voice interaction module, and an intelligent cabin controller.
5. The intelligent car seat according to claim 4, wherein the intelligent seat system comprises an intelligent light module, an intelligent sound module, an intelligent fragrance module, an intelligent massage module, an intelligent hug module, an intelligent ventilation module, and an intelligent heating module.
6. A control method of an automobile intelligent regulation seat with different mood scenes, which uses the automobile intelligent regulation seat with different mood scenes according to claim 5, characterized by comprising the following steps:
s102, collecting emotion parameters; the passenger sits on the intelligent seat, the emotion monitoring system monitors emotion parameters of the passenger in real time by wearing an intelligent bracelet on the seat or a self-speaking mode of the passenger, wherein a body monitoring module monitors physiological parameters of heart rate, blood oxygen, pressure, body temperature and respiratory rate of the passenger, an emotion monitoring module monitors facial expression and characteristic action changes of the passenger, and a sound monitoring module collects voice signals containing speech speed, audio frequency and vocabulary when the passenger speaks and transmits the emotion parameters to a control analysis system;
s104, extracting emotion characteristics; extracting features of 6 emotion parameters, wherein the feature extraction comprises 2 physiological parameters including heart rate and heart rate variability, 3 facial motion parameters including mouth motion, eyebrow motion, eye opening and closing and 1 voice signal recorded in real time;
preprocessing the heart rate signals and heart rate variability signals by utilizing a continuous wavelet transformation and smoothing processing method aiming at the collected 2 physiological parameter signals, and obtaining a plurality of physiological parameter feature vectors with emotion feature differences by a time domain or frequency domain or nonlinear or time-frequency domain feature extraction method; aiming at the collected 3 facial motion tracking, combining a face detection technology and a facial motion coding system FACS, obtaining expression time sequence change characteristics of mouth, eyebrow and eye motions of a plurality of key parts which are strongly related to emotion based on a geometric feature method or a feature extraction method based on a wavelet analysis mode; aiming at 1 collected real-time recording voice signals, a spectrogram with voice time domain and frequency domain characteristics is obtained through a short-time Fourier transform spectrum analysis method, and simultaneously, a attention mechanism is introduced, and a convolutional neural network method is adopted to extract a plurality of voice emotion characteristics from the spectrogram in a protruding mode;
s106, emotion feature combination and selection; introducing a maximum information coefficient theory method, measuring the association strength among different types of emotion characteristics, combining and merging the strongly associated emotion characteristics to obtain an optimized emotion characteristic set covering three different types of emotion parameters;
s108, emotion classification and identification based on intelligent networking cloud computing; the horizontal axis and the vertical axis of the arousal degree-valence emotion model represent the positive and negative of different emotions and the excitation degree of an emotion state of people respectively, the three types of emotion parameters are subjected to feature extraction, combination, selection and training by means of a machine learning method based on a support vector machine algorithm or a deep learning method based on a convolutional neural network algorithm by means of an automobile intelligent networking and computing technology, the recognition accuracy is used as a standard, a model which can classify the positive and negative of the emotion and the excitation degree of the emotion respectively and has higher accuracy is obtained, and the passenger emotion recognition is carried out by the model according to an optimized emotion feature set of a monitoring user in the step S106.
7. The method for controlling an intelligent car seat with different mood scenes according to claim 6, wherein the intelligent car seat can be divided into three modes: non-driving mode, driving mode and custom mode.
8. The control method of intelligent car seat with different moods according to claim 6, wherein for the passengers using the car for a long time, basic information such as their names, ages and sexes are input in advance in the database module, and the emotional characteristics under different moods are recorded as training sets of the database.
9. The method for controlling an intelligent car seat with different mood scenes according to claim 6, wherein the user can confirm and correct the identified mood at any time, the confirmed and corrected mood features are added into the database as new training sets, and the identification model is customized and updated for the user to further improve the accuracy.
10. A readable storage medium, wherein a program is stored on the readable storage medium, the program executing the control method of the intelligent car seat with different mood scenes according to any one of claims 6 to 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310290999.7A CN116394807A (en) | 2023-03-22 | 2023-03-22 | Automobile intelligent adjusting seat with different mood scenes and control method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310290999.7A CN116394807A (en) | 2023-03-22 | 2023-03-22 | Automobile intelligent adjusting seat with different mood scenes and control method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116394807A true CN116394807A (en) | 2023-07-07 |
Family
ID=87009579
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310290999.7A Pending CN116394807A (en) | 2023-03-22 | 2023-03-22 | Automobile intelligent adjusting seat with different mood scenes and control method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116394807A (en) |
-
2023
- 2023-03-22 CN CN202310290999.7A patent/CN116394807A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7821382B2 (en) | Vehicular user hospitality system | |
| JP5152570B2 (en) | Automotive user hospitality system | |
| US8140344B2 (en) | Vehicular user hospitality system | |
| WO2021077737A1 (en) | Interaction based on vehicle-mounted digital human | |
| JP4525925B2 (en) | Automotive user hospitality system | |
| JP4525926B2 (en) | Automotive user hospitality system | |
| JP4535274B2 (en) | Automotive user hospitality system | |
| US20080119994A1 (en) | Vehicular user hospitality system | |
| JP4535272B2 (en) | Automotive user hospitality system | |
| US20160288708A1 (en) | Intelligent caring user interface | |
| CN108099827A (en) | For the adjusting method and device of automobile cabin | |
| JP2003072488A (en) | Onboard device and processing method of vehicle and vehicle information | |
| WO2020045658A1 (en) | Robot and voice generation program | |
| CN109313837A (en) | Operate the method and motor vehicle of motor vehicle | |
| KR101305129B1 (en) | Intelligent assistance apparatus and methed for entertainment of driver | |
| JP6115577B2 (en) | Vehicle occupant emotion response control device | |
| CN109109624A (en) | A kind of system of intelligent control gas generating unit | |
| CN112545516A (en) | Emotion adjusting method, device and system and storage medium | |
| JP2016137871A (en) | Vehicular occupant feeling correspondence control device | |
| JP4621983B2 (en) | Automotive user hospitality system | |
| JP2016137200A (en) | Control device for coping with feeling of passenger for vehicle | |
| CN116394807A (en) | Automobile intelligent adjusting seat with different mood scenes and control method thereof | |
| US11315675B2 (en) | System and method for entrainment of a user based on bio-rhythm of the user | |
| JP4968532B2 (en) | Automotive user hospitality system | |
| JP2016137202A (en) | Control device for coping with feeling of passenger for vehicle |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication |