CN117341445A - Vehicle-mounted fragrance control method and device, vehicle system and storage medium - Google Patents
Vehicle-mounted fragrance control method and device, vehicle system and storage medium Download PDFInfo
- Publication number
- CN117341445A CN117341445A CN202311394385.XA CN202311394385A CN117341445A CN 117341445 A CN117341445 A CN 117341445A CN 202311394385 A CN202311394385 A CN 202311394385A CN 117341445 A CN117341445 A CN 117341445A
- Authority
- CN
- China
- Prior art keywords
- type
- emotion information
- smell
- vehicle
- driver
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 239000003205 fragrance Substances 0.000 title claims abstract description 181
- 238000000034 method Methods 0.000 title claims abstract description 63
- 230000008451 emotion Effects 0.000 claims abstract description 235
- 230000001815 facial effect Effects 0.000 claims abstract description 30
- 238000012790 confirmation Methods 0.000 claims abstract description 14
- 230000004044 response Effects 0.000 claims abstract description 12
- 238000004590 computer program Methods 0.000 claims description 26
- 230000015654 memory Effects 0.000 claims description 18
- 230000036651 mood Effects 0.000 claims description 9
- 238000002360 preparation method Methods 0.000 abstract description 4
- 235000019645 odor Nutrition 0.000 description 113
- 230000035943 smell Effects 0.000 description 88
- 230000006870 function Effects 0.000 description 14
- 238000012545 processing Methods 0.000 description 14
- 238000004891 communication Methods 0.000 description 11
- 238000011217 control strategy Methods 0.000 description 11
- 230000002093 peripheral effect Effects 0.000 description 10
- 230000001133 acceleration Effects 0.000 description 9
- 238000010586 diagram Methods 0.000 description 7
- 230000003287 optical effect Effects 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 241000207199 Citrus Species 0.000 description 5
- 235000020971 citrus fruits Nutrition 0.000 description 5
- 235000014676 Phragmites communis Nutrition 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 238000013473 artificial intelligence Methods 0.000 description 3
- 238000001514 detection method Methods 0.000 description 3
- 240000000560 Citrus x paradisi Species 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 239000000919 ceramic Substances 0.000 description 2
- 230000006835 compression Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000009877 rendering Methods 0.000 description 2
- 238000011160 research Methods 0.000 description 2
- 244000141359 Malus pumila Species 0.000 description 1
- 235000006679 Mentha X verticillata Nutrition 0.000 description 1
- 235000002899 Mentha suaveolens Nutrition 0.000 description 1
- 235000001636 Mentha x rotundifolia Nutrition 0.000 description 1
- 244000273256 Phragmites communis Species 0.000 description 1
- 235000021016 apples Nutrition 0.000 description 1
- 238000013475 authorization Methods 0.000 description 1
- 230000033228 biological regulation Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000006641 stabilisation Effects 0.000 description 1
- 238000011105 stabilization Methods 0.000 description 1
- 239000010409 thin film Substances 0.000 description 1
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60H—ARRANGEMENTS OF HEATING, COOLING, VENTILATING OR OTHER AIR-TREATING DEVICES SPECIALLY ADAPTED FOR PASSENGER OR GOODS SPACES OF VEHICLES
- B60H3/00—Other air-treating devices
- B60H3/0007—Adding substances other than water to the air, e.g. perfume, oxygen
- B60H3/0035—Adding substances other than water to the air, e.g. perfume, oxygen characterised by the control methods for adding the substance
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/29—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area inside the vehicle, e.g. for viewing passengers or cargo
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
- B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
- B60R16/037—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for occupant comfort, e.g. for automatic adjustment of appliances according to personal settings, e.g. seats, mirrors, steering wheel
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Multimedia (AREA)
- Air-Conditioning For Vehicles (AREA)
Abstract
The application provides a vehicle-mounted fragrance control method, a vehicle-mounted fragrance control device, a vehicle-mounted system and a storage medium, and belongs to the technical field of vehicle control. According to the method provided by the embodiment of the invention, the first emotion of the driver can be obtained by collecting the facial image of the driver, the second emotion of the driver is predicted by the first emotion, preparation is made for emitting the corresponding smell, then the target smell type corresponding to the second emotion is matched in the matching relation table of the smell type and the emotion information type, the smell of the target smell type can pointedly influence the second emotion of the driver, then the smell switching prompt is output, the driver is prompted to switch the smell type, then the current smell type is switched to the target smell type in response to the confirmation switching operation of the target smell type, so that the emotion of the driver is influenced, the intelligent degree of the vehicle-mounted fragrance system is improved, and the fragrance experience of the driver is further improved.
Description
Technical Field
The present disclosure relates to the field of vehicle control technologies, and in particular, to a vehicle-mounted fragrance control method, device, vehicle-mounted system, and storage medium.
Background
Along with the development of the vehicle industry, the personalized demand for the vehicle-mounted system is gradually increased, and the vehicle-mounted fragrance system is used as one of the vehicle-mounted systems and can provide an odor environment for the interior of the vehicle. Research shows that smell and emotion of a person can influence each other, and different smell can influence different emotion. Therefore, how to control the emission of odors based on a vehicle-mounted fragrance system, thereby affecting the emotion of a driver, and improving the fragrance experience of the driver is an important point of research in the field.
At present, the common mode of controlling odor emission of the vehicle-mounted fragrance system is as follows: the in-vehicle fragrance system emits a scent based on a scent type selected by a user.
However, the above technical solution can only change the odor type in the vehicle based on the selection operation of the user, and has low intelligent degree, and affects the fragrance experience of the driver.
Disclosure of Invention
The embodiment of the application provides a vehicle-mounted fragrance control method, device, vehicle-mounted machine system and storage medium, which are used for controlling the emission of smell based on a vehicle-mounted fragrance system, improving the intelligent degree of the vehicle-mounted fragrance system and further improving the fragrance experience of a driver. The technical proposal is as follows:
in one aspect, a vehicle-mounted fragrance control method is provided, the method comprising:
Acquiring a face image of a driver, and acquiring at least one first emotion information of the driver based on the face image, wherein the at least one first emotion information is used for representing emotion of the driver in a first time period;
predicting second emotion information based on the at least one first emotion information, the second emotion information being used to represent the emotion of the driver in a second period of time, the second period of time being a period of time subsequent to the first period of time;
based on the second emotion information, acquiring a target odor type from a matching relation table of the odor type and the emotion information type, wherein the target odor type is matched with the type of the second emotion information;
outputting an odor switching prompt, wherein the odor switching prompt is used for prompting switching the current odor type into a target odor type;
and switching the current scent type to the target scent type in response to a confirmation switching operation of the target scent type.
In another aspect, there is provided a vehicle-mounted fragrance control device comprising:
the emotion information acquisition module is used for acquiring a face image of the driver, and acquiring at least one first emotion information of the driver based on the face image, wherein the at least one first emotion information is used for representing emotion of the driver in a first time period;
A prediction module for predicting second emotion information based on at least one first emotion information, the second emotion information being used for representing emotion of the driver in a second period of time, the second period of time being a period of time after the first period of time;
the target smell type acquisition module is used for acquiring a target smell type from a matching relation table of the smell type and the emotion information type based on the second emotion information, wherein the target smell type is matched with the type of the second emotion information;
the prompting module is used for outputting a smell switching prompt, and the smell switching prompt is used for prompting switching the current smell type into the target smell type;
and the switching module is used for switching the current smell type into the target smell type in response to the confirmation switching operation of the target smell type.
In some embodiments, the prediction module is to:
determining the occurrence frequency of first emotion information in each sub-period in the first period, and determining the duration duty ratio of the first emotion information in the first period based on the first emotion information and the number of sub-periods in the first period;
and determining the first emotion information with the duration ratio higher than the target duration ratio as second emotion information.
In some embodiments, the apparatus further comprises:
the emotion information type acquisition module is used for acquiring a plurality of emotion information types from the emotion type library, wherein the emotion type library comprises a plurality of different emotion information types;
the odor type acquisition module is used for acquiring various odor types of the plurality of odor dispersing devices based on radio frequency signals sent by the plurality of odor dispersing devices in the vehicle, wherein the odor dispersing devices are used for dispersing odor of one odor type;
the display module is used for displaying various emotion information types and various smell types in an interface form;
the generating module is used for responding to the matching operation of the driver aiming at various emotion information types and various smell types and generating a matching relation table of the smell types and the emotion information types.
In some embodiments, the switching module is to:
positioning a target type of fragrance dispersing equipment, wherein the target type is a fragrance dispersing equipment type capable of dispersing target odor type odors;
if the odor type in the vehicle is not the target odor type in the first time period, controlling the currently working fragrance diffusing equipment to stop diffusing the odor, and controlling the fragrance diffusing equipment to diffuse the target odor type;
and if no odor emission is detected in the first time period, controlling the target type fragrance emitting device to emit the target odor type odor.
In another aspect, a computer device is provided, the computer device including a processor and a memory for storing at least one section of a computer program, the at least one section of the computer program being loaded and executed by the processor to implement operations performed by the in-vehicle fragrance control method in embodiments of the present application.
In another aspect, a computer readable storage medium is provided, in which at least one section of a computer program is stored, the at least one section of the computer program being loaded and executed by a processor to implement operations performed by an in-vehicle fragrance control method in an embodiment of the present application.
In another aspect, a computer program product or computer program is provided, the computer program product or computer program comprising computer program code stored in a computer readable storage medium, the computer program code being read from the computer readable storage medium by a processor of a computer device, the computer program code being executed by the processor, such that the computer device performs the in-vehicle fragrance control method provided in the various alternative implementations of any of the above aspects.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic view of an implementation environment of an on-board fragrance control method according to an embodiment of the present application;
fig. 2 is a flowchart of an on-board fragrance control method provided according to an embodiment of the present application;
fig. 3 is a schematic flow chart of a vehicle-mounted fragrance control method according to an embodiment of the present application;
fig. 4 is a flowchart of an on-board fragrance control method provided according to an embodiment of the present application;
fig. 5 is a schematic flow chart of an on-vehicle fragrance control method according to an embodiment of the present application;
fig. 6 is a schematic flow chart of an on-vehicle fragrance control method according to an embodiment of the present application;
fig. 7 is a block diagram of a vehicle-mounted fragrance control device provided according to an embodiment of the present application;
FIG. 8 is a schematic diagram of a computer device according to an embodiment of the present application;
fig. 9 is a schematic structural diagram of a server according to an embodiment of the present application.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the present application more apparent, the embodiments of the present application will be described in further detail below with reference to the accompanying drawings.
The terms "first," "second," and the like in this application are used to distinguish between identical or similar items that have substantially the same function and function, and it should be understood that there is no logical or chronological dependency between the "first," "second," and "nth" terms, nor is it limited to the number or order of execution.
The term "at least one" in this application means one or more, and the meaning of "a plurality of" means two or more.
It should be noted that, information (including but not limited to user equipment information, user personal information, etc.), data (including but not limited to data for analysis, stored data, presented data, etc.), and signals referred to in this application are all authorized by the user or are fully authorized by the parties, and the collection, use, and processing of relevant data is required to comply with relevant laws and regulations and standards of relevant countries and regions. For example, the facial images referred to in this application are all acquired with sufficient authorization.
Fig. 1 is a schematic view of an implementation environment of a vehicle-mounted fragrance control method according to an embodiment of the present application. Referring to fig. 1, the implementation environment is a vehicle system.
The vehicle system comprises a computer device 101, and in some embodiments, the computer device is provided with and runs an application program supporting data processing, the application program is used for processing emotion information data and smell type data, the computer device 101 is illustratively used by a user, and the user can trigger a data processing function on the computer device 101 to determine a target smell type, so that the vehicle fragrance system can control the smell emission in the vehicle.
In some embodiments, the vehicle system includes a DMS (Driver Monitoring System ) and a vehicle-mounted fragrance system, the DMS is mainly responsible for collecting facial images of a driver and predicting emotion information, the vehicle-mounted fragrance system is mainly responsible for collecting odor types and controlling emission of odors in a vehicle, the vehicle-mounted fragrance system includes a CLM (Climate Module), a fragrance controller and a fragrance dispersing device, the air conditioner controller detects an in-vehicle environment including an in-vehicle temperature and the like through a sensor, the fragrance controller is mainly responsible for controlling the fragrance dispersing device to emit odors of different odor types, and the fragrance dispersing device is mainly responsible for emitting odors of different odor types, and the air conditioner controller, the fragrance controller and the fragrance dispersing device cooperate to implement the vehicle-mounted fragrance control method provided by the embodiments of the application.
In some embodiments, the vehicle system can download data from the server 102, where the server 102 is a separate physical server, can be a server cluster or a distributed system formed by a plurality of physical servers, and can also be a cloud server that provides cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN (Content Delivery Network ), basic cloud computing services such as big data and artificial intelligence platforms. The server is used for providing background service for the vehicle-mounted system. In some embodiments, the server takes on primary computing work and the vehicle system takes on secondary computing work; or the server bears secondary computing work, and the vehicle machine system bears primary computing work; or, the server and the vehicle computer system adopt a distributed computing architecture to perform cooperative computing.
The vehicle system and the server can be directly or indirectly connected through wired or wireless communication, which is not limited herein.
In some embodiments, the vehicle system may further be connected to a terminal, where the terminal may be, but is not limited to, a smart phone, a tablet computer, a notebook computer, and the like, and the terminal has a function module supporting facial recognition, and the function module supporting facial recognition may be a social application, a multimedia application, and the like.
For example, the application program supporting facial recognition is a social application program, firstly, a video is shot, then the shot video is sent to a server, after the video is received by the server, the expression characteristics of the person in the video are determined by adopting the vehicle-mounted fragrance control method provided by the embodiment of the application, so that the emotion information of the person in the video is determined, and optionally, the emotion information of the person is displayed by a GUI (Graphical User Interface ) interface in a vehicle system.
In some embodiments, the wireless network or wired network described above uses standard communication techniques and/or protocols. The network is typically the internet, but can be any network including, but not limited to, a local area network (Local Area Network, LAN), metropolitan area network (Metropolitan Area Network, MAN), wide area network (Wide Area Network, WAN), mobile, wired or wireless network, private network, or any combination of virtual private networks. In some embodiments, data exchanged over the network is represented using techniques and/or formats including HyperText Mark-up Language (HTML), extensible markup Language (Extensible Markup Language, XML), and the like. In addition, all or some of the links can be encrypted using conventional encryption techniques such as secure socket layer (Secure Socket Layer, SSL), transport layer security (Transport Layer Security, TLS), virtual private network (Virtual Private Network, VPN), internet protocol security (Internet Protocol Security, IPsec), and the like. In other embodiments, custom and/or dedicated data communication techniques can also be used in place of or in addition to the data communication techniques described above.
Fig. 2 is a flowchart of a vehicle-mounted fragrance control method according to an embodiment of the present application, and as shown in fig. 2, a vehicle-mounted system is taken as an example in the embodiment of the present application. The vehicle-mounted fragrance control method comprises the following steps:
201. the DMS in the vehicle system acquires a face image of the driver, and acquires at least one first emotion information of the driver based on the face image, wherein the at least one first emotion information is used for representing emotion of the driver in a first time period.
In some embodiments, the capturing of the facial image of the driver is implemented based on a DMS, the DMS captures an image or video stream containing a face based on a camera in a capturing module, and then the DMS transmits the image or video stream to a detection module, and detects the face in the image and the video stream based on the detection module, thereby capturing the facial image of the driver, and by performing operations such as face feature extraction on the facial image of the driver, first emotion information of the driver is obtained, where the first emotion information includes emotion, such as happiness, vigilance, difficulty, and the like, of the driver in a first period of time.
The first time period is a certain target time period in which a face is detected after the DMS is started, and the duration of the target time period may be set to ten minutes or may be set to other durations.
202. The DMS in the vehicle system predicts second emotion information for representing emotion of the driver in a second period of time, which is a period of time after the first period of time, based on the at least one first emotion information.
In some embodiments, the DMS in the vehicle system and the vehicle-mounted fragrance control system perform data transmission through a CAN (Controller Area Network ) bus technology, the DMS transmits the predicted second emotion information data to the vehicle-mounted fragrance system, and the vehicle-mounted fragrance system further controls the smell through the received second emotion information data, so that linkage of the two systems is realized, and the vehicle-mounted fragrance control method of the embodiment of the application is jointly realized.
In order to ensure the instantaneity of the vehicle-mounted fragrance system for odor control, the DMS linked with the vehicle-mounted fragrance system periodically collects face images of a driver, and predicts emotion information of the next time period of the first time period after the emotion information of the first time period is collected, so that emission of odor is controlled in a targeted manner.
The second emotion information includes an emotion of the driver in a time period after the first time period, and is similar to the process of acquiring the first emotion information, for example, a face image of the driver in the time period after the first time period is acquired, and the second emotion information of the driver is acquired through operations such as face feature extraction of the face image of the driver.
203. And the vehicle-mounted fragrance system in the vehicle-mounted system acquires a target odor type from a matching relation table of the odor type and the emotion information type based on the second emotion information, wherein the target odor type is matched with the type of the second emotion information.
In some embodiments, the odor type and emotion information type matching relationship table includes matching relationships between multiple odor types and multiple emotion information types, wherein odors of different odor types can affect the emotion of different emotion information types, for example, when the emotion of a driver falls down, the taste of fresh apples or reeds can affect the emotion of the driver, so that the emotion of the driver becomes happy.
The matching relation table of the smell type and the emotion information type is set by user definition, the user can register user identifications in the vehicle-mounted aroma system, different user identifications correspond to the matching relation table of different smell types and emotion information types, the matching relation table of the smell types and the emotion information types is stored by the user identifications, the user identifications correspond to facial images of the user, the user inputs own facial images in advance, the vehicle-mounted aroma system associates the facial images with the user identifications of the user, after the vehicle-mounted aroma system is started, facial images of the user are identified through facial recognition by a DMS (digital hierarchy) linked with the vehicle-mounted aroma system, so that the user identifications of the user are determined, and then the matching relation table of the smell types and the emotion information types corresponding to the user is obtained based on the user identifications.
204. The vehicle-mounted fragrance system in the vehicle-mounted system outputs a smell switching prompt, and the smell switching prompt is used for prompting that the current smell type is switched to the target smell type.
In some embodiments, the vehicle-mounted fragrance system interacts with a user in the form of an interface, and outputs a fragrance switching prompt on the interface after the vehicle-mounted fragrance system acquires a target fragrance type, wherein the fragrance switching prompt can comprise a fragrance type of fragrance, a fragrance concentration of fragrance and a fragrance emission rate of fragrance, the fragrance type is the target fragrance type, and the user can confirm the fragrance type, the fragrance concentration and the fragrance emission rate to be emitted by selecting on the interface.
For example, the interface shows "is the odor type replaced with reed odor? The user clicks the button with a plurality of different functions after clicking the button with the confirmation, including the button with the smell concentration adjustment and the button with the smell emission rate adjustment, the user can click the button with the smell concentration adjustment, then the sliding block displayed in the sliding interface is clicked to adjust the smell concentration, the button with the saving is clicked to save the smell concentration at the concentration value position of the current sliding block, or the button with the smell emission rate adjustment is clicked, the sliding block is slid to adjust the smell emission rate, and the button with the saving is clicked to save the smell concentration at the concentration value position of the current sliding block.
205. The in-vehicle fragrance system in the in-vehicle system switches the current scent type to the target scent type in response to a confirmation switching operation for the target scent type.
In some embodiments, a control instruction is generated based on a user's confirmation switching operation, the control instruction enabling a CLM in the vehicle-mounted fragrance system to control switching of scent types, thereby causing the vehicle-mounted fragrance system to emit scents of a target scent type.
In some embodiments, the vehicle-mounted fragrance control method is implemented through various hardware linkages, referring to fig. 3, fig. 3 is a hardware topological diagram related to the vehicle-mounted fragrance control method according to an embodiment of the application, in the figure, a vehicle is mainly used for providing a system interface to realize interaction between a user and a system, the vehicle is used for realizing data exchange with a DMS and a CLM through a CAN bus technology, the DMS and the CLM are also used for data exchange through the CAN, the DMS is mainly used for acquiring and predicting facial images of a driver in a driving state, the CLM is mainly used for controlling switching of odor types, the CLM and a fragrance controller are used for data exchange through a LIN (Local Interconnect Network) and a local connection network, and the fragrance controller is mainly used for emitting odor.
According to the method provided by the embodiment of the invention, the first emotion of the driver can be obtained by collecting the facial image of the driver, the second emotion of the driver is predicted by the first emotion, preparation is made for emitting the corresponding smell, then the target smell type corresponding to the second emotion is matched in the matching relation table of the smell type and the emotion information type, the smell of the target smell type can pointedly influence the second emotion of the driver, then the smell switching prompt is output, the driver is prompted to switch the smell type, then the current smell type is switched to the target smell type in response to the confirmation switching operation of the target smell type, so that the emotion of the driver is influenced, the intelligent degree of the vehicle-mounted fragrance system is improved, and the fragrance experience of the driver is further improved.
Fig. 4 is a flowchart of a vehicle-mounted fragrance control method according to an embodiment of the present application, and as shown in fig. 4, a vehicle-mounted system is taken as an example in the embodiment of the present application. The method comprises the following steps:
401. a DMS in the vehicle system acquires a facial image of a driver, and acquires at least one expression feature of the driver in a first time period based on the facial image of the driver.
In some embodiments, the DMS extracts facial features of the driver, such as the relative position of the driver's mouth across the face and the arc of the driver's canthus, when extracting facial features from the driver's facial image, which can represent the driver's expressive features.
The expression features are of various types, and different types of expression features can represent different emotion information of a driver.
402. Based on the at least one expression feature, the DMS in the vehicle-mounted system acquires at least one first emotion information of the driver from a relation matching table of the expression feature and the emotion information.
In some embodiments, the expression feature-to-emotion information relationship matching table stores a plurality of expression feature-to-emotion information relationship data, wherein the expression feature-to-emotion information relationship includes one-to-one, many-to-one, and many-to-many, e.g., a one-to-one relationship refers to one expression feature corresponding to one emotion information.
In some embodiments, the DMS periodically acquires the expression features of the driver during the first period, so that the expression features of each sub-period during the first period may be obtained, and for each expression feature, step 402 is performed to obtain the first emotion information of each sub-period during the first period based on each expression feature acquired during the sub-period.
403. The DMS in the vehicle system predicts second emotion information for representing emotion of the driver in a second period of time, which is a period of time after the first period of time, based on the at least one first emotion information.
In some embodiments, the prediction process is implemented in a DMS, wherein the prediction process includes the following steps 403A and 403B:
403A: the DMS determines the occurrence number of the first emotion information in each sub-period in the first period, and determines the duration duty ratio of the first emotion information in the first period based on the first emotion information and the number of the sub-periods in the first period.
In some embodiments, the number of occurrences of the first emotion information may represent the emotion of the user in the first period, and based on statistics of the number of occurrences, it may be determined which emotion is the main emotion in the first period, and the main emotion may last for the next period, so that the first emotion information determined based on the number of occurrences may predict the second emotion information more accurately, so as to improve accuracy of fragrance control.
For example, 10 emotions are extracted in the first period, and accordingly, the first emotion information for indicating fatigue appears 8 times in the first period, and the duration of the first emotion information in the first period is 80%.
403B: the DMS determines the first emotion information with the duration ratio higher than the target duration ratio as the second emotion information.
In some embodiments, after determining the time length duty ratio of the plurality of first emotion information in the first time period, comparing the time length duty ratios with the target time length duty ratio, and determining the first emotion information with the time length duty ratio higher than the target time length duty ratio as the second emotion information, where the target time length duty ratio may take 70%, and other values may also take, which is not limited in this application.
404. And the vehicle-mounted fragrance system in the vehicle-mounted system acquires a target odor type from a matching relation table of the odor type and the emotion information type based on the second emotion information, wherein the target odor type is matched with the type of the second emotion information.
In some embodiments, the matching relationship table of the odor type and the emotion information type is generated at the system initialization stage of the vehicle-mounted aroma system, and the generating process may refer to fig. 5, and fig. 5 is a flow chart of a vehicle-mounted aroma control method in the embodiments of the present application, as shown in the drawing, firstly, the emotion information type supported by DMS is obtained, then the odor type in the vehicle-mounted aroma system is obtained through CLM, and then the fragrance selection interface is entered, based on the fragrance selection interface, the user matches the odor type and the emotion information type, that is, a matching relationship table of the odor type and the emotion information type is created in the vehicle-mounted aroma system, and then the vehicle-mounted aroma system stores the matching relationship table of the odor type and the emotion information type, where the generating process of the matching relationship table of the odor type and the emotion information type includes the following steps 404A-404D:
404A: the vehicle system obtains a plurality of emotion information types from an emotion type library, wherein the emotion type library comprises a plurality of different emotion information types.
In some embodiments, the emotion type library is formed based on data of a large amount of emotion information, and is stored in the DMS, the emotion type library comprises the emotion information types such as fatigue, pleasure, sadness and the like, and the vehicle-mounted fragrance system obtains a plurality of different emotion information types in the emotion type library of the DMS based on the CAN, so that preparation is made for the vehicle system to display the plurality of different emotion information types.
404B: the vehicle-mounted fragrance system acquires a plurality of odor types of a plurality of fragrance dispersing devices based on radio frequency signals sent by the fragrance dispersing devices in a vehicle, wherein the fragrance dispersing devices are used for dispersing one odor type.
The fragrance dispersing device is controlled by the fragrance controller, a plurality of different fragrance dispersing devices are arranged in the vehicle-mounted fragrance system, namely, the fragrance dispersing device can emit the smells of a plurality of different smell types, and the vehicle-mounted fragrance system converts the radio frequency signals into the smell types by receiving the radio frequency signals emitted by the fragrance dispersing device, so that a plurality of smell types included in the vehicle-mounted fragrance system are acquired, and data of the plurality of smell types are stored in the CLM to prepare for displaying the plurality of smell types.
In some embodiments, based on the radio frequency signal of the fragrance dispersing device received by the vehicle-mounted fragrance system, a prompt function can be realized, when the fragrance concentration in the fragrance dispersing device is lower than a fixed value, the fragrance allowance for dispersing the fragrance in the fragrance dispersing device is insufficient, and the vehicle-mounted fragrance dispersing device is prompted to be replaced by the vehicle-mounted fragrance system in an interface mode, so that the fragrance in the vehicle-mounted fragrance system is ensured to be dispersed at any time.
404C: the car machine system displays the plurality of emotion information types and the plurality of smell types in an interface form.
In some embodiments, the on-board fragrance system acquires multiple emotion information types in the system from the DMS based on the CAN, acquires multiple odor types in the system from the CLM, and displays the multiple emotion information types and the multiple odor types simultaneously in the form of an interface for a user to create a matching relationship table of the odor types and the emotion information types.
The matching operation is a custom setting, and matching operations corresponding to different users may be the same or different, for example, when the user a matches the odor type with the emotion information type, the reed odor type matches with the sad emotion information type, but when the user B matches the odor type with the emotion information type, the reed odor type matches with the tired emotion information type.
404D: the vehicle-mounted fragrance system responds to the matching operation of the driver aiming at the plurality of emotion information types and the plurality of smell types, and generates a matching relation table of the smell types and the emotion information types.
In some embodiments, the on-board fragrance system may generate a table of matching relationship between scent types and emotion information types in the form of a data table, which may be similar to step 404C, and the matching relationship between scent types and emotion information types of different users may be different, so as to facilitate distinction, and store the matching relationship between scent types and emotion information types in correspondence with the user identification of the user.
405. The vehicle-mounted fragrance system in the vehicle-mounted system outputs a smell switching prompt, and the smell switching prompt is used for prompting that the current smell type is switched to the target smell type.
The output scent switching prompting step is the same as the step 204.
In some embodiments, before outputting the scent switching prompt, the air conditioner controller in the vehicle-mounted fragrance system further generates an emotion control strategy based on the environmental factors in the vehicle and the system requirements, wherein the emotion control strategy comprises scent emission strategies set for different emotion information types. In some embodiments, the emotion control strategy includes emitting different smell types of different styles in time periods, or emitting the same smell type in different concentrations in time periods, for example, the emotion control strategy is to emit different smell types in time periods, based on the fact that the second emotion information of the driver is pleasant, and the air conditioner controller obtains that the temperature in the vehicle is higher than the preset temperature, the generated emotion control strategy is to emit citrus of the smell type corresponding to the pleasure in the first half period of the second time period and emit mint of the smell type corresponding to the higher temperature in the vehicle in the second half period, and the content of the smell switching prompt corresponding to the emotion control strategy is still to prompt to switch the current smell type to the target smell type; or the emotion control strategy is to emit the same odor type at different concentrations in different time periods, the second emotion information of the driver is confirmed to be pleasant based on the DMS system, and the air conditioner controller obtains that the temperature in the vehicle is the same as the preset temperature, and the generated emotion control strategy is that the concentration of the citrus odor type emitted in the first half of the second time period is 50%, and the concentration of the citrus odor type is increased in the second half at a frequency of 10% concentration per minute.
In still other embodiments, the emotion control strategy may further include emitting different smell types of the same style in a time period, for example, based on the DMS system, confirming that the second emotion information of the driver is pleasant, and the air conditioner controller obtains that the temperature in the vehicle is the same as the preset temperature, the generated emotion control strategy is to emit a citrus smell type in a first half of the second time period, and emit a grapefruit smell type in a second half, wherein the citrus smell type and the grapefruit smell type are smell types of which the same style corresponds to the pleasant emotion information, and the emotion control strategy enables the manner of controlling the smell emission by the vehicle-mounted fragrance system to be adjusted in real time along with the environment in the vehicle and the emotion information of the driver, so that the manner of emitting the smell in the vehicle is more flexible, and the intelligent degree of the vehicle-mounted fragrance system for the smell emission in the vehicle is further improved.
406. The in-vehicle fragrance system in the in-vehicle system switches the current scent type to the target scent type in response to a confirmation switching operation of the target scent type.
In some embodiments, the target type of scent needs to be emitted based on the scent controller controlling the corresponding scent dispersing apparatus, so after the vehicle-mounted scent system receives the confirmation switching operation of the target scent type, a corresponding scent control instruction is generated, and the scent control instruction can instruct the scent controller to control the scent dispersing apparatus to switch the current scent type to the target scent type, wherein the step of switching the current scent type to the target scent type includes the following steps 406A-406C:
406A: positioning a target type of fragrance emitting device, the target type being a fragrance emitting device type capable of emitting a target scent type scent.
Based on the fragrance control instruction, the fragrance controller can acquire the identification information of the fragrance dispersing equipment for dispersing the target odor type, and can acquire the fragrance dispersing equipment for dispersing the target odor type in the vehicle-mounted fragrance system based on the identification information, so that the fragrance dispersing equipment for dispersing the target odor type is further controlled.
406B: and if the odor type in the vehicle is not the target odor type in the first time period, controlling the currently working fragrance diffusing device to stop diffusing the odor, and controlling the fragrance diffusing device to diffuse the target odor type.
Before controlling the fragrance dispersing device to emit the odor, the CLM in the vehicle-mounted fragrance system firstly samples the air in the vehicle to detect whether the odor is emitted in the vehicle, and the fragrance controller in the vehicle-mounted fragrance system also detects the type of the fragrance dispersing device in the current working state.
In some embodiments, if the CLM detects the emission of a scent in the vehicle and the fragrance controller detects that the type of the scent diffusing device in the operating state in the first period of time is not the target scent type, the fragrance controller controls to turn off the scent diffusing device emitting the current scent type scent, and then the fragrance controller positions the scent diffusing device of the target type based on the scent control instruction and controls the scent diffusing device of the target type to start operating, thereby diffusing the scent of the target scent type.
406C, if no odor emission is detected in the first time period, controlling the target type fragrance emitting device to emit the target odor type odor.
If no odor is emitted in the vehicle in the first time based on the CLM, the CLM transmits the detection result to a fragrance controller, and the fragrance controller positions the fragrance emitting device of the target type based on the fragrance control instruction and controls the fragrance emitting device of the target type to emit the odor of the target odor type.
In some embodiments, the vehicle-mounted fragrance control method is implemented in a vehicle-mounted fragrance system, the overall flow of the method can be seen in fig. 6, fig. 6 is a schematic flow chart of a vehicle-mounted fragrance control method in the embodiment of the application, as shown in the figure, firstly, facial images of a driver in a first time period are collected based on a DMS in the vehicle-mounted fragrance system, the emotion of the driver in the first time period is obtained, then the emotion of the driver in a next time period is predicted based on the DMS, the DMS transmits the predicted emotion of the driver in the next time period to the vehicle-mounted fragrance system, a target odor type is obtained based on a matching relation table of odor types and emotion information types in the vehicle-mounted fragrance system, and then a fragrance controller in the vehicle-mounted fragrance system controls switching of the odor types in the vehicle to be the target odor types.
According to the method provided by the embodiment of the invention, the first emotion of the driver can be obtained by collecting the facial image of the driver, the second emotion of the driver is predicted by the first emotion, preparation is made for emitting the corresponding odor, then the target odor type corresponding to the second emotion is matched in the matching relation table of the odor type and the emotion information type, the odor of the target odor type can pointedly influence the second emotion of the driver, then the odor switching prompt is output, the driver is prompted to switch the odor type, then the current odor type is switched to the target odor type in response to the confirmation switching operation of the target odor type, thereby influencing the emotion of the driver, the intelligent degree of the vehicle-mounted fragrance system is improved, and the fragrance experience of the driver is further improved.
Fig. 7 is a block diagram of a vehicle-mounted fragrance control device provided according to an embodiment of the present application. The device is used for executing the steps when the vehicle-mounted fragrance control method is executed, and referring to fig. 7, the device comprises:
a mood information obtaining module 701, configured to collect a facial image of a driver, and obtain at least one first mood information of the driver based on the facial image, where the at least one first mood information is used to represent a mood of the driver in a first period of time;
A prediction module 702, configured to predict second emotion information based on at least one first emotion information, where the second emotion information is used to represent an emotion of the driver in a second period of time, and the second period of time is a period of time after the first period of time;
a target smell type obtaining module 703, configured to obtain a target smell type in a matching relationship table of smell types and emotion information types based on the second emotion information, where the target smell type matches the type of the second emotion information;
the prompting module 704 is configured to output a smell switching prompt, where the smell switching prompt is configured to prompt switching of a current smell type to a target smell type;
the switching module 705 is configured to switch the current scent type to the target scent type in response to a confirmation switching operation of the target scent type.
In some embodiments, the mood information acquisition module 701 is configured to:
acquiring an expression characteristic of the driver in a first time period based on the facial image of the driver;
based on the expression features, first emotion information of the driver is obtained in a relation matching table of the expression features and the emotion information.
In some embodiments, the prediction module 702 is to:
determining the occurrence frequency of first emotion information in each sub-period in the first period, and determining the duration duty ratio of the first emotion information in the first period based on the first emotion information and the number of sub-periods in the first period;
And determining the first emotion information with the duration ratio higher than the target duration ratio as second emotion information.
In some embodiments, the apparatus further comprises:
the emotion information type acquisition module is used for acquiring a plurality of emotion information types from the emotion type library, wherein the emotion type library comprises a plurality of different emotion information types;
the odor type acquisition module is used for acquiring various odor types of the plurality of odor dispersing devices based on radio frequency signals sent by the plurality of odor dispersing devices in the vehicle, wherein the odor dispersing devices are used for dispersing odor of one odor type;
the display module is used for displaying various emotion information types and various smell types in an interface form;
the generating module is used for responding to the matching operation of the driver aiming at various emotion information types and various smell types and generating a matching relation table of the smell types and the emotion information types.
In some embodiments, the switching module 705 is to:
positioning a target type of fragrance dispersing equipment, wherein the target type is a fragrance dispersing equipment type capable of dispersing target odor type odors;
if the odor type in the vehicle is not the target odor type in the first time period, controlling the currently working fragrance diffusing equipment to stop diffusing the odor, and controlling the fragrance diffusing equipment to diffuse the target odor type;
And if no odor emission is detected in the first time period, controlling the target type fragrance emitting device to emit the target odor type odor.
It should be noted that: the vehicle-mounted fragrance control device provided in the above embodiment is only exemplified by the division of the above functional modules when controlling the emission of the odor in the vehicle, and in practical application, the above functional allocation may be performed by different functional modules according to needs, i.e. the internal structure of the device is divided into different functional modules, so as to perform all or part of the functions described above. In addition, the vehicle-mounted fragrance control device provided in the above embodiment and the vehicle-mounted fragrance control method embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment, which is not repeated here.
In the embodiment of the present application, the computer device may be configured as a terminal or a server, and when the computer device is configured as a terminal, the technical solution provided in the embodiment of the present application may be implemented by the terminal as an execution body, and when the computer device is configured as a server, the technical solution provided in the embodiment of the present application may be implemented by the server as an execution body, and also the technical solution provided in the present application may be implemented by interaction between the terminal and the server, which is not limited in this embodiment of the present application.
Fig. 8 is a block diagram of a computer device 800 provided in accordance with an embodiment of the present application. The computer device 800 may be a portable mobile terminal such as: a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III, motion picture expert compression standard audio plane 3), an MP4 (Moving Picture Experts Group Audio Layer IV, motion picture expert compression standard audio plane 4) player, a notebook computer, or a desktop computer. The computer device 800 may also be referred to by other names of user devices, portable terminals, laptop terminals, desktop terminals, and the like.
In general, the computer device 800 includes: a processor 801 and a memory 802.
Processor 801 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and the like. The processor 801 may be implemented in at least one hardware form of DSP (Digital Signal Processing ), FPGA (Field-Programmable Gate Array, field programmable gate array), PLA (Programmable Logic Array ). The processor 801 may also include a main processor, which is a processor for processing data in an awake state, also referred to as a CPU (Central Processing Unit ), and a coprocessor; a coprocessor is a low-power processor for processing data in a standby state. In some embodiments, the processor 801 may integrate a GPU (Graphics Processing Unit, image processor) for taking care of rendering and rendering of the content that the display screen is required to display. In some embodiments, the processor 801 may also include an AI (Artificial Intelligence ) processor for processing computing operations related to machine learning.
Memory 802 may include one or more computer-readable storage media, which may be non-transitory. Memory 802 may also include high-speed random access memory as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In some embodiments, a non-transitory computer readable storage medium in memory 802 is used to store at least one computer program for execution by processor 801 to implement the on-board fragrance control method provided by the method embodiments herein.
In some embodiments, the computer device 800 may optionally further include: a peripheral interface 803, and at least one peripheral. The processor 801, the memory 802, and the peripheral interface 803 may be connected by a bus or signal line. Individual peripheral devices may be connected to the peripheral device interface 803 by buses, signal lines, or a circuit board. Specifically, the peripheral device includes: at least one of radio frequency circuitry 804, a display 805, a camera assembly 806, audio circuitry 807, and a power supply 808.
Peripheral interface 803 may be used to connect at least one Input/Output (I/O) related peripheral to processor 801 and memory 802. In some embodiments, processor 801, memory 802, and peripheral interface 803 are integrated on the same chip or circuit board; in some other embodiments, either or both of the processor 801, the memory 802, and the peripheral interface 803 may be implemented on separate chips or circuit boards, which is not limited in this embodiment.
The Radio Frequency circuit 804 is configured to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 804 communicates with a communication network and other communication devices via electromagnetic signals. The radio frequency circuit 804 converts an electrical signal into an electromagnetic signal for transmission, or converts a received electromagnetic signal into an electrical signal. In some embodiments, the radio frequency circuit 804 includes: antenna systems, RF transceivers, one or more amplifiers, tuners, oscillators, digital signal processors, codec chipsets, subscriber identity module cards, and so forth. The radio frequency circuitry 804 may communicate with other terminals via at least one wireless communication protocol. The wireless communication protocol includes, but is not limited to: the world wide web, metropolitan area networks, intranets, generation mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks, and/or WiFi (Wireless Fidelity ) networks. In some embodiments, the radio frequency circuitry 804 may also include NFC (Near Field Communication ) related circuitry, which is not limited in this application.
The display 805 is used to display a UI (User Interface). The UI may include graphics, text, icons, video, and any combination thereof. When the display 805 is a touch display, the display 805 also has the ability to collect touch signals at or above the surface of the display 805. The touch signal may be input as a control signal to the processor 801 for processing. At this time, the display 805 may also be used to provide virtual buttons and/or virtual keyboards, also referred to as soft buttons and/or soft keyboards. In some embodiments, the display 805 may be one, disposed on the front panel of the computer device 800; in other embodiments, the display 805 may be at least two, respectively disposed on different surfaces of the computer device 800 or in a folded design; in other embodiments, the display 805 may be a flexible display disposed on a curved surface or a folded surface of the computer device 800. Even more, the display 805 may be arranged in an irregular pattern other than rectangular, i.e., a shaped screen. The display 805 may be made of LCD (Liquid Crystal Display ), OLED (Organic Light-Emitting Diode) or other materials.
The camera assembly 806 is used to capture images or video. In some embodiments, the camera assembly 806 includes a front camera and a rear camera. Typically, the front camera is disposed on the front panel of the terminal and the rear camera is disposed on the rear surface of the terminal. In some embodiments, the at least two rear cameras are any one of a main camera, a depth camera, a wide-angle camera and a tele camera, so as to realize that the main camera and the depth camera are fused to realize a background blurring function, and the main camera and the wide-angle camera are fused to realize a panoramic shooting and Virtual Reality (VR) shooting function or other fusion shooting functions. In some embodiments, the camera assembly 806 may also include a flash. The flash lamp can be a single-color temperature flash lamp or a double-color temperature flash lamp. The dual-color temperature flash lamp refers to a combination of a warm light flash lamp and a cold light flash lamp, and can be used for light compensation under different color temperatures.
Audio circuitry 807 may include a microphone and a speaker. The microphone is used for collecting sound waves of users and the environment, converting the sound waves into electric signals, inputting the electric signals to the processor 801 for processing, or inputting the electric signals to the radio frequency circuit 804 for voice communication. For purposes of stereo acquisition or noise reduction, the microphone may be multiple, each disposed at a different location of the computer device 800. The microphone may also be an array microphone or an omni-directional pickup microphone. The speaker is used to convert electrical signals from the processor 801 or the radio frequency circuit 804 into sound waves. The speaker may be a conventional thin film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, not only the electric signal can be converted into a sound wave audible to humans, but also the electric signal can be converted into a sound wave inaudible to humans for ranging and other purposes. In some embodiments, audio circuit 807 may also include a headphone jack.
The power supply 808 is used to power the various components in the computer device 800. The power supply 808 may be an alternating current, a direct current, a disposable battery, or a rechargeable battery. When the power supply 808 includes a rechargeable battery, the rechargeable battery may be a wired rechargeable battery or a wireless rechargeable battery. The wired rechargeable battery is a battery charged through a wired line, and the wireless rechargeable battery is a battery charged through a wireless coil. The rechargeable battery may also be used to support fast charge technology.
In some embodiments, the computer device 800 also includes one or more sensors 809. The one or more sensors 809 include, but are not limited to: acceleration sensor 810, gyro sensor 811, pressure sensor 812, optical sensor 813, and proximity sensor 814.
The acceleration sensor 810 may detect the magnitude of acceleration on three coordinate axes of a coordinate system established with the computer device 800. For example, the acceleration sensor 810 may be used to detect components of gravitational acceleration in three coordinate axes. The processor 801 may control the display screen 805 to display a user interface in a landscape view or a portrait view based on the gravitational acceleration signal acquired by the acceleration sensor 810. Acceleration sensor 810 may also be used for the acquisition of motion data for a game or user.
The gyro sensor 811 may detect a body direction and a rotation angle of the computer device 800, and the gyro sensor 811 may collect a 3D motion of the user on the computer device 800 in cooperation with the acceleration sensor 810. The processor 801 may implement the following functions based on the data collected by the gyro sensor 811: motion sensing (e.g., changing UI according to a tilting operation by a user), image stabilization at shooting, game control, and inertial navigation.
Pressure sensor 812 may be disposed on a side frame of computer device 800 and/or on an underside of display 805. When the pressure sensor 812 is disposed on the side frame of the computer device 800, a grip signal of the user on the computer device 800 may be detected, and the processor 801 performs a left-right hand recognition or a shortcut operation according to the grip signal collected by the pressure sensor 812. When the pressure sensor 812 is disposed at the lower layer of the display screen 805, the processor 801 controls the operability control on the UI interface according to the pressure operation of the user on the display screen 805. The operability controls include at least one of a button control, a scroll bar control, an icon control, and a menu control.
The optical sensor 813 is used to collect the intensity of the ambient light. In one embodiment, the processor 801 may control the display brightness of the display screen 805 based on the intensity of ambient light collected by the optical sensor 813. Specifically, when the intensity of the ambient light is high, the display brightness of the display screen 805 is turned up; when the ambient light intensity is low, the display brightness of the display screen 805 is turned down. In another embodiment, the processor 801 may also dynamically adjust the shooting parameters of the camera module 806 based on the ambient light intensity collected by the optical sensor 813.
A proximity sensor 814, also known as a distance sensor, is typically provided on the front panel of the computer device 800. The proximity sensor 814 is used to capture the distance between the user and the front of the computer device 800. In one embodiment, when the proximity sensor 814 detects that the distance between the user and the front of the computer device 800 gradually decreases, the processor 801 controls the display 805 to switch from the bright screen state to the off screen state; when the proximity sensor 814 detects that the distance between the user and the front surface of the computer device 800 gradually increases, the processor 801 controls the display screen 805 to switch from the off-screen state to the on-screen state.
Those skilled in the art will appreciate that the architecture shown in fig. 8 is not limiting and that more or fewer components than shown may be included or that certain components may be combined or that a different arrangement of components may be employed.
Fig. 9 is a schematic structural diagram of a server provided according to an embodiment of the present application, where the server 900 may have a relatively large difference due to different configurations or performances, and may include one or more processors (Central Processing Units, CPU) 901 and one or more memories 902, where at least one computer program is stored in the memories 902, and the at least one computer program is loaded and executed by the processor 901 to implement the vehicle-mounted fragrance control method provided in each of the method embodiments described above. Of course, the server may also have a wired or wireless network interface, a keyboard, an input/output interface, and other components for implementing the functions of the device, which are not described herein.
The embodiment of the application also provides a computer readable storage medium, wherein at least one section of computer program is stored in the computer readable storage medium, and the at least one section of computer program is loaded and executed by a processor of the vehicle system to realize the operation executed by the vehicle system in the vehicle-mounted fragrance control method of the embodiment. For example, the computer readable storage medium may be Read-Only Memory (ROM), random-access Memory (Random Access Memory, RAM), compact disc Read-Only Memory (Compact Disc Read-Only Memory, CD-ROM), magnetic tape, floppy disk, optical data storage device, and the like.
Embodiments of the present application also provide a computer program product or computer program comprising computer program code stored in a computer readable storage medium. The computer program code is read from the computer readable storage medium by a processor of the in-vehicle system, which executes the computer program code, causing the in-vehicle system to perform the in-vehicle fragrance control method provided in the various alternative implementations described above.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program for instructing relevant hardware, where the program may be stored in a computer readable storage medium, and the storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
The foregoing description of the preferred embodiments is merely exemplary in nature and is in no way intended to limit the invention, since it is intended that all modifications, equivalents, improvements, etc. that fall within the spirit and scope of the invention.
Claims (10)
1. A vehicle-mounted fragrance control method, characterized in that the method comprises:
acquiring a face image of a driver, and acquiring at least one first emotion information of the driver based on the face image, wherein the at least one first emotion information is used for representing emotion of the driver in a first time period;
predicting second emotion information based on the at least one first emotion information, the second emotion information being used for representing emotion of the driver in a second time period, the second time period being a time period after the first time period;
based on the second emotion information, acquiring a target odor type from a matching relation table of the odor type and the emotion information type, wherein the target odor type is matched with the type of the second emotion information;
outputting an odor switching prompt, wherein the odor switching prompt is used for prompting switching the current odor type into the target odor type;
And switching the current smell type to the target smell type in response to a confirmation switching operation of the target smell type.
2. The method of claim 1, wherein the acquiring a facial image of the driver, acquiring at least one first mood information of the driver based on the facial image, comprises:
acquiring an expression feature of the driver in a first time period based on the facial image of the driver;
and acquiring the first emotion information of the driver in a relation matching table of the expression characteristics and the emotion information based on the expression characteristics.
3. The method of claim 1, wherein predicting second mood information based on the at least one first mood information comprises:
determining the occurrence times of first emotion information in each sub-period in the first period, and determining the duration ratio of the first emotion information in the first period based on the first emotion information and the number of sub-periods in the first period;
and determining the first emotion information with the duration ratio higher than the target duration ratio as the second emotion information.
4. The method according to claim 1, wherein the method further comprises:
Acquiring a plurality of emotion information types from an emotion type library, wherein the emotion type library comprises a plurality of different emotion information types;
based on radio frequency signals sent by a plurality of fragrance dispersing devices in a vehicle, acquiring a plurality of smell types of the fragrance dispersing devices, wherein the fragrance dispersing devices are used for dispersing smell of one smell type;
displaying the plurality of emotion information types and the plurality of scent types in an interface form;
and generating a matching relation table of the smell types and the emotion information types in response to the matching operation of the driver aiming at the plurality of emotion information types and the plurality of smell types.
5. The method of claim 1, wherein switching the current scent type to the target scent type in response to a confirmation switching operation of the target scent type comprises:
positioning a target type of fragrance dispersing equipment, wherein the target type is a fragrance dispersing equipment type capable of dispersing the odor of the target odor type;
if the odor type in the vehicle is not the target odor type in the first time period, controlling the currently working fragrance dispersing equipment to stop the emission of the odor, and controlling the fragrance dispersing equipment to emit the target odor type;
And if no odor emission is detected in the first time period, controlling the target type fragrance emitting device to emit the odor of the target odor type.
6. A vehicle-mounted fragrance control device, the device comprising:
the system comprises an emotion information acquisition module, a first emotion information acquisition module and a second emotion information acquisition module, wherein the emotion information acquisition module is used for acquiring a face image of a driver and acquiring at least one first emotion information of the driver based on the face image, wherein the at least one first emotion information is used for representing emotion of the driver in a first time period;
a prediction module for predicting second emotion information based on the at least one first emotion information, the second emotion information being used for representing emotion of the driver in a second period of time, the second period of time being a period of time after the first period of time;
the target smell type acquisition module is used for acquiring a target smell type from a matching relation table of the smell type and the emotion information type based on the second emotion information, wherein the target smell type is matched with the type of the second emotion information;
the prompting module is used for outputting a smell switching prompt, and the smell switching prompt is used for prompting switching the current smell type into the target smell type;
And the switching module is used for switching the current smell type into the target smell type in response to the confirmation switching operation of the target smell type.
7. The apparatus of claim 6, wherein the mood information acquisition module is configured to:
acquiring the expression characteristics of the driver in a first time period based on the facial image of the driver;
and acquiring the first emotion information of the driver in a relation matching table of the expression characteristics and the emotion information based on the expression characteristics.
8. A vehicle system comprising a processor and a memory for storing at least one computer program loaded by the processor and executing the vehicle-mounted fragrance control method according to any one of claims 1 to 5.
9. A computer-readable storage medium, characterized in that the computer-readable storage medium is for storing at least one segment of a computer program for executing the in-vehicle fragrance control method of any one of claims 1 to 5.
10. A computer program product comprising a computer program, characterized in that the computer program, when executed by a processor, implements the in-vehicle fragrance control method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311394385.XA CN117341445A (en) | 2023-10-24 | 2023-10-24 | Vehicle-mounted fragrance control method and device, vehicle system and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311394385.XA CN117341445A (en) | 2023-10-24 | 2023-10-24 | Vehicle-mounted fragrance control method and device, vehicle system and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117341445A true CN117341445A (en) | 2024-01-05 |
Family
ID=89355595
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311394385.XA Pending CN117341445A (en) | 2023-10-24 | 2023-10-24 | Vehicle-mounted fragrance control method and device, vehicle system and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117341445A (en) |
-
2023
- 2023-10-24 CN CN202311394385.XA patent/CN117341445A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110377365B (en) | Method and device for showing small program | |
| CN110334352B (en) | Guide information display method, device, terminal and storage medium | |
| CN110061900B (en) | Message display method, device, terminal and computer readable storage medium | |
| CN110341627B (en) | Method and device for controlling behavior in vehicle | |
| CN112328091B (en) | Barrage display method and device, terminal and storage medium | |
| CN113212257B (en) | Automatic driver seat position adjusting method, device, terminal and storage medium based on Internet of vehicles | |
| CN112764608B (en) | Message processing method, device, equipment and storage medium | |
| CN111339326A (en) | Multimedia resource display method, multimedia resource providing method and multimedia resource providing device | |
| CN112416207A (en) | Information content display method, device, equipment and medium | |
| CN116331102A (en) | Vehicle control method, device, equipment and storage medium | |
| CN106330672B (en) | Instant messaging method and system | |
| CN113076077B (en) | Method, device and equipment for installing vehicle-mounted program | |
| CN112311661B (en) | Message processing method, device, equipment and storage medium | |
| CN113609358A (en) | Content sharing method and device, electronic equipment and storage medium | |
| CN111061369B (en) | Interaction method, device, equipment and storage medium | |
| CN111341317B (en) | Method, device, electronic equipment and medium for evaluating wake-up audio data | |
| CN112118482A (en) | Audio file playing method and device, terminal and storage medium | |
| CN110152309B (en) | Voice communication method, device, electronic equipment and storage medium | |
| CN114143280B (en) | Session display method and device, electronic equipment and storage medium | |
| CN117341445A (en) | Vehicle-mounted fragrance control method and device, vehicle system and storage medium | |
| CN114594751B (en) | Method, device and equipment for testing vehicle functions and computer readable storage medium | |
| CN112860046A (en) | Method, apparatus, electronic device and medium for selecting operation mode | |
| CN112717409B (en) | Virtual vehicle control method, device, computer equipment and storage medium | |
| CN115643445A (en) | Interaction processing method and device, electronic equipment and storage medium | |
| CN113204673A (en) | Audio processing method, device, terminal and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |