CN113459943A - Vehicle control method, device, equipment and storage medium - Google Patents
Vehicle control method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN113459943A CN113459943A CN202110727432.2A CN202110727432A CN113459943A CN 113459943 A CN113459943 A CN 113459943A CN 202110727432 A CN202110727432 A CN 202110727432A CN 113459943 A CN113459943 A CN 113459943A
- Authority
- CN
- China
- Prior art keywords
- vehicle
- welcome
- user
- preset
- driver
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 38
- 238000011217 control strategy Methods 0.000 claims abstract description 38
- 238000004458 analytical method Methods 0.000 claims abstract description 18
- 238000004590 computer program Methods 0.000 claims description 22
- 238000010438 heat treatment Methods 0.000 claims description 12
- 230000000977 initiatory effect Effects 0.000 claims description 6
- 230000004044 response Effects 0.000 claims description 4
- 230000006870 function Effects 0.000 description 34
- 238000012549 training Methods 0.000 description 12
- 238000013527 convolutional neural network Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 5
- 230000006872 improvement Effects 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 238000012545 processing Methods 0.000 description 5
- 241000220317 Rosa Species 0.000 description 4
- 238000004891 communication Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 238000013528 artificial neural network Methods 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000001816 cooling Methods 0.000 description 2
- 230000007423 decrease Effects 0.000 description 2
- 238000007791 dehumidification Methods 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 238000011176 pooling Methods 0.000 description 2
- 230000035807 sensation Effects 0.000 description 2
- 230000004913 activation Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q1/00—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
- B60Q1/26—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic
- B60Q1/32—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating vehicle sides, e.g. clearance lights
- B60Q1/323—Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to indicate the vehicle, or parts thereof, or to give signals, to other traffic for indicating vehicle sides, e.g. clearance lights on or for doors
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
- B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
- B60R16/023—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for transmission of signals between vehicle parts or subsystems
-
- H—ELECTRICITY
- H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
- H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
- H05B47/00—Circuit arrangements for operating light sources in general, i.e. where the type of light source is not relevant
- H05B47/10—Controlling the light source
- H05B47/105—Controlling the light source in response to determined parameters
- H05B47/115—Controlling the light source in response to determined parameters by determining the presence or movement of objects or living beings
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02B—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO BUILDINGS, e.g. HOUSING, HOUSE APPLIANCES OR RELATED END-USER APPLICATIONS
- Y02B20/00—Energy efficient lighting technologies, e.g. halogen lamps or gas discharge lamps
- Y02B20/40—Control techniques providing energy savings, e.g. smart controller or presence detection
Abstract
The invention discloses a vehicle control method, which comprises the following steps: responding to the welcome starting operation, and acquiring an in-car user image shot by an in-car camera; based on a preset user analysis model, carrying out user identification on the in-vehicle user image to obtain the character attributes and the number of the in-vehicle users; acquiring a preset welcome control strategy corresponding to the in-vehicle user based on the character attributes and the number of the in-vehicle users; and controlling the vehicle according to the welcome control strategy. The invention also discloses a vehicle control device, a vehicle control apparatus, and a computer-readable storage medium. By adopting the embodiment of the invention, the corresponding welcome function is automatically opened through analyzing the scene of the vehicle driven by the user, so that the driving experience of the user is improved, and the vehicle is more intelligent.
Description
Technical Field
The present invention relates to the field of vehicle technologies, and in particular, to a vehicle control method, apparatus, device, and storage medium.
Background
The variety of vehicle types is increasing with the development of the automotive industry, and there are also higher demands on the comfort and luxury configuration required for different types of vehicles. Therefore, in order to improve the comfort and appearance of the vehicle, it is important to improve the overall luxury of the vehicle. Nowadays, automobiles generally have a guest-greeting function, such as a guest-greeting lamp, and the traditional guest-greeting lamp can improve the grade of the automobile on one hand, and can illuminate the road of an automobile door for a passenger on the other hand, so that the passenger has the feeling of being guest to home. These courtesy lights are generally installed below the door or below the rearview mirror, and are lit at the moment when the door is opened when the driver or passenger is ready to get on the vehicle; or when the automobile door is pushed open by flameout, the welcome lamp is instantly lightened. However, the meeting requirements of the user cannot be met only by the meeting lamp, and the meeting lamp cannot interact with the driver, so that the intelligent driving environment cannot be adapted.
Disclosure of Invention
The embodiment of the invention aims to provide a vehicle control method, a vehicle control device, equipment and a storage medium, which can automatically open a corresponding welcome function by analyzing a scene of a user driving a vehicle, improve the driving experience of the user and enable the vehicle to be more intelligent.
In order to achieve the above object, an embodiment of the present invention provides a vehicle control method, including:
responding to the welcome starting operation, and acquiring an in-car user image shot by an in-car camera;
based on a preset user analysis model, carrying out user identification on the in-vehicle user image to obtain the character attributes and the number of the in-vehicle users;
acquiring a preset welcome control strategy corresponding to the in-vehicle user based on the character attributes and the number of the in-vehicle users;
and controlling the vehicle according to the welcome control strategy.
As a modification of the above, the character attributes include a driver and a non-driver; then, the obtaining of the preset welcome control strategy corresponding to the in-vehicle user includes:
when the number of the users in the vehicle is 1 and the character attribute of the users in the vehicle is a driver, controlling the vehicle to play a welcome language corresponding to the driver;
after the object greeting is played, controlling a vehicle to play a music program corresponding to the driver;
and acquiring historical main driving seat adjusting parameters of the driver, and adjusting seat parameters of a main driving seat based on the historical main driving seat adjusting parameters.
As an improvement of the above scheme, the obtaining of the preset welcome control strategy corresponding to the in-vehicle user further includes:
when the number of the users in the vehicle is larger than 1 and the character attributes of the users in the vehicle comprise drivers, playing a voice prompt;
acquiring voice information of a user in a vehicle, and identifying the voice information;
and when the voice information meets a preset voice control scene, controlling the vehicle according to the voice control scene.
As an improvement of the above scheme, after responding to the guest initiation operation, the method further includes:
identifying an outdoor scene, and adjusting a temperature control device in the vehicle according to the identified outdoor scene; wherein, the temperature control device comprises at least one of a vehicle air conditioner, a seat heating device and a steering wheel heating device.
As an improvement of the above, after the controlling the vehicle according to the welcome control strategy, the vehicle control method further includes:
when a preset welcome ending condition is met, the welcome function is closed and the vehicle is controlled to recover the driving mode; the welcome ending condition comprises that starting and departure of the vehicle are detected or a welcome stopping instruction sent by a user is received.
As an improvement of the above scheme, the response condition of the welcome initiation includes at least one of the following:
detecting that a vehicle key is within a preset range of the vehicle;
detecting a welcome starting instruction sent by a mobile terminal;
acquiring a voice signal, wherein the voice signal meets a preset voice starting condition;
and acquiring a welcome starting instruction sent by a vehicle display device.
In order to achieve the above object, an embodiment of the present invention further provides a vehicle control apparatus, including:
the welcome starting module is used for responding to the welcome starting operation;
the identification module is used for acquiring an in-vehicle user image shot by an in-vehicle camera; based on a preset user analysis model, carrying out user identification on the in-vehicle user image to obtain the character attributes and the number of the in-vehicle users;
the welcome control module is used for acquiring a preset welcome control strategy corresponding to the in-vehicle user based on the character attributes and the number of the in-vehicle users; and controlling the vehicle according to the welcome control strategy.
As an improvement of the above aspect, the vehicle control device further includes:
the welcome ending module is used for closing the welcome system and controlling the vehicle to recover the driving mode when a preset welcome ending condition is met; the welcome ending condition comprises that starting and departure of the vehicle are detected or a welcome stopping instruction sent by a user is received.
To achieve the above object, an embodiment of the present invention further provides a vehicle control apparatus, including a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, wherein the processor implements the vehicle control method according to any one of the above embodiments when executing the computer program.
In order to achieve the above object, an embodiment of the present invention further provides a computer-readable storage medium, where the computer-readable storage medium includes a stored computer program, and when the computer program runs, the apparatus where the computer-readable storage medium is located is controlled to execute the vehicle control method according to any one of the above embodiments.
Compared with the prior art, the vehicle control method, the vehicle control device, the vehicle control equipment and the storage medium provided by the embodiment of the invention have the advantages that the person attributes and the number of the in-vehicle users are obtained by carrying out user identification on the in-vehicle user images, then the preset welcome control strategy corresponding to the in-vehicle users is obtained based on the person attributes and the number of the in-vehicle users, and the vehicle is controlled according to the welcome control strategy. Through the scene analysis to the user driving vehicle, open corresponding usher's function automatically, improve user's driving experience, make the vehicle more intelligent.
Drawings
FIG. 1 is a flow chart of a vehicle control method provided by an embodiment of the present invention;
fig. 2 is a block diagram of a vehicle control apparatus according to an embodiment of the present invention;
fig. 3 is a block diagram of a vehicle control apparatus according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, fig. 1 is a flowchart of a vehicle control method according to an embodiment of the present invention, where the vehicle control method includes:
s1, responding to the welcome starting operation, and acquiring an in-car user image shot by an in-car camera;
s2, based on a preset user analysis model, carrying out user identification on the in-vehicle user image to obtain the character attributes and the number of the in-vehicle users;
s3, acquiring a preset welcome control strategy corresponding to the in-vehicle user based on the character attributes and the number of the in-vehicle user;
and S4, controlling the vehicle according to the welcome control strategy.
It is worth to be noted that the vehicle control method according to the embodiment of the present invention is implemented by a vehicle-mounted controller in a vehicle, where the vehicle-mounted controller is a front-end device of a vehicle monitoring and management system, integrates multiple functions such as data processing and data communication, and has a strong service scheduling function and data processing capability. The vehicle-mounted controller establishes communication connection with a camera and other equipment in the vehicle in advance. The vehicle-mounted controller identifies the character attributes and the number of the users in the vehicle based on an image identification technology, acquires a corresponding welcome control strategy according to the identified character attributes and the number, and finally controls the vehicle according to the welcome control strategy to realize the welcome function of the vehicle.
Specifically, in step S1, the response condition of the guest initiation operation includes at least one of:
detecting that a vehicle key is within a preset range of the vehicle;
detecting a welcome starting instruction sent by a mobile terminal;
acquiring a voice signal, wherein the voice signal meets a preset voice starting condition;
and acquiring a welcome starting instruction sent by a vehicle display device.
For example, the preset range may be 1m, and when the vehicle key is detected to be near the vehicle, it indicates that the user is near the vehicle at this time, and needs to use the vehicle, and the welcome function is activated at this time. The user can also load the APP on the mobile terminal of the user, and when the vehicle receives a guest greeting starting instruction sent by the user from the mobile terminal, the guest greeting function is started at the moment. When the vehicle detects the voice signal, whether the voice signal is a pre-stored voice guest-initiating instruction or not is detected, and if so, the guest-initiating function is initiated at the moment. The user can also start the greeting system through a display device in the vehicle, for example, the greeting start instruction is sent through a touch screen in the vehicle, and at the moment, the greeting function is started.
Specifically, in step S2, the character attributes include a driver including a history driver and a new driver and a non-driver. After the in-vehicle user image is obtained, the in-vehicle user image is sent to the user analysis model, so that the user analysis model performs image recognition on the in-vehicle user image. For example, the user analysis model may be a CNN (Convolutional neural network) model. The CNN is a feedforward neural network, comprises a convolutional layer and a pooling layer, and has wide application in the field of image recognition. Theoretically, as long as there are enough training samples, the CNN model with the corresponding recognition function can be obtained, the training samples refer to the original data marked with the recognition result, and in the user face recognition scene, the training samples are the images marked with the face information of the driver.
Further, in the process of training the user analysis model, in order to improve the recognition accuracy and the convergence rate of the model, the training sample may be preprocessed before being input to the model to be trained, specifically, the training sample is subjected to preliminary feature extraction, so as to improve the convergence rate of the model by reducing the calculation amount.
Specifically, in steps S3 to S4, a preset welcome control strategy corresponding to the in-vehicle user is obtained based on the attributes and the number of the people of the in-vehicle user, and the vehicle is controlled according to the welcome control strategy.
In one embodiment, the welcome function of the vehicle can be simplified when only one driver is using the vehicle. The step of obtaining the preset welcome control strategy corresponding to the in-vehicle user comprises steps S31-S33:
s31, when the number of the in-vehicle users is 1 and the character attribute of the in-vehicle users is a driver, controlling a vehicle to play a welcome language corresponding to the driver;
s32, after the object greeting is played, controlling the vehicle to play a music program corresponding to the driver;
and S33, obtaining historical main driving seat adjusting parameters of the driver, and adjusting the seat parameters of the main driving seat based on the historical main driving seat adjusting parameters.
For example, the greeting may change over time, such as in the morning the greeting may be "host, good morning" and may also include weather conditions. After the object greeting is played, the music playing device in the vehicle can be automatically started to play music programs. Meanwhile, the seat parameters of the main driver seat are automatically adjusted, so that a comfortable driving environment is provided for the driver. Understandably, when the driver manually adjusts the seat parameters each time, the system automatically records the historical main driving seat adjusting parameters, and then analyzes the seat parameters meeting the habits of the user according to the historical main driving seat adjusting parameters, so that the automatic adjustment of the main driving seat can be realized according to the seat adjusting habits of the user.
Further, when the character attribute of the user in the vehicle is identified as the driver, whether the driver is a historical driver or a non-driver can be further analyzed, for the non-driver, the music program played by the vehicle can be random, and the seat adjustment parameter can also be the default adjustment parameter of the system. For the historical drivers, different driving habits of different historical drivers can be recorded, the music programs played at the time are also corresponding to the historical drivers, and the music programs which are in line with the favorite of the historical drivers can be automatically recommended by integrating the music program playing habits of the historical drivers. Similarly, the adjustment parameters of the main driver seat correspond to historical drivers, that is, if there are a plurality of historical drivers, the adjustment parameters of the main driver seat are correspondingly recorded.
In another embodiment, when the in-vehicle user has other people besides the driver, the driver may want the vehicle to perform more complicated welcome operation, and the voice recognition device in the vehicle is activated to perform corresponding control operation according to the voice information of the in-vehicle user. Then, the obtaining of the preset welcome control strategy corresponding to the in-vehicle user further includes steps S34 to S36:
s34, when the number of the in-vehicle users is larger than 1 and the character attributes of the in-vehicle users comprise drivers, playing voice reminding;
s35, acquiring voice information of a user in the vehicle, and identifying the voice information;
and S36, when the voice information meets a preset voice control scene, controlling the vehicle according to the voice control scene.
Illustratively, if someone other than the owner drives the car, the car will enter the voice reminding mode, and the smart voice will ask "owner, your good", the in-car user can reply dozens of answers such as "lover's happy occasion, birthday happy occasion, new year happy occasion, go hi together, we go to play", and each answer corresponds to one scene, for example: the valentine's day is happy, and atmosphere lamp can present pink scintillation effect in the car, has a sensation of heartbeat, also can sound romantic valentine's day song simultaneously, and the full-screen rose also can appear in the big-screen in the car, has the fragrant release of rose simultaneously.
Further, if a gift is delivered to the guest, the system automatically recognizes the voice information of the driver, and when a preset voice signal for delivering the gift is captured (for example, keywords such as a gift and a gift are recognized), controlling the vehicle according to the voice control scenario includes steps S361 to S363:
s361, identifying the riding position of a user in the other vehicle;
s362, opening a box cover of the storage box corresponding to the sitting position;
and S363, controlling a driving device of the storage box to send out the articles prestored in the storage box.
For example, the seating position of the user in the other vehicle may be recognized by a camera, or the seating position of the user in the other vehicle may be recognized by a weight sensor installed under a seat. The drive device drives the storage rack body in the storage box to stretch out, and the storage rack is used for placing articles, so that the articles are sent out.
Optionally, after responding to the guest initiation operation, the method further includes step S21:
s21, identifying an outdoor scene, and adjusting a temperature control device in the vehicle according to the identified outdoor scene; wherein, the temperature control device comprises at least one of a vehicle air conditioner, a seat heating device and a steering wheel heating device.
Illustratively, the outdoor scene includes outdoor weather, outdoor temperature, and outdoor brightness. For example, when the outdoor weather is rainy, the vehicle air conditioner can be controlled to start the dehumidification function because the air is relatively humid; when the outdoor temperature is higher, starting the cooling function of the vehicle air conditioner; when the outdoor temperature is lower, a seat heating device and a steering wheel heating device are started; when the outdoor brightness is in the daytime, the temperature of the vehicle air conditioner can be properly reduced due to the fact that sunlight is strong in the daytime.
Optionally, after the vehicle is controlled according to the welcome control strategy, the vehicle control method further includes step S5:
s5, when the preset welcome ending condition is met, closing the welcome system and controlling the vehicle to recover the driving mode; the welcome ending condition comprises that starting and departure of the vehicle are detected or a welcome stopping instruction sent by a user is received.
Illustratively, when the vehicle starts to send a car, the system can resume the driving mode, at the moment, the atmosphere lamp gradually becomes dark, the music sound gradually decreases, the large screen playing stops the main driving to enter the driving mode, the other positions are the watching selection mode, the seat can automatically enter the massage mode and the like, and the welcoming activities in the vehicle are ended.
Further, when the guest welcoming system in the vehicle is finished and an external scene mode starting instruction is received, the vehicle control method further comprises the following steps:
the method comprises the steps of controlling the NT door to be unfolded, controlling the atmosphere lamp to be started, controlling the vehicle lamp to flash according to a preset pattern, controlling the music playing device to play music outside, and controlling the external projection system to be started to play video animation, so that a film watching mode is provided for customers.
Compared with the prior art, the vehicle control method provided by the embodiment of the invention has the advantages that the person attributes and the number of the in-vehicle users are obtained by carrying out user identification on the in-vehicle user images, then the preset welcome control strategy corresponding to the in-vehicle users is obtained based on the person attributes and the number of the in-vehicle users, and the vehicle is controlled according to the welcome control strategy. Through the scene analysis to the user driving vehicle, open corresponding usher's function automatically, improve user's driving experience, make the vehicle more intelligent.
Referring to fig. 2, fig. 2 is a block diagram of a vehicle control device 10 according to an embodiment of the present invention, where the vehicle control device 10 includes:
the welcome starting module 11 is used for responding to the welcome starting operation;
the identification module 12 is used for acquiring an in-vehicle user image shot by an in-vehicle camera; based on a preset user analysis model, carrying out user identification on the in-vehicle user image to obtain the character attributes and the number of the in-vehicle users;
the welcome control module 13 is configured to obtain a preset welcome control strategy corresponding to the in-vehicle user based on the person attributes and the number of the in-vehicle users; and controlling the vehicle according to the welcome control strategy.
It should be noted that the vehicle control device 10 according to the embodiment of the present invention is a vehicle-mounted controller in a vehicle, and the vehicle-mounted controller is a front-end device of a vehicle monitoring and management system, integrates multiple functions such as data processing and data communication, and has a strong service scheduling function and data processing capability. The vehicle-mounted controller establishes communication connection with a camera and other equipment in the vehicle in advance. The vehicle-mounted controller identifies the character attributes and the number of the users in the vehicle based on an image identification technology, acquires a corresponding welcome control strategy according to the identified character attributes and the number, and finally controls the vehicle according to the welcome control strategy to realize the welcome function of the vehicle.
Specifically, the response condition of the welcome start operation includes at least one of the following:
detecting that a vehicle key is within a preset range of the vehicle;
detecting a welcome starting instruction sent by a mobile terminal;
acquiring a voice signal, wherein the voice signal meets a preset voice starting condition;
and acquiring a welcome starting instruction sent by a vehicle display device.
For example, the preset range may be 1m, and when the vehicle key is detected to be near the vehicle, it indicates that the user is near the vehicle at this time, and needs to use the vehicle, and the welcome function is activated at this time. The user can also load the APP on the mobile terminal of the user, and when the vehicle receives a guest greeting starting instruction sent by the user from the mobile terminal, the guest greeting function is started at the moment. When the vehicle detects the voice signal, whether the voice signal is a pre-stored voice guest-initiating instruction or not is detected, and if so, the guest-initiating function is initiated at the moment. The user can also start the greeting system through a display device in the vehicle, for example, the greeting start instruction is sent through a touch screen in the vehicle, and at the moment, the greeting function is started.
Specifically, the human attributes include a driver and a non-driver, and the driver includes a historical driver and a new driver. After the in-vehicle user image is obtained, the in-vehicle user image is sent to the user analysis model, so that the user analysis model performs image recognition on the in-vehicle user image. For example, the user analysis model may be a CNN (Convolutional neural network) model. The CNN is a feedforward neural network, comprises a convolutional layer and a pooling layer, and has wide application in the field of image recognition. Theoretically, as long as there are enough training samples, the CNN model with the corresponding recognition function can be obtained, the training samples refer to the original data marked with the recognition result, and in the user face recognition scene, the training samples are the images marked with the face information of the driver.
Further, in the process of training the user analysis model, in order to improve the recognition accuracy and the convergence rate of the model, the training sample may be preprocessed before being input to the model to be trained, specifically, the training sample is subjected to preliminary feature extraction, so as to improve the convergence rate of the model by reducing the calculation amount.
Specifically, the identification module 12 obtains a preset welcome control strategy corresponding to the in-vehicle user based on the character attributes and the number of the in-vehicle users, so that the welcome control module 13 controls the vehicle according to the welcome control strategy.
In one embodiment, the welcome function of the vehicle can be simplified when only one driver is using the vehicle. The welcome control module 13 is configured to:
when the number of the users in the vehicle is 1 and the character attribute of the users in the vehicle is a driver, controlling the vehicle to play a welcome language corresponding to the driver;
after the object greeting is played, controlling a vehicle to play a music program corresponding to the driver;
and acquiring historical main driving seat adjusting parameters of the driver, and adjusting seat parameters of a main driving seat based on the historical main driving seat adjusting parameters.
For example, the greeting may change over time, such as in the morning the greeting may be "host, good morning" and may also include weather conditions. After the object greeting is played, the music playing device in the vehicle can be automatically started to play music programs. Meanwhile, the seat parameters of the main driver seat are automatically adjusted, so that a comfortable driving environment is provided for the driver. Understandably, when the driver manually adjusts the seat parameters each time, the system automatically records the historical main driving seat adjusting parameters, and then analyzes the seat parameters meeting the habits of the user according to the historical main driving seat adjusting parameters, so that the automatic adjustment of the main driving seat can be realized according to the seat adjusting habits of the user.
Further, when the character attribute of the user in the vehicle is identified as the driver, whether the driver is a historical driver or a non-driver can be further analyzed, for the non-driver, the music program played by the vehicle can be random, and the seat adjustment parameter can also be the default adjustment parameter of the system. For the historical drivers, different driving habits of different historical drivers can be recorded, the music programs played at the time are also corresponding to the historical drivers, and the music programs which are in line with the favorite of the historical drivers can be automatically recommended by integrating the music program playing habits of the historical drivers. Similarly, the adjustment parameters of the main driver seat correspond to historical drivers, that is, if there are a plurality of historical drivers, the adjustment parameters of the main driver seat are correspondingly recorded.
In another embodiment, when the in-vehicle user has other people besides the driver, the driver may want the vehicle to perform more complicated welcome operation, and the voice recognition device in the vehicle is activated to perform corresponding control operation according to the voice information of the in-vehicle user. Then, the welcome control module 13 is configured to:
when the number of the users in the vehicle is larger than 1 and the character attributes of the users in the vehicle comprise drivers, playing a voice prompt;
acquiring voice information of a user in a vehicle, and identifying the voice information;
and when the voice information meets a preset voice control scene, controlling the vehicle according to the voice control scene.
Illustratively, if someone other than the owner drives the car, the car will enter the voice reminding mode, and the smart voice will ask "owner, your good", the in-car user can reply dozens of answers such as "lover's happy occasion, birthday happy occasion, new year happy occasion, go hi together, we go to play", and each answer corresponds to one scene, for example: the valentine's day is happy, and atmosphere lamp can present pink scintillation effect in the car, has a sensation of heartbeat, also can sound romantic valentine's day song simultaneously, and the full-screen rose also can appear in the big-screen in the car, has the fragrant release of rose simultaneously.
Further, if a gift is delivered to the guest, the system automatically recognizes the voice information of the driver, and when a preset voice signal for delivering the gift is captured (for example, keywords such as a gift and a gift are recognized), controlling the vehicle according to the voice control scenario includes:
identifying a seating position of a user in another vehicle;
opening a box cover of the storage box corresponding to the seating position;
and controlling a driving device of the storage box to send out the articles prestored in the storage box.
For example, the seating position of the user in the other vehicle may be recognized by a camera, or the seating position of the user in the other vehicle may be recognized by a weight sensor installed under a seat. The drive device drives the storage rack body in the storage box to stretch out, and the storage rack is used for placing articles, so that the articles are sent out.
Optionally, after responding to the guest initiation operation, the identification module 12 is further configured to identify an outdoor scene, and the guest control module 13 adjusts a temperature control device in the vehicle according to the identified outdoor scene; wherein, the temperature control device comprises at least one of a vehicle air conditioner, a seat heating device and a steering wheel heating device.
Illustratively, the outdoor scene includes outdoor weather, outdoor temperature, and outdoor brightness. For example, when the outdoor weather is rainy, the vehicle air conditioner can be controlled to start the dehumidification function because the air is relatively humid; when the outdoor temperature is higher, starting the cooling function of the vehicle air conditioner; when the outdoor temperature is lower, a seat heating device and a steering wheel heating device are started; when the outdoor brightness is in the daytime, the temperature of the vehicle air conditioner can be properly reduced due to the fact that sunlight is strong in the daytime.
Optionally, after controlling the vehicle according to the welcome control strategy, the vehicle control apparatus 10 further includes a welcome ending module 14, where the welcome ending module is further configured to:
when a preset welcome ending condition is met, closing the welcome system and controlling the vehicle to recover the driving mode; the welcome ending condition comprises that starting and departure of the vehicle are detected or a welcome stopping instruction sent by a user is received.
Illustratively, when the vehicle starts to send a car, the system can resume the driving mode, at the moment, the atmosphere lamp gradually becomes dark, the music sound gradually decreases, the large screen playing stops the main driving to enter the driving mode, the other positions are the watching selection mode, the seat can automatically enter the massage mode and the like, and the welcoming activities in the vehicle are ended.
Further, when the guest welcoming system in the vehicle is finished and an external scene mode starting instruction is received, the guest welcoming control module 13 is further configured to:
the method comprises the steps of controlling the NT door to be unfolded, controlling the atmosphere lamp to be started, controlling the vehicle lamp to flash according to a preset pattern, controlling the music playing device to play music outside, and controlling the external projection system to be started to play video animation, so that a film watching mode is provided for customers.
Compared with the prior art, the vehicle control device 10 according to the embodiment of the present invention obtains the attributes and the number of the people of the in-vehicle users by performing user identification on the in-vehicle user image, then obtains the preset guest greeting control strategy corresponding to the in-vehicle users based on the attributes and the number of the people of the in-vehicle users, and controls the vehicle according to the guest greeting control strategy. Through the scene analysis to the user driving vehicle, open corresponding usher's function automatically, improve user's driving experience, make the vehicle more intelligent.
Referring to fig. 3, fig. 3 is a block diagram of a vehicle control apparatus 20 according to an embodiment of the present invention, where the vehicle control apparatus 20 includes: a processor 21, a memory 22 and a computer program, such as a driving control program, stored in said memory and executable on said processor. The processor 21, when executing the computer program, implements the steps in the above-described vehicle control method embodiments, such as steps S1-S4 shown in fig. 1. Alternatively, the processor implements the functions of the modules in the above device embodiments when executing the computer program.
Illustratively, the computer program may be divided into one or more modules, which are stored in the memory 22 and executed by the processor 21 to accomplish the present invention. The one or more modules may be a series of computer program instruction segments capable of performing specific functions, which are used to describe the execution process of the computer program in the vehicle control apparatus 20. For example, the computer program may be divided into a welcome activation module 11, an identification module 12, a welcome control module 13 and a welcome termination module 14. For the specific working process of each module, reference may be made to the working process of the vehicle control device 10 described in the foregoing embodiment, and details are not repeated here.
The vehicle control device 20 may be a desktop computer, a notebook computer, a palm computer, a cloud server, or other computing devices. The vehicle control device 20 may include, but is not limited to, a processor 21, a memory 22. It will be appreciated by those skilled in the art that the schematic diagram is merely an example of an image enhancement device and is not intended to limit the vehicle control device 20 and may include more or fewer components than shown, or some components in combination, or different components, for example, the vehicle control device 20 may also include an input-output device, a network access device, a bus, etc.
The Processor 21 may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may be any conventional processor or the like, and the processor 21 is a control center of the vehicle control apparatus 20 and connects various parts of the entire vehicle control apparatus 20 by various interfaces and lines.
The memory 22 may be used to store the computer programs and/or modules, and the processor 21 implements various functions of the vehicle control apparatus 20 by operating or executing the computer programs and/or modules stored in the memory 22 and calling data stored in the memory 22. The memory 22 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. In addition, the memory 22 may include high speed random access memory, and may also include non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), at least one magnetic disk storage device, a Flash memory device, or other volatile solid state storage device.
The integrated modules of the vehicle control device 20 may be stored in a computer-readable storage medium if they are implemented in the form of software functional units and sold or used as separate products. Based on such understanding, all or part of the flow of the method according to the embodiments of the present invention may also be implemented by a computer program, which may be stored in a computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method embodiments may be implemented. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, and the like.
While the foregoing is directed to the preferred embodiment of the present invention, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention.
Claims (10)
1. A vehicle control method characterized by comprising:
responding to the welcome starting operation, and acquiring an in-car user image shot by an in-car camera;
based on a preset user analysis model, carrying out user identification on the in-vehicle user image to obtain the character attributes and the number of the in-vehicle users;
acquiring a preset welcome control strategy corresponding to the in-vehicle user based on the character attributes and the number of the in-vehicle users;
and controlling the vehicle according to the welcome control strategy.
2. The vehicle control method according to claim 1, wherein the character attributes include a driver and a non-driver; then, the obtaining of the preset welcome control strategy corresponding to the in-vehicle user includes:
when the number of the users in the vehicle is 1 and the character attribute of the users in the vehicle is a driver, controlling the vehicle to play a welcome language corresponding to the driver;
after the object greeting is played, controlling a vehicle to play a music program corresponding to the driver;
and acquiring historical main driving seat adjusting parameters of the driver, and adjusting seat parameters of a main driving seat based on the historical main driving seat adjusting parameters.
3. The vehicle control method according to claim 2, wherein the obtaining of the preset welcome control strategy corresponding to the in-vehicle user further comprises:
when the number of the users in the vehicle is larger than 1 and the character attributes of the users in the vehicle comprise drivers, playing a voice prompt;
acquiring voice information of a user in a vehicle, and identifying the voice information;
and when the voice information meets a preset voice control scene, controlling the vehicle according to the voice control scene.
4. The vehicle control method of claim 1, wherein after responding to the welcome initiation operation, further comprising:
identifying an outdoor scene, and adjusting a temperature control device in the vehicle according to the identified outdoor scene; wherein, the temperature control device comprises at least one of a vehicle air conditioner, a seat heating device and a steering wheel heating device.
5. The vehicle control method of claim 1, wherein after controlling the vehicle according to the welcome control strategy, the vehicle control method further comprises:
when a preset welcome ending condition is met, closing the welcome system and controlling the vehicle to recover the driving mode; the welcome ending condition comprises that starting and departure of the vehicle are detected or a welcome stopping instruction sent by a user is received.
6. The vehicle control method according to claim 1, wherein the response condition of the guest start operation includes at least one of:
detecting that a vehicle key is within a preset range of the vehicle;
detecting a welcome starting instruction sent by a mobile terminal;
acquiring a voice signal, wherein the voice signal meets a preset voice starting condition;
and acquiring a welcome starting instruction sent by a vehicle display device.
7. A vehicle control apparatus characterized by comprising:
the welcome starting module is used for responding to the welcome starting operation;
the identification module is used for acquiring an in-vehicle user image shot by an in-vehicle camera; based on a preset user analysis model, carrying out user identification on the in-vehicle user image to obtain the character attributes and the number of the in-vehicle users;
the welcome control module is used for acquiring a preset welcome control strategy corresponding to the in-vehicle user based on the character attributes and the number of the in-vehicle users; and controlling the vehicle according to the welcome control strategy.
8. The vehicle control apparatus according to claim 7, characterized by further comprising:
the welcome ending module is used for closing the welcome system and controlling the vehicle to recover the driving mode when a preset welcome ending condition is met; the welcome ending condition comprises that starting and departure of the vehicle are detected or a welcome stopping instruction sent by a user is received.
9. A vehicle control apparatus, characterized by comprising a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, the processor implementing the vehicle control method according to any one of claims 1 to 6 when executing the computer program.
10. A computer-readable storage medium, characterized in that the computer-readable storage medium comprises a stored computer program, wherein the computer program, when executed, controls an apparatus in which the computer-readable storage medium is located to perform the vehicle control method according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110727432.2A CN113459943B (en) | 2021-06-29 | 2021-06-29 | Vehicle control method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110727432.2A CN113459943B (en) | 2021-06-29 | 2021-06-29 | Vehicle control method, device, equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113459943A true CN113459943A (en) | 2021-10-01 |
| CN113459943B CN113459943B (en) | 2023-08-01 |
Family
ID=77873889
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110727432.2A Active CN113459943B (en) | 2021-06-29 | 2021-06-29 | Vehicle control method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113459943B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114979208A (en) * | 2022-05-23 | 2022-08-30 | 阿尔特(北京)汽车数字科技有限公司 | Method, device, system, equipment and storage medium for vehicle-family interconnection |
| CN115080788A (en) * | 2022-08-11 | 2022-09-20 | 小米汽车科技有限公司 | Music pushing method and device, storage medium and vehicle |
| CN115223149A (en) * | 2021-11-11 | 2022-10-21 | 广州汽车集团股份有限公司 | Intelligent vehicle interaction method and device and storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101800727B1 (en) * | 2017-05-31 | 2017-11-24 | (주)가민정보시스템 | Vehicle control system using black box |
| CN109131167A (en) * | 2018-08-03 | 2019-01-04 | 百度在线网络技术（北京）有限公司 | Method for controlling a vehicle and device |
| CN109685516A (en) * | 2019-01-17 | 2019-04-26 | 深兰科技（上海）有限公司 | A kind of bus |
| CN110626254A (en) * | 2019-08-14 | 2019-12-31 | 合肥科维特电气科技有限公司 | Control method for vehicle welcome system |
| CN110834590A (en) * | 2019-11-26 | 2020-02-25 | 奇瑞汽车股份有限公司 | Automobile door welcome system and control method thereof |
| CN111327990A (en) * | 2018-12-13 | 2020-06-23 | 宝马股份公司 | Method, device and system for controlling multi-channel audio playing, vehicle and storage medium |
| CN111739450A (en) * | 2020-05-29 | 2020-10-02 | 惠州华阳通用电子有限公司 | Multi-cabin welcome method and system and vehicle |
| CN112078438A (en) * | 2019-06-12 | 2020-12-15 | 北京车和家信息技术有限公司 | Vehicle seat adjusting method and device, vehicle and computer readable storage medium |
-
2021
- 2021-06-29 CN CN202110727432.2A patent/CN113459943B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101800727B1 (en) * | 2017-05-31 | 2017-11-24 | (주)가민정보시스템 | Vehicle control system using black box |
| CN109131167A (en) * | 2018-08-03 | 2019-01-04 | 百度在线网络技术（北京）有限公司 | Method for controlling a vehicle and device |
| CN111327990A (en) * | 2018-12-13 | 2020-06-23 | 宝马股份公司 | Method, device and system for controlling multi-channel audio playing, vehicle and storage medium |
| CN109685516A (en) * | 2019-01-17 | 2019-04-26 | 深兰科技（上海）有限公司 | A kind of bus |
| CN112078438A (en) * | 2019-06-12 | 2020-12-15 | 北京车和家信息技术有限公司 | Vehicle seat adjusting method and device, vehicle and computer readable storage medium |
| CN110626254A (en) * | 2019-08-14 | 2019-12-31 | 合肥科维特电气科技有限公司 | Control method for vehicle welcome system |
| CN110834590A (en) * | 2019-11-26 | 2020-02-25 | 奇瑞汽车股份有限公司 | Automobile door welcome system and control method thereof |
| CN111739450A (en) * | 2020-05-29 | 2020-10-02 | 惠州华阳通用电子有限公司 | Multi-cabin welcome method and system and vehicle |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115223149A (en) * | 2021-11-11 | 2022-10-21 | 广州汽车集团股份有限公司 | Intelligent vehicle interaction method and device and storage medium |
| CN114979208A (en) * | 2022-05-23 | 2022-08-30 | 阿尔特(北京)汽车数字科技有限公司 | Method, device, system, equipment and storage medium for vehicle-family interconnection |
| CN115080788A (en) * | 2022-08-11 | 2022-09-20 | 小米汽车科技有限公司 | Music pushing method and device, storage medium and vehicle |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113459943B (en) | 2023-08-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113459943B (en) | Vehicle control method, device, equipment and storage medium | |
| CN108725357B (en) | Parameter control method and system based on face recognition and cloud server | |
| CN109416733B (en) | Portable personalization | |
| US20190354192A1 (en) | Smart tutorial for gesture control system | |
| WO2019201304A1 (en) | Face recognition-based voice processing method, and device | |
| CN110641476A (en) | Interaction method and device based on vehicle-mounted robot, controller and storage medium | |
| WO2023000840A1 (en) | Onboard function configuration method and system, and terminal and computer-readable storage medium | |
| CN111137227A (en) | Automatic setting method and system for contextual model | |
| CN113119683A (en) | Control method of vehicle air conditioner, vehicle terminal and server | |
| CN113002460A (en) | Control method and device for contextual model of vehicle and vehicle | |
| CN110682921A (en) | Vehicle interaction method and device, vehicle and machine readable medium | |
| CN112034989A (en) | Intelligent interaction system | |
| CN113665514A (en) | Vehicle service system and service method thereof | |
| CN112959998B (en) | Vehicle-mounted human-computer interaction method and device, vehicle and electronic equipment | |
| CN112092751A (en) | Cabin service method and cabin service system | |
| CN112141031A (en) | Cabin service method and cabin service system | |
| WO2023138563A1 (en) | Volume adjustment method and apparatus, and automobile | |
| CN113225433B (en) | Vehicle voice reminding method and device, electronic equipment and storage medium | |
| CN115848138A (en) | Cabin visual angle switching method, device and equipment and vehicle | |
| CN111907435B (en) | Control method, device and equipment of vehicle-mounted multimedia system and storage medium | |
| CN112172712A (en) | Cabin service method and cabin service system | |
| CN113538738A (en) | Intelligent personalized setting method and system for automobile and automobile | |
| CN112721834A (en) | Vehicle control method and control system | |
| CN112721565A (en) | Vehicle-mounted air conditioner control method, vehicle and medium | |
| CN115268334A (en) | Vehicle window control method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| PP01 | Preservation of patent right |
Effective date of registration: 20240222 Granted publication date: 20230801 |
|
| PP01 | Preservation of patent right |