CN114954332A - Vehicle control method and device, storage medium and vehicle - Google Patents
Vehicle control method and device, storage medium and vehicle Download PDFInfo
- Publication number
- CN114954332A CN114954332A CN202110939304.4A CN202110939304A CN114954332A CN 114954332 A CN114954332 A CN 114954332A CN 202110939304 A CN202110939304 A CN 202110939304A CN 114954332 A CN114954332 A CN 114954332A
- Authority
- CN
- China
- Prior art keywords
- vehicle
- state information
- target user
- controlling
- signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 60
- 206010011469 Crying Diseases 0.000 claims abstract description 24
- 230000011664 signaling Effects 0.000 claims abstract description 9
- 230000009471 action Effects 0.000 claims description 17
- 238000001514 detection method Methods 0.000 claims description 10
- 230000008921 facial expression Effects 0.000 claims description 10
- 238000012790 confirmation Methods 0.000 claims description 4
- 230000008569 process Effects 0.000 abstract description 16
- 206010039740 Screaming Diseases 0.000 abstract description 3
- 238000004590 computer program Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 7
- 230000010365 information processing Effects 0.000 description 5
- 230000000694 effects Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 230000004044 response Effects 0.000 description 4
- 206010039203 Road traffic accident Diseases 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 3
- 208000024827 Alzheimer disease Diseases 0.000 description 2
- 206010039966 Senile dementia Diseases 0.000 description 2
- 230000035565 breathing frequency Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 239000012141 concentrate Substances 0.000 description 2
- 230000001121 heart beat frequency Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 239000000523 sample Substances 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 230000004888 barrier function Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 239000006185 dispersion Substances 0.000 description 1
- 230000008451 emotion Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 201000003152 motion sickness Diseases 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000002618 waking effect Effects 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R21/00—Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
- B60R21/01—Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60H—ARRANGEMENTS OF HEATING, COOLING, VENTILATING OR OTHER AIR-TREATING DEVICES SPECIALLY ADAPTED FOR PASSENGER OR GOODS SPACES OF VEHICLES
- B60H1/00—Heating, cooling or ventilating [HVAC] devices
- B60H1/00642—Control systems or circuits; Control members or indication devices for heating, cooling or ventilating devices
- B60H1/00735—Control systems or circuits characterised by their input, i.e. by the detection, measurement or calculation of particular conditions, e.g. signal treatment, dynamic models
- B60H1/00742—Control systems or circuits characterised by their input, i.e. by the detection, measurement or calculation of particular conditions, e.g. signal treatment, dynamic models by detection of the vehicle occupants' presence; by detection of conditions relating to the body of occupants, e.g. using radiant heat detectors
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60H—ARRANGEMENTS OF HEATING, COOLING, VENTILATING OR OTHER AIR-TREATING DEVICES SPECIALLY ADAPTED FOR PASSENGER OR GOODS SPACES OF VEHICLES
- B60H1/00—Heating, cooling or ventilating [HVAC] devices
- B60H1/00642—Control systems or circuits; Control members or indication devices for heating, cooling or ventilating devices
- B60H1/00814—Control systems or circuits characterised by their output, for controlling particular components of the heating, cooling or ventilating installation
- B60H1/00878—Control systems or circuits characterised by their output, for controlling particular components of the heating, cooling or ventilating installation the components being temperature regulating devices
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
- B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
- B60R16/037—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for occupant comfort, e.g. for automatic adjustment of appliances according to personal settings, e.g. seats, mirrors, steering wheel
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R21/00—Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
- B60R21/01—Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents
- B60R21/015—Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents including means for detecting the presence or position of passengers, passenger seats or child seats, and the related safety parameters therefor, e.g. speed or timing of airbag inflation in relation to occupant position or seat belt use
- B60R21/01512—Passenger detection systems
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Physics & Mathematics (AREA)
- Thermal Sciences (AREA)
- Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
Abstract
The embodiment of the application relates to the technical field of vehicles, in particular to a vehicle control method, a device, a storage medium and a vehicle, aiming at solving the problem that the driving of a driver is easily influenced when the vehicle is provided with the conditions of crying and screaming of children and the like; when a target user of a preset age group is detected to exist on the vehicle, controlling the vehicle to execute protection operation, and detecting the state of the target user in real time to obtain the state information of the target user; when the state information is preset state information, outputting a placating prompt signal aiming at the target user, responding to a reply signal of the placating prompt signal, and controlling the vehicle to output corresponding multimedia information according to the reply signal; and when the state information is sleeping state information, controlling the vehicle to execute preset operation corresponding to the sleeping state information. The state of the target user is automatically acquired, analyzed and pacified through the vehicle, so that the influence on a driver is effectively reduced, and the safety of the driver in the driving process is improved.
Description
Technical Field
The embodiment of the application relates to the technical field of vehicles, in particular to a vehicle control method, a vehicle control device, a storage medium and a vehicle.
Background
As is well known, a driver needs to concentrate on the spirit during driving, but in life, when a child cries and screaming on a vehicle, the driver is prone to being distracted, driving of the driver is affected, and risks of traffic accidents are increased.
In the related art, a driver often depends on playing a multimedia file to pacify a child, but still needs to pay attention to the state of the child at any time in the driving process, and the operation of playing the multimedia file is adjusted according to the state of the child, so that the driving safety of the driver is affected.
Disclosure of Invention
The embodiment of the application provides a vehicle control method, a device, a storage medium and a vehicle, and aims to solve the problem that driving of a driver is easily affected when children cry and the like exist on the vehicle.
A first aspect of an embodiment of the present application provides a vehicle control method, including;
when detecting that a target user of a preset age range exists on the vehicle, controlling the vehicle to execute a protection operation, wherein the protection operation comprises starting a child lock;
detecting the state of the target user in real time to obtain the state information of the target user;
when the state information is preset state information, outputting a placating prompt signal aiming at a target user, responding to a reply signal of the placating prompt signal, and controlling the vehicle to output corresponding multimedia information according to the reply signal;
and when the state information is sleeping state information, controlling the vehicle to execute preset operation corresponding to the sleeping state information.
Optionally, the control method further includes:
obtaining biometric information of users on the vehicle other than the driver;
identifying the biological characteristic information to obtain age information of users on the vehicle except the driver;
when detecting that a target user of a preset age group exists on the vehicle, controlling the vehicle to execute protection operation; the method comprises the following steps:
and controlling the vehicle to perform a protection operation when detecting a user on the vehicle, except the driver, with age information in a preset age range.
Optionally, detecting the state of the target user in real time to obtain the state information of the target user includes:
detecting the voice, action amplitude and facial expression of the template user to obtain the state information of the target user;
when the state information is preset state information, outputting a placating prompt signal aiming at the target user, and comprising the following steps:
analyzing the state information, and determining whether the current state of the target user is represented as a crying state or not;
and when the state information of the target user is the state information representing that the current state of the target user is crying, outputting a placating prompt signal aiming at the target user.
Optionally, the reply signal comprises at least a first signal and a second signal;
responding to a reply signal of the pacification prompt signal, controlling the vehicle to output corresponding multimedia information according to the reply signal, and comprising the following steps:
when the reply signal is detected to be the first signal, controlling the vehicle to play multimedia information of a first preset type;
and when the reply signal is detected to be the second signal, controlling the vehicle to play the multimedia information of the second preset type.
Optionally, when the state information is sleeping state information, controlling the vehicle to perform a preset operation corresponding to the sleeping state information includes:
acquiring state information about the target user, wherein the state information at least comprises the size of sound, the amplitude of action and the facial expression, and judging whether the current state of the target user is a sleep state or not;
and when the state information of the target user is state information representing that the current state of the target user is sleeping, controlling the vehicle to execute preset operation corresponding to the sleeping state information.
Optionally, when the state information is sleeping state information, controlling the vehicle to perform a preset operation corresponding to the sleeping state information includes:
when the state information is sleep state information, detecting the working state of a sound module of the vehicle, and when the sound module works, adjusting the volume of the sound module to a preset volume;
and outputting a sleep prompting signal aiming at sleep, and driving the vehicle to adjust the temperature in the vehicle to a preset temperature when detecting a confirmation signal responding to the sleep prompting signal.
Optionally, the control method further includes:
when a target user with crying state information and a sleeping user exist on the vehicle at the same time, a placating prompt signal aiming at the target user is preferentially output;
responding to a reply signal aiming at the pacification prompt signal, and controlling the vehicle to output multimedia information corresponding to the reply signal;
and when detecting that only a user with sleeping state information exists on the vehicle, controlling the vehicle to execute a preset operation corresponding to the sleeping state information.
A second aspect of the embodiments of the present application provides a vehicle control apparatus, including:
the protection module is used for controlling the vehicle to execute protection operation when detecting that a target user of a preset age range exists on the vehicle, wherein the protection operation comprises starting a child lock;
the detection module is used for detecting the state of the target user to obtain the state information of the target user;
the first execution module is used for outputting a placating prompt signal aiming at a target user when the state information is preset state information, responding to a reply signal of the placating prompt signal, and controlling the vehicle to output corresponding multimedia information according to the reply signal;
and the second execution module is used for controlling the vehicle to execute preset operation corresponding to the sleeping state information when the state information is the sleeping state information.
A third aspect of embodiments of the present application provides a computer-readable storage medium having stored thereon instructions, which, when executed by one or more processors, cause the processors to perform the steps of one or more of the control methods of claims 1-7.
A fourth aspect of the embodiments of the present application provides a vehicle including the control apparatus as described above to implement the steps of the control method as described above.
By adopting the vehicle control method, the device, the storage medium and the vehicle provided by the application, other users except a driver are detected in the vehicle driving process, when other users are detected, the age information of other users is obtained, when a target user with a preset age range is detected on the vehicle, the vehicle is controlled to execute protection operation, the method comprises the steps of starting a child lock to avoid the danger of the target user, then detecting the current state of the target user in real time to determine the current state of the target user, when the state of the target user is a preset state, namely a crying state, outputting soothing prompt information of the target user, then generating a reply signal according to the reply of the target user, controlling the vehicle to output corresponding multimedia information according to the reply signal, thereby soothing the target user, when the target user is detected to go to sleep, the control vehicle executes preset operation corresponding to the sleeping state information, influence on the target user is reduced, accordingly, sleeping quality of the target user is improved, influence of the target user on a driver is reduced, the state of the target user is automatically acquired, analyzed and pacified through the vehicle, influence on the driver is effectively reduced, and safety of the driver in the driving process is improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the description of the embodiments of the present application will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without inventive exercise.
Fig. 1 is a schematic flowchart of a control method according to an embodiment of the present application;
fig. 2 is a schematic flowchart of acquiring age information according to an embodiment of the present application;
fig. 3 is a schematic flow chart of acquiring status information according to an embodiment of the present application;
FIG. 4 is a flowchart illustrating outputting multimedia information according to an embodiment of the present application;
fig. 5 is a flowchart illustrating a state information being a sleep state according to an embodiment of the present application;
FIG. 6 is a flowchart illustrating a preset operation according to an embodiment of the present disclosure;
fig. 7 is a schematic flowchart of an embodiment of the present application illustrating a sleep state of another user;
FIG. 8 is a flow chart of one embodiment of the present application;
fig. 9 is a block diagram of a control device according to an embodiment of the present application.
Reference numerals: 8. a control device; 81. a protection module; 82. a detection module; 83. a first execution module; 84. a second execution module; 85. and a judging module.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, of the embodiments of the present application. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application without making any creative effort belong to the protection scope of the present application.
As is well known, a driver is distracted and is likely to cause a traffic accident, and in the driving process of the driver, when children, old people, special users and other users are present in the vehicle, the driver is often required to look after and pay attention to the vehicle, when other users cry and scream and other conditions occur, the driving state of the driver is likely to be affected, and meanwhile, the driver is distracted and disposed, so that the risk of danger is increased.
Along with the development of science and technology, automobiles are more and more intelligent, corresponding operations can be performed according to instructions, for example, multimedia information such as music or videos is played, other users are pacified, and drivers can drive leisurely, so that traffic accidents are reduced.
In a first embodiment, the present application provides a vehicle control method, and referring to fig. 1, the control method includes:
s1, when detecting that a target user in a preset age range exists on the vehicle, controlling the vehicle to execute a protection operation, wherein the protection operation comprises starting a child lock;
detect the passenger except that the navigating mate on to the vehicle through detection module, including copilot and back row passenger, carry out identification analysis to the passenger, confirm whether passenger's age bracket is for predetermineeing the age bracket, when passenger's age is for being in the target user who predetermines the age bracket, detect the vehicle speed, when the speed of a motor vehicle is greater than zero, control vehicle execution protection operation protects the target user, reduces the vehicle and goes the probability that the in-process target user takes place danger.
The preset age range can be set by a vehicle owner according to the use condition of the vehicle, and if a vehicle user needs to aim at a passenger with a relatively large age or a passenger with senile dementia, the preset age range can be set to be over sixty years old and the like, so that the vehicle mainly aims at the passenger with the relatively large age or the passenger with senile dementia; when the user of the vehicle needs to target children, the preset age range may be set to six years or less, so that the vehicle is mainly targeted to older passengers. A plurality of age groups may also be provided to improve the applicability of the vehicle.
The protection operation has a variety, including starting the child lock and avoiding the target user to open the door by mistake, in other embodiments, the protection operation can also include closing the vehicle window, avoiding other operations such as target user probe, thereby improving the safety of the vehicle in the use process, and enabling a driver to drive with more concentration.
The specific action of the protection operation can be preset according to the condition of a common user of the vehicle, and if the target user easily gets sick, the protection operation can comprise the operations of opening a certain window amount, controlling the vehicle to emit special anti-carsickness smell and the like.
S2, detecting the state of the target user in real time to obtain the state information of the target user;
the method comprises the steps of detecting a target user in real time, obtaining state information of the target user, and determining the current state of the target user according to the state information of the target user, so that a vehicle executes response operation according to the state of the target user, and the target user is prevented from influencing a driver.
S3, when the state information is preset state information, outputting a placating prompt signal aiming at the target user, responding to a reply signal of the placating prompt signal, and controlling the vehicle to output corresponding multimedia information according to the reply signal;
the preset state information is state information representing that the state of the user is crying, when the state information of the target user is detected to be the preset state information, the target user is in a state which is easy to interfere with a driver, therefore, a pacifying prompt signal aiming at the target user is output, how to pacify the target user is inquired so as to change the state of the target user, then, a reply about the pacifying prompt signal is received, a reply signal responding to the pacifying prompt signal is generated, the vehicle is controlled to output corresponding multimedia information according to the reply signal, and the vehicle is controlled to output corresponding multimedia information according to the reply signal.
The multimedia information can be video, audio and video, the target user is pacified through the multimedia information, and the current state of the target user is relieved or changed, so that the influence of the target user on a driver is reduced, the driving safety is improved, and the riding experience of the target user is improved.
And S4, when the state information is sleeping state information, controlling the vehicle to execute preset operation corresponding to the sleeping state information.
When the target user is detected to be in the sleep state, or the target user enters the sleep state through pacifying, the vehicle is controlled to execute preset operation corresponding to the sleep state information, so that the influence of the vehicle on the sleeping target user is reduced, the influence on a driver caused by waking up of the target user is avoided, the experience of the target user in the sleep state is improved, the driver does not need to repeatedly confirm the state of the target user, the attention of the driver is more concentrated when the driver drives, and the driving safety is improved.
By adopting the vehicle control method, the device, the storage medium and the vehicle provided by the application, other users except a driver are detected in the vehicle driving process, when other users are detected, the age information of other users is obtained, when a target user with a preset age range is detected on the vehicle, the vehicle is controlled to execute protection operation, the method comprises the steps of starting a child lock to avoid the danger of the target user, then detecting the current state of the target user in real time to determine the current state of the target user, when the state of the target user is a preset state, namely a crying state, outputting soothing prompt information of the target user, then generating a reply signal according to the reply of the target user, controlling the vehicle to output corresponding multimedia information according to the reply signal, thereby soothing the target user, when the target user is detected to go to sleep, the control vehicle executes preset operation corresponding to the sleeping state information, influence on the target user is reduced, accordingly, sleeping quality of the target user is improved, influence of the target user on a driver is reduced, the state of the target user is automatically acquired, analyzed and pacified through the vehicle, influence on the driver is effectively reduced, and safety of the driver in the driving process is improved.
In some embodiments, referring to fig. 2, the control method further comprises:
s101, obtaining biological characteristic information of users on the vehicle except the driver;
and identifying users except the driver on the vehicle by an information acquisition module, such as an AI intelligent identification module, wherein the identification comprises the sound ray detection, the face identification, the height and weight analysis and the like of sound, and acquiring the related biological characteristic information of the users.
S102, identifying the biological characteristic information to obtain age information of users on the vehicle except the driver;
after the biological characteristic information about the user is obtained, the biological characteristic information is analyzed through the information processing module of the vehicle, so that the age information about the user is obtained, for example, through cloud big data matching analysis, or the identity information about the vehicle user is stored in the information processing module in advance, so that the age information of the user is confirmed.
The identification may also be, for example, an identification of the use of the child seat, and when the child seat is used, a signal is sent to the vehicle to determine that a child is present in the vehicle.
When detecting that a target user of a preset age group exists on the vehicle, controlling the vehicle to execute protection operation; the method comprises the following steps:
and S103, controlling the vehicle to execute protection operation when detecting a user with age information except for a driver in the vehicle in a preset age range.
When a user with age information in a preset age range except a driver on the vehicle is detected, the target user can be determined to need protection, so that the vehicle executes corresponding protection operation, the target client is automatically protected, and the burden of the driver is reduced.
For example, when the preset age group is below 6 years old, namely the target user is a child, in order to prevent the vehicle door from being opened by mistake in the driving process, the vehicle is controlled to open the child lock, so that the target user is protected; in order to avoid children from extending hands or probes of the vehicle, the vehicle is controlled to be automatically closed, so that the safety of the vehicle is improved.
For example, when the preset age bracket is set to be over 60 years old, namely when the target user is the old, the vehicle jolts due to the fact that the vehicle speed is too fast, the vehicle speed can be limited, a reminding signal is sent out when the vehicle speed is high or the vehicle jolts, the influence of the vehicle jolts on the target user is reduced, and the seat state of the target user can be adjusted, so that the target user is protected.
The vehicle improves the protection effect on the target user by executing the protection operation, thereby reducing the driving burden of a driver, enabling the driver to concentrate more attention when driving and improving the driving safety.
In some embodiments, referring to fig. 3, detecting the state of the target user to obtain the state information of the target user includes:
s201, acquiring state information of a target user, wherein the state information at least comprises sound size, action amplitude and facial expression, and judging whether the current state of the target user is represented as a crying state or not;
various state information of the target user is acquired through an information acquisition module, such as an AI identification module, a camera, a sound acquisition module, and the like.
For example, the sound volume and the tone of the target user are acquired and judged, or the voice is intelligently recognized to acquire the intention of the target user, so that the state of the target user is acquired through the sound;
analyzing the action, action amplitude and action meaning of a target user through an AI identification module or a camera, for example, when the target user is a child, and the target user is a crying user, the action of limbs is easy to affect a driver, or when the target user is a language barrier user and sends a request through gestures or limb languages, the target user is processed through an information processing module, so that the state of the target user is obtained through the action;
analyzing the facial expression of the target user through an AI identification module or a camera and the like to obtain the emotion state of the current target user so as to obtain the state of the target user;
the state of the target user can be confirmed in an auxiliary mode through heartbeat frequency, breathing frequency and the like, so that the state information of the target user can be obtained more accurately.
And then determining whether the target user is in a crying state or not according to the acquired state information.
When the status information is predetermined status information, output the suggestion signal of pacifying to the target user, include:
s202, when the state information of the target user is the state information representing that the current state of the target user is crying, a placating prompt signal aiming at the target user is output.
When the state of the target user is determined to be crying, the vehicle sends out a placating prompt signal aiming at the target user to the target user or a driver according to the state information, such as whether to play preset multimedia or whether to adjust the state in the vehicle.
Wherein, pacify the cue signal and can confirm through vehicle terminal screen through voice broadcast, the video on suggestion pronunciation or the terminal screen can set up according to actual conditions, perhaps self-defined records or uploads, for example, is connected with the vehicle through cell-phone APP or computer software to long-range recording or upload suggestion pronunciation and video, thereby improve the effect of pacifying target user.
After the target user or the driver receives the placating prompt signal, the operation which the vehicle is expected to execute can be replied by voice according to the prompt voice, or clicking selection is carried out through a screen of the vehicle terminal, so that the vehicle executes the corresponding placating operation.
In some embodiments, the reply signal includes at least a first signal and a second signal;
the first signal and the second signal are signals generated by identifying answers to the placating prompting signals and used for controlling the vehicle to execute corresponding operations, for example, when the placating prompting signals inquire whether a children song or a fairy tale is selected, the first signal corresponds to controlling the vehicle to play multimedia contents related to the children song, the second signal corresponds to controlling the vehicle to play multimedia contents related to the fairy tale, and reply signals output to the vehicle are determined by identifying replies of a target user or a driver.
Referring to fig. 4, in response to a reply signal to the pacification prompt signal, controlling the vehicle to output corresponding multimedia information according to the reply signal, including:
s301, when the reply signal is detected to be a first signal, controlling the vehicle to play multimedia information of a first preset type;
for example, the first signal is associated with a reply to a children song, and controls the vehicle to play music or video about the children song when the target user or driver replies about the children song by voice, or selects the children song on a terminal screen of the vehicle.
And S302, when the reply signal is detected to be a second signal, controlling the vehicle to play the multimedia information of a second preset type.
The second signal is associated with a reply story, and controls the vehicle to play music or video regarding the fairy tale when the voice of the target user or driver replies about the fairy tale or the fairy tale is selected on a terminal screen of the vehicle.
The multimedia information can be preset inside the vehicle, played according to the preset multimedia information when played, and also set in a user-defined mode according to conditions, for example, the multimedia information is connected with the vehicle through a mobile phone APP or computer software, so that remote recording or uploading is achieved, and the pacifying effect on a target user is improved.
Wherein, multimedia information can contain the multiple, for example be provided with light components or projection subassembly in the car, when detecting the target user and be in the state of crying and screaming, attract target user's attention through light components to pacify target user, improve target user's the effect of pacifying.
In some embodiments, referring to fig. 5, when the state information is the sleeping state information, controlling the vehicle to perform a preset operation corresponding to the sleeping state information includes:
s401, acquiring state information of a target user, wherein the state information at least comprises the size of sound, the amplitude of action and facial expression, and judging whether the current state of the target user is a sleep state or not;
the information acquisition module, such as the AI identification module, the camera, the sound acquisition module, and the like, is used for acquiring various state information of the target user, such as judging the sound volume of the target user, analyzing the facial expression of the target user through the AI identification module or the camera, and judging whether the target user enters a sleep state, and the state of the target user can be confirmed through assistance such as the heartbeat frequency, the breathing frequency, and the like, so that the state information of the target user can be acquired more accurately.
S402, when the state information of the target user is the state information representing that the current state of the target user is sleeping, controlling the vehicle to execute preset operation corresponding to the sleeping state information.
When the state information of the target user is the state information representing that the current state of the target user is the sleeping state information, in order to reduce the influence on the target user, the vehicle is controlled to execute the preset operation corresponding to the sleeping state information, so that the experience of the target user is improved, meanwhile, the influence on a driver is further reduced, and the safety of the driver in the driving process is improved.
In some embodiments, referring to fig. 6, when the state information is the sleeping state information, controlling the vehicle to perform a preset operation corresponding to the sleeping state information includes:
s501, when the state information is sleeping state information, detecting the working state of a sound module of the vehicle, and when the sound module works, adjusting the volume of the sound module to a preset volume;
when the target user is detected to enter the sleep state, in order to reduce the influence of sound on the target user, the volume of the current sound module is reduced to the preset volume, so that the experience of the target user is improved, wherein the preset volume can be set according to the actual situation.
S502, outputting a sleep prompting signal aiming at sleep, and driving the vehicle to adjust the temperature in the vehicle to a preset temperature when detecting a confirmation signal responding to the sleep prompting signal.
By changing the temperature in the vehicle, the target user is in a proper environment, so that the experience of the target user is improved, the influence on a driver is further reduced, and the safety of the driver in the driving process is improved.
In some embodiments, referring to fig. 7, the control method further includes:
s601, when detecting that a target user with crying and sleeping state information simultaneously exist on the vehicle, preferentially outputting a placation prompt signal aiming at the target user;
s602, responding to a reply signal aiming at the pacification prompt signal, and controlling the vehicle to output multimedia information corresponding to the reply signal;
and S603, controlling the vehicle to execute preset operation corresponding to the sleeping state information when detecting that only the user with the sleeping state information exists on the vehicle.
When a plurality of users exist on the vehicle, and some of the vehicles in the crying state are in the sleeping state, the vehicle is controlled to preferentially pacify the crying users, the crying operation is performed on the users, the influence of the crying on the users in the sleeping state is reduced, then the preset operation is performed on the sleeping users, so that the experience feeling of the users is effectively improved, and meanwhile, the dispersion of the attention of drivers is reduced.
In some embodiments, when other users except the driver on the vehicle are detected, state information of the other users is detected, and when the state information of the other users is detected to be a sleeping target user, the vehicle is controlled to execute preset operation corresponding to the sleeping state information without judging age characteristics of the other users, so that the experience of the target user is improved.
In a specific embodiment, referring to fig. 8, after a vehicle is started, detecting passengers except a driver on the vehicle through a detection module, detecting state information of other users when other users except the driver on the vehicle are detected, and controlling the vehicle to execute preset operation corresponding to the state information of the sleep when the state information of the other users is detected to be the sleep; when a passenger is a child in a preset age range, detecting the current speed, when the speed is greater than zero, controlling the vehicle to execute protection operation to protect the child, reducing the danger probability of the child in the vehicle running process, then detecting the child in real time to acquire the state information of the child, when the state information of the child is detected to be the preset state information, enabling the child to be in a state which is easy to interfere with a driver, outputting a placating prompt signal aiming at the child, inquiring how to placate the child so as to change the state of the child, then receiving a reply about the placating prompt signal, generating a reply signal responding to the placating prompt signal, controlling the vehicle to output corresponding multimedia information according to the reply signal according to a reply signal of a corresponding point, and when the placating prompt signal is used for inquiring whether to select a children song or a fairy tale, the first signal corresponds to controlling the vehicle to play multimedia contents related to the children song, the second signal corresponds to controlling the vehicle to play multimedia contents related to the fairy tale, and reply signals output to the vehicle are determined by recognizing reply of a target user or a driver; when detecting children and be in the sleep state, perhaps children get into the sleep state after pacifying, the control vehicle carries out the operation of predetermineeing that corresponds with the state information of sleep to reduce the influence of vehicle to the children of sleep, thereby avoid children to awaken, lead to the fact the influence to navigating mate, improve the experience of children in the sleep state simultaneously, and need not the navigating mate and confirm the children state repeatedly, attention is more concentrated when making the navigating mate drive, improves driving safety.
Example two
Based on the same inventive concept, another embodiment of the present application provides a vehicle control apparatus, and referring to fig. 9, the control apparatus 8 includes:
the protection module 81 is used for controlling the vehicle to execute protection operation when detecting that target users in a preset age range exist on the vehicle, wherein the protection operation comprises starting a child lock;
the detection module 82 is configured to detect a state of a target user to obtain state information of the target user;
the detection module 82 includes an information acquisition module and an information processing module, and after the information acquisition module acquires the relevant information, the information processing module analyzes the relevant information, so as to determine the state information of the user.
The first execution module 83 is configured to output a pacifying prompt signal for the target user when the state information is preset state information, and control the vehicle to output corresponding multimedia information according to a reply signal in response to the reply signal of the pacifying prompt signal;
and a second executing module 84, configured to control the vehicle to execute a preset operation corresponding to the sleeping state information when the state information is the sleeping state information.
In some embodiments, the detection module 82 and the protection module 81 are further configured to perform the following steps:
obtaining biometric information of users on the vehicle other than the driver;
identifying the biological characteristic information to obtain age information of users on the vehicle except the driver;
and controlling the vehicle to perform a protection operation when detecting a user on the vehicle, other than a driver, with age information in a preset age range.
In some embodiments, the detection module 82 is further configured to perform the following steps:
acquiring state information of a target user, wherein the state information at least comprises the size of sound, the amplitude of action and the facial expression, and judging whether the current state of the target user is represented as a crying state or not;
and when the state information of the target user is the state information representing that the current state of the target user is crying, outputting a placating prompt signal aiming at the target user.
In some embodiments, the first execution module 83 is further configured to perform the following steps:
when the reply signal is detected to be a first signal, controlling the vehicle to play multimedia information of a first preset type;
and when the reply signal is detected to be a second signal, controlling the vehicle to play the multimedia information of a second preset type.
In some embodiments, the second execution module 84 is further configured to perform the following steps:
acquiring state information about a target user, wherein the state information at least comprises the size of sound, the amplitude of action and the facial expression, and judging whether the current state of the target user is a sleep state or not;
and when the state information of the target user is the state information representing that the current state of the target user is the sleeping state, controlling the vehicle to execute preset operation corresponding to the sleeping state information.
When the state information is sleep state information, detecting the working state of a sound module of the vehicle, and when the sound module works, adjusting the volume of the sound module to a preset volume;
and outputting a sleep prompt signal aiming at sleep, and driving the vehicle to adjust the temperature in the vehicle to the preset temperature when detecting a confirmation signal responding to the sleep prompt signal.
In some embodiments, the control device further comprises:
the judging module 85 is used for preferentially outputting a placating prompt signal when detecting that a target user with crying and sleeping state information simultaneously exists on the vehicle, and controlling the vehicle to output corresponding multimedia information according to a reply signal in response to the reply signal of the placating prompt signal;
and when detecting that only the target user with the sleeping state information exists on the vehicle, controlling the vehicle to execute a preset operation corresponding to the sleeping state information.
Based on the same inventive concept, another embodiment of the present application provides a computer-readable storage medium having stored thereon instructions, which, when executed by one or more processors, cause the processors to perform the steps of the control method according to one or more of the above.
Based on the same inventive concept, another embodiment of the present application provides a vehicle including the control apparatus as described above to implement one or more of the steps of the control method as described above.
For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
As will be appreciated by one of skill in the art, embodiments of the present application may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
Embodiments of the present application are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present application have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including the preferred embodiment and all such alterations and modifications as fall within the true scope of the embodiments of the application.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.
The foregoing detailed description is directed to a vehicle control method, a device, a storage medium, and a vehicle provided by the present application, and specific examples are applied herein to explain the principles and embodiments of the present application, and the descriptions of the foregoing examples are only used to help understand the method and the core ideas of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.
Claims (10)
1. A control method of a vehicle, characterized by comprising;
when detecting that a target user of a preset age range exists on the vehicle, controlling the vehicle to execute a protection operation, wherein the protection operation comprises starting a child lock;
detecting the state of the target user in real time to obtain the state information of the target user;
when the state information is preset state information, outputting a placating prompt signal aiming at a target user, responding to a reply signal of the placating prompt signal, and controlling the vehicle to output corresponding multimedia information according to the reply signal;
and when the state information is sleeping state information, controlling the vehicle to execute preset operation corresponding to the sleeping state information.
2. The control method according to claim 1, characterized by further comprising:
obtaining biometric information of users on the vehicle other than the driver;
identifying the biological characteristic information to obtain age information of users on the vehicle except the driver;
when detecting that a target user of a preset age range exists on the vehicle, controlling the vehicle to execute protection operation; the method comprises the following steps:
and controlling the vehicle to perform a protection operation when detecting a user on the vehicle, except the driver, with age information in a preset age range.
3. The control method according to claim 1, wherein detecting the status of the target user to obtain the status information of the target user comprises:
detecting the voice, action amplitude and facial expression of the template user to obtain the state information of the target user;
when the state information is preset state information, outputting a placating prompt signal aiming at the target user, and comprising the following steps:
analyzing the state information, and determining whether the current state of the target user is represented as a crying state or not;
and when the state information of the target user is the state information representing that the current state of the target user is crying, outputting a placating prompt signal aiming at the target user.
4. The control method according to claim 1, wherein the reply signal includes at least a first signal and a second signal;
responding to a reply signal of the pacification prompt signal, controlling the vehicle to output corresponding multimedia information according to the reply signal, and comprising the following steps:
when the reply signal is detected to be the first signal, controlling the vehicle to play multimedia information of a first preset type;
and when the reply signal is detected to be the second signal, controlling the vehicle to play the multimedia information of the second preset type.
5. The control method according to claim 1, wherein when the state information is sleeping state information, controlling the vehicle to perform a preset operation corresponding to the sleeping state information includes:
detecting the voice, action amplitude and facial expression of the template user to obtain the state information of the target user;
and when the state information of the target user is state information representing that the current state of the target user is sleeping, controlling the vehicle to execute preset operation corresponding to the sleeping state information.
6. The control method according to claim 1, wherein when the state information is sleeping state information, controlling the vehicle to perform a preset operation corresponding to the sleeping state information includes:
when the state information is sleep state information, detecting the working state of a sound module of the vehicle, and when the sound module works, adjusting the volume of the sound module to a preset volume;
and outputting a sleep prompting signal aiming at sleep, and driving the vehicle to adjust the temperature in the vehicle to a preset temperature when receiving a confirmation signal responding to the sleep prompting signal.
7. The control method according to claim 1, characterized by further comprising:
when a target user with crying state information and a sleeping user exist on the vehicle at the same time, a placating prompt signal aiming at the target user is preferentially output;
responding to a reply signal aiming at the pacification prompt signal, and controlling the vehicle to output multimedia information corresponding to the reply signal;
and when detecting that only a user with sleeping state information exists on the vehicle, controlling the vehicle to execute a preset operation corresponding to the sleeping state information.
8. A vehicle control apparatus, characterized by comprising:
the protection module is used for controlling the vehicle to execute protection operation when detecting that a target user of a preset age range exists on the vehicle, wherein the protection operation comprises starting a child lock;
the detection module is used for detecting the state of the target user to obtain the state information of the target user;
the first execution module is used for outputting a placating prompt signal aiming at a target user when the state information is preset state information, responding to a reply signal of the placating prompt signal, and controlling the vehicle to output corresponding multimedia information according to the reply signal;
and the second execution module is used for controlling the vehicle to execute preset operation corresponding to the sleeping state information when the state information is the sleeping state information.
9. A computer-readable storage medium having stored thereon instructions, which, when executed by one or more processors, cause the processors to perform the steps of the method of one or more of claims 1-7.
10. A vehicle, characterized in that it comprises a control device according to claim 8 to implement the steps of the method according to one or more of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110939304.4A CN114954332A (en) | 2021-08-16 | 2021-08-16 | Vehicle control method and device, storage medium and vehicle |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110939304.4A CN114954332A (en) | 2021-08-16 | 2021-08-16 | Vehicle control method and device, storage medium and vehicle |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114954332A true CN114954332A (en) | 2022-08-30 |
Family
ID=82973491
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110939304.4A Pending CN114954332A (en) | 2021-08-16 | 2021-08-16 | Vehicle control method and device, storage medium and vehicle |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114954332A (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2012061933A (en) * | 2010-09-15 | 2012-03-29 | Sanyo Electric Co Ltd | Video/audio equipment |
| CN106878364A (en) * | 2015-12-11 | 2017-06-20 | 比亚迪股份有限公司 | Information-pushing method, system, Cloud Server and vehicle for vehicle |
| CN108549720A (en) * | 2018-04-24 | 2018-09-18 | 京东方科技集团股份有限公司 | It is a kind of that method, apparatus and equipment, storage medium are pacified based on Emotion identification |
| CN111319583A (en) * | 2020-01-21 | 2020-06-23 | 东风小康汽车有限公司重庆分公司 | Child lock control method, device and system |
| CN112124242A (en) * | 2020-09-25 | 2020-12-25 | 长城汽车股份有限公司 | Children riding safety control method and device, storage medium and vehicle |
| CN112507976A (en) * | 2021-01-08 | 2021-03-16 | 蔚来汽车科技(安徽)有限公司 | In-vehicle child protection method, device, computer-readable storage medium and vehicle |
| CN113139070A (en) * | 2021-03-23 | 2021-07-20 | 合创汽车科技有限公司 | Interaction method and device for in-vehicle user, computer equipment and storage medium |
| CN113183900A (en) * | 2021-03-31 | 2021-07-30 | 江铃汽车股份有限公司 | Vehicle personnel monitoring method and device, readable storage medium and vehicle-mounted system |
-
2021
- 2021-08-16 CN CN202110939304.4A patent/CN114954332A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2012061933A (en) * | 2010-09-15 | 2012-03-29 | Sanyo Electric Co Ltd | Video/audio equipment |
| CN106878364A (en) * | 2015-12-11 | 2017-06-20 | 比亚迪股份有限公司 | Information-pushing method, system, Cloud Server and vehicle for vehicle |
| CN108549720A (en) * | 2018-04-24 | 2018-09-18 | 京东方科技集团股份有限公司 | It is a kind of that method, apparatus and equipment, storage medium are pacified based on Emotion identification |
| CN111319583A (en) * | 2020-01-21 | 2020-06-23 | 东风小康汽车有限公司重庆分公司 | Child lock control method, device and system |
| CN112124242A (en) * | 2020-09-25 | 2020-12-25 | 长城汽车股份有限公司 | Children riding safety control method and device, storage medium and vehicle |
| CN112507976A (en) * | 2021-01-08 | 2021-03-16 | 蔚来汽车科技(安徽)有限公司 | In-vehicle child protection method, device, computer-readable storage medium and vehicle |
| CN113139070A (en) * | 2021-03-23 | 2021-07-20 | 合创汽车科技有限公司 | Interaction method and device for in-vehicle user, computer equipment and storage medium |
| CN113183900A (en) * | 2021-03-31 | 2021-07-30 | 江铃汽车股份有限公司 | Vehicle personnel monitoring method and device, readable storage medium and vehicle-mounted system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20210287669A1 (en) | Modification of electronic system operation based on acoustic ambience classification | |
| US11186241B2 (en) | Automated emotion detection and environmental response | |
| CN106803423B (en) | Man-machine interaction voice control method and device based on user emotion state and vehicle | |
| Eyben et al. | Emotion on the road—necessity, acceptance, and feasibility of affective computing in the car | |
| US20170235361A1 (en) | Interaction based on capturing user intent via eye gaze | |
| CN106683673A (en) | Method, device and system for adjusting driving modes and vehicle | |
| CN111402925B (en) | Voice adjustment method, device, electronic equipment, vehicle-mounted system and readable medium | |
| JP6589514B2 (en) | Dialogue device and dialogue control method | |
| US10054921B2 (en) | Apparatus and method for adaptively controlling a target system according to operating environment | |
| Kutchek et al. | Takeover and handover requests using non-speech auditory displays in semi-automated vehicles | |
| JP2000181500A (en) | Speech recognition apparatus and agent apparatus | |
| CN110111471A (en) | A kind of automobile account login method, onboard system and vehicle | |
| JP6267563B2 (en) | Driving support device and driving support method | |
| CN114954332A (en) | Vehicle control method and device, storage medium and vehicle | |
| CN113450788A (en) | Method and device for controlling sound output | |
| JP2024090176A (en) | Information processing device | |
| Lashkov et al. | Dangerous state detection in vehicle cabin based on audiovisual analysis with smartphone sensors | |
| US20240208295A1 (en) | Information processing device | |
| CN106653064A (en) | Audio playing method and device | |
| CN113516978A (en) | Method and device for controlling sound output | |
| CN117055827A (en) | Control method and device of vehicle-mounted screen, electronic equipment, storage medium and vehicle | |
| CN116386672A (en) | In-vehicle emotion soothing method and device, electronic equipment and vehicle | |
| CN117482353A (en) | Method, system, device and storage medium for pacifying emotion | |
| Tengroth et al. | Enhancing the drivers user experience by broadening the sonic environment, two visual designers take on sound design | |
| CN116872955A (en) | Processing method and device applied to vehicle-mounted system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20220830 |