CN117341623A - Vehicle control method, vehicle control system and vehicle - Google Patents
Vehicle control method, vehicle control system and vehicle Download PDFInfo
- Publication number
- CN117341623A CN117341623A CN202210742570.2A CN202210742570A CN117341623A CN 117341623 A CN117341623 A CN 117341623A CN 202210742570 A CN202210742570 A CN 202210742570A CN 117341623 A CN117341623 A CN 117341623A
- Authority
- CN
- China
- Prior art keywords
- vehicle
- child
- image information
- monitoring area
- control method
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 84
- 238000012544 monitoring process Methods 0.000 claims abstract description 92
- 238000004378 air conditioning Methods 0.000 claims abstract description 12
- 230000004044 response Effects 0.000 claims abstract description 12
- 230000008451 emotion Effects 0.000 claims description 26
- 230000007958 sleep Effects 0.000 claims description 15
- 230000003993 interaction Effects 0.000 claims description 13
- 230000005611 electricity Effects 0.000 claims description 7
- 230000006870 function Effects 0.000 description 50
- 230000001276 controlling effect Effects 0.000 description 22
- 206010011469 Crying Diseases 0.000 description 6
- 238000001514 detection method Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 6
- 238000013135 deep learning Methods 0.000 description 5
- 238000013526 transfer learning Methods 0.000 description 5
- 230000008909 emotion recognition Effects 0.000 description 4
- 208000019901 Anxiety disease Diseases 0.000 description 3
- 208000027418 Wounds and injury Diseases 0.000 description 3
- 230000036506 anxiety Effects 0.000 description 3
- 230000006378 damage Effects 0.000 description 3
- 230000005284 excitation Effects 0.000 description 3
- 208000014674 injury Diseases 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 206010039740 Screaming Diseases 0.000 description 1
- 231100000136 action limit Toxicity 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000009423 ventilation Methods 0.000 description 1
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R21/00—Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60H—ARRANGEMENTS OF HEATING, COOLING, VENTILATING OR OTHER AIR-TREATING DEVICES SPECIALLY ADAPTED FOR PASSENGER OR GOODS SPACES OF VEHICLES
- B60H1/00—Heating, cooling or ventilating [HVAC] devices
- B60H1/00642—Control systems or circuits; Control members or indication devices for heating, cooling or ventilating devices
- B60H1/00814—Control systems or circuits characterised by their output, for controlling particular components of the heating, cooling or ventilating installation
- B60H1/00821—Control systems or circuits characterised by their output, for controlling particular components of the heating, cooling or ventilating installation the components being ventilating, air admitting or air distributing devices
- B60H1/00835—Damper doors, e.g. position control
- B60H1/00849—Damper doors, e.g. position control for selectively commanding the induction of outside or inside air
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R21/00—Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
- B60R21/01—Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R21/00—Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
- B60R2021/003—Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks characterised by occupant or pedestian
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R21/00—Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
- B60R21/01—Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents
- B60R2021/01122—Prevention of malfunction
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Physics & Mathematics (AREA)
- Thermal Sciences (AREA)
- Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
Abstract
The invention discloses a vehicle control method, a vehicle control system and a vehicle, wherein the vehicle control method comprises the following steps: responding to a signal for locking the vehicle, and acquiring the battery power of the vehicle; responding to the battery electric quantity higher than a preset electric quantity threshold value, and acquiring image information of a child monitoring area in the vehicle; analyzing whether children remain in the vehicle according to the image information of the child monitoring area in the vehicle; in response to the child remaining in the vehicle, the vehicle-mounted air conditioning system is controlled to adjust the environment in the vehicle. The vehicle control method provided by the embodiment of the invention can be completely based on the consideration of child safety, and can avoid serious consequences caused by starting the child monitoring function when the battery capacity of the vehicle is relatively low.
Description
Technical Field
The present invention relates to the field of vehicle technologies, and in particular, to a vehicle control method, a vehicle control system, and a vehicle.
Background
In the prior art, although a series of forgetting reminding functions of children in vehicles have been added to some vehicles, further improvement is needed for forgetting the children in the vehicles so that events still occur frequently.
Disclosure of Invention
The present invention aims to solve at least one of the technical problems existing in the prior art. Therefore, one of the objectives of the present invention is to provide a vehicle control method, which is completely based on the consideration of child safety, and avoids the serious consequences caused by starting the child monitoring function when the battery level of the vehicle is relatively low.
Another object of the present invention is to provide a vehicle control system.
A third object of the present invention is to provide a vehicle.
In order to achieve the above object, a vehicle control method according to an embodiment of a first aspect of the present invention includes: responding to a vehicle locking signal, and acquiring the electric quantity of a vehicle battery; responding to the battery electricity quantity higher than a preset electricity quantity threshold value, and acquiring image information of a child monitoring area in the vehicle; analyzing whether children remain in the vehicle according to the image information of the child monitoring area in the vehicle; in response to the child remaining in the vehicle, the vehicle-mounted air conditioning system is controlled to adjust the environment in the vehicle.
According to the vehicle control method provided by the embodiment of the invention, after the vehicle is locked, whether the child monitoring function is started or not is intelligently judged according to the battery power, the situation that the vehicle is powered down faster due to the fact that the child monitoring function is started when the vehicle power is lower is avoided, the situation that the child monitoring function is started under the condition that the vehicle battery power is lower can be avoided based on the consideration of child safety completely, the serious consequences caused by the fact that the child monitoring function is started when the vehicle battery power is lower are avoided, and the vehicle-mounted air conditioning system is controlled to adjust the vehicle environment when the child is left in the vehicle after the child monitoring function is started and the child is determined to be left in the vehicle, so that a relatively healthy vehicle environment can be provided for the child in the vehicle, and the life safety of the child is ensured.
In some embodiments of the invention, in response to a child remaining in the vehicle, the method further comprises: and sending the image information, the vehicle position and the reminding information of the child monitoring area in the vehicle to a vehicle remote service platform so that the vehicle remote service platform forwards the information to a user terminal corresponding to the current login account of the vehicle. The remote service platform directly forwards the information to the user terminal of the current login account, can directly inform the user of the nearest vehicle to the vehicle, can also contact with the login person of the current login account more quickly, is beneficial to quickly helping children to escape, and reduces hidden danger in the vehicle missed by the children.
In some embodiments of the invention, in response to a child remaining in the vehicle, the method further comprises: and controlling the vehicle-mounted multimedia screen to display dynamic information. When the child is trapped in the vehicle, the vehicle-mounted multimedia screen is controlled to display dynamic information, so that the attention of the child can be dispersed, the anxiety emotion is relieved, the child is pacified, and the possibility of injury to the child is reduced.
In some embodiments of the invention, the method further comprises: when the vehicle is in a driving state, acquiring image information of a child monitoring area in the vehicle; and controlling the vehicle-mounted multimedia screen to play the image information of the child monitoring area in the vehicle in real time.
According to the vehicle control method provided by the embodiment of the invention, based on the in-vehicle camera and the image recognition algorithm, under the child monitoring scene in the vehicle driving state, the vehicle control system, namely the controller, can control the vehicle-mounted multimedia screen to play the image information of the child monitoring area in the vehicle in real time, for example, the small window form of the picture of the child monitoring area in the vehicle is projected to the side of the multimedia screen, which is close to the driver, so that the sight of the driver is effectively prevented from leaving the front to ensure that the driver can focus on driving, and meanwhile, the rear road condition can be displayed by the inner rearview mirror, so that the potential safety hazard is reduced.
In some embodiments of the invention, the method further comprises: acquiring the speed of a vehicle and image information of a child monitoring area in the vehicle when the vehicle is in a driving state; determining that the vehicle speed exceeds a preset vehicle speed, and analyzing whether a child wears a safety belt according to the image information of the child monitoring area in the vehicle; and prompting according to a preset reporting period in response to the fact that the child is not belted with the safety belt. Based on the camera and the image recognition algorithm in the vehicle, the vehicle speed information detection is overlapped, so that the state of the child safety belt can be detected in real time under the driving scene, and the effective passenger protection is realized.
In some embodiments of the invention, the method further comprises: when the vehicle is in a driving state, acquiring image information and voice recognition information of a child monitoring area in the vehicle; analyzing the current emotion of the child according to the image information and the voice recognition information; and controlling the vehicle-mounted multimedia to perform voice interaction and playing corresponding multimedia information according to the current emotion of the child. The vehicle-mounted entertainment system is used for monitoring the emotion of a rear-row child based on the in-vehicle camera and the image recognition algorithm, and can be used for timely pacifying the child under the condition of crying and excessive excitation, so that the safety of the child in the vehicle environment can be ensured, and entertainment cabin experience can be brought to the child. The danger caused by the large-amplitude movement of the children is reduced, and the interference to the driver is reduced.
In some embodiments of the invention, the method further comprises: when the vehicle is in a driving state, acquiring image information of a child monitoring area in the vehicle; analyzing whether the child enters a sleep state according to the image information of the child monitoring area in the vehicle; and responding to the child entering the sleep state, controlling the vehicle-mounted multimedia to carry out voice prompt and controlling the vehicle load to enter the child sleep mode. Under the scene that children fall asleep, the environment in the vehicle is intelligently adjusted, a good environment in the vehicle is built, and the sleeping quality of the children is improved.
In order to achieve the above object, a vehicle control system according to an embodiment of the second aspect includes: the battery management device is used for detecting the electric quantity of a vehicle battery; the image acquisition device is used for acquiring image information of a child monitoring area in the vehicle; and a controller connected to the battery management device and the image acquisition device for executing the vehicle control method according to any one of the above.
According to the vehicle control system provided by the embodiment of the invention, based on the existing hardware structures of the battery management device, the image acquisition device and the controller in the vehicle, by executing any one of the vehicle control methods in the above embodiments, whether the child monitoring function is started or not can be intelligently judged according to the battery capacity based on the child safety consideration after the vehicle is locked, so that serious consequences caused when the child is locked in the vehicle under the condition of low electricity of the vehicle are avoided, and the vehicle air conditioning system is controlled to adjust the vehicle environment after the child monitoring function is started and when the child is determined to be left in the vehicle, so that a relatively healthy and safe vehicle environment can be provided for the child in the vehicle, and the life safety of the child is ensured
In some embodiments of the invention, the vehicle control system further comprises: the vehicle-mounted multimedia is connected with the controller; the vehicle speed sensor is connected with the controller and is used for detecting the vehicle speed in the running state of the vehicle; and the voice recognition device is connected with the controller and is used for detecting and recognizing voice information of children in the vehicle.
According to the vehicle control system provided by the embodiment of the invention, based on the vehicle-mounted hardware structure of the image acquisition device, the controller, the vehicle-mounted multimedia, the vehicle speed sensor and the voice recognition device, the vehicle control method in any one of the embodiments is executed, the child monitoring function, the multi-mode interaction function, the preschool education enlightenment function and the multi-mode interaction function are integrated, the child safety is more focused, the user experience is more focused, hidden danger in the vehicle is eliminated, and meanwhile, the child accompany can be provided to ensure the concentrated driving.
In order to achieve the above object, an embodiment of the third aspect further provides a vehicle, including: the child monitoring function switch unit is used for switching on or switching off the child monitoring function according to a user trigger instruction; the vehicle control system of the above embodiment, wherein the controller of the system is connected to the child monitoring function switch unit.
According to the vehicle provided by the embodiment of the invention, the vehicle control system 10 and the child monitoring function switch unit are configured, so that the vehicle is more intelligent, the child safety is more concerned, hidden danger in the vehicle can be eliminated, meanwhile, the child accompany can be provided to ensure the attentive driving, the acceptance and the additional holding of parents and owners can be easily obtained, and the acceptance of social value sense can be easily obtained.
Additional aspects and advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.
Drawings
The foregoing and/or additional aspects and advantages of the invention will become apparent and may be better understood from the following description of embodiments taken in conjunction with the accompanying drawings in which:
FIG. 1 is a flow chart of a vehicle control method according to one embodiment of the invention;
FIG. 2 is a flow chart of a vehicle control method according to another embodiment of the invention;
FIG. 3 is a flow chart of a vehicle control method according to yet another embodiment of the invention;
FIG. 4 is a flow chart of a vehicle control method according to yet another embodiment of the invention;
FIG. 5 is a flow chart of a vehicle control method according to yet another embodiment of the invention;
FIG. 6 is a flow chart of a vehicle control method according to yet another embodiment of the invention;
FIG. 7 is a flow chart of a vehicle control method according to yet another embodiment of the invention;
FIG. 8 is a flow chart of a vehicle control method according to yet another embodiment of the invention;
FIG. 9 is a flow chart of a vehicle control method according to yet another embodiment of the invention;
FIG. 10 is a flow chart of a vehicle control method according to yet another embodiment of the invention;
FIG. 11 is a flow chart of a vehicle control method according to yet another embodiment of the invention;
FIG. 12 is a flow chart of a vehicle control method according to yet another embodiment of the invention;
FIG. 13 is a block diagram of a vehicle control system according to one embodiment of the invention;
FIG. 14 is a block diagram of a vehicle control system according to another embodiment of the invention;
fig. 15 is a block diagram of a vehicle according to one embodiment of the invention.
Reference numerals:
a vehicle 100;
a vehicle control system 10, a child monitoring function switch unit 20;
a battery management device 1, an image acquisition device 2, an on-vehicle multimedia 4, a vehicle speed sensor 5 and a voice recognition device 6.
Detailed Description
Embodiments of the present invention will be described in detail below, by way of example with reference to the accompanying drawings.
A vehicle control method according to an embodiment of the invention is described below with reference to fig. 1 to 12.
In some embodiments of the present invention, as shown in fig. 1, a flowchart of a vehicle control method according to an embodiment of the present invention is provided, wherein the vehicle control method at least includes steps S1-S4, which are specifically described below.
S1, responding to a vehicle locking signal, and acquiring the electric quantity of a vehicle battery.
In real life, there is a lot of problems that children are left in the vehicle, and after the vehicle is locked, it is difficult for the children to open the door from the vehicle interior to cause the children to be left in the vehicle, especially for the vehicle provided with the child lock. Wherein the controller in the vehicle can acquire the vehicle battery power detected by the vehicle battery management device in real time.
And S2, responding to the fact that the battery electricity quantity is higher than a preset electricity quantity threshold value, and acquiring image information of a child monitoring area in the vehicle.
The preset power threshold may be set as needed, for example, the preset power threshold may be set to 10% or 15% or 20% or the like. Considering that if the battery power in the vehicle is lower than the preset power threshold, the child monitoring function is forced to be started, the situation that the vehicle is powered down may occur, if the child is trapped in the vehicle by one alone, the user cannot execute the operations such as electric unlocking or remote window opening and air conditioning under the condition that the battery power of the vehicle is extremely low or even the power is lost, and thus the child is helped. Based on the method, when the battery power is higher than the preset power threshold, the child monitoring function is started, and the child can be conveniently unfolded for rescue.
S3, analyzing whether children remain in the vehicle according to the image information of the child monitoring area in the vehicle.
The image acquisition device can be arranged in the vehicle to acquire image information of a child monitoring area in the vehicle in real time, for example, the image acquisition device can be a 360-degree annular camera arranged in the vehicle and can be used for shooting video pictures of the environment in the vehicle in real time. After the child monitoring function is started, the camera shoots images of the child monitoring area in the vehicle in real time and transmits videos to the controller of the vehicle.
Specifically, the human face recognition can be performed through visual recognition of the image acquisition device, or through an image model trained by deep learning and transfer learning, the image information of the child monitoring area in the vehicle is recognized, and whether the child state is left in the vehicle is determined.
And S4, responding to the child left in the vehicle, and controlling the vehicle-mounted air conditioning system to adjust the environment in the vehicle.
When a child is left in the vehicle according to image information of a child monitoring area in the vehicle, the vehicle-mounted air conditioning system is automatically controlled to be started and adjust the environment in the vehicle, for example, the vehicle-mounted air conditioning system is controlled to operate at a set temperature of 24 ℃ to maintain the temperature in the vehicle at a proper temperature, the air conditioning system is controlled to operate in an AUTO gear and the state is in an outer circulation, and ventilation inside and outside the vehicle is conveniently achieved under the condition that the vehicle window is tightly closed.
According to the vehicle control method provided by the embodiment of the invention, after the vehicle is locked, whether the child monitoring function is started or not is intelligently judged according to the battery power, so that the situation that the vehicle is powered down due to forced starting of the child monitoring function when the vehicle power is low is avoided, and the situation that the child monitoring function is started under the condition that the vehicle battery power is low is avoided based on the consideration of the child safety completely, so that more serious consequences are caused. And after the child monitoring function is started and the child left in the vehicle is determined, controlling the vehicle-mounted air conditioning system to adjust the environment in the vehicle, and providing a relatively healthy environment in the vehicle for the child in the vehicle so as to ensure the life safety of the child.
In some embodiments of the present invention, as shown in fig. 2, a flowchart of a vehicle control method according to another embodiment of the present invention is shown, wherein the vehicle control method further specifically includes step S5 in response to a child remaining in the vehicle.
And S5, sending the image information, the vehicle position and the reminding information of the child monitoring area in the vehicle to a vehicle remote service platform so that the vehicle remote service platform forwards the information to a user terminal corresponding to the current login account of the vehicle.
Considering that the vehicle user closest to the vehicle is usually the login person of the current login account, when the remote service platform directly forwards the information to the user terminal of the current login account, the user closest to the vehicle can be directly notified, and the rapid rescue of the child is facilitated. And when the vehicle is borrowed by a login person of the current login account to other people, the situation that the child is forgotten in the vehicle usually occurs in the situation that the login person of the current account drives and carries the child to go out, so that the child in the vehicle is usually related to the login person of the current login account, and the remote service platform can also contact with the login person of the current login account more quickly when directly forwarding information to the user terminal of the current login account. Furthermore, in the case of car rental business increments today, in the scenario of a user renting a car, the car rental user and the car owner may not be acquainted, and if a situation arises in which the child is forgotten in the car, the current login account needs to be contacted in time.
Based on the above, after determining that the child is left in the vehicle, the vehicle remote service platform forwards the information to the user terminal corresponding to the current login account of the vehicle, so that the vehicle remote service platform can conveniently and more quickly contact with the user of the current login account, is beneficial to quickly rescuing the child to escape, and reduces hidden danger that the child misses in the vehicle.
In some embodiments of the present invention, as shown in fig. 3, a flowchart of a vehicle control method according to still another embodiment of the present invention is shown, wherein the vehicle control method further specifically includes step S6 in response to a child remaining in the vehicle.
S6, controlling the vehicle-mounted multimedia screen to display dynamic information.
In the child monitoring scene, after the child is left in the vehicle according to the image captured in the vehicle, the situation that the emotion of the child is easy to fluctuate and is irritated when the child is independently locked in the vehicle is considered, the child can be injured by accident due to the fact that the child is easy to be attracted by light, a screen and animation is considered, a controller in the vehicle automatically controls the vehicle-mounted multimedia screen to display dynamic information, such as displaying dynamic information of opening an air conditioner, opening window information and the like, and can also start a VPA (Virtual Personal Assistance, virtual personal assistant) to control the vehicle-mounted multimedia screen to play animation and the like, so that the attention of the child can be dispersed, the anxiety emotion is relieved, the child is calmed, the possibility of injury to the child is reduced, and the occurrence of tragedy can be effectively avoided.
As shown in fig. 4, a flowchart of a vehicle control method according to still another embodiment of the present invention is shown, wherein the method may further include steps S101-S116, which are specifically described below.
S101, whether the function switch is started, the vehicle is locked and the power supply quantity is more than 10% is detected, if yes, step S102 is executed, and if no, the detection is continued.
S102, starting a camera and a child detection algorithm.
S103, judging whether only children in the vehicle are detected, if yes, executing step S104, and if no, returning to executing step S101.
S104, receiving an alarm event, and starting an air conditioner to set the temperature to 24 degrees, the external circulation and the AUTO gear; the HUT screen displays prompt information; the vehicle owner is informed and the air conditioner is started, and the current temperature in the vehicle is displayed; taking a picture in the vehicle; event information, in-vehicle photographs, and vehicle location are sent to the TSP.
S105, determining whether key unlocking, remote closing of an air conditioner, opening of a window, or other vehicle control is detected, if yes, executing step S106, and if no, executing step S107.
S106, judging whether the whole vehicle is dormant, if not, returning to the step S101.
S107, closing the air conditioner and closing the screen.
S108, judging whether the air conditioner is started for 4 hours or the battery power is lower than 10 percent, if the judging result is yes, executing step S109, and if the judging result is no, executing step S110.
S109, turning off the air conditioner, turning off the screen, taking the in-vehicle photo, sending event information, the in-vehicle photo and the vehicle position to the TSP.
S110, starting an air conditioner to set the temperature to 24 degrees, and performing external circulation and AUTO gear; HUT screen display prompt message: the vehicle owner is informed and the air conditioner is started, and the current temperature in the vehicle is displayed.
S111, event information is received.
S112, detecting whether the current vehicle logs in the account, if yes, executing step S114, and if no, executing step S113.
S113, notifying the owner account.
S114, notifying the current login account.
S115, short message notification, including prompt information, in-car picture links, customer service telephones and the like.
S116, the mobile phone APP pushes reminding, including reminding information, in-car pictures, geographic positions of vehicles, customer service telephones and the like.
In some embodiments of the present invention, as shown in fig. 5, a flowchart of a vehicle control method according to still another embodiment of the present invention is provided, wherein the method may further include at least step S7 and step S8.
S7, acquiring image information of a child monitoring area in the vehicle in the running state of the vehicle.
In real life, market heat of large space SUV (Sport Utility Vehicle ) and MPV (multi-Purpose Vehicles) Vehicles is continuously increasing, and high frequencies of parent-child travel scenes are mapped. In parent-child travel, parents take care of 'baby needs' and 'attentive driving', which definitely increases driving hidden trouble, and vehicles are used as intelligent moving space, all scenes, all cabin members including child coverage are required to be provided, and an image acquisition device is arranged in the vehicles to acquire image information of a child monitoring area in the vehicles in real time.
S8, controlling the vehicle-mounted multimedia screen to play the image information of the child monitoring area in the vehicle in real time.
For parents to take children's travel scene, the driver usually adjusts the interior rear-view mirror and sees back row children's state, and this can be dispersed at driver's driving sight and attention, and when the driver adjusted the interior rear-view mirror to the direction that can observe children's monitoring area in the car, can lead to the interior rear-view mirror to lose the function of observing rear road conditions condition, this all can increase the potential safety hazard in the driving process.
According to the vehicle control method provided by the embodiment of the invention, based on the in-vehicle camera and the image recognition algorithm, under the child monitoring scene in the vehicle driving state, the vehicle control system, namely the controller, can control the vehicle-mounted multimedia screen to play the image information of the child monitoring area in the vehicle in real time, for example, the small window form of the picture of the child monitoring area in the vehicle is projected to the side of the multimedia screen, which is close to the driver, so that the sight of the driver is effectively prevented from leaving the front to ensure that the driver can focus on driving, and meanwhile, the rear road condition can be displayed by the inner rearview mirror, so that the potential safety hazard is reduced.
In some embodiments of the present invention, as shown in fig. 6, a flowchart of a vehicle control method according to still another embodiment of the present invention is shown, wherein the method may further include steps S9-S11, specifically as follows.
S9, acquiring the speed of the vehicle and the image information of the child monitoring area in the vehicle in the running state of the vehicle.
When a child sits on the vehicle, the predictive ability and the self-protection ability for an emergency accident are relatively poor, and in the driving process, if the child in the vehicle is not fastened with the safety belt, the risk of injury to the child is easily increased when the vehicle speed is too high. The vehicle speed sensor is used for detecting the vehicle speed, and the controller in the vehicle can acquire the vehicle speed of the vehicle detected by the vehicle speed sensor in real time and acquire the image information of the child monitoring area in the vehicle acquired by the image acquisition device in real time.
And S10, responding to the fact that the vehicle speed exceeds the preset vehicle speed, and analyzing whether the child is fastened with the safety belt according to the image information of the child monitoring area in the vehicle.
The preset vehicle speed may be set according to the performance of the vehicle and the safety driving requirement of the vehicle, wherein the preset vehicle speed may be set to a smaller value to prevent the children in the vehicle from being injured to the greatest extent, for example, the preset vehicle speed may be set to 20km/h or 25km/h or 30km/h or 35km/h, etc., and is not particularly limited herein. And when the vehicle speed exceeds the preset vehicle speed, starting a child safety belt detection algorithm. The child safety belt recognition algorithm can be started through the image acquisition device so as to detect whether the child wears the safety belt.
And S11, prompting according to a preset reporting period in response to the fact that the safety belt is not fastened by the child.
The preset reporting period may be set as required, for example, the preset reporting period may be set to 30s or 1min or 90s or 2min, etc. And when the child is detected to be unbuckled, the prompt is circularly carried out according to a preset reporting period. Specifically, a prompting method can be set according to the needs, for example, a voice prompt, a HUT (Human Machine Interface, human-computer interaction interface) such as a touch-control multimedia screen and the like can be used for prompting a driver or an in-car adult to ask the child to tie up a safety belt, and the like.
In some embodiments of the present invention, as shown in fig. 7, a flowchart of a vehicle control method according to still another embodiment of the present invention is shown, wherein the method may further include steps S201-S207, specifically as follows.
S201, the vehicle starts a child monitoring function and detects that the current vehicle speed exceeds a preset vehicle speed.
S202, starting a vehicle camera vision algorithm and voice monitoring of the rear-row children.
S203, detecting whether the child is not fastened with the safety belt, if yes, executing step S204, and if no, returning to executing step S201.
S204, judging whether the current power-on period is reminded once, if yes, executing step S205 and step S206, and if no, executing step S207.
S205, no reminding is performed.
S206, the child safety belt detection algorithm is closed.
S207, a language prompt is provided for helping children tie the safety belt.
According to the vehicle control method provided by the embodiment of the invention, based on the in-vehicle camera and the image recognition algorithm, the superposition vehicle speed information detection can be realized, the state of the child safety belt can be detected in real time under the driving scene, and the effective passenger protection can be realized.
In some embodiments of the present invention, as shown in fig. 8, a flowchart of a vehicle control method according to still another embodiment of the present invention is provided, wherein the method may further include steps S12-S14, as follows.
S12, when the vehicle is in a driving state, acquiring image information and voice recognition information of a child monitoring area in the vehicle.
The child's emotion is changeable, especially when the child takes the vehicle, is limited by the interior space, the action limit etc. and is liable to generate fear or anxiety, and then cry and cry are generated, or when the riding time is longer, when the child lacks the attraction of fresh things, the child is liable to generate boring and falling feeling, at this time, the child may intentionally cry and cry for the purpose of obtaining accompaniment. Or children are easily attracted by fresh things in the environment inside and outside the car, and excited emotion is easy to occur. Wherein a controller in the vehicle may be responsible for emotion recognition from speech and/or images. The vehicle can be provided with a voice recognition device, such as a microphone at each position in the vehicle, for detecting and recognizing voice information of the child in the vehicle, and the controller in the vehicle can acquire the voice information of the child in the vehicle detected by the voice recognition device in real time and acquire the image information of the child monitoring area in the vehicle acquired by the image acquisition device in real time.
S13, analyzing the current emotion of the child according to the image information and the voice recognition information.
The voice recognition device is deployed in the vehicle to extract voice characteristics of the child, wherein the influence of background voice on the voice characteristics of the child can be avoided, the voice characteristics of the child are subjected to emotion recognition through a language model trained by deep learning and transfer learning, and emotion changes such as crying and excitement of the child are recognized. For example, the voice feature collection of the child can be performed through a microphone arranged on a rear seat of the vehicle, emotion recognition is performed through a language feature model and a language dictionary library of the child trained by deep learning and transfer learning, crying, excitement and other emotion changes of the child at the rear position are recognized, and the recognition result is transmitted to a controller of the vehicle.
And/or, the emotion recognition can be carried out through the visual recognition of the image acquisition device, and emotion changes such as crying, excitation and the like of the children can be recognized through the image model trained by deep learning and transfer learning. For example, according to the camera deployed in the vehicle, image information of a child monitoring area in the vehicle can be directly acquired, facial features of the child in the vehicle are extracted, recognition is performed based on a face recognition model, and a corresponding recognition result is transmitted to a controller of the vehicle.
And S14, controlling the vehicle-mounted multimedia to perform voice interaction and playing corresponding multimedia information according to the current emotion of the child.
The vehicle can be provided with vehicle-mounted multimedia for playing corresponding multimedia information and realizing voice interaction, voice interaction can be performed on remote personnel besides man-machine language interaction, and corresponding video and audio information can be provided for the rear-row position where the child is located.
Further, a database corresponding to the pacifying mode and pacifying resources can be stored in the vehicle-mounted multimedia, or the vehicle-mounted multimedia can be connected with the cloud server through a 5G network to directly acquire pacifying data of the cloud server and the like. The controller in the vehicle controls the vehicle-mounted multimedia to adopt a corresponding pacifying mode and call the corresponding pacifying resources according to the current emotion of the child, so that the vehicle-mounted multimedia is controlled to perform voice interaction and play corresponding multimedia information.
For example, when it is determined that the emotion of the child in the vehicle is excited, laughed, or spiked, the vehicle control method according to the embodiment of the present invention is understood with reference to a flowchart shown in fig. 9, and fig. 9 is a flowchart of a vehicle control method according to still another embodiment of the present invention, wherein the method may further include steps S301 to S306, as follows.
S301, the vehicle is in a running state.
S302, starting a vehicle camera vision algorithm and voice monitoring of the rear-row children.
S303, judging that the emotion result is laughing and screaming.
S304, controlling the vehicle-mounted multimedia to output emotion timbre' yang is happy today, and I tell story bar to yang.
S305, actively recommending adapted content resources, for example: a preliminary child story, a scientific story, a pre-sleep story, a fairy tale story, etc.
S306, controlling the vehicle-mounted multimedia screen to play the image information of the child monitoring area in the vehicle in real time.
For another example, when it is detected that the emotion of the child in the vehicle is sadness or crying, the vehicle control method according to the embodiment of the present invention is understood with reference to the flowchart shown in fig. 10, and fig. 10 is a flowchart of the vehicle control method according to another embodiment of the present invention, where the method may further include steps S401 to S406, which are specifically described below.
S401, the vehicle is in a running state.
S402, starting a vehicle camera vision algorithm and voice monitoring of the rear-row children.
S403, judging the emotion result as sadness.
S404, controlling the vehicle-mounted multimedia to output emotion colors of cry in yang and listen to the emotion.
S405, playing a happy song for children, simultaneously turning on a quintic atmosphere lamp mode, and actively recommending adapted content resources, for example: primary english pergola, new ancient poems, etc.
S406, controlling the vehicle-mounted multimedia screen to play the image information of the child monitoring area in the vehicle in real time.
According to the vehicle control method provided by the embodiment of the invention, based on the in-vehicle camera and the image recognition algorithm, the voice monitoring is overlapped, so that the monitoring of the emotion of the rear-row child can be realized, and the vehicle-mounted entertainment system can pacify the child in time under the conditions of crying and excessive excitation of the child, thereby ensuring the safety of the child in the vehicle environment and bringing entertainment cabin experience to the child. The danger caused by the large-amplitude movement of the children is reduced, and the interference to the driver is reduced.
In some embodiments of the present invention, as shown in fig. 11, a flowchart of a vehicle control method according to still another embodiment of the present invention is shown, wherein the method may further include steps S15-S17, specifically as follows.
S15, acquiring image information of a child monitoring area in the vehicle in the running state of the vehicle.
In a driving scene of parent-child travel, the sleeping of a child is a very common scene, and a controller in a vehicle can acquire image information of a child monitoring area in the vehicle, which is acquired by an image acquisition device, in real time.
S16, analyzing whether the child enters a sleep state according to the image information of the child monitoring area in the vehicle.
The state of the child, such as a wakeful state and a sleep state, can be identified by visual identification of the image acquisition device and emotion identification of the image model trained by deep learning and transfer learning.
And S17, responding to the child entering the sleep state, controlling the vehicle-mounted multimedia to carry out voice prompt and controlling the vehicle load to enter the child sleep mode.
After determining that the child enters the sleep state, the controller in the vehicle can also be used for controlling the vehicle-mounted multimedia to play corresponding voice prompt information and controlling the vehicle load to enter the sleep mode of the child. The vehicle load may include an on-board multimedia screen, an on-board multimedia, a rear seat window, an in-vehicle light, an air conditioner, and the like.
For example, as shown in fig. 12, a flowchart of a vehicle control method according to still another embodiment of the present invention is shown, wherein the method may further include steps S501-S506, which are specifically described below.
S501, the vehicle is in a running state.
S502, starting a vehicle camera vision algorithm and voice monitoring of the rear-row children.
S503, judging that the child state is falling asleep.
S504, controlling the vehicle-mounted multimedia to output emotion tone, namely that the baby sleeps, the air conditioner is turned on, the attention is paid to preventing catching a cold, and the baby sleeps.
S505, controlling the multimedia volume to be reduced, closing a rear seat window, dimming the light of an interior lamp, controlling the air quantity of the air conditioner to be reduced, and setting the air outlet temperature of the air conditioner to be 25 degrees.
S506, controlling the vehicle-mounted multimedia screen to play the sleeping image information of the child in the vehicle in real time.
According to the vehicle control method provided by the embodiment of the invention, based on the in-vehicle camera and the image recognition algorithm, the monitoring of the state of the rear-row children can be realized, and the in-vehicle environment can be actively regulated under the sleeping scene of the children.
In some embodiments of the present invention, as shown in fig. 13, there is a block diagram of a vehicle control system according to an embodiment of the present invention, in which a vehicle control system 10 includes a battery management device 1, an image pickup device 2, and a controller 3.
The battery management device 1 is used for detecting the vehicle battery level. The image acquisition device 2 is used for acquiring image information of a child monitoring area in a vehicle, wherein the image acquisition device can be a 360-degree annular camera arranged in the vehicle and can be used for shooting video pictures of the internal environment of the vehicle in real time.
The controller 3 is connected to the battery management device 1 and the image capturing device 2, and is used for executing the vehicle control method according to any of the above embodiments, and may be specifically understood with reference to fig. 1 to 12 and related content, which are not described herein.
According to the vehicle control system 10 of the embodiment of the invention, based on the existing hardware structures of the battery management device 1, the image acquisition device 2 and the controller 3 in the vehicle, by executing any one of the vehicle control methods in the above embodiments, whether to start the child monitoring function can be intelligently judged according to the battery power based on the child safety consideration after the vehicle is locked, so that serious consequences caused when the child is locked in the vehicle under the condition of low power of the vehicle are avoided, and the vehicle-mounted air conditioning system is controlled to adjust the vehicle environment after the child monitoring function is started and when the child is determined to be left in the vehicle, so that a relatively healthy vehicle environment can be provided for the child in the vehicle to ensure the life safety of the child.
In some embodiments of the present invention, as shown in fig. 14, a block diagram of a vehicle control system according to another embodiment of the present invention is shown, wherein the vehicle control system 10 further includes an on-board multimedia 4, a vehicle speed sensor 5, and a voice recognition device 6.
The vehicle-mounted multimedia 4 is connected with the controller 3, the vehicle speed sensor 5 is connected with the controller 3 and used for detecting the vehicle speed in the running state of the vehicle, and the voice recognition device 6 is connected with the controller 3 and used for detecting and recognizing the voice information of children in the vehicle.
According to the vehicle control system 10 of the embodiment of the invention, based on the vehicle-mounted hardware structure of the image acquisition device 2, the controller 3, the vehicle-mounted multimedia 4, the vehicle speed sensor 5 and the voice recognition device 6, by executing any one of the vehicle control methods of the above embodiments, a child monitoring function, such as a child left-behind reminding function, a safety belt monitoring function and other safety related scene functions, a multi-mode interaction function, such as a function of providing a tone color of a child in close habit of child interaction, a function of performing AI interaction by adopting cartoon virtual images, and a preschool education enlightening function, such as a function of providing voice broadcasting, are realized, a function of supporting a rear child to use massive child resources is more focused on child safety and user experience, hidden hazards in a vehicle are eliminated for the child, and meanwhile, the child company can be provided to ensure special driving.
In some embodiments of the present invention, as shown in fig. 15, a block diagram of a vehicle according to another embodiment of the present invention is shown, wherein the vehicle 100 includes a vehicle control system 10 and a child care function switch unit 20.
The controller 3 of the vehicle control system 10 is connected to the child care function switch unit 20. The child monitor function switch unit 20 is configured to switch on or off the child monitor function according to a user trigger instruction, where a user can set a condition for switching on or off the child monitor function in advance, and the vehicle control system 10 can intelligently control the child monitor function switch unit 20 to switch on or off the child monitor function according to the condition, or the user can send the trigger instruction through the user terminal, or directly operate the vehicle terminal to send the instruction to the vehicle control system 10, so that the vehicle control system 10 can control the child monitor function switch unit 20 to switch on or off the child monitor function.
According to the vehicle 100 of the embodiment of the invention, the vehicle control system 10 and the child monitoring function switch unit 20 are configured, so that the vehicle is more intelligent, the child safety is more concerned, hidden danger in the vehicle can be eliminated, meanwhile, the child accompany can be provided to ensure the special driving, the acceptance and the additional holding of parents and owners can be easily obtained, and the acceptance of social value feeling can be easily obtained.
Other configurations and operations of the vehicle control system 10 and the vehicle 100, etc. according to the embodiment of the present invention are known to those of ordinary skill in the art and will not be described in detail herein.
In the description of the present specification, reference to the terms "one embodiment," "some embodiments," "illustrative embodiments," "examples," "specific examples," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiments or examples.
While embodiments of the present invention have been shown and described, it will be understood by those of ordinary skill in the art that: many changes, modifications, substitutions and variations may be made to the embodiments without departing from the spirit and principles of the invention, the scope of which is defined by the claims and their equivalents.
Claims (10)
1. A vehicle control method characterized by comprising:
responding to a vehicle locking signal, and acquiring the electric quantity of a vehicle battery;
responding to the battery electricity quantity higher than a preset electricity quantity threshold value, and acquiring image information of a child monitoring area in the vehicle;
analyzing whether children remain in the vehicle according to the image information of the child monitoring area in the vehicle;
in response to the child remaining in the vehicle, the vehicle-mounted air conditioning system is controlled to adjust the environment in the vehicle.
2. The vehicle control method according to claim 1, characterized in that, in response to a child remaining in the vehicle, the method further comprises:
and sending the image information, the vehicle position and the reminding information of the child monitoring area in the vehicle to a vehicle remote service platform so that the vehicle remote service platform forwards the information to a user terminal corresponding to the current login account of the vehicle.
3. The vehicle control method according to claim 1, characterized in that, in response to a child remaining in the vehicle, the method further comprises:
and controlling the vehicle-mounted multimedia screen to display dynamic information.
4. The vehicle control method according to claim 1, characterized in that the method further comprises:
when the vehicle is in a driving state, acquiring image information of a child monitoring area in the vehicle;
and controlling the vehicle-mounted multimedia screen to play the image information of the child monitoring area in the vehicle in real time.
5. The vehicle control method according to claim 1, characterized in that the method further comprises:
acquiring the speed of a vehicle and image information of a child monitoring area in the vehicle when the vehicle is in a driving state;
responding to the vehicle speed exceeding a preset vehicle speed, and analyzing whether a child is tied with a safety belt according to the image information of the child monitoring area in the vehicle;
and prompting according to a preset reporting period in response to the fact that the child is not belted with the safety belt.
6. The vehicle control method according to claim 1, characterized in that the method further comprises:
when the vehicle is in a driving state, acquiring image information and voice recognition information of a child monitoring area in the vehicle;
analyzing the current emotion of the child according to the image information and the voice recognition information;
and controlling the vehicle-mounted multimedia to perform voice interaction and playing corresponding multimedia information according to the current emotion of the child.
7. The vehicle control method according to claim 1, characterized in that the method further comprises:
when the vehicle is in a driving state, acquiring image information of a child monitoring area in the vehicle;
analyzing whether the child enters a sleep state according to the image information of the child monitoring area in the vehicle;
and responding to the child entering the sleep state, controlling the vehicle-mounted multimedia to carry out voice prompt and controlling the vehicle load to enter the child sleep mode.
8. A vehicle control system, characterized by comprising:
the battery management device is used for detecting the electric quantity of a vehicle battery;
the image acquisition device is used for acquiring image information of a child monitoring area in the vehicle;
a controller connected to the battery management device and the image acquisition device for executing the vehicle control method according to any one of claims 1 to 7.
9. The vehicle control system according to claim 8, characterized by further comprising:
the vehicle-mounted multimedia is connected with the controller;
the vehicle speed sensor is connected with the controller and is used for detecting the vehicle speed in the running state of the vehicle;
and the voice recognition device is connected with the controller and is used for detecting and recognizing voice information of children in the vehicle.
10. A vehicle, characterized by comprising:
the child monitoring function switch unit is used for switching on or switching off the child monitoring function according to a user trigger instruction;
the vehicle control system of claim 8 or 9, a controller of the system being connected to the child care function switch unit.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210742570.2A CN117341623A (en) | 2022-06-28 | 2022-06-28 | Vehicle control method, vehicle control system and vehicle |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210742570.2A CN117341623A (en) | 2022-06-28 | 2022-06-28 | Vehicle control method, vehicle control system and vehicle |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117341623A true CN117341623A (en) | 2024-01-05 |
Family
ID=89363681
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210742570.2A Pending CN117341623A (en) | 2022-06-28 | 2022-06-28 | Vehicle control method, vehicle control system and vehicle |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117341623A (en) |
-
2022
- 2022-06-28 CN CN202210742570.2A patent/CN117341623A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20160049061A1 (en) | Integrated vehicle sensing and warning system | |
| CN106564461A (en) | Intelligent control system with intra-vehicle person or pet safety and method of intelligent control system | |
| JP2002063668A (en) | Device for detecting and reporting person inside vehicle and dangerous state avoiding device | |
| CN202491773U (en) | Car interior rear view mirror and car interior human body safety alarm system | |
| CN112061026A (en) | Vehicle-mounted early warning method, vehicle-mounted intelligent monitoring equipment and storage medium | |
| AU2016236831A1 (en) | Vehicle safety system and method | |
| CN110154757A (en) | The multi-faceted safe driving support method of bus | |
| CN112319419B (en) | Intelligent driving control method and system | |
| CN111086370A (en) | Implementation method of in-car system for preventing children from being locked independently for car with Tbox | |
| CN108263323A (en) | A kind of automotive electronics security system | |
| WO2020066757A1 (en) | Dangerous driving prevention device | |
| CN112937437A (en) | Vehicle grading alarm method and alarm system | |
| CN105427530A (en) | Intelligent safety alarm device in car and alarm method thereof | |
| CN102582522A (en) | Automobile interior rearview mirror and automobile interior personal safety alarm system | |
| CN113593184B (en) | Method for restraining fatigue driving and related device | |
| JP2023182752A (en) | System, and program or the like | |
| CN107933461A (en) | In-car identification fusing device and method based on single camera | |
| CN117341623A (en) | Vehicle control method, vehicle control system and vehicle | |
| CN112712043A (en) | Intelligent cabin image processing system | |
| CN114103861B (en) | Vehicle alarm method, device, vehicle-mounted equipment and storage medium | |
| Raja et al. | Alcohol Detection and Emergency Alert System using IoT | |
| CN208085584U (en) | A kind of vehicle CAN FD bus monitoring equipments based on RS232 communications | |
| CN217213898U (en) | Binocular vision-based monitoring and alarm system for preventing children from leaving behind | |
| CN216761684U (en) | Vehicle-mounted protection system and vehicle | |
| CN116461454A (en) | Child riding management and control method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |