CN117183890A

CN117183890A - Vehicle safety control method and vehicle controller

Info

Publication number: CN117183890A
Application number: CN202311170946.8A
Authority: CN
Inventors: 朱智; 高发华; 刘长伟; 高洁; 白彦梅; 方伟杰; 杨方飞
Original assignee: Chery New Energy Automobile Co Ltd
Current assignee: Chery New Energy Automobile Co Ltd
Priority date: 2023-09-11
Filing date: 2023-09-11
Publication date: 2023-12-08

Abstract

The invention discloses a vehicle safety control method and a vehicle controller, wherein the vehicle controller is connected with a user terminal, and the method comprises the following steps: acquiring key gear information, passenger state information and vehicle door state information of a current vehicle in real time; if the key gear is monitored to be switched to OFF or ACC, continuously monitoring the passenger state information and the vehicle door state information of the driving position, and if the passenger state of the driving position is monitored to be switched from manned to unmanned and the vehicle door of the driving position is opened, executing safety control: continuously monitoring the passenger state information of the main driving position, and performing fortification control in response to a fortification control instruction sent by the key; if the arming control instruction sent by the key is not received within a period of time and the passenger state of the driving position is not monitored, the unmanned state is changed into the occupied state, and automatic arming control is performed. The invention can prompt and defend the safety condition of the vehicle in time, and can discover and intervene in time when living things such as babies or animals are left in the vehicle.

Description

Vehicle safety control method and vehicle controller

Technical Field

The invention belongs to the technical field of new energy automobiles, and particularly relates to a vehicle safety control method and a vehicle control unit.

Background

The statements in this section merely provide background information related to the present disclosure and may not necessarily constitute prior art.

The intelligent and networking can assist the car owners to better drive the vehicles and early warn in advance in many times. In the daily use process, the situation that the car door is not closed or the car is not protected after the car owner stops the car often occurs, and if the car is parked in public places, the risk of theft exists. Some owners also have been provided with protection to the vehicle, but to drop the infant or pet in the vehicle, resulting in the infant or pet being in a dangerous environment, especially outdoor high temperature weather.

In addition, owners sometimes get off temporarily for only a short period of time, pick up items nearby, or purchase items at a walk-up shop, in which case some owners may not be armed. However, the prediction of the time length of the car owner for getting off is sometimes inaccurate, and the car owner may become uncontrollable due to queuing payment or other things, and the car distance at the moment may exceed the distance for remote fortification by the key, so that the car owner falls into embarrassing situation. Also, in this case, if an infant or pet is left in the vehicle, the vehicle interior environment becomes gradually uncomfortable in the case where the doors and windows are closed, and it is difficult for the vehicle owner to find and cope with in time.

Disclosure of Invention

In order to overcome the defects in the prior art, the invention provides the vehicle safety control method and the whole vehicle controller, which can timely remind and timely defend the safety condition of the vehicle, timely discover and intervene when living things such as babies or animals remain in the vehicle, and realize multi-angle safety control.

To achieve the above object, one or more embodiments of the present invention provide the following technical solutions:

the vehicle safety control method is applied to a whole vehicle controller, and the whole vehicle controller is connected with a user terminal, and comprises the following steps:

acquiring key gear information, passenger state information and vehicle door state information of a current vehicle in real time;

if the key gear is monitored to be switched to OFF or ACC, continuously monitoring the passenger state information and the vehicle door state information of the driving position, and if the passenger state of the driving position is monitored to be switched from manned to unmanned and the vehicle door of the driving position is opened, executing safety control:

continuously monitoring the passenger state information of the main driving position, and performing fortification control in response to a fortification control instruction sent by the key; if the arming control instruction sent by the key is not received within a period of time and the passenger state of the driving position is not monitored, the unmanned state is changed into the occupied state, and automatic arming control is performed.

In some embodiments, the arming control in response to the arming control command sent by the key comprises:

acquiring image information in a vehicle, and judging whether a living object remains on the vehicle;

if the vehicle body controller does not exist, a fortification control instruction is sent to the vehicle body controller, a fortification control feedback message of the vehicle body controller is received, and the feedback message is fortification or the vehicle door is not closed; if the feedback information is that the vehicle door is not closed, a reminding message is sent to the user terminal;

if the environment-friendly type intelligent vehicle is in existence, a reminding message of the existence of the living things on the vehicle is sent to the user terminal, and meanwhile, the environment in the vehicle is monitored in real time based on the environment sensing device in the vehicle, and whether a comfort condition is met is judged; when the environment in the vehicle does not meet the comfort condition, an environment control request is also sent to the user terminal; and responding to the environment control instruction fed back by the user terminal to perform environment adjustment.

In some embodiments, if the arming control instruction sent by the key is not received within a period of time, and the state of the passenger in the driving position is not monitored, the state is changed from unmanned state to occupied state, the position information of the user terminal of the driver is also obtained, and the parking position of the vehicle is combined, so that whether the driver can return to the vehicle within a short time is predicted, and automatic arming control is performed.

In some embodiments, the automatic arming control comprises:

if the vehicle door state detection command does not exist, sending a vehicle door state detection command to a vehicle body controller, and receiving feedback information; if the vehicle door is not closed, a reminding message that the vehicle door is not closed is sent to the user terminal; if the vehicle door is closed, whether to fortify is requested to the user terminal, and fortification is performed in response to a control instruction fed back by the user terminal;

if the environment-friendly type automobile is in existence, a prompting message of whether the automobile has a living object and whether the automobile is subjected to fortification or not is sent to the user terminal, and meanwhile, the environment in the automobile is monitored in real time based on the environment sensing device in the automobile, and whether a comfort condition is met or not is judged; when the environment in the vehicle does not meet the comfort condition, an environment control request is also sent to the user terminal; and responding to the environment control instruction fed back by the user terminal to perform environment adjustment.

In some embodiments, obtaining the in-vehicle image information, determining whether there is a living being left on the vehicle includes:

acquiring temperature distribution in the vehicle based on an infrared device, and when an area with the temperature within a preset temperature interval exists, acquiring position information of the area, and controlling a camera to shoot a visible light image aiming at the area; and carrying out target identification on the visible light image, comparing the visible light image with a pre-stored target image, and if the similarity reaches a preset threshold value, considering that a living object exists.

In some embodiments, an in-vehicle sound signal is also obtained, and if there is an area with a temperature within a preset temperature interval, but no target is detected based on the visible light image, the sound signal is compared with a pre-stored target audio, and if the similarity reaches a preset threshold, the living matter is considered to exist.

One or more embodiments provide a vehicle safety control system, including a vehicle controller, a vehicle body controller and a seat pressure sensor connected to the vehicle controller, wherein the vehicle controller obtains door state information from the vehicle body controller, obtains occupant state information from the seat pressure sensor, and is configured to execute the vehicle safety control method.

In some embodiments, the system further includes an interaction module connected to the vehicle controller, for acquiring an in-vehicle sound signal.

In some embodiments, the system further comprises an image acquisition device connected with the vehicle controller, wherein the image acquisition device comprises an infrared device and a camera.

The one or more of the above technical solutions have the following beneficial effects:

the driver getting-off condition can be judged more accurately through the key gear, the driver state and the vehicle door state with multiple data sources, and besides the condition of being fortified based on the instruction sent by the key, the automatic fortification control is carried out on the condition that the passenger is not getting on the car for a period of time, so that the situation that the car owner forgets fortification or the car cannot get back in a short time in the future can be dealt with.

In addition, in-car living things identification is added in an automatic fortification control strategy, when living things exist in a car, a car owner forgets the living things in the car, or the car owner can timely know the reminding of the in-car environment under the condition that the car owner can not return in a short time, and when the environment is uncomfortable, the car owner can remotely intervene.

Drawings

The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the invention.

FIG. 1 is a diagram of a vehicle safety management system architecture in accordance with one or more embodiments of the present invention;

FIG. 2 is a flow chart of a vehicle safety control method in accordance with one or more embodiments of the present invention;

FIG. 3 is a schematic flow diagram of security control in response to security control commands sent by a key in one or more embodiments of the invention;

FIG. 4 is a flowchart of an automatic arming control process in one or more embodiments of the present invention, wherein the arming control command sent by the key is not received for a period of time, and the sitting condition of the occupant is not monitored.

Detailed Description

It should be noted that the following detailed description is exemplary and is intended to provide further explanation of the invention. Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.

It is noted that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of exemplary embodiments according to the present invention. As used herein, the singular is also intended to include the plural unless the context clearly indicates otherwise, and furthermore, it is to be understood that the terms "comprises" and/or "comprising" when used in this specification are taken to specify the presence of stated features, steps, operations, devices, components, and/or combinations thereof.

Embodiments of the invention and features of the embodiments may be combined with each other without conflict.

In order to realize omnibearing safety control on a vehicle, the embodiment provides a vehicle safety control system which can timely remind and timely fortify the safety condition of the vehicle and timely discover and intervene when living things such as infants or animals are left in the vehicle. As shown in fig. 1, the system comprises a Vehicle Controller (VCU), and an interaction module, a Body Controller (BCM), an in-vehicle environment sensing device and an image acquisition device which are connected with the vehicle controller, wherein the body controller is also connected with a seat pressure sensor, a vehicle door detection device and an environment control device.

The interactive module comprises an in-vehicle infotainment system (IHU) for receiving various operation requests of a user and feeding back data. The user may input the operation request via a touch screen input or a voice input device. For example, the whole vehicle controller integrates a living matter detection function, and a user can turn on or off the living matter detection function through the interaction module. In addition, the content to be reminded can be selected in a self-defined manner, for example: a. the car owner forgets to set up the defence or forgets to close the car door to remind; b. reminding when the living things are identified to be locked in the vehicle; c. when the environment in the vehicle is dangerous, reminding is carried out (such as the concentration of harmful gas in the vehicle is too high, the ambient temperature is abnormal, etc.).

The in-vehicle environment sensing device comprises a temperature sensor, an air quality sensor, a gas sensor and the like.

The environment control device is mainly an air conditioner controller.

The image acquisition device comprises an infrared device and a camera. The infrared device is used for acquiring temperature distribution in the vehicle, and the camera is used for acquiring visible light images. The camera can be a panoramic camera and is arranged in the middle of the vehicle roof, so that the whole coverage of the position in the vehicle is realized.

The vehicle controller may be further connected to a user terminal, for example, through wireless connection, but because of distance limitation when the vehicle and the user terminal are directly connected wirelessly, the vehicle controller may also establish association between the vehicle and the user terminal through a server based on an internet of things system, the user terminal registers vehicle identification information, user terminal identification information, driver information, and the like in advance to the server, and the server stores these information in association. The user terminal can generate a remote control instruction to the whole vehicle controller through the server, and the whole vehicle controller can also send information to the user terminal through the server. The user terminal may be a mobile phone, a tablet, etc., without limitation again. Through the user terminal, a user can remotely operate the vehicle, including but not limited to: (1) Remote control starts fortification, specifically, a fortification instruction is issued to a body controller of a vehicle through a T-box; (2) The remote control is powered down and is armed, specifically, a power-down instruction is issued to a keyless entry system (PEPS) through a T-box, the PEPS issues the power-down instruction to a whole vehicle controller after receiving the power-down instruction, and then the high-voltage relay is controlled to be disconnected, and each controller is controlled by the PEPS to sleep, and the arming instruction is issued to a vehicle body controller; (3) And the vehicle body controller requests the air conditioner controller to start the air conditioner, and the air conditioner controller controls the air conditioner to start.

As shown in fig. 2, the whole vehicle controller is configured to: key gear information of a current vehicle is obtained in real time, passenger state information is obtained from a driver seat pressure sensor, and main driver seat door state information is obtained from a vehicle body controller. As a specific implementation manner, the vehicle body controller sends a command for acquiring a seat pressure sensor signal or a vehicle door sensor to the vehicle body controller, and responds to the command, the vehicle body controller acquires a signal and feeds back the signal to the vehicle body controller through a Controller Area Network (CAN). If the key gear is detected to be changed to OFF or ACC, the passenger state information and the main driver position door state information are continuously monitored, and if the door opening signal and the driver position are detected to be changed from someone to no person, the driver is considered to get OFF the vehicle, and safety control is executed for vehicle fortification and whether living things remain in the vehicle. It will be appreciated that the set time may be set to 30s, or other times, without limitation. Whether the driver gets off the vehicle or not is judged by integrating the key gear, whether a person exists in the main driver seat and whether the door is opened or not, and the accuracy is higher.

In some embodiments, the whole vehicle controller performs safety control for vehicle fortification specifically includes: continuously monitoring the passenger state information of the main driving position, and performing fortification control in response to a fortification control instruction sent by the key; if the arming control instruction sent by the key is not received within a period of time and the sitting of the passenger is not monitored, automatic arming control is performed.

As shown in fig. 3, in order to avoid the hidden danger caused by the door not being closed or the remaining living things in the car, the following steps are further executed for the case of performing the security control in response to the security control command sent by the key:

step 1-1: and judging whether the vehicle has a left living thing or not based on the infrared device and the camera in the vehicle, if not, executing the step 1-2, and if so, executing the step 1-3.

Step 1-2: sending a fortification control instruction to a vehicle body controller, and receiving a fortification control feedback message of the vehicle body controller; when the vehicle body controller performs fortification control, whether the vehicle door is closed or not is firstly detected, if not, feedback is sent to the whole vehicle controller, and the whole vehicle controller sends a reminding message that the vehicle door is not closed to the user terminal and/or controls the vehicle lamp to flash. It can be appreciated that if the key is in the gear ACC at this time, the power is also turned off before the fortification is turned on.

Step 1-3: sending a reminding message of the existence of the living things on the vehicle to the user terminal, and simultaneously monitoring the environment in the vehicle in real time based on the environment sensing device in the vehicle to judge whether the comfort condition is met; when the environment in the vehicle does not meet the comfort condition, for example, the concentration of harmful gas is detected to be abnormal through an air filtering sensor, or the temperature in the vehicle is abnormal, an air conditioner or air circulation control request is sent to a user terminal; and receiving a control instruction fed back by the user terminal, and controlling the air conditioner or the air circulation device.

The control method can remind the user in time, and if the user cannot see that the message is far away from the vehicle in time, the environment in the vehicle can be regulated, so that infants or animals are prevented from being in dangerous environments such as high temperature or hypoxia for a long time.

As shown in fig. 3, for a situation that a fortification control command sent by a key is not received for a period of time and sitting of an occupant is not monitored, as a specific implementation manner, if sitting of an occupant is not monitored for a period of time, position information of a user terminal of a driver is also obtained, and in combination with the vehicle parking position, whether the driver can return to the vehicle in a short time is predicted, and if not, subsequent fortification control is executed.

By combining the departure time, the departure distance and the environment of the driver, the intention of the driver can be accurately predicted, for example, the driver leaves the vehicle and takes something in time sometimes and can sit again in a short time, if the driver does not sit again for a certain time, the driver can leave the vehicle far, go back temporarily, or purchase articles in an adjacent store, and the predicted time is exceeded due to queuing or other reasons, and the situation preferably needs to be defmed for the vehicle to improve the safety. If the driver leaves for a longer time and is farther away, it can be inferred that the driver has forgotten to be armed by the key.

In some embodiments, whether the vehicle can be returned in a short time is determined according to the distance between the user terminal and the current vehicle, wherein the distance can be Euclidean distance between two points, and the actual distance between the two points can be calculated by means of a navigation system. In other embodiments, in addition to the distance between the user terminal and the current vehicle, the scene information of the user terminal is combined, where the scene information can be determined according to the navigation system, and if the position of the user terminal is a shop, the prediction is performed according to the type of the shop and the current time period, so as to predict whether the driver can return to the vehicle in a short time. Generally, if the traffic of shops such as supermarkets and catering is high at the late peak of the working day, the possibility of queuing is also high.

The automatic fortification control comprises the following steps:

step 2-1: judging whether a living object is left on the vehicle or not based on the infrared device and the camera in the vehicle; if not, executing the step 2-2, and if so, executing the step 2-3.

Step 2-2: and sending a door state detection instruction to the vehicle body controller, feeding back to the whole vehicle controller if the door is not closed, sending a warning message of the door being not closed to the user terminal by the whole vehicle controller, requesting whether to fortify the door if the door is closed, receiving a control instruction fed back by the user terminal, and fortifying the door. In some embodiments, if the user does not feedback the instruction within the set time, the arming is automatically performed. It can be appreciated that if the key is in the gear ACC at this time, the power is also turned off before the fortification is turned on.

Step 2-3: the method comprises the steps of sending a reminding message of whether a living object exists on the vehicle and whether the fortification is carried out or not to a user terminal, and simultaneously, monitoring the environment in the vehicle in real time based on an environment sensing device in the vehicle to judge whether a comfort condition is met or not; when the environment in the vehicle does not meet the comfort condition, sending an air conditioner or air circulation control request to the user terminal; and receiving a control instruction fed back by the user terminal, wherein the control instruction comprises a fortification control instruction and/or an environment control instruction which are respectively used for controlling the fortification of the vehicle and controlling the air conditioner or the air circulation device.

The situation corresponds to the situation that the driver temporarily leaves the vehicle but cannot return in a short time, or the driver forgets the infant or the animal in the vehicle, and the environment in the vehicle can be regulated by the driver under the condition that the driver cannot quickly return through monitoring and remote control of the environment in the vehicle, so that the infant or the animal is prevented from being in dangerous environments such as high temperature or hypoxia for a long time.

Judging whether a living object is left on the vehicle or not based on the infrared device and the camera in the vehicle in the steps 1-1 and 2-1, as a specific implementation manner, pre-storing a target image, such as a baby or pet photo, continuously monitoring the temperature distribution in the vehicle based on the infrared device, acquiring the position information of the region when the region with the temperature within a preset temperature interval exists, and controlling the camera to shoot an image aiming at the region; after the image is acquired, comparing is carried out on the image with a pre-stored target image based on a target recognition algorithm, and the comparison similarity reaches a set threshold value, so that living things are considered to exist.

Of course, due to the arrangement of the seats in the car, even if the panoramic camera, there is still a dead angle when shooting, for example, the ground area between the front and rear rows of seats, which is enough to accommodate a pet of smaller size, and in addition, the shooting effect of the camera is also affected by light, so, in order to avoid the situation that the recognition is inaccurate, as another specific implementation manner, the target audio, for example, the sound of the infant or the pet is stored in advance, the sound in the car is obtained based on the interaction module, and when the area of the existence temperature within the preset temperature interval is detected based on the infrared device, and the sound similar to the target audio exists in the car, the living things are considered to exist in the car. The two modes can be complemented with each other.

It will be appreciated by those skilled in the art that the above-described manner of acquiring an image, the manner of acquiring the state of an occupant, and the like are not limited to the above-described manner, as long as the corresponding functions can be realized, and are not limited herein.

Based on the safety control system, one or more embodiments of the present invention further provide a vehicle safety control method applied to a vehicle controller, which specifically includes the following steps: acquiring key gear information, passenger state information and vehicle door state information of a current vehicle in real time; if the key gear is monitored to be switched to OFF or ACC, continuously monitoring the passenger state information and the vehicle door state information of the driving position, and if the passenger state of the driving position is monitored to be switched from manned to unmanned and the vehicle door of the driving position is opened, executing safety control: continuously monitoring the passenger state information of the main driving position, and performing fortification control in response to a fortification control instruction sent by the key; if the arming control instruction sent by the key is not received within a period of time and the passenger state of the driving position is not monitored, the unmanned state is changed into the occupied state, and automatic arming control is performed.

In some embodiments, for a case where a user performs fortification based on a key, performing fortification control in response to a fortification control instruction sent by the key includes:

And if the user only temporarily leaves the vehicle and is ready to come back immediately, if the fortification control instruction sent by the key is not received within a period of time, the state of the passenger in the driving position is not monitored to be changed from unmanned to occupied, the position information of the user terminal of the driver is also acquired, and the parking position of the vehicle is combined to predict whether the driver can return to the vehicle within a short time so as to perform automatic fortification control. For such a case, the automatic arming control includes:

As a specific implementation manner, acquiring image information in a vehicle, and judging whether a living object remains on the vehicle includes:

In order to solve the problem of poor recognition effect of the visible light image caused by shielding or insufficient light, as a complementary technical scheme, an in-car sound signal is also obtained, if a region with the temperature within a preset temperature interval exists, but a target is not detected based on the visible light image, the sound signal is compared with a pre-stored target audio, and if the similarity reaches a preset threshold, living things are considered to exist.

While the foregoing description of the embodiments of the present invention has been presented in conjunction with the drawings, it should be understood that it is not intended to limit the scope of the invention, but rather, it is intended to cover all modifications or variations within the scope of the invention as defined by the claims of the present invention.

Claims

1. The vehicle safety control method is applied to a whole vehicle controller, and the whole vehicle controller is connected with a user terminal, and is characterized by comprising the following steps of:

2. The vehicle security management method according to claim 1, wherein performing the arming control in response to the arming control instruction transmitted by the key comprises:

3. The vehicle safety control method according to claim 1, wherein if a fortification control command sent by a key is not received within a period of time, and the passenger state of the driving position is not monitored to be changed from unmanned to occupied, position information of a user terminal of the driver is also obtained, and in combination with the vehicle parking position, whether the driver can return to the vehicle within a short period of time is predicted, and automatic fortification control is performed.

4. A vehicle safety control method according to claim 3, wherein the automatic arming control includes:

5. The vehicle safety control method according to claim 2 or 4, wherein acquiring the image information in the vehicle, determining whether there is a living thing left on the vehicle includes:

6. The method of claim 5, further comprising obtaining an in-vehicle sound signal, comparing the sound signal with a pre-stored target audio if there is a region with a temperature within a predetermined temperature range but no target is detected based on a visible light image, and considering that a living being is present if the similarity reaches a predetermined threshold.

7. A vehicle safety control system, characterized by comprising a vehicle controller, a vehicle body controller and a seat pressure sensor, wherein the vehicle body controller is connected with the vehicle controller, the vehicle controller obtains door state information from the vehicle body controller, and obtains occupant state information from the seat pressure sensor, and is configured to execute the vehicle safety control method according to any one of claims 1 to 6.

8. The vehicle safety management and control system of claim 7, further comprising an interaction module coupled to the vehicle controller for acquiring an in-vehicle acoustic signal.

9. The vehicle safety management and control system of claim 7, further comprising an image acquisition device coupled to the vehicle controller, the image acquisition device comprising an infrared device and a camera.