CN113487830A - Vehicle safety early warning method, device, storage medium and device - Google Patents

Vehicle safety early warning method, device, storage medium and device Download PDF

Info

Publication number
CN113487830A
CN113487830A CN202110715550.1A CN202110715550A CN113487830A CN 113487830 A CN113487830 A CN 113487830A CN 202110715550 A CN202110715550 A CN 202110715550A CN 113487830 A CN113487830 A CN 113487830A
Authority
CN
China
Prior art keywords
vehicle
preset
information
passenger
safety device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110715550.1A
Other languages
Chinese (zh)
Inventor
石登仁
李云
胡锡挺
张霖
杨甄鑫
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Dongfeng Liuzhou Motor Co Ltd
Original Assignee
Dongfeng Liuzhou Motor Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dongfeng Liuzhou Motor Co Ltd filed Critical Dongfeng Liuzhou Motor Co Ltd
Priority to CN202110715550.1A priority Critical patent/CN113487830A/en
Publication of CN113487830A publication Critical patent/CN113487830A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02Alarms for ensuring the safety of persons
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/18Status alarms
    • G08B21/24Reminder alarms, e.g. anti-loss alarms

Landscapes

  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Emergency Alarm Devices (AREA)

Abstract

The invention discloses a vehicle safety early warning method, equipment, a storage medium and a device, which are characterized in that an object image in monitoring information of a target vehicle and a passenger image in the monitoring information are subjected to feature extraction through a preset image recognition model to obtain object position information and passenger sitting posture information, and whether the operation condition of a safety device meets the preset condition or not is determined according to safety device information, object position information and passenger sitting posture information corresponding to an in-vehicle restraint system; and when the operation condition of the safety device does not meet the preset condition, giving an alarm to the passenger. Compared with the prior art that the safety device does not meet the specific standard, the safety device has lower effect and poor protection performance on passengers, improves the safety of the safety device during operation and better protects the passengers.

Description

Vehicle safety early warning method, device, storage medium and device
Technical Field
The invention relates to the field of vehicle safety, in particular to a vehicle safety early warning method, vehicle safety early warning equipment, a storage medium and a vehicle safety early warning device.
Background
At present, with the development of automobile technology, more and more people use vehicles, however, with the increase of vehicles, the number of safety accidents is also increased, so that each large automobile factory pays more and more attention to the safety of the vehicles. However, since the effect of the safety device installed in the vehicle is often limited by various conditions, the effect of the safety device is low when the safety device does not satisfy a specific standard, and thus the safety device has poor protection for the occupant.
The above is only for the purpose of assisting understanding of the technical aspects of the present invention, and does not represent an admission that the above is prior art.
Disclosure of Invention
The invention mainly aims to provide a vehicle safety early warning method, vehicle safety early warning equipment, a vehicle safety early warning storage medium and a vehicle safety early warning device, and aims to solve the technical problem that in the prior art, under the condition that a safety device does not meet a specific standard, the effect of the safety device is low, and accordingly the protection performance of the safety device on passengers is poor.
In order to achieve the above object, the present invention provides a vehicle safety warning method, which comprises the following steps:
acquiring monitoring information of a target vehicle, current vehicle speed and safety device information corresponding to an in-vehicle restraint system;
when the current vehicle speed is greater than a preset vehicle speed, performing feature extraction on the object image in the monitoring information according to a preset image recognition model to obtain object position information corresponding to the object in the vehicle;
performing feature extraction on the passenger image in the monitoring information according to the preset image recognition model to obtain passenger sitting posture information;
determining whether a safety device operating condition of the target vehicle meets a preset condition according to the safety device information, the article position information and the passenger sitting posture information;
and when the operation condition of the safety device does not meet the preset condition, giving an alarm to the passenger.
Preferably, when the current vehicle speed is greater than a preset vehicle speed, the step of performing feature extraction on the article image in the monitoring information according to a preset image recognition model to obtain article position information corresponding to an article in the vehicle includes:
when the current vehicle speed is greater than a preset vehicle speed, segmenting an article image in the monitoring information according to a preset image recognition model to obtain sub-image information;
extracting the characteristics of the subimage information to obtain the relative positions of the in-vehicle articles and the in-vehicle camera;
and determining the position information of the articles in the vehicle under the whole vehicle coordinate corresponding to the target vehicle according to the relative position so as to obtain the article position information corresponding to the articles in the vehicle.
Preferably, the step of performing feature extraction on the image of the passenger in the monitoring information according to the preset image recognition model to obtain the sitting posture information of the passenger includes:
performing feature extraction on the passenger image in the monitoring information according to the preset image recognition model to obtain a passenger type and a passenger feature point set;
extracting a target sitting posture feature set from a preset sitting posture feature library according to the passenger type and the passenger feature point set;
and determining occupant sitting posture information according to the target sitting posture feature set.
Preferably, the step of determining whether the safety device operating condition of the target vehicle satisfies a preset condition according to the safety device information, the article position information, and the occupant sitting posture information includes:
judging whether the coordinates of the articles in the vehicle are in a preset safe area or not according to the article position information and the safety device information;
and when the articles in the vehicle are in a preset safety region, determining whether the operation condition of the safety device of the target vehicle meets a preset condition or not according to the passenger sitting posture information.
Preferably, the step of determining whether the safety device operating condition of the target vehicle satisfies a preset condition according to the occupant sitting posture information when the in-vehicle article is in a preset safety zone includes:
when the articles in the vehicle are in a preset safe area, the sitting posture information of the passengers is matched according to a preset safe sitting posture state, and a sitting posture matching result is obtained;
and determining whether the operation condition of the safety device of the target vehicle meets a preset condition or not according to the sitting posture matching result.
Preferably, the step of alerting the occupant when the safety device operation condition does not satisfy a preset condition includes:
when the operation condition of the safety device does not meet a preset condition, determining a sitting posture to be adjusted according to the sitting posture matching result;
and generating early warning information according to the sitting posture to be adjusted, and giving an alarm to passengers according to the early warning information.
Preferably, after the step of alerting the occupant when the safety device operation condition does not satisfy the preset condition, the method further comprises:
when the current vehicle speed is greater than a preset safe vehicle speed, judging whether the operation hazard degree of the safety device is greater than a preset hazard degree or not according to the article position information and the passenger sitting posture information;
and when the operation hazard degree is greater than the preset hazard degree, controlling the safety device to stop operating.
In addition, in order to achieve the above object, the present invention further provides a vehicle safety precaution device, which includes a memory, a processor, and a vehicle safety precaution program stored in the memory and operable on the processor, wherein the vehicle safety precaution program is configured to implement the steps of vehicle safety precaution as described above.
In addition, to achieve the above object, the present invention further provides a storage medium having a vehicle safety warning program stored thereon, where the vehicle safety warning program implements the steps of the vehicle safety warning method as described above when executed by a processor.
In addition, in order to achieve the above object, the present invention further provides a vehicle safety warning device, including:
the information acquisition module is used for acquiring monitoring information of a target vehicle, the current speed and safety device information corresponding to an in-vehicle restraint system;
the characteristic extraction module is used for extracting the characteristics of the object images in the monitoring information according to a preset image recognition model when the current vehicle speed in the vehicle speed information is greater than a preset vehicle speed, and acquiring the position information of the object corresponding to the object in the vehicle;
the feature extraction module is further configured to perform feature extraction on the passenger image in the monitoring information according to the preset image recognition model to obtain passenger sitting posture information;
the condition judgment module is used for determining whether the safety device operation condition of the target vehicle meets a preset condition or not according to the safety device information, the article position information and the passenger sitting posture information;
and the safety early warning module is used for giving an alarm to the passenger when the operation condition of the safety device does not meet the preset condition.
The method comprises the steps of acquiring monitoring information of a target vehicle, the current vehicle speed and safety device information corresponding to an in-vehicle restraint system; when the current vehicle speed is greater than the preset vehicle speed, performing feature extraction on the object image in the monitoring information according to a preset image recognition model to obtain object position information corresponding to the object in the vehicle; extracting characteristics of passenger images in the monitoring information according to a preset image recognition model to obtain passenger sitting posture information; determining whether the safety device operation condition of the target vehicle meets a preset condition or not according to the safety device information, the article position information and the passenger sitting posture information; and when the operation condition of the safety device does not meet the preset condition, giving an alarm to the passenger. Compared with the prior art that the safety device does not meet the specific standard, the safety device has lower action effect, so that the safety device has poor protection on the passengers, improves the safety of the safety device during operation, and realizes better protection on the passengers.
Drawings
FIG. 1 is a schematic structural diagram of a vehicle safety precaution device in a hardware operating environment according to an embodiment of the invention;
FIG. 2 is a schematic flow chart illustrating a first embodiment of a vehicle safety warning method according to the present invention;
FIG. 3 is a flowchart illustrating a second embodiment of a vehicle safety warning method according to the present invention;
FIG. 4 is a flowchart illustrating a vehicle safety warning method according to a third embodiment of the present invention;
fig. 5 is a block diagram illustrating a first embodiment of the vehicle safety warning apparatus according to the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Referring to fig. 1, fig. 1 is a schematic structural diagram of a vehicle safety precaution device in a hardware operating environment according to an embodiment of the present invention.
As shown in fig. 1, the vehicle safety warning apparatus may include: a processor 1001, such as a Central Processing Unit (CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display), and the optional user interface 1003 may further include a standard wired interface and a wireless interface, and the wired interface for the user interface 1003 may be a USB interface in the present invention. The network interface 1004 may optionally include a standard wired interface, a Wireless interface (e.g., a Wireless-Fidelity (Wi-Fi) interface). The Memory 1005 may be a Random Access Memory (RAM) or a Non-volatile Memory (NVM), such as a disk Memory. The memory 1005 may alternatively be a storage device separate from the processor 1001.
Those skilled in the art will appreciate that the configuration shown in fig. 1 does not constitute a limitation of the vehicle safety precaution device, and may include more or fewer components than shown, or some components in combination, or a different arrangement of components.
As shown in fig. 1, a memory 1005, identified as one type of computer storage medium, may include an operating system, a network communication module, a user interface module, and a vehicle safety warning program.
In the vehicle safety early warning device shown in fig. 1, the network interface 1004 is mainly used for connecting with a background server and performing data communication with the background server; the user interface 1003 is mainly used for connecting user equipment; the vehicle safety early warning device calls a vehicle safety early warning program stored in the memory 1005 through the processor 1001 and executes the vehicle safety early warning method provided by the embodiment of the invention.
Based on the hardware structure, the embodiment of the vehicle safety early warning method is provided.
Referring to fig. 2, fig. 2 is a schematic flow chart of a first embodiment of the vehicle safety early warning method, and provides the first embodiment of the vehicle safety early warning method.
In this embodiment, the vehicle safety warning method includes the following steps:
step S10: and acquiring monitoring information of the target vehicle, the current vehicle speed and safety device information corresponding to the in-vehicle restraint system.
It should be noted that, the execution subject in this embodiment may be a device including a vehicle safety warning system, such as: the vehicle-mounted computer may also be other devices capable of implementing the same or similar functions, which is not limited in this embodiment, and the vehicle safety warning method of the present invention is described in this embodiment and the following embodiments by taking a vehicle safety warning system as an example.
It should be understood that the target vehicle may refer to a vehicle equipped with a vehicle safety warning system, and the target vehicle may be a vehicle that is traveling. The monitoring information may refer to audio image information acquired by a vehicle-mounted camera on a target vehicle, the vehicle-mounted camera may refer to an in-vehicle monitoring camera arranged on a roof of the vehicle, the number of the cameras is at least one, the embodiment does not limit the number of the vehicle-mounted cameras, the vehicle-mounted camera may be arranged in the center of the roof or in front of or behind the roof, and the camera may be used for monitoring and recording objects, persons, and postures and actions of the persons in the vehicle at any time.
It is understood that the current vehicle speed may refer to a vehicle speed of the target vehicle during driving, and the in-vehicle restraint system may refer to an automobile safety restraint system formed by components such as an in-vehicle seat, a headrest, a safety belt, an airbag and the like. The safety device information may include position information and operational information corresponding to components of the restraint system.
In the specific implementation, the vehicle safety early warning system can acquire monitoring information of a target vehicle through the vehicle-mounted camera, extract the current vehicle speed from the vehicle speed sensor, and extract position information and operation information corresponding to each safety device according to the in-vehicle constraint system.
Step S20: and when the current vehicle speed is greater than the preset vehicle speed, performing feature extraction on the object image in the monitoring information according to a preset image recognition model to obtain object position information corresponding to the object in the vehicle.
It should be noted that the preset vehicle speed may be a minimum vehicle speed preset to enable the safety precaution system. The preset vehicle speed may be the lowest vehicle speed that is best matched as determined by a restraint system collision test performed on a target vehicle model during vehicle development. The preset image recognition model may be a preset model for image recognition, which may be a model trained from historical vehicle driving data.
It is understood that the item image may refer to an item on the in-vehicle instrument desk and an item placed in the vehicle, and the item may be a vehicle-configured item or an artificially placed item.
It should be understood that the item location information may refer to location information of an item within the vehicle in full vehicle coordinates.
In the concrete realization, when the current speed of a motor vehicle is zero, article and passenger position of sitting in the car are not monitored, when the current speed of a motor vehicle is less than preset speed of a motor vehicle, carry out the feature extraction according to article image among the preset image recognition model to the monitoring information, obtain the article position information that article correspond in the car, if: when the current vehicle speed is lower than 30km/h, the vehicle-mounted camera does not monitor whether the objects in the vehicle affect the restraint system, namely, whether the objects hinder the normal operation of a safety device in the restraint system is monitored, and when the current vehicle speed is higher than the preset vehicle speed, feature extraction is carried out on the object images in the monitoring information according to a preset image recognition model to obtain the object position information corresponding to the objects in the vehicle. The preset vehicle speed in this embodiment may be a vehicle speed determined according to a data parameter corresponding to a historical collision test, or may be a vehicle speed set manually.
Step S30: and performing feature extraction on the passenger image in the monitoring information according to the preset image recognition model to obtain passenger sitting posture information.
Note that the occupant image may refer to an image corresponding to a passenger in the target vehicle. The occupant images may be classified into a driver, a front occupant (passenger), and a rear occupant.
It is understood that the occupant seating information may refer to seating information corresponding to the occupant. The seating posture information may include occupant movement information and posture information.
It should be understood that the image recognition model may perform image segmentation on the acquired passenger image, divide the passenger image into an image corresponding to the driving position and the passenger position, and perform feature extraction on the person image corresponding to the driving position and the person image corresponding to the passenger position to obtain passenger sitting posture information, where the image segmentation may refer to segmentation of the image information through algorithms such as edge detection, grayscale image segmentation, region detection, color image segmentation, and the like.
In specific implementation, the vehicle safety early warning system can extract the characteristics of passenger images in the monitoring information according to a pre-trained image recognition model to obtain passenger sitting posture information.
Step S40: and determining whether the safety device operation condition of the target vehicle meets a preset condition or not according to the safety device information, the article position information and the passenger sitting posture information.
It should be noted that the safety device operation condition may refer to a safety condition required when the subject vehicle is protecting an occupant by activating a safety device in the restraint system, for example: if the article is in a position that would affect the safety of the occupant when the airbag is popped, the operating conditions of the safety device do not meet the preset conditions.
It will be appreciated that the preset condition may refer to a condition in which the safety device does not affect the safety of the occupant when the occupant is protected by the safety device in the restraint system when the target vehicle is activated.
In specific implementation, the vehicle safety early warning can determine whether the operation condition of the safety device of the target vehicle meets the preset condition according to the safety device information, the article position information and the passenger sitting posture information.
Step S50: and when the operation condition of the safety device does not meet the preset condition, giving an alarm to the passenger.
In the concrete implementation, when recognizing that the operation condition of the safety device does not meet the preset condition, the vehicle safety early warning system can send out prompt tone or alarm to passengers by controlling the modes of steering wheel vibration, sound alarm, in-vehicle lights and the like, so as to remind the personnel in the vehicle.
In the embodiment, monitoring information of a target vehicle, the current speed and safety device information corresponding to an in-vehicle restraint system are obtained; when the current vehicle speed is greater than the preset vehicle speed, performing feature extraction on the object image in the monitoring information according to a preset image recognition model to obtain object position information corresponding to the object in the vehicle; extracting characteristics of passenger images in the monitoring information according to a preset image recognition model to obtain passenger sitting posture information; determining whether the safety device operation condition of the target vehicle meets a preset condition or not according to the safety device information, the article position information and the passenger sitting posture information; and when the operation condition of the safety device does not meet the preset condition, giving an alarm to the passenger. Because this embodiment is through discerning in-car article and passenger position of sitting to judge the influence of in-car article and passenger position of sitting to the safety device operation, this embodiment is for among the prior art under the condition that safety device does not satisfy specific standard, and safety device's effect is lower, thereby leads to safety device poor to passenger's protectiveness, and this embodiment has promoted the security when safety device operates, and realizes better protection to the passenger.
Referring to fig. 3, fig. 3 is a schematic flow chart of a vehicle safety warning method according to a second embodiment of the present invention, and the vehicle safety warning method according to the second embodiment of the present invention is provided based on the first embodiment shown in fig. 2.
In this embodiment, the step S20 includes:
step S201: and when the current vehicle speed is greater than the preset vehicle speed, segmenting the article image in the monitoring information according to a preset image recognition model to obtain sub-image information.
It should be noted that the sub-image information may be obtained by performing image segmentation on the acquired article image according to a preset image recognition model. Image segmentation may refer to segmentation of image information by algorithms such as edge detection, grayscale image segmentation, region detection, and color image segmentation.
Step S202: and performing feature extraction on the subimage information to obtain the relative position of the in-vehicle article and the in-vehicle camera.
It should be noted that feature extraction is performed on an image corresponding to an in-vehicle object in the sub-image information, position information of the in-vehicle object relative to the entire vehicle coordinate system is obtained, and a relative position of the in-vehicle object and the in-vehicle camera is determined according to the position information of the in-vehicle camera relative to the entire vehicle coordinate system.
It can be understood that the detection of the relative position may be performed based on the design coordinates of the vehicle (each model of vehicle determines an absolute coordinate system during design), or may be performed based on a certain point or a certain position on the target vehicle as a reference point, such as: the reference point can be based on the vehicle-mounted camera.
In specific implementation, the vehicle safety early warning system can extract the characteristics of the subimages corresponding to the articles in the vehicle to obtain the relative positions of the articles in the vehicle and the camera in the vehicle.
Step S203: and determining the position information of the articles in the vehicle under the whole vehicle coordinate corresponding to the target vehicle according to the relative position so as to obtain the article position information corresponding to the articles in the vehicle.
It should be noted that, in order to improve the position detection accuracy corresponding to the article in the vehicle, the information such as the specific position of the article in the vehicle coordinate and the relative distance between the article and the vehicle-mounted camera can be obtained by calculating the relative position of the article in the vehicle.
In this embodiment, the step S30 includes:
step S301: and performing feature extraction on the passenger image in the monitoring information according to the preset image recognition model to obtain the passenger type and a passenger feature point set.
The type of the passenger may refer to whether the passenger is a driver and/or a passenger (a front passenger, a rear passenger), a male, a female, an old person, a child, or the like, and the set of passenger feature points may be a set of body part feature points corresponding to the passenger, such as joint feature points of important parts, such as a head, a neck, a chest, and four limbs.
In specific implementation, the vehicle safety early warning system can extract body part feature points of the collected passenger images according to a preset image recognition model so as to obtain passenger types and passenger feature point sets.
Step S302: and extracting a target sitting posture feature set from a preset sitting posture feature library according to the passenger type and the passenger feature point set.
It should be noted that the preset sitting posture feature library may refer to a preset sitting posture feature library, and the sitting posture feature library may include posture features of all types of people.
It can be understood that the target sitting posture feature set can be obtained by matching the feature point set in the passenger image with the posture features in the preset sitting posture feature library and outputting the posture features successfully matched as the target sitting posture feature set.
Step S303: and determining occupant sitting posture information according to the target sitting posture feature set.
In specific implementation, the vehicle safety early warning system can determine the sitting posture corresponding to the passenger according to the posture feature set corresponding to the passenger type and a preset sitting posture feature library.
In the embodiment, monitoring information of a target vehicle, a current vehicle speed and safety device information corresponding to an in-vehicle restraint system are obtained, when the current vehicle speed is greater than a preset vehicle speed, an article image in the monitoring information is segmented according to a preset image recognition model to obtain sub-image information, feature extraction is carried out on the sub-image information to obtain the relative position of the in-vehicle article and an in-vehicle camera, position information of the in-vehicle article under a whole vehicle coordinate corresponding to the target vehicle is determined according to the relative position to obtain article position information corresponding to the in-vehicle article, feature extraction is carried out on a passenger image in the monitoring information according to the preset image recognition model to obtain a passenger type and a passenger feature point set, and a target sitting posture feature set is extracted from a preset sitting posture feature library according to the passenger type and the passenger feature point set; determining passenger sitting posture information according to the target sitting posture feature set, and determining whether the safety device operation condition of the target vehicle meets a preset condition or not according to the safety device information, the article position information and the passenger sitting posture information; and when the operation condition of the safety device does not meet the preset condition, giving an alarm to the passenger. Because this embodiment is through discerning in-car article and passenger position of sitting to judge the influence of in-car article and passenger position of sitting to the safety device operation, this embodiment is for among the prior art under the condition that safety device does not satisfy specific standard, and safety device's effect is lower, thereby leads to safety device poor to passenger's protectiveness, and this embodiment has promoted the security when safety device operates, and realizes better protection to the passenger.
Referring to fig. 4, fig. 4 is a schematic flow chart of a vehicle safety warning method according to a third embodiment of the present invention, and the third embodiment of the vehicle safety warning method is provided based on the first embodiment shown in fig. 2.
In this embodiment, the step S40 includes:
the step S40 includes:
step S401: and judging whether the coordinates of the articles in the vehicle are in a preset safety area or not according to the article position information and the safety device information.
It should be noted that the preset safe region may refer to a region that does not affect the operation of the safety device, the preset safe region may be a region determined by tests on the safety device, collision test data, historical data, and the like, and the preset safe regions corresponding to different vehicle types are different. For example: there are often upholstery on the steering wheel and seat of a vehicle, and in an emergency turn, the steering wheel sheath slips relative to the steering wheel body, resulting in the risk of steering failure, particularly after the steering wheel sheath has aged. The seat cover may also interfere with proper deployment of the seat side airbag. When detecting that other articles are hung on the steering wheel sheath and the vehicle underwear hat hook to influence the unfolding of the seat side air bag, reminding is carried out.
It can be understood that the safety device information includes a safety device operation area and a maximum operation range, and the vehicle safety early warning system can determine whether the in-vehicle article is in a preset safety area according to the position of the in-vehicle article and the safety device operation area.
In a specific implementation, the air bag in the safety device is rapidly inflated to a maximum value within 15 milliseconds (0.015 second) from a small roll or folded shape during the unfolding process; the air bag is generally circular or oval, and the maximum capacity of different vehicles after being unfolded varies from 50 liters to 90 liters. Any obstacle encountered during the deployment of the airbag will affect the deployment shape and time of the airbag, and during the explosive and rapid deployment of the airbag, the obstacle will be ejected out, causing injury to the personnel on the vehicle. After encountering an obstacle, the air bag can be scratched by the obstacle, hung with wires and the like, so that the air bag deflates in advance or is too fast to generate corresponding protection effect. The size of the airbag after deployment and the airbag deployment influence area can be determined and pre-stored in a target vehicle onboard computer in the airbag deployment test of the target vehicle.
Step S402: and when the articles in the vehicle are in a preset safety region, determining whether the operation condition of the safety device of the target vehicle meets a preset condition or not according to the passenger sitting posture information.
In the concrete implementation, when monitoring that the articles in the vehicle are in a preset safe region, the vehicle safety early warning system can not influence the operation of the safety device, and judges whether the sitting posture of the passenger can influence the operation of the safety device or not by recognizing the sitting posture of the passenger.
Further, the step S402 includes: when the articles in the vehicle are in a preset safe area, the sitting posture information of the passengers is matched according to a preset safe sitting posture state, and a sitting posture matching result is obtained; and determining whether the operation condition of the safety device of the target vehicle meets a preset condition or not according to the sitting posture matching result.
It should be noted that the preset safe sitting posture state refers to a preset safe standard sitting posture of the passenger, and the sitting posture matching result may be a result generated after the sitting posture of the passenger is matched with the preset safe standard sitting posture.
It will be appreciated that the predetermined safe standard seating position may be a seating position that best protects the occupant as required by the regulations. The preset safe standard sitting posture may be a sitting posture parameter obtained through a collision test.
In the specific implementation, the vehicle safety early warning system can monitor the articles in the vehicle and judge whether the articles in the vehicle are in a preset safe region, when the articles in the vehicle are in the preset safe region, the vehicle safety early warning system judges whether the sitting posture of the passenger is standard or not by identifying the sitting posture of the passenger, and determines whether the operation condition of a safety device of a target vehicle meets the preset condition or not.
Further, the step of alerting the occupant when the safety device operation condition does not satisfy a preset condition includes: when the operation condition of the safety device does not meet a preset condition, determining a sitting posture to be adjusted according to the sitting posture matching result; and generating early warning information according to the sitting posture to be adjusted, and giving an alarm to passengers according to the early warning information.
It should be noted that the sitting posture to be adjusted may be a sitting posture state that needs to be adjusted and is determined after the sitting posture of the occupant is matched with the preset safe standard sitting posture.
It can be understood that the early warning information can be prompt information generated according to the sitting posture to be adjusted, and the early warning information can contain specific sitting posture adjustment information. For example: in the driving process, if the seat of a passenger or a driver is adjusted too far forward or the head is too close to the steering wheel, when the airbag is popped up, the passenger cannot be effectively protected, the injury is aggravated, namely, a prompt needs to be sent to the passenger to remind the passenger.
In the concrete realization, the position of sitting of passenger in the car is monitored at any time to camera in the car, when the position of sitting and predetermine safety standard position of sitting gap great, when the effect when passenger's position of sitting can influence safety device operation promptly, makes the police dispatch newspaper to the passenger of a certain specific position, for example: the automobile safety protection system is characterized in that the front row passenger driving is provided with a front row seat, sitting postures can influence the safety function of an air bag and timely adjust the sitting postures, a driver is too far ahead, the function of the safety air bag is influenced, and timely parking adjustment is required, meanwhile, an automobile inner safety belt and a lock catch area are covered by an automobile inner camera, and when a passenger at a corresponding position does not monitor that the safety belt bypasses the passenger or the lock catch position of the safety belt does not enter or exit the lock tongue, an alarm is given to the automobile inner passenger. Thereby replacing the seat belt reminder.
In this embodiment, after the step S50, the method further includes: when the current vehicle speed is greater than a preset safe vehicle speed, judging whether the operation hazard degree of the safety device is greater than a preset hazard degree or not according to the article position information and the passenger sitting posture information; and when the operation hazard degree is greater than the preset hazard degree, controlling the safety device to stop operating.
It should be noted that the predetermined degree of danger may refer to a degree of injury to the occupant when the safety device is operated.
In the concrete realization, the article image that vehicle safety early warning system gathered vehicle-mounted camera is discerned, confirms the kind, the size of article to save in on-vehicle computer, according to current speed of a motor vehicle, influence to passenger's injury when information such as article kind and size, passenger type (man, woman, old man, child) and position of sitting come aassessment safety device operation, when safety device operation harm degree is greater than preset harm degree, control safety device stop operation, for example: when the injury to the passengers is larger when the air bag/air curtain is detonated than when the air bag/air curtain is not detonated, the computer is controlled not to detonate the air bag/air curtain; otherwise, the air bag/air curtain is detonated normally.
In the embodiment, monitoring information of a target vehicle, the current speed and safety device information corresponding to an in-vehicle restraint system are obtained; when the current vehicle speed is greater than the preset vehicle speed, performing feature extraction on the object image in the monitoring information according to a preset image recognition model to obtain object position information corresponding to the object in the vehicle; extracting characteristics of passenger images in the monitoring information according to a preset image recognition model to obtain passenger sitting posture information; judging whether the coordinates of the articles in the vehicle are in a preset safety region or not according to the article position information and the safety device information, determining whether the safety device operation condition of the target vehicle meets the preset condition or not according to the passenger sitting posture information when the articles in the vehicle are in the preset safety region, and giving an alarm to the passenger when the safety device operation condition does not meet the preset condition. Because this embodiment is through safe area in advance judgement car interior article and passenger position of sitting influence to safety device operation, neglect among the prior art in this embodiment to the harm that the car interior article caused the passenger to lead to safety device to the secondary damage of passenger when the operation, this embodiment has promoted the security when safety device operates, and realizes better protection to the passenger.
In addition, an embodiment of the present invention further provides a storage medium, where a vehicle safety early warning program is stored on the storage medium, and when executed by a processor, the vehicle safety early warning program implements the steps of the vehicle safety early warning method described above.
Referring to fig. 5, fig. 5 is a block diagram illustrating a first embodiment of a vehicle safety precaution device of the present invention.
As shown in fig. 5, a vehicle safety warning device according to an embodiment of the present invention includes:
the information acquisition module 10 is configured to acquire monitoring information of a target vehicle, a current vehicle speed, and safety device information corresponding to an in-vehicle restraint system.
And the feature extraction module 20 is configured to, when the current vehicle speed in the vehicle speed information is greater than a preset vehicle speed, perform feature extraction on the object image in the monitoring information according to a preset image recognition model to obtain object position information corresponding to an object in the vehicle.
The feature extraction module 20 is further configured to perform feature extraction on the passenger image in the monitoring information according to the preset image recognition model, so as to obtain passenger sitting posture information.
And a condition judgment module 30, configured to determine whether a safety device operating condition of the target vehicle meets a preset condition according to the safety device information, the article position information, and the passenger sitting posture information.
And the safety early warning module 40 is used for giving an alarm to the passenger when the operation condition of the safety device does not meet the preset condition.
In the embodiment, monitoring information of a target vehicle, the current speed and safety device information corresponding to an in-vehicle restraint system are obtained; when the current vehicle speed is greater than the preset vehicle speed, performing feature extraction on the object image in the monitoring information according to a preset image recognition model to obtain object position information corresponding to the object in the vehicle; extracting characteristics of passenger images in the monitoring information according to a preset image recognition model to obtain passenger sitting posture information; determining whether the safety device operation condition of the target vehicle meets a preset condition or not according to the safety device information, the article position information and the passenger sitting posture information; and when the operation condition of the safety device does not meet the preset condition, giving an alarm to the passenger. Because this embodiment is through discerning in-car article and passenger position of sitting to judge the influence of in-car article and passenger position of sitting to the safety device operation, this embodiment is for among the prior art under the condition that safety device does not satisfy specific standard, and safety device's effect is lower, thereby leads to safety device poor to passenger's protectiveness, and this embodiment has promoted the security when safety device operates, and realizes better protection to the passenger.
Further, the feature extraction module 20 is further configured to, when the current vehicle speed is greater than a preset vehicle speed, segment the article image in the monitoring information according to a preset image recognition model to obtain sub-image information; extracting the characteristics of the subimage information to obtain the relative positions of the in-vehicle articles and the in-vehicle camera; and determining the position information of the articles in the vehicle under the whole vehicle coordinate corresponding to the target vehicle according to the relative position so as to obtain the article position information corresponding to the articles in the vehicle.
Further, the feature extraction module 20 is further configured to perform feature extraction on the passenger image in the monitoring information according to the preset image recognition model to obtain a passenger type and a passenger feature point set; extracting a target sitting posture feature set from a preset sitting posture feature library according to the passenger type and the passenger feature point set; and determining occupant sitting posture information according to the target sitting posture feature set.
Further, the condition determining module 30 is further configured to determine whether coordinates of the in-vehicle object are in a preset safe area according to the object position information and the safety device information; and when the articles in the vehicle are in a preset safety region, determining whether the operation condition of the safety device of the target vehicle meets a preset condition or not according to the passenger sitting posture information.
Further, the condition determining module 30 is further configured to, when the in-vehicle object is located in a preset safe area, match the sitting posture information of the passenger according to a preset safe sitting posture state, and obtain a sitting posture matching result; and determining whether the operation condition of the safety device of the target vehicle meets a preset condition or not according to the sitting posture matching result.
Further, the safety early warning module 40 is further configured to determine a sitting posture to be adjusted according to the sitting posture matching result when the operation condition of the safety device does not meet a preset condition; and generating early warning information according to the sitting posture to be adjusted, and giving an alarm to passengers according to the early warning information.
Further, the vehicle safety precaution device still includes: the safety control module is used for judging whether the operation harmfulness of the safety device is greater than a preset harmfulness degree or not according to the article position information and the passenger sitting posture information when the current vehicle speed is greater than a preset safety vehicle speed; and when the operation hazard degree is greater than the preset hazard degree, controlling the safety device to stop operating.
It should be understood that the above is only an example, and the technical solution of the present invention is not limited in any way, and in a specific application, a person skilled in the art may set the technical solution as needed, and the present invention is not limited thereto.
It should be noted that the above-described work flows are only exemplary, and do not limit the scope of the present invention, and in practical applications, a person skilled in the art may select some or all of them to achieve the purpose of the solution of the embodiment according to actual needs, and the present invention is not limited herein.
In addition, the technical details that are not described in detail in this embodiment can be referred to the vehicle safety warning method provided by any embodiment of the present invention, and are not described herein again.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The use of the words first, second, third, etc. do not denote any order, but rather the words first, second, third, etc. are to be interpreted as names.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention or portions thereof that contribute to the prior art may be embodied in the form of a software product, where the computer software product is stored in a storage medium (e.g., a Read Only Memory (ROM)/Random Access Memory (RAM), a magnetic disk, an optical disk), and includes several instructions for enabling a terminal device (which may be a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.

Claims (10)

1. A vehicle safety early warning method is characterized by comprising the following steps:
acquiring monitoring information of a target vehicle, current vehicle speed and safety device information corresponding to an in-vehicle restraint system;
when the current vehicle speed is greater than a preset vehicle speed, performing feature extraction on the object image in the monitoring information according to a preset image recognition model to obtain object position information corresponding to the object in the vehicle;
performing feature extraction on the passenger image in the monitoring information according to the preset image recognition model to obtain passenger sitting posture information;
determining whether a safety device operating condition of the target vehicle meets a preset condition according to the safety device information, the article position information and the passenger sitting posture information;
and when the operation condition of the safety device does not meet the preset condition, giving an alarm to the passenger.
2. The vehicle safety pre-warning method according to claim 1, wherein the step of performing feature extraction on the object image in the monitoring information according to a preset image recognition model to obtain the object position information corresponding to the object in the vehicle when the current vehicle speed is greater than a preset vehicle speed comprises:
when the current vehicle speed is greater than a preset vehicle speed, segmenting an article image in the monitoring information according to a preset image recognition model to obtain sub-image information;
extracting the characteristics of the subimage information to obtain the relative positions of the in-vehicle articles and the in-vehicle camera;
and determining the position information of the articles in the vehicle under the whole vehicle coordinate corresponding to the target vehicle according to the relative position so as to obtain the article position information corresponding to the articles in the vehicle.
3. The vehicle safety precaution method according to claim 1, wherein the step of performing feature extraction on the image of the passenger in the monitoring information according to the preset image recognition model to obtain the sitting posture information of the passenger comprises:
performing feature extraction on the passenger image in the monitoring information according to the preset image recognition model to obtain a passenger type and a passenger feature point set;
extracting a target sitting posture feature set from a preset sitting posture feature library according to the passenger type and the passenger feature point set;
and determining occupant sitting posture information according to the target sitting posture feature set.
4. The vehicle safety precaution method of claim 1, wherein the step of determining whether the safety device operating condition of the target vehicle satisfies a preset condition based on the safety device information, the item location information, and the occupant seating posture information comprises:
judging whether the coordinates of the articles in the vehicle are in a preset safe area or not according to the article position information and the safety device information;
and when the articles in the vehicle are in a preset safety region, determining whether the operation condition of the safety device of the target vehicle meets a preset condition or not according to the passenger sitting posture information.
5. The vehicle safety precaution method of claim 4, wherein the step of determining whether the safety device operating condition of the target vehicle meets a preset condition based on the occupant sitting posture information when the in-vehicle item is in a preset safety zone comprises:
when the articles in the vehicle are in a preset safe area, the sitting posture information of the passengers is matched according to a preset safe sitting posture state, and a sitting posture matching result is obtained;
and determining whether the operation condition of the safety device of the target vehicle meets a preset condition or not according to the sitting posture matching result.
6. The vehicle safety precaution method of claim 5, wherein the step of alerting an occupant when the safety device operating condition does not satisfy a preset condition comprises:
when the operation condition of the safety device does not meet a preset condition, determining a sitting posture to be adjusted according to the sitting posture matching result;
and generating early warning information according to the sitting posture to be adjusted, and giving an alarm to passengers according to the early warning information.
7. The vehicle safety precaution method according to any one of claims 1 to 6, wherein, after the step of alerting an occupant when the safety device operating condition does not satisfy a preset condition, further comprising:
when the current vehicle speed is greater than a preset safe vehicle speed, judging whether the operation hazard degree of the safety device is greater than a preset hazard degree or not according to the article position information and the passenger sitting posture information;
and when the operation hazard degree is greater than the preset hazard degree, controlling the safety device to stop operating.
8. A vehicle safety pre-warning apparatus, comprising: a memory, a processor, and a vehicle safety precaution program stored on the memory and executable on the processor, the vehicle safety precaution program, when executed by the processor, implementing the vehicle safety precaution method of any one of claims 1 to 7.
9. A storage medium having a vehicle safety warning program stored thereon, the vehicle safety warning program implementing the vehicle safety warning method according to any one of claims 1 to 7 when executed by a processor.
10. A vehicle safety warning apparatus, characterized by comprising:
the information acquisition module is used for acquiring monitoring information of a target vehicle, the current speed and safety device information corresponding to an in-vehicle restraint system;
the characteristic extraction module is used for extracting the characteristics of the object images in the monitoring information according to a preset image recognition model when the current vehicle speed in the vehicle speed information is greater than a preset vehicle speed, and acquiring the position information of the object corresponding to the object in the vehicle;
the feature extraction module is further configured to perform feature extraction on the passenger image in the monitoring information according to the preset image recognition model to obtain passenger sitting posture information;
the condition judgment module is used for determining whether the safety device operation condition of the target vehicle meets a preset condition or not according to the safety device information, the article position information and the passenger sitting posture information;
and the safety early warning module is used for giving an alarm to the passenger when the operation condition of the safety device does not meet the preset condition.
CN202110715550.1A 2021-06-25 2021-06-25 Vehicle safety early warning method, device, storage medium and device Pending CN113487830A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110715550.1A CN113487830A (en) 2021-06-25 2021-06-25 Vehicle safety early warning method, device, storage medium and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110715550.1A CN113487830A (en) 2021-06-25 2021-06-25 Vehicle safety early warning method, device, storage medium and device

Publications (1)

Publication Number Publication Date
CN113487830A true CN113487830A (en) 2021-10-08

Family

ID=77937216

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110715550.1A Pending CN113487830A (en) 2021-06-25 2021-06-25 Vehicle safety early warning method, device, storage medium and device

Country Status (1)

Country Link
CN (1) CN113487830A (en)

Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030036835A1 (en) * 1997-02-06 2003-02-20 Breed David S. System for determining the occupancy state of a seat in a vehicle and controlling a component based thereon
US20030125855A1 (en) * 1995-06-07 2003-07-03 Breed David S. Vehicular monitoring systems using image processing
CN1899890A (en) * 2005-07-19 2007-01-24 高田株式会社 Occupant information detection system, occupant restraint system, and vehicle
JP2007055294A (en) * 2005-08-22 2007-03-08 Tokai Rika Co Ltd Occupant detection apparatus for vehicle
US20090033075A1 (en) * 2007-07-30 2009-02-05 Honda Motor Co., Ltd. Vehicle occupant sensing system
JP2010195139A (en) * 2009-02-24 2010-09-09 Takata Corp Occupant restraint control device and occupant restraint control method
CN104129354A (en) * 2014-07-30 2014-11-05 湖南大学 Control method for accidental injury prevention safety air bag
CN104648297A (en) * 2015-01-04 2015-05-27 大陆汽车电子(长春)有限公司 Vehicle interior safety method and equipment
DE102016003315A1 (en) * 2016-03-17 2016-10-06 Daimler Ag Method for recording a seat occupancy
CN106956619A (en) * 2016-01-12 2017-07-18 福特全球技术公司 The system and method monitored for seat
CN107428302A (en) * 2015-04-10 2017-12-01 罗伯特·博世有限公司 Utilize occupant's size of vehicle interior camera and the detection of posture
CN108116353A (en) * 2016-11-28 2018-06-05 罗伯特·博世有限公司 Device for passenger protection and corresponding vehicle for vehicle
CN110210284A (en) * 2019-04-12 2019-09-06 哈工大机器人义乌人工智能研究院 A kind of human body attitude behavior intelligent Evaluation method
CN110576818A (en) * 2018-06-11 2019-12-17 沃尔沃汽车公司 method and system for controlling the state of an occupant protection feature of a vehicle
CN111204301A (en) * 2020-01-21 2020-05-29 恒大新能源汽车科技(广东)有限公司 Riding safety control method and electronic equipment

Patent Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030125855A1 (en) * 1995-06-07 2003-07-03 Breed David S. Vehicular monitoring systems using image processing
US20030036835A1 (en) * 1997-02-06 2003-02-20 Breed David S. System for determining the occupancy state of a seat in a vehicle and controlling a component based thereon
CN1899890A (en) * 2005-07-19 2007-01-24 高田株式会社 Occupant information detection system, occupant restraint system, and vehicle
JP2007055294A (en) * 2005-08-22 2007-03-08 Tokai Rika Co Ltd Occupant detection apparatus for vehicle
US20090033075A1 (en) * 2007-07-30 2009-02-05 Honda Motor Co., Ltd. Vehicle occupant sensing system
JP2010195139A (en) * 2009-02-24 2010-09-09 Takata Corp Occupant restraint control device and occupant restraint control method
CN104129354A (en) * 2014-07-30 2014-11-05 湖南大学 Control method for accidental injury prevention safety air bag
CN104648297A (en) * 2015-01-04 2015-05-27 大陆汽车电子(长春)有限公司 Vehicle interior safety method and equipment
CN107428302A (en) * 2015-04-10 2017-12-01 罗伯特·博世有限公司 Utilize occupant's size of vehicle interior camera and the detection of posture
CN106956619A (en) * 2016-01-12 2017-07-18 福特全球技术公司 The system and method monitored for seat
DE102016003315A1 (en) * 2016-03-17 2016-10-06 Daimler Ag Method for recording a seat occupancy
CN108116353A (en) * 2016-11-28 2018-06-05 罗伯特·博世有限公司 Device for passenger protection and corresponding vehicle for vehicle
CN110576818A (en) * 2018-06-11 2019-12-17 沃尔沃汽车公司 method and system for controlling the state of an occupant protection feature of a vehicle
CN110210284A (en) * 2019-04-12 2019-09-06 哈工大机器人义乌人工智能研究院 A kind of human body attitude behavior intelligent Evaluation method
CN111204301A (en) * 2020-01-21 2020-05-29 恒大新能源汽车科技(广东)有限公司 Riding safety control method and electronic equipment

Similar Documents

Publication Publication Date Title
CN108621883B (en) Monitoring vehicle carriage
CN105313829B (en) Car roof mounted rear seat airbag safety cage
JP2007022401A (en) Occupant information detection system, occupant restraint device and vehicle
JPH1115980A (en) Device for detecting presence of object in automobile
JP2007153035A (en) Occupant sitting judgement system
EP3581440A1 (en) Method and system for controlling a state of an occupant protection feature for a vehicle
US9616747B1 (en) Method for controlling travel of golf carts and all-terrain vehicles
CN106494349A (en) A kind of seat belt system alarm method and device
EP1535807A3 (en) Method and apparatus for deploying countermeasures in response to sensing an imminent vehicular collision
WO2009146173A2 (en) Enhanced vision road detection system
CN113479160A (en) Vehicle occupant collision safety protection method, device, equipment and storage medium
JP3632619B2 (en) Occupant protection device starter
US7320478B2 (en) Smart airbag for vehicular applications
US20210201601A1 (en) Information processing device and information processing method
CN114215434A (en) Method and device for controlling opening of vehicle door and electronic equipment
JP2013252863A (en) Occupant restriction control device and occupant restriction control method
CN113487830A (en) Vehicle safety early warning method, device, storage medium and device
KR20220081453A (en) Apparatus for rear occupant alert of vehicle and method thereof
CN117794790A (en) Method for securing the passenger compartment of a motor vehicle, control device for a motor vehicle, motor vehicle having a passenger compartment
JP2018156212A (en) Physique determination device, physique determination method and program
CN110450713B (en) Driving reminding method and device, computer equipment and storage medium
CN115416547B (en) Vehicle seat adjusting method, device, equipment and storage medium
US20230406250A1 (en) Vehicle for protecting occupant and operating method thereof
JP2008056016A (en) Vehicular safety protection device
CN115805890A (en) Vehicle safety control method and device, storage medium and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20211008