KR101297187B1 - Method for protecting passenger of a vehicles and system for performing the same - Google Patents

Abstract

PURPOSE: A method to protect passengers in a vehicle and a system therefor are provided to prevent a minor collision with the other vehicles when parking or boarding in the vehicle and safety accidents caused by the passenger remaining inside the vehicle. CONSTITUTION: A system to protect passengers in a vehicle comprises an inner input member (100), a control member (200), an RF transmission member (300), and a warning member (400). The inner input member includes a passenger boarding or getting off sensor (110) and an inner passenger sensor (120). The passenger boarding or getting off sensor senses the pressure when the passenger boards or gets off if a door of the vehicle is opened. The inner passenger sensor includes a movement recognizing unit (130) and a sound recognizing unit (140), and determines whether or not passengers remaining inside the vehicle exist. The control member receives states of each device in the vehicle from an ECU (102) of the vehicle and controls RF transceiver operations and warning operations by comprehensively determining the state inside the vehicle which is detected from the inner input member. The RF transmission member transmits a dangerous situation inside the vehicle to a predetermined driver or concerned peoples by a voice message or a text message by a control of the control member. The warning member includes a speaker, a light, and a display device to audio-visually warn the dangerous situation inside the vehicle or whether or not the passenger boards or gets off by the control of the control member. [Reference numerals] (102) Vehicle ECU; (112) Piezo-sensor; (114) Contact switch; (130) Movement recognizing unit; (140) Sound recognizing unit; (200) Control member; (300) RF transmission member; (AA) Vehicle condition; (BB) Speaker; (CC) Warning light; (DD) Display device

Description

Method for protecting passenger of a vehicles and system for performing the same

The present invention relates to a method for protecting occupants of a vehicle and a system for performing the same. More particularly, the present invention provides a visual and visual alert to a surrounding at the time of getting on or off of a passenger in a child or elderly person's protective vehicle, and a passenger in a vehicle where the operation is terminated. If a dangerous situation is left, it detects this and notifies the driver and guardian by using a wireless communication network together with its own audiovisual alarm, so that the occupant of the vehicle to prepare for an accident, such as a suffocation, is left alone in the vehicle. A protection method and a system for performing the same.

In general, a vehicle for education or for the convenience of transportation for the elderly or a facility for accommodating the elderly is operating a vehicle. However, most of the accidents that occur during the operation of the vehicle for the protection of the elderly are in blind spots of safety accidents because they occur in vehicles operated by education or childcare facilities. Types of accidents that occur in vehicles operated by education or childcare facilities include accidents caused by carelessness of the driver or the lead person, such as accidents caused by contact with other vehicles during getting on and off, and accidents caused by clothes or bags being caught in the car doors. Mostly.

In particular, the number of deaths from traffic accidents per 100,000 children under the age of 14 is the highest among the 26 OECD countries, compared to 0 in Luxembourg, 0.6 in Finland, 0.9 in Japan and 1.4 in the United Kingdom. It is also about 1.5 times higher than the OECD average of 2.1 and 2-3 times higher than that of developed countries.

Therefore, it is necessary to pay attention to safety management in the operation of children's school vehicles, such as practicing child safety education, mandatory teacher safety education, mandatory insurance, and the placement of passengers on the ship's towers, and to transport children under the Road Traffic Act (Revised Dec. 31, 2001). The bus must be declared and the provision of a stamp and safety sign (safety equipment, indicator lights, auxiliary scaffolding, controller, etc.) is being reinforced.

However, drivers often have to operate all the way from the departure of a child's school vehicle to the arrival of a child's school vehicle. Since there are not many vehicles, safety accidents are happening in many cases.

In addition, in the case of asphyxiation accidents frequently occur in the summer in the car, the elderly and especially the infants are left alone in the vehicle and left for a long time. When the elderly, especially infants, are left in the vehicle for a long time, the vehicle's temperature increases due to the sun's heat, and especially during summer, the temperature rises rapidly, making breathing difficult, but the closed window prevents outside air from passing through. To suffocation accidents.

Because the infant left alone in the car breathed in a confined space for a long time, the oxygen in the car gradually decreased, while the concentration of carbon dioxide emitted from the infant gradually increased, which made it impossible to breathe later and eventually caused a choking condition. .

Looking at the prior art for preventing a safety accident in such a vehicle, Korean Patent No. 10-0569849 discloses a sensor for detecting the remaining number of people inside the children's school vehicle as a heat sensor, and the heat sensor It is installed in every row of four chairs, and the engine is stopped when the residual number is detected by the heat sensor. Therefore, the driver does not leave the vehicle with the remaining number of people remaining in the vehicle.

In addition, Korean Patent Laid-Open No. 2001-0001841 detects an indoor temperature through a temperature sensor when the vehicle is stopped, and prevents asphyxiation by opening a power window when the indoor temperature is above a set value.

However, in the above-mentioned conventional prior art, there is a problem in that the residual number of people is inaccurate by using a heat sensor or a temperature sensor as a means for detecting a passenger left in the vehicle in the elderly and particularly a child protection vehicle of the vehicle. In other words, when the elderly are left in the vehicle and the suffocation occurs, the indoor temperature of the vehicle increases in summer.

 The heat sensor and the temperature sensor used as a conventional means for detecting the remaining number of people can accurately provide the detection value due to the temperature difference only when the internal temperature of the vehicle and the temperature of the human body differ by more than a certain temperature. Since most cases rise above the temperature of the human body, there is a problem in that the detection values of the thermal sensor and the temperature sensor are not accurate and thus prevent the safety accident from being completely prevented.

The present invention has been invented to solve the above problems, in addition to the microphone for recognizing the presence of the remaining personnel in the vehicle in the closed state of the vehicle window and the door of the vehicle is closed and the operation of the engine is stopped By adopting the method of detecting the movement by passing the fixed SPOT pattern in the diffraction optical element (DOE) in the room, it detects the presence of residual personnel in the vehicle because the outside air temperature is high in the method of adopting the conventional temperature sensing and heat sensing sensor The object of the present invention is to provide a vehicle occupant protection method and system that can prevent errors occurring in the vehicle and improve accuracy.

In addition, the present invention improves the accuracy of detecting the presence of the remaining personnel in the vehicle, and while the vehicle is running to detect the getting on and off of the occupant from the pressure sensor installed on the floor and the footrest of the vehicle to get on and off the child or the elderly It is another object of the present invention to provide a method and a system for protecting occupants of a vehicle that visually and visually alerts a city to promote getting on and off safety.

Vehicle occupant protection system according to the present invention for performing these objects,

A plurality of passengers getting on and off the protection means formed on a lower portion of the vehicle and a footrest for detecting a pressure of the occupant's getting on and off by detecting pressure;

The beam output from the light source is passed through the diffraction optical element (DOE) to transmit a plurality of fixed SPOT patterns in the vehicle, and the spot pattern fixed by the light source filter and the camera is detected to detect the fixed point pattern through image processing. In-vehicle occupant detection means comprising an operation recognition unit for determining whether there is a change and a voice recognition unit for detecting a voice signal in the vehicle;

When the vehicle is in operation by receiving the current state of the vehicle from the ECU of the vehicle, the passenger's getting on and off alarm is visually and alarmed around by the passenger's getting on and off protection means, and when the vehicle is parked, the signal input from the vehicle's occupant detection means Control means for controlling the RF transmission operation for determining the danger situation that the occupant is left alone in the vehicle through the audio and visual alert and at the same time by voice and text to the mobile terminal of the driver and vehicle personnel;

An alarm means operated under the control of the control means and including a speaker, a warning light, and a display device for visually notifying a passenger of getting on and off and a dangerous situation in the vehicle; And

It is operated under the control of the control means and includes an RF transmission means for transmitting voice and text messages to the driver and vehicle personnel stored in advance the dangerous situation in the vehicle.

In addition, the vehicle occupant protection method according to the present invention for performing these objects,

A vehicle driving state determining step of determining whether the vehicle is in operation or parking by receiving a current state of the vehicle from the ECU of the vehicle;

When the vehicle is in operation, it detects whether the vehicle stops and the door is opened.If the door is opened when the vehicle is stopped, it is determined that the passenger is getting on and off. A passenger getting on and off protection step of warning around;

If the vehicle is not in operation, the engine stops and detects that the door is closed to determine that the vehicle is parked, and a plurality of fixed point patterns transmitted through the image during parking are fixed through the image processing. In-car occupant detection step of determining whether the remaining occupant in the car by determining whether there is a voice signal in the car at the same time to determine whether there is a change; And

If it is determined that the occupant is in danger of being left alone in the vehicle, the speaker, warning lamp, and display device formed in the vehicle visually alert the user of the dangerous situation and, at the same time, use the RF transmission module to transmit the voice and text to the portable terminal of the driver and vehicle personnel. It includes a risk alert stage to inform.

The vehicle occupant protection system according to the present invention detects whether the occupant remains in the vehicle when the vehicle is parked while the vehicle is stopped and the engine is stopped and the vehicle door is closed. By warning this visually, it is possible to prevent safety accidents such as occupants of the vehicle, especially the elderly and the disabled, such as getting on and off the car and contacting with other vehicles and suffocating accidents left in the vehicle.

In particular, in order to prevent suffocation caused by the occupants remaining inside the vehicle, the voice detection in the vehicle and the image processing method using the diffraction optical element (DOE) are combined to prevent errors in detecting the residual number of persons in the vehicle. There is a unique effect that enables accurate detection without being affected by environmental changes such as temperature.

1 is a block diagram showing the configuration of a vehicle occupant protection system according to the present invention.
FIG. 2 is a block diagram illustrating the structure and operation of the motion detection unit in the occupant protection system of the vehicle of FIG. 1.
3 is a photograph showing the result of configuring the motion recognition unit with an infrared sensing module according to another embodiment of the present invention.
4 is a flowchart illustrating the operation of the vehicle occupant protection method according to the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram illustrating a configuration of a vehicle occupant protection system according to an exemplary embodiment of the present invention, and FIG. 2 is a block diagram illustrating a structure and an operation of an operation detection unit in a vehicle occupant protection system of FIG. 1. In addition, Figure 3 is a picture for showing the result of configuring the motion recognition unit with the infrared sensing module according to another embodiment of the present invention.

The present invention, as shown in Figure 1 is installed inside the vehicle to detect the situation in the vehicle and input the signal according to the vehicle input means 100, input the state of each device of the vehicle from the ECU 102 formed in the vehicle And in advance the dangerous situation in the vehicle by the control means 200 and the control means 200 for controlling the RF transmission and reception operation and the audiovisual alarm operation by comprehensively determining the in-vehicle situation detected by the in-vehicle input means 100. Speakers, warning lights, and displays for visually notifying the passenger of getting on and off and the dangerous situation in the vehicle by the control of the RF transmitting means 300 and the control means 200 for transmitting voice and text messages to the stored driver and vehicle personnel. It consists of an alarm means 400 comprising a device.

Here, the in-vehicle input means 100 is composed of a passenger ride on and off detection unit 110 and the vehicle occupant detection unit 120. Passenger getting on and off detection unit 110 is composed of a plurality of piezo (PIEZZO) sensor 112 formed on the bottom and the foot of the vehicle and the contact switch 114 formed on the door of the vehicle, when the vehicle door is opened, Will be detected.

In-vehicle occupant detector 120 is composed of a motion recognition unit 130 and a voice recognition unit 140. As shown in FIG. 2, the motion recognition unit 130 passes the infrared laser beam output from the infrared laser light source 121 through the diffractive optical element (DOE) 122 to detect the dot pattern 123 fixed in the vehicle. Permeate. The fixed point pattern 123 is configured such that the fixed point pattern transmitted through the pattern in which a plurality of fixed points SPOTs are formed passes through the infrared light source filter 124 and is input to the camera 125. The fixed dot pattern 123 input to the camera 125 is subjected to image processing through the image processing unit 126, and then the controller 127 determines whether there is a change in the fixed dot pattern 123 to determine whether the occupant in the vehicle remains. You will be judged.

In addition, according to another embodiment of the present invention, the motion recognition unit 130 may be configured using an infrared detection module. The infrared detection module excludes the infrared laser light source 121 and the diffraction optical element (DOE) 122 from the motion recognition unit 130 of FIG. 2, and photographs the interior of the vehicle with an infrared camera or detects only movement using an infrared sensor. Configure to The interior image of the car input to the infrared camera is processed by the image processing unit, and the controller compares the difference with the previous image in real time, and if there is a partial change, the occupant is determined to remain.The infrared sensor detects infrared rays emitted from the human body. Bay is detected to determine whether the occupants remain.

That is, as shown in FIG. 3, the image inputted by the infrared camera is processed to compare the difference with the indoor image of the pre-stored vehicle, and if there is a change, it is determined that the occupant remains.

In addition, the operation recognition unit 130 according to the present invention is preferably installed in the interior light portion of the vehicle is configured to enable the detection of the occupant remaining as a single module to reduce the installation cost.

Another sensing means for detecting whether the occupant is present in the vehicle is the voice recognition unit 140, the voice recognition unit 140 is a microphone device for recognizing the voice emitted by the passenger in the car, and the external noise and voice In order to have discriminating power, it is configured to be able to recognize only the voice generated inside the vehicle based on the voice in the closed space.

The alarm means 400 is typically installed in a vehicle for protecting the elderly or children, and includes a speaker, a warning light, and a display device for visually informing the state of the vehicle to the outside.

Referring to the detailed operation of the vehicle occupant protection system according to the present invention configured as described above are as follows.

4 is a flowchart illustrating an operation of a method for protecting occupants of a vehicle according to the present invention.

As shown in FIG. 4, the present invention starts operation from the moment when the start of the vehicle is started by operating the start switch to drive the vehicle, and the current state of the vehicle is determined from the ECU 102 of the vehicle. It is determined whether the vehicle is running or parked by receiving the input. (Step S101) Since the ECU 102 of the vehicle controls each device necessary for driving the vehicle, whether the start switch of the vehicle is turned on and the speedometer of the instrument cluster The vehicle driving state is determined by determining whether the vehicle is operating.

If the vehicle is in operation in step S101, the vehicle door is detected while the vehicle's speedometer is stopped to determine whether the vehicle is running or whether the vehicle is parked (step S102). When the speedometer is stopped and the door is opened, the vehicle stop mode is performed to protect the occupant when getting on and off. (Steps S103 to 105).

That is, when the vehicle stops when the vehicle door is opened by receiving signals from a plurality of piezo sensors 112 formed on the lower part and the footboard of the vehicle and the contact switch 114 formed on the entrance door of the vehicle, When the vehicle approaches the right side of the road for stopping and stopping the vehicle by visually warning the passenger's getting on and off through the warning means 400 consisting of a speaker, a warning light, and a display device by detecting the generated pressure. It can warn drivers such as bicycles and motorcycles going to the right side of the vehicle, and make sure that the occupants are completely disengaged from the vehicle.

If the engine of the vehicle is stopped and the door of the vehicle is closed in step S102, it is determined that the vehicle is parked, and the vehicle parking mode is performed to determine whether there is a residual occupant in the vehicle. Is prevented in advance. (Steps S106 to 109)

That is, when the door is closed while the engine of the vehicle is stopped, it is determined that the vehicle is parked, and the operation recognition unit 130 and the voice recognition unit 140 are operated. As shown in FIG. 2, the operation recognition unit 130 passes the infrared laser beam output from the infrared laser light source 121 through the diffraction optical element (DOE) 122 to fix the dot pattern 123 fixed in the vehicle. Permeate. The fixed point pattern 123 is spaced at regular intervals, and the fixed point pattern transmitted as a pattern in which a plurality of fixed points are formed is input to the camera 125 through the infrared light source filter 124. The fixed dot pattern 123 input to the camera 125 is subjected to image processing through the image processing unit 126, and then the controller 126 determines whether there is a change in the fixed dot pattern 123 to determine whether the occupant in the vehicle remains. You will be judged.

As shown in FIG. 2, the fixed dot pattern 123 is a pattern in which a plurality of fixed points are spaced at regular or irregular intervals so that the image processing result of the pattern may vary depending on whether a passenger is present in the vehicle. do. If there is no occupant in the vehicle, the image processing unit 126 processes the fixed dot pattern 123 input to the camera 125 through the infrared light source filter 124 in the vehicle so that there is no change. If present, the fixed dot pattern 123 transmitted in the vehicle is changed every time.

Here, the motion recognition unit composed of an infrared camera and a voice recognition unit processes the image input by the infrared camera and compares the difference with the indoor image of the pre-stored vehicle. Will be judged.

In addition, the operation recognition unit employing an infrared sensor detects only the infrared wavelength band emitted by the human body to determine whether the occupant remains. Since the human body emits about 5 ~ 30um of far infrared rays, the infrared sensor detects the infrared wavelength band emitted by the human body to determine whether the occupants remain.

On the other hand, in order to increase the reliability of the device to recognize the situation in which the occupant is present in the risk of the accident in more detail, the interior of the vehicle detects the sound emitted by the occupant to convert into an electrical signal to the control means 200 The voice recognition unit 140 configured to send a microphone is installed.

In the parking mode of the vehicle, if it is determined that the signal input from the operation recognition unit 130 and the voice recognition unit 140 is a dangerous situation in which the occupant is left alone in the vehicle, the control means 200 includes a speaker, a warning light, and a display formed in the vehicle. The device visually alerts the user of the dangerous situation (step S110).

At the same time, the RF transmission module notifies voice and text messages to the portable terminals of the driver and vehicle personnel. The driver driving the vehicle may not be aware of this danger, so it is very urgent to inform the driver or the vehicle's management of the risk.

Accordingly, the control means 200 transmits a signal to a mobile phone terminal (not shown) of a driver or vehicle officials previously input through an RF transmission module, thereby receiving a text such as an alarm or SMS from the mobile phone terminal receiving the signal. Is to be formed.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. In addition, various modifications and variations may be made by those skilled in the art within the equivalent scope of the technical concept of the present invention and the appended claims.

Claims (8)

Passenger getting on and off detecting means for detecting an operation of getting on and off of the occupant by determining an input of a sensor which is formed on the footboard of the vehicle to sense pressure;
The beam output from the light source passes through the diffraction optical element (DOE) to transmit a plurality of fixed SPOT patterns in the vehicle, and detects the SPOT patterns fixed by the light source filter and the camera to determine whether the SPOT pattern is changed through image processing. In-vehicle occupant detecting means including an operation recognition unit and a voice recognition unit for detecting a voice signal in the vehicle;
Determines the current state of the vehicle from the ECU of the vehicle and visually alarms the passenger's getting on and off according to the signal from the passenger getting on and off detection means when getting on and off the vehicle, and when the vehicle is parked, a signal input from the vehicle's passenger detecting means. Control means for controlling the RF transmission operation for determining the danger situation that the occupant is left alone in the vehicle through an audio and visually alert and at the same time by the voice and text to the driver and vehicle personnel by wireless;
An alarm means operated under the control of the control means and including a speaker, a warning light, and a display device for visually notifying a passenger of getting on and off and a dangerous situation in the vehicle; And
And RF transmission means for transmitting voice and text messages to a driver and a vehicle official, which are operated under the control of the control means and pre-store a dangerous situation in the vehicle. The apparatus of claim 1, wherein the operation recognition unit comprises: a diffraction optical element (DOE) configured to transmit a dot pattern fixed in a vehicle by using an infrared laser beam output from an infrared laser light source; An infrared light source filter and a camera for receiving a fixed dot pattern transmitted from the diffractive optical element and photographing the fixed dot pattern; An image processor for image processing a fixed dot pattern photographed by the camera; And a controller configured to determine whether the occupant remains in the vehicle by determining whether the fixed dot pattern processed by the image processor is changed. The apparatus of claim 2, wherein the motion recognition unit comprises: an infrared camera for receiving an image of an interior of a vehicle; An image processor for image processing a vehicle interior image inputted to the infrared camera; And a controller configured to determine whether a passenger remains by comparing the image processing image with a previous image in real time. The apparatus of claim 2, wherein the operation recognition unit comprises: an infrared sensor which selectively receives only infrared wavelengths emitted from a human body; And a controller configured to determine whether the occupant remains by the value inputted by the infrared sensor. The vehicle occupant protection system according to claim 2, 3 or 4, wherein the operation recognition unit is formed in an indoor light module of the vehicle. A vehicle operating state determining step of determining whether the vehicle is in operation or parking by receiving a current state of the vehicle from the ECU of the vehicle;
Ii) If the vehicle is in operation, it detects whether the vehicle stops and the door is opened.If the door is opened during the vehicle stop, it is determined that the passenger is getting on and off. Step of getting on and off the occupant to alert around the enemy;
Ⅲ) If the vehicle is not in operation, the engine stops and detects that the door is closed to determine that the vehicle is parked, and when the vehicle is parked, a plurality of fixed dot patterns transmitted through the vehicle are fixed through image processing. In-vehicle occupant detection step of determining whether the occupant remains in the vehicle by determining whether there is a change in the dot pattern and at the same time the presence of a voice signal in the vehicle; And
Ⅳ) If it is determined that the dangerous situation is left alone in the vehicle, the speaker, warning light, and display device formed in the vehicle will visually alert the dangerous situation, and the voice and text will be transmitted to the mobile terminal of the driver and vehicle personnel through the RF transmission module. A method for protecting occupants of a vehicle, including a risk warning step to inform the passenger. 7. The method of claim 6, wherein the step 감지 detects that the engine is stopped and the door is closed when the vehicle is not in operation, and determines that the vehicle is parked, and images the image input by the infrared camera at the time of parking and stores the image in advance. Passenger protection of the vehicle characterized in that it can be replaced by the vehicle occupant detection step of determining whether there is a voice signal in the vehicle by comparing the difference with the indoor image of the vehicle and determining whether there is a voice signal in the vehicle. Way. 7. The method of claim 6, wherein the step 감지 detects that the engine is stopped and the door is closed when the vehicle is not in operation, and determines that the vehicle is parked. Infrared wavelengths emitted by the human body by using an infrared sensor during parking. A method for protecting occupants of a vehicle, characterized in that it can be replaced by an in-car occupant detection step of determining whether a passenger has remaining in the car by selectively accepting a bay and simultaneously determining whether a voice signal exists in the car.

Images