WO2022203125A1

WO2022203125A1 - Safety apparatus for travel in tunnels and on all roads

Info

Publication number: WO2022203125A1
Application number: PCT/KR2021/008418
Authority: WO
Inventors: 이학승
Original assignee: 주식회사 에스투에이치원
Priority date: 2021-03-22
Filing date: 2021-07-02
Publication date: 2022-09-29
Also published as: KR102269227B1

Abstract

Provided is a safety apparatus for travel in tunnels and on all roads, the apparatus being mounted on medians and guard rails of a road so as to prevent contact with vehicles. The safety apparatus comprises: safety cases installed on the road at regular intervals in a certain section; lighting units installed in the safety cases so as to emit light forward in the vehicle travel direction; warning units installed in the safety cases so that light blinks rearward in the vehicle travel direction; sensor units which detect the movement of vehicles traveling on the road and detect the presence of traffic congestion on the road through the movement of the vehicles, and which detect whether an accident has occurred and whether simple congestion due to an increase in vehicles has occurred when traffic congestion on the road is detected; and a control unit for controlling so that light is emitted from the lighting units when it is detected by the sensor unit that vehicles are traveling on the road, light blinks in a first color in the warning unit when it is detected by the sensor unit that simple congestion has occurred, and light blinks in a second color in the warning unit when it is detected by the sensor unit that an accident has occurred.

Description

Safety devices for driving in tunnels and on all roads

The embodiments below relate to a technology for providing road safety devices installed in tunnels and on all roads.

Tunnels are formed through mountains or underground for rapid passage of vehicles traveling on roads or the like. Such a tunnel has the advantage of minimizing the driving time and traffic inconvenience by reducing the mileage of the vehicle, but has a disadvantage in that the interior of the tunnel is dark and the driving environment of the vehicle is poor due to poor ventilation.

In addition, when a vehicle enters the tunnel, due to a sudden change in the environment, various sensory functions of the driver may be deteriorated, and there is also a problem in that it is difficult to recognize the sense of speed and distance due to the distortion of the visual sense.

Therefore, in the tunnel, the probability of occurrence of a traffic accident increases due to the deterioration of the aforementioned driving environment. In addition to these human accidents, since the tunnel is artificially constructed indoors, an environment difficult to pass may be created due to defects, damage or collapse of the tunnel facility itself. Of course, such a sudden accident could cause a major accident because it was impossible to give sufficient notice to passing vehicles.

In particular, it is required to effectively prevent safety accidents while driving on all roads at night when visibility is not secured as well as in tunnels.

In addition, when driving on a dark road on which street lights are not installed, when a vehicle accident or a predetermined obstacle is located in front of the driving direction of the road, it is difficult for the vehicle driver to check in advance, so a secondary accident in the process of avoiding the obstacle There is a problem that will occur.

On the other hand, rear-end collision accidents that occur because subsequent vehicles do not recognize highway accidents and congestion are repeated every year, and there is a problem that leads to multiple collisions and fatalities due to the characteristics of the highway.

Accordingly, there is an increasing demand for implementing a technology for preventing a rear-end collision accident by allowing the front traffic situation to be grasped in advance.

According to an embodiment of the present invention, when it is detected that simple congestion has occurred due to an increase in vehicles in the tunnel and on all roads, the light of the first color is controlled to flicker in the rearward direction of the vehicle, and in the tunnel and on all roads. An object of the present invention is to provide a safety device for driving in a tunnel and on all roads that controls so that the light of the second color blinks in the rear of the vehicle traveling direction when it is detected that an accident has occurred.

Objects of the present invention are not limited to the objects mentioned above, and other objects not mentioned will be clearly understood from the description below.

According to an embodiment of the present invention, the safety case is installed on the road at regular intervals in a certain section so as not to be in contact with the vehicle by being mounted on the road median and the guard rail portion; a lighting unit installed in the safety case to irradiate light in a forward direction of the vehicle; a warning unit installed in the safety case so that the light flickers in the rear of the vehicle traveling direction; Detects the movement of a vehicle traveling on the road, detects whether there is congestion in road driving through the movement of the vehicle, and detects that there is congestion in road driving. a sensor unit that detects whether it has occurred; and when the sensor unit detects that the vehicle is driving on the road, the lighting unit controls light to be irradiated. and a control unit for controlling the light to blink in a second color in the warning unit when it is detected that an accident has occurred by the sensor unit, wherein the sensor unit includes a position of a vehicle and a distance between the vehicles through an image sensor to detect and analyze, obtain image information of a plurality of vehicles located in a section with congestion on the road, classify the obtained image information for each vehicle to extract image information of the vehicle to be analyzed, and Check the target area image and vehicle status information from the image information, check whether there is a vehicle having an appearance problem based on the vehicle status information, generate a determination result as to whether an accident has occurred, and the determination result Accordingly, when it is determined that an accident has occurred, it is detected that congestion has occurred on the road due to the occurrence of an accident, and when it is determined that no accident has occurred, it is detected that congestion has occurred on the road due to simple congestion. A device is provided.

When it is detected that congestion has occurred on the road due to simple congestion according to the determination result, the sensor unit detects a congestion section in which the driving speed of the vehicle is less than or equal to a reference speed, and the control unit, a simple congestion occurrence point that is the starting point of the congestion section Calculates the length of the congestion section from to the end point of the simple congestion, which is the end point of the congestion section, and when the first reference distance is set through the congestion pattern for each time period for a predetermined period, the length of the congestion section is greater than the first reference distance If it is checked whether the length of the congestion section is shorter than the first reference distance, it is determined that the congestion section is a general congestion phenomenon, and the length of the congestion section is 4 times the length of the congestion section backward from the simple congestion occurrence point. Until the position, the light of the first color is controlled to blink through a first blinking speed with the intensity of the first intensity. Determined as a phenomenon, it is checked whether the length of the congestion section is shorter than a second reference distance set to a value longer than the first reference distance, and when it is confirmed that the length of the congestion section is shorter than the second reference distance, the congestion The section is determined as a serious congestion phenomenon, and from the simple congestion occurrence point to a position three times the length of the congestion section backward, the light of the first color has a second intensity stronger than the first intensity. Controlled to blink through a blinking speed, and when it is confirmed that the length of the congestion section is longer than the second reference distance, the congestion section is judged as a very serious congestion phenomenon, and the length of the congestion section backward from the simple congestion occurrence point is It is possible to control the light of the first color to blink through a second blinking speed faster than the first blinking speed with the intensity of the second intensity up to twice the distance.

The sensor unit, according to the determination result, when it is detected that congestion has occurred on the road due to the occurrence of an accident, detects the number of vehicles in the accident, and the control unit, whether the number of vehicles in the accident is smaller than a preset first reference value If it is confirmed that the number of vehicles in the accident is smaller than the first reference value, it is determined that the accident occurred on the road is a small accident, and the first is a position that is twice the first reference distance backward from the accident point. Until the point, the light of the second color is controlled to flash through the first flashing speed with the intensity of the first intensity, and when it is confirmed that the number of accident-causing vehicles is greater than the first reference value, an accident occurring on the road It is determined as a medium-to-large accident, and it is checked whether the number of accident vehicles is smaller than a second reference value set to a value higher than the first reference value, and if it is confirmed that the number of accident vehicles is smaller than the second reference value, on the road It is determined that the accident occurred is a medium-scale accident, and the light of the second color flashes the first with the intensity of the second intensity from the point of occurrence to a second point that is three times the first reference distance to the rear from the point of occurrence. Control to blink through speed, and when it is confirmed that the number of vehicles in the accident is greater than the second reference value, the accident occurring on the road is determined as a large-scale accident, and 4 times the first reference distance backward from the accident point It is possible to control so that the light of the second color blinks through the second blinking speed with the intensity of the second intensity up to a third point, which is a distant location.

The control unit, if it is determined that the accident occurring on the road is a medium-scale accident, and it is confirmed that the blinking time of the second color light from the accident occurrence point to the second point is longer than the reference time, from the accident occurrence point control so that the light of the second color flashes through the first flashing speed with the intensity of the second intensity from the first point to the first point, and the light of the second color from the first point to the second point Controlled to blink through the first blinking speed with an intensity of 1 intensity, and the accident occurring on the road is determined as a large-scale accident, and the blinking time for the blinking of the light of the second color from the accident occurrence point to the third point is If it is confirmed that it is longer than the reference time, the light of the second color is controlled to blink through the second blinking speed with the intensity of the second intensity from the accident occurrence point to the first point, and from the first point control so that the light of the second color blinks through the first blinking speed with the intensity of the second intensity from the second point to the second point, and the light of the second color from the second point to the third point It can be controlled to blink through the first blinking speed with an intensity of 1 intensity.

When the first vehicle, which is any one of the plurality of vehicles, is identified as the vehicle to be analyzed, the controller acquires 3D data on the surface of the first vehicle through the lidar, and obtains 3D data on the surface of the first vehicle through the camera. Obtaining 2D data for a surface, separating the union region of the 2D data and the 3D data, extracting first data obtained by merging the 2D data and the 3D data, and encoding the first data to input the first input generating a signal, inputting the first input signal to a first artificial neural network, obtaining a first output signal based on a result of the input of the first artificial neural network, and based on the first output signal, the A first classification result for the surface of the first vehicle is generated, the first data is analyzed to detect cracks generated on the surface of the first vehicle, and cracks generated on the surface of the first vehicle are identified by area, Separating a normal region in which a crack is detected below a preset first set value and a damaged region in which a crack is detected above the first set value, and extracting second data in which the damaged region is deleted from the first data, generating a second input signal by encoding the second data, inputting the second input signal to a second artificial neural network, and obtaining a second output signal based on a result of the input of the second artificial neural network; A second classification result is generated for the surface of the first vehicle based on the second output signal, and when the first classification result and the second classification result are the same, the first classification result and the second classification result Any one of the results may be set as a final classification result for the surface of the first vehicle.

According to an embodiment of the present invention, when it is detected that simple congestion has occurred due to an increase in vehicles in the tunnel and on all roads, the light of the first color is controlled to flicker in the rearward direction of the vehicle, and in the tunnel and on all roads. When it is sensed that an accident has occurred, by controlling the light of the second color to flicker in the rear of the vehicle traveling direction, the driver can grasp the traffic situation ahead, thereby preventing a rear collision accident.

On the other hand, the effects according to the embodiments are not limited to those mentioned above, and other effects not mentioned will be clearly understood by those of ordinary skill in the art from the following description.

1 is a perspective view schematically showing a road driving safety device according to an embodiment of the present invention.

2 is a view showing a state in which the safety case of the road driving safety device is installed on the road.

3 is a diagram schematically showing the configuration of a road driving safety device.

4 is a perspective view schematically showing a road driving safety device according to another embodiment of the present invention.

5 is a view for explaining a method of processing an image taken of a vehicle located in a section with congestion on the road in order to determine whether there is a vehicle having a problem in appearance due to the occurrence of an accident according to an embodiment of the present invention; to be.

6 is a view for explaining a learning method employed to process an image of a vehicle to be analyzed in order to determine whether there is a vehicle having an appearance problem due to an accident occurrence according to an embodiment of the present invention.

7 is a flowchart illustrating a process of controlling blinking according to a length of a congestion section according to an embodiment.

8 is a flowchart for explaining a process of controlling blinking according to the number of vehicles having an accident according to an exemplary embodiment.

9 is a flowchart for explaining a process of controlling the blinking step by step according to a distance during a medium-scale accident according to an embodiment.

10 is a flowchart for explaining a process of controlling the blinking step by step according to the distance during a large-scale accident according to an embodiment.

11 is a flowchart illustrating a process of classifying a surface of a vehicle according to an exemplary embodiment.

12 is a diagram for explaining an artificial neural network according to an embodiment.

13 is a diagram for explaining a method of learning an artificial neural network according to an embodiment.

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. However, since various changes may be made to the embodiments, the scope of the patent application is not limited or limited by these embodiments. It should be understood that all modifications, equivalents and substitutes for the embodiments are included in the scope of the rights.

Specific structural or functional descriptions of the embodiments are disclosed for purposes of illustration only, and may be changed and implemented in various forms. Accordingly, the embodiments are not limited to a specific disclosure form, and the scope of the present specification includes changes, equivalents, or substitutes included in the technical spirit.

Although terms such as first or second may be used to describe various elements, these terms should be interpreted only for the purpose of distinguishing one element from another. For example, a first component may be termed a second component, and similarly, a second component may also be termed a first component.

When a component is referred to as being “connected” to another component, it may be directly connected or connected to the other component, but it should be understood that another component may exist in between.

Terms used in the examples are used for the purpose of description only, and should not be construed as limiting. The singular expression includes the plural expression unless the context clearly dictates otherwise. In the present specification, terms such as “comprise” or “have” are intended to designate that a feature, number, step, operation, component, part, or combination thereof described in the specification exists, but one or more other features It is to be understood that this does not preclude the possibility of the presence or addition of numbers, steps, operations, components, parts, or combinations thereof.

Spatially relative terms "below", "beneath", "lower", "above", "upper", etc. It can be used to easily describe the correlation between a component and other components. A spatially relative term should be understood as a term that includes different directions of components during use or operation in addition to the directions shown in the drawings. For example, when a component shown in the drawing is turned over, a component described as “beneath” or “beneath” of another component may be placed “above” of the other component. can Accordingly, the exemplary term “below” may include both directions below and above. Components may also be oriented in other orientations, and thus spatially relative terms may be interpreted according to orientation.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which the embodiment belongs. Terms such as those defined in a commonly used dictionary should be interpreted as having a meaning consistent with the meaning in the context of the related art, and should not be interpreted in an ideal or excessively formal meaning unless explicitly defined in the present application. does not

In addition, in the description with reference to the accompanying drawings, the same components are assigned the same reference numerals regardless of the reference numerals, and the overlapping description thereof will be omitted. In the description of the embodiment, if it is determined that a detailed description of a related known technology may unnecessarily obscure the gist of the embodiment, the detailed description thereof will be omitted.

1 is a perspective view schematically showing a road driving safety device according to an embodiment of the present invention, FIG. 2 is a view showing a state in which a safety case of the road driving safety device is installed on the road, and FIG. 3 is road driving safety It is a diagram schematically showing the configuration of the device.

1 to 3 , the road driving safety device 100 according to the first embodiment of the present invention includes a safety case 10 installed on a road 11 , and a safety case 10 installed in the safety case 10 . The lighting unit 20 that irradiates light in the traveling direction of the vehicle, the control unit 30 that controls so that power is supplied to the lighting unit 20, and the safety case 10 are installed in the safety case 10 to detect the movement of a vehicle or animal and a sensor unit 40 for operating the lighting unit 20 .

As shown in FIG. 2 , the safety case 10 may be installed so as not to be in contact with the vehicle by being mounted on the median and guard rail portions, and may be installed in plurality at regular intervals in a predetermined section.

An installation space is formed inside the safety case 10, and in this embodiment, one is installed in the median, one in the left guardrail part, and one in the right guardrail part, so that a total of three are spaced apart from each other. It will be described as an example to be installed in the state. However, the safety case 10 is not necessarily limited to being installed in three pieces, and two or less or more than three safety cases 10 may be installed in the road median and guard rail portions.

The safety case 10 may be installed at regular intervals along each of the median and guardrails, and preferably installed in the median and guardrails in the tunnel and on all roads 11 .

The lighting unit 20 is installed in the safety case 10 .

The lighting unit 20 may be installed in the safety case 10 to selectively irradiate the lighting forward in the vehicle driving direction.

The lighting unit 20 is installed so as to selectively irradiate the lighting in the forward direction of the vehicle driving direction, and in this embodiment, it will be exemplarily described that it is installed as an LED lighting. Of course, the lighting unit 20 is not necessarily applied as LED lighting, and it is also possible to apply a predetermined lighting that can easily check the median and guard rail portions.

On the other hand, at least three or more safety cases 10 are installed in the median and guard rail portions of the road, and the lighting unit 20 may also be installed in at least three or more in the median and guard rail portions of the road. That is, at least three lighting units 20 may be installed in units of 50 m, and may be installed in units of approximately 150 m.

Accordingly, it is possible for the vehicle driver to easily check the median section and the guard rail portion by the light-emitting action of the lighting unit 20 .

Accordingly, when the driver is driving in a place where no street lights are installed, it is possible to easily check the median and guard rail portions and drive safely. The light-emitting action of the lighting unit 20 may be selectively emitted by the sensing action of the sensor unit 40 to be described later. Hereinafter, the sensor unit 40 will be described in more detail.

On the other hand, the control unit 30 is connected to the lighting unit 20 and may be controlled to emit light forward in the driving direction of the vehicle at night.

The control unit 30 may include a solar cell 31 installed on the side of the road 11 , and a connection unit 33 connecting the solar cell 31 and the lighting unit 20 . The solar cell 31 may be installed on the side of the road to convert and store solar light energy into electrical energy during the daytime. A plurality of solar cells 31 may be installed along the side of the road 11 to smoothly supply power to the lighting units 20 . The solar cell 31 may be installed in a fixed state on the side of the road 11 or may be installed in a movable state so that the installed position can be changed.

The solar cell 31 and the lighting unit 20 may be connected through a connection unit 33 to supply power to the lighting unit 20 .

The connection part 33 may be installed to connect one solar cell 31 and a plurality of lighting parts 20 or to connect the solar cell 31 and the lighting part 20 alone. Therefore, by using solar energy during the daytime through the solar cell 31 to store light energy in the form of electrical energy, and by supplying power to the lighting unit 20 through the connection unit 33 at night, the lighting unit 20 is selectively It is possible to make it luminous.

On the other hand, the safety case 10 is provided with a sensor unit 40 for selectively operating the lighting unit 20 .

The sensor unit 40 may be installed in the safety case 10 to sense a movement of a vehicle or an animal from the side of the road 11 to the central portion of the road. The sensor unit 40 is installed with an infrared sensor, etc., so that it is possible to check the movement of a vehicle or an animal in real time in front of the vehicle driving direction. In the case of two lanes of the road, the sensor unit 40 may adjust the sensing direction of the sensor unit 50 to detect both lanes.

The sensor unit 40 may be installed as one in the safety case 10 , and may be installed in plurality while changing the installation direction. Accordingly, the sensor unit 40 can easily confirm that a predetermined object such as a vehicle or an animal moves from the front of the vehicle in the driving direction to the central portion of the road 11 through both sides of the road 11 .

As such, when it is confirmed that a predetermined object, such as a vehicle or an animal, moves to the central portion of the road 11 through the sensor unit 40 , the lighting unit 20 may be controlled to emit light.

When a movement of a vehicle or an animal is detected by the sensor unit 40 , the warning unit 210 may blink to notify the driver of a danger warning. Accordingly, it is possible for the driver to more effectively sense the danger through the warning unit 210 while checking the median section and the guard rail portion through the lighting unit 20 .

That is, the lighting unit 20 may be installed in the safety case 10 to irradiate light in the front of the vehicle traveling direction, and the warning unit 210 may be installed so that the light flickers in the rear of the vehicle traveling direction.

On the other hand, when the safety case 10 is installed on the road in the tunnel, the sensor unit 40 may be separately installed on the road instead of the safety case 10, for example, it is installed as an image sensor and is installed on the road. It can detect the movement of a driving vehicle and detect whether there is congestion in road driving through the movement of the vehicle. It can be detected whether or not it has occurred.

When it is detected that the vehicle is driving on the road by the sensor unit 40, the control unit 30 controls the lighting unit 20 to emit light, and when the sensor unit 40 detects that there is congestion on the road, The warning unit 210 may control the light of different colors to flicker depending on the cause of congestion.

That is, when it is detected that a simple congestion has occurred on the road, the controller 30 controls the light to blink in the first color in the warning unit 210, and when it is detected that an accident has occurred on the road, the warning unit 210 controls the second You can control the light to flicker in two colors.

Therefore, when the light of the first color, for example, the blue light flickers in the warning unit 210, the vehicle driver can confirm in advance that simple congestion has occurred in the tunnel and on all roads, and the light of the second color, For example, when the yellow light flickers in the warning unit 210, it can be confirmed in advance that an accident has occurred in the tunnel and on all roads.

4 is a view for explaining the occurrence of congestion in road driving according to an embodiment of the present invention.

The sensor unit 40 may detect whether there is congestion in road driving through the movement of a vehicle traveling on the road, and when it is detected that there is congestion in road driving, whether simple traffic congestion has occurred due to an increase in vehicles, and It is possible to detect whether a simple congestion has occurred due to an increase in vehicles.

As shown in (a) of FIG. 4 , when it is detected that there is a traffic jam in the first area 401 , the sensor unit 40 analyzes the image information photographed in the first area 401 , Zone 401 may detect that a traffic jam has occurred due to an increase in vehicles.

As shown in (b) of FIG. 4 , when it is detected that there is a traffic jam in the second area 402 , the sensor unit 40 analyzes image information photographed in the second area 402 , Zone 402 may detect that congestion has occurred due to a traffic accident.

According to one embodiment, when it is sensed that simple traffic jam occurs on the road, the controller 30 controls the light of the first color to flicker from the point where the simple congestion occurs to a position that is a first distance to the rear, and an accident occurs on the road. When it is detected that the accident occurs, it is possible to control the light of the second color to flicker from the point of occurrence to a second distance set to be longer than the first distance to the rear rearward.

For example, the control unit 30 may control the blue light to flicker to a position 50 m rearward from the simple congestion occurrence point, and control the yellow light to flicker to a position 100 m rearward from the accident occurrence point. have.

The sensor unit 40 may detect the driving speed of the vehicle, and detect where the congestion section is in which the driving speed of the vehicle is less than or equal to the reference speed, and the control unit 30 warns the warning unit 210 according to the length of the congestion section. By setting the intensity of the light of the first color that flickers in , it is possible to control the light of the first color to flicker strongly as the stagnation period is longer.

For example, when the congestion section is 10m, the controller 30 may control the light of the first color to blink with a normal intensity, and when the congestion section is 20m, the light of the first color blinks with a stronger intensity can be controlled as much as possible.

The sensor unit 40 may detect the number of accidents occurring vehicles based on the image information obtained through the image sensor, and the control unit 30 blinks in the warning unit 210 according to the number of accidents occurring vehicles. By setting the intensity of the light of the second color, it is possible to control the light of the second color to flicker strongly as the number of vehicles in the accident increases.

For example, the control unit 30 may control the light of the second color to flicker with normal intensity when the number of vehicles in the accident is 2, and when the number of vehicles in the accident is 4, the light of the second color is more It can be controlled to blink with strong intensity.

The control unit 30 may set a third distance that is an accident risk distance according to the number of vehicles in which the accident occurred.

For example, the controller 30 may set the third distance to 10 m when the number of accident-inducing vehicles is two, and may set the third distance to 20 m when the number of accident-occurring vehicles is four.

The control unit 30 controls the light of the second color to flicker from the point of the accident to a position that is a second distance backward from the point of occurrence, while the light of the second color that flickers from the point where the accident occurred to a position that is a third distance from the point of the accident is the third It can be controlled to change to a colored light and flicker.

For example, the control unit 30 controls so that the yellow light blinks to a position 100 m rearward from the accident occurrence point, while controlling the red light instead of yellow to blink 30 m rearward from the accident occurrence point, When the accident point approaches, it can be controlled to change to a different color light and blink.

The controller 30 may control the flashing speed of the light of the third color to be faster as it approaches the accident occurrence point.

For example, the control unit 30 controls the light of the third color to flicker at a rate of blinking once per second from the location 20m to 30m away from the accident point rearward, and 10m to 20m away from the accident point rearward. The third color light can be controlled to blink at a rate of blinking twice per second to the location, and the light of the third color can be controlled to blink at a rate of blinking three times per second to a location 10m rearward from the accident site. have.

The sensor unit 40 may detect a lane in which an accident has occurred based on image information obtained through the image sensor, and the control unit 30 may detect a lane in which an accident has occurred rather than a light flashing on both sides of a lane in which an accident does not occur. You can control the light flickering on both sides to flicker more strongly.

For example, when it is detected that an accident has occurred in the second lane, the control unit 30 may control the yellow light flickering on both sides of the second lane to flash with strong intensity, and the left side of the first lane and the third lane. The yellow light flickering on the right side can be controlled to flicker with normal intensity.

On the other hand, the sensor unit 40 may detect by analyzing the position of the vehicle and the distance between the vehicles through the image sensor, obtain image information of a plurality of vehicles located in a section with congestion on the road, and from the image information It is possible to check the target area image and vehicle state information for each of a plurality of vehicles, and to determine whether there is a vehicle having an appearance problem based on the vehicle state information, thereby generating a determination result as to whether an accident has occurred. .

For example, the sensor unit 40 obtains image information of the first vehicle and the second vehicle located in a section where there is congestion on the road, checks the vehicle state information of each of the first vehicle and the second vehicle, and the second It is checked whether there is a vehicle having a problem in the exterior of each of the first vehicle and the second vehicle, and when it is confirmed that there is no problem in the exterior of all vehicles, a determination result may be generated that an accident has not occurred, and the first vehicle and when it is confirmed that there is a problem in the appearance of at least one of the second vehicles, a result of determining that an accident has occurred may be generated.

When it is determined that an accident has occurred according to the determination result, the sensor unit 40 detects that traffic congestion has occurred due to the occurrence of an accident, and when it is determined that no accident has occurred, it is detected that congestion has occurred on the road due to simple congestion can do.

According to an embodiment, the sensor unit 40 may include an image sensor installed in the tunnel and on the top of all roads, and acquire image information of a plurality of vehicles located in a section where there is congestion on the road through the image sensor. and extract the image information of the vehicle to be analyzed by classifying the obtained image information by vehicle, check the target area image and vehicle condition information from the extracted image information of the vehicle to be analyzed, and check the appearance of the vehicle based on the vehicle condition information It is possible to check whether there is a vehicle with the , and generate a determination result as to whether an accident has occurred.

Specifically, the sensor unit 40 may analyze the target area image of the analysis target vehicle and extract vehicle state information included in the target area. The sensor unit 40 may determine a target area of the vehicle to be analyzed to obtain an image 501 of the target area.

According to an embodiment, the sensor unit 40 may identify an effective vehicle boundary based on color information and texture information in the target area image 501 . The sensor unit 40 may determine whether it is a vehicle for each area based on a color and a texture. The sensor unit 40 may determine whether a vehicle is in each area by sliding a filter of a predefined unit, and the filter may be designed to output a result according to a color and a texture.

According to an embodiment, the sensor unit 40 may extract an effective vehicle area 502 separated by an effective vehicle boundary from the target area image 501 . The sensor unit 40 may extract appearance characteristics of particle objects in the effective vehicle area 502 .

According to an embodiment, the sensor unit 40 may identify a foreign object 503 among particle objects based on the extracted exterior features, and remove the foreign object 503 from the effective vehicle area 502 . have. The sensor unit 40 identifies an object outside a predefined range based on the appearance, color, and texture information of the vehicle body and glass distributed within the effective vehicle area 502 , and determines the identified object as a foreign object 503 . can do.

According to an embodiment, the sensor unit 40 may extract size features 505 to 507 of particle objects in the effective vehicle area 504 from which the foreign object is removed. The sensor unit 40 may identify particle objects within the effective vehicle area 504 and extract size features 505 to 507 from among information describing the identified particle objects for each size. The sensor unit 40 may extract and classify the size features 505 to 507 by size according to a range serving as a reference for classifying the vehicle body and the glass.

According to an embodiment, the sensor unit 40 may classify the particle objects into one of a body object and a glass object, respectively, based on the extracted size features 505 to 507 . The sensor unit 40 may generate a first ratio in the effective vehicle area 504 of at least one particle object classified as a vehicle body object. The first ratio may correspond to a body ratio within the effective vehicle area 504 . The sensor unit 40 may generate vehicle state information in which the characteristics of the vehicle body are reflected by using the first ratio.

According to an embodiment, the sensor unit 40 may generate a second ratio in the effective vehicle area 504 of at least one particle object classified as a glass object. The second proportion may correspond to the proportion of glass in the effective vehicle area 504 . The sensor unit 40 may generate vehicle state information in which the characteristics of glass are reflected by using the second ratio.

According to an embodiment, the sensor unit 40 may generate a third ratio of the foreign object 503 within the effective vehicle area 502 . The third ratio may mean a ratio occupied by foreign substances in the effective vehicle area 502 .

According to an embodiment, the sensor unit 40 may extract a color feature within the effective vehicle area 504 . The sensor unit 40 may generate car color information based on color characteristics.

According to an embodiment, the sensor unit 40 may generate basic vehicle information based on the first ratio, the second ratio, the third ratio, and the vehicle color information. The sensor unit 40 may generate basic vehicle information based on the first ratio, the second ratio, the third ratio, and the car color information according to the image processing of the effective vehicle area 504 .

According to an embodiment, the sensor unit 40 may identify the target area image 501 based on the location, inquire the environment information of the tunnel in which the vehicle is located, and reflect the current environmental state (illuminance, etc.) in the tunnel. Auxiliary vehicle information may be generated.

The sensor unit 40 may generate a feature vector 510 corresponding to the effective vehicle area 502 based on the basic vehicle information and the auxiliary vehicle information. The sensor unit 40 may obtain the output information 512 by applying the feature vector 510 to the pre-trained neural network 511 .

The neural network 511 may be trained to estimate vehicle state information from input according to basic vehicle information generated based on features extracted from the image of the vehicle and auxiliary vehicle information that affects depending on the environmental condition in the tunnel, which is the shooting area. have.

The sensor unit 40 may generate vehicle state information corresponding to the effective vehicle area 502 based on the output information 512 .

The output information 512 may be information including a matching degree for each scratch of the vehicle or may be designed as variables describing a state in which the vehicle is distorted. In addition, the output information 512 may be discretely designed according to the classification of the vehicle. For example, output nodes of the output layer of the neural network 511 correspond to each type of vehicle, and the output nodes correspond to each type of vehicle. Probability values can be output for each classification. Hereinafter, the learning contents of the neural network 511 will be described with reference to FIG. 7 .

According to an embodiment, the learning apparatus may train the neural network 604 for estimating information required to obtain vehicle state information from the target area image. The learning device may be a separate entity different from the sensor unit 40 , but is not limited thereto.

According to an embodiment, the learning apparatus may acquire labeled vehicle images 601 . The learning apparatus may obtain pre-labeled information on each vehicle image for each vehicle type, and the vehicle image may be labeled according to a pre-classified vehicle type.

According to an embodiment, the learning apparatus may provide a first ratio corresponding to the vehicle body object, a glass, based on at least one of color information, texture information, and appearance characteristics and size characteristics of the particle objects of the labeled vehicle images 601 . The basic vehicle information 602 may be generated based on the second ratio corresponding to the object, the third ratio corresponding to the foreign object, and the vehicle color information. The learning apparatus may generate the feature vectors 603 of the vehicle to be analyzed based on the basic vehicle information 602 . Auxiliary vehicle information may be employed in generating the feature vectors 603 of the vehicle to be analyzed.

According to an embodiment, the learning apparatus may obtain the output information 605 by applying the feature vectors 603 to the neural network 604 . The learning apparatus may train the neural network 604 based on the output information 605 and the labels 606 . The learning apparatus may train the neural network 604 by calculating errors corresponding to the output information 605 and optimizing the connection relationships of nodes in the neural network 604 to minimize the errors. The sensor unit 40 may acquire vehicle state information from the target area image by using the neural network 604 that has been trained.

Referring to FIG. 7 , first, in step S701 , when it is detected that there is congestion on the road, the sensor unit 40 determines whether there is a vehicle having a problem in appearance based on vehicle state information in order to check the cause of the congestion. By checking, it is possible to generate a determination result as to whether an accident has occurred, and according to the determination result, when it is determined that an accident has not occurred, it is possible to detect that congestion has occurred on the road due to simple congestion.

In step S702 , the sensor unit 40 may detect a congestion section in which the driving speed of the vehicle is equal to or less than the reference speed on the road.

In step S703, the control unit 30 can identify a simple congestion occurrence point, which is the starting point of the congestion section, and a simple congestion end point, which is an end point of the congestion section, and through the distance from the simple congestion occurrence point to the simple congestion end point, the congestion section length can be calculated.

In step S704 , the controller 30 may determine whether the length of the congestion section is shorter than the first reference distance. In this case, the first reference distance may be set through a congestion pattern for each time period for a predetermined time.

For example, the control unit 30 may check the congestion pattern for each time period for a month, and when the current time is 7 o'clock, the control unit 30 may set the first reference distance through the 7 o'clock congestion pattern.

In setting the first reference distance through the congestion pattern, the controller 30 may set the first reference distance to a longer value as the probability of occurrence of congestion increases.

For example, when the current time is 7 o'clock, the control unit 30 may set the first reference distance to 20 m if, as a result of checking the congestion pattern at 7 o'clock, the probability of occurrence of congestion is 80%, the current time is 8 In the case of a viewer, when it is confirmed that the probability of occurrence of congestion is 90% as a result of checking the congestion pattern at 8 o'clock, the first reference distance may be set to 30 m.

If it is determined in step S704 that the length of the congestion section is shorter than the first reference distance, in step S705, the controller 30 may determine the congestion section as a general congestion phenomenon.

For example, when the length of the congestion section is 30 m and the first reference distance is 50 m, the controller 30 may determine the congestion section as a general congestion phenomenon.

In step S706, the control unit 30 flashes the light of the first color at a first flashing speed with the intensity of the first intensity from the simple congestion occurrence point, which is the starting point of the congestion section, to a position that is four times the length of the congestion section backward. can be controlled as much as possible.

For example, when the length of the congestion section is 30 m, the control unit 30 controls the light of the first color to blink through the first blinking speed with the intensity of the first intensity from the simple congestion occurrence point to a position 120 m rearward. can do.

Meanwhile, if it is determined in step S704 that the length of the congestion section is longer than the first reference distance, in step S707 , the controller 30 may determine the congestion section as a special congestion phenomenon.

In step S708 , the controller 30 may determine whether the length of the congestion section is shorter than the second reference distance. In this case, the second reference distance may be set to a value longer than the first reference distance.

If it is determined that the length of the congestion section is shorter than the second reference distance in step S708 , in step S709 , the controller 30 may determine the congestion section as a serious congestion phenomenon.

For example, when the length of the congestion section is 80 m and the second reference distance is 100 m, the controller 30 may determine the congestion section as a serious congestion phenomenon.

In step S710, the control unit 30 flashes the light of the first color with the intensity of the second intensity at a first flashing speed from the simple congestion occurrence point, which is the starting point of the congestion section, to a position three times the length of the congestion section backwards. can be controlled as much as possible. In this case, the second intensity may be set to a light intensity stronger than the first intensity. For example, when the first intensity is 10lx, the second intensity may be set to 20lx.

For example, when the length of the congestion section is 80 m, the control unit 30 controls the light of the first color to flash through the first flashing speed with the intensity of the second intensity from the simple congestion occurrence point to a position 240 m to the rear. can do.

On the other hand, if it is confirmed in step S708 that the length of the congestion section is longer than the second reference distance, in step S711 , the controller 30 may determine the congestion section as a very serious congestion phenomenon.

For example, when the length of the congestion section is 130 m and the second reference distance is 100 m, the controller 30 may determine the congestion section as a very serious congestion phenomenon.

In step S712, the control unit 30 flashes the light of the first color at a second flashing speed with the intensity of the second intensity from the simple congestion occurrence point, which is the start point of the congestion section, to a position that is twice the length of the congestion section backward. can be controlled as much as possible. In this case, the second flashing speed may be set to be faster than the first flashing speed. For example, when the first flashing speed is a flashing speed once per second, the second flashing speed is two per second. It can be set to flashing speed.

For example, when the length of the congestion section is 130 m, the control unit 30 controls the light of the first color to flash through the second flashing speed with the intensity of the second intensity from the simple congestion occurrence point to a position 260 m to the rear. can do.

Referring to FIG. 8 , first, in step S801 , when the sensor unit 40 detects that there is congestion on the road, to determine the cause of the congestion, based on the vehicle state information, whether there is a vehicle having a problem in appearance By checking, a determination result as to whether an accident has occurred may be generated, and if it is determined that an accident has occurred according to the determination result, it may be detected that congestion has occurred on the road due to the occurrence of the accident.

In step S802 , the sensor unit 40 may detect the number of accidents occurring vehicles.

In step S803 , the controller 30 may determine whether the number of accident-causing vehicles is smaller than a preset first reference value. In this case, the first reference value may be set differently depending on the embodiment.

If it is determined in step S803 that the number of vehicles having an accident is smaller than the first reference value, in step S804, the controller 30 may determine the accident occurring on the road as a small accident.

For example, when the number of vehicles having an accident is 2 and the first reference value is 3, the controller 30 may determine the accident occurring on the road as a small accident.

In step S805, the control unit 30 causes the light of the second color to flash through the first flashing speed with the intensity of the first intensity from the accident point to the first point that is twice the first reference distance rearward. can be controlled

For example, when the first reference distance is 50 m, the control unit 30 determines that the accident occurring on the road is a small accident, sets a position 100 m rearward from the accident point as the first point, and from the accident point The light of the second color may be controlled to blink through the first blinking speed with the intensity of the first intensity up to the first point.

On the other hand, if it is confirmed in step S803 that the number of vehicles in which the accident occurs is greater than the first reference value, in step S806, the controller 30 may determine the accident occurring on the road as a serious accident.

In step S807 , the control unit 30 may determine whether the number of vehicles having an accident is smaller than a preset second reference value. In this case, the second reference value may be set to be higher than the first reference value.

If it is confirmed in step S807 that the number of vehicles having an accident is smaller than the second reference value, in step S808 , the controller 30 may determine the accident occurring on the road as a medium-scale accident.

For example, when the number of vehicles having an accident is 4 and the second reference value is 5, the controller 30 may determine the accident occurring on the road as a medium-scale accident.

In step S809, the controller 30 causes the light of the second color to flash through the first flashing speed with the intensity of the second intensity from the accident occurrence point to the second point that is three times the first reference distance to the rear. can be controlled

For example, when the first reference distance is 50 m, the control unit 30 determines that the accident occurring on the road is a medium-scale accident, sets a position 150 m rearward from the accident point as the second point, and from the accident point The light of the second color may be controlled to blink through the first blinking speed with the intensity of the second intensity up to the second point.

On the other hand, if it is confirmed in step S807 that the number of vehicles having an accident is greater than the second reference value, in step S810 , the controller 30 may determine that the accident occurring on the road is a large-scale accident.

For example, when the number of vehicles having an accident is 6 and the second reference value is 5, the controller 30 may determine that the accident occurring on the road is a large-scale accident.

In step S811, the control unit 30 causes the light of the second color to flash through the second flashing speed with the intensity of the second intensity to the third point that is four times the first reference distance rearward from the accident occurrence point. can be controlled

For example, if the first reference distance is 50 m, the control unit 30 determines that the accident occurring on the road is a large-scale accident, sets a position 200 m rearward from the accident point as the third point, and from the accident point The light of the second color may be controlled to blink through the second blinking speed with the intensity of the second intensity up to the third point.

Referring to FIG. 9 , first, in step S901 , when it is confirmed that the number of vehicles having an accident is greater than a first reference value and smaller than a second reference value, the controller 30 may determine the accident occurring on the road as a medium-scale accident.

In step S902 , the controller 30 may control the light of the second color to blink through the first blinking speed with the intensity of the second intensity from the accident occurrence point to the second point.

In step S903, the control unit 30 may check whether the accident management is completed after a predetermined time has elapsed. At this time, when it is confirmed that the congestion caused by the accident has been resolved, the control unit 30 may confirm that the accident management has been completed.

When it is confirmed that the accident management is completed in step S903, the control unit 30 may control the light of the second color that is blinking from the accident occurrence point to the second point not to blink anymore.

If it is confirmed in step S903 that the accident management has not been completed, in step S904, the control unit 30 checks the blinking time during which the light of the second color that is blinking from the accident occurrence point to the second point maintains the blinking state, , it is possible to check whether the blinking time is longer than the preset reference time. In this case, the reference time may be set differently depending on the embodiment.

If it is confirmed in step S904 that the blinking time is shorter than the reference time, it returns to step S902, and the control unit 30 sets the first blinking speed with the intensity of the second intensity of the light of the second color from the accident point to the second point. By controlling it to blink through, it is possible to maintain the blinking state.

If it is confirmed in step S904 that the blinking time is longer than the reference time, in step S905, the control unit 30 flashes the light of the second color from the accident occurrence point to the first point with the intensity of the second intensity through the first blinking speed. and control so that the light of the second color from the first point to the second point blinks with the intensity of the first intensity through the first blinking speed.

In step S906 , the control unit 30 may check whether the accident management is completed after a predetermined time has elapsed.

When it is confirmed that the accident management is completed in step S906 , the controller 30 may control the light of the second color that is blinking from the accident occurrence point to the second point not to blink anymore.

If it is confirmed that the accident management is not completed in step S906, the control unit 30 returns to step S905, and the control unit 30 transmits the light of the second color from the accident occurrence point to the first point through the first flashing speed with the intensity of the second intensity. The blinking state may be maintained by controlling the blinking, and controlling the light of the second color from the first point to the second point to blink through the first blinking speed with the intensity of the first intensity.

Referring to FIG. 10 , first, in step S1001 , when it is confirmed that the number of vehicles having an accident is greater than a second reference value, the controller 30 may determine an accident occurring on the road as a large-scale accident.

In step S1002 , the controller 30 may control the light of the second color to blink through the second blinking speed with the intensity of the second intensity from the accident occurrence point to the third point.

In step S1003, the control unit 30 may check whether the accident management is completed after a predetermined time has elapsed. At this time, when it is confirmed that the congestion caused by the accident has been resolved, the control unit 30 may confirm that the accident management has been completed.

When it is confirmed that the accident management is completed in step S1003, the controller 30 may control the light of the second color that is blinking from the accident occurrence point to the third point not to blink anymore.

If it is confirmed in step S1003 that the accident management is not completed, in step S1004, the control unit 30 checks the blinking time during which the light of the second color that is blinking from the accident occurrence point to the third point maintains the blinking state, , it is possible to check whether the blinking time is longer than the preset reference time. In this case, the reference time may be set differently depending on the embodiment.

If it is confirmed that the blinking time is shorter than the reference time in step S1004, the process returns to step S1002, and the control unit 30 determines the second blinking speed with the intensity of the second intensity of the light of the second color from the accident point to the third point. By controlling it to blink through, it is possible to maintain the blinking state.

If it is confirmed in step S1004 that the blinking time is longer than the reference time, in step S1005, the control unit 30 blinks the light of the second color from the accident occurrence point to the first point with the second intensity of the second blinking speed. control so that the light of the second color from the first point to the second point blinks through the first blinking speed with the intensity of the second intensity, and the light of the second color from the second point to the third point It can be controlled to blink through the first blinking speed with an intensity of 1 intensity.

In step S1006, the control unit 30 may check whether the accident management is completed after a predetermined time has elapsed.

When it is confirmed that the accident management is completed in step S1006, the controller 30 may control the light of the second color that is blinking from the accident occurrence point to the third point not to blink anymore.

If it is confirmed that the accident management is not completed in step S1006, the process returns to step S1005, and the control unit 30 allows the light of the second color from the accident occurrence point to the first point through the second flashing speed with the intensity of the second intensity. control to blink, and control so that the light of the second color from the first point to the second point blinks through the first blinking speed with the intensity of the second intensity, and the light of the second color from the second point to the third point By controlling the flashing through the first flashing speed with the intensity of the first intensity, the flashing state may be maintained.

First, the controller 30 may identify a first vehicle, which is any one of a plurality of vehicles located in a section with congestion on the road, as an analysis target vehicle.

In step S1301, the controller 30 may acquire 3D data on the surface of the first vehicle through the lidar. Here, the 3D data is a 3D image of the surface of the first vehicle. To this end, the control unit 30 may be connected to a device equipped with a lidar through wired or wireless.

In step S1302, the controller 30 may acquire 2D data on the surface of the first vehicle through the camera. Here, the 2D data is a 2D image of the surface of the first vehicle. To this end, the controller 30 may be connected to a device equipped with a camera through wired or wireless.

In step S1303 , the controller 30 may separate the union region of the 2D data and the 3D data to extract the first data obtained by merging the 2D data and the 3D data.

Specifically, the controller 30 can compare the 2D data and the 3D data to identify overlapping union regions, separate the union regions from the 2D data and separate the union regions from the 3D data, and merge the separated union regions. Thus, the first data may be extracted. Here, the first data may consist of 4 channels, 3 channels may be 2D data representing an RGB value, and 1 channel may be data representing a 3D depth value.

The controller 30 may generate a first input signal by encoding the first data.

Specifically, the controller 30 may generate the first input signal by encoding the pixels of the first data with color information. The color information may include, but is not limited to, RGB color information, brightness information, saturation information, and depth information. The controller 30 may convert the color information into a numerical value, and may encode the first data in the form of a data sheet including the value.

The controller 30 may input the first input signal to the first artificial neural network previously learned in the road driving safety device 100 .

The first artificial neural network according to an embodiment is composed of a feature extraction neural network and a classification neural network, and the feature extraction neural network sequentially stacks a convolutional layer and a pooling layer on an input signal. The convolution layer includes a convolution operation, a convolution filter, and an activation function. The calculation of the convolution filter is adjusted according to the matrix size of the target input, but a 9X9 matrix is generally used. The activation function generally uses, but is not limited to, a ReLU function, a sigmoid function, and a tanh function. The pooling layer is a layer that reduces the size of the input matrix, and uses a method of extracting representative values by tying pixels in a specific area. In general, the average value or the maximum value is often used for the calculation of the pooling layer, but is not limited thereto. The operation is performed using a square matrix, usually a 9x9 matrix. The convolutional layer and the pooling layer are repeated alternately until the corresponding input becomes small enough while maintaining the difference.

According to an embodiment, the classification neural network has a hidden layer and an output layer. Classification of the first artificial neural network for classifying the roughness level of the surface of the first vehicle The neural network consists of five or less hidden layers, and may include a total of 50 or less hidden layer nodes. The activation function of the hidden layer uses a ReLU function, a sigmoid function, and a tanh function, but is not limited thereto. There is a total of one output layer node of the classification neural network, and an output value for classification of the surface of the first vehicle may be output to the output layer node. A detailed description of the first artificial neural network will be described later with reference to FIG. 12 .

The controller 30 may obtain a first output signal based on a result of the input of the first artificial neural network.

In operation S1304 , the controller 30 may generate a first classification result for the surface of the first vehicle based on the first output signal. Here, the first classification result may include information on which stage the surface of the first vehicle is classified.

For example, as a result of checking the output value of the first output signal, when the output value is 1, the control unit 30 generates a first classification result that the surface of the first vehicle corresponds to stage 1, and when the output value is 2 , a first classification result may be generated as the surface of the first vehicle corresponds to the second stage. It can be seen that the higher the step, the rougher the surface of the first vehicle becomes.

In step S1105 , the controller 30 may analyze the first data to detect a crack generated on the surface of the first vehicle. In the case of crack detection, only a portion confirmed to be larger than a certain size through image analysis may be detected as a crack occurring on the surface of the first vehicle.

In step S1106 , the control unit 30 may identify cracks generated on the surface of the first vehicle for each region, and distinguish a normal region from a damaged region.

Specifically, the control unit 30 divides the first data into a plurality of areas such as a first area and a second area, and can check how many cracks are detected for each area, and the number of cracks is less than the first set value. The detected area may be divided into a normal area, and an area in which cracks greater than or equal to the first set value are detected may be classified as a damaged area. In this case, the first set value may be set differently depending on the embodiment.

In step S1107 , the controller 30 may extract second data from which the damaged area is deleted from the first data.

For example, the image in the first data consists of a first region, a second region, and a third region, wherein the first region is divided into a damaged region, and the second region and the third region are divided into a normal region. In this case, the controller 30 may extract an image including only the second region and the third region as the second data.

The controller 30 may generate a second input signal by encoding the second data.

Specifically, the controller 30 may generate a second input signal by encoding pixels of the second data with color information. The color information may include, but is not limited to, RGB color information, brightness information, saturation information, and depth information. The controller 30 may convert the color information into a numerical value, and may encode the second data in the form of a data sheet including the value.

The controller 30 may input the second input signal to the second artificial neural network previously learned in the road driving safety device 100 .

The second artificial neural network according to an embodiment consists of a feature extraction neural network and a classification neural network, and the feature extraction neural network sequentially stacks a convolutional layer and a pooling layer on an input signal. The convolution layer includes a convolution operation, a convolution filter, and an activation function. The calculation of the convolution filter is adjusted according to the matrix size of the target input, but a 9X9 matrix is generally used. The activation function generally uses, but is not limited to, a ReLU function, a sigmoid function, and a tanh function. The pooling layer is a layer that reduces the size of the input matrix, and uses a method of extracting representative values by tying pixels in a specific area. In general, the average value or the maximum value is often used for the calculation of the pooling layer, but is not limited thereto. The operation is performed using a square matrix, usually a 9x9 matrix. The convolutional layer and the pooling layer are repeated alternately until the corresponding input becomes small enough while maintaining the difference.

According to an embodiment, the classification neural network has a hidden layer and an output layer. Classification of the second artificial neural network for classifying the roughness level of the surface of the first vehicle The neural network consists of five or less hidden layers, and may include a total of 50 or less hidden layer nodes. The activation function of the hidden layer uses a ReLU function, a sigmoid function, and a tanh function, but is not limited thereto. There is a total of one output layer node of the classification neural network, and an output value for classification of the surface of the first vehicle may be output to the output layer node. A detailed description of the second artificial neural network will be described later with reference to FIG. 12 .

The controller 30 may obtain a second output signal based on a result of the input of the second artificial neural network.

In operation S1108 , the controller 30 may generate a second classification result for the surface of the first vehicle based on the second output signal. Here, the second classification result may include information on which stage the surface of the first vehicle is classified.

For example, as a result of checking the output value of the second output signal, when the output value is 1, the control unit 30 generates a second classification result as that the surface of the first vehicle corresponds to stage 1, and when the output value is 2 , a second classification result may be generated as the surface of the first vehicle corresponds to the second stage.

In operation S1109 , the controller 30 may set a final classification result for the surface of the first vehicle based on the first classification result and the second classification result.

Specifically, when the first classification result and the second classification result are the same, the controller 30 may set any one of the first classification result and the second classification result as the final classification result for the surface of the first vehicle.

The controller 30 may determine whether there is a problem in the appearance of the first vehicle by using the final classification result, and through this, determine whether an accident has occurred in the first vehicle.

The artificial neural network 1200 according to an embodiment may be any one of a first artificial neural network and a second artificial neural network. In the case of the first artificial neural network, information on which level of roughness the surface of the first vehicle is classified may be output as a first input signal generated by encoding the first data as an input. In the case of the second artificial neural network, the second input signal generated by encoding the second data may be input as an input, and information on which stage of the roughness stage of the first vehicle surface is classified may be output.

Encoding according to an embodiment may be performed by storing color information for each pixel of an image in the form of a digitized data sheet, and the color information includes RGB color, brightness information, saturation information, and depth information of one pixel. can, but is not limited to.

According to an embodiment, the artificial neural network 1200 is composed of a feature extraction neural network 1210 and a classification neural network 1220, and the feature extraction neural network 1210 separates the first vehicle region and the background region from the image. may be performed, and the classification neural network 1220 may perform an operation of determining whether the surface of the first vehicle is classified into any roughness stage in the image.

In the method for the feature extraction neural network 1210 to distinguish the region of the first vehicle and the background region, the change in each value of color information from the data sheet of the input signal encoding the image is at least 6 out of 8 pixels including one pixel. A bundle of pixels that are detected as having a change of 30% or more may be used as a boundary between the area of the first vehicle and the background area, but is not limited thereto.

The feature extraction neural network 1210 proceeds by sequentially stacking a convolutional layer and a pooling layer on the input signal. The convolution layer includes a convolution operation, a convolution filter, and an activation function. The calculation of the convolution filter is adjusted according to the matrix size of the target input, but a 9X9 matrix is generally used. The activation function generally uses, but is not limited to, a ReLU function, a sigmoid function, and a tanh function. The pooling layer is a layer that reduces the size of the input matrix, and uses a method of extracting representative values by tying pixels in a specific area. In general, the average value or the maximum value is often used for the calculation of the pooling layer, but is not limited thereto. The operation is performed using a square matrix, usually a 9x9 matrix. The convolutional layer and the pooling layer are repeated alternately until the corresponding input becomes small enough while maintaining the difference.

The classification neural network 1220 checks the surface of the region of the first vehicle separated from the background through the feature extraction neural network 1210, and checks whether it is similar to the predefined roughness step surface state, It is possible to determine whether the surface is classified into which level of roughness level. In order to compare the roughness step-by-step surface state, information stored in the database of the road driving safety device 100 may be utilized.

The classification neural network 1220 has a hidden layer and an output layer, and is composed of five or less hidden layers, including a total of 50 or less hidden layer nodes, and the activation function of the hidden layer is a ReLU function and a sigmoid function. and tanh functions, but is not limited thereto.

The classification neural network 1220 may include only one output layer node in total.

The output of the classification neural network 1220 is an output value of which stage of the roughness stage the surface of the first vehicle is classified, and may indicate which stage of the roughness stage it corresponds to. For example, when the output value is 1, it may indicate that the surface of the first vehicle corresponds to the first stage, and when the output value is 2, it may indicate that the surface of the first vehicle corresponds to the second stage.

According to an embodiment, the artificial neural network 1200 may learn by receiving the first learning signal generated by the corrected correct answer input by the user when the user discovers a problem in the output according to the artificial neural network 1200 . The problem of output according to the artificial neural network 1200 may mean a case in which an output value classified into another stage among the roughness stages is output with respect to the surface of the first vehicle.

The first learning signal according to an embodiment is created based on the error between the correct answer and the output value, and in some cases, SGD using delta, a batch method, or a method following a backpropagation algorithm may be used. The artificial neural network 1200 performs learning by modifying the existing weights according to the first learning signal, and may use momentum in some cases. A cost function can be used to calculate the error, and a cross entropy function can be used as the cost function. Hereinafter, the learning contents of the artificial neural network 1200 will be described with reference to FIG. 13 .

According to an embodiment, the learning apparatus may train the artificial neural network 1200 . The learning apparatus may be a separate entity different from the road driving safety apparatus 100 , but is not limited thereto.

According to an embodiment, the artificial neural network 1200 includes an input layer to which training samples are input and an output layer to output training outputs, and may be learned based on a difference between the training outputs and the first labels. Here, the first labels may be defined based on a representative image registered for each roughness level. The artificial neural network 1200 is connected as a group of a plurality of nodes, and is defined by weights between the connected nodes and an activation function that activates the nodes.

The learning apparatus may train the artificial neural network 1200 using a Gradient Decent (GD) technique or a Stochastic Gradient Descent (SGD) technique. The learning apparatus may use a loss function designed by the outputs and labels of the artificial neural network 1200 .

The learning apparatus may calculate a training error using a predefined loss function. The loss function may be predefined with a label, an output, and a parameter as input variables, where the parameter may be set by weights in the artificial neural network 1200 . For example, the loss function may be designed in a Mean Square Error (MSE) form, an entropy form, or the like, and various techniques or methods may be employed in an embodiment in which the loss function is designed.

The learning apparatus may find weights affecting the training error by using a backpropagation technique. Here, the weights are relationships between nodes in the artificial neural network 1200 . The learning apparatus may use the SGD technique using labels and outputs to optimize the weights found through the backpropagation technique. For example, the learning apparatus may update the weights of the loss function defined based on the labels, outputs, and weights using the SGD technique.

According to an embodiment, the learning apparatus may obtain the representative images 1301 for each level of the labeled training roughness from the database of the road safety apparatus 100 . The learning apparatus may obtain pre-labeled information on the representative images 1301 for each roughness stage, and the representative images 1301 for each roughness stage may be labeled according to the pre-classified roughness stage.

According to an embodiment, the learning apparatus may acquire 1000 labeled training roughness step-by-step representative images 1301, and based on the labeled training roughness step-by-step representative images 1301, the first training roughness step-by-step vectors ( 1302) can be created. Various methods may be employed to extract the first training roughness step vectors 1302 .

According to an embodiment, the learning apparatus may obtain the first training outputs 1303 by applying the first training roughness step vectors 1302 to the artificial neural network 1200 . The learning apparatus may train the artificial neural network 1200 based on the first training outputs 1303 and the first labels 1304 . The learning apparatus may train the artificial neural network 1200 by calculating the training errors corresponding to the first training outputs 1303 and optimizing the connection relationship of nodes in the artificial neural network 1200 to minimize the training errors. .

The embodiments described above may be implemented by a hardware component, a software component, and/or a combination of a hardware component and a software component. For example, the apparatus, methods and components described in the embodiments may include, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate (FPGA). array), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions, may be implemented using one or more general purpose or special purpose computers. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to execution of the software. For convenience of understanding, although one processing device is sometimes described as being used, one of ordinary skill in the art will recognize that the processing device includes a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that may include For example, the processing device may include a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as parallel processors.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the embodiment, or may be known and available to those skilled in the art of computer software. Examples of the computer-readable recording medium include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic such as floppy disks. - includes magneto-optical media, and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. A hardware device may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

The software may comprise a computer program, code, instructions, or a combination of one or more thereof, which configures a processing device to operate as desired or is independently or collectively processed You can command the device. The software and/or data may be any kind of machine, component, physical device, virtual equipment, computer storage medium or device, to be interpreted by or to provide instructions or data to the processing device. , or may be permanently or temporarily embody in a transmitted signal wave. The software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and data may be stored in one or more computer-readable recording media.

As described above, although the embodiments have been described with reference to the limited drawings, various technical modifications and variations may be applied to those skilled in the art based on the description. For example, the described techniques are performed in a different order than the described method, and/or the described components of the system, structure, apparatus, circuit, etc. are combined or combined in a different form than the described method, or other components Or substituted or substituted by equivalents may achieve an appropriate result.

Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

Claims

a safety case installed on the road at regular intervals in a certain section so that it does not come into contact with the vehicle by being mounted on the median section and the guard rail portion of the road;

a lighting unit installed in the safety case to irradiate light in a forward direction of the vehicle;

a warning unit installed in the safety case so that the light flickers in the rear of the vehicle traveling direction;

Detects the movement of a vehicle traveling on the road, detects whether there is congestion in road driving through the movement of the vehicle, and detects that there is congestion in road driving. a sensor unit that detects whether it has occurred; and

When it is detected that the vehicle is driving on the road by the sensor unit, the lighting unit controls light to be irradiated, and when it is detected that simple congestion has occurred by the sensor unit, the warning unit blinks the light in the first color. and a control unit for controlling the light to blink in a second color in the warning unit when it is detected that an accident has occurred by the sensor unit,

The sensor unit,

It detects by analyzing the location of the vehicle and the distance between the vehicles through the image sensor,

Obtaining image information of a plurality of vehicles located in a section with congestion on the road, classifying the obtained image information for each vehicle to extract image information of a vehicle to be analyzed, and an image of a target area from the image information of the vehicle to be analyzed And check the vehicle state information, check whether there is a vehicle having an appearance problem based on the vehicle state information, and generate a determination result as to whether an accident has occurred,

According to the determination result, when it is determined that an accident has occurred, it is detected that congestion has occurred on the road due to the occurrence of the accident, and when it is determined that no accident has occurred, it is detected that congestion has occurred on the road due to simple congestion,

Safety devices for driving in tunnels and on all roads.
According to claim 1,

The sensor unit,

According to the determination result, when it is detected that congestion has occurred on the road due to simple congestion, a congestion section in which the driving speed of the vehicle is less than or equal to the reference speed is detected,

The control unit is

calculating the length of the congestion section from the simple congestion occurrence point, which is the starting point of the congestion section, to the simple congestion end point, which is the end point of the congestion section,

When the first reference distance is set through the congestion pattern for each time period for a predetermined period, it is checked whether the length of the congestion section is shorter than the first reference distance,

When it is confirmed that the length of the congestion section is shorter than the first reference distance, it is determined that the congestion section is a general congestion phenomenon, and the first color control so that the light of the light blinks through the first blinking speed with the intensity of the first intensity,

If it is confirmed that the length of the congestion section is longer than the first reference distance, it is determined that the congestion section is a special congestion phenomenon, and whether the length of the congestion section is shorter than a second reference distance set to a value longer than the first reference distance check whether

If it is confirmed that the length of the congestion section is shorter than the second reference distance, it is determined that the congestion section is a serious congestion phenomenon, and the first color control so that the light of the light blinks through the first blinking speed with an intensity of a second intensity stronger than the first intensity,

If it is confirmed that the length of the congestion section is longer than the second reference distance, it is determined that the congestion section is a very serious congestion phenomenon, and the first Controlling the light of the color to blink through a second blinking speed faster than the first blinking speed with the intensity of the second intensity,

Safety devices for driving in tunnels and on all roads.
3. The method of claim 2,

The sensor unit,

According to the determination result, when it is detected that congestion has occurred on the road due to the occurrence of an accident, the number of vehicles in the accident is detected,

The control unit is

Check whether the number of the accident-causing vehicle is smaller than a preset first reference value,

If it is confirmed that the number of vehicles in which the accident occurred is smaller than the first reference value, it is determined that the accident occurred on the road is a small accident, and from the accident point to the first point that is twice the first reference distance rearward, the Controlling the light of the second color to blink through the first blinking speed with the intensity of the first intensity,

When it is confirmed that the number of vehicles in the accident is greater than the first reference value, the accident occurring on the road is determined as a major accident, and whether the number of vehicles in the accident is smaller than the second reference value set to a value higher than the first reference value check,

When it is confirmed that the number of vehicles in the accident is smaller than the second reference value, it is determined that the accident occurred on the road is a medium-scale accident, and from the accident point to a second point that is three times the first reference distance to the rear, Controlling the light of the second color to blink through the first blinking speed with the intensity of the second intensity,

When it is confirmed that the number of vehicles in the accident is greater than the second reference value, it is determined that the accident occurred on the road is a large-scale accident, and from the accident point to a third point that is 4 times the first reference distance rearward, Controlling the light of the second color to blink through the second blinking speed with the intensity of the second intensity,

Safety devices for driving in tunnels and on all roads.
4. The method of claim 3,

The control unit is

If it is determined that the accident occurring on the road is a medium-scale accident, and it is confirmed that the blinking time of the second color light from the accident occurrence point to the second point is longer than the reference time, the first point from the accident occurrence point control so that the light of the second color flickers through the first flashing speed with the intensity of the second intensity, and the light of the second color from the first point to the second point has the intensity of the first intensity to control to blink through the first blinking speed,

If it is determined that the accident occurring on the road is a large-scale accident, and it is confirmed that the blinking time of the second color light from the accident occurrence point to the third point is longer than the reference time, the first control so that the light of the second color blinks through the second blinking speed with the intensity of the second intensity up to a point, and the light of the second color from the first point to the second point of the second intensity Control to blink through the first blinking speed with intensity, and control so that the light of the second color from the second point to the third point blinks through the first blinking speed with the intensity of the first intensity,

Safety devices for driving in tunnels and on all roads.
The method of claim 1,

The control unit is

When the first vehicle, which is any one of the plurality of vehicles, is identified as the vehicle to be analyzed, 3D data on the surface of the first vehicle is obtained through lidar, and 2D data on the surface of the first vehicle is obtained through the camera. acquire data,

separating the union region of the 2D data and the 3D data to extract the first data obtained by merging the 2D data and the 3D data;

Encoding the first data to generate a first input signal,

inputting the first input signal to a first artificial neural network, and obtaining a first output signal based on a result of the input of the first artificial neural network;

generate a first classification result for the surface of the first vehicle based on the first output signal;

Analyze the first data to detect cracks generated on the surface of the first vehicle,

The cracks generated on the surface of the first vehicle are checked for each region, and a normal region in which cracks are detected less than a preset first set value and a damaged region in which cracks are detected above the first set value are distinguished.

extracting second data from which the damaged area is deleted from the first data;

generating a second input signal by encoding the second data;

inputting the second input signal to a second artificial neural network, and obtaining a second output signal based on a result of the input of the second artificial neural network;

generating a second classification result for the surface of the first vehicle based on the second output signal;

When the first classification result and the second classification result are the same, setting any one of the first classification result and the second classification result as a final classification result for the surface of the first vehicle,

Safety devices for driving in tunnels and on all roads.