KR20230105231A - Systems and method for preventing pedestrian traffic accidents - Google Patents

Abstract

Disclosed are a system and method for preventing a pedestrian traffic accident. According to the present invention, provided is a system for preventing a pedestrian traffic accident, which includes: a camera device which generates image data for sidewalk areas and shoulder areas; a server which receives the image data and detects a pedestrian's departure from the sidewalk area; and an alarm unit controlled from the server and displaying a signal according to the departure.

Description

Systems and methods for preventing pedestrian traffic accidents {SYSTEMS AND METHOD FOR PREVENTING PEDESTRIAN TRAFFIC ACCIDENTS}

The present invention relates to systems and methods for preventing pedestrian traffic accidents. More specifically, it relates to a system and method for automatically detecting and notifying a driver when a pedestrian crosses over to the shoulder.

In general, the children's protection area means a special protection area for children around schools including kindergartens as well as elementary schools. Various safety facilities are installed by designating roads within a radius of 300m, mainly centered on the main entrance of elementary schools, etc., and vehicles passing there must operate at 30km/h or less, and regulations such as illegal parking and stopping can be enforced. It is a special protection area for children, also known as a school zone.

Recently, technologies have been proposed that explicitly guide the driver of a speeding vehicle by monitoring whether or not the speed limit is observed, and conventionally, the driving speed of the vehicle is detected and displayed on a traffic safety sign, and also, driving exceeding the speed limit The plate number of the speeding vehicle is detected along with the vehicle speed, and the license plate number and vehicle speed of the speeding vehicle are displayed on the traffic safety sign.

Looking at the method of detecting the vehicle speed in the above prior art, a method of detecting the speed by embedding two loop coils in the road and detecting the pressure pressed by the vehicle, emitting laser light toward the vehicle A method of detecting the speed according to the time point at which the light is reflected and receiving the light, a method of detecting the speed by image processing by capturing a moving vehicle with a camera, etc. have been used. Here, the method using a loop coil is not only difficult to maintain and difficult to construct due to frequent breakdowns, but the method using laser light has a high possibility of malfunction and is limited to roads that can be applied. Recently, a method using image processing this is mainly used

On the other hand, in the child protection zone, despite the restrictions on illegal parking and stopping, temporary parking is sometimes made, and in addition, people leave objects on the road, so the driver cannot check the child because the view is obstructed by these objects or parked vehicles. A lot of time. Moreover, children who are vulnerable to transportation have weak attention and sometimes just cross the road without checking the vehicle. In this case, if the driver does not check the child, the probability of leading to a traffic accident is very high. No measures were taken to prevent accidents.

KR101031995B1 (Title of invention: Explicit safety traffic guidance system in child protection zone)

An object of the present invention is to provide a system and method capable of automatically detecting and notifying a driver of a pedestrian, such as a child, suddenly leaving a sidewalk in a specific area and crossing a shoulder or roadway.

In order to solve the above problems, the present invention is a system for preventing traffic accidents of pedestrians, a camera device for generating image data for a sidewalk area and a shoulder area, receiving the image data, and the pedestrian's guidance It may include a server that detects departure from the area and an alarm unit controlled by the server and displaying a signal according to the departure.

In addition, the sidewalk area and the shoulder area are areas around a child protection area, and the server extracts a feature point for a pedestrian shorter than a predetermined height among the pedestrians from the image data, and detects the departure based on the feature point. can

Also, the camera device may include a housing including a through hole in a side wall, a lens installed in the through hole, and a driving unit for driving the lens.

In addition, the server derives a feature point for the pedestrian, and based on the feature point, when the pedestrian is firstly detected in the sidewalk area and secondly detected in the shoulder area, it can be detected that the pedestrian has departed.

In addition, the notification unit may be a lighted display device embedded around the shoulder area.

In addition, in order to solve the above problems, the present invention includes the steps of receiving image data for a sidewalk area and a shoulder area, extracting feature points for a pedestrian from the image data, The method may include detecting a departure state from the area and transmitting a warning message to an external device when the departure state is detected.

In addition, in order to solve the above problems, the present invention is a non-transitory computer readable medium storing instructions, wherein the instructions are non-transitory computer readable medium that, when executed by a processor, causes the processor to perform a common method. can be a medium.

The present invention provides a system and method for automatically detecting and notifying a driver of a pedestrian, such as a child, who suddenly leaves the sidewalk in a specific area and crosses the shoulder or roadway, thereby protecting pedestrians such as children and avoiding civil or criminal punishment. It has the effect of relieving drivers who may be affected.

Effects obtainable according to the present invention are not limited to the effects mentioned above, and other effects not mentioned can be clearly understood by those skilled in the art from the description below. will be.

1 shows a system for preventing traffic accidents of pedestrians according to the present invention.
2 shows an example of a system for preventing traffic accidents of pedestrians according to the present invention.
3 schematically shows a server according to the present invention.
4 shows a functional configuration included in a memory according to the present invention.
5 schematically illustrates a camera device according to the present invention.
6 is a diagram showing an example of an image correction filter according to the present invention.
7 shows a HSV graph according to the present invention.
8 schematically illustrates a method for preventing pedestrian traffic accidents according to the present invention.
The accompanying drawings, which are included as part of the detailed description to aid understanding of the present specification, provide examples of the present specification and describe technical features of the present specification together with the detailed description.

Hereinafter, the embodiments disclosed in this specification will be described in detail with reference to the accompanying drawings, but the same or similar elements are given the same reference numerals regardless of reference numerals, and redundant description thereof will be omitted.

In addition, in describing the embodiments disclosed in this specification, if it is determined that a detailed description of a related known technology may obscure the gist of the embodiment disclosed in this specification, the detailed description thereof will be omitted.

In addition, the accompanying drawings are only for easy understanding of the embodiments disclosed in this specification, the technical idea disclosed in this specification is not limited by the accompanying drawings, and all changes included in the spirit and technical scope of the present invention , it should be understood to include equivalents or substitutes.

Terms including ordinal numbers, such as first and second, may be used to describe various components, but the components are not limited by the terms. These terms are only used for the purpose of distinguishing one component from another.

Singular expressions include plural expressions unless the context clearly dictates otherwise.

In this application, terms such as "comprise" or "have" are intended to designate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, but one or more other features It should be understood that the presence or addition of numbers, steps, operations, components, parts, or combinations thereof is not precluded.

Hereinafter, a system for preventing traffic accidents of pedestrians according to a preferred embodiment of the present specification based on the above description will be described in detail.

1 shows a system for preventing traffic accidents of pedestrians according to the present invention, and FIG. 2 shows an example of a system for preventing traffic accidents of pedestrians according to the present invention.

According to FIG. 1 , a system for preventing pedestrian traffic accidents according to the present invention may include a camera device 100 , a server 200 and an alarm unit 300 .

The camera device 100 according to the present invention may generate image data for a sidewalk area and a shoulder area. The sidewalk area may mean a passage for pedestrians, and the shoulder area may mean an edge area of a roadway area. The driveway area may mean a road for vehicles such as cars to pass.

The server 200 according to the present invention may receive image data and detect the departure of the pedestrian from the sidewalk area. Departure may mean a state in which the location of the pedestrian is in an area other than the sidewalk area, and specifically may mean a state in which the location of the pedestrian moves from the sidewalk area to the shoulder area.

That is, the server 200 according to the present invention derives a feature point for the pedestrian, and based on the feature point, detects that the pedestrian has departed when the pedestrian is firstly detected in the sidewalk area and secondly detected in the shoulder area.

The alarm unit 300 according to the present invention may be a lighted display device embedded around a shoulder area. That is, the alarm unit 300 is controlled by the server 200 and may externally display or output a signal according to the departure of the pedestrian.

In the alarm unit 300 according to the present invention, when the departure of a pedestrian is detected, a lighting display device in a surrounding area where the departure has occurred may be turned on. In addition, the alarm unit 300 may turn off the lighting display device when it is detected that the departure of the pedestrian is resolved. As such, the alarm unit 300 may include a plurality of embedded lighting display devices.

Since the light display device is embedded and installed in a shoulder area or a driveway area, parking or driving of a vehicle stopped on the shoulder or a vehicle traveling on the roadway may not be hindered. In addition, the light display device may display a color (for example, red) that is easily visible from a distance. The lighted display device may include an LED lamp therein.

Referring to FIG. 2 , an example of a case where a pedestrian moves from a sidewalk area to a shoulder area is shown.

Referring to the example of FIG. 2 , when a pedestrian moves from the sidewalk area A1 to the shoulder area A2, the corresponding scene may be captured as image data or image data by the camera device 100. Since image data in the present invention is formed by connecting a plurality of frames, it can be replaced with the term image data.

The example of FIG. 2 may be an example of a children's protection area. A children's protection area according to the present invention may refer to an area designated by laws, rules, ordinances, etc. as a place where children are likely to unexpectedly run out toward the roadway, such as around a school or kindergarten.

The server 200 according to the present invention may receive image data and roughly detect whether the pedestrian is a child based on the height (height) of the pedestrian included in the image data. When it is detected that the pedestrian is shorter than the reference object 400 in comparison with the reference object 400 having a predetermined height, the server 200 classifies the pedestrian as a child and detects whether the pedestrian has deviated from the sidewalk area.

In addition, the server 200 according to the present invention may detect the distance to the object through comparison of the reference object 400 . Specifically, only in the case of an object having a known size in advance, the server 200 may detect a distance to the object through comparison of size or height with the reference object 400 (distance detection through perspective).

When the departure of the child is detected, the server 200 may control the lighted display unit through the control unit 310 of the notification unit 300 . The controller 310 may be connected to a plurality of lighted display units 320 . The plurality of lighted display units 320 may be buried in the shoulder area A2 and/or the roadway area A3 according to predetermined coordinates. The server 200 may extract coordinate information of an area where the child has departed and control the lighted display unit 320 based on the extracted coordinate information. In this case, the coordinate information may be predetermined coordinate information based on image data according to a predetermined angle.

According to FIG. 2 , not only the lighting display unit 320 located in one driving direction of the roadway area A3 but also the lighting display unit 320 located in another driving direction can be controlled together. Through this, the present invention can deliver a warning message to both vehicles in one driving direction and vehicles in another driving direction.

According to FIG. 2 , the system according to the present invention may further include a LiDAR sensor or a laser sensor 500 . The LiDAR sensor or laser sensor 500 may be installed around a specific area such as a crosswalk. The system according to the present invention detects the distance to the object through the lidar sensor or the laser sensor 500, and can detect the departure of a pedestrian such as a child based on this.

Although not shown in FIGS. 1 and 2 , the system according to the present invention can receive power from a peripheral power supply device by wire. Since some of the components according to the present invention are buried in the road, a wired power supply method may be used rather than a wireless power supply method to supply power to the buried components.

3 schematically shows a server according to the present invention.

According to FIG. 3 , the server 200 according to the present invention may include a processor 210, a memory 220 and a communication module 230.

The processor 210 may execute commands stored in the memory 220 to control other components. The processor 210 may execute instructions stored in the memory 220 .

The processor 210 is a component capable of performing calculations and controlling other devices. Mainly, it may mean a central processing unit (CPU), an application processor (AP), a graphics processing unit (GPU), and the like. Also, the CPU, AP, or GPU may include one or more cores therein, and the CPU, AP, or GPU may operate using an operating voltage and a clock signal. However, while a CPU or AP consists of a few cores optimized for serial processing, a GPU may consist of thousands of smaller and more efficient cores designed for parallel processing.

The processor 210 may provide or process appropriate information or functions to a user by processing signals, data, information, etc. input or output through the components described above or by running an application program stored in the memory 220.

The memory 220 stores data supporting various functions of the server 200 . The memory 220 may store a plurality of application programs (application programs or applications) running in the server 200, data for operation of the server 200, and commands. At least some of these application programs may be downloaded from an external server through wireless communication. Also, the application program may be stored in the memory 220, installed in the server 200, and driven by the processor 210 to perform the operation (or function) of the server 200.

The memory 220 may be a flash memory type, a hard disk type, a solid state disk type, a silicon disk drive type, or a multimedia card micro type. ), card-type memory (eg SD or XD memory, etc.), RAM (random access memory; RAM), SRAM (static random access memory), ROM (read-only memory; ROM), EEPROM (electrically erasable programmable read -only memory), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and an optical disk. Also, the memory 220 may include a web storage performing a storage function on the Internet.

The communication module 230 transmits and receives information with a base station or a camera having a communication function through an antenna. The communication module 230 may include a modulation unit, a demodulation unit, a signal processing unit, and the like. Also, the communication module 230 may perform a wired communication function.

Wireless communication may refer to communication using a wireless communication network using a communication facility previously installed by telecommunication companies and a frequency of the communication facility. At this time, the communication module 230 is CDMA (code division multiple access), FDMA (frequency division multiple access), TDMA (time division multiple access), OFDMA (orthogonal frequency division multiple access), SC-FDMA (single carrier frequency division multiple access), and the like, as well as the communication module 230 can also be used for 3rd generation partnership project (3GPP) long term evolution (LTE). In addition, not only 5G communication, which is currently being commercialized, but also 6G, which is scheduled to be commercialized later, can be used. However, the present specification may utilize a pre-installed communication network without being bound by such a wireless communication method.

In addition, as a short range communication technology, Bluetooth, BLE (Bluetooth Low Energy), Beacon, RFID (Radio Frequency Identification), NFC (Near Field Communication), infrared communication (Infrared Data Association; IrDA) ), UWB (Ultra Wideband), ZigBee, LoRa, etc. may be used.

As such, the server 200 according to the present invention may use the wireless communication function of the communication module 230 to control other configurations according to the present invention.

4 shows a functional configuration included in a memory according to the present invention.

According to FIG. 4 , the memory 220 according to the present invention may include a pedestrian recognition module 221 , a departure detection module 222 and an alarm unit control module 223 .

The pedestrian recognition module 221 according to the present invention may be configured to recognize a pedestrian in image data through a previously learned CNN module. That is, the pedestrian recognition module 221 pre-trains images labeled as people and images that are not through the CNN module, and based on big data, based on labeled images of people located in the sidewalk area or the shoulder area, may have been learned. Also, the pedestrian recognition module 221 may form a bounding box surrounding an object recognized as a pedestrian.

The pedestrian recognition module 221 according to the present invention may recognize a pedestrian by applying an image filter to be described later, and details will be described later.

The departure detection module 222 according to the present invention may detect departure using image data formed by the camera device (100 in FIG. 1 ) at a specific angle. That is, the departure detection module 222 may receive a preset reference line for image data at a specific angle, and detect departure of the pedestrian based on the preset reference line. The departure prevention module 222 may detect departure based on the formed bounding box. The departure prevention module 222 may detect departure based on the width of the bounding box. That is, the departure prevention module 222 may detect departure based on the widths of the first area that crosses the preset reference line and the second area that does not cross the bounding box. When the width of the first area is greater than the width of the second area, the departure prevention module 222 may classify that the object has escaped.

The alarm unit control module 223 according to the present invention may extract coordinate information where the pedestrian is located when it is classified that the departure of the pedestrian has occurred. In this case, the coordinate information is an approximate value, and may be coordinate information closest to the pedestrian's position among predetermined coordinate information. The alarm unit control module 223 may operate an alarm unit (300 in FIG. 2 ) or a lit display unit (320 in FIG. 2 ) adjacent to the extracted coordinate information. This may be the same as the example shown in FIG. 2 described above.

The child screening module 224 according to the present invention may classify the pedestrian by comparing the height (height) of the pedestrian with the height of the reference object. The reference object (400 in FIG. 2, hereinafter the same) may be pre-installed at regular intervals along the delivery area in the camera device (100 in FIG. 1) of a specific angle. The child screening module 224 extracts the height (height) of the pedestrian recognized by the pedestrian recognition module based on the pixel in the image data and the height of the reference object (400), and determines the height (height) of the pedestrian as the reference object ( 400), the pedestrian may be classified as a child. The separation detection module 222 according to the present invention can detect whether or not a subject has departed only from a subject classified as a child by the child screening module 224 .

5 schematically illustrates a camera device according to the present invention.

The camera device according to the present invention (100 in FIG. 1, hereinafter the same) may generate image data from an optical image. The camera module 1320 may include a housing including a through hole on a side wall, a lens 1321 installed in the through hole, and a driving unit 1323 that drives the lens 1321 . The through hole may have a size corresponding to the diameter of the lens 1321 . The lens 1321 may be inserted into the through hole.

The driving unit 1323 may be configured to control the lens 1321 to move forward or backward. The lens 1321 and the driving unit 1323 are connected in a conventionally known manner, and the lens 1321 may be controlled by the driving unit 1323 in a conventionally known manner.

In order to obtain various video images, the lens 1321 needs to be exposed to the outside of the camera device 100 or the housing.

In particular, since the camera device 100 according to the present invention needs to directly photograph a road where a traffic situation occurs, a lens having strong contamination resistance is required. Accordingly, the present invention proposes a coating layer for coating a lens to solve this problem.

Preferably, the surface of the lens 1321 may be coated with a coating composition including a compound represented by Chemical Formula 1 below, an organic solvent, inorganic particles, and a dispersant.

[Formula 1]

here,

L ₁ is a single bond, a substituted or unsubstituted arylene group having 6 to 30 carbon atoms, a substituted or unsubstituted alkylene group having 1 to 20 carbon atoms, a substituted or unsubstituted cycloalkylene group having 3 to 20 carbon atoms, substituted or unsubstituted is selected from the group consisting of an alkenylene group having 2 to 20 carbon atoms, a substituted or unsubstituted cycloalkenylene group having 3 to 20 carbon atoms, and a substituted or unsubstituted alkynylene group having 2 to 20 carbon atoms,

When the L ₁ is substituted, hydrogen, a nitro group, a halogen group, a hydroxy group, an alkyl group having 1 to 30 carbon atoms, a cycloalkyl group having 1 to 20 carbon atoms, an alkenyl group having 2 to 30 carbon atoms, an alkynyl group having 2 to 24 carbon atoms, and a carbon number It is substituted with one or more substituents selected from the group consisting of an aralkyl group having 7 to 30 carbon atoms, an aryl group having 6 to 30 carbon atoms, and an alkoxy group having 1 to 30 carbon atoms, and when substituted with a plurality of substituents, they are the same as or different from each other.

When the lens 1321 is coated with the coating composition, it can exhibit excellent water repellency and stain resistance, so even if the lens 1321 installed near the road is exposed to a polluted environment for a long time, clearer images or videos can be collected.

The inorganic particles may be selected from the group consisting of silica, alumina, and mixtures thereof. The average diameter of the inorganic particles is 70 to 100 μm, but is not limited to the above examples. After forming the coating layer 1322 on the surface of the lens 1321, the inorganic particles may improve physical strength and maintain viscosity within a certain range to increase moldability.

The organic solvent is selected from the group consisting of methyl ethyl ketone (MEK), toluene, and mixtures thereof, and preferably methyl ethyl ketone may be used, but is not limited to the above examples.

As the dispersing agent, a polyester-based dispersing agent may be used, and specifically, TEGO-Disperse 670 (manufacturer : EVONIK) can be used, but it is not limited to the above examples, and all dispersants obvious to those skilled in the art can be used without limitation.

The coating composition may further include a stabilizer as other additives, and the stabilizer may include a UV absorber, an antioxidant, and the like, but is not limited to the above examples and may be used without limitation.

A coating composition for forming the coating layer 1322 may include, more specifically, the compound represented by Chemical Formula 1, an organic solvent, inorganic particles, and a dispersant.

The coating composition may include 40 to 60 parts by weight of the compound represented by Chemical Formula 1, 20 to 40 parts by weight of inorganic particles, and 5 to 15 parts by weight of a dispersant, based on 100 parts by weight of the organic solvent. In the case of the above range, a synergistic effect is expressed to the extent that the water repellency effect due to the interaction of each component is of critical significance, and when it is out of the above range, the synergistic effect is rapidly reduced or almost nonexistent.

More preferably, the viscosity of the coating composition is 1500 to 1800 cP, and when the viscosity is less than 1500 cP, when applied to the surface of the lens 1321, there is a problem that it is not easy to form the coating layer 1322 because it flows down, and the coating composition exceeds 1800 cP. In this case, there is a problem in that it is not easy to form a uniform coating layer 1322.

[Preparation Example 1: Preparation of coating layer]

1. Preparation of coating composition

A coating composition was prepared by mixing a compound represented by Formula 1, inorganic particles, and a dispersant in methyl ethyl ketone:

[Formula 1]

here,

L ₁ is an unsubstituted alkylene group having 5 carbon atoms.

A more specific composition of the antistatic composition is shown in Table 1 below.

TX1 TX2 TX3 TX4 TX5 organic solvent 100 100 100 100 100 Compound represented by Formula 1 30 40 50 60 70 inorganic particles 10 20 30 40 50 dispersant One 5 10 15 20

(unit weight parts)

2. Preparation of coating layer

A coating layer 1322 was formed by applying the coating composition of DX1 to DX5 on one surface of the lens 1321 and then curing the coating composition.

[Experimental example]

1. Evaluation of surface appearance

Due to the difference in viscosity of the coating composition, after the coating layer 1322 was prepared, a sensory evaluation was performed on whether a uniform surface was formed. Evaluation was conducted on whether or not a uniform coating layer 1322 was formed, and the evaluation was conducted according to the following criteria.

○: uniform coating layer formation

×: Formation of non-uniform coating layer

TX1 TX2 TX3 TX4 TX5 sensory evaluation Х ○ ○ ○ Х

When forming the coating layer 1322, if the viscosity is less than a certain amount, flow occurs on the surface of the lens 1321, and it is difficult to form a uniform coating layer 1322 after the curing process in many cases. Accordingly, a problem of lowering the production yield may occur. In addition, even when the viscosity is too high, it is difficult to uniformly apply the composition and it is impossible to form a uniform coating layer 1322 .

2. Measurement of water repellency angle

After forming the coating layer 1322 on the surface of the lens 1321, the results of measuring the water repellency angle are shown in Table 3 below.

Advancing contact angle (〃) Static contact angle (〃) receding contact angle (〃) TX1 117.1±2.9 112.1±4.1 < 10 TX2 132.4±1.5 131.5±2.7 141.7±3.4 TX3 138.9±3.0 138.9±2.7 139.8±3.7 TX4 136.9±2.0 135.6±2.6 140.4±3.4 TX5 116.9±0.7 115.4±3.0 < 10

As shown in Table 3, after the coating layer 1322 was formed using the coating compositions of TX1 to TX5, the result of measuring the contact angle was confirmed. TX1 and TX5 measured receding contact angles less than 10 degrees. That is, it was confirmed that a phenomenon in which water droplets are pinned occurs when the coating composition is out of the optimal range for preparing the coating composition. On the other hand, it was confirmed that the pinning phenomenon did not occur in TX2 to 4, indicating that excellent waterproofing effect could be exhibited.

3. Fouling resistance evaluation

A lens 1321 having the coating layer 1322 according to the above embodiment formed outside the facility was attached to a model camera, and exposed to the environment on a general road for 4 days. As a comparative example (Con), the same lens 1321 without the coating layer 1322 was used, and the model camera was attached to the same location of the vehicle in each example.

After that, the degree of contamination of the lens 1321 before and after the experiment was evaluated, and for objective comparison, the result was compared with the comparative example in which the coating layer 1322 was not formed, and the result was evaluated by an index of 1 to 10, and Table 4 below shown in In the index below, the lower the number, the better the stain resistance.

Con TX1 TX2 TX3 TX4 TX5 stain resistance 10 7 3 3 3 8

(Unit: index) Referring to Table 4 above, in the case of forming the coating layer 1322 on the lens 1321, even if the lens 1321 is exposed to the outside while installing the camera in the external environment, analysis of high contamination resistance for a long period of time It can be seen that image data can be collected in a form that is easy to do. In particular, in the case of TX2 to TX4, it can be confirmed that the contamination resistance by the coating layer 1322 is very excellent.

6 is a diagram showing an example of an image correction filter according to the present invention, and FIG. 7 shows a HSV graph according to the present invention.

According to Figure 6, the type and function of the filter is shown. That is, the CNN algorithm may be a learning algorithm using a plurality of layers. In addition, the CNN algorithm can automatically learn a filter that maximizes image classification accuracy, and by adding a new layer called a convolutional layer and a polling layer before the fully connected layer, after applying the filtering technique to the original image, the filtered image A classification operation can be performed on . The CNN algorithm is configured to apply a filtering technique to the original image by adding a new layer, called a convolutional layer and a pooling layer, before the fully-connected layer, and then perform a classification operation on the filtered image. can

At this time, the operation expression for the image filter using the CNN algorithm is as shown in Equation 1 below.

[Equation 1]

(step,

: 행렬로 표현된 필터링된 이미지의 i번째 행, j번째 열의 픽셀,

: pixels in the i-th row and j-th column of the filtered image expressed as a matrix,

: 필터,

: filter,

: 이미지,

: image,

: 필터의 높이 (행의 수),

: height of the filter (number of rows),

: 필터의 너비 (열의 수)이다. )

: The width of the filter (number of columns). )

Preferably, the operation expression for the image filter using the CNN algorithm is as shown in Equation 2 below.

[Equation 2]

(step,

: 행렬로 표현된 필터링된 이미지의 i번째 행, j번째 열의 픽셀,

: pixels in the i-th row and j-th column of the filtered image expressed as a matrix,

: 응용 필터

: Application filter

: 이미지,

: image,

: 응용 필터의 높이 (행의 수),

: height of application filter (number of rows),

: 응용 필터의 너비 (열의 수)이다.)

: The width (number of columns) of the application filter.)

는 응용 필터로서 보행자가 포함된 이미지 데이터를 학습하고, 이미지 데이터에 포함된 보행자를 인식하기 위하여, 상기 이미지 데이터에 적용되는 필터일 수 있다. 특히, 보행자 인식의 경우 형태 및 색감의 차이를 기초로 분류될 수 있으므로, 형태 및 색감 등을 효과적으로 인지하기 위한 응용 필터가 필요할 수 있다. 이러한 필요성을 충족하기 위하여 응용 필터

는 아래의 수학식 3에 의하여 연산될 수 있다. Preferably,

As an application filter, may be a filter applied to image data in order to learn image data including a pedestrian and recognize a pedestrian included in the image data. In particular, since pedestrian recognition can be classified based on differences in shape and color, an application filter for effectively recognizing shape and color may be required. Application filters to meet these needs

Can be calculated by Equation 3 below.

[Equation 3]

: 필터,

: 계수,

: 응용 필터)(step,

: filter,

: Coefficient,

: application filter)

에 따른 필터는 도 6에 따른 엣지 인식 필터(Edge detection), 샤픈 필터(sharpen) 및 박스 블러 필터(Box blur) 중 어느 하나의 행렬일 수 있다. At this time, each

A filter according to may be any one matrix of an edge detection filter according to FIG. 6, a sharpen filter, and a box blur filter.

를 구하는 연산식은 아래의 수학식 4와 같다. 이때,

는 필터의 효율을 높이기 위하여 사용되는 하나의 변수로서 해석될 수 있으며, 그 단위는 무시될 수 있다. Preferably,

The operation expression for obtaining is as shown in Equation 4 below. At this time,

can be interpreted as a variable used to increase the efficiency of the filter, and its unit can be ignored.

[Equation 4]

However, the diameter (diameter) of the lens of the camera device (100 in FIG. 1) used for image capture is in mm, the f-value of the lens is the aperture value (F number) of the lens, and the HSV average value is the color coordinate according to the image It may mean a value obtained by averaging values converted into magnitude values through the HSV graph. Details of the HSV value are as follows.

According to FIG. 7 , the HSV graph according to the present invention may mean a color space in which perceptual characteristics are reflected. H (Hue, 0 to 360°) may mean hue, S (Saturation, 0 to 100%) may mean saturation, and V (Value, 0 to 100%) may mean lightness. . Hue, saturation, and lightness values can be referred to as HSV values, which can be easily extracted using graphic tools such as Adobe illustrator cc 2019.

The HSV average value according to the present invention can be obtained through the HSV three-dimensional coordinates of FIG. 7 . That is, the average HSV value according to the present invention may be calculated based on the HSV value obtained through a graphic tool. The distance value of the HSV coordinates measured with the origin coordinates on the HSV 3-dimensional coordinates as a reference point may constitute the above-described HSV average value. That is, the image according to the present invention includes an image of a vehicle, and the HSV color coordinates of the image may be distributed in a certain area among HSV three-dimensional coordinates. Therefore, the HSV average value according to the present invention may mean a distance value from the origin coordinates calculated based on average coordinates using the average of HSV coordinates for colors of a certain region.

[Experimental example]

Regarding the image data according to the present invention, when the application filter F' of the present invention is applied, the recognition accuracy of the actual user is as follows. The table below shows the accuracy of the recognition result as a numerical value, depending on whether a filter is applied or not, commissioned by 10 experts in the relevant technical field.

no filter applied

적용filter

apply filter

apply Average Accuracy (Score) 75 90 97

Table 5 shows the scores for accuracy evaluated by experts for each case. In this experimental example, the accuracy of the pedestrian recognition module learned in advance through big data was investigated according to whether or not a filter was applied.

In addition, in this experimental example, image data including 120 different pedestrians were tested, and 10 experts surveyed the accuracy of pedestrian recognition included in the image data with respect to the recognition result value.

As can be seen in Table 5, when the filter is not applied, there is a probability of error in image recognition, and the evaluation is relatively low accuracy. In contrast, the accuracy was slightly higher when the general CNN filter F was applied, but it was confirmed that the accuracy was remarkably improved when the applied filter F' was applied.

Hereinafter, a method for preventing a traffic accident of a pedestrian according to another preferred embodiment of the present specification based on the above description will be described in detail.

8 schematically illustrates a method for preventing pedestrian traffic accidents according to the present invention.

According to FIG. 8 , the method for preventing traffic accidents of pedestrians according to the present invention includes receiving image data for a sidewalk area and a shoulder area (S1100), and extracting feature points for a pedestrian from the image data (S1200). ), detecting a state in which the pedestrian leaves the sidewalk area based on the feature point (S1300), and transmitting a warning message to an external device when the state of separation is detected (S1400). there is.

Among the descriptions of the method according to another embodiment of the present invention, the same or duplicate descriptions of the system according to the above-described embodiment may be omitted. In addition, it is clear that those skilled in the art can support and explain the content of a method according to another embodiment with a description of a system according to one embodiment.

The above-described present invention can be modeled as a computer readable code on a medium on which a program is recorded. The computer-readable medium includes all types of recording devices in which data readable by a computer system is stored. Examples of computer-readable media include Hard Disk Drive (HDD), Solid State Disk (SSD), Silicon Disk Drive (SDD), ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc. , and also includes those modeled in the form of carrier waves (eg, transmission over the Internet). Accordingly, the above detailed description should not be construed as limiting in all respects and should be considered illustrative. The scope of this specification should be determined by reasonable interpretation of the appended claims, and all changes within the equivalent scope of this specification are included in the scope of this specification.

Any or other embodiments of the present invention described above are not mutually exclusive or distinct. Certain or other embodiments of the present invention described above may be used in combination or combination of respective configurations or functions.

The above detailed description should not be construed as limiting in all respects and should be considered illustrative. The scope of the present invention should be determined by reasonable interpretation of the appended claims, and all changes within the equivalent scope of the present invention are included in the scope of the present invention.

100: camera device
200: server
300: alarm unit

Claims (7)

In the system for preventing traffic accidents of pedestrians,
a camera device generating image data for a sidewalk area and a shoulder area;
a server that receives the image data and detects departure of the pedestrian from the sidewalk area; and
An alarm unit controlled from the server and displaying a signal according to the departure; including,
A system for preventing pedestrian traffic accidents.
According to claim 1,
The sidewalk area and the shoulder area are areas around the children's protection area,
The server,
extracting a feature point for a pedestrian shorter than a predetermined height among the pedestrians from the image data, and detecting the departure based on the feature point;
A system for preventing pedestrian traffic accidents.
According to claim 1,
The camera device,
A housing including a through hole in a side wall;
a lens installed in the through hole; and
To include; a driving unit for driving the lens;
A system for preventing pedestrian traffic accidents.
According to claim 1,
The server,
Deriving a feature point for the pedestrian, and detecting that the pedestrian's departure has occurred when the pedestrian is first detected in the sidewalk area and secondly detected in the shoulder area based on the feature point,
A system for preventing pedestrian traffic accidents.
According to claim 1,
The notification unit,
A lighted display device embedded around the shoulder area,
A system for preventing pedestrian traffic accidents.
Receiving image data of a sidewalk area and a shoulder area;
extracting feature points of the pedestrian from the image data;
detecting a state in which the pedestrian leaves the sidewalk area based on the feature point; and
When the departure state is detected, transmitting a warning message to an external device;
How to prevent pedestrian accidents.
A non-transitory computer readable medium storing instructions,
The instructions, when executed by a processor, cause the processor to perform the method of claim 6.

Images