TWI627612B - Traffic video receiving and analyzing system - Google Patents

Abstract

A traffic video receiving and analyzing system, the traffic video receiving and analyzing system is composed of a plurality of monitoring devices, each of which includes a control unit, a camera unit, a storage unit and an analyzing unit, wherein the camera unit, Electrically connecting with the control unit to be controlled by the control unit to perform an imaging function; the storage unit is electrically connected to the control unit and the camera unit to receive and store an image frame recorded by the camera unit through the camera function The analysis unit is electrically connected to the control unit and the storage unit to read the image frame stored in the storage unit, and can analyze the image frame according to at least one analysis condition preset. In this way, the analysis of the image frame can be performed through the analysis unit, and the occurrence of the traffic event can be recorded in advance prediction, in-process judgment, or afterwards.

Description

Traffic video receiving and analyzing system

The invention relates to a traffic video receiving and analyzing system, in particular to a traffic analysis system capable of intercepting images and performing analysis and calculation.

With the gradual development of the modern industrial and commercial society, people's demand and dependence on transportation is also rising. In such a modern society that is highly dependent on transportation, traffic safety is already one of the important links in people's lives. Common dangerous driving includes a variety of driving behaviors as described below, such as: driving the vehicle within the speed limit (including overspeed and low speed), arbitrarily changing lanes, crossing double white lines, not maintaining a safe distance from the preceding vehicle, and the like. These driving behaviors not only endanger the safety of themselves and others, but also may cause serious car accidents. Therefore, in order to avoid traffic accidents, in addition to the need to comply with traffic regulations, every driver must pay attention to the condition of the road.

In order to effectively grasp the traffic situation and fully understand the cause of the incident and clarify the responsibility after the accident, the traffic situation analysis and notification system obtains an image of the traffic scene through the camera equipment, and analyzes the image. In order to restore the situation of the site, understand the cause of the accident.

According to the image recognition technology, it has been widely used in such traffic analysis and notification systems. Most of the applications are image recognition of image data of a single camera (such as license plate recognition, traffic detection, face detection/identification, etc. Displacement detection Measurement, personnel tracking, directional motion detection, electronic fences, object legacy, camera coverage, face detection, etc.), after the identification is completed, image features (such as license plate number, vehicle color, vehicle type, vehicle factory) Card type, large/small/locomotive number, object position, object size, directionality, etc.) information for storage and display. Without a more comprehensive analysis and utilization of the identification results of different characteristics, it is a waste of a lot of computing resources.

In addition, the familiar traffic condition analysis and notification system only has basic imaging equipment on the road site, and these cameras are connected to one of the remote servers through the network, when the traffic situation analysis and notification is known. When the system wants to perform the above-mentioned image recognition and other operations, all the analysis and calculation functions must be sent to the remote server. The information is time-consuming and slow, and it is impossible to respond to the situation on the spot. It is not ideal.

It can be seen from the above description that the conventional traffic condition analysis and notification system does not make a more comprehensive analysis and utilization of the identification results of different characteristics, and all analysis and calculation must be sent to the remote server for information, and the information is time-consuming and slow. Urgently, therefore, how to design a traffic video receiving and analyzing system to provide the most immediate, first-hand information, and to take into account the detailed and precise analysis work and the overall cost of the installation, that is, the inventor wants to solve this problem. An important topic.

In view of the many shortcomings of the traffic analysis and notification system, the inventor has developed and designed a traffic video receiving and analyzing system of the present invention after many years of research and adjustment based on his long experience in serving related industries. By the present invention, many defects of the conventional traffic condition analysis and notification system are improved.

The main purpose of the present invention is to provide a traffic video receiving and dividing The analysis system, the traffic video receiving and analyzing system is composed of a plurality of monitoring devices, each of which includes a control unit, a camera unit, a storage unit and an analysis unit, wherein the camera unit is electrically connected to the control unit Connected to be controlled by the control unit to perform a camera function; the storage unit is electrically connected to the control unit and the camera unit to receive and store an image frame recorded by the camera unit through the camera function; the analysis unit is The control unit and the storage unit are electrically connected to read the image frame stored in the storage unit, and can analyze the image frame according to at least one analysis condition preset. In this way, each of the monitoring devices can analyze the image frame through the analysis unit, and predict the occurrence of the traffic event in advance, during the event, or afterwards.

A further object of the present invention is that at least one of the analysis conditions is a moving object identification condition, and when the analyzing unit identifies a moving object according to the moving object identification condition, the analyzing unit performs a simulation operation, To obtain a simulated moving path corresponding to one of the moving objects. In this way, the simulation operation performed by the analysis unit can pre-calculate the possible movement trajectory of various vehicles and even pedestrians, and can further serve as a basis for estimating the traffic condition beforehand.

Still another object of the present invention is that each of the monitoring devices further includes a wireless transmission unit electrically connected to the control unit, and any monitoring device of the system can transmit the wireless transmission unit to another system The monitoring device transmits information. In this way, each monitoring device can obtain image images acquired from different angles by sharing information with each other, and perform comprehensive analysis to improve the accuracy and credibility of various analysis.

Another object of the present invention is that the analysis unit of each monitoring device can receive another image frame of another monitoring device, and according to the monitoring device The image frame, and the other image frame of the another monitoring device, perform a simulation operation to acquire the simulated movement path corresponding to the moving object. In this way, by comprehensively analyzing the image images acquired at different angles, the prediction result of the simulated moving path can be more accurate.

Another object of the present invention is that the system further includes a sound receiving unit electrically connected to the control unit and the storage unit to be controlled by the control unit to perform a recording function, and to store one of the recorded sound signals. The storage unit. In this way, the analysis conditions related to the sound signal can be added outside the image to further improve the correctness of the analysis and judgment of the event.

According to still another object of the present invention, at least one of the analysis conditions is an accident feature identification condition, and when the analysis unit determines that an accident occurs according to the accident feature identification condition, an event is sent to the control unit. Recording a signal so that the control unit can record the image images in a predetermined time range as an event recording screen according to the event recording signal, and store the audio signals in the predetermined time range as an event record. Audio. In this way, the sounds and images before and after the incident can be stored as the event recording audio and the event recording screen, so as to clarify the responsibility for the incident.

Yet another object of the present invention is to provide a server that is coupled to the monitoring devices via a network and that is capable of receiving information transmitted by the monitoring devices. In this way, not only the event recording audio and the event recording screen can be sent to the server, so that the event recording audio and the event recording screen can be stored for a long time by the server, and further, the server can be built on the server. The hardware resources are used for analysis operations that are more complex and cannot be performed by the monitoring device itself.

According to still another object of the present invention, the system further includes an open flame sensor electrically connected to the control unit to be in the open flame sensor When a fire is detected, an alarm signal can be sent to the control unit, so that the control unit can send a notification signal to the server through the network (for example, by the wireless transmission unit). In this way, the system can be used not only for the prediction, notification and recording of general traffic events, but also to provide further functions such as fire alarms, which greatly enhances its added value.

It is a prophet that, in order to facilitate the more comprehensive and universal construction of the traffic video receiving and analyzing system of the present invention to form a more complete traffic safety network, another object of the present invention is to receive the traffic video and audio. The analysis system is disposed on a street lamp device. Thus, due to the popularity of the street lamp device, the traffic audio and video receiving and analyzing system of the present invention can be quickly established without cost extra or occupying extra space. The funding and space utilization problems faced by modernization construction during the promotion.

For your convenience, the review committee can make a further understanding and understanding of the purpose, technical features and effects of the present invention. The embodiments are combined with the drawings, and the details are as follows:

1‧‧‧ system

11‧‧‧Monitoring equipment

111‧‧‧Control unit

112‧‧‧ camera unit

113‧‧‧ storage unit

114‧‧‧Analysis unit

115‧‧‧Wireless transmission unit

116‧‧‧ Radio unit

117‧‧‧Open fire sensor

12‧‧‧Server

2‧‧‧

3‧‧‧moving objects

1 is a system architecture diagram of a preferred embodiment of the present invention; and FIG. 2 is a schematic diagram of the monitoring device of the present invention applied to a road traffic sign.

The present invention is a traffic video receiving and analyzing system. Referring to FIG. 1 and FIG. 2, the traffic video receiving and analyzing system 1 of the present invention is composed of a plurality of monitoring devices 11, each of which includes a The control unit 111 (such as a central processing unit, CPU), a camera unit 112, a storage unit 113 (such as a memory or a hard disk), an analyzing unit 114, and a radio unit 116. In an embodiment of the present invention, each of the monitoring devices 11 can be disposed on the first light 2, but the invention is not limited thereto. In other preferred embodiments of the present invention, The traffic video receiving and analyzing system of the present invention is more comprehensively and universally constructed to form a more complete traffic safety network, and each monitoring device 11 can also be disposed on a street light device, thus, due to the popularity of the street lamp device The utility model can quickly construct the traffic audio-visual receiving and analyzing system 1 of the present invention, which can effectively solve the problem of funds and space utilization faced by the modernization construction in the promotion.

As described above, in the preferred embodiment of the present invention, the camera unit 112 and the sound unit 116 are electrically connected to the control unit 111 to be controlled by the control unit 111 to perform an imaging function or a recording function. The storage unit 113 is electrically connected to the control unit 111, the camera unit 112, and the sound unit 116 to receive and store an image image recorded by the camera unit 112 through the camera function, and/or receive and store the sound. Unit 116 records one of the sound signals. The analysis unit 114 is electrically connected to the control unit 111 and the storage unit 113 to read the image frame stored in the storage unit 113 and/or read the audio signal stored in the storage unit 113.

Referring to FIG. 1 and FIG. 2, the analysis unit 114 can analyze the image frame according to at least one analysis condition set in advance. For example, in a preferred embodiment of the present invention, at least one of the analysis conditions is a moving object identification condition, and when the analyzing unit 114 identifies a moving object 3 according to the moving object identification condition (eg, a pedestrian, When the vehicle is even an unmanned aerial vehicle or the like, the analysis unit 114 performs a simulation operation to acquire a simulated movement path corresponding to the moving object 3. In this way, the simulation operation performed by the analysis unit 114 can pre-calculate the various vehicles and even pedestrians in the process of moving. The ability to move the trajectory, and can further serve as the basis for the evaluation of traffic conditions in advance. For example, if a particular vehicle is traveling at an abnormal speed and other objects are present on the predicted simulated path, it may be judged to be potentially dangerous; or, if the identified moving object 3 is an unmanned aerial vehicle (Drone, or Unmanned Aerial Vehicle, or UAV for short), when it is judged that it is moving in the direction of the air traffic control area (such as the vicinity of the airport or the location of important government agencies, etc.), a warning message may be issued in advance to notify the unmanned person. The operator of the flying vehicle changes the course of the unmanned aerial vehicle. The actual application of the present invention is not limited to the above-exemplified application modes, and any changes that can be easily considered by those skilled in the art should be in the scope of protection of the present invention. Bright.

Check, the main characteristics of traffic accidents, including the sudden increase in the volume of the radio, the inclusion of clearly recognizable collision sounds, the instantaneous slowdown or down to the speed of the vehicle, more than two moving objects 3 overlapping events, non-crash time or non- When the traffic lights stop waiting for the remnants on the road (the vehicle stays on the road after the collision), the traffic jam occurs after the accident, the traffic changes lanes after the accident, and the acceleration of the object suddenly increases (the vehicle or the person is hit by flying). Referring to FIG. 1 and FIG. 2 , the above features can be acquired by the imaging unit 112 and the radio unit 116 , and analyzed by the analysis unit 114 . In other words, the present invention can be applied to the moving path. Simulation calculations can also be used for accident analysis. More specifically, in other application examples of the present invention, at least one of the analysis conditions is an accident feature identification condition (such as the aforementioned collision sound, overlapping event or remnant, etc., when the identified feature The more it is determined, the higher the correct rate of occurrence of a traffic accident). When the analyzing unit 114 determines that an accident occurs according to the accident feature identification condition, an event recording signal is sent to the control unit 111, so that the control unit 111 can record the signal according to the event, and the predetermined time range is The image images are stored as an event recording screen, and the pre-recording The audio signals within a predetermined time range are stored as an event recording audio.

In general, these continuous monitoring systems do not store all acquired image frames and/or audio signals for a long time, but are constantly overwritten with subsequent acquired image frames and/or audio signals. Replace the original storage content. The present invention records the signal by the foregoing, and in the case of a suspected accident, within a predetermined time range (for example, from the time point when the accident is judged, the forward calculation is 3 minutes, the backward calculation is 7 minutes, etc., The video images and audio signals stored in the event are stored as an event recording screen and event recording audio, and stored separately so that they are not overwritten or replaced by subsequent information obtained by normality and persistence. The sounds and images before and after the incident are stored as the event recording audio and the event recording screen, so as to clarify the responsibility for the incident.

Referring to FIG. 1, in the preferred embodiment of the present invention, each of the monitoring devices 11 further includes a wireless transmission unit 115. The wireless transmission unit 115 is electrically connected to the control unit 111, and any monitoring device 11 of the system can transmit information to the other system 1 through the wireless transmission unit 115 under the control of the control unit 111. Monitoring device 11. In detail, each of the analysis units 114 of the monitoring device 11 can not only read the image images and audio signals stored in the respective storage units 113, but also obtain information at different angles and distances by sharing information with each other. Image and sound signals, and comprehensive analysis to improve the accuracy and credibility of various analyses. As a matter of course, the above comprehensive analysis can be achieved by techniques such as real time video stitching. Specifically, in the preferred embodiment of the present invention, each of the monitoring devices 11 shares the acquired image images through the wireless transmission unit 115, and acquires different angles of each camera unit 112 through real-time video splicing technology. The image of the position is instantly stitched and constructed to form a full-frame (for example, a 180-degree viewing angle) image or a specific angle image. surface. In practical applications, many advantages can be achieved through these technologies. For example, since some cities have stricter regulations on unmanned aerial vehicles, their specifications may require operators of unmanned aerial vehicles to maintain the unmanned aerial vehicle in their line of sight when operating unmanned aerial vehicles. Inside. When the technology of the present invention is applied to such areas, the operator of the unmanned aerial vehicle can obtain the processed image frame through each of the wireless transmission units 115, thereby enabling visual confirmation of the unmanned aerial vehicle at any time. Flight status.

Further, as described above, the analyzing unit 114 of the present invention can acquire the simulated moving path corresponding to the moving object 3 by performing an analog operation. In the preferred embodiment of the present invention, since each monitoring device 11 can share information with each other through the wireless transmission unit 115, the analysis unit 114 can receive another monitoring device 11 when performing the simulation operation. And performing another simulation operation according to the image frame of the monitoring device 11 and the another image frame of the another monitoring device 11 to acquire the simulated moving path corresponding to the moving object 3. In this way, the comprehensively analyzed (for example, the aforementioned real-time video splicing) image images acquired at different angles can make the prediction result of the simulated moving path more accurate.

Referring to FIG. 1, in a preferred embodiment of the present invention, the system further includes a server 12 connected to the monitoring device 11 via a network to receive the same. The information sent by the device 11 is monitored. In this way, not only the event recording audio and the event recording screen can be sent to the server 12, so that the event recording audio and the event recording screen can be stored for a long time by the server 12, and the event can be recorded and recorded. After the event record screen is stored in the server 12, the storage space in the storage unit 113 is released for subsequent application. Furthermore, although each of the monitoring devices 11 of the present invention can perform basic analysis operations by itself, it is difficult to expect that each of the monitoring devices 11 is configured to handle complex operations based on cost considerations. The present invention can be used to transmit the event recording audio and the event recording screen to the server 12, and the complexity can be further improved by uniformly configuring the high-end soft and hardware resources of the server 12. An analysis operation that cannot be performed by each of the monitoring devices 11 itself. According to this, a good division of labor effect can be achieved, that is, each of the monitoring devices 11 uses each of the wireless transmission units 115 to share information with each other, and performs basic operations to provide the most immediate and first-hand information; For more detailed and precise analysis, as well as long-term preservation of the data, relevant information is transmitted to the server 12 for execution. This method effectively avoids the shortcomings of the traditional practice that all analyses must be sent to the remote end for analysis, and the information is time-consuming and time-consuming, and the shortcomings are not urgent. In addition, the possibility of performing precise operations is maintained, and at the same time, the overall setting is also taken into account. cost.

As a commentator, as shown in FIG. 1, in order to further improve the security notification content of the system 1, in the preferred embodiment of the present invention, the system 1 further includes an open flame sensor 117 (Flame). Detector). Generally speaking, depending on the burning material and the temperature environment, the flame may emit spectra of different wavelengths, so the open flame sensor 117 is also designed into various types, such as a detector for detecting near-infrared light (nfra). -red (IR) based flame detectors), ultra-violet (UV) based flame detectors or a mixture of the two, even a dual band infrared flame detector Or various types such as tri-band infrared flame detectors. As indicated above, only the various types of detectors can be used as the open flame sensor 117 of the present invention, but the open flame sensor 117 of the present invention is not limited to the above list, and is familiar to the above. Those skilled in the art, in accordance with the technical content disclosed in the present invention, use other types of detectors to achieve equivalent changes, and should not fall within the protection scope of the "open flame sensor 117" referred to in the present invention. .

The fire sensor 117 is electrically connected to the control unit 111 to send an alarm signal to the control unit 111 when the fire sensor 117 detects a fire, thereby enabling the control unit 111 to transmit The network (for example, by the wireless transmission unit 115) sends a notification signal to the server 12. In detail, if a fire accident occurs due to a traffic accident (for example, a vehicle is on fire), the system will perform a notification at this time, which is self-evident; however, as described above, the monitoring device 11 of the present invention can also be widely used. It is installed on equipment such as street lamps. It is also a part of the community fire prevention or notification mechanism. In this way, the system can be used not only for the prediction, notification and recording of general traffic events, but also to provide further functions such as fire alarms, which greatly enhances its added value.

The foregoing is only a few preferred embodiments of the present invention, but the scope of the claimed invention is not limited thereto, and the technical contents disclosed in the present invention are disclosed by those skilled in the art. Equivalent changes that can be easily considered are within the scope of protection of the present invention.

Claims (8)

A traffic video receiving and analyzing system, the system is composed of a plurality of monitoring devices, each of which includes: a control unit; an imaging unit is electrically connected to the control unit to be controlled by the control unit to perform an imaging function a storage unit electrically connected to the control unit and the camera unit to receive and store an image image recorded by the camera unit through the camera function; and an analysis unit electrically connected to the control unit and the storage unit Connecting to read the image frame stored in the storage unit, and analyzing the image frame according to at least one analysis condition preset; wherein at least one of the analysis conditions is a moving object recognition condition; When the analyzing unit identifies a moving object according to the moving object identification condition, the analyzing unit performs a simulation operation to acquire a simulated moving path corresponding to one of the moving objects. The system of claim 1, wherein each of the monitoring devices further comprises: a wireless transmission unit electrically connected to the control unit, and any monitoring device of the system can communicate with the system through the wireless transmission unit Another monitoring device transmits information. The system of claim 1, wherein the analysis unit of each monitoring device can receive another image frame of another monitoring device, and according to the image frame of the monitoring device, and the another monitoring device The other image frame performs a simulation operation to acquire the simulated movement path corresponding to the moving object. The system of claim 1, further comprising: a radio unit electrically connected to the control unit and the storage unit to be controlled by the control unit to perform a recording function, and storing one of the recorded audio signals in the Storage unit. The system of claim 1, wherein at least one of the analysis conditions is an accident feature identification condition. The system of claim 5, wherein the analyzing unit sends an event recording signal to the control unit when the accident condition is determined according to the accident characteristic identification condition, so that the control unit can Recording signals to store the image frames within a predetermined time range as an event recording screen. The system of claim 6 further comprising: a server connected to the monitoring device via the network to receive information transmitted by the monitoring device. The system of claim 7, further comprising: an open flame sensor electrically connected to the control unit to send an alarm signal to the control unit when the fire sensor detects a fire In turn, the control unit can send a notification signal to the server through the network.