KR102231343B1 - Marine warning system for the protection of bridge facilities - Google Patents

Abstract

According to the present invention, provided is a maritime warning system for protecting bridge facilities by receiving vessel operation information from a vessel having an AIS, which comprises: one or more photographing units (100) installed on the bridge to photograph a predetermined range; an AIS transceiver (200) receiving operation information of the vessel from the AIS of the vessel; a control unit (300) receiving an image photographed by the photographing unit (100) and the operation information of the vessel from the AIS transceiver (200); and an alarm unit (400) warning when the collision of the vessel and the bridge is expected.

Description

Marine warning system for the protection of bridge facilities

The present invention relates to a marine warning system for protecting bridge facilities.

In general, surveillance cameras are installed in residential areas, shopping streets, sidewalks and roads, and are used to collect evidence of various crimes and to understand road conditions.

These surveillance cameras are installed above the ground in order to secure a range for photographing. In the case of residential areas, they are installed at a predetermined height such as power poles or exterior walls of buildings, and various types of streetlights, traffic lights, road guide signs, posts, etc. are installed on sidewalks and roads. It is installed at a predetermined height on road structures. In other words, surveillance cameras are generally installed to protect and monitor facilities and roads on land.

On the other hand, Korea Patent Registration No. 10-1695899, as shown in Figure 1, "a marine monitoring system using a vehicle is mounted on a manned or unmanned ship, and receives ship identification information sent from the ship automatic identification unit of a specific ship in the vicinity. Unit; Converts image information photographed by the photographing unit mounted on the manned or unmanned vessel into an electric signal, but is displayed using radio waves such as daytime image sensor or infrared sensor, SAR (Synthetic Aperture Radar), LiDAR, etc. An image sensor that is one of the devices; a control unit that combines two pieces of information received from the receiving unit and the image sensor to control the display unit to superimpose the image of a specific ship and the identification information of the ship to be output, wherein the control unit is the control unit. Further comprises being installed on the manned or unmanned ship, and the image output to the display unit further comprises a correction unit for removing fog or correcting image shake by improving the image quality of the ship image in real time, The display unit further includes outputting a single or a plurality of vessels located within the proximity area of the image sensor, and further includes an electronic map showing the navigation information of the vessel and the traveling direction of the vessel received from the vessel identification unit. When the ship is selected on the map by using a mouse or screen touch method, one or more information including the ship name obtained from the ship identification unit is output, along with the location and direction of the aircraft, and the image sensor of the aircraft is displayed. A marine monitoring system using a vehicle in which a target point to be aimed is also shown is disclosed.

Meanwhile, there was a case where the Russian national cargo ship'Sea Grand' collided with the Gwangan Bridge located in Busan. The ship departed Yongho Bay Pier on February 28, 2019 at 15:35 at 15:35, and was heading for Vladivostok Port, colliding 2 yachts and 1 barge at 15:47, and then 16:00. He hit the Gwangan Bridge in the 23rd minute, and while attempting to escape, he was stopped by the Korean Maritime Police and failed to escape.

Therefore, it is the time when a marine alarm system is needed to protect bridge facilities by extending the scope of application of the surveillance camera to the sea.

KR 10-1695899 B1 KR 10-163885 B1 KR 10-1313134 B1 KR 10-2088793 B1 WO 2016-194375 A1

Therefore, the present invention is to solve the above-described problem, by installing a surveillance camera on a marine bridge facility to monitor, and to protect a bridge facility to prevent a collision with the ship by receiving the ship's operation information from the ship's AIS. To provide a maritime warning system for

The maritime warning system for protecting bridge facilities by receiving operation information of a ship from a ship having an AIS according to the present invention comprises: at least one photographing unit 100 installed on a bridge to photograph a predetermined range; An AIS transceiver 200 for receiving the ship's navigation information from the ship's AIS; Including a control unit 300 that receives the image captured from the photographing unit 100 and the operation information of the ship from the AIS transceiver 200, and an alarm unit 400 that warns when a collision between the ship and the bridge is expected. It is characterized.

The present invention receives ship operation information in real time through CCTV and AIS transceiver capable of day and night monitoring, and in the case of ships not recognized by AIS, it detects an object in the image and approaches a ship that is likely to collide with a bridge. It has the effect of protecting offshore bridge facilities by warning about it.

1 is a diagram of a conventional marine surveillance system.
2 is a conceptual diagram of a maritime warning system for protecting bridge facilities according to the present invention.
3 is a block diagram of a marine warning system for protecting bridge facilities according to the present invention.
4 is a view for explaining the deep learning of the maritime warning system for the protection of bridge facilities according to the present invention.
5 is a view for explaining the deep learning of the maritime warning system for the protection of bridge facilities according to the present invention.
6 is a view showing a function of storing and reproducing by integrating information being implemented of the maritime warning system image analysis processing unit 310 for protecting bridge facilities according to the present invention.
7 is a CCTV image screen through the maritime warning system image analysis processing unit 310 for the protection of bridge facilities according to the present invention.
8 is a view for explaining a screen shake correction function of the maritime warning system image analysis processing unit 310 for the protection of bridge facilities.
9 is a view for explaining the function of the marine warning system control unit 300 for the protection of bridge facilities according to the present invention.
10 is a diagram illustrating object recognition of a deep learning unit for protecting a bridge facility according to the present invention.

Before addressing the details of the embodiments described below, some terms will be defined or clarified.

AIS is an abbreviation of'Automatic Identification System' and means a device that automatically transmits and receives ship's specifications and operation information between ships and ships or ships and lands at a fixed interval according to the speed of the ship.

VTS is an abbreviation of'Vessel Traffic Service', which means ship navigation information service. In order to improve the safety and efficiency of ship passage, and protect the environment, the movement of ships when navigating ports and entry routes is controlled by advanced technology such as RADAR, CCTV, VHF It refers to a service service that provides advice or necessary information for safe operation within the scope of observation with scientific equipment that does not infringe on the authority of the master or exempt from obligations.

MMSI stands for'Maritime Mobile Service Identity', and is transmitted in digital form over a radio frequency channel to uniquely identify ship stations, ship earth stations, coast stations, coast earth stations and group calls with a series of 9 digits.

Hereinafter, a marine warning system for protecting a bridge facility according to the present invention will be described in detail with reference to FIGS. 2 to X.

The maritime warning system for protecting bridge facilities by receiving operation information of a ship from a ship having an AIS according to the present invention comprises: at least one photographing unit 100 installed on a bridge to photograph a predetermined range; An AIS transceiver 200 for receiving the ship's navigation information from the ship's AIS; Including a control unit 300 that receives the image captured from the photographing unit 100 and the operation information of the ship from the AIS transceiver 200, and an alarm unit 400 that warns when a collision between the ship and the bridge is expected. It is characterized.

The present invention increases the safety of citizens and the efficiency of integrated control operation through the introduction of a collision prediction system. The ship's operation information (ship's current position, etc.) is received from the ship's AIS, and the ship approaching the bridge facility is detected through the photographing unit 100 that monitors the surroundings to protect the bridge facility. Through this, it is possible to establish a rapid maritime response system in case of an accident. In addition, the maritime warning system for protecting bridge facilities according to the present invention can be interlocked with the maritime warning system system of the VTS center, so that it can be integrated with the existing operating system to be displayed.

In addition, it characterized in that it further comprises a manager terminal 500 that communicates with the control unit 300 to remotely check the image captured from the photographing unit 100 and the operation information of the ship from the AIS transceiver 200 It is done.

The manager can communicate with the control unit 300 in real time through the manager terminal 500 to check the real-time monitoring status of the bridge facility to be protected and the operation information of nearby ships.

In addition, it characterized in that it further comprises an image deep learning unit 600 for deep learning by receiving the image captured by the photographing unit 100.

Referring to FIG. 4, when an image is input, the image deep learning unit 600 tracks an object, which tracks an object in steps of foreground, background separation, noise removal, object extraction, and object combination. After that, object information (images, movement paths, etc.) can be obtained through the process of object extraction and object recognition. 5, it is possible to classify an image in which an object appears and implement a metadata generation function, and a convolutional neural network (CNN or ConvNet) uses a CNN to directly classify images, video, text, or sound. Ships can be classified by configuring and learning with yolo, a learning framework.

In addition, the photographing unit 100 is characterized in that it includes a daytime CCTV 110 for photographing during the daytime and a nighttime CCTV 120 for photographing at night by designating a daytime and nighttime time zone in advance.

In addition, the nighttime CCTV 120 is characterized in that the infrared night vision camera or infrared thermal imaging camera using infrared.

In addition, the alarm unit 400 is characterized in that it includes a speaker 410 to warn an approaching ship by voice and a warning light 420 to warn visually with light. A manager can set a danger zone so that it can warn a ship approaching a bridge facility, and automatically or manually warn when a ship approaches the danger zone. In the case of the warning light 420, light is irradiated over the sea to inform the ship of the danger zone.

In addition, the speaker 410 is characterized in that it receives and transmits the warning broadcast of the offshore bridge control center. This is to enable automatic broadcasting by receiving warning broadcasting from the offshore bridge control center when the administrator cannot directly broadcast.

In addition, the speaker 410 uses a network broadcasting system capable of unlimited expansion in the same network, and flexible interworking with other facilities is possible through a network method.

In addition, the control unit 300 is characterized in that it includes an image analysis processing unit 310 for analyzing and processing the image transmitted from the photographing unit 100. To explain in more detail with reference to FIGS. 6 to 7, the image analysis processing unit 310 recognizes the vessel in the CCTV image, displays real-time information of the AIS vessel superimposed on the detected maritime vessel image, and integrates and stores the information being implemented. It is configured to be able to grasp various ship-related information on the screen, playback function and CCTV screen at once, and it provides efficiency of management and operation by displaying real-time information on the screen. That is, as shown in FIG. 7, the administrator can check the CCTV image screen processed by the image analysis processing unit 310 through the administrator terminal 500 in real time.

In addition, the image analysis processing unit 310 has a fog removal function, which applies an algorithm through Equation 1 below.

<Equation 1. Fog removal algorithm formula>

The present invention analyzes a defog noise pixel to remove a fog, extracts a lower brightness value among R, G, and B, and adjusts the lower pixel value by applying the above equation.

In addition, the image analysis processing unit 310 has a screen shake correction function with reference to FIG. 8.

In addition, the marine warning system for protecting bridge facilities according to the present invention further includes a recording and reproducing apparatus. This means that the control unit 300 overlays and displays the captured image of the photographing unit 100 received or the navigation information data of the ship transmitted from the AIS transceiver 200. It receives data in real time and plays back the record, and it can play back the record from the past image (stored image).

In addition, with reference to FIG. 9, the control unit 300 has a function of setting and tracking a vessel of interest, an alarm function of a vessel of interest, a function of checking the position of a vessel of interest and a course speed, an electronic chart display function of a control area based on a geographic coordinate system, and a function of displaying AIS vessel information , Ocean map update function, user map creation function, ship search and inquiry function using MMSI call code, ship search and inquiry function using name, and distance range/direction display function between two points.

In addition, the control unit 300 may further include an image storage unit 320 that stores an image analyzed and processed by the image analysis processing unit 310.

In addition, the deep learning unit 600 is characterized in that when a vessel that is not recognized by the AIS transceiver 200 is detected by the photographing unit 100, the object in the image captured by the photographing unit 100 is detected. . In more detail with reference to FIG. 10, when a vessel not recognized by AIS is displayed in an image, an object in the image is detected.

In addition, the maritime alarm system for protecting bridge facilities according to the present invention has a function to automatically block when an unauthorized device is connected to enhance security, and set a password to prevent arbitrary changes other than the administrator. In addition, it has the function of connecting with multiple AIS devices of several ships, integrating into one signal, and removing redundant signals.

100: photographing department
110: Daytime CCTV 120: Nighttime CCTV
200: AIS transceiver
300: control unit
400: alarm unit
410: speaker 420: warning light
500: administrator terminal
600: Deep Learning Department

Claims (10)

In the maritime warning system that protects bridge facilities by receiving the ship's operation information from a ship with AIS,
One or more photographing units 100 installed on the bridge to photograph a predetermined range;
An AIS transceiver 200 for receiving the ship's navigation information from the ship's AIS;
The control unit 300 receiving the image captured from the photographing unit 100 and the operation information of the ship from the AIS transceiver 200, and
Marine warning system for protecting bridge facilities, characterized in that it comprises an alarm unit 400 to warn when a collision between a ship and a bridge is expected.
The method according to claim 1,
It characterized in that it further comprises a manager terminal 500 that communicates with the control unit 300 to remotely check the image captured from the photographing unit 100 and the operation information of the ship from the AIS transceiver 200. Marine alarm system to protect bridge facilities.
The method according to claim 1,
The maritime warning system for protecting bridge facilities, characterized in that it further comprises an image deep learning unit (600) for receiving the image captured by the photographing unit (100) and performing deep learning.
The method according to claim 1,
The photographing unit 100 designates daytime and nighttime time zones in advance
Weekly CCTV (110) and
A maritime warning system for protecting bridge facilities, comprising a night CCTV 120 for photographing at night.
The method of claim 4,
The nighttime CCTV (120) is a marine warning system for protecting bridge facilities, characterized in that the infrared night vision camera or infrared thermal imaging camera using infrared.
The method according to claim 1,
The alarm unit 400 for the approaching ship
A speaker 410 to warn by voice, and
Marine warning system for protecting bridge facilities, characterized in that it comprises a warning light (420) for visual warning with light.
The method of claim 6,
The speaker 410 is a marine warning system for protecting a bridge facility, characterized in that for receiving and transmitting a warning broadcast from a marine bridge control center.
The method according to claim 1,
The control unit 300,
And an image analysis processing unit 310 for analyzing and processing the image transmitted from the photographing unit 100.
The method of claim 8,
The control unit 300,
The maritime warning system for protecting bridge facilities, characterized in that it further comprises an image storage unit (320) for storing the image analyzed and processed by the image analysis processing unit (310).
The method of claim 3,
The deep learning unit 600,
When a vessel not recognized by the AIS transceiver (200) is detected by the photographing unit (100), the photographing unit (100) detects an object in an image captured by the photographing unit (100).

Images