CN113762141A - Intelligent video recognition early warning method, system, computer equipment and storage medium - Google Patents

Intelligent video recognition early warning method, system, computer equipment and storage medium Download PDF

Info

Publication number
CN113762141A
CN113762141A CN202111032006.3A CN202111032006A CN113762141A CN 113762141 A CN113762141 A CN 113762141A CN 202111032006 A CN202111032006 A CN 202111032006A CN 113762141 A CN113762141 A CN 113762141A
Authority
CN
China
Prior art keywords
ship
ships
information
early warning
ais
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111032006.3A
Other languages
Chinese (zh)
Inventor
范文峰
范晓月
蓝启威
陈敬普
龚鑫鹏
韩斌
范嵩
王峰
文小波
文明忠
胡华锋
刘士军
魏操
杨茁
凌文豪
何国彬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Maritime Technology Co ltd
Original Assignee
Guangzhou Maritime Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Maritime Technology Co ltd filed Critical Guangzhou Maritime Technology Co ltd
Priority to CN202111032006.3A priority Critical patent/CN113762141A/en
Publication of CN113762141A publication Critical patent/CN113762141A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/22Matching criteria, e.g. proximity measures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G3/00Traffic control systems for marine craft
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02Services making use of location information
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/30Services specially adapted for particular environments, situations or purposes
    • H04W4/40Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P]
    • H04W4/42Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P] for mass transport vehicles, e.g. buses, trains or aircraft

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Evolutionary Computation (AREA)
  • General Engineering & Computer Science (AREA)
  • Evolutionary Biology (AREA)
  • Molecular Biology (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computing Systems (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Ocean & Marine Engineering (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Traffic Control Systems (AREA)

Abstract

The invention relates to an intelligent video identification early warning method, a system, computer equipment and a storage medium, and the technical scheme is as follows: acquiring image information in a monitored area and AIS ship data of all ships; after all ships in the monitoring area are obtained according to the image information, image recognition is carried out on all the ships, first ship number information and first ship name information of all the ships are recognized, then load lines and horizontal planes of all the ships are recognized, and actual waterlines of all the ships are obtained; associating the first ship number information of all ships with the AIS ship data of all ships one by one, then judging whether the ship violates rules or not according to the first ship name information of the ship, the AIS ship data corresponding to the ship and the actual waterline of the ship, and if the ship violates the rules, sending violation early warning to the ship; this application has carries out safety supervision to boats and ships on water to send out the effect of early warning to the boats and ships of violating the regulations and speeding.

Description

Intelligent video recognition early warning method, system, computer equipment and storage medium
Technical Field
The invention relates to the technical field of ship safety supervision, in particular to an intelligent video identification early warning method, an intelligent video identification early warning system, computer equipment and a storage medium.
Background
Along with the increasingly busy of water traffic, more and more boats and ships of navigating on water, wherein, there is not rare boats and ships and has the problem of violating transportation, speeding, leads to the fact the influence to the safe navigation on water, consequently, the boats and ships of navigating on water need carry out the safety supervision urgently.
Disclosure of Invention
Aiming at the defects in the prior art, the invention aims to provide an intelligent video identification early warning, which has the functional advantages of carrying out safety supervision on a water ship and giving an early warning to illegal and overspeed ships.
The technical purpose of the invention is realized by the following technical scheme:
an intelligent video identification early warning method comprises the following steps:
acquiring image information in a monitoring area and AIS ship data of all ships in the monitoring area;
after all ships in the monitoring area are obtained according to the image information, image recognition is carried out on all the ships, ship plate and ship name areas of all the ships are recognized, character recognition is carried out on the ship plate and ship name areas of all the ships, first ship number information and first ship name information of all the ships are recognized, then load lines and horizontal planes of all the ships are recognized, and actual waterlines of all the ships are obtained;
the first ship number information of all ships is associated with the AIS ship data of all ships one by one, whether the ship breaks rules or not is judged according to the first ship name information of the ship, the AIS ship data corresponding to the ship and the actual waterline of the ship, and if the ship breaks rules, violation early warning is sent to the ship.
Optionally, obtaining all ships in the monitored area according to the image information includes:
selecting a plurality of characteristic points of the same object in the image information, inputting the plurality of characteristic points of the object into a preset ship model for matching processing to obtain matching data, judging the object as other objects if the matching data is smaller than a preset threshold value, judging the object as a ship if the matching data is not smaller than the preset threshold value, and obtaining all ships in a monitoring area according to the judgment, wherein the preset ship model comprises: passenger ship model, container ship model, grocery ship model and bulk cargo ship model.
Optionally, the AIS ship data includes: second ship number information and second ship name information.
Optionally, associate the first ship number information of all boats and ships with the AIS ship data of all boats and ships one-to-one, then judge whether this boats and ships violate rule according to the first ship name information of boats and ships and the AIS ship data that correspond with this boats and ships and the actual waterline of boats and ships, if this boats and ships violate rule and send out violation early warning to it, include:
matching the first ship number information of all ships with the second ship number information of all AIS ship data to obtain a matching result, and associating the ship corresponding to the first ship number information with the AIS ship data corresponding to the second ship number information under the condition that the matching result is in accordance;
comparing first ship name information of a ship with a second ship name in AIS ship data related to the first ship name information, judging ship name compliance of the ship under the condition that the first ship name information is the same as the second ship name information, judging violation of the ship under the condition that the first ship name information is different from the second ship name information, and sending violation early warning to the ship;
the method comprises the steps of comparing an actual waterline of a ship with a threshold value marked on a load line, judging that the ship carries the reclosing gauge under the condition that the actual waterline is not larger than the threshold value marked on the load line, judging that the ship breaks rules and sending violation early warning to the ship under the condition that the actual waterline is larger than the threshold value marked on the load line.
Optionally, the method further includes: acquiring position information of all ships according to image information of all ships at different moments, and acquiring the navigational speeds of all ships according to the position information of all the ships;
the method comprises the steps of comparing the speed of a ship with a preset first speed threshold value and a preset second speed threshold value respectively, judging that the ship does not run at an overspeed if the speed of the ship is not greater than the preset first speed threshold value and not less than the preset speed threshold value, and judging that the ship runs at an overspeed and sending an overspeed warning to the ship if the speed of the ship is greater than the preset first speed threshold value or the speed of the ship is less than the preset second speed threshold value.
Optionally, the method further includes: acquiring position information of all ships at different moments through a radar, and acquiring the navigational speeds of all the ships according to the position information of all the ships;
comparing the navigational speed of the ship with a preset navigational speed threshold, judging that the ship does not run at an overspeed if the navigational speed of the ship is not greater than the preset navigational speed threshold, and judging that the ship runs at an overspeed and sending an overspeed early warning to the ship if the navigational speed of the ship is greater than the preset navigational speed threshold.
Optionally, the violation early warning and the overspeed early warning are both sent through AIS, VHF, 3G, 4G, or 5G.
An intelligent video recognition early warning system, comprising:
the data acquisition module is used for acquiring image information in a monitoring area and AIS ship data of all ships in the monitoring area;
the image recognition module is used for carrying out image recognition on all ships after all the ships in the monitoring area are obtained according to the image information, recognizing the ship plate and ship name areas of all the ships, then carrying out character recognition on the ship plate and ship name areas of all the ships, recognizing first ship number information and first ship name information of all the ships, and then recognizing load lines and horizontal planes of all the ships to obtain actual waterlines of all the ships;
and the violation early warning module is used for associating the first ship number information of all ships with the AIS ship data of all ships one by one, then judging whether the ships violate rules or not according to the first ship name information of the ships, the AIS ship data corresponding to the ships and the actual waterline of the ships, and if the ships violate the rules, sending violation early warnings to the ships.
A computer device comprising a memory storing a computer program and a processor implementing the steps of the method described above when executing the computer program.
A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the above-mentioned method.
In conclusion, the invention has the following beneficial effects: under the condition that the monitoring area is a coastal water area or near a sea mouth, image information near the sea mouth can be acquired, safety supervision work on the coastal water area or the sea mouth can be well done, ship dynamics of all ships on water can be fully mastered, active supervision on all ships can be realized through AIS (automatic identification system) ships including image information of all ships and all ships, overspeed early warning can be sent to all ships in the monitoring area, and safety supervision on all ships can be realized.
Drawings
FIG. 1 is a schematic flow diagram of a method provided by the present invention;
FIG. 2 is a block diagram of an intelligent video recognition early warning system provided by the present invention;
fig. 3 is an internal structural diagram of a computer device in the embodiment of the present invention.
Detailed Description
In order to make the objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in detail below. Several embodiments of the invention are presented in the drawings. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein.
In the present invention, unless otherwise expressly specified or limited, the terms "mounted," "connected," "secured," and the like are to be construed broadly and can, for example, be fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations. The terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature.
The invention is described in detail below with reference to the figures and examples.
The invention provides an intelligent video identification early warning method, as shown in figure 1, comprising the following steps:
step 100, acquiring image information in a monitoring area and AIS ship data of all ships in the monitoring area;
200, acquiring all ships in a monitored area according to the image information, then carrying out image recognition on all the ships, recognizing the ship plate and ship name areas of all the ships, then carrying out character recognition on the ship plate and ship name areas of all the ships, recognizing first ship number information and first ship name information of all the ships, and then recognizing load lines and horizontal planes of all the ships to obtain actual waterlines of all the ships;
step 300, associating the first ship number information of all ships with the AIS ship data of all ships one by one, then judging whether the ship violates rules or not according to the first ship name information of the ship, the AIS ship data corresponding to the ship and the actual waterline of the ship, and if the ship violates the rules, sending violation early warning to the ship.
In practical application, a channel bypass is usually provided with a shore-based AIS, a ship is provided with AIS equipment for communicating with the shore-based AIS, image information in a monitoring area can be acquired through camera equipment such as a ball machine and an infrared camera which are installed near the monitoring area, image information near a sea outlet can be acquired under the condition that the monitoring area is a coastal water area or near the sea outlet, safety supervision work on the coastal water area or the sea outlet can be well done, ship dynamics of all ships on water can be fully mastered, then image recognition is carried out on the image information, all ships in the image information can be recognized, specifically, ship plates are usually fixedly arranged on two sides of the ships, ship numbers are carved or printed on the ship plates, ship names are usually brushed on the ship bodies of the ships, and image information containing the ship plates and the ship names can be shot through the camera equipment, then, carrying out image recognition on the image information to obtain an image and a ship name area of the ship plate, then correcting the image and the ship name area of the ship plate, carrying out character recognition on the corrected image and the corrected ship plate area to obtain the ship number on the ship plate and the ship name on the ship body, namely obtaining first ship number information and first ship name information of the ship; a load line is usually engraved on the ship, and the draft information of the ship can be obtained in real time by carrying out image recognition on the load line and the horizontal plane of the ship, namely the actual draft information of the ship is obtained; and then acquiring AIS ship data transmitted by all ships to the AIS base station, actively monitoring all ships by the AIS ships including all ships and image information of all ships, specifically, associating all ships identified in the image information with the AIS ship data of all the ships in a one-to-one correspondence manner, then judging whether the real-time information of the ships corresponds to the AIS ship data corresponding to the ships or not, and if not, judging that the ships violate rules and sending violation early warning to the ships.
Further, obtaining all ships in the monitored area according to the image information includes:
after image information in a monitored area is obtained, matching operation needs to be carried out on all objects in the image information and a preset ship model, the preset ship model is built by adopting a deep learning algorithm, specifically, a plurality of feature points on the same object are selected, the feature points can be the left end point, the right end point, the upper end point, the lower end point and turning points of the object, then the plurality of feature points of the object are all input into the preset ship model to be matched, matching data are obtained, if the matching data are smaller than a preset threshold value, the object is judged to be other objects, if the matching data are not smaller than the preset threshold value, the object is judged to be a ship, then matching operation is carried out on the next object in the image information until all the objects in the image information are matched with the preset ship model, and all ships in the monitored area are obtained.
All objects that can discern in the image information all carry out matching processing with predetermineeing the ship model in this application to the realization is to the discernment of all boats and ships in the image information, thereby is convenient for carry out the one-to-one with the boats and ships that discern and all AIS boats and ships data. Specifically, the preset ship model includes: a passenger ship model, a container ship model, a grocery ship model and a bulk cargo ship model; in practical application, a plurality of characteristic points of an object are input into any one preset ship model of a passenger ship model, a container ship model, a grocery ship model and a bulk cargo ship model to obtain matching data of the object and the preset ship model, if the matching data is not smaller than a preset threshold value, the object is judged to be the ship type corresponding to the preset ship model, if the matching data is smaller than the preset threshold value, the plurality of characteristic points of the object are input into a next preset ship model to obtain matching data of the object and the next preset ship model, and the next preset ship model is selected from one of other preset ship models, so that whether the object is a ship or not is determined, and the ship type of the object is determined.
Further, the AIS vessel data includes: second ship number information, second ship name information and MMSI code; the second ship number information can be matched with the first ship number information, and the first ship name information of the ship can be compared according to the second ship name information so as to judge whether the ship name of the ship is in compliance.
Further, associating all boats and ships with the AIS ship data of all boats and ships one by one, then judging whether this boats and ships violate rules according to the real-time information of boats and ships and the AIS ship data corresponding to this boats and ships, if this boats and ships violate rules and send out violation early warning to it, include:
matching the first ship number information of all ships with the second ship number information of all AIS ship data to obtain a matching result, and associating the ship corresponding to the first ship number information with the AIS ship data corresponding to the second ship number information under the condition that the matching result is in accordance, namely under the condition that any one of the first ship number information of all ships is the same as any one of the second ship number information of all AIS ship data;
comparing first ship name information of a ship with a second ship name in AIS ship data related to the first ship name information, judging ship name compliance of the ship under the condition that the first ship name information is the same as the second ship name information, judging violation of the ship under the condition that the first ship name information is different from the second ship name information, and sending violation early warning to the ship;
the method comprises the steps of comparing an actual waterline of a ship with a threshold value marked on a load line, judging that the ship carries the reclosing gauge under the condition that the actual waterline is not larger than the threshold value marked on the load line, judging that the ship breaks rules and sending violation early warning to the ship under the condition that the actual waterline is larger than the threshold value marked on the load line.
Under the condition that the first ship number information is the same as the second ship number information, the ship corresponding to the first ship number information is associated with the AIS ship data corresponding to the second ship number information, and the association between the ship and the AIS ship data is realized through the same ship number information, so that the association between the ship and the AIS ship data is more accurate and is not easy to generate association errors or the condition that the ship is not associated with any AIS ship data in all the AIS ship data is generated compared with the association between the ship and the AIS ship data through the same ship name; after the association between the ship and the AIS ship data is realized, the first ship name information of the ship can be compared with the second ship name information in the AIS ship data associated with the first ship name information, so that whether the ship name of the ship is in compliance or not is judged, and if the ship name of the ship is not in compliance, namely the first ship name information and the second ship name information of the ship are not the same, an early warning is sent to the ship, and the safety supervision on the ship name of the ship is realized.
In practical application, a threshold value is marked on a load line of a ship, the actual waterline of the ship cannot exceed the threshold value marked on the load line in the process of sailing the ship, the actual waterline of the ship can be obtained by identifying the load line and a horizontal plane of the ship, then the actual waterline of the ship is compared with the threshold value marked on the load line of the ship, and the load condition of the ship can be judged according to the actual waterline of the ship and the load line on the ship, so that the ship-borne coincidence gauge is judged under the condition that the actual waterline does not exceed the threshold value marked on the load line, namely the actual waterline is not greater than the threshold value marked on the load line, no early warning is sent to the ship, but under the condition that the actual waterline exceeds the threshold value marked on the load line, namely the actual waterline is smaller than the threshold value marked on the load line, and if the load of the ship is judged to be illegal, an illegal early warning is sent to the ship, and the safety supervision of the ship is further realized.
In practical application, under the condition that load limitation exists in a river channel or a channel area, namely, under the condition that only the load of a ship is allowed to be located in a specified load range, the condition that the load of the ship exceeds the specified load range is judged, whether the load of the ship exceeds the specified load range can be judged according to a real-time waterline, and under the condition that the load exceeds the specified load range, the condition that the load of the ship exceeds the specified load range is judged, and violation early warning is sent out to the ship.
Further, still include: acquiring position information of all ships according to image information of all ships at different moments, and acquiring the navigational speeds of all ships according to the position information of all the ships;
the method comprises the steps of comparing the speed of a ship with a preset first speed threshold value and a preset second speed threshold value respectively, judging that the ship does not run at an overspeed if the speed of the ship is not greater than the preset first speed threshold value and not less than the preset speed threshold value, and judging that the ship runs at an overspeed and sending an overspeed warning to the ship if the speed of the ship is greater than the preset first speed threshold value or the speed of the ship is less than the preset second speed threshold value.
Specifically, image information of all ships is obtained at a first moment, position information of all the ships at the first moment can be obtained through positions of all the ships in the image information, then image information of all the ships is obtained at a second moment, position information of all the ships at the second moment can be obtained through positions of all the ships in the image information, the speed of the ship is obtained according to the position information of the same ship at the first moment and the position information of the same ship at the second moment, so that the speed of all the ships in a monitored area is obtained, the speed of all the ships in the monitored area is monitored, then the speed of the ship is respectively compared with a preset first speed threshold and a preset second speed threshold, the preset first speed threshold is larger than the preset second speed threshold, and under the condition that the speed of the ship is larger than the preset first speed threshold, and judging that the ship runs at an ultrahigh speed, judging that the ship runs at an ultralow speed under the condition that the speed of the ship is less than a preset second speed threshold, and sending an overspeed early warning to the ship when the ship runs at the ultrahigh speed or the ultralow speed, so that whether the ship has a suspicious condition or not is judged conveniently, and supervision on the ship in a monitored area is enhanced.
In practical application, a speed suspicion interval can be preset, then the navigational speed of the ship is compared with the speed suspicion interval, if the navigational speed of the ship is located in the speed suspicion interval, the suspicion of the navigational speed of the ship is judged, and the ship and/or a ship management center send out early warning to strengthen the supervision on the ship.
Further, the violation early warning and the overspeed early warning are both sent through AIS, VHF, 3G, 4G or 5G.
Optionally, the position information of all the ships at different moments can be acquired through the radar, the speed of the ships is obtained according to the position information of all the ships and the time difference of different moments, then the speed of the ships is compared with a preset speed threshold value, if the speed of the ships is not greater than the preset speed threshold value, the ships are judged not to run at an overspeed, if the speed of the ships is greater than the preset speed threshold value, the ships are judged to run at an overspeed and overspeed early warning is sent to the ships through the combination of the radar and the image information, the accuracy of the acquired position information of all the ships in the detection area is further ensured, and the radar can adopt any one or more of phased array radar, static radar, solid state radar and photoelectric radar.
According to the intelligent video identification early warning method, under the condition that the monitoring area is a coastal water area or near a sea outlet, the image information near the sea outlet can be obtained, the safety supervision work on the coastal water area or the sea outlet can be well done, the ship dynamics of all ships on water can be fully mastered, the active supervision on all the ships is realized through AIS (automatic identification system) ships including all the ships and the image information of all the ships, the overspeed early warning can be sent to all the ships in the monitoring area, and the safety supervision on all the ships is realized.
As shown in fig. 2, the present invention further provides an intelligent video recognition early warning system, which includes:
the data acquisition module 10 is used for acquiring image information in a monitoring area and AIS ship data of all ships in the monitoring area;
the image recognition module 20 is used for performing image recognition on all ships after obtaining all the ships in the monitored area according to the image information, recognizing the ship plate and ship name areas of all the ships, then performing character recognition on the ship plate and ship name areas of all the ships, recognizing first ship number information and first ship name information of all the ships, and then recognizing load lines and horizontal planes of all the ships to obtain actual waterlines of all the ships;
and the violation early warning module 30 is used for associating the first ship number information of all the ships with the AIS ship data of all the ships one by one, then judging whether the ships violate rules according to the first ship name information of the ships, the AIS ship data corresponding to the ships and the actual waterline of the ships, and if the ships violate the rules, sending violation early warnings to the ships.
For specific limitations of an intelligent video recognition early warning system, reference may be made to the above limitations on an intelligent video recognition early warning method, which is not described herein again. All modules in the intelligent video identification early warning system can be completely or partially realized through software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
In one embodiment, a computer device is provided, which may be a server, the internal structure of which may be as shown in fig. 3. The computer device includes a processor, a memory, a network interface, and a database connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The computer program is executed by a processor to implement an intelligent video recognition early warning method.
Those skilled in the art will appreciate that the architecture shown in fig. 3 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, a computer device is provided, comprising a memory and a processor, the memory having a computer program stored therein, the processor implementing the following steps when executing the computer program: acquiring image information in a monitoring area and AIS ship data of all ships in the monitoring area;
after all ships in the monitoring area are obtained according to the image information, image recognition is carried out on all the ships, ship plate and ship name areas of all the ships are recognized, character recognition is carried out on the ship plate and ship name areas of all the ships, first ship number information and first ship name information of all the ships are recognized, then load lines and horizontal planes of all the ships are recognized, and actual waterlines of all the ships are obtained;
the first ship number information of all ships is associated with the AIS ship data of all ships one by one, whether the ship breaks rules or not is judged according to the first ship name information of the ship, the AIS ship data corresponding to the ship and the actual waterline of the ship, and if the ship breaks rules, violation early warning is sent to the ship.
In one embodiment, the obtaining all ships in the monitored area according to the image information includes:
selecting a plurality of characteristic points of the same object in the image information, inputting the plurality of characteristic points of the object into a preset ship model for matching processing to obtain matching data, judging the object as other objects if the matching data is smaller than a preset threshold value, judging the object as a ship if the matching data is not smaller than the preset threshold value, and obtaining all ships in a monitoring area according to the judgment, wherein the preset ship model comprises: passenger ship model, container ship model, grocery ship model and bulk cargo ship model.
In one embodiment, the AIS vessel data includes: second ship number information and second ship name information.
In one embodiment, the associating the first ship number information of all ships with the AIS ship data of all ships one to one, and then determining whether the ship violates a rule according to the first ship name information of the ship, the AIS ship data corresponding to the ship, and an actual waterline of the ship, and if the ship violates the rule, sending violation early warning to the ship, includes:
matching the first ship number information of all ships with the second ship number information of all AIS ship data to obtain a matching result, and associating the ship corresponding to the first ship number information with the AIS ship data corresponding to the second ship number information under the condition that the matching result is in accordance;
comparing first ship name information of a ship with a second ship name in AIS ship data related to the first ship name information, judging ship name compliance of the ship under the condition that the first ship name information is the same as the second ship name information, judging violation of the ship under the condition that the first ship name information is different from the second ship name information, and sending violation early warning to the ship;
the method comprises the steps of comparing an actual waterline of a ship with a threshold value marked on a load line, judging that the ship carries the reclosing gauge under the condition that the actual waterline is not larger than the threshold value marked on the load line, judging that the ship breaks rules and sending violation early warning to the ship under the condition that the actual waterline is larger than the threshold value marked on the load line.
In one embodiment, further comprising: acquiring position information of all ships according to image information of all ships at different moments, and acquiring the navigational speeds of all ships according to the position information of all the ships;
the method comprises the steps of comparing the speed of a ship with a preset first speed threshold value and a preset second speed threshold value respectively, judging that the ship does not run at an overspeed if the speed of the ship is not greater than the preset first speed threshold value and not less than the preset speed threshold value, and judging that the ship runs at an overspeed and sending an overspeed warning to the ship if the speed of the ship is greater than the preset first speed threshold value or the speed of the ship is less than the preset second speed threshold value.
In one embodiment, further comprising: acquiring position information of all ships at different moments through a radar, and acquiring the navigational speeds of all the ships according to the position information of all the ships;
comparing the navigational speed of the ship with a preset navigational speed threshold, judging that the ship does not run at an overspeed if the navigational speed of the ship is not greater than the preset navigational speed threshold, and judging that the ship runs at an overspeed and sending an overspeed early warning to the ship if the navigational speed of the ship is greater than the preset navigational speed threshold.
In one embodiment, the violation early warning and the overspeed early warning are both transmitted via AIS, VHF, 3G, 4G, or 5G.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
The above description is only a preferred embodiment of the present invention, and the protection scope of the present invention is not limited to the above embodiments, and all technical solutions belonging to the idea of the present invention belong to the protection scope of the present invention. It should be noted that modifications and embellishments within the scope of the invention may occur to those skilled in the art without departing from the principle of the invention, and are considered to be within the scope of the invention.

Claims (10)

1. An intelligent video identification early warning method is characterized by comprising the following steps:
acquiring image information in a monitoring area and AIS ship data of all ships in the monitoring area;
after all ships in the monitoring area are obtained according to the image information, image recognition is carried out on all the ships, ship plate and ship name areas of all the ships are recognized, character recognition is carried out on the ship plate and ship name areas of all the ships, first ship number information and first ship name information of all the ships are recognized, then load lines and horizontal planes of all the ships are recognized, and actual waterlines of all the ships are obtained;
the first ship number information of all ships is associated with the AIS ship data of all ships one by one, whether the ship breaks rules or not is judged according to the first ship name information of the ship, the AIS ship data corresponding to the ship and the actual waterline of the ship, and if the ship breaks rules, violation early warning is sent to the ship.
2. The intelligent video identification early warning method according to claim 1, wherein the obtaining of all ships in the monitored area according to the image information comprises:
selecting a plurality of characteristic points of the same object in the image information, inputting the plurality of characteristic points of the object into a preset ship model for matching processing to obtain matching data, judging the object as other objects if the matching data is smaller than a preset threshold value, judging the object as a ship if the matching data is not smaller than the preset threshold value, and obtaining all ships in a monitoring area according to the judgment, wherein the preset ship model comprises: passenger ship model, container ship model, grocery ship model and bulk cargo ship model.
3. The intelligent video identification early warning method of claim 2, wherein the AIS vessel data comprises: second ship number information and second ship name information.
4. The intelligent video identification early warning method according to claim 3, wherein the first ship number information of all ships is associated with the AIS ship data of all ships one by one, then whether the ship violates a rule is judged according to the first ship name information of the ship, the AIS ship data corresponding to the ship and the actual waterline of the ship, and if the ship violates the rule, violation early warning is sent to the ship, comprising:
matching the first ship number information of all ships with the second ship number information of all AIS ship data to obtain a matching result, and associating the ship corresponding to the first ship number information with the AIS ship data corresponding to the second ship number information under the condition that the matching result is in accordance;
comparing first ship name information of a ship with a second ship name in AIS ship data related to the first ship name information, judging ship name compliance of the ship under the condition that the first ship name information is the same as the second ship name information, judging violation of the ship under the condition that the first ship name information is different from the second ship name information, and sending violation early warning to the ship;
the method comprises the steps of comparing an actual waterline of a ship with a threshold value marked on a load line, judging that the ship carries the reclosing gauge under the condition that the actual waterline is not larger than the threshold value marked on the load line, judging that the ship breaks rules and sending violation early warning to the ship under the condition that the actual waterline is larger than the threshold value marked on the load line.
5. The intelligent video identification early warning method according to claim 1, further comprising: acquiring position information of all ships according to image information of all ships at different moments, and acquiring the navigational speeds of all ships according to the position information of all the ships;
the method comprises the steps of comparing the speed of a ship with a preset first speed threshold value and a preset second speed threshold value respectively, judging that the ship does not run at an overspeed if the speed of the ship is not greater than the preset first speed threshold value and not less than the preset speed threshold value, and judging that the ship runs at an overspeed and sending an overspeed warning to the ship if the speed of the ship is greater than the preset first speed threshold value or the speed of the ship is less than the preset second speed threshold value.
6. The intelligent video identification early warning method according to claim 1, further comprising: acquiring position information of all ships at different moments through a radar, and acquiring the navigational speeds of all the ships according to the position information of all the ships;
comparing the navigational speed of the ship with a preset navigational speed threshold, judging that the ship does not run at an overspeed if the navigational speed of the ship is not greater than the preset navigational speed threshold, and judging that the ship runs at an overspeed and sending an overspeed early warning to the ship if the navigational speed of the ship is greater than the preset navigational speed threshold.
7. The intelligent video identification warning method according to claim 1, wherein the violation warning and overspeed warning are both transmitted through AIS, VHF, 3G, 4G or 5G.
8. An intelligent video identification early warning system, comprising:
the data acquisition module is used for acquiring image information in a monitoring area and AIS ship data of all ships in the monitoring area;
the image recognition module is used for carrying out image recognition on all ships after all the ships in the monitoring area are obtained according to the image information, recognizing the ship plate and ship name areas of all the ships, then carrying out character recognition on the ship plate and ship name areas of all the ships, recognizing first ship number information and first ship name information of all the ships, and then recognizing load lines and horizontal planes of all the ships to obtain actual waterlines of all the ships;
and the violation early warning module is used for associating the first ship number information of all ships with the AIS ship data of all ships one by one, then judging whether the ships violate rules or not according to the first ship name information of the ships, the AIS ship data corresponding to the ships and the actual waterline of the ships, and if the ships violate the rules, sending violation early warnings to the ships.
9. A computer device comprising a memory and a processor, the memory storing a computer program, characterized in that the processor, when executing the computer program, implements the steps of the method of any of claims 1 to 7.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 7.
CN202111032006.3A 2021-09-03 2021-09-03 Intelligent video recognition early warning method, system, computer equipment and storage medium Pending CN113762141A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111032006.3A CN113762141A (en) 2021-09-03 2021-09-03 Intelligent video recognition early warning method, system, computer equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111032006.3A CN113762141A (en) 2021-09-03 2021-09-03 Intelligent video recognition early warning method, system, computer equipment and storage medium

Publications (1)

Publication Number Publication Date
CN113762141A true CN113762141A (en) 2021-12-07

Family

ID=78792905

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111032006.3A Pending CN113762141A (en) 2021-09-03 2021-09-03 Intelligent video recognition early warning method, system, computer equipment and storage medium

Country Status (1)

Country Link
CN (1) CN113762141A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114218231A (en) * 2022-02-21 2022-03-22 杭州春来科技有限公司 Ship tail gas monitoring data processing method and system and computer readable storage medium
CN114875877A (en) * 2022-05-18 2022-08-09 苏交科集团股份有限公司 Ship lockage safety detection method
CN115019560A (en) * 2022-07-06 2022-09-06 浙江索思科技有限公司 Management method and system for ship entering and leaving port
CN115015900A (en) * 2022-05-30 2022-09-06 广州海事科技有限公司 Ship positioning method, system, computer equipment and storage medium

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114218231A (en) * 2022-02-21 2022-03-22 杭州春来科技有限公司 Ship tail gas monitoring data processing method and system and computer readable storage medium
CN114218231B (en) * 2022-02-21 2022-05-17 杭州春来科技有限公司 Ship tail gas monitoring data processing method and system and computer readable storage medium
CN114875877A (en) * 2022-05-18 2022-08-09 苏交科集团股份有限公司 Ship lockage safety detection method
WO2023221425A1 (en) * 2022-05-18 2023-11-23 苏交科集团股份有限公司 Ship lockage safety detection method
CN115015900A (en) * 2022-05-30 2022-09-06 广州海事科技有限公司 Ship positioning method, system, computer equipment and storage medium
CN115019560A (en) * 2022-07-06 2022-09-06 浙江索思科技有限公司 Management method and system for ship entering and leaving port
CN115019560B (en) * 2022-07-06 2023-08-25 浙江索思科技有限公司 Ship entry and exit management method and system

Similar Documents

Publication Publication Date Title
CN113762141A (en) Intelligent video recognition early warning method, system, computer equipment and storage medium
CN113393707A (en) Ship monitoring method, system, equipment and storage medium based on photoelectric linkage
CN104269075B (en) Navigation mark based on multiple sensors collision monitoring system
CN111935446B (en) Ship monitoring method, device, monitoring system and equipment based on block chain
CN112017478B (en) Bridge monitoring anti-collision early warning method and system, computer equipment and storage medium
CN111815120A (en) Water traffic risk assessment method, device, computer equipment and storage medium
CN111696388A (en) Bridge collision avoidance monitoring and early warning method and system, computer equipment and storage medium
CN113470374B (en) Vehicle overspeed monitoring method and device, computer equipment and storage medium
CN111951609B (en) Bridge active anti-collision early warning method, device, equipment and storage medium
CN112084971A (en) Ship bayonet detection method, system, computer equipment and storage medium
CN112084972A (en) Channel gate management method, channel gate management system, computer device, and storage medium
CN114881336A (en) Method, system, computer equipment and storage medium for automatically marking virtual navigation mark
CN112435449A (en) Full-digital intelligent fishery illegal ship identification and troubleshooting system and method
CN111985363B (en) Ship name identification system and method based on deep learning framework
CN111240229B (en) Fault information processing system based on intelligent ship berthing-off simulation test
CN112441196A (en) Processing method, system and storage medium of ship navigation risk assessment information
CN113257040B (en) Inland river traffic safety sign monitoring method, system, computer equipment and storage medium
CN113077658B (en) Method, system, computer device and storage medium for basin management
CN112037411B (en) Permission verification platform based on block chain database
CN113593304B (en) River-crossing building early warning anti-collision method, system, computer equipment and storage medium
CN113282084A (en) Ship safety control system based on big data
CN113313974A (en) Navigation mark collision detection method and device and computer readable storage medium
CN113538972B (en) Ferry ship early warning method, system, computer equipment and storage medium
CN117889865B (en) Ship sailing route optimization method, system and medium based on machine vision
CN116704817A (en) Intelligent water area channel management method, system, medium and computer

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination