CN113220910B

CN113220910B - Construction method and system of ship deck cable database

Info

Publication number: CN113220910B
Application number: CN202110552915.3A
Authority: CN
Inventors: 章文俊; 赵常九; 马双福; 岳敬文; 吕红光; 王庆武; 杨雪; 孟祥坤; 周翔宇
Original assignee: Dalian Maritime University
Current assignee: Dalian Maritime University
Priority date: 2021-05-20
Filing date: 2021-05-20
Publication date: 2023-06-06
Anticipated expiration: 2041-05-20
Also published as: CN113220910A

Abstract

The invention provides a construction method and a construction system of a ship deck cable database, wherein the method comprises the steps of obtaining video data of unsafe behaviors; preprocessing video data; screening the preprocessed data; labeling the screened images by labelimg; and storing the basic information of the marked unsafe behavior database image into a picture data table to form a deck cable unsafe behavior database. The invention extracts unsafe behavior characteristics of each database picture by collecting an image database of unsafe behaviors of a shipman, and stores the database picture characteristics and unsafe behavior indexes into a picture characteristic table; and the unsafe behavior of crews operating the deck cables is monitored through algorithms such as deep learning and a neural network, and based on the support of the project of the 'unsafe behavior of crews and state monitoring and early warning platform', the crews can obtain early warning through hand ring vibration.

Description

Construction method and system of ship deck cable database

Technical Field

The invention relates to the technical field of crossing between the field of ships and the field of computers, in particular to a method and a system for constructing a ship deck cable database.

Background

Monitoring of unsafe behavior of a crewman deck cable is a crucial step in a monitoring system of the behavior of the crewman, and along with the wide application of video monitoring technology in the field of ships, the unsafe behavior of the operation of the crewman cable is gradually changed from monitoring dominated by personnel and experience to video intelligent monitoring, and the video intelligent monitoring is also gradually accepted by crewman and on-road monitoring personnel in the operation of the ships.

However, video monitoring of unsafe behavior of crews in the field of ships is currently not widely studied and applied, and has the following three main difficulties:

1. object tracking management is difficult. The work of the crew is an international work, and usually ocean vessels are required to navigate in the global scope, so that the research is relatively difficult, and the crew can be conveniently tracked and managed in fixed places such as mines, railway stations and the like.

2. Real-time contact is difficult. The signals on the ocean vessel cannot be kept good like on land, so that the signals cannot be timely connected and timely communication cannot be achieved like on shore.

3. Because the ship has the characteristics of rolling, pitching and the like which are not possessed on land, the characteristics of unstable video images and the like can be met in the video acquisition process, and the method for manufacturing the land data set cannot be fully applied.

Thanks to the rapid development of video monitoring technology, intelligent, convenient and efficient identification can be realized in the land field. However, due to the special working environment and the special working property of the ship, the system cannot be directly applied to a monitoring system on the road, and therefore, the independent research and development of the ship and the establishment of a set of monitoring and early warning platform for checking the unsafe behaviors and the states of the crew are additionally important. In the process of establishing video monitoring, the only step requiring more human participation is to establish a complete unsafe behavior data set, and a set of data set integrating all unsafe behaviors must be completed to accurately identify and timely remind in the future identification process. At present, the data set is made by collecting a series of unsafe behaviors when a shipman actually works instead of designing unsafe behaviors in software, cutting a video into pictures, and processing through screening, labeling and the like to further form the data set. For example, the data sets of unsafe behaviors are provided for monitors in mines and construction sites, so that the quality of the data sets is particularly important for monitoring unsafe behaviors, and the final monitoring and early warning are directly influenced by the unsafe behavior database.

However, unsafe behavior in professional data sets of mines and construction sites is more professional, can be used for classifying navigation less, is unknown for a producer of the data set due to lack of navigation experience, and is difficult to be practically applied to the navigation field. Moreover, as the ship has the characteristics of rolling and pitching, the method for manufacturing the land data set is completely suitable for the ship, so that the manufacturing of the deck cable operation unsafe behavior database which is suitable for the navigation field and can accurately identify and early warn is very necessary.

Disclosure of Invention

According to the technical problems, a method and a system for constructing a ship deck cable database are provided. The invention extracts unsafe behavior characteristics of each database picture by collecting an image database of unsafe behaviors of a shipman, and stores the database picture characteristics and unsafe behavior indexes into a picture characteristic table; and the unsafe behavior of a crewman operating on a deck cable is monitored through algorithms such as deep learning and a neural network, and the crewman can obtain early warning through hand ring vibration based on the support of the unsafe behavior of the crewman and the state monitoring early warning platform project.

The invention adopts the following technical means:

a construction method of a ship deck cable database comprises the following steps:

acquiring video data of unsafe behaviors;

preprocessing the acquired video data;

screening the preprocessed data;

labeling the screened images by labelimg;

and storing the basic information of the marked unsafe behavior database image into a picture data table to form a ship deck cable database.

Further, the acquiring video data of unsafe behavior includes:

extracting unsafe behavior of a shipper as first information by combining a shipping company system file and an IMO rule;

counting and sorting unsafe behavior of ship deck cable operation as second information;

the correlation between the first information and the second information is analyzed, and information integration is carried out to obtain third information;

and converting the third information into actual operation through actual operation of boarding, and recording in a video mode.

Further, the preprocessing the acquired video data includes:

the recorded video data is clipped, each frame of image is clipped into one image, and the resolution of the image is 1920 x 1080.

Further, the screening the preprocessed data includes:

subtracting the N frame image from the N+1 frame image, subtracting the N+1 frame image from the N frame image, and adding the two subtracted images to obtain a target area;

subtracting the N frame image from the N+2 frame image, subtracting the N+2 frame image from the N frame image, and adding the two subtracted images to obtain a new target area;

subtracting the N-frame image from the N+n-frame image, subtracting the N+n-frame image from the N-frame image, and adding the two subtracted images to obtain a final target area;

setting a threshold value through repeating the above operation, continuing repeating the above steps from the n+n frame, reserving the image after reaching the threshold value, and continuing repeating the operation to obtain all the screened images.

Further, the basic information of the marked unsafe behavior database image is stored in a picture data table to form a ship deck cable database, wherein the picture data table comprises picture location information of pictures, picture warehousing time information and unsafe behavior information contained in the pictures.

The invention also provides a ship deck cable database construction system based on the construction method, which comprises the following steps:

the unsafe behavior data acquisition module is used for acquiring unsafe behavior video data;

the preprocessing module is used for preprocessing the acquired video data;

the data screening module is used for screening the preprocessed data;

the image labeling module is used for labeling the screened images by labelimg;

the picture basic information storage module is used for storing the basic information of the marked unsafe behavior database image into a picture data table to form a ship deck cable database.

Further, the picture data table comprises picture location information of pictures, picture warehousing time information and unsafe behavior information contained in the pictures.

A computer-readable storage medium having stored therein a set of computer instructions; the computer instruction set, when executed by the processor, implements the above-described method of constructing a ship deck line database.

Compared with the prior art, the invention has the following advantages:

1. according to the method and the system for constructing the ship deck cable database, provided by the invention, the unsafe behavior characteristics of each database picture are extracted through collecting the image database of unsafe behaviors of a shipman, and the database picture characteristics and unsafe behavior indexes are stored in the picture characteristic table; and the unsafe behavior of the crewman operated by the deck cable is monitored through algorithms such as deep learning and a neural network, and the crewman can obtain early warning through hand ring vibration based on the support of the unsafe behavior of the crewman and the state monitoring early warning platform project.

2. The construction method and the construction system of the ship deck cable database solve the problem that unsafe behavior monitoring and early warning of deck crew cable operation cannot be achieved in the prior art, and further safety of crew cable operation cannot be guaranteed. Meanwhile, the database can be used for development and verification of various algorithms, and plays a key role in promoting development of marine video monitoring of ships.

3. The construction method and the construction system of the ship deck cable database provide a basis for video monitoring of unsafe behaviors of crews, and reduce casualties on a ship deck caused by unsafe behaviors of operation cables.

Based on the reasons, the invention can be widely popularized in the fields of crossing of the ship field and the computer field and the like.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings may be obtained according to the drawings without inventive effort to a person skilled in the art.

FIG. 1 is a flow chart of the method of the present invention.

Detailed Description

In order that those skilled in the art will better understand the present invention, a technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in which it is apparent that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present invention without making any inventive effort, shall fall within the scope of the present invention.

It should be noted that the terms "first," "second," and the like in the description and the claims of the present invention and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the invention described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

As shown in fig. 1, the invention provides a method for constructing a ship deck cable database, which comprises the following steps:

s1, acquiring video data of unsafe behaviors;

in a specific implementation, as a preferred embodiment of the present invention, the acquiring video data of unsafe behavior includes:

S2, preprocessing the acquired video data;

in a specific implementation, as a preferred embodiment of the present invention, the preprocessing the acquired video data includes:

S3, screening the preprocessed data; the video file captured by the camera has tens of thousands of pictures after being decomposed into images, but most of the pictures have no practical meaning for labeling, and a lot of time is required for manually eliminating the pictures, so that the screening method of unsafe behavior pictures based on the ship deck environment is provided in the embodiment.

In a specific implementation, as a preferred embodiment of the present invention, the screening the pretreated data includes:

subtracting the N frame image from the N+1 frame image, subtracting the N+1 frame image from the N frame image, and adding the two subtracted images to obtain a target area; the purpose of this process is to increase the contrast of the target area.

However, for the operation of the ship deck, the two subtracted images may not be able to extract the required feature target, so that the N-frame image is subtracted from the n+2-frame image, the n+2-frame image is subtracted from the N-frame image, and the two subtracted images are added to obtain a new target area;

S4, labeling the screened images by labelimg;

In a specific implementation, as a preferred embodiment of the present invention, the basic information of the marked unsafe behavior database image is stored in a picture data table to form a ship deck cable database, wherein the picture data table includes picture information of a picture, picture warehouse-in time information and unsafe behavior information contained in the picture.

Corresponding to the construction method of the ship deck cable database in the application, the application also provides a ship deck cable database construction system, which comprises the following steps: the method comprises the steps of acquiring unsafe behavior data modules, preprocessing modules, data screening modules, image labeling modules and picture basic information storage modules, wherein:

the preprocessing module is used for preprocessing the acquired video data;

the data screening module is used for screening the preprocessed data;

the image labeling module is used for labeling the screened images by labelimg;

For the embodiments of the present invention, since they correspond to those in the above embodiments, the description is relatively simple, and the relevant similarities will be found in the description of the above embodiments, and will not be described in detail herein.

Examples:

in this embodiment, the system files and IMO specifications of each large shipping company are collected first, the unsafe behavior specifications therein are extracted and integrated, and the database is formed to conform to the integrity requirement, so that the official requirement specifications are collected first for database generation.

Because unsafe behavior is not limited to company files and IMO regulations when actual crews work, but also a plurality of problems to be avoided after practice summary are carried out, the experiences are closer to the actual work, and a plurality of dangers are avoided in the actual work. And secondly, carrying out correlation analysis according to unsafe behaviors obtained by system files and various regulations and actual working experiences. Because practical experience is different from the emphasis of various regulations and files, system files and regulations are more from the viewpoint of protecting normal operation of ships, and practical working experience is more focused on protecting own safety, correlation analysis is carried out on the two materials, and a complete unsafe behavior database is obtained.

After the collection of the unsafe behavior database of the shipman is completed, video sampling is needed, and specific unsafe behavior operation is obtained for further identification. The actual conditions of cable winding and unwinding, cable machine use and deck daily maintenance are shot on the actual ship, and the water staff is required to make protective measures, so that unsafe behaviors in the unsafe behavior database are actually demonstrated under the condition of ensuring safety. Specifically, the video data is decomposed into an original picture data set after being acquired, and subjected to image processing such as graying, median filtering, and the like. Then, through subtraction, addition and iteration of images, a proper threshold value is obtained through experiments of two hundred pictures. Finally, further iteration is carried out, and all pictures to be marked are screened out. After a picture data set to be marked is obtained, a labelimg is used for carrying out frame processing on specific actions to be identified in the image, and marking is carried out on actions of unsafe behaviors, wherein the marking name accords with data in a shipman unsafe behavior database.

Finally, the basic information of the marked unsafe behavior database picture is stored in a picture data table, and the information in the picture data table comprises the picture place, the picture warehousing time and unsafe behaviors contained in the picture; wherein the noted unsafe behavior is an identification of the database picture.

The data set can be used in a crewman unsafe behavior and state early warning platform, and is particularly applied to a semi-outdoor camera, and according to the crewman unsafe behavior and state detection early warning platform, in a specification of application of a river mail wheel, five cameras in total can use the data set as a training set to conduct behavior recognition. Specific:

1 deck on the middle part of the stern of the upper deck and 1 deck on the left and right side ceilings respectively, and 1 deck on the left and right side ceilings outside the driving cab door respectively.

The application is as follows: a camera is arranged on a ceiling at the midship of the ship of the stern winch of the upper deck to collect behaviors of operators at the stern winch and a mooring line;

the data set is used as the basis of unsafe behavior detection of deck cable operation, monitoring is carried out on unsafe behavior and state of a crew, special software is adopted for analysis and early warning, and comprehensive, timely and effective big data support is provided for ship safety management. And (5) improving the safety navigation management level of the ship. And then the system outputs network signals to the 4G network switch configured by the ship, so that information sharing between the ship and the shore (a shipborne company, a school laboratory) is realized.

The embodiment of the application also discloses a computer readable storage medium, wherein a computer instruction set is stored in the computer readable storage medium, and when the computer instruction set is executed by a processor, the construction method of the ship deck cable database provided by any embodiment is realized.

In the several embodiments provided in the present application, it should be understood that the disclosed technology content may be implemented in other manners. The above-described embodiments of the apparatus are merely exemplary, and the division of the units, for example, may be a logic function division, and may be implemented in another manner, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be through some interfaces, units or modules, or may be in electrical or other forms.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in the embodiments of the present invention may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.

The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied essentially or in part or all of the technical solution or in part in the form of a software product stored in a storage medium, including instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a removable hard disk, a magnetic disk, or an optical disk, or other various media capable of storing program codes.

Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present invention, and not for limiting the same; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the invention.

Claims

1. The construction method of the ship deck cable database is characterized by comprising the following steps of:

acquiring video data of unsafe behavior, comprising:

converting the third information into actual operation through actual operation of wheel boarding, and recording in a video mode;

preprocessing the acquired video data;

screening the preprocessed data, including:

setting a threshold value by repeating the above operation, continuing repeating the above steps from the n+n frame, retaining the image after reaching the threshold value, and continuing repeating the operation to obtain all the screened images

Labeling the screened images by labelimg;

2. The method of constructing a ship deck line database according to claim 1, wherein the preprocessing of the acquired video data comprises:

3. The method for constructing a ship deck cable database according to claim 1, wherein the basic information of the marked unsafe behavior database image is stored in a picture data table to form the ship deck cable database, and the picture data table comprises picture location information, picture warehouse-in time information and unsafe behavior information contained in a picture.

4. A computer-readable storage medium having a set of computer instructions stored therein; a method of constructing a ship deck cable database according to any one of claims 1 to 3 when the set of computer instructions is executed by a processor.