CN116187651A - Method and device for generating supervision report of cargo state on arrival ship - Google Patents
Method and device for generating supervision report of cargo state on arrival ship Download PDFInfo
- Publication number
- CN116187651A CN116187651A CN202211607721.XA CN202211607721A CN116187651A CN 116187651 A CN116187651 A CN 116187651A CN 202211607721 A CN202211607721 A CN 202211607721A CN 116187651 A CN116187651 A CN 116187651A
- Authority
- CN
- China
- Prior art keywords
- camera
- ship
- generating
- cargo state
- audio
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
- G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0631—Resource planning, allocation, distributing or scheduling for enterprises or organisations
- G06Q10/06311—Scheduling, planning or task assignment for a person or group
- G06Q10/063114—Status monitoring or status determination for a person or group
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/08—Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
- G06Q10/083—Shipping
- G06Q10/0833—Tracking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/08—Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
- G06Q10/087—Inventory or stock management, e.g. order filling, procurement or balancing against orders
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
- G06V20/41—Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
Abstract
The invention discloses a method and a device for generating a supervision report of the cargo state on a ship in a port, wherein the method comprises the following steps: reading user account information, and acquiring a camera and a microphone matched with the user account information based on the user account information; acquiring audio and video data obtained by acquiring video data and audio data by a camera and a microphone aiming at the cargo state and the loading and unloading process on a ship, and performing anomaly detection and image interception on the audio and video data; and inputting the abnormal condition information obtained through abnormal detection and the picture information obtained through image interception into a preset supervision report generation template, and automatically generating a supervision report. The invention collects the audio and video data of the cargo state and the loading and unloading process on the ship based on the camera and the microphone, then carries out anomaly detection and image interception, and generates the supervision report, thereby carrying out real-time monitoring on the cargo state of the ship to the port.
Description
Technical Field
The invention relates to the technical field of remote monitoring, in particular to a method and a device for generating a supervision report of the cargo state on a ship in a port.
Background
One of the important tasks in the marine transportation mode is the supervision and unloading of the cargo, the supervision and unloading (collectively referred to as "supervision" in actual work) refers to a test and identification activity that is performed by a subject to supervise and faithfully reflect the cargo state, the loading and unloading mode and the influencing factors thereof during the loading and unloading of the cargo, and has no fixed procedure or mode, generally has low technical requirements according to the needs of users, but has higher timeliness and quantitative and qualitative requirements on the generated problems. Traditionally, supervision is generally performed by a pallet owner engaging a professional supervision worker to a cargo handling site, and the whole process comprises: accepting report, organizing, checking before loading and unloading, supervising loading and unloading, sampling detection, marking box sealing, photographing and evidence obtaining, summarizing and sorting, preparing and issuing a supervision certificate, and the like. However, the traditional supervision flow becomes more difficult to implement under epidemic conditions.
After the international cargo ship arrives at the port, personnel on the ship are difficult to go off the ship to check the cargo or monitor other works, and temporary personnel under the ship cannot easily go on the ship to monitor and other activities, so that the state information of the cargo cannot be controlled by a cargo owner in real time. Moreover, the traditional supervision flow has high labor cost and time cost, long-time high-strength work can lead the supervision personnel to be tired, the work efficiency to be reduced, and the supervision is easy to be out of place. In addition, the prior art also lacks real-time analysis and summary of the information of the supervision, so that the supervision effect is not in place.
Accordingly, there is a need for improvement and advancement in the art.
Disclosure of Invention
The invention aims to solve the technical problems that the method and the device for generating the supervision report of the cargo state on the arrival ship are provided for overcoming the defects of the prior art, and aim to solve the problems that the cargo state information cannot be controlled in real time by a cargo owner, the efficiency is low, the supervision is easy to be in place due to the lack of real-time analysis and summarization of the supervision information in the prior art by adopting a mode of manually monitoring the cargo state.
In a first aspect, the present invention provides a method for generating a supervision report of cargo state on a ship to a port, wherein the method includes:
reading user account information, and acquiring a camera and a microphone matched with the user account information based on the user account information;
acquiring audio and video data obtained by acquiring video data and audio data of the cameras and the microphones aiming at the cargo state and the loading and unloading processes on the ship, and performing anomaly detection and image interception on the audio and video data;
and inputting abnormal condition information obtained through abnormal detection and picture information obtained through image interception into a preset supervision report generation template, and automatically generating the supervision report.
In one implementation manner, the acquiring, based on the user account information, a camera and a microphone matched with the user account information includes:
determining a user ID based on the user account information;
and matching the corresponding audio and video acquisition card module based on the user ID, and determining the corresponding camera and microphone based on the serial number information of the audio and video acquisition card module.
In one implementation manner, the detecting the abnormality of the audio and video data and the intercepting the image include:
carrying out image recognition on the audio and video data, and recognizing abnormal condition information in the image, wherein the abnormal condition information comprises abnormal cargo state on a ship and abnormal conditions in the loading and unloading process;
screening the identified images, and intercepting the images comprising the abnormal condition information in the images to obtain the picture information.
In one implementation, the method further comprises:
the method comprises the steps of obtaining a visual angle adjustment instruction, sending the visual angle adjustment instruction to a camera corresponding to the visual angle adjustment instruction based on a cloud server, and controlling the camera to execute the visual angle adjustment instruction so as to change the shooting visual angle of the camera.
In one implementation, the method further comprises:
and acquiring a high-altitude installation instruction, and sending the high-altitude installation instruction to preset unmanned aerial vehicle equipment based on the cloud server, and controlling the unmanned aerial vehicle equipment to assist in completing high-altitude installation of the camera.
In one implementation, the controlling the unmanned aerial vehicle device to assist in completing the aerial installation of the camera includes:
controlling the unmanned aerial vehicle equipment to fly to a specified height, and after the unmanned aerial vehicle equipment reaches the specified height, controlling telescopic devices arranged on the left side and the right side below the unmanned aerial vehicle equipment to extend forwards, wherein a camera fixing device is arranged on the telescopic devices, and a camera to be installed is arranged on the camera fixing device;
and fixing the camera to be installed to a fixed point of the designated height based on the magnet module on the camera to be installed.
In one implementation, the method further comprises:
when the camera needs to be taken down from the designated height, carrying out electrifying and demagnetizing treatment on the magnet module so as to separate the camera from a fixed point of the designated height;
and controlling the telescopic device to extend forwards, and retracting after taking the camera to finish high-altitude unloading.
In a second aspect, an embodiment of the present invention further provides a device for generating a supervision report of a cargo state on a ship in a port, where the device includes:
the information matching module is used for reading user account information and acquiring a camera and a microphone matched with the user account information based on the user account information;
the data analysis module is used for acquiring audio and video data obtained by acquiring video data and audio data of the cameras and the microphones aiming at the cargo state and the loading and unloading process on the ship, and carrying out anomaly detection and image interception on the audio and video data;
the report generation module is used for inputting the abnormal condition information obtained through abnormal detection and the picture information obtained through image interception into a preset supervision report generation template and automatically generating the supervision report.
In a third aspect, an embodiment of the present invention further provides a terminal device, where the terminal device includes a memory, a processor, and a method program for generating a loading report of a cargo state on a arrival ship stored in the memory and capable of running on the processor, and when the processor executes the method program for generating a loading report of a cargo state on a arrival ship, the method for generating a loading report of a cargo state on a arrival ship according to any one of the above schemes is implemented.
In a fourth aspect, an embodiment of the present invention further provides a computer readable storage medium, where the computer readable storage medium stores a program for generating a monitoring report of a cargo state on a arrival ship, and when the program for generating a monitoring report of a cargo state on a arrival ship is executed by a processor, the steps of the method for generating a monitoring report of a cargo state on a arrival ship according to any one of the above schemes are implemented.
The beneficial effects are that: compared with the prior art, the invention provides a method for generating a supervision report of cargo state on a ship in a port. And then, acquiring audio and video data obtained by acquiring video data and audio data by the camera and the microphone aiming at the cargo state and the loading and unloading process on the ship, and performing anomaly detection and image interception on the audio and video data. And finally, inputting the abnormal condition information obtained through abnormal detection and the picture information obtained through image interception into a preset supervision report generation template, and automatically generating the supervision report. The invention collects the audio and video data of the cargo state and the loading and unloading process on the ship based on the cameras and the microphones, then performs anomaly detection and image interception, and generates a monitoring report, thereby achieving better monitoring effect on the cargo state of the ship in the harbor. The method for generating the supervision report is simple, so that the supervision state can be analyzed and summarized, and the supervision efficiency is greatly improved.
Drawings
Fig. 1 is a flowchart of a specific implementation of a method for generating a monitoring report of a cargo state on a ship to port according to an embodiment of the present invention.
Fig. 2 is an overall frame diagram of a system for generating a monitoring report of cargo state on a ship in port according to an embodiment of the present invention.
Fig. 3 is a flowchart of the present invention when monitoring cargo state on a ship in port.
Fig. 4 is a schematic diagram of a device for generating a monitoring report of cargo state on a ship in port according to an embodiment of the present invention.
Fig. 5 is a schematic block diagram of a terminal device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and effects of the present invention clearer and more specific, the present invention will be described in further detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
The embodiment provides a method for generating a supervision report of cargo state on a ship to a harbor, and the method comprises the steps of firstly reading user account information, and acquiring a camera and a microphone matched with the user account information based on the user account information. And then, acquiring audio and video data obtained by acquiring video data and audio data by the camera and the microphone aiming at the cargo state and the loading and unloading processes on the ship, and carrying out anomaly detection and image interception on the audio and video data. Finally, the abnormal condition information obtained through abnormal detection and the picture information obtained through image interception are input into a preset supervision report generation template, and the supervision report is automatically generated (monitoring on the cargo state and the loading and unloading process is collectively called as supervision in the industry, so that the supervision report is obtained without subdivision of supervision and supervision). According to the embodiment, based on the fact that the cameras and the microphones collect the audio and video data of the cargo state and the loading and unloading process on the ship, anomaly detection and image interception are carried out, and a supervision report is generated, so that the cargo state of the ship in the harbor is monitored in real time, and a better monitoring effect is achieved. The method for generating the supervision report is simple, so that the supervision state can be analyzed and summarized, and the supervision efficiency is greatly improved.
Exemplary method
The method for generating the supervision report of the cargo state on the arrival ship in the embodiment can be applied to terminal equipment, and the terminal equipment can be an intelligent product terminal such as a mobile phone, a computer and the like. Specifically, as shown in fig. 1, the method for generating a supervision report of cargo state on a arrival ship according to the present embodiment includes the following steps:
step S100, reading user account information, and acquiring a camera and a microphone matched with the user account information based on the user account information.
Specifically, the present embodiment provides a system for generating a supervision report of cargo state on a ship to port, the system having a frame structure as shown in fig. 2, comprising: terminal equipment (namely a user end), an audio and video acquisition card module, a main processor, a network module, a cloud server, a magnet module, a waterproof cover module, a storage module, a Bluetooth module and an unmanned aerial vehicle high-altitude loading and unloading module. The terminal device and the cloud server of the embodiment can be provided with a plurality of, the audio/video acquisition card module comprises a camera and a microphone, and the camera and the microphone are respectively used for acquiring video data and audio data on the port ship. The main processor is connected with the audio and video acquisition card module, and is used as a core processor for processing data related to the audio and video acquisition card module, the storage module, the network module, the microphone module and the camera module in the system, processing the data into usable data of other modules of the terminal and transmitting the usable data to the other modules. Meanwhile, data exchange and instruction transmission are carried out between the processor module and the cloud server. In addition, in this embodiment, audio data and video data acquired from the camera and the microphone are sent to the main processor module through the audio/video acquisition card module, the main processor converts the audio data and the video data into a unified data format identifiable by other modules in the terminal and the cloud server, so as to obtain audio/video data, and then the audio/video data in the unified format is sent to the storage module (including the local storage and the cloud server).
The network module of the embodiment is connected with the main processor, the cloud server is also connected with the network module, and the cloud server is connected with a plurality of user terminals. The network module in this embodiment mainly transmits audio and video data, including transmitting to the main processor and the cloud server. The network module comprises a 5G network card module and a WiFi module. The WiFi module transmits data and instructions before the device, the cloud server and the user terminal under the condition of all available local area networks of the use field where the device is located; the 5G network card module can be inserted into a 5G card through a 5G card interface arranged in the device to provide 5G network communication possibility for the device, and can be used under the condition that the device is free of Wi-Fi connection, so that data and instruction transmission among the device, the cloud server and the user side is realized. The 5G technology has the characteristics of high speed, low delay and the like, and can provide better user experience.
Further, the system in this embodiment further includes a bluetooth module, where the bluetooth module is connected to the main processor, and the bluetooth module is configured to perform bluetooth connection with the terminal device. When the network (comprising a WiFi module and a 5G network card module) cannot be connected or the network quality is lower than a certain level and cannot transmit data and instructions, the Bluetooth function is automatically opened and can be connected with a nearby user terminal, when a user needs to adjust the angle or focal length of a camera, the user terminal sends an instruction for rotating the camera or adjusting the focal length of the camera to a cloud server, the cloud server analyzes the instruction of the user terminal and then sends the instruction to a processor module, and the processor module sends instruction data to the camera module to operate, so that the instruction of the user is realized.
In one implementation, the system of the present embodiment supports both local storage and cloud storage modes. The cloud server completes the corresponding cloud storage function, the local storage function is realized through a storage module in the device, and the storage module is connected with the main processor. The storage module is provided with an SD card slot, and after the SD card slot is inserted into the SD card, audio and video data are stored on the SD card in the live broadcast monitor process. When viewing the video content stored locally in the storage module, the memory card needs to be taken out from the device, inserted into the card reader and then inserted into the computer for viewing.
In order to ensure the video capturing effect at night and in the case of non-ideal weather, the camera of this embodiment adopts a zoom camera with an infrared high-definition function. In order to better obtain the shooting effect in the outdoor rainwater environment, a camera window adopts invisible windshield wiper; compared with the common window glass, the invisible windshield wiper window glass has the functions of repelling water, dust and the like. In addition, the microphone of the embodiment also has a noise reduction function. Because the cloud server is connected with a plurality of user terminals, the user terminals can send visual angle conversion instructions to the cloud server. After receiving the visual angle conversion instruction, the cloud server analyzes the visual angle conversion instruction, and then carries out conversion of shooting visual angles on the camera, so that any corner on the ship is monitored.
In addition, the system of the embodiment also comprises a power supply module, wherein the power supply module adopts a mobile power supply mode to provide power for the normal operation and software operation of each module of the terminal. The mobile power supply in the embodiment has larger battery capacity, can ensure that the system can work outdoors for a long time under the condition of not externally connecting the power supply, and uses the latest quick charging technology, so that full power can be supplemented in a shorter time. The one end inside this portable power source body is equipped with the mounting groove, and the mounting groove can be in a lump with the terminal connection, forms a whole better, conveniently carries. After the mobile power supply in the embodiment is connected with the camera, the whole waterproof performance is realized after the sealing performance is ensured.
In one implementation, the magnet module of the present embodiment is disposed at the bottom of the camera, and the magnet module is configured as a ring magnet. The ring magnet belongs to a neodymium-iron-boron magnet, compared with magnets made of aluminum-nickel-cobalt and ferrite materials, the neodymium-iron-boron magnet has stronger performance, the magnetic strength is higher than that of the former two magnets, the manufacturing cost is relatively low, the camera and the metal on the ship can be tightly adsorbed by the high-strength magnets, and the position of the camera can not be changed due to shaking of the ship body or careless touching of personnel. In addition, the outdoor solar energy heat collector can be suitable for various environments such as outdoor heavy wind, heavy rain, severe summer heat, severe cold and the like. The annular design can reduce the weight on the premise of not influencing the magnetic force, so that the invention can be more convenient to carry. The waterproof cover module of the embodiment is used for covering the camera. The waterproof cover can effectively prevent the erosion of rainwater to the camera, reduce the interference of the rainwater to the camera lens and ensure the definition and accuracy of shooting content. The mirror surface adopts invisible windshield wiper window glass, can drain rainwater and dust, and keeps the mirror surface clean.
When the terminal equipment wants to acquire audio and video data obtained by acquiring video data and audio data by the camera and the microphone aiming at the cargo state and the loading and unloading process on the ship, the terminal equipment of the embodiment firstly reads user account information. Specifically, a piece of software is preset on the terminal device, and the software is used for managing audio and video data collected by the camera and the microphone. The user can log in the account on the software first, when logging in, the user uses the unique account number and the password to log in the software, the terminal equipment can acquire the user account information after successful login, and then the user ID is determined based on the user account information. The user ID is used for identifying the identity of the user, and then the corresponding audio and video acquisition card module is matched based on the user ID. Because when monitoring cargo state and loading and unloading goods process on the boats and ships, can use a plurality of cameras and a plurality of microphone, consequently this embodiment is after confirming audio and video acquisition card module, can acquire the serial number information of audio and video acquisition card module, then according to this serial number information, confirms corresponding camera and microphone.
Step 200, acquiring audio and video data obtained by acquiring video data and audio data by the camera and the microphone according to the cargo state and the loading and unloading processes on the ship, and performing anomaly detection and image interception on the audio and video data.
After determining the camera and the microphone, the embodiment can acquire the video data acquired by the camera and the audio data acquired by the microphone to obtain the audio-video data. In a specific application, the embodiment may acquire the audio/video data from the storage module. Then, the embodiment can perform operations such as anomaly detection and image interception on the audio/video data so as to generate a supervision report in a subsequent step.
Specifically, the embodiment performs image recognition on the audio and video data, and recognizes abnormal condition information in the image, where the abnormal condition information includes abnormal cargo states on the ship and abnormal conditions occurring during loading and unloading, such as a cargo stacking position error or conditions that the cargo falls from a high place during loading and unloading. And then, the terminal equipment screens the identified images, and intercepts images comprising the abnormal condition information from the images to obtain the picture information.
In one implementation manner, when the shooting view angle of the camera needs to be adjusted, the terminal device of the embodiment may further obtain a view angle adjustment instruction, send the view angle adjustment instruction to the camera corresponding to the view angle adjustment instruction based on the cloud server, and control the camera to execute the view angle adjustment instruction, so as to transform the shooting view angle of the camera, thereby obtaining different shooting view angles and different video information.
And step S300, inputting abnormal condition information obtained through abnormal detection and picture information obtained through image interception into a preset supervision report generation template, and automatically generating the supervision report.
When abnormal condition information is detected, the abnormal condition information and picture information obtained through image interception are input into a preset supervision report generation template, and the picture information is obtained through intercepting an image containing the abnormal condition information, so that after the abnormal condition information and the picture information are input into the preset supervision report generation template, a supervision report containing the abnormal condition information and the picture information is automatically generated, and the supervision report is stored for the next use.
In one implementation, the monitoring report of the present embodiment may be displayed on software of the terminal device, where a user may view, edit, and evaluate the monitoring report, such as changing an IP address of a control camera, etc. Because the monitoring report is a detection result which can reflect the abnormal detection of the audio and video data collected by the camera and the microphone, a user can determine whether the cargo state or the cargo loading and unloading process on the ship is abnormal or not based on the monitoring report, and the abnormality can be further processed in time.
In one implementation manner, the terminal device of the embodiment may further obtain a high-altitude installation instruction, and send the high-altitude installation instruction to a preset unmanned aerial vehicle high-altitude loading and unloading module based on the cloud server, and then the unmanned aerial vehicle high-altitude loading and unloading module includes unmanned aerial vehicle equipment. Then, the embodiment can control the unmanned aerial vehicle equipment to assist in completing the high-altitude installation of the camera. Specifically, the telescoping device that both sides set up about unmanned aerial vehicle equipment below of this embodiment is provided with camera fixing device on the telescoping device, be provided with the camera of waiting to install on the camera fixing device. When needing to install the camera of waiting to install to appointed high, this embodiment can control based on high altitude installation instruction unmanned aerial vehicle equipment flies to rise to appointed high to after unmanned aerial vehicle equipment reaches appointed high, control telescoping device that both sides set up about unmanned aerial vehicle equipment below stretches out forward, owing to be provided with magnet module on the camera of waiting to install, consequently can be based on magnet module will the camera of waiting to install is fixed to the fixed point of appointed high. After the camera is sucked to the fixed point, the telescopic device is retracted backwards, the high-place installation process is completed, and the high-place installation can provide wider visual field for the camera. When the camera needs to be taken down from the designated height, the magnet module is electrified and demagnetized so that the camera is separated from the fixed point of the designated height, and then the telescopic device is controlled to extend forwards, and the camera is retracted after being taken down, so that the high-altitude unloading is completed.
Therefore, the embodiment can automatically intercept useful materials according to the supervision process and automatically export the supervision report, thereby greatly improving the efficiency and effect of the supervision report generation. In addition, the device can be installed on the surface of a higher steel object by being assembled and disassembled in cooperation with the unmanned aerial vehicle, so that the on-line real-time monitoring of the monitoring process can be realized from a high place at any angle.
Exemplary apparatus
Based on the embodiment, the invention also provides a device for generating a supervision report of the cargo state on the arrival ship, as shown in fig. 4, the device comprises: information matching module 10, data analysis module 20, and report generation module 30. Specifically, the information matching module 10 is configured to read user account information, and obtain a camera and a microphone matched with the user account information based on the user account information. The data analysis module 20 is configured to obtain audio and video data obtained by collecting video data and audio data of the cameras and the microphones for cargo states and loading and unloading processes on the ship, and perform anomaly detection and image capturing on the audio and video data. The report generating module 30 is configured to input abnormal condition information obtained through abnormal detection and picture information obtained through image capturing into a preset supervision report generating template, and automatically generate the supervision report.
In one implementation, the information matching module 10 includes:
a user ID obtaining unit, configured to determine a user ID based on the user account information;
and the equipment matching unit is used for matching out the corresponding audio and video acquisition card module based on the user ID and determining the corresponding camera and microphone based on the serial number information of the audio and video acquisition card module.
In one implementation, the data analysis module 20 includes:
the image recognition unit is used for carrying out image recognition on the audio and video data and recognizing abnormal condition information in the image, wherein the abnormal condition information comprises abnormal cargo state on a ship and abnormal conditions in the loading and unloading process;
and the image intercepting unit is used for screening the identified images and intercepting the images comprising the abnormal condition information in the images to obtain the picture information.
In one implementation, the apparatus further comprises:
the visual angle adjusting module is used for acquiring visual angle adjusting instructions, sending the visual angle adjusting instructions to cameras corresponding to the visual angle adjusting instructions based on the cloud server, and controlling the cameras to execute the visual angle adjusting instructions so as to change shooting visual angles of the cameras.
The high-altitude installation module is used for acquiring a high-altitude installation instruction, and sending the high-altitude installation instruction to preset unmanned aerial vehicle equipment based on the cloud server, and controlling the unmanned aerial vehicle equipment to assist in completing high-altitude installation of the camera.
In one implementation, the high altitude installation module includes:
the unmanned aerial vehicle control unit is used for controlling the unmanned aerial vehicle equipment to fly to a specified height, and controlling telescopic devices arranged on the left side and the right side below the unmanned aerial vehicle equipment to extend forwards after the unmanned aerial vehicle equipment reaches the specified height, wherein a camera fixing device is arranged on the telescopic devices, and a camera to be installed is arranged on the camera fixing device;
and the installation fixing unit is used for fixing the camera to be installed to the fixed point of the designated height based on the magnet module on the camera to be installed.
In one implementation, the apparatus further comprises:
the demagnetizing processing module is used for carrying out electrifying demagnetizing processing on the magnet module when the camera needs to be taken down from the designated height so as to separate the camera from a fixed point of the designated height;
and the high-altitude unloading module is used for controlling the telescopic device to extend forwards and retract after the telescopic device is taken out of the camera so as to finish high-altitude unloading.
The principle of each functional module of the monitoring report generating device for cargo state on the arrival ship in this embodiment is the same as the execution process of each step in the above method embodiment, and will not be repeated here.
Based on the above embodiment, the present invention also provides a terminal device, and a schematic block diagram of the terminal device may be shown as 5. The terminal device may implement the method of generating a monitoring report of the cargo state on the arrival vessel in the above embodiment, and the terminal device may include one or more processors 100 (only one is shown in fig. 5), a memory 101, and a computer program 102 stored in the memory 101 and executable on the one or more processors 100, for example, a program of the method of generating a monitoring report of the cargo state on the arrival vessel. The one or more processors 100, when executing the computer program 102, may implement the various steps in method embodiments of a method of monitoring report generation of cargo state on a port vessel. Alternatively, the one or more processors 100, when executing the computer program 102, may implement the functions of the modules/units in the apparatus embodiment of the method for generating a monitoring report of the cargo state on a port vessel, which is not limited herein.
In one embodiment, the processor 100 may be a central processing unit (Central Processing Unit, CPU), but may also be other general purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), off-the-shelf programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
In one embodiment, the memory 101 may be an internal storage unit of the electronic device, such as a hard disk or a memory of the electronic device. The memory 101 may also be an external storage device of the electronic device, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) card, a flash card (flash card) or the like, which are provided on the electronic device. Further, the memory 101 may also include both an internal storage unit and an external storage device of the electronic device. The memory 101 is used to store computer programs and other programs and data required by the terminal device. The memory 101 may also be used to temporarily store data that has been output or is to be output.
It will be appreciated by persons skilled in the art that the functional block diagram shown in fig. 5 is merely a block diagram of some of the structures associated with the present inventive arrangements and is not limiting of the terminal device to which the present inventive arrangements are applied, and that a particular terminal device may include more or fewer components than shown, or may combine some of the components, or may have a different arrangement of components.
Those skilled in the art will appreciate that implementing all or part of the above-described methods in accordance with the embodiments may be accomplished by way of a computer program stored on a non-transitory computer readable storage medium, which when executed may comprise the steps of the embodiments of the methods described above. Any reference to memory, storage, operational database, or other medium used in embodiments provided herein may include non-volatile and/or volatile memory. The nonvolatile memory can include Read Only Memory (ROM), programmable ROM (PROM), electrically Programmable ROM (EPROM), electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual operation data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous Link DRAM (SLDRAM), memory bus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), among others.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present invention, and are not limiting; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. A method for generating a monitoring report of a cargo state on a ship to a port, the method comprising:
reading user account information, and acquiring a camera and a microphone matched with the user account information based on the user account information;
acquiring audio and video data obtained by acquiring video data and audio data of the cameras and the microphones aiming at the cargo state and the loading and unloading process on the ship, and performing anomaly detection and image interception on the audio and video data;
and inputting abnormal condition information obtained through abnormal detection and picture information obtained through image interception into a preset supervision report generation template, and automatically generating the supervision report.
2. The method for generating a monitoring report of cargo state on a port-arriving ship according to claim 1, wherein the step of acquiring a camera and a microphone matched with the user account information based on the user account information comprises the steps of:
determining a user ID based on the user account information;
and matching the corresponding audio and video acquisition card module based on the user ID, and determining the corresponding camera and microphone based on the serial number information of the audio and video acquisition card module.
3. The method for generating a supervision report of cargo state on a port-arriving ship according to claim 1, wherein the performing anomaly detection and image interception on the audio-video data comprises:
carrying out image recognition on the audio and video data, and recognizing abnormal condition information in the image, wherein the abnormal condition information comprises abnormal cargo state on a ship and abnormal conditions in the loading and unloading process;
screening the identified images, and intercepting the images comprising the abnormal condition information in the images to obtain the picture information.
4. The method of generating a monitoring report of cargo state on a port-arriving ship of claim 1, further comprising:
the method comprises the steps of obtaining a visual angle adjustment instruction, sending the visual angle adjustment instruction to a camera corresponding to the visual angle adjustment instruction based on a cloud server, and controlling the camera to execute the visual angle adjustment instruction so as to change the shooting visual angle of the camera.
5. The method of generating a monitoring report of cargo state on a port-arriving ship of claim 4, further comprising:
and acquiring a high-altitude installation instruction, and sending the high-altitude installation instruction to preset unmanned aerial vehicle equipment based on the cloud server, and controlling the unmanned aerial vehicle equipment to assist in completing high-altitude installation of the camera.
6. The method for generating a monitoring report of cargo state on a port-arriving ship according to claim 5, wherein the controlling the unmanned aerial vehicle device to assist in completing the high-altitude installation of the camera comprises:
controlling the unmanned aerial vehicle equipment to fly to a specified height, and after the unmanned aerial vehicle equipment reaches the specified height, controlling telescopic devices arranged on the left side and the right side below the unmanned aerial vehicle equipment to extend forwards, wherein a camera fixing device is arranged on the telescopic devices, and a camera to be installed is arranged on the camera fixing device;
and fixing the camera to be installed to a fixed point of the designated height based on the magnet module on the camera to be installed.
7. The method of generating a monitoring report of cargo state on a port-arriving ship of claim 6, further comprising:
when the camera needs to be taken down from the designated height, carrying out electrifying and demagnetizing treatment on the magnet module so as to separate the camera from a fixed point of the designated height;
and controlling the telescopic device to extend forwards, and retracting after taking the camera to finish high-altitude unloading.
8. A device for generating a monitoring report of the cargo state of a ship in a port, the device comprising:
the information matching module is used for reading user account information and acquiring a camera and a microphone matched with the user account information based on the user account information;
the data analysis module is used for acquiring audio and video data obtained by acquiring video data and audio data of the cameras and the microphones aiming at the cargo state and the loading and unloading process on the ship, and carrying out anomaly detection and image interception on the audio and video data;
the report generation module is used for inputting the abnormal condition information obtained through abnormal detection and the picture information obtained through image interception into a preset supervision report generation template and automatically generating the supervision report.
9. A terminal device, characterized in that the terminal device comprises a memory, a processor and a method program for generating a monitoring report of the cargo state on a arrival ship stored in the memory and being operable on the processor, the steps of the method for generating a monitoring report of the cargo state on a arrival ship according to any one of claims 1-7 being implemented when the processor executes the method program for generating a monitoring report of the cargo state on a arrival ship.
10. A computer-readable storage medium, wherein a program for generating a monitoring report of a cargo state on a arrival ship is stored on the computer-readable storage medium, and when the program for generating a monitoring report of a cargo state on a arrival ship is executed by a processor, the steps of the method for generating a monitoring report of a cargo state on a arrival ship according to any one of claims 1 to 7 are implemented.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211607721.XA CN116187651A (en) | 2022-12-14 | 2022-12-14 | Method and device for generating supervision report of cargo state on arrival ship |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211607721.XA CN116187651A (en) | 2022-12-14 | 2022-12-14 | Method and device for generating supervision report of cargo state on arrival ship |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116187651A true CN116187651A (en) | 2023-05-30 |
Family
ID=86435425
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211607721.XA Pending CN116187651A (en) | 2022-12-14 | 2022-12-14 | Method and device for generating supervision report of cargo state on arrival ship |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116187651A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116502982A (en) * | 2023-06-26 | 2023-07-28 | 深圳市汉德网络科技有限公司 | Canned ship cargo flow direction control method and system |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH06338957A (en) * | 1993-05-28 | 1994-12-06 | Sharp Corp | Home automation device |
| KR20120119557A (en) * | 2011-04-22 | 2012-10-31 | 대양전기공업 주식회사 | Ship condition monitoring service system |
| CN105578126A (en) * | 2014-11-11 | 2016-05-11 | 杜向阳 | Monitoring camera automatic alarm system |
| KR101729973B1 (en) * | 2016-09-10 | 2017-04-26 | 엠엘씨월드카고 주식회사 | System for managing ocean air freights |
| KR20210147799A (en) * | 2020-05-31 | 2021-12-07 | 이진규 | Electric robotic arm and gripper system mounted on an unmanned underwater drone |
| CN115379174A (en) * | 2022-08-29 | 2022-11-22 | 深圳技术大学 | Live broadcast monitoring device and monitoring method for cargo loading state of ship arriving at port |
-
2022
- 2022-12-14 CN CN202211607721.XA patent/CN116187651A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH06338957A (en) * | 1993-05-28 | 1994-12-06 | Sharp Corp | Home automation device |
| KR20120119557A (en) * | 2011-04-22 | 2012-10-31 | 대양전기공업 주식회사 | Ship condition monitoring service system |
| CN105578126A (en) * | 2014-11-11 | 2016-05-11 | 杜向阳 | Monitoring camera automatic alarm system |
| KR101729973B1 (en) * | 2016-09-10 | 2017-04-26 | 엠엘씨월드카고 주식회사 | System for managing ocean air freights |
| KR20210147799A (en) * | 2020-05-31 | 2021-12-07 | 이진규 | Electric robotic arm and gripper system mounted on an unmanned underwater drone |
| CN115379174A (en) * | 2022-08-29 | 2022-11-22 | 深圳技术大学 | Live broadcast monitoring device and monitoring method for cargo loading state of ship arriving at port |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116502982A (en) * | 2023-06-26 | 2023-07-28 | 深圳市汉德网络科技有限公司 | Canned ship cargo flow direction control method and system |
| CN116502982B (en) * | 2023-06-26 | 2023-09-08 | 深圳市汉德网络科技有限公司 | Canned ship cargo flow direction control method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2017024975A1 (en) | Unmanned aerial vehicle portable ground station processing method and system | |
| CN111985352B (en) | AI front-end substation inspection video real-time identification method and system | |
| CN112449147B (en) | Video cluster monitoring system of photovoltaic power station and image processing method thereof | |
| CN116187651A (en) | Method and device for generating supervision report of cargo state on arrival ship | |
| CN109326125B (en) | Picture quality diagnosis system and method based on embedded system | |
| CN113311861A (en) | Automatic detection method and system for photovoltaic module subfissure characteristics | |
| CN108318781A (en) | A method of the insulator remote monitoring based on infrared image and fault diagnosis | |
| CN116136613A (en) | Automatic inspection method, device, equipment and medium for data center | |
| CN116580362B (en) | Transmission operation cross-system fusion data acquisition method and digital asset processing system | |
| CN112180353A (en) | Target object confirmation method and system and storage medium | |
| CN115379174A (en) | Live broadcast monitoring device and monitoring method for cargo loading state of ship arriving at port | |
| CN116631087A (en) | Unmanned aerial vehicle-based electric power inspection system | |
| CN112422818A (en) | Intelligent screen dropping remote detection method based on multivariate image fusion | |
| Jung et al. | Industrial humanless monitoring system over 5g networks in the shipyard environment | |
| CN112016380A (en) | Wild animal monitoring method and system | |
| CN109698933B (en) | Data transmission method, camera, electronic device, and computer-readable storage medium | |
| CN114581598A (en) | Service integration framework based on three-dimensional live-action and on-site video fusion management | |
| CN114841932A (en) | Foreign matter detection method, system, equipment and medium for photovoltaic panel of photovoltaic power station | |
| WO2021189429A1 (en) | Image photographing method and device, movable platform, and storage medium | |
| CN113810505A (en) | System for cloud synchronization of face recognition camera data and use method thereof | |
| CN111653000A (en) | Unmanned aerial vehicle system of patrolling and examining | |
| CN115346283B (en) | Image acquisition device, method and equipment for cable inspection and storage medium | |
| CN105812742A (en) | Intelligent video visitor system | |
| CN207166669U (en) | VR intelligent monitor systems | |
| CN112180986A (en) | Unmanned aerial vehicle remote control system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |