CN117119152A - A multichannel video intelligent monitoring equipment for ship - Google Patents

Abstract

The invention discloses a multipath video intelligent monitoring device for a ship. The equipment comprises a shell, wherein a substrate is arranged in the shell, a main control processing board and at least one video processing board which are connected in a pluggable manner are arranged on the substrate, a first network interface and a network exchange chip are further arranged on the substrate, the main control processing board, the video processing board and the first network interface are electrically connected with the network exchange chip, video image data are input through the first network interface, and video image processing is performed by the main control processing board and/or the video processing board. The substrate is also provided with a plurality of types of peripheral interfaces and functional chips. The device can meet the intelligent processing requirements of multiple paths of videos at the same time, and has the technical advantages of miniaturization and low cost.

Description

A multichannel video intelligent monitoring equipment for ship

Technical Field

The invention relates to the technical field of ship management, in particular to multichannel video intelligent monitoring equipment for a ship.

Background

Video monitoring is carried out on a ship body and staff, video monitoring is carried out on a barge berthing operation at a wharf, video collected by a plurality of cameras is mainly stored and played back on a hard disk under the prior art condition, and generally, the real-time illegal behaviors cannot be identified and alarmed.

In the prior art, the intelligent identification processing of the video image generally needs to transmit and collect the video image and then transmit the video image to a control center for processing through network cables or wireless communication, and the mode has higher bandwidth requirements on communication transmission, so that wider wireless communication bandwidth and high-speed communication rate are needed, and the communication cost is high.

Therefore, when the intelligent processing device of the video image is close to the local processing of the ship, a high requirement on computational power is required, and the intelligent processing device is usually processed by an industrial personal computer with high computational processing capacity, and the mode also brings about an increase in hardware cost. The problems of larger processing equipment volume, higher power consumption and the like are also caused.

Disclosure of Invention

The invention mainly solves the technical problems of providing the multipath video intelligent monitoring equipment for the navigation ship, solving the technical problems of the prior art that the intelligent monitoring of the navigation ship video is lack of the installation on the nearby ship, and realizing the management technical means of low cost, miniaturization and multipath video synchronous monitoring.

In order to solve the technical problems, the technical scheme adopted by the invention is to provide the multipath video intelligent monitoring equipment for the navigation ship, which comprises a shell, wherein a substrate is arranged in the shell, a main control processing board and at least one video processing board which can be connected in a pluggable manner are arranged on the substrate, a first network interface and a network exchange chip are also arranged on the substrate, the main control processing board, the video processing board and the first network interface are electrically connected with the network exchange chip, video image data is input through the first network interface, and video image processing is carried out by the main control processing board and/or the video processing board.

Preferably, the substrate is provided with a main connector for connecting the main control processing board in a plug-in manner, and a video connector for connecting the video processing board in a plug-in manner.

Preferably, the main control processing board is provided with a main control processing chip, a cache chip and a storage chip, and a patch cord correspondingly connected with a main control connector on the substrate, and the main control processing chip is respectively and electrically connected with the cache chip, the storage chip and the patch cord which are arranged on the main control processing board.

Preferably, the video processing board is provided with a video processing chip, a cache chip, a storage chip and a patch cord correspondingly connected with the video connector on the substrate, and the video processing chip is respectively and electrically connected with the cache chip, the storage chip and the patch cord which are arranged on the video processing board.

Preferably, a mobile communication chip connection socket for connecting the mobile communication chip in a plugging manner is arranged on the substrate, the mobile communication chip connection socket is electrically connected with the main control connector on the substrate, the mobile communication chip is electrically connected with the main control processing chip, and the mobile communication chip is used for carrying out remote wireless communication transmission with the monitoring platform.

Preferably, the substrate is provided with a hard disk data interface for connecting with a hard disk, the hard disk data interface is further electrically connected with a main control connector on the substrate, and further electrically connected with the main control processing chip, and the hard disk is used for storing video image data.

Preferably, the substrate is provided with a single chip microcomputer chip, a photoelectric isolation interface and/or a wired communication interface, the single chip microcomputer chip is electrically connected with the photoelectric isolation interface, and the single chip microcomputer chip and the wired communication interface are also electrically connected with a main control connector on the substrate and further electrically connected with a main control processing chip arranged on the main control processing board.

Preferably, the monitoring platform downloads the running program to the main control processing board and/or the video processing board remotely through the mobile communication chip, and the main control processing board transmits video monitoring data to the monitoring platform through the mobile communication chip.

Preferably, the single chip microcomputer chip monitors the stable operation of the main control processing chip through a first monitoring circuit and a first reset circuit; and the main control processing chip monitors the stable operation of each video processing chip through the second monitoring circuit and the second reset circuit.

Preferably, the photoelectric isolation interface receives a ship running state signal, and the corresponding video processing board starts a relevant video monitoring program to monitor personnel operation conditions related to the current ship running state.

The beneficial effects of the invention are as follows: the invention discloses a multipath video intelligent monitoring device for a ship. The equipment comprises a shell, wherein a substrate is arranged in the shell, a main control processing board and at least one video processing board which are connected in a pluggable manner are arranged on the substrate, a first network interface and a network exchange chip are further arranged on the substrate, the main control processing board, the video processing board and the first network interface are electrically connected with the network exchange chip, video image data are input through the first network interface, and video image processing is performed by the main control processing board and/or the video processing board. The substrate is also provided with a plurality of types of peripheral interfaces and functional chips. The device can meet the intelligent processing requirements of multiple paths of videos at the same time, and has the technical advantages of miniaturization and low cost.

Drawings

FIG. 1 is a schematic view of an application scenario of one embodiment of a multi-channel video intelligent monitoring device for a watercraft according to the present invention;

FIG. 2 is a schematic diagram of a remote access application scenario for another embodiment of a multi-channel video intelligent monitoring device for a watercraft according to the present invention;

FIG. 3 is a schematic diagram of the structure of a chassis of another embodiment of a multi-channel video intelligent monitoring device for a boat according to the present invention;

FIG. 4 is a schematic view of the front composition of a substrate in another embodiment of a multi-channel video intelligent monitoring apparatus for a boat according to the present invention;

FIG. 5 is a schematic view of the back side composition of a substrate in another embodiment of a multi-channel video intelligent monitoring apparatus for a boat according to the present invention;

FIG. 6 is a schematic diagram of the main control processing board in another embodiment of the multi-channel video intelligent monitoring device for a boat according to the present invention;

FIG. 7 is a schematic diagram of the front composition of a video processing board in another embodiment of a multi-channel video intelligent monitoring device for a watercraft according to the invention;

FIG. 8 is a schematic view of the back side composition of a video processing board in another embodiment of a multi-channel video intelligent monitoring device for a watercraft according to the invention;

FIG. 9 is a schematic diagram of electrical connections in another embodiment of a multi-channel video intelligent monitoring device for a watercraft according to the invention;

FIG. 10 is a schematic diagram of electrical connections associated with system stability monitoring management in another embodiment of a multi-channel video intelligent monitoring device for a watercraft according to the present invention;

FIG. 11 is a system stability monitoring management workflow in another embodiment of a multi-channel video intelligent monitoring device for a watercraft in accordance with the present invention;

FIG. 12 is a schematic diagram of electrical connections associated with remote monitoring and program download in another embodiment of a multi-channel video intelligent monitoring device for a boat according to the present invention;

FIG. 13 is a remote monitoring workflow in another embodiment of a multi-channel video intelligent monitoring device for a watercraft according to the invention;

FIG. 14 is a remote download workflow diagram in another embodiment of a multi-channel video intelligent monitoring device for a watercraft according to the invention;

FIG. 15 is a flow chart of intelligent monitoring operations associated with shipping status in another embodiment of a multi-channel video intelligent monitoring apparatus for a watercraft according to the present invention;

FIG. 16 is a workflow diagram according to one embodiment of a multi-channel video intelligent monitoring method for a marine vessel.

Detailed Description

In order that the invention may be readily understood, a more particular description thereof will be rendered by reference to specific embodiments that are illustrated in the appended drawings. Preferred embodiments of the present invention are shown in the drawings. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete.

Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. The term "and/or" as used in this specification includes any and all combinations of one or more of the associated listed items.

FIG. 1 shows a schematic view of an application scenario of an embodiment of the multi-channel video intelligent monitoring device for a ship of the present invention. In fig. 1, including multichannel video intelligent monitoring equipment A1, set up a plurality of cameras C1 on ship B1 or pier, camera C1 all with multichannel video intelligent monitoring equipment A1 communication interconnection, the video image that camera C1 took is transmitted for behind multichannel video intelligent monitoring equipment A1, multichannel video intelligent monitoring equipment A1 is to each the video image that the camera was shot carries out intelligent identification respectively, including discernment personnel's behavior of violating regulations and/or natural disaster scene to carry out the propelling movement to local or remote monitoring platform to the recognition result.

In the practical application, the cameras may also be connected to a network switch through a network line, and the multiple video intelligent monitoring device A1 is also connected to the network switch through a network line, so that the multiple video intelligent monitoring device A1 can identify and process the video shot by each camera based on the network data exchange mode. Therefore, the invention can be applied to the video monitoring system built on the ship, and the identification processing of the video shot by each camera can be realized only by additionally connecting the video data of the cameras to the multi-path video intelligent monitoring device A1.

Preferably, for the camera C1, the single-frame image pixels of the video image data obtained by it include: (1) 1080P, corresponding resolution pixel 1920×1080= 2073600, frame rate including 30fps, 25fps, 12fps; (2) 720P, with a corresponding resolution of 1280×720= 921600, i.e., about 92 ten thousand pixels, and a frame rate of 30fps, 25fps, 12fps; (3) 2K, corresponding resolution pixels 2560 x 1440= 2073600, frame rate including 30fps, 25fps, 12fps.

Taking the example of 1080P video type and 25fps frame rate, the video rate is 50Mbit/s. Each video path enters the multi-path video intelligent monitoring device to reduce the pixel resolution, for example, the frame frequency is uniformly reduced to 960 x 960= 921600, the frame frequency is uniformly reduced to 10fps for intelligent video analysis, and the frame frequency is further reduced to 2fps for intelligent video analysis.

Therefore, the multi-channel video intelligent monitoring equipment can be compatible with the data types and the data rates of video images adapting to various cameras, and uniformly regulate and control the video images to a fixed image resolution and frame frequency for intelligent identification processing.

Based on the embodiment shown in fig. 1, for the multi-path video intelligent monitoring device, the multi-path video intelligent monitoring device is generally arranged in the area where the camera is located, after intelligent processing is performed on the video collected by the camera, main video calculation processing is completed, and the intelligent recognition result, including information such as the type of violation, video evidence of violation and the like, can be transmitted to the monitoring platform in a wireless communication mode.

Therefore, on the basis of the embodiment shown in fig. 1, fig. 2 further shows that the multi-channel video intelligent monitoring device for a ship according to the present invention is installed on a plurality of ships, and the ships are sailing in a plurality of different waters, so that the multi-channel video intelligent monitoring device can be connected to a unified monitoring platform D1 through a wireless communication manner, and the mobile terminal E1 can also access the network to access each monitoring device.

Further, referring to fig. 3, an embodiment A1 of the multi-channel video intelligent monitoring device for a ship comprises a housing a11, wherein a front panel of the housing includes a plurality of peripheral interfaces a12, and functions of the peripheral interfaces include inputting and outputting video image data, data storage, power access, data communication, and the like. The diversity of the peripheral interfaces can enable the equipment to have various application modes, and is beneficial to interconnection and intercommunication of different existing video monitoring facilities.

Preferably, a substrate 1 is provided in the housing a11, and a main control processing board 2 and at least one video processing board 3 are provided on the substrate 1 to be connected in a pluggable manner. Of course, the main control processing board 2 and the video processing board 3 can also be fixedly arranged on the substrate, and the pluggable arrangement mode is beneficial to reasonably arranging the types and the numbers of the two processing boards according to the needs, for example, the main control processing board can have different types, different processing capacities and the video processing board can flexibly select the number to be used.

Further, as shown in fig. 4, the peripheral interface includes a first network interface 103, a network switching chip 4 is disposed on the substrate 1, and a main control connector 118 is disposed on the substrate 1, and is configured to connect to the main control processing board 2 in a pluggable manner. A plurality of video connectors 119 provided on the substrate 1 for removably connecting the video processing board 3.

Preferably, the actual size of such a substrate 1 is small, preferably 290mm by 200mm, which is smaller than the size of a normal PC host board. While the main control processing board has dimensions of 82mm by 50mm, and the video processing board has dimensions of 70mm by 34 mm. The size structure is obviously smaller than the structure size of the industrial personal computer, and has the characteristic of miniaturization. Preferably, the type of network switch chip 4 includes RTL8382L. The main control processing board and the video processing boards can be configured on the substrate according to the requirements, so that the method is suitable for the requirements of multipath video processing and has the flexibility of using configuration.

The first network interface 103 and the master control connector 118 are electrically connected to the network switch chip 4, so that the master control processing board 2 is also electrically connected to the network switch chip 4 through the master control connector 118. The model of the master connector includes a SODIMM standard interface, such as a 260P standard interface, 0.5mm pitch.

Further, a first network interface chip 122 is connected between the main control connector 118 and the network switching chip 4, and preferably, the type of the first network interface chip includes an RTL8211F chip. Through the first network interface chip, electrical type conversion of signals can be performed between the network switching chip 4 and the main control processing chip of the main control processing board 2.

By arranging the network exchange chip 4 on the substrate 1, network exchange of multiple paths of videos from the first network interface 103 is facilitated, interface expansion is facilitated through the network exchange chip 4, and simultaneous processing capacity of multiple paths of videos is enhanced.

By providing the main control connector 118 on the substrate 1, the main control processing board 2 can be connected in a pluggable manner, and the types of the main control processing board 2 can have a variety, so that the main control processing boards 2 with different processing capacities and prices can be selected according to the needs.

Preferably, the video connector 119 is also electrically connected to the network switching chip 4, so that the video processing board 3 is also electrically connected to the network switching chip 4 through the video connector 119. The model of the video connector includes a SODIMM standard interface, such as a 260P standard interface, 0.5mm pitch.

In this way, the first network interface 103 can be directly connected to the network output end of the camera (such as a monitoring camera), so that the video image data shot by the camera is transmitted to the network switching chip 4, and then transmitted to the selected video processing board 3, and the video image data is subjected to image processing.

Preferably, the first network interface 103 may be used to connect to an external switch, and the external switch has a plurality of network interfaces, and each of the plurality of cameras may be connected to the external switch, so that the cameras may access the network interface 103 of the video processing device through the plurality of network interfaces of the external switch, and further the video processing device may implement processing of video image data captured by the plurality of cameras through the plurality of video processing boards 3.

Preferably, a second network interface 104 is further disposed on the substrate 1, and a second network interface chip 121 is connected between the second network interface 104 and the master connector 118, and preferably, the type of the second network interface chip includes RTL8211F. By providing the second network interface 104, the camera can be connected through the network interface, and the video image data of the camera is transmitted to the main control processing board 2 for processing after being subjected to signal conversion through the second network interface chip 121.

Compared with the first network interface chip which needs to be connected with the network exchange chip, the main control processing board 2 can be accessed, and the second network interface chip 121 can be directly accessed to the main control processing board 2, so that the method has the characteristics of being more direct and efficient.

Preferably, the second network interface is further used for accessing monitoring configuration data, and the monitoring configuration data are input to a main control processing chip on the main control processing board and used for configuring parameters of components in the device.

Preferably, the first network interface chip 122 and the second network interface chip 121 are disposed on the back side of the substrate 1, and the network switching chip 4, the first network interface 103, the second network interface 104, and the main control connector 118 are disposed on the front side of the substrate 1. Thus, the layout of the electronic components can be effectively performed by using the double-sided space of the substrate 1.

Further, as shown in fig. 5, a network interface chip corresponding to the video processing board 3, namely, network interface chips 123-128, are further disposed on the back surface of the substrate 1, that is, each of the video processing boards 3 is electrically connected to the network switching chip 4 through the corresponding network interface chip. Preferably, the type of the network interface chip includes RTL8211F. Preferably, these network interface chips are disposed on the back side of the substrate 1, while the network switch chip 4, the first network interface 103 and the plurality of video connectors 119 are disposed on the front side of the substrate 1. Thus, the layout of the electronic components can be effectively performed by using the double-sided space of the substrate 1.

Further, as shown in fig. 5, the back surface of the substrate 1 is provided with a first network interface chip 122 and a second network interface chip 121, and the electrical connection relation between these two network interface chips has been described with reference to fig. 4, and fig. 5 only shows that these two chips are located on the back surface of the substrate 1 in terms of space arrangement.

The layout structure of the peripheral interface and the electronic component of the monitoring device on the substrate is described in detail below with reference to fig. 4 and 5.

Preferably, the peripheral interfaces include a first network interface 103, a second network interface 104, a photoelectric isolation interface 101, a wired communication interface 102, a USB2.0 interface 105, an HDMI interface 106, a USB3.0 interface 107, an SD card socket 108, an audio output port 109, an audio input port 110, a work indicator 113, a hard disk power socket 114, a hard disk data interface 115, and a mobile communication chip socket 130, a PCIE socket 131 and the like disposed on the back surface of the substrate 1, where these peripheral interfaces are directly or indirectly electrically connected to the main control connector 118, and are further electrically connected to a main control processing chip on a main control processing board.

Preferably, the front side edge of the substrate 1 is provided with a photoelectric isolation interface 101, and a single-chip microcomputer 132 is disposed adjacent to the photoelectric isolation interface 101, and the photoelectric isolation interface 101 is electrically connected with the single-chip microcomputer 132 through an optocoupler chip, and the optocoupler chip preferably comprises a TLP218-4, and comprises two such optocoupler chips corresponding to an optocoupler input of 4 channels and an optocoupler output of 4 channels respectively. The singlechip 132 is electrically connected to the main control connector, and further electrically connected to a main control processing chip on the main control processing board.

Preferably, on the substrate 1, a wifi chip 133 is provided adjacent to the singlechip 132, and the wifi chip 133 is electrically connected to the main control connector, and further electrically connected to the main control processing chip on the main control processing board.

Preferably, a wired communication interface 102 is arranged adjacent to the optoelectronic isolation interface 101 side by side, the wired communication interface 102 further includes an RS232 interface, an RS485 interface and a CAN interface, a first signal conversion chip MAX3221CPW is electrically connected corresponding to the RS232 interface, a second signal conversion chip MAX3485 is electrically connected corresponding to the RS485 interface, and a third signal conversion chip TJA1044GT is electrically connected corresponding to the CAN interface. The three signal conversion chips are electrically connected to the main control connector in an asynchronous serial port mode respectively, and are further electrically connected with a main control processing chip on the main control processing board.

Preferably, the front edge of the substrate 1 is further provided with a first network interface 103 and a second network interface 104, and the substrate 1 is further provided with a network switch chip 4, and the first network interface 103 and the master control connector 118 are electrically connected with the network switch chip 4, so that the master control processing board 2 is also electrically connected with the network switch chip 4 through the master control connector 118. Preferably, the type of network switch chip 4 includes RTL8382L. By providing the second network interface 104, the camera can be connected through the network interface, and the video image data of the camera is transmitted to the main control processing board 2 for processing after being subjected to signal conversion through the second network interface chip 121.

Further, as shown in fig. 4, on the substrate, a USB2.0 interface 105 is disposed adjacent to the second network interface 104, and the interface is electrically connected to the main control connector, and further electrically connected to the main control processing chip on the main control processing board.

Preferably, on the substrate, adjacent to the USB2.0 interface 105, an HDMI interface 106 is provided, which is a video interface, which is electrically connected to the host connector and further electrically connected to the host processing chip on the host processing board.

Preferably, on the substrate, a USB3.0 interface 107 is disposed adjacent to the HDMI interface 106, and the interface is electrically connected to the main control connector, and further electrically connected to the main control processing chip on the main control processing board.

Preferably, on the substrate, adjacent to the USB3.0 interface 107, an SD card socket 108 is provided for plugging an SD card, and the socket is electrically connected to the main control connector, and further electrically connected to the main control processing chip on the main control processing board.

Preferably, on the substrate, an audio output port 109, such as an earphone socket, is disposed adjacent to the SD card socket 108 for outputting audio, and the audio output port is electrically connected to the main control connector, and further electrically connected to the main control processing chip on the main control processing board.

Preferably, an audio input 110, such as a microphone, is provided on the substrate adjacent to the audio output 109 for inputting audio, the audio input being electrically connected to the host connector and further to the host processing chip on the host processing board.

Preferably, a SIM card socket 111 is disposed on the substrate adjacent to the audio input port 110 for plugging a SIM card for mobile communication access, such as 4G or 5G mobile communication, and is electrically connected to a mobile communication chip socket disposed on the back surface of the substrate for plugging a mobile communication chip or a mobile communication chip. The mobile communication chip socket is electrically connected to the main control connector, and further electrically connected with a main control processing chip on the main control processing board.

Preferably, a power socket 112 is arranged on the substrate adjacent to the SIM card socket 111 and is used for accessing a direct current power supply, preferably the voltage of the direct current power supply is 12V, and then the direct current power supply is converted into voltages of 5V, 3.3V and 1.8V through a DC-DC power supply module arranged on the substrate, so as to supply power for various components on the substrate and the main control processing board.

Preferably, an operation indicator lamp 113 is provided on the substrate adjacent to the power outlet 112 for indicating the power-on state of the device. The work indicator lamp 113 is also electrically connected to the main control connector, and further electrically connected to the main control processing chip on the main control processing board, and is controlled by the main control processing chip.

Preferably, on the substrate, a hard disk power socket 114 is provided adjacent to the operation indicator lamp 113, wherein the power socket includes direct current 12V and 5V power supply, and the power cable is connected to the hard disk through the hard disk power socket to supply power to the hard disk, and the hard disk is used for storing video monitoring data.

Preferably, on the substrate, a hard disk data interface 115 is disposed adjacent to the hard disk power outlet 114, and the hard disk data interface 115 is electrically connected to the main control connector, and further electrically connected to the main control processing chip on the main control processing board. The hard disk data interface 115 is further connected to a hard disk through a data line, and performs data read/write operation on the hard disk.

Further, as shown in fig. 5, an extended memory chip 129 is disposed on the back surface of the substrate 1, and the extended memory chip 129 is a further capacity extension of the existing memory chip on the main control processing board, so as to ensure that the memory space of the main control processing board is enough to meet the requirements of program storage and data storage. The extended memory chip 129 is electrically connected to a main control connector provided on the front surface of the substrate 1, and further electrically connected to a main control processing chip on the main control processing board.

Preferably, a mobile communication chip socket 130 is disposed on the back surface of the substrate 1, and as mentioned above, the mobile communication chip socket 130 is electrically connected to the SIM card socket 111 on one hand, and is electrically connected to a main control connector disposed on the front surface of the substrate 1 on the other hand, and further electrically connected to a main control processing chip on the main control processing board.

Preferably, a PCIE socket 131 is disposed on the back surface of the substrate 1, where the PCIE socket 131 is used to establish PCIE communication connection with the main control processing board, so that the socket is electrically connected to the main control connector disposed on the front surface of the substrate 1, and further electrically connected to the main control processing chip on the main control processing board.

Preferably, a real-time clock chip 134 is provided on the back side of the substrate 1, and is used for providing real-time information, and the model preferably includes HYM8563TS, so that the chip is electrically connected to a main control connector provided on the front side of the substrate 1, and further electrically connected to a main control processing chip on the main control processing board.

It can be seen that the substrate is provided with a plurality of peripheral interfaces, and the peripheral interfaces are electrically connected to the main control connector and further electrically connected with the main control processing chip on the main control processing board. In the intelligent video processing solution, the embodiment faces the input and output requirements of multiple interfaces, and has the advantages of miniaturization and low cost.

Preferably, as shown in fig. 6, the main control processing board 2 is provided with a main control processing chip 21, cache chips 22 and 23, a memory chip 24 and a power management chip 25, and a patch cord 26 correspondingly connected with a main control connector 118 on the substrate 1, and through the patch cord 26 and the main control connector 118, power supply connection and data signal transmission between the main control processing board 2 and the substrate 1 are realized.

The main control processing chip 21 is electrically connected with the cache chips 22 and 23 and the storage chip 24 respectively, wherein the storage chip 24 is used for storing a main control processing program and processed result data. After the power-up operation, the main control processing chip 21 loads the main control processing program from the storage chip 24 to start running, and the cache chips 22 and 23 are used for carrying out data cache in real time in the process of main control processing in cooperation with the main control processing chip 21, so that the data reading speed is high, but the data in the cache chips 22 and 23 are not saved after the power-down operation. The power management chip 25 is used for supplying power to the above chips on the main control processing board 2, and providing corresponding voltage and current requirements.

Preferably, the type of the main control processing chip 21 includes a quad-core 64-bit processor RK3568 chip, the type of the cache chip 22 includes a DDR chip, and the types of the memory chips 24 include flash chips, and the types of the memory chips 32G, 64G, and 128G are selectable. For RK3568 chip, mainly used image processing, built-in CPU with main frequency up to 2.0GHz, GPU supporting OpenGL ES1.1/2.0/3.2, NPU of high-performance AI accelerator, and VPU supporting video decoding of multiple specifications.

Preferably, as shown in fig. 7, the video processing board 3 is provided with a video processing chip 31, a cache chip 32 and a power management chip 33, and a patch cord 34 for corresponding connection with a video connector 119 on the substrate 1, and through the patch cord 34 and the video connector 119, power supply connection and data signal transmission between the video processing board 3 and the substrate 1 are realized.

Referring to fig. 8, a memory chip 35 is further provided on the video processing board 3. Preferably, the memory chip 35 is disposed on the back side of the video processing board 3, and the video processing chip 31, the cache chip 32, and the power management chip 33 are disposed on the front side of the video processing board 3.

The video processing chip 31 is electrically connected to the buffer chip 32 and the memory chip 35, respectively, wherein the memory chip 35 is used for storing a video processing program and processed result data. After the power-up operation, the video processing chip 31 starts to run by loading the video processing program from the storage chip 35, and the buffer chip 32 is used for performing data buffer in real time in cooperation with the video processing chip 31 in the video processing process, so that the data reading speed is high, but the data in the buffer chip 32 is not saved after the power-down operation. The power management chip 33 is used for supplying power to the above-mentioned chips on the video processing board 3, and providing corresponding voltage and current requirements.

Preferably, the type of video processing chip 31 includes a Rockchip RV1126 chip, including a quad ARM Cortex-A7, and a RISC-V MCU based with built-in NPU, computing power up to 2.0TOPs. The type of the buffer chip 32 includes a DDR chip, and the type of the memory chip 35 includes a flash chip or an eMMC chip. For RV1126 chip, mainly used image processing, processing capacity 2.0Tops, and for neural network processor NPU, realize AI operation's consumption less than corresponding 10% of required GPU.

The invention can realize the calculation of 12T within the power consumption of 30W, and can process the encoding and decoding of 12 paths 1080p@12 frame video. The general method of the X86 architecture with the Inlet/Vicat display card is difficult to achieve the processing capability, and the implementation form of the architecture of the PC and the display card is more than 10 times of the device in terms of power consumption, and obviously the cost performance of the device is higher.

In combination with the foregoing description, after the video shot by each camera reaches the video processing board, the video is uniformly regulated to a fixed image resolution and frame frequency to perform intelligent recognition processing. The pixel resolution is uniformly regulated to 960 x 960, the frame frequency is 10fps or 2fps, and then intelligent video analysis is carried out. Then, for one video processing board, the video processing of multiple cameras can be satisfied, so long as the video processing board is within the processing capability of the video processing chip. For video from different cameras, the video data are distinguished by the network addresses of the cameras, so that the video data can be processed and stored respectively by using independent storage spaces on a video processing board.

Further, as shown in fig. 9, in combination with the foregoing, it can be seen that, for the substrate 1, there are provided thereon a first network interface 103, a second network interface 104, a network switching chip 4, a first network interface chip 122, and a second network interface chip 121. For the main control processing board 2, a main control processing chip 21, a cache chip 22, and a memory chip 24 are provided thereon. The main control processing board 2 is electrically connected to the main control connector on the substrate 1 through a patch cord, for example, the main control processing board 2 is plugged onto the corresponding main control connector in a plugging manner. Preferably, the number of the cache chips used by the main control processing boards 2 can be determined according to the requirement, such as two or one, and the type of the main control processing chips 21 therein can also be adaptively selected according to the required processing capacity requirement.

For the substrate 1, a first network interface 103, a network switching chip 4 and a plurality of network interface chips 123-128 are provided thereon. For the video processing board 3, a video processing chip 31, a cache chip 32, and a memory chip 35 are provided thereon. Each video processing board 3 is electrically connected to a connector on the substrate 1 by means of a patch cord, for example by plugging the video processing board 3 to a corresponding connector. Preferably, the number of the video processing boards 3 can be determined according to the requirement, when the number of the cameras is large, the video processing boards 3 can be correspondingly used for processing, and when the number of the cameras is small, the video processing boards 3 can be correspondingly used for processing.

Further, on the substrate 1, a single chip 132, a wifi chip 133, a wired communication interface 102, a USB2.0 interface 105, an HDMI interface 106, a USB3.0 interface 107, an SD card socket 108, an audio output port 109, an audio input port 110, a work indicator 113, a hard disk power socket 114, and a hard disk data interface 115 are further provided, and an expansion memory chip 129, a mobile communication chip socket 130, a PCIE socket 131, and a real-time clock chip 134 are provided on the back surface of the substrate 1. The interfaces and the chips are all electrically connected to a main control connector on the substrate, and are further electrically connected with a main control processing chip on the main control processing board.

The specific application scenario mode of the device is described in detail below in conjunction with the aforementioned peripheral interface.

Application mode one:

referring to fig. 9, it can be seen that the main control processing chip 21 on the main control processing board 2 and the video processing chip 31 on the video processing board 3 perform data transmission and exchange mainly through the network interface chips (121, 122, 123, 128) and the network exchange chip 4 on the substrate 1, and these data mainly are video image data, and belong to service data. The interface connection lines between these network chips are connected in a bus manner, and each interface is usually in the form of 8 lines for transmitting data, and mainly performs data communication in the form of network addressing and data packets in a standard network protocol, but the flexibility in cooperative control between the respective connection boards is not sufficient, although the standardization degree is high. For this purpose, individual control line connections between the control chips on the individual boards are further increased.

On the basis of fig. 9, the same contents as those in fig. 9 are not repeated in conjunction with those in fig. 10. In fig. 10, the single chip microcomputer chip 132 disposed on the substrate 1 is electrically connected to the main control processing chip 21 on the main control processing board 2 directly through the IO interface of the chip pin, preferably by using a dual-line asynchronous serial port, as shown in a first monitor circuit AQ11 in fig. 10, and the main control processing chip 21 on the main control processing board 2 is electrically connected to the video processing chip 31 on the video processing board 3 also directly through the IO interface of the chip pin, as shown in a second monitor circuit AQ21 in fig. 10, where the main control processing chip 21 and the six video processing chips 31 are electrically connected through different IO interfaces respectively.

Through the mode of direct interconnection through the IO interface between these control chips, can carry out convenient communication transmission between control chips to can be used for the state monitoring and the reset restarting operation to control chip. Preferably, the singlechip chip 132 on the substrate periodically inquires the working state of the master control processing chip 21 through the first monitoring line AQ11, the line AQ11 is preferably an asynchronous serial port of two lines, whether the master control processing chip 21 works normally is judged by inquiry, for example, the master control processing chip 21 feeds back the working state information to the singlechip chip 132 by inquiry, if the working state information contains the abnormal working information of the master control processing chip, or the master control processing chip 21 does not feed back to the singlechip chip 132 in time, it is judged that the working of the master control processing chip 21 is abnormal, and reset control is required to be performed on the master control processing chip 21 on the master control processing board 2.

Preferably, as shown in fig. 10, the single chip microcomputer 132 controls the first reset circuit 141, and then sends a reset control signal to the reset pin of the main control chip 21 through the first reset line AQ12, so that the main control chip 21 resets.

Preferably, as shown in fig. 10, the main control processing chip 21 is further electrically connected to the video processing chip 31 on the video processing board 3 through a second monitoring circuit AQ21, and the circuit AQ21 is connected by transfer to the substrate 1. In application, the video processing chip 31 periodically transmits working state information to the main control processing chip 21, where the working state information is mainly used for verifying whether an operating system on the video processing chip is running normally, where a unidirectional reporting mode is adopted, the video processing chip 31 actively sends the working state information to the main control processing chip 21, and the main control processing chip 21 only needs to receive the working state information in a unidirectional manner and does not need to send instructions to the video processing chip, so that information can be transmitted by using one connecting line, and real-time monitoring of the working state of the video processing chip can also be ensured.

Further, when the main control processing chip considers that the video processing chip is not working normally, the second reset circuit 142 and the second reset circuit AQ22 electrically connected to the reset pin of the video processing chip are used for performing the reset control on the video processing chip.

Preferably, the above belongs to the physical layer to monitor whether the operation of the video processing chip is normal, and may also monitor the operation of the video processing chip based on the application layer. The main control processing chip 21 also sends an inquiry data packet to the video processing chip 31 through the network exchange chip 4, and receives a response data packet from the video processing chip after receiving the inquiry data packet, wherein the two data packets belong to data packets of an application layer, so that whether the video intelligent recognition function in the video processing chip works normally can be further verified.

On the basis of fig. 10, a method for realizing the stable operation of the apparatus will be specifically described with reference to fig. 11. The singlechip chip monitors stable operation of the main control processing chip through a first monitoring circuit and a first reset circuit; and the main control processing chip monitors the stable operation of each video processing chip through the second monitoring circuit and the second reset circuit. The method specifically comprises the following steps:

step S101: the singlechip chip queries the working state of the main control processing chip at regular time through the first monitoring circuit;

step S102: the master control processing chip feeds back the working state to the singlechip chip;

Step S103: if the feedback working state of the main control processing chip is abnormal or the working state cannot be timely fed back to the singlechip chip, the singlechip chip judges that the main control processing chip works abnormally;

step S104: after the singlechip chip judges that the main control chip works abnormally, resetting operation is carried out on the main control chip through a first resetting line;

step S105: and resetting the main control processing chip and rerun the program.

The stability control method between the singlechip chip on the substrate and the main control processing chip on the main control processing board is adopted. The following is a method for controlling the stability between the main control processing chip on the main control processing board and the video processing chip on the video processing board.

Step S106: each video processing chip reports working states to the main control processing chip at regular time through a second monitoring circuit;

step S107: if the main control processing chip receives the abnormal working state of the video processing chip or can not timely receive the report of the working state of the video processing chip, the main control processing chip judges that the video processing chip works abnormally;

step S108: after the main control processing chip judges that the video processing chip works abnormally, resetting operation is carried out on the video processing chip through a second resetting line;

Step S109: the video processing chip resets and rerun the program.

Application mode two:

on the basis of fig. 9, in combination with fig. 12, the main control processing chip on the main control processing board may perform network interconnection with the remote monitoring platform D1 or the local monitoring platform through the mobile communication chip 130, the Wifi chip 133, the first network interface 103 and the second network interface 104, and further be electrically connected with a local hard disk in the device through the hard disk interface 115. Therefore, each video processing board can perform local storage on the found illegal behaviors in the monitoring process and can also remotely send the illegal behaviors to a remote monitoring platform.

Based on fig. 12, a method for maintaining the device for local video surveillance identification processing, and local storage and remote transmission is specifically described below in conjunction with fig. 13. The method comprises the following steps:

step S201: video images from the camera are transmitted to the video processing board through a first network interface and a network switching chip which are arranged on the substrate;

step S202: the video image is cached in a cache chip of the video processing board, and when the video processing chip detects that a violation event is found, a violation video fragment and/or picture to be recorded is selected from the cached video and transmitted to the main control processing board for storage;

Step S203: transmitting the illegal video clips and/or pictures to a network switching chip on the substrate;

step S204: the network exchange chip on the substrate further transmits the illegal video clips and/or pictures to the main control processing board;

step S205: the main control processing board transmits the illegal video clips to a hard disk data interface on the substrate, and the hard disk data interface is connected with a hard disk to store the illegal video clips;

step S206: under the control of the main control processing board, the illegal video clips can be remotely transmitted through the mobile communication chip, the first network interface or the second network interface on the substrate.

Preferably, after the violation video clips are stored, when remote transmission is required, the violation video clips can be selectively transmitted, for example, the violation video clips are stored at the rate of 10 frames per second, when transmission is performed, firstly, the time period in which the violation occurs is accurately positioned, then, the video in the time period is extracted, for example, one frame or two frames are separated for transmission, on the basis of ensuring that the violation video can be transmitted, the video frame rate is reduced, the remote transmission data load is reduced, and meanwhile, the evidence obtaining frequency band is ensured not to lose information.

And (3) an application mode III:

based on the illustration in fig. 14, the running program of the main control processing chip on the main control processing board can be updated, downloaded and started remotely, and the running program of the video processing chip on the video processing board, namely the video monitoring identification program, can be updated, downloaded and started remotely. The method comprises the following steps:

step S301: receiving a remote program downloading instruction and program code data through a mobile communication chip;

step S302: the program downloading instruction and the program code data are transmitted to a main control processing chip on a main control processing board;

step S303: the main control processing chip analyzes the program downloading instruction to determine a downloading object, if the downloading object is the main control processing board, the program code data is stored on a storage chip of the main control processing board, and after the program is downloaded and checked, a new downloading program is started to work; if the downloaded object is a video processing board, transmitting the program code to the corresponding video processing board through the network exchange chip according to the identification number of the video processing board;

step S304: when the downloaded object is a video processing board, transmitting program code data to the corresponding video processing board;

step S305: after receiving the program code data, the corresponding video processing chip stores the program code data in a storage chip on the video processing board, and after the program is downloaded and checked, a new downloaded program is started to work.

Application mode four:

based on the opto-electrical isolation interface 101, the wired communication interface 102, the device can be connected to a ship handling device, for example, a switching signal in the ship can be connected to the opto-electrical isolation interface 101, and a positioning signal of the ship can be connected to the wired communication interface 102. After the signals are input into the monitoring device, the signals can be used as associated control signals for enabling relevant monitoring and identification by the video processing board. For the ship loaded by the equipment, four sailing states are mainly sailing, anchoring, port unloading/loading and port stopping, and the sailing states can directly input corresponding control signals to the equipment through the photoelectric isolation interface 101 and the wired communication interface 102, so that corresponding intelligent video monitoring is correspondingly started.

And the photoelectric isolation interface receives a ship running state signal, and the corresponding video processing board starts a relevant video monitoring program to monitor personnel operation conditions related to the current ship running state. The method specifically includes the steps as shown in fig. 15:

step S401: accessing a control signal of the ship equipment through the photoelectric isolation interface, receiving the control signal by the singlechip chip, analyzing the control signal, and judging the running state of the ship;

Step S402: the singlechip chip sends the running state of the ship to a main control processing chip on a main control processing board;

step S403: after receiving the running state information of the navigation ship, the main control processing chip performs identification judgment;

step S404: issuing a corresponding detection and identification instruction to a video processing chip on a corresponding video processing board;

step S405: and after receiving the detection and identification instruction, the corresponding video processing chip operates a corresponding intelligent video processing program to realize a corresponding detection and identification function.

The method specifically comprises the steps that a ship is provided with a sailing state switch signal, wherein the sailing state switch signal comprises a ship port-leaning unloading switch signal, when the switch signal is effective and is input to a singlechip chip through a photoelectric isolation interface, the singlechip chip analyzes and considers that the ship is currently in a port-leaning unloading state, the state information is sent to a main control processing chip on a main control processing board, the main control processing chip inquires and determines one of the video processing boards to receive a monitoring video from a deck monitoring camera, then the video processing board sends an instruction for intelligently monitoring a deck operator, and after the video processing chip on the video processing board receives the instruction, a corresponding monitoring program is started, and detection, identification and alarm recording are carried out on conditions of wearing a safety helmet and wearing a life jacket for the water operation of the deck operator.

Based on the same conception, the invention provides a multipath video intelligent monitoring method for a ship. As shown in fig. 16, the method includes:

s1, arranging a plurality of monitoring cameras on the ship, and respectively shooting video image data for each monitored area;

s2, transmitting the video image data shot by each monitoring camera to multi-channel video intelligent monitoring equipment arranged on the boat;

s3, a plurality of video processing boards are arranged in the multi-channel video intelligent monitoring equipment, and video image data acquired by each monitoring camera are respectively input to the corresponding video processing boards for intelligent video image processing;

and S4, after the intelligent video image processing, each video processing board recognizes corresponding illegal operation behaviors and/or dangerous disasters, records corresponding video evidence data and outputs alarm information.

Preferably, each video processing board stores a pre-trained intelligent video image processing program, and the intelligent video image processing program is operated to process input video image data, so as to identify corresponding illegal operation behaviors and/or dangerous disasters.

Preferably, the processing of the input video image data includes selecting a detection event and associating with a corresponding detection recognition object.

Preferably, the multi-channel video intelligent monitoring device is further internally provided with a main control processing board, the main control processing board is electrically connected with a local storage hard disk, and video evidence data are transmitted to the main control processing board by the video processing board and then stored to the local storage hard disk.

Preferably, the main control processing board is electrically connected with a mobile communication chip, and the video evidence data is transmitted from the video processing board to the main control processing board and then transmitted to the remote control platform through the mobile communication chip.

Preferably, the main control processing board and the video processing board are electrically connected to a network switching chip, and video image data exchange and transmission are performed through the network switching chip.

Preferably, the video processing boards are all pluggable and arranged on the substrate, and when power is applied, the video processing boards automatically configure the network address corresponding to the video processing boards by inquiring the voltages of a plurality of pins of the video processing chip arranged on the video processing boards.

Preferably, the substrate is provided with a first network interface, the network interface is electrically connected with the network switching chip, video image data from a single monitoring camera is transmitted to the video processing board corresponding to one network address for processing through the first network interface, or video image data from at least two monitoring cameras is transmitted to the video processing board corresponding to the same network address through the first network interface for synchronous processing.

Preferably, the substrate is provided with a video input/output port, and is electrically connected with the main control processing board, the video input/output port is used for being connected with a display, and the video evidence data is input to the display for displaying.

Preferably, the substrate is provided with a wired communication interface and is electrically connected with the main control processing board, and the wired communication interface is used for compatibly connecting a monitor with a corresponding interface and is used for communication interconnection with the multi-path video intelligent monitoring device.

Therefore, the invention discloses a multi-channel video intelligent monitoring device for a ship. The equipment comprises a shell, wherein a substrate is arranged in the shell, a main control processing board and at least one video processing board which are connected in a pluggable manner are arranged on the substrate, a first network interface and a network exchange chip are further arranged on the substrate, the main control processing board, the video processing board and the first network interface are electrically connected with the network exchange chip, video image data are input through the first network interface, and video image processing is performed by the main control processing board and/or the video processing board. The substrate is also provided with a plurality of types of peripheral interfaces and functional chips. The device can meet the intelligent processing requirements of multiple paths of videos at the same time, and has the technical advantages of miniaturization and low cost.

The foregoing description is only illustrative of the present invention and is not intended to limit the scope of the invention, and all equivalent structural changes made by the present invention and the accompanying drawings, or direct or indirect application in other related technical fields, are included in the scope of the present invention.

Claims (10)

1. The utility model provides a multichannel video intelligent monitoring equipment for ship by plane, includes the casing, its characterized in that be provided with the base plate in the casing be provided with master control processing board and at least one video processing board that can plug and connect on the base plate still be provided with first network interface and network exchange chip on the base plate, master control processing board, video processing board and first network interface all with network exchange chip electricity is connected, through first network interface input video image data, by master control processing board and/or video processing board carry out video image processing.

2. The multi-channel video intelligent monitoring device for a ship according to claim 1, wherein a main connector for plug-in connection with the main control processing board and a video connector for plug-in connection with the video processing board are arranged on the base plate.

3. The multi-channel video intelligent monitoring device for a ship according to claim 2, wherein a main control processing chip, a cache chip and a storage chip are arranged on the main control processing board, and a patch cord is further arranged for being correspondingly connected with a main control connector on the substrate, and the main control processing chip is respectively and electrically connected with the cache chip, the storage chip and the patch cord which are arranged on the main control processing board.

4. The multi-channel video intelligent monitoring device for a ship according to claim 3, wherein a video processing chip, a cache chip and a storage chip are arranged on the video processing board, and a patch cord is further arranged for being correspondingly connected with a video connector on the substrate, and the video processing chip is respectively and electrically connected with the cache chip, the storage chip and the patch cord which are arranged on the video processing board.

5. The multi-channel video intelligent monitoring device for a ship according to claim 4, wherein a mobile communication chip connection socket for plugging and unplugging a mobile communication chip is arranged on the substrate, the mobile communication chip connection socket is electrically connected with a main control connector on the substrate, the mobile communication chip is electrically connected with the main control processing chip, and the mobile communication chip is used for carrying out remote wireless communication transmission with a monitoring platform.

6. The multi-channel video intelligent monitoring device for a ship according to claim 5, wherein a hard disk data interface is arranged on the substrate and is used for being connected with a hard disk, the hard disk data interface is further electrically connected with a main control connector on the substrate and further electrically connected with the main control processing chip, and the hard disk is used for storing video image data.

7. The multi-channel video intelligent monitoring device for a ship according to claim 4, wherein a single chip microcomputer chip, a photoelectric isolation interface and/or a wired communication interface are arranged on the substrate, the single chip microcomputer chip is electrically connected with the photoelectric isolation interface, and the single chip microcomputer chip and the wired communication interface are further electrically connected with a main control connector on the substrate and further electrically connected with a main control processing chip arranged on the main control processing board.

8. The multi-channel video intelligent monitoring device for a ship according to claim 6, wherein the monitoring platform remotely downloads an operation program to the main control processing board and/or the video processing board through the mobile communication chip, and the main control processing board transmits video monitoring data to the monitoring platform through the mobile communication chip.

9. The multi-channel video intelligent monitoring device for a ship according to claim 7, wherein the single chip microcomputer chip monitors the stable operation of the main control processing chip through a first monitoring line and a first reset line; and the main control processing chip monitors the stable operation of each video processing chip through the second monitoring circuit and the second reset circuit.

10. The intelligent multi-channel video monitoring device for a ship according to claim 7, wherein the photoelectric isolation interface receives a ship running state signal, and the corresponding video processing board enables a relevant video monitoring program to monitor personnel operation conditions related to the current ship running state.