CN116246224A - A loading and unloading intelligent monitoring device and method - Google Patents

Abstract

The invention relates to the field of dump truck monitoring, and discloses an intelligent monitoring device and method for loading and unloading materials. The device includes a housing, a camera, a processor, a memory, an alarm module, a communication module and a power supply module; The edge of the bucket between the buckets; the camera is half-embedded in the casing, and the exposed lens of the camera faces the bucket of the dump truck; the processor, memory, communication module and alarm module are installed inside the casing, and the processor and the memory are respectively , communication module, alarm module and camera communication connection; communication module and cloud platform communication connection; power supply module is connected with the power output interface of the dump truck, and respectively connected with the camera, processor, memory, alarm module and communication module, deployed in the memory There is an image analysis module for image similarity comparison. The technical solution provided by the invention can effectively supervise problems such as cutting corners and wrong materials during loading and unloading under the condition of relatively low cost.

Description

A loading and unloading intelligent monitoring device and method

technical field

The invention relates to the field of dump truck monitoring, in particular to an intelligent monitoring device and method for loading and unloading materials.

Background technique

Existing dump truck unloading monitoring in hydropower projects generally adopts the method of manual supervision at the picking and unloading site. The existing technology relies on manual supervision, which is not only time-consuming and labor-intensive, but also has risks such as misjudgment, cutting corners, loading and unloading wrong materials.

At present, in order to solve these problems, various sensors are usually loaded on the dump truck, such as pressure sensors, gravity sensors, lift sensors installed at the lower part of the body, etc. On the one hand, if more sensors are installed, it will cause the dump truck to The cost price is high, and the risk of sensor failure is high, which brings troubles for later maintenance work. If fewer sensors are installed, it will not be able to automatically supervise the loading and unloading of materials, so a new solution is urgently needed to effectively supervise the loading and unloading of materials.

Contents of the invention

In view of this, the embodiment of the present invention provides an intelligent monitoring device and method for loading and unloading, which can effectively monitor the phenomena of cutting corners, loading wrong materials, and unloading wrong materials at a relatively low cost.

According to the first aspect, an embodiment of the present invention provides an intelligent monitoring device for loading and unloading, the device includes a housing, a camera, a processor, a memory, an alarm module, a communication module and a power module; the housing is installed on a dump truck On the edge of the vehicle body between the front and the vehicle body; the camera is half-embedded on the housing, and the exposed lens of the camera faces the body of the dump truck; the processor, memory, communication module and the alarm The module is installed inside the housing, and the processor is respectively connected to the memory, the communication module, the alarm module and the camera in communication; an image analysis module is deployed in the memory for image processing Similarity comparison; when the processor runs the image analysis module, the camera is controlled to collect images in the direction of the vehicle body, and receives the loading material image or the vehicle body image returned by the camera, while the processor requesting the target material image or empty bucket image from the cloud platform, and then the processor compares the similarity between the loading material image and the target material image to analyze whether the loading material is loaded correctly, or, the The processor compares the image of the bucket with the image of the empty bucket to obtain the height of the material in the image of the bucket, and then analyzes the full load rate of the dump truck according to the height of the material, so as to determine by the full load rate Whether the loading material is missing; the alarm module is used to send an alarm message when receiving the alarm command from the processor; the power module is connected to the power output interface of the dump truck, and is connected to the camera, processor, The memory, the alarm module and the communication module are connected.

Optionally, the housing further includes a fixing clip, and for the opposite ends of the fixing clip, one end is connected to the housing, and the other end is not connected to the housing, and the housing passes through the The unconnected end of the fixing clip is inserted on the edge of the vehicle body between the vehicle head and the vehicle body.

Optionally, the device further includes a transparent protective cover and a rotating motor; the rotating motor is installed inside the casing and connected to the processor and the power module respectively; the rotating shaft of the rotating motor extends out of the The casing, the transparent protective cover is connected with the extending shaft and is covered outside the casing.

Optionally, the device also includes a transparent protective cover and a vibrating motor; a plurality of shock absorbing springs are arranged around the side of the casing, and the casing is connected to the inner wall of the transparent protective cover through the shock absorbing springs. connected, the transparent protective cover is covered outside the housing; the vibration motor is installed inside the transparent protective cover and connected to the processor and the power supply module through signal lines.

Optionally, the device further includes a GPS positioning module, the GPS positioning module is located inside the housing and communicated with the processor.

According to the second aspect, an embodiment of the present invention provides an intelligent monitoring method for loading and unloading, which is applied to an intelligent monitoring device for loading and unloading. The method includes: establishing a communication connection with the cloud platform; vehicle material image, and request the target material image to the cloud platform; receive the target material image sent by the cloud platform, and compare the similarity between the loading material image and the target material image; if the similarity comparison result If the loading error is indicated, the first alarm message is issued; when the dump truck starts to move, the bucket image of the dump truck is collected, and the empty bucket image is requested from the cloud platform; the empty bucket image sent by the cloud platform is received, and Comparing the bucket image with the empty bucket image to obtain the material height in the bucket image; analyzing the full load rate of the dump truck according to the material height in the bucket image, and when the full load rate is lower than the first preset When the threshold is reached, a second alarm message is issued.

Optionally, the method further includes: when the dump truck is moving, GPS positioning is performed on the dump truck to obtain location information of the dump truck; sending a navigation request to the cloud platform, and receiving loading and unloading route information sent by the cloud platform, the loading and unloading route The information is the route information returned by the cloud platform based on the navigation request; analyze whether the dump truck is off course based on the dump truck positioning information and the loading and unloading route information, and send a third alarm when the dump truck is off course information.

Optionally, the method further includes: after the dump truck arrives at the unloading location, collecting the bucket image of the dump truck, comparing the bucket image with the empty bucket image, and obtaining the material height in the bucket image; The unloading rate of the dump truck is analyzed according to the material height in the bucket image, and when the unloading rate is higher than a second preset threshold value, an unloading completion message is sent.

Optionally, the method further includes: when the dump truck arrives at the loading location, start the rotating motor provided inside the housing of the loading and unloading intelligent monitoring device, so as to extend the rotating shaft of the housing through the rotating motor, so that The transparent protective cover connected on the rotating shaft rotates.

Optionally, the method further includes: when the dump truck arrives at the loading site, starting a vibration motor on the transparent protective cover to vibrate the transparent protective cover.

The technical scheme provided by the application has the following advantages:

The technical solution provided by this application provides an intelligent monitoring device for loading and unloading, which includes a housing, a camera, a processor, a memory, an alarm module, a communication module and a power module; the housing is installed between the front of the dump truck and the bucket on the edge of the body between the two; the camera is half-embedded on the casing, and the exposed lens of the camera faces the body of the dump truck; the processor, memory, communication module and alarm module are installed inside the casing, and the processor communicates with the memory and the The module, the alarm module and the camera are connected by communication; an image analysis module is deployed in the memory for image similarity comparison; when the processor runs the image analysis module, it controls the camera to collect images in the direction of the vehicle body, and receives the returned image from the camera. At the same time, the processor requests the target material image or empty bucket image from the cloud platform, and then the processor compares the similarity between the loading material image and the target material image to analyze whether the loading material is loaded The truck is correct, or the processor compares the similarity between the bucket image and the empty bucket image to obtain the material height in the bucket image, and then analyzes the full load rate of the dump truck according to the material height, so as to determine the loading material through the full load rate Whether it is missing; the alarm module is used to send alarm information when receiving the alarm command from the processor; the power module is connected to the power output interface of the dump truck, and is connected to the camera, processor, memory, alarm module and communication module respectively. Based on the device provided in this embodiment, if the aggregate is filled or wrongly loaded, the processor can send an alarm message in time through the alarm module to remind the driver that there is a problem with loading. On the one hand, it realizes the automatic supervision of dump truck loading and unloading. On the other hand, the structure of the device is not complicated. It only needs common parts such as core processor, camera, and communication module to realize it, which reduces the cost of the device. In addition, the processor can also send the collected image to the cloud platform through the communication module, so that the cloud platform can analyze and judge the image, and then the processor can receive the judgment result issued by the cloud platform through the communication module, and the processor no longer performs image analysis steps, thereby reducing the computing power requirements of the processor, enabling the use of lower-priced chips, and further reducing the overall cost of the device.

Description of drawings

The features and advantages of the present invention will be more clearly understood by referring to the accompanying drawings, which are schematic and should not be construed as limiting the invention in any way. In the accompanying drawings:

Fig. 1 shows a schematic diagram of the installation position of a loading and unloading intelligent monitoring device in one embodiment of the present invention;

Fig. 2 shows a front view of a loading and unloading intelligent monitoring device in one embodiment of the present invention;

Fig. 3 shows a top view of a loading and unloading intelligent monitoring device in one embodiment of the present invention;

Fig. 4 shows a right view of a loading and unloading intelligent monitoring device in an embodiment of the present invention;

Fig. 5 shows a front perspective view of an intelligent monitoring device for loading and unloading in an embodiment of the present invention;

Fig. 6 shows a schematic structural view of a loading and unloading intelligent monitoring device in an embodiment of the present invention;

Fig. 7 shows another schematic structural view of a loading and unloading intelligent monitoring device in an embodiment of the present invention;

Fig. 8 shows a schematic diagram of the steps of an intelligent monitoring method for loading and unloading in an embodiment of the present invention.

Reference signs: 1-housing, 2-camera, 3-processor, 4-memory, 5-alarm module, 6-communication module, UPS-power supply module, 7-fixing clip, 8-GPS positioning module, 9- SD card, 10-RAM memory chip, 11-5G wireless data transmission terminal, 12-antenna, 13-data expansion interface, 14-transparent protective cover, 15-rotating shaft, 16-vibration motor, 17-shock absorbing spring.

Detailed ways

In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments It is some embodiments of the present invention, but not all of them. Based on the implementation manners in the present invention, all other implementation manners obtained by those skilled in the art without creative efforts fall within the protection scope of the present invention.

Please refer to FIG. 1 to FIG. 5 , in one embodiment, a loading and unloading intelligent monitoring device specifically includes a housing 1 , a camera 2 , a processor 3 , a memory 4 , an alarm module 5 , a communication module 6 and a power supply module UPS.

Wherein, the housing 1 is installed on the edge of the dump truck between the head and the bucket, and the installation methods include but not limited to bolts, welding, and pasting. The camera 2 is half-embedded in one surface of the casing 1. When installing, the side without the camera 2 on the casing 1 faces the front of the vehicle, and the side embedded with the camera 2 faces the vehicle body, so that the exposed lens of the camera 2 faces the dump truck. bucket, so that the camera 2 can collect a complete image of the direction of the bucket.

Wherein, the processor 3, the memory 4, the communication module 6 and the alarm module 5 are installed inside the housing 1 and integrated on the main board, and the processor 3 is respectively connected to the memory 4, the communication module 6, the alarm module 5 and the camera 2 in communication, An image analysis module is deployed in the memory 4, and the processor 3 is used to run the image analysis module. The processor 3 controls the communication module 6, the alarm module 5 and the camera 2 by running the image analysis module, and controls the camera 2 by running the image analysis module. The acquired images were analyzed.

Wherein, when the processor 3 runs the image analysis module, it sends an image acquisition instruction to the camera 2, and the camera 2 is used to collect the image in the direction of the vehicle body when receiving the image acquisition instruction issued by the processor 3, and sends the collected image to the The processor 3 and the memory 4, so that the processor 3 can analyze the collected images, and the memory 4 can save the collected images.

The processor 3 is also used to analyze the collected images according to computer instructions and/or send the collected images to the cloud platform through the communication module 6; the communication module 6 is also used to receive the data sent by the cloud platform, and the communication module 6 can select Including but not limited to 2G\3G\4G wireless communication chip implementation. Based on this principle, the embodiment of the present invention can realize two loading and unloading intelligent monitoring processes:

In one embodiment, when the processor runs the image analysis module, the camera is controlled to collect the image in the direction of the vehicle body, and receives the image of the loading material or the image of the vehicle body returned by the camera, and at the same time, the processor requests the image of the target material from the cloud platform or the empty bucket image, and then the processor compares the similarity between the loading material image and the target material image to analyze whether the loading material is loaded correctly, or, the processor compares the similarity between the vehicle bucket image and the empty bucket image , to obtain the height of the material in the bucket image, and then analyze the full load rate of the dump truck according to the height of the material, so as to determine whether the loaded material is missing through the full load rate. The application process of this embodiment can be specifically explained as the following monitoring process one.

Monitoring process 1: When the processor 3 receives the signal that the dump truck is driving to the loading area, the processor 3 controls the camera 2 to collect images in the direction of the truck body, mainly collecting images of the loading material and the body of the truck, and the processor 3 communicates Module 6 requests the target material image of the current loading task from the cloud platform; the processor 3 compares the loading material image with the target material image through the built-in image recognition algorithm and image similarity comparison algorithm of the memory 4, and analyzes the current loading material image. Whether the material of material is wrong, if find that charging is wrong, then send alarm command in time to alarm module 5, make alarm module 5 send first alarm message, notify driver and charging worker, stop charging at once. When the processor 3 receives the signal confirming that the dump truck starts to move, the processor 3 requests the cloud platform for the empty bucket image of the current dump truck through the communication module 6, and the processor 3 uses the image recognition algorithm built in the memory 4 and the image similarity ratio For the algorithm, compare the bucket image with the empty bucket image, analyze whether the loading is full according to the current loading height, if it is found that the loading is not enough, then send an alarm command to the alarm module 5 in time, so that the alarm module 5 sends the first 2. Alarm information to inform the driver to stop and return to the loading place to continue loading.

In addition, in another embodiment, based on functions and connection modes of the camera, processor, memory, alarm module, and communication module, the second monitoring process can also be realized, which is explained in detail as follows.

Monitoring process 2: When the processor 3 receives the signal confirming that the dump truck has driven to the loading area, the processor 3 controls the camera 2 to collect images in the direction of the truck body, mainly collecting images of the loading material and the body of the truck; the processor 3 passes The communication module 6 sends the loading material image to the cloud platform, so that the cloud platform compares the loading material image with the target material image saved by itself based on its own preset image recognition algorithm and image similarity comparison algorithm, and analyzes the current loading material image. Whether the material of the material is wrong, if it is found that the material is wrong, the cloud platform returns the material error information to the communication module 6 in time, and the communication module 6 forwards the material error information to the processor 3, so that the processor 3 sends an alarm according to the material error information Command to alarm module 5, and then make alarm module 5 send the first alarm message, notify driver and charging worker, stop charging at once. When the processor 3 receives the signal that the dump truck starts to move, the processor 3 sends the body image to the cloud platform through the communication module 6, so that the cloud platform can perform the same task based on its own preset image recognition algorithm and image similarity comparison algorithm. Compare the bucket image with the empty bucket image saved by itself, and analyze whether the loading is full according to the height of the current loading. If it is found that the loading is not enough, the cloud platform will return the full filling information to the communication module 6 in time, and the communication module 6 will The filling dissatisfaction information is forwarded to the processor 3, so that the processor 3 sends an alarm command to the alarm module 5 according to the filling dissatisfaction information, and then the alarm module 5 sends a second alarm information to notify the driver to stop and return to the loading place to continue loading.

In the embodiment of the present invention, the processor 3 can choose embedded processors such as Raspberry Pi and STM32 with relatively low prices, and can also choose processors such as ARM9 series and x86 series with slightly higher computing power. If the output intelligent monitoring device for loading and unloading is in pursuit of lower cost, and thus chooses a lower-cost processor such as Raspberry Pi, STM32, etc., considering that the computing power of the processor itself is not high, you can use the above monitoring process 2 The proposed method process puts the calculation and analysis tasks on the powerful cloud platform to complete, and realizes the automatic supervision of loading and unloading by receiving the analysis results returned by the cloud platform, sacrificing the timeliness of a small number of intelligent monitoring devices. If the output intelligent monitoring device for loading and unloading chooses processors such as ARM9 series and x86 series with slightly higher prices in order to pursue higher alarm timeliness, the calculation and analysis tasks can be calculated and analyzed through the method process proposed in the above monitoring process 1 It is completed locally in the intelligent monitoring device for loading and unloading, reducing the waste of communication time and improving the timeliness of alarming.

Specifically, the alarm module 5 includes, but is not limited to, a voice alarm and a warning light, so as to remind the driver through voice and light to check the problem of wrong or insufficient filling.

Specifically, in one embodiment, the alarm module 5 can use a voice alarm, and correspondingly, the housing 1 also includes an opening, and the position of the opening corresponds to the installation position of the voice alarm inside the housing 1, so that Because the voice broadcast signal of the voice alarm is transmitted outward through the opening, the voice is clearer.

In addition, in this embodiment, after the alarm module 5 alarms, the driver needs to manually trigger the stop button on the intelligent monitoring device for loading and unloading to stop the alarm. button, processor 3 will send a reminder request to the cloud platform, so that the cloud platform will send a reminder message to the driver's mobile phone.

In addition, the power supply module UPS provided by the embodiment of the present invention is connected to the power output interface of the dump truck, and is connected to the camera 2, processor 3, memory 4, alarm module 5 and communication module 6 through the main board inside the housing 1. In this way, the intelligent monitoring device for loading and unloading is connected to the power supply circuit of the dump truck, and no additional battery is required to avoid the problem that the intelligent monitoring device for loading and unloading will stop working because the battery is dead.

Specifically, as shown in FIG. 2 and FIG. 3 , in one embodiment, the housing 1 further includes a fixing clip 7 , the two ends of the fixing clip 7 are opposite to each other, one end of which is connected to the housing 1 , and the connection method includes but not It is limited to sticking, welding, riveting and bolting, and the other end is not connected with the shell 1. Therefore, the end of the housing 1 that is not connected to the housing 1 is inserted downward on the edge of the vehicle body between the front and the vehicle body through the fixing clip 7, and the end connected to the housing 1 is inserted into the edge of the vehicle body. The position of the fixed clip 7 is connected with the shell 1 to generate an interactive clamping force between the fixed clip 7 and the shell 1, and the clamping force acts on the edge of the middle bucket, so that the intelligent monitoring device for loading and unloading can be firmly installed on the dump truck. When the device needs to be repaired and replaced, it only needs to be pulled out from the edge of the vehicle body without using other tools, which saves time and effort.

Specifically, in one embodiment, the intelligent monitoring device for loading and unloading provided by the embodiment of the present invention further includes a GPS positioning module 8 . The GPS positioning module 8 is located inside the casing 1 , installed on the main board, and communicated with the processor 3 . In this embodiment, the GPS positioning module 8 guides the driver according to the route planned by the cloud platform. The position of the dump truck can be monitored in real time by the GPS positioning module 8. When the dump truck deviates from its path or has other temporary tasks, the processor 3 will send an alarm message through the alarm module 5 to prompt the driver to travel according to the correct route, so as to better respond to the dump truck. Dump trucks are finely controlled.

Specifically, in one embodiment, the memory 4 provided by the embodiment of the present invention specifically includes an SD card 9 and a RAM storage chip 10, wherein the RAM storage chip 10 is used to read and cache computer instructions from the SD card 9, when processing When the device 3 executes the command, it directly reads the cache command from the RAM memory chip 10, so that the command codes such as control commands, navigation commands, and image analysis commands run more stably and read faster. When the navigation instruction, control instruction or image analysis instruction on the cloud platform changes, the cloud platform can issue the latest instruction to the communication module 6, and the communication module 6 replaces the old instruction in the SD card 9 with the latest instruction to realize loading and unloading. The system of the intelligent monitoring device is automatically upgraded. Among them, the SD card 9 is also used to store data other than computer instructions, including but not limited to the image data collected by the camera 2, the target material image and the empty bucket image issued by the cloud platform. The SD card 9 is taken out and quickly copied, realizing the quick review and analysis of the accident scene.

Specifically, in one embodiment, the above-mentioned communication module 6 specifically includes a 5G wireless data transmission terminal 11 (5G DataTransfer Unit, 5G DTU) and an antenna 12, and the 5G wireless data transmission terminal 11 is located inside the casing 1, serving as a link between the 5G network and the industry. The connection carrier of the equipment, the 5G capability provided by the 5G wireless data transmission terminal 11 can bring great improvements to multiple vertical industries such as the Internet of Vehicles and the Industrial Internet, reduce the difficulty of terminal development, enrich the selection of industrial field equipment, build customization capabilities, and help breakthroughs Industry terminal capability boundaries. Therefore, this embodiment realizes the communication connection between the device and the cloud platform based on 5G communication technology, which can significantly improve the transmission speed of image data and image analysis results, and make the alarm more timely. Wherein, the antenna 12 is connected to the 5G wireless data transmission terminal 11, and the antenna 12 is located outside the housing 1 and extends upwards from the installation position, so as to further enhance the communication signal of the device.

Specifically, in one embodiment, the casing 1 also includes a plurality of data expansion interfaces 13, the data expansion interfaces 13 are communicatively connected with the processor 3, and the data expansion interfaces 13 include but are not limited to USB interfaces, serial interfaces, parallel interfaces , Type-C interface to improve the ability to debug the intelligent monitoring device for loading and unloading from the outside.

Specifically, as shown in Figure 6, in one embodiment, the intelligent monitoring device for loading and unloading provided by the embodiment of the present invention also includes a transparent protective cover 14 and a rotating motor; It is connected with the power supply module UPS; the rotating shaft 15 of the rotating motor extends out of the casing 1 , and the transparent protective cover 14 is connected with the extended rotating shaft 15 and is covered outside the casing 1 .

Specifically, considering that dust usually occurs when materials are loaded into vehicles, it is easy to dirty the camera 2 of the intelligent monitoring device, affecting the monitoring effect. In order to solve this problem, the embodiment of the present invention adds a transparent protective cover 14 on the outside of the intelligent monitoring device, and a rotating motor is installed inside the intelligent monitoring device. The rotating shaft 15 of the rotating motor can extend out of the housing 1 of the intelligent monitoring device and extend to the on the protective cover 14. The position where the rotating shaft 15 protrudes as long as it does not block the camera 2 is sufficient. The rotating shaft 15 can be at the center of the casing 1 or slightly deviated from the center. This is not particularly limited in the embodiment of the present invention. In FIG. 6, the rotating shaft 15 is at the center Take the exact center of the housing 1 as an example. When the large truck is loading and unloading, the intelligent monitoring device will start the rotating motor through the processor 3, thereby rotating the transparent protective cover 14 through the rotating shaft 15. Because of the transparent property of the transparent protective cover 14, it does not affect the shooting of the camera 2. When the transparent protective cover 14 rotated, rely on the centrifugal force generated by the gravity of the dirty ash and the rotation, the dirty ash was thrown out to prevent the dirty ash from adhering to the protective cover. In this way, the shooting of the camera 2 is not affected, and the camera 2 can be stably and effectively prevented from getting dirty.

Specifically, as shown in Figure 7, in another embodiment, the intelligent monitoring device for loading and unloading provided by the embodiment of the present invention also includes a transparent protective cover 14 and a vibration motor 16; Vibration spring 17, housing 1 is connected with the inner wall of transparent protective cover 14 by shock-absorbing spring 17, and transparent protective cover 14 is covered outside housing 1; The lines are respectively connected to the processor 3 and the power supply module.

Specifically, in this embodiment, a circle of damping spring 17 is installed outside the housing 1 of the intelligent monitoring device, and the damping spring 17 is connected to the inner wall of the transparent protective cover 14, so that the transparent protective cover 14 can be hung outside the intelligent monitoring device . Then a vibrating motor 16 is installed in the inboard of transparent protective cover 14, and vibrating motor 16 is connected with processor 3 and power module UPS in the intelligent monitoring device respectively by signal line, and processor 3 is used for starting vibrating motor 16, and power module UPS is used for To supply power to the vibration motor 16. When the large truck is loading and unloading, the processor 3 turns on the vibrating motor 16, so that the dust cannot be attached to the transparent protective cover 14 under the condition of vibration, because the transparent protective cover 14 and the intelligent monitoring device are connected by the shock absorbing spring 17, so The vibration generated by the transparent protective cover 14 will not be transmitted to the intelligent monitoring device, so as to ensure that the camera 2 will not vibrate, thereby not affecting the normal shooting of the intelligent monitoring device. Based on the transparent property of the transparent protective cover 14, it will not affect the normal shooting of the camera 2 as well.

Through the cooperation of the above components, the technical solution provided by the application provides an intelligent monitoring device for loading and unloading, which includes a housing, a camera, a processor, a memory, an alarm module, a communication module and a power supply module; the housing Installed on the edge of the dump truck between the front and the truck body; the camera is half-embedded in the casing, and the exposed lens of the camera faces the dump truck body; the processor, memory, communication module and alarm module are installed in the casing Internally, the processor communicates with the memory, the communication module, the alarm module and the camera respectively; the image analysis module is deployed in the memory for image similarity comparison; when the processor runs the image analysis module, it controls the direction of the camera to the vehicle body. and receive the image of the loading material or the image of the bucket returned by the camera, and at the same time, the processor requests the image of the target material or the image of the empty bucket from the cloud platform, and then the processor compares the image of the loading material with the image of the target material Yes, to analyze whether the loading materials are loaded correctly, or, the processor compares the similarity between the bucket image and the empty bucket image to obtain the height of the material in the bucket image, and then analyze the full load rate of the dump truck according to the height of the material , to determine whether the loading material is missing through the full load rate; the alarm module is used to send an alarm message when receiving the alarm command from the processor; the power module is connected to the power output interface of the dump truck, and is connected to the camera, processor, The memory, the alarm module and the communication module are connected. Based on the device provided in this embodiment, if the aggregate is filled or wrongly loaded, the processor can send an alarm message in time through the alarm module to remind the driver that there is a problem with loading. On the one hand, it realizes the automatic supervision of dump truck loading and unloading. On the other hand, the structure of the device is not complicated. It only needs common parts such as core processor, camera, and communication module to realize it, which reduces the cost of the device. In addition, the processor can also send the collected image to the cloud platform through the communication module, so that the cloud platform can analyze and judge the image, and then the processor can receive the judgment result issued by the cloud platform through the communication module, and the processor no longer performs image analysis steps, thereby reducing the computing power requirements of the processor, enabling the use of lower-priced chips, and further reducing the overall cost of the device.

As shown in Figure 8, in one embodiment, the present invention also provides an intelligent monitoring method for loading and unloading, which is applied to the intelligent monitoring device for loading and unloading provided in the aforementioned device embodiment, and specifically includes the following steps:

Step S101: Establish a communication connection with the cloud platform.

Step S102: When the dump truck arrives at the loading location, collect the image of the loading material, and request the image of the target material from the cloud platform.

Step S103: Receive the target material image sent by the cloud platform, and compare the similarity between the loading material image and the target material image.

Step S104: If the result of the similarity comparison indicates a loading error, a first alarm message is issued.

Step S105: When the dump truck starts to move, collect the bucket image of the dump truck, and request the empty bucket image from the cloud platform.

Step S106: Receive the empty bucket image sent by the cloud platform, compare the bucket image with the empty bucket image, and obtain the material height in the bucket image.

Step S107: Analyze the full load rate of the dump truck according to the material height in the bucket image, and send a second alarm message when the full load rate is lower than the first preset threshold.

Specifically, the intelligent monitoring method for loading and unloading provided by the embodiment of the present invention corresponds to the first monitoring process in the foregoing device embodiment. After the loading and unloading intelligent monitoring device is installed on the dump truck, first establish a communication connection with the cloud platform through the communication module to ensure that the loading and unloading intelligent monitoring device operates normally and the network communication is normal. When the dump truck arrives at the loading location, the device collects the image of the loading material through the camera, and at the same time requests the image of the target material from the cloud platform. The cloud platform returns the target material image corresponding to the current loading task according to the request of the loading and unloading intelligent monitoring device. After receiving the target material image sent by the cloud platform, the loading and unloading intelligent monitoring device performs on-site comparison between the loading material image and the target material image. Analyze whether the material being loaded is consistent with the task material, including the color, particle size, surface texture, etc. of the material. Among them, the image similarity comparison algorithm operated by the loading and unloading intelligent monitoring device is preset in the SD card of the device. For example, the convolutional neural network can be used to extract the features of the two images, and then based on the squared The square root error of the value performs similarity analysis on the two images, thereby obtaining the material similarity of the two images. The image similarity analysis algorithm involved in this embodiment is a prior art, and the specific principles will not be repeated here. If the material similarity between the target material image and the loading material image is above 95%, the verification is passed. If the material similarity between the target material image and the loading material image is below 95%, the verification will not pass, and the first alarm message will be sent through the alarm module to notify the driver to conduct further manual verification to confirm whether the material is correct.

After loading, when the driver starts the dump truck and starts to move, the loading and unloading intelligent monitoring device collects the bucket image of the dump truck through the camera, and requests the empty bucket image from the cloud platform. The cloud platform responds to the request sent by the loading and unloading intelligent monitoring device, and returns the empty bucket image of the current model dump truck to the loading and unloading intelligent monitoring device. After the loading and unloading intelligent monitoring device receives the image of the empty bucket, it uses the image recognition algorithm preset in the memory (this embodiment uses a commonly used target recognition algorithm, such as the YOLO series algorithm, the specific content is the existing technology, and will not be repeated here) Compare and analyze the bucket image and the empty bucket image, for example, obtain the material target in the bucket image through the target recognition algorithm, and then calculate the material target in the bucket image according to the comparison between the material target in the bucket image and the empty bucket image Material height, and then calculate the full load rate of the dump truck. If the full load rate is not lower than the first preset threshold (for example, 95%), the verification is passed. If the full load rate is lower than the first preset threshold (for example, 95%), a second alarm message will be issued to remind the driver to stop and return to loading The location continues to load. Through the above steps, this embodiment realizes the automatic supervision of dump truck loading and unloading.

Specifically, in one embodiment, an intelligent monitoring method for loading and unloading provided by an embodiment of the present invention further includes the following steps:

Step 1: When the dump truck is moving, perform GPS positioning on the dump truck to obtain the location information of the dump truck.

Step 2: Send a navigation request to the cloud platform, and receive the loading and unloading route information sent by the cloud platform. The loading and unloading route information is the route information returned by the cloud platform based on the navigation request.

Step 3: Based on the location information of the dump truck and the loading and unloading route information, analyze whether the dump truck is off course, and send a third alarm message when the dump truck is off course.

Specifically, in this embodiment, based on the GPS positioning module, the loading and unloading intelligent monitoring device will also report information such as the position, speed, head orientation of the dump truck, and whether it is loaded or not when it is started. If the dump truck is not loaded with goods, the cloud platform will arrange the nearest material point according to the location of the dump truck, and send the transportation task to the intelligent monitoring device for loading and unloading. The transportation task includes the name of the material, loading location, unloading location, etc. After receiving the task, the loading and unloading intelligent monitoring device is connected to the voice system and navigation system of the cab of the dump truck to guide the driver to the destination. When the dump truck is moving, the GPS positioning module performs GPS positioning on the dump truck in real time to obtain the dump truck positioning information. And send a navigation request to the cloud platform to receive the loading and unloading route information returned by the cloud platform. After that, the loading and unloading intelligent monitoring device analyzes whether the dump truck is yaw based on the dump truck positioning information and loading and unloading route information. If the driver's driving route yaws, Then, through the alarm module, the third alarm message will be issued when the dump truck yaws, reminding the driver to return to the correct route, so as to better finely control the dump truck.

Specifically, in one embodiment, an intelligent monitoring method for loading and unloading provided by an embodiment of the present invention further includes the following steps:

Step 4: When the dump truck arrives at the unloading location, collect the body image of the dump truck, compare the body image with the empty bucket image, and obtain the material height in the body image.

Step 5: Analyze the unloading rate of the dump truck according to the height of the material in the bucket image, and send an unloading completion message when the unloading rate is higher than a second preset threshold.

Specifically, when the dump truck arrives at the unloading location, it monitors the unloading of the material in the bucket based on the unloading rate, analyzes whether the material is completely unloaded, and considers that the material has been unloaded when the unloading rate is higher than the second preset threshold , to send out the unloading completion message to remind the driver to proceed to the next transportation task. Specifically, the principle of analyzing the unloading rate according to the image of the truck body in this embodiment is the same as that of steps S105-S107. For specific explanations, please refer to the relevant descriptions of the foregoing embodiments, which will not be repeated here.

Specifically, in one embodiment, an intelligent monitoring method for loading and unloading provided by an embodiment of the present invention further includes the following steps:

Step 6: When the dump truck arrives at the loading site, start the rotating motor installed inside the casing of the intelligent monitoring device for loading and unloading, so as to extend the rotating shaft of the casing through the rotating motor to rotate the transparent protective cover connected to the rotating shaft.

Specifically, for an explanation of the principles of the intelligent monitoring method for loading and unloading provided in this embodiment, please refer to the relevant descriptions of the foregoing embodiments of the intelligent monitoring device for loading and unloading, and details are not repeated here.

Specifically, in one embodiment, an intelligent monitoring method for loading and unloading provided by an embodiment of the present invention further includes the following steps:

Step 7: When the dump truck arrives at the loading place, start the vibration motor on the transparent protective cover to make the transparent protective cover vibrate.

Specifically, for an explanation of the principles of the intelligent monitoring method for loading and unloading provided in this embodiment, please refer to the relevant descriptions of the foregoing embodiments of the intelligent monitoring device for loading and unloading, and details are not repeated here.

Through the above steps, the technical solution provided by this application provides an intelligent monitoring device for loading and unloading, which includes a housing, a camera, a processor, a memory, an alarm module, a communication module and a power module; the housing is installed on the front of the dump truck The edge of the truck body between the truck body and the truck body; the camera is half-embedded in the casing, and the exposed lens of the camera faces the dump truck body; the processor, memory, communication module and alarm module are installed inside the casing, and the processors are respectively It communicates with the memory, communication module, alarm module and camera; an image analysis module is deployed in the memory for image similarity comparison; when the processor runs the image analysis module, it controls the camera to collect images in the direction of the vehicle body, And receive the loading material image or bucket image returned by the camera, and at the same time, the processor requests the target material image or empty bucket image from the cloud platform, and then the processor compares the loading material image with the target material image to analyze the loading Whether the truck material is loaded correctly, or, the processor compares the similarity between the bucket image and the empty bucket image to obtain the height of the material in the bucket image, and then analyzes the full load rate of the dump truck according to the material height, so as to pass the full load rate Determine whether the loading material is missing; the alarm module is used to send an alarm message when receiving an alarm command from the processor; the power module is connected to the power output interface of the dump truck, and is connected to the camera, processor, memory, alarm module and Communication module connection. Based on the device provided in this embodiment, if the aggregate is filled or wrongly loaded, the processor can send an alarm message in time through the alarm module to remind the driver that there is a problem with loading. On the one hand, it realizes the automatic supervision of dump truck loading and unloading. On the other hand, the structure of the device is not complicated. It only needs common parts such as core processor, camera, and communication module to realize it, which reduces the cost of the device. In addition, the processor can also send the collected image to the cloud platform through the communication module, so that the cloud platform can analyze and judge the image, and then the processor can receive the judgment result issued by the cloud platform through the communication module, and the processor no longer performs image analysis steps, thereby reducing the computing power requirements of the processor, enabling the use of lower-priced chips, and further reducing the overall cost of the device.

Although the embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art can make various modifications and variations without departing from the spirit and scope of the present invention, and such modifications and variations all fall into the scope of the appended claims. within the limited range.

Claims (10)

1. An intelligent monitoring device for loading and unloading, characterized in that the device comprises a housing, a camera, a processor, a memory, an alarm module, a communication module and a power supply module; The housing is installed on the edge of the dump truck between the head and the bucket; The camera is half-embedded on the housing, and the exposed lens of the camera faces the bucket of the dump truck; The processor, the memory, the communication module and the alarm module are installed inside the housing, and the processor is respectively connected in communication with the memory, the communication module, the alarm module and the camera; An image analysis module is deployed in the memory for image similarity comparison; when the processor runs the image analysis module, it controls the camera to collect images in the direction of the vehicle body, and receives the returned image from the camera. The image of the loading material or the image of the bucket, and at the same time, the processor requests the image of the target material or the image of the empty bucket from the cloud platform, and then the processor performs a similarity comparison between the image of the loading material and the image of the target material, To analyze whether the loading material is loaded correctly, or, the processor compares the similarity between the bucket image and the empty bucket image to obtain the material height in the bucket image, and then according to the material height Analyze the full load rate of the dump truck to determine whether the loading material is missing through the full load rate; The alarm module is configured to send alarm information when receiving an alarm instruction from the processor; The power module is connected with the power output interface of the dump truck, and connected with the camera, processor, memory, alarm module and communication module respectively. 2. The device according to claim 1, characterized in that, the housing further includes a fixing clip, and for the two opposite ends of the fixing clip, one end is connected with the housing, and the other end is not connected with the said fixing clip. The casing is connected, and the unconnected end of the casing is plugged on the edge of the vehicle body between the vehicle head and the vehicle body through the unconnected end of the fixing clip. 3. The device according to claim 1, characterized in that, the device further comprises a transparent protective cover and a rotating motor; the rotating motor is installed inside the casing, and is connected to the processor and the power module respectively. connection; the rotating shaft of the rotating motor extends out of the casing, and the transparent protective cover is connected with the extended rotating shaft and covered outside the casing. 4. The device according to claim 1, characterized in that, the device also comprises a transparent protective cover and a vibrating motor; a plurality of damping springs are arranged along the circumference of the side of the housing, and the housing passes through the The shock-absorbing spring is connected with the inner wall of the transparent protective cover, and the transparent protective cover is covered outside the housing; the vibration motor is installed inside the transparent protective cover, and communicates with the processor and the The power module is connected. 5 . The device according to claim 1 , further comprising a GPS positioning module, the GPS positioning module is located inside the casing and communicated with the processor. 5 . 6. An intelligent monitoring method for loading and unloading, characterized in that it is applied to an intelligent monitoring device for loading and unloading, the method comprising: Establish a communication connection with the cloud platform; After the dump truck arrives at the loading location, collect the loading material image, and request the target material image to the cloud platform; receiving the target material image sent by the cloud platform, and comparing the similarity between the loading material image and the target material image; If the similarity comparison result represents a charging error, the first alarm message is issued; When the dump truck starts to move, collect the bucket image of the dump truck, and request the empty bucket image to the cloud platform; receiving the empty bucket image sent by the cloud platform, and comparing the bucket image with the empty bucket image to obtain the material height in the bucket image; The full load rate of the dump truck is analyzed according to the material height in the bucket image, and a second alarm message is issued when the full load rate is lower than a first preset threshold. 7. The method according to claim 6, further comprising: When the dump truck is moving, GPS positioning is performed on the dump truck to obtain the location information of the dump truck; Sending a navigation request to the cloud platform, and receiving the loading and unloading route information sent by the cloud platform, the loading and unloading route information is the route information returned by the cloud platform based on the navigation request; Analyzing whether the dump truck is off course based on the dump truck positioning information and the loading and unloading route information, and sending a third alarm message when the dump truck is off course. 8. The method according to claim 6, further comprising: When the dump truck arrives at the unloading location, collect the bucket image of the dump truck, compare the bucket image with the empty bucket image, and obtain the material height in the bucket image; The unloading rate of the dump truck is analyzed according to the material height in the bucket image, and when the unloading rate is higher than a second preset threshold value, an unloading completion message is sent. 9. The method of claim 8, further comprising: When the dump truck arrives at the loading site, start the rotating motor installed inside the housing of the loading and unloading intelligent monitoring device, so as to extend the rotating shaft of the housing through the rotating motor, so that the transparent protective cover connected to the rotating shaft turn. 10. The method according to claim 8, further comprising: After the dump truck arrives at the loading site, start the vibrating motor on the transparent protective cover to vibrate the transparent protective cover.

Images