WO2021121254A1

WO2021121254A1 - Fixed-site container inspection system

Info

Publication number: WO2021121254A1
Application number: PCT/CN2020/136735
Authority: WO
Inventors: 池浩塬
Original assignee: 上海撬动网络科技有限公司
Priority date: 2019-12-20
Filing date: 2020-12-16
Publication date: 2021-06-24
Also published as: CN110942461A

Abstract

A fixed-site container inspection system comprises a container truck location acquisition unit (10), an image acquisition and processing unit (20), a terminal processing unit (30), a data transmission unit (40) and a man-machine interaction unit (50).

Description

Fixed scene container inspection system

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office with an application number of 201911323007.6 on December 20, 2019. The entire content of this application is incorporated into this application by reference.

Technical field

This application belongs to the field of electronic technology applications, for example, it relates to a fixed scene container inspection system.

Background technique

With the progress of science and technology and the increase of national import and export trade, the logistics and transportation industry is in an environment of rapid development and increasing demand. The demand for container transportation is increasing year by year. Containers play an important role in maritime transportation. Fixed places such as storage yards and container yards still rely on container inspectors to manually inspect the boxes. The entire inspection process is cumbersome, the inspection time is longer, and there are high security risks, low efficiency and cumbersome processes. Seriously affect the efficiency of logistics in the digital and intelligent era. The technology based on computer vision has been unprecedentedly mature. If the technology of the Internet of Things and image processing can be used to automate the processing of the containers on the trucks, without manual operation, the fully automatic inspection of the containers can be realized.

Summary of the invention

The present application provides a fixed scene container inspection system. By using the system, automatic inspection of containers can be realized without manual operation.

A fixed scene container inspection system is provided, which includes a collection card position collection unit, an image collection and processing unit, a terminal processing unit, a data transmission unit and a human-computer interaction unit.

Description of the drawings

FIG. 1 is a schematic diagram of the system structure of a fixed scene container inspection system provided by an embodiment;

FIG. 2 is a schematic diagram of the use process of the fixed scene container inspection system provided by an embodiment;

Fig. 3 is a scene implementation diagram of a fixed scene container inspection system provided by an embodiment.

Detailed ways

The embodiments of the present application will be described below in conjunction with the drawings. In the following description, many details are presented. This application can be implemented without some of these details. The following description of the embodiments is only for showing an example of the present application to provide an understanding of the present application. This application is not limited to any specific configurations and algorithms proposed below, but covers any modification, replacement and improvement of elements, units and processes without departing from this application. In the following description, well-known structures and technologies are not shown in order to avoid unnecessary obscurity of the present application.

Example embodiments will now be described with reference, which can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein.

In addition, the described features, operating procedures, or characteristics can be combined in one or more embodiments in any suitable manner. The technical solutions of the present application can be practiced without one or more of the specific details, or other methods, components, devices, etc. can be used.

This embodiment is implemented on the premise of the technical solution of the present application, and the implementation mode and operation process are given, but the protection scope of the present application is not limited to the following embodiments.

As shown in Figure 1, the fixed scene container inspection system disclosed in this embodiment includes a collection card position collection unit 10, an image collection and processing unit 20, a terminal processing unit 30, a data transmission unit 40, and a human-computer interaction unit 50; The location acquisition unit 10 is set to control the entrance and exit of the truck; the human-computer interaction unit 50 is set to control image acquisition, and the Equipment Interchange Receipt (EIR) information display, instructs the driver to open the door, display the information of the container, and display the final The inspection results. The image acquisition and processing unit 20 is configured to collect the box image and transmit the box image to the terminal processing unit 30; the terminal processing unit 30 includes a sub-view image segmentation unit and a sub-component image inspection unit, and the sub-view image segmentation unit is set according to different The container image is divided into multiple parts of the container, and the sub-component image inspection unit is set to perform defect detection and inspection on the segmented parts. The inspection result of the box image is first associated with the container information, and then the data is passed The transmission unit 40 sends to the server; the data transmission unit 40 receives the container inspection result sent by the server, and displays the container inspection result through the human-computer interaction unit 50.

The truck position collection unit 10 is configured to control the up and down of the parking rod to control the in and out of the truck. The human-computer interaction unit 50 is configured to display EIR information, control the image acquisition processing unit 20 to acquire images, receive feedback information processed by the terminal to instruct the driver to open the box door, and obtain the final box inspection information. The image acquisition and processing unit 20 is configured to collect the box image and transmit the box image to the terminal processing unit 30; the terminal processing unit 30 includes a sub-view image segmentation unit and a sub-component image inspection unit. The sub-view image segmentation unit is based on different boxes. The container image is segmented into multiple parts of the container, and the sub-component image inspection unit performs defect detection and inspection on the segmented parts; the container image inspection result is associated with the container information, and then the container is transmitted through the data transmission unit 40 The information is sent to the server; the container inspection result sent by the server is received through the data transmission unit 40, and the container inspection result is displayed by the human-computer interaction unit 50. Wherein, the container information includes container type and container number.

The collection card position collection unit 10 includes a ground sensing coil A and a ground sensing coil B arranged at the start position and the end position of the lane, and a vehicle detector connected to the ground sensing coil A and the ground sensing coil B And two pairs of infrared radio switches arranged in sequence along the advancing direction of the lane, the ground sensing coil A and the ground sensing coil B are connected through the vehicle detector and the parking rod controller, and when the truck enters the lane or leaves the lane In this case, the ground sensing coil A or the ground sensing coil B generates a trigger signal and transmits it to the vehicle inspector, and the vehicle inspector transmits the trigger signal to the parking rod controller so that the The parking rod controller controls the up and down of the parking rod.

The pickup position collection unit 10 includes ground induction coils A and B arranged at the start and end positions of the lane, a vehicle detector connected to the inductance coil, and two pairs of infrared through-beam switches arranged in sequence along the advancing direction of the lane, The ground-sensing coil of the lane is connected to the parking rod controller through the car detector. When the truck enters the lane or leaves the lane, the ground-sensing coil generates a trigger signal and transmits it to the car detector, and the car detector transmits the signal to the parking rod controller. To control the ups and downs of the parking rod.

The image acquisition and processing unit 20 includes an image acquisition and processing server, an image acquisition device, and an image acquisition auxiliary device;

The image acquisition and processing server is connected to the human-computer interaction unit 50 through a network cable, and the image acquisition and processing server is configured to accept a shooting instruction sent by the human-computer interaction unit 50 and control the image acquisition and processing unit to shoot, And transmitting the shooting information to the terminal processing unit 30 through the data transmission unit, and the terminal processing unit 30 is set as an inspection container;

The image acquisition device is a high-definition camera, which is deployed on the gantry and parking pole, and is configured to receive control instructions from the image acquisition and processing server and to acquire images of all angles of the container;

The image capture auxiliary device is a device for assisting the image capture device to capture images in a dark environment, the image capture auxiliary device includes a light supplement device, wherein the light supplement device includes a flash, and the dark environment Including bad weather.

The human-computer interaction unit 50 includes a two-dimensional code interaction machine, the human-computer interaction unit 50 is connected to the image acquisition and processing unit, the human-computer interaction unit 50 issues control instructions, and the human-computer interaction unit 50 passes The data transmission unit 40 is connected to a terminal server, and the human-computer interaction unit 50 is configured to obtain necessary information. Through the display device of the two-dimensional code interactive machine, the EIR information of the equipment handover list of the container is displayed for the driver's Enter the site to confirm, so that the driver can change the information through the switch or mobile phone;

The two-dimensional code interactive machine is also set to interact with the driver after receiving the successful information of the container exterior photograph collection of the image acquisition device to instruct the driver to open the box door;

The two-dimensional code interactive machine is also set to receive the final inspection information of the container of the processing terminal, and set to display defect information and display payment information.

In an embodiment, the human-computer interaction unit 50 is further configured to display a container in-position signal.

In an embodiment, the image collection and processing unit 20 is further configured to collect container information and transmit the container information to the terminal processing unit 30.

Optionally, the image acquisition and processing unit 20 is a container inspection camera device installed at a fixed site.

Optionally, the box image collected by the image acquisition processing unit 20 includes multiple multi-angle box exterior images and box interior images.

The image acquisition and processing unit 20 is configured to acquire a box image, and the box image includes a plurality of multi-angle box exterior images and box interior images.

In one embodiment, the terminal processing unit 30 is configured to control the human-computer interaction unit 50 to instruct the driver to open the container door.

The terminal processing unit 30 is further configured to control the human-computer interaction unit 50 to display EIR information.

The terminal processing unit 30 is further configured to control the human-computer interaction unit 50 to display the case inspection result.

In one embodiment, the terminal processing unit 30 includes a sub-view image segmentation unit and a sub-component image inspection unit. The sub-view image segmentation unit divides a plurality of components of the container according to different container images, and the sub-component image inspection unit compares Perform defect detection and inspection on the multiple parts that are separated; if the integrity of the box can be recognized, the recognition result is displayed through the human-computer interaction unit 50, and the recognition result is sent to the server through the data transmission unit 40; if If the integrity of the box body cannot be recognized, the box body image is sent to the server through the data transmission unit 40.

In an embodiment, the terminal processing unit 30 is further configured to recognize container information, display the recognition result through the human-computer interaction unit 50, and send the recognition result to the server through the data transmission unit 40.

In one embodiment, after the terminal processing unit 30 receives the container inspection result sent by the server, if the container inspection result is qualified, the payment procedure is initiated.

Optionally, the human-computer interaction unit 50 is composed of a touch screen, or a display screen and buttons.

The man-machine interaction unit 50 is also configured to display a container in-position signal.

The present application can effectively improve the inspection efficiency of the container, and the fully automatic inspection of the container can be realized without manual operation.

The following describes the fixed scene container inspection system disclosed in this embodiment.

Image acquisition and processing unit 20: includes an image acquisition and processing server, an image acquisition device, and an image acquisition auxiliary device. As an example and not limitation, the image acquisition unit is a container inspection camera installed in a fixed site, including front camera-left, front camera-right, rear camera-left, rear camera-right, front camera, top camera, and bottom camera. The camera obtains the front side photos of the cabinet-left, front side photos-right, back side photos-left, back side photos-right, door photos (outside), interior photos, top photos, bottom photos, and interior photos The body image is transmitted to the terminal processing unit 30. The image acquisition auxiliary device includes but is not limited to a flashlight.

Terminal processing unit 30: As an example and not a limitation, it is composed of a storage medium and a processor. The processor is set to execute a program on the storage medium, and the program on the storage medium performs the following operations:

1. Determine the box type and box number; the choice of box type can be 20-foot standard container, 40-foot standard container, and 40-foot tall container.

2. Receive the box image of the container.

3. Control the human-computer interaction unit 50 to instruct the driver to open the container door.

4. The image preprocessing unit preprocesses the received box image, and the preprocessing includes algorithms such as image denoising and image enhancement.

5. The split-view image segmentation unit segments multiple parts of the container according to different box images.

6. The sub-component image inspection unit performs defect detection and inspection on the segmented multiple components.

7. The result of the box image inspection is correlated with container information such as box type and box number, and then sent to the server through the data transmission unit 40.

8. Receive the container inspection result sent by the server, and display the container inspection result through the human-computer interaction unit 50.

The data transmission unit 40: as an example and not a limitation, a Transmission Control Protocol/Internet Protocol (TCP/IP) protocol can be used to complete the data transmission between the container intelligent laboratory system and the server in a fixed scene.

The human-computer interaction unit 50: as an example and not a limitation, it may be composed of a touch screen, or a display screen and buttons. The user obtains the container in-position signal, EIR information and container inspection result by using the human-computer interaction unit 50.

The use process of the fixed scene container inspection system is as follows:

1. When in use, after transporting the container to the yard, the driver scans the two-dimensional code of the human-computer interaction unit 50 to obtain EIR information, and make changes to the information.

2. The driver opens the container door according to the instructions of the human-computer interaction unit 50 of the system.

3. The system automatically collects cabinet images.

4. The system associates the cabinet image with the cabinet information and sends it to the server.

5. The server inspects the container body and sends the container inspection result to the fixed scene container inspection system. According to requirements, the server can also send the container inspection results to a third party for review, such as the freight party or shipping company.

Check the container inspection results through the fixed scene container inspection system. If the inspection result of the container is intact, you can start the payment procedure and arrange the loading of the goods to be transported next time. If the inspection result of the container body is unrecognizable, the human-computer interaction unit 50 reminds the relevant personnel to re-collect the container body image. If the inspection result of the container body is unqualified, the truck driver will transport the container to the manual judgment area.

Claims

A fixed scene container inspection system includes: a collection card position acquisition unit, an image acquisition processing unit, a terminal processing unit, a data transmission unit and a human-computer interaction unit.
The system according to claim 1, wherein the collection card position collecting unit includes ground sensing coil A and ground sensing coil B arranged at the start position of the lane and the end position of the lane, and the ground sensing coil A and the ground sensing coil B are arranged at the start position of the lane and the end position of the lane. The vehicle detector connected to the ground sensing coil B and two pairs of infrared on-beam switches arranged in sequence along the advancing direction of the lane, the ground sensing coil A and the ground sensing coil B are connected through the vehicle detector and the parking rod controller When the truck enters the lane or leaves the lane, the ground sensing coil A or the ground sensing coil B generates a trigger signal and transmits it to the vehicle inspector, and the vehicle inspector transmits the trigger signal to the vehicle inspector. The parking rod controller is used to make the parking rod controller control the up and down of the parking rod.
The system according to claim 1, wherein the image acquisition processing unit includes an image acquisition processing server, an image acquisition device, and an image acquisition auxiliary device;

The image acquisition processing server is connected to the human-computer interaction unit through a network cable, and the image acquisition processing server is configured to accept shooting instructions sent by the human-computer interaction unit, control the image acquisition processing unit to shoot, and The shooting information is transmitted to the terminal processing unit through the data transmission unit, and the terminal processing unit is set as an inspection container;

The image acquisition device is a high-definition camera, which is deployed on the gantry and parking pole, and is configured to receive control instructions from the image acquisition and processing server and to acquire images of all angles of the container;

The image capture auxiliary device is a device for assisting the image capture device to capture images in a dark environment, the image capture auxiliary device includes a light supplement device, wherein the light supplement device includes a flash, and the dark environment Including bad weather.
The system according to claim 1, wherein the human-computer interaction unit comprises a two-dimensional code interaction machine, the human-computer interaction unit is connected to the image acquisition and processing unit, and the human-computer interaction unit issues control instructions, The human-computer interaction unit is connected to the terminal server through the data transmission unit, and the human-computer interaction unit is configured to obtain necessary information, and the display device of the two-dimensional code interaction machine displays the container's equipment transfer order EIR The information is used to confirm the arrival of the driver, so that the driver can change the information through the switch or mobile phone;

The two-dimensional code interactive machine is also set to interact with the driver after receiving the successful information of the container exterior photograph collection of the image acquisition device to instruct the driver to open the box door;

The two-dimensional code interactive machine is also set to receive the final inspection information of the container of the processing terminal, and set to display defect information and display payment information.
The system according to claim 1, wherein the image acquisition and processing unit is a container inspection camera device installed in a fixed site.
The system according to claim 1, wherein the image acquisition and processing unit is configured to acquire a box image, and the box image includes a plurality of multi-angle box exterior images and box interior images.
The system according to claim 1, wherein the image collection and processing unit is further configured to collect container information and transmit the container information to the terminal processing unit.
The system according to claim 1, wherein the terminal processing unit is configured to control the human-computer interaction unit to instruct the driver to open the container door.
The system according to claim 1, wherein the terminal processing unit is further configured to control the human-computer interaction unit to display EIR information.
The system according to claim 1, wherein the terminal processing unit is further configured to control the human-computer interaction unit to display the case inspection result.
The system according to claim 1, wherein the terminal processing unit includes a sub-view image segmentation unit and a sub-component image inspection unit, and the sub-view image segmentation unit is configured to multiply the container according to different container images. The sub-component image inspection unit is configured to perform defect detection and inspection on a plurality of segmented components, and when the integrity of the box is recognized, the recognition result is passed through the man-machine The interactive unit performs display, and sends the recognition result to the server through the data transmission unit, and sends the box image to the server through the data transmission unit when the integrity of the cabinet cannot be recognized.
The system according to claim 1, wherein the terminal processing unit is further configured to, after receiving the container inspection result sent by the server, start the payment procedure when the container inspection result is qualified .
The system according to claim 1, wherein the terminal processing unit is further configured to recognize container information, display the recognition result through the human-computer interaction unit, and pass the recognition result through the data transmission unit Send to the server.
The system according to claim 1, wherein the human-computer interaction unit is composed of a touch screen, or a display screen and buttons.
The system according to claim 1, wherein the human-computer interaction unit is further configured to display a container in-position signal.