WO2022089074A1

WO2022089074A1 - Inspection device and inspection method

Info

Publication number: WO2022089074A1
Application number: PCT/CN2021/118532
Authority: WO
Inventors: 李元景; 崔锦; 胡斌; 李金路; 林东; 李红涛; 刘春辉; 刘梦晨; 张清
Original assignee: 清华大学; 同方威视技术股份有限公司
Priority date: 2020-10-29
Filing date: 2021-09-15
Publication date: 2022-05-05
Also published as: CN114427878A

Abstract

An inspection device and an inspection method. The inspection device comprises: a main structure comprising an operating platform, the main structure being configured to support an object to be inspected, such that the object can be placed on the operating platform; an image acquisition device configured to acquire a video and/or photograph of the object and a video and/or photograph of the environment in which the inspection device is located; an intelligent measurement device configured to acquire a measurement parameter of the object; a communication device configured to exchange data with a remote server; and a main control device configured to control the image acquisition device, the intelligent measurement device and the communication device, and to process the acquired videos and/or photographs, the measurement parameter and the exchanged data.

Description

Inspection device and inspection method

technical field

The present disclosure relates to the technical field of inspection, and in particular, to an inspection device and an inspection method for customs inspection.

Background technique

At present, during the inspection of customs items, it is necessary to weigh, measure the temperature, check the items and take photos of a single item. At present, the above work is basically carried out manually, including traditional weighing table weighing, manual reading of hand-held thermometers, checking of artificial objects based on experience, and operators holding camera equipment to take pictures.

The current customs inspection work has the following problems:

1. The application efficiency of inspection equipment is not high, and it is difficult to meet the requirements of customs prevention and control of security access risks under the new situation. The inspection method is mainly manual inspection, and the data needs to be manually entered into the system. Among them, there are many links of human intervention, which has a great impact on the rigor of the data and is not conducive to further improving the efficiency of supervision inspection;

2. Insufficient informatization support, using traditional weighing and temperature measuring equipment for measurement and manual item identification cannot achieve information integration and interconnection; at the same time, manual judgment on item types, trademark infringement, etc. relies too much on operation Personal experience of personnel, lack of unified judgment standards;

3. There is no unified standard. When the operator takes pictures of objects, the camera angle and background are relatively random. There is no uniform standard for parameters such as object angle, direction, and light. Some details are not clearly displayed in the photos, which is not conducive to the later application of informatization construction.

To sum up, it is necessary to apply automatic measurement and artificial intelligence technology to the inspection of customs articles, reduce manual intervention and work intensity, improve work efficiency, and promote the informatization construction of customs inspection.

SUMMARY OF THE INVENTION

Some embodiments of the present disclosure provide an inspection device, the inspection device includes: a main structure, including an operation platform, configured to carry an object to be inspected, so that the object to be inspected is placed above the operation platform; an image acquisition device, Configured to collect video and/or photos of the object to be inspected, as well as video and/or photos of the environment where the inspection device is located; an intelligent measurement device, configured to collect measurement parameters of the object to be inspected; a communication device, configured to communicate data with a remote server interaction; and a main control device, configured to control the image acquisition device, the intelligent measurement device, and the communication device, and to process the captured video and/or photos, measurement parameters, and the interaction data.

In some embodiments, the intelligent measuring device includes an automatic weighing device, the automatic weighing device is arranged on the operating platform and used to measure the actual weight of the object to be inspected, the inspection device is configured to weigh the object to be inspected The actual weight is compared with the total weight of the declared goods in the declaration information and/or the marked weight on the packaging of the inspected object. If the marked weights do not match, the inspection device will issue an alarm.

In some embodiments, comparing the actual weight of the inspected object with the total weight of the declared goods in the declaration information includes: multiplying the measured average actual weight of the inspected object in one or several packages by the package in the declaration information The product after the quantity is compared with the total weight of the declared goods in the declaration information to determine whether it is close.

In some embodiments, the image capture device includes a first camera device, the first camera device is disposed on the top of the main structure, and is configured to capture video and/or video of the object under inspection located above the operating platform Photo, the video and/or photo of the object to be inspected is the video and/or photo of the package of the object to be inspected or the items in the package.

In some embodiments, the main structure further includes: a column, one end of the column is fixed on the operating platform, and the column can be determined according to the size of the object to be inspected or the clarity of the photos and/or videos taken by the image acquisition device The extension part extends from the top of the upright in a direction parallel to the operation platform, and the first camera device is fixed on the extension part.

In some embodiments, the inspection device further includes a storage device, a database is built in the storage device, and the inspection device compares the video and/or photo of the object to be inspected collected by the first camera device with data The application information is queried and compared with the videos and/or photos retrieved in the database and the analysis results are output, and/or the inspection device collects the video and/or the packaging of the inspected object collected by the first camera device. or photos to identify and obtain relevant information, the inspection device compares the relevant information with the corresponding information in the declaration information of the inspected object and outputs an analysis result.

In some embodiments, the communication device is configured to interact data with a remote server to update the database of the storage device.

In some embodiments, a database is built in the remote server, and the remote server compares the video and/or photo of the inspected object collected by the first camera device with the data retrieved from the database according to the declaration information. The video and/or photo is queried and compared and the analysis result is output, and/or the remote server identifies the video and/or photo of the packaging of the inspected object collected by the first camera device and obtains relevant information, The remote server compares the relevant information with the corresponding information in the declaration information of the inspected object and outputs an analysis result, and the communication device is configured to transmit the video of the inspected object between the remote server and the inspection device and/or photographs and analysis results.

In some embodiments, the video and/or photo of the inspected object includes at least one of an appearance image, a trademark image, a label information image, a transportation sign image, a hazardous chemical identification image, a box number image, and a seal image of the inspected object. A sort of.

In some embodiments, the image acquisition device includes a second camera device, the second camera device is disposed above the operating platform, and is configured to capture video and/or photos of the environment where the inspection device is located for on-site use record.

In some embodiments, the communication device is configured to transmit video and/or photos of the environment in which the interrogation device is located, captured by the second camera device, to the remote server.

In some embodiments, the videos and/or photos of the environment where the inspection device is located and collected by the second camera device include: videos and/or photos of an operator performing inspection work.

In some embodiments, the intelligent measurement device includes a non-contact temperature measurement device configured to collect the temperature of the object under inspection located above the operating platform, and if the collected temperature exceeds a predetermined range, the inspection device issues an alarm.

In some embodiments, the inspection device further includes a human-computer interaction device configured to perform human-computer interaction between the inspection device and an operator, wherein the main control unit is further configured to control the human-computer interaction device, and processing data and/or signals from the human-computer interaction device, the human-computer interaction device comprising a display device configured to display a video and/or photo of the object to be interrogated captured by the image capture device , at least one of analysis results, and operational recommendations.

Some embodiments of the present disclosure provide an inspection method, using the inspection device described in the preceding embodiments, wherein the inspection method includes: placing an object to be inspected on the inspection device; using the image acquisition device to capture the inspection object The video and/or photo of the object and the video and/or photo of the environment where the inspection device is located; the intelligent measurement device is used to collect the measurement parameters of the inspected object; the main control unit is used to control the communication device to perform data interaction with a remote server.

In some embodiments, using the main control unit to control the communication device to perform data interaction with a remote server includes: converting the collected video and/or photo of the object to be inspected and the video and/or video of the environment where the inspection device is located. The photos and the collected measurement parameters of the inspected object are uploaded to the remote server; the collected videos and/or photos of the inspected object are queried and compared in the database in the remote server, and the analysis results are output and fed back to the remote server. the inspection device.

In some embodiments, the image capturing device includes a first camera device, the video and/or photo of the inspected object includes a package identification image, and the inspection method includes: capturing the inspected object through the first camera device the package identification image; determine whether the package information extracted from the package identification image is consistent with the declared information, and if the result is no, an alarm is issued.

In some embodiments, the video and/or photo of the inspected object further includes an appearance image of the item in the package, and the inspection method further includes: if the package information extracted from the package identification image is consistent with the declared information, pass The first camera device collects the appearance image of the item in the package of the inspected object; and query and compare the collected appearance image of the item in the package with the video and/or photo retrieved in the database according to the declaration information, if If the two do not match, an alert is raised.

In some embodiments, the inspection method further includes: when the video and/or photo captured by the image capture device is not clear, the inspection device provides a suggestion for adjusting the image capture height, so as to improve the quality of the capture. Check the clarity of the subject's video and/or photo.

Description of drawings

In order to illustrate the technical solutions of the embodiments of the present disclosure more clearly, the accompanying drawings of the embodiments will be briefly described below. It should be understood that the drawings described below only relate to some embodiments of the present disclosure, but not to the present disclosure. restrictions, where:

1 is a structural block diagram of an inspection apparatus according to some embodiments of the present disclosure;

FIG. 2 is a schematic structural block diagram of an inspection apparatus according to some embodiments of the present disclosure;

3 is a schematic side view of an inspection device according to some embodiments of the present disclosure;

4 is a flowchart of a checker method according to some embodiments of the present disclosure.

Detailed ways

In order to more clearly illustrate the objectives, technical solutions and advantages of the present disclosure, the embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. It should be understood that the following description of the embodiments is intended to explain and illustrate the general concept of the present disclosure, and should not be construed to limit the present disclosure. In the specification and drawings, the same or similar reference numbers refer to the same or similar parts or components. For the purpose of clarity, the drawings are not necessarily to scale and some well-known components and structures may be omitted from the drawings.

Unless otherwise defined, technical or scientific terms used in this disclosure shall have the ordinary meaning as understood by one of ordinary skill in the art to which this disclosure belongs. As used in this disclosure, "first," "second," and similar terms do not denote any order, quantity, or importance, but are merely used to distinguish the various components. The wording "a" or "an" does not exclude a plurality. "Comprises" or "comprising" and similar words mean that the elements or things appearing before the word encompass the elements or things recited after the word and their equivalents, but do not exclude other elements or things. Words like "connected" or "connected" are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "Up", "Down", "Left", "Right", "Top" or "Bottom" are only used to indicate relative positional relationship. When the absolute position of the described object changes, the relative positional relationship may also correspond to to change. When an element is referred to as being "on" or "under" another element, it can be "directly on" or "under" the other element or intervening elements may be present.

Some embodiments of the present disclosure provide an inspection device, which includes: a main structure, an image acquisition device, an intelligent measurement device, a communication device, and a main control device. The main structure includes an operation platform, which is configured to carry the object to be inspected, so that the object to be inspected is placed above the operation platform; the image acquisition device is configured to collect the video and/or photos of the object to be inspected and the environment where the inspection device is located; intelligent The measurement device is configured to collect measurement parameters of the object to be inspected; the communication device is configured to perform data interaction with a remote server; the main control device is configured to control the image acquisition device, the intelligent measurement device, and the communication device, and monitor the collected video and data. /or photographs, measurement parameters, and data of the interaction are processed.

The use of the above inspection device can improve the work efficiency of customs inspection and meet the requirements of customs prevention and control of security access risks under the new situation. Various data and parameters of the inspected object are automatically collected, and the collected data and parameters can be automatically uploaded and recorded to the remote server, with fewer human interventions, which can further improve the efficiency of supervision and inspection.

The above-mentioned inspection device can also realize the integration and interconnection of information; try to reduce or avoid manual judgment on the type of goods, trademark infringement, etc., the inspection process has a high consistency of judgment standards, and minimize or avoid relying too much on the personal experience of customs officers.

FIG. 1 is a structural block diagram of an inspection apparatus according to some embodiments of the present disclosure. As shown in FIG. 1 , the inspection device 100 includes an image acquisition device 10 , an intelligent measurement device 20 , a communication device 30 and a main control device 40 .

The image capture device 10 is configured to capture video and/or photos of the object being inspected and/or the environment in which the inspection device 100 is located. The image acquisition device 10 includes, for example, but is not limited to, a camera, a camera that can be raised and lowered, an infrared thermal phaser, and the like. The video and/or photos of the inspected object include but are not limited to the appearance image, trademark image, label information image, transportation sign image, hazardous chemical identification image, box number image, seal image, etc. of the inspected object. Among them, in some embodiments, the trademark image, label information image, transportation logo image, hazardous chemical identification image, box number image, seal image, etc. can be obtained by collecting the outer packaging of the inspection object, which can be collectively referred to as packaging identification images. The video and/or photo of the environment in which the inspection device 100 is located includes, but is not limited to, images and/or video of the operator's operation.

The intelligent measurement device 20 is configured to collect measurement parameters of the object under investigation. The intelligent measuring device 20 includes, but is not limited to, an automatic weighing device, a non-contact temperature measuring device, such as an infrared temperature measuring device, and the like. The measurement parameters of the inspected object include but are limited to the weight, temperature and the like of the inspected object.

The communication device 30 is configured for data interaction with the remote server. The communication device 30 includes, but is not limited to, a network switch, a router, a wireless communication device, a wired communication device, and the like.

The main control device 40 is configured to control the image capture device 10 , the intelligent measurement device 20 and the communication device 30 , and to process the captured video and/or photos, measurement parameters, and the interactive data. The main control device 40 includes, but is not limited to, a processor, an industrial computer, and the like.

In some embodiments, as shown in FIG. 1 , the inspection device 100 may further include a human-computer interaction device 50 configured to perform human-computer interaction between the inspection device 100 and the operator. For example, receiving the operation instructions of the operator, outputting or displaying the inspection results, displaying various data images in the inspection process, etc. The human-computer interaction device 50 includes, but is not limited to, a voice interaction system, a touch display screen, voice intercom and broadcasting, touch buttons, sound and light prompting warning lights, and the like.

In some embodiments, as shown in FIG. 1 , the inspection device 100 may further include a detachable additional detection device 70 , and the additional detection device 70 can be conveniently connected to the inspection device 100 through a reserved interface on the inspection device 100 . The additional detection device 70 may include, but is not limited to, various types of inspection technology equipment such as Raman, rapid screening of polymer components, detection of harmful element content, etc., which can realize the radioactivity of items (that is, the radioactivity detection of the inspected object itself), abnormal smell , inclusion content, appearance properties, etc. to identify. Those skilled in the art can understand that the additional detection device 70 is not necessary, and it can be conveniently connected to the inspection device 100 when a specific detection is required.

In some embodiments, as shown in FIG. 1 , the inspection device 100 may further include a power supply device 60 that provides power and performs power management for various components of the inspection device 100 . The power supply device 60 includes, but is not limited to, a battery pack, a battery pack management module, a battery charging module, a power supply module, and a power exchange module.

FIG. 2 shows a schematic structural diagram of an inspection apparatus according to some embodiments of the present disclosure, and FIG. 3 shows a side view of the inspection apparatus according to some embodiments of the present disclosure. 1-3, the inspection device 100 includes a main body structure 80. The main body structure 80 is, for example, a table body structure, including support legs and an operation platform 81 supported by the support legs. The operation platform 81 includes but is not limited to flat plates, grids, Multiple parallel strips, etc. The operating platform 81 is configured to carry the object to be inspected such that the object to be inspected is placed above the operating platform. The main structure 80 also includes an accommodating space, which is located below the operation platform 81 and used for accommodating the electric control box 82 . The electric control box 82 is used for accommodating the aforementioned communication device 30 , the main control device 40 , the power supply device 60 and the like.

The intelligent measuring device 20 of the inspection device 100 includes an automatic weighing device 21. The automatic weighing device 21 is fixed on the operation platform 81 of the main structure 80 for automatically recognizing the actual weight of the inspected object placed thereon, and automatically. The weighing device 21 can be controlled by the main control device 40, and the main control device 40 can perform processing such as storage, transmission, compression, etc. on the weight information collected by the automatic weighing device 21. For example, the main control device 40 can control the communication device 30 to automatically The weight information collected by the weighing device 21 is uploaded to the remote server. The operator only needs to place the object to be inspected on the automatic weighing device 21 to realize the automatic collection and entry of the weight of the object to be inspected, which avoids the operator using a separate weighing device, such as an electronic scale, in the related art to obtain the object to be inspected. After checking the weight of the object, a manual input step is required, which reduces the steps of manual intervention, reduces the probability of errors, and is simple to operate, thereby improving the working efficiency of the checking.

In some embodiments, the inspection device 100 may compare the actual weight of the inspected object measured by the automatic weighing device 21 with the total weight of the declared goods in the declaration information and/or the marked weight on the package of the inspected object, if If the actual weight does not match the total weight of the declared goods in the declared information and/or the marked weight on the package of the inspected object, the inspection device 100 will issue an alarm.

Specifically, comparing the actual weight of the inspected object with the total weight of the declared goods in the declaration information includes: multiplying the measured average actual weight of the inspected object in one or several packages by the number of packages in the declaration information. The product is compared with the total weight of the declared goods in the declaration information to determine whether it is close. If it is not close, it is determined that the actual weight of the inspection object does not match the total weight of the declared goods in the declaration information, and the inspection device 100 issues an alarm.

Inspection device 100 also includes upright 83 and extension 831 . One end of the upright post 83 is fixed on the operating platform, and the upright post 83 can be extended and retracted to adjust the height; the extension portion 831 extends from the top of the upright post 83 in a direction parallel to the operating platform. In some embodiments, the upright column 83 is perpendicular to the operation platform 81 on the base plate.

The image capture device 10 includes a first camera device 11, such as a high-definition camera. The first camera device 11 is disposed on the top of the main body structure 80 . In some embodiments, the first camera device 11 is fixed on the side of the extension portion 831 facing the automatic weighing device 21 , and is used for photographing or taking pictures of the inspected object placed on the automatic weighing device 21 by the operator. Video recording, collecting video and/or photos of the object under inspection. In one embodiment, the height of the column 83 can be adjusted, so that the distance between the first camera device 11 and the object to be inspected can be adjusted, so that the first camera device 11 can capture clear video and/or photos of the object to be inspected. Since the orientations of the first camera 11 and the automatic weighing device 21 are relatively fixed, the shooting environment such as the shooting angle and the shooting distance of the first camera 11 when acquiring the image of the inspected object located on the automatic weighing device 21 is relatively fixed, The obtained images of the inspected object have clear details and good consistency. It avoids that in the prior art, when the operator uses an independent handheld photographing device to obtain the image of the object to be inspected, the photographing angle and background are relatively random, and the photographing angle, direction, light and other photographing environment parameters are not uniform. Some details are displayed in the image. Unclear and other issues. Furthermore, the image capture device 10 including the first camera device 11 may be controlled by the main control device 40, and the main control device 40 may perform operations such as storage and transmission of the video and/or photos of the object under inspection captured by the first camera device 11. , compression, etc. The operator only needs to place the inspected object on the automatic weighing device 21 to realize the automatic collection and entry of the video and/or photos of the inspected object, avoiding the use of stand-alone photographing equipment, such as a hand-held camera, in the related art. After the image of the object to be inspected is acquired, a manual input step is required, which reduces the steps of manual intervention, reduces the probability of errors, and is easy to operate, thereby improving the work efficiency of the inspection.

Generally speaking, the inspected object includes the package and the goods inside the package, and the video and/or photo of the inspected object includes the video and/or photo of the inspected object's package or the items in the package. The inspection device 100 uses the first camera device 11 to first acquire images of key parts (such as parts with item label information) on the packaging of the inspected object, such as packaging identification images (text labels, barcodes, two-dimensional codes, etc.), Identify the image to obtain the various information it claims (for example, item type, trademark information, label information, logo information, origin information, net weight), and the declaration information on the customs declaration (for example: item type, trademark information, label information) , logo information, origin information, the total weight of the goods loaded in the container, the number of packages) are directly compared to determine whether they are consistent, or conversion comparison is performed to determine whether they are consistent (for example, multiply the claimed net weight of the packaged goods to be inspected by According to the quantity on the customs declaration form, judge whether the product is close to the total weight of the goods loaded in the container on the customs declaration form, if it is close, it is judged to be consistent). If sufficient label information on the packaging is not collected, the operator can be informed to adjust the posture of the packaging through the human-computer interaction device 50, so that the operator can move the packaging box or even turn the packaging box so that the other side is aligned with the first camera device 11; If the image on the package captured by the first camera device 11 is not clear, the inspection device 100 can give the operator an operation suggestion for raising or lowering the height of the upright 83 through the human-computer interaction device 50, so that the first camera can be adjusted. The distance between the device 11 and the object under investigation.

After the collected label image on the package is sufficient and clear, the inspection device 100 compares the captured image with the declaration information on the customs declaration. If the collected information on the package is consistent with the declaration information in the customs declaration, the inspection device 100 may notify the operator to perform the next operation; if not, an alarm will be issued to notify the operator and the remote server.

After the inspection device 100 has checked the package information, such as the item label information, the operator opens the package of the inspected object so that the first camera device 11 can capture images of the items in the package. If the first camera device 11 cannot capture a complete and clear image of the object to be inspected, the inspection device 100 can give the operator an operation suggestion for raising or lowering the height of the column 83 through the human-computer interaction device 50, so that the first camera can be adjusted. The distance between a camera device 11 and the object under inspection enables the first camera device 11 to obtain a complete and clear image of the object under inspection. Then, according to at least one of the declared information of the inspected object (such as item type, trademark information, origin information), the image or video of the standard item corresponding to the declared object of the inspected object is retrieved, and then the photographed image or video of the inspected object is retrieved. The image is intelligently compared with the video and/or photo of the corresponding standard item retrieved in the database to automatically determine whether the appearance of the inspected object is consistent with the appearance of the standard item retrieved according to the declaration information, and if not, an alarm will be issued to notify the operation host and remote server.

Taking judging whether the inspected object is consistent with the declared item type as an example, in the related art, in the past, the judgment of whether the inspected object is consistent with the declared item type is usually manually judged by customs operators based on their experience. It relies too much on the personal experience of the operator and lacks a unified judgment standard. However, in the practice of customs inspection, different kinds of items may have similar appearance with only slight differences. For example, different species of chilled fish may have a similar appearance but vary widely in value and in tariffs. Some criminals will declare high-value chilled fish as low-value chilled fish to evade tariffs and obtain improper benefits. Only relying on the personal experience of the operator to judge the types of items to be inspected will inevitably lead to mistakes and cause losses to the country.

However, in some embodiments of the present disclosure, the obtained video or image of the image of the inspected object is intelligently compared with the video or image of the same item previously stored in the database, so as to automatically determine and identify the item type of the inspected object, The manual judgment based on experience is avoided, the error probability is reduced, the operation is simple, and the work efficiency of the inspection is improved.

Specifically, in some embodiments of the present disclosure, a database storing specific information of various items is constructed. The specific information of various articles includes, for example, the appearance information, trademark information, label information, transportation sign information, hazardous chemical identification information, box number information, seal information, etc. of the article. When the object to be inspected is inspected, the database may query and compare the video and/or photo of the object to be inspected collected by the first camera device, and output an analysis result. Specifically, taking judging whether the inspected object is consistent with the declared item type as an example, the database receives customs declaration item information including the inspected object and the video and/or photo of the inspected object collected by the first camera device 11 . The video or image information corresponding to the customs declaration item information of the inspected object is searched in the database, and comprehensively compared with the video and/or photos of the inspected object collected by the first camera device 11, for example, a specific comparison video And/or the color, relative positional relationship, etc. of the corresponding pixel points and/or pixel areas in the photo. And give specific analysis results back to the operator. The specific analysis result is, for example, that the inspected object is consistent with its corresponding declared item type, or, for example, the inspected object is inconsistent with its corresponding declared item type. The specific analysis result can be fed back to the operator by the human-computer interaction device 50 .

In some embodiments, the inspection device 100 further includes a storage device, which may also be accommodated in the electrical control box 82. The database may be a local database, built into the storage device of the inspection device 100 . At this time, the inspection apparatus 100 can complete the inquiry and comparison of the video or image of the image of the inspected object, and output the analysis result, which does not require high networking. The communication device 30 can enable the inspection device 100 to exchange data with a remote server, for example, the remote server is set in the central control center of the customs and other units. The local database in the ping device 100 may be updated by the communication device 30 periodically or irregularly based on the database in the remote server. In order to improve the accuracy of the query and comparison of the video or image of the image to be inspected by the local database in the inspection device 100 .

In some embodiments, the database is constructed in a remote server, the inspection device 100 does not set up a local database locally or does not enable the local database under good networking conditions, and the video or image of the image of the inspected object obtained by the first camera device 11 is obtained by The communication device 30 transmits it to the remote server, searches the database in the remote server for the video or image information corresponding to the customs declaration item information of the inspected object, and matches the video and/or image information of the inspected object collected by the first camera device 11. Photos are compared in an all-round way, and specific analysis results are output. The analysis result is sent to the inspection device 100 by the remote server, and the inspection device 100 receives the analysis result from the remote server through the communication device 30 and feeds it back to the operator through the human-computer interaction device 50 .

In some embodiments, for the inspection device 100 with a local database, when the working environment where the inspection device 100 is located has good networking conditions, the inspection device 100 can be connected to the remote server smoothly, and the remote server can be directly used. The database is used to query and compare the videos and/or photos of the inspected object collected by the first camera device 11, and output specific comparison results. When the network condition of the working environment where the inspection device 100 is located is not good, the local database of the inspection device 100 can be used to query and compare the videos and/or photos of the inspected object collected by the first camera device 11 , and Output specific comparison results.

In some embodiments, when the output specific comparison result is positive, that is, when the inspected object is consistent with its declared item information, the video and/or photo of the inspected object collected by the first camera device 11 may be the same as that of the inspected object. The item information is associated, stored in the database, and the database is updated.

In some embodiments, the image capture device 10 includes a second camera device 12, such as a 360° (or 4*90°, where 360° or 90° refers to the field of view) high-definition camera or a liftable pan/tilt camera (with 360° pan rotation, ±90° pitch), configured to obtain video and/or photos of the environment in which the inspection device 100 is located, the video and/or photos of the environment in which the inspection device 100 is located are, for example, images and/or images of the operator performing operations Video, etc. are used for on-site recording. The second camera device 12 can take pictures of the environment where the inspection device 100 is located in an all-round way by adjusting the camera angle and the camera position. As shown in FIGS. 2 and 3 , the second camera device 12 may be fixedly connected to the upright post 83 . In other embodiments, the second camera device 12 may also be set at other positions, as long as the environment in which the inspection device 100 is located can be photographed in all directions.

The image and/or video of the environment in which the inspection device 100 is located and captured by the second camera device 12 may be transmitted to a remote server through the communication device 30 . The administrator can monitor the environment in which the inspection device 100 is located in real time, for example, check in real time whether the operation flow of the operator is standardized. The image and/or video of the environment in which the inspection device 100 is located and captured by the second camera device 12 may also be stored in a remote server, which is convenient for management personnel to check later.

Those skilled in the art can understand that, in some embodiments, the image capturing device 10 may only have one camera device to implement the functions of both the above-mentioned first camera device 11 and the second camera device 12 . That is, only one camera device is used to capture both video and/or photos of the object to be inspected, and videos and/or photos of the environment where the inspection device 100 is located.

The intelligent measurement device 20 of the inspection device 100 includes a non-contact temperature measurement device 22. In some embodiments, the non-contact temperature measurement device 22 is fixed on the side of the extension of the column 83 facing the automatic weighing device 21, and is connected to the first camera. The devices 11 are arranged adjacently. The non-contact temperature measurement device 22 is configured to acquire the temperature of the object under inspection located on the automatic weighing device. It can be understood by those skilled in the art that not all measured objects need to be temperature measured. The non-contact temperature measurement device 22 can automatically collect temperature information only for the measured object that needs temperature measurement, such as chilled aquatic products. The non-contact temperature measuring device 22 is, for example, an infrared temperature measuring device. Through the non-contact temperature measuring method, the contamination of the measured object itself can be avoided, and the operation is convenient. The non-contact temperature measurement device 22 can be controlled by the main control device 40, and the main control device 40 can perform processing such as storage, transmission, compression, etc. on the temperature information collected by the non-contact temperature measurement device 22. For example, the main control device 40 can control the communication device. 30 Upload the temperature information collected by the non-contact temperature measuring device 22 to the remote server. The operator only needs to place the inspected object on the automatic weighing device 21 to realize the automatic collection and entry of the temperature of the inspected object, which avoids the operator using a separate temperature measuring device, such as a contact thermometer, etc. in the related art. After the temperature of the object to be inspected, a manual input step is required, which reduces the steps of manual intervention, reduces the probability of errors, and is simple to operate and improves the work efficiency of inspection.

The human-computer interaction device 50 of the inspection device 100 includes, for example, a touch display screen 51 . As shown in FIGS. 2 and 3 , the touch display screen 51 is, for example, fixedly connected to the upright column 83 . In other embodiments, the second camera 12 may also be set in other positions, as long as the human-computer interaction with the inspection device 100 can be realized. The touch display screen 51 is configured to display at least one of the video and/or photo of the object to be inspected, the analysis result, and the operation suggestion collected by the first camera device.

In some embodiments, the touch display screen 51 may, for example, display the video and/or photo of the object under inspection collected by the first camera device 11 in real time. When the video and/or photo of the object to be inspected collected by the first camera device 11 displayed on the touch display screen 51 is not clear, the first camera device 11 can be adjusted by inputting a signal through the touch display screen 51 to obtain Clear video and/or photos. For example, the touch display screen 51 can also display the weight of the object under inspection collected by the automatic weighing device 21 and/or the temperature of the object under inspection collected by the non-contact temperature measuring device 22 in real time. For a container including multiple boxes of inspected objects, if the weights of the objects to be inspected in each box are very similar, only one or several boxes need to be inspected. Compare the total weight of the system, pass if it is close, and sound an alarm if it is not. If the packing box of the inspected object has net weight information, the actual weight can be directly compared with the net weight marked on the package. If it is close, it will pass, and if it is not close, an alarm will be issued. For objects to be inspected that require temperature measurement, such as chilled food, it is necessary to ensure that they are within a certain temperature range (for example, lower than 10 degrees Celsius). When the temperature measurement device detects that the object to be inspected is higher than 10 degrees Celsius, it indicates that the object to be inspected has Risk of spoilage, the inspection device sounds an alarm.

In some embodiments, the touch display screen 51 can also display the query comparison result of the video and/or photo of the inspected object output from the database, so as to feed back to the operator whether the inspected object is consistent with the declared item information. Further, in some embodiments, the touch display screen 51 can also simultaneously display the video and/or photo corresponding to the declared item information queried from the database, and the video and/or photo of the inspected object collected by the first camera device 11 . / or photo. This enables the operator to intuitively compare the video and/or photo of the inspected object collected by the first camera device 11 with the video and/or photo of the corresponding declared item information queried from the database.

As shown in FIGS. 2 and 3 , the inspection device 100 further includes a roller 90 located at the end of the support leg of the main structure 80 away from the operation platform 81 . Specifically, the main body structure 80 is, for example, a table body structure, including the support legs of the supported operation platform 81, and the end of each support leg away from the operation platform 81 is provided with a roller 90, and the roller 90 is, for example, a universal wheel, It is convenient to move the inspection device 100 to different inspection positions.

In some embodiments, the inspection apparatus 100 may include an interface for accessing an external device, and the additional detection apparatus 70 may conveniently access the inspection apparatus 100 through the interface on the inspection apparatus 100. The additional detection apparatus 70 is, for example, a Raman, Various inspection technical equipment such as rapid screening of polymer components and detection of harmful element content can realize the identification of radioactivity (ie, radioactivity detection of the inspected object itself), abnormal odor, content of inclusions, and appearance. When the object to be inspected needs to perform a specific additional inspection, the additional inspection device 70 can be conveniently connected to the inspection device 100 to realize the inspection. The additional detection device 70 of the access inspection device 100 can also be controlled by the main control device 40, and the main control device 40 can perform processing such as storage, transmission, compression, etc. on the information collected by the additional detection device 70. For example, the main control device 40 can control The communication device 30 uploads the information collected by the additional detection device 70 to the remote server.

The inspection device 100 provided by the above embodiment can automatically collect various information of the inspected object, such as weight, temperature, pictures, videos, etc., and can directly perform the collected inspection object pictures and other information by the database in the remote server or the local database. Intelligent comparison, automatic judgment and identification of the object type of the inspected object, avoids manual judgment based on experience, and reduces the probability of errors. And the inspection device 100 can also collect various information of the inspected object and the pictures and/or videos of the positive result given after intelligent comparison, automatically generate an inspection report, and upload it to a remote server, and the operation is simple, Improve inspection efficiency.

The on-site operator only needs to place the object to be inspected on the automatic weighing device 21 of the inspection device 100, and if necessary, simply adjust the placement posture of the object to be inspected to complete the inspection step, without manual input of information, and reduces the need for manual intervention or judgment. link, and improve the efficiency of inspection work.

Some embodiments of the present disclosure further provide a checking method, and the checking method may adopt the checking apparatus 100 in the foregoing embodiments. FIG. 4 is a flowchart of a ping method according to some embodiments of the present disclosure. As shown in Figure 4, the inspection method includes the following steps:

S10 places the inspected object on the inspection device;

S20 adopts the image acquisition device to collect the video and/or photo of the inspected object and the video and/or photo of the environment where the inspection device is located;

S30 adopts the intelligent measuring device to collect the measurement parameters of the inspected object;

S40 adopts the main control unit to control the communication unit to perform data interaction with the remote server.

In step S10, during the inspection, the on-site operator only places the object to be inspected on the automatic weighing device 21 of the inspection device 100, and if necessary, simply adjusts the placement posture of the object to be inspected to facilitate the inspection of the image of the device 100 in subsequent steps The collecting device collects videos and/or photos of the inspected object and videos and/or photos of the environment where the inspection device is located.

In step S20, the first camera device 11 is used to capture the video and/or photo of the inspected object, for example, the appearance image, trademark image, label information image, transportation sign image, hazardous chemical identification image, box number of the inspected object images, seal images, etc. The second camera device 12 is used to capture video and/or photos of the environment where the inspection device is located, for example, images and/or videos of the operator's operation.

In step S30, the automatic weighing device 21 is used to automatically identify and collect the weight of the object to be inspected placed on it, and the non-contact temperature measuring device 22 is used to collect the temperature of the object to be inspected. It can be understood by those skilled in the art that not all measured objects need to be temperature measured. The non-contact temperature measurement device 22 can automatically collect temperature information only for the measured object that needs temperature measurement, such as chilled aquatic products.

In step S40, the inspection apparatus 100 exchanges data with the remote server through the communication unit, and the exchanged data includes pictures, videos, instructions, and the like. Taking the inspection device 100 without a local database as an example, the collected video and/or photos of the inspected object, the video and/or photos of the environment where the inspection device is located, and the measurement parameters of the inspected object are uploaded to the inspection device. The remote server performs query and comparison on the collected videos and/or photos of the object under inspection in the database in the remote server, and outputs an analysis result to feed back to the inspection device 100 .

In some embodiments, if the output analysis result is normal, that is, the output analysis result is positive, and the inspected object is consistent with the declared item information, the video and/or photo of the inspected object is included in the In the database in the remote server, specifically, the video and/or photo of the inspected object collected by the first camera device 11 can be associated with the item information, stored in the database, and the database can be updated.

In some embodiments, the checking method further includes:

Collect the packaging identification image of the inspected object by the first camera device;

It is judged whether the package information extracted from the package identification image is consistent with the declared information, and if the result is no, an alarm is issued.

Further, the checking method also includes:

If the package information extracted from the package identification image is consistent with the declared information, the first camera device is used to collect the appearance image of the object in the package of the inspected object; and

The collected appearance images of the packaged items are compared with the videos and/or photos retrieved from the database according to the declaration information, and if the two do not match, an alarm is issued.

A specific example is used for description below.

In some embodiments, the video and/or photo of the inspected object includes a package identification image and an appearance image of an item in the package, and the inspection method for inspecting the inspected object that needs to be unpacked by the inspection device 100 includes the following steps:

First, the inspection device 100 uses the first camera device 11 to acquire an image of a key part (for example, a part with item label information) on the package of the inspected object, such as an image of a package identification, and then compares the image with the image on the customs declaration. The declaration information (for example: item type, trademark information, label information, logo information, origin information) is compared to determine whether it is consistent.

If sufficient label information on the packaging is not collected, the operator can be informed to adjust the posture of the packaging through the human-computer interaction device 50, so that the operator can move the packaging box or even turn the packaging box so that the other side is aligned with the first camera device 11; If the image on the package captured by the first camera device 11 is not clear, the inspection device 100 can give the operator an operation suggestion for raising or lowering the height of the upright 83 through the human-computer interaction device 50, so that the first camera can be adjusted. The distance between the device 11 and the object under investigation.

Next, after the inspection device 100 has checked the packaging information, such as the item label information, the operator opens the packaging of the item so that the first camera device 11 can capture an image of the item to be inspected. If the first camera device 11 cannot capture a complete and clear image of the object to be inspected, the inspection device 100 can give the operator an operation suggestion for raising or lowering the height of the column 83 through the human-computer interaction device 50, so that the first camera can be adjusted. The distance between a camera device 11 and the object under inspection enables the first camera device 11 to obtain a complete and clear image of the object under inspection.

Then, according to at least one of the declared information of the inspected object (such as item type, trademark information, origin information), the image or video of the standard item corresponding to the declared object of the inspected object is retrieved, and then the photographed image or video of the inspected object is retrieved. The image is intelligently compared with the video and/or photo of the corresponding standard item retrieved in the database to automatically determine whether the appearance of the inspected object is consistent with the appearance of the standard item retrieved according to the declaration information, and if not, an alarm will be issued to notify the operation host and remote server.

The inspection method provided by the above-mentioned embodiment can automatically collect various information of the inspected object, such as weight, temperature, pictures, videos, etc., and can directly perform intelligence on the collected inspection object pictures and other information by the database in the remote server or the local database. Comparison, automatic judgment and identification of the object type of the inspected object, avoid manual judgment based on experience, and reduce the probability of error. In addition, the inspection device can also correlate various information collected on the inspected object with pictures and/or videos of positive results given after intelligent comparison, automatically generate an inspection report, and upload it to a remote server, and the operation is simple and improves. Check work efficiency.

Although the present disclosure is described with reference to the accompanying drawings, the embodiments disclosed in the accompanying drawings are intended to illustrate the embodiments of the present disclosure and should not be construed as a limitation of the present disclosure. The size ratios in the drawings are only schematic, and should not be construed as limiting the present disclosure.

The above embodiments are only illustrative of the principles and structures of the present disclosure, but are not intended to limit the present disclosure. Those skilled in the art should understand that any changes to the present disclosure can be made without departing from the general concept of the present disclosure. and improvements are within the scope of this disclosure. The protection scope of the present disclosure should be determined by the scope defined by the claims of the present application.

Claims

An inspection device, characterized in that the inspection device comprises:

The main structure, including the operating platform, is configured to carry the object to be inspected, so that the object to be inspected is placed above the operating platform;

an image capture device, configured to capture video and/or photos of the object to be inspected, and videos and/or photos of the environment where the inspection device is located;

An intelligent measurement device, configured to collect measurement parameters of the object under inspection;

a communication device configured to interact with the remote server; and

The main control device is configured to control the image acquisition device, the intelligent measurement device and the communication device, and to process the captured video and/or photos, measurement parameters and the interactive data.
The inspection device according to claim 1, wherein the intelligent measuring device comprises an automatic weighing device, and the automatic weighing device is arranged on the operation platform and used to measure the actual weight of the inspected object,

The inspection device is configured to compare the actual weight of the inspected object with the total weight of the declared goods in the declaration information and/or the marked weight on the package of the inspected object. If the weight and/or the marked weight on the package of the object being inspected does not match, the inspection device will issue an alarm.
The inspection device according to claim 2, wherein comparing the actual weight of the inspected object with the total weight of the declared goods in the declaration information comprises:

Compare the product of the average actual weight of the inspected object in one or several packages to be multiplied by the number of packages in the declaration information and the total weight of the declared goods in the declaration information to determine whether it is close.
The inspection device according to claim 1 or 2, wherein,

The image capture device includes a first camera device, the first camera device is arranged on the top of the main structure, and is configured to capture video and/or photos of the inspected object located above the operating platform, the inspected object The video and/or photo of the object is a video and/or photo of the package of the object being inspected or the items in the package.
The inspection device according to claim 1, wherein the main structure further comprises:

A column, one end of the column is fixed on the operating platform, the column can be telescopically adjusted according to the size of the object to be inspected or the clarity of the photos and/or videos taken by the image acquisition device, and can be fixed after being adjusted in place;

The extension portion extends from the top of the upright in a direction parallel to the operation platform, and the first camera device is fixed on the extension portion.
The inspection device according to claim 4, wherein the inspection device further comprises a storage device, and a database is built in the storage device,

The inspection device compares the video and/or photo of the inspected object collected by the first camera device with the video and/or photo retrieved from the database according to the declaration information, and outputs an analysis result, and /or

The inspection device identifies the video and/or photo of the packaging of the inspected object collected by the first camera device and obtains relevant information, and the inspection device combines the relevant information with the declaration information of the inspected object. The corresponding information is compared and the analysis results are output.
The inspection device of claim 6, wherein:

The communication device is configured to interact data with a remote server to update the database of the storage device.
The inspection device according to claim 4, wherein a database is built in the remote server,

The remote server queries and compares the video and/or photo of the inspected object collected by the first camera device with the video and/or photo retrieved from the database according to the declaration information, and outputs an analysis result, and /or the remote server identifies the video and/or photo of the packaging of the inspected object collected by the first camera device and obtains relevant information, and the remote server compares the relevant information with the declaration of the inspected object The corresponding information in the information is compared and the analysis results are output.

The communication device is configured to transmit video and/or photos of the subject to be interrogated and analysis results between the remote server and the interrogation device.
The inspection device according to claim 4, wherein the video and/or photo of the inspected object includes the appearance image, trademark image, label information image, transportation sign image, hazardous chemical identification image, box number image, At least one of the seal images.
The inspection device according to claim 1 or 2, wherein,

The image acquisition device includes a second camera device, which is disposed above the operating platform and configured to capture video and/or photos of the environment where the inspection device is located for on-site verification.
The inspection device according to claim 10, wherein the communication device is configured to transmit a video and/or a photo of the environment in which the inspection device is located, collected by the second camera device, to the remote server.
The inspection device according to claim 11, wherein the video and/or the photo of the environment where the inspection device is located and collected by the second camera device includes: the video and/or the photo of the operator performing the inspection work.
The inspection device according to claim 12, wherein the intelligent measurement device comprises a non-contact temperature measurement device configured to collect the temperature of the inspected object located above the operation platform, and if the collected temperature exceeds a predetermined range, the The inspection device issues an alarm.
The inspection device according to claim 1, wherein the inspection device further comprises a human-computer interaction device configured to perform human-computer interaction between the inspection device and the operator,

Wherein, the main control unit is further configured to control the human-computer interaction device, and process data and/or signals from the human-computer interaction device,

The human-computer interaction device includes a display device, and the display device is configured to display at least one of the video and/or photo of the object to be inspected, the analysis result, and the operation suggestion collected by the image acquisition device.
An inspection method, using the inspection device according to any one of claims 1-14, wherein the inspection method comprises:

placing the object to be inspected on the inspection device;

Use the image capture device to capture video and/or photos of the object to be inspected and videos and/or photos of the environment where the inspection device is located;

Use the intelligent measuring device to collect the measurement parameters of the inspected object;

The main control unit is used to control the communication device to perform data interaction with the remote server.
The checking method according to claim 15, wherein the controlling the communication device to perform data interaction with a remote server using a main control unit comprises:

uploading the collected video and/or photo of the inspected object, the video and/or photo of the environment where the inspection device is located, and the collected measurement parameters of the inspected object to the remote server;

In the database in the remote server, query and compare the collected videos and/or photos of the object to be inspected, and output an analysis result to feed back to the inspection device.
The inspection method according to claim 15, wherein the image acquisition device comprises a first camera device, and the video and/or photo of the inspected object includes a package identification image,

The inspection method includes:

Collect the packaging identification image of the inspected object by the first camera device;

It is judged whether the package information extracted from the package identification image is consistent with the declared information, and if the result is no, an alarm is issued.
The inspection method according to claim 17, wherein the video and/or photo of the inspected object further includes an appearance image of the item in the package,

The checking method also includes:

If the package information extracted from the package identification image is consistent with the declared information, the first camera device is used to collect the appearance image of the object in the package of the inspected object; and

The collected appearance images of the packaged items are compared with the videos and/or photos retrieved from the database according to the declaration information, and if the two do not match, an alarm is issued.
The inspection method according to claim 15, wherein the inspection method further comprises: when the video and/or photos captured by the image capture device are not clear, the inspection device provides a suggestion for adjusting the image capture height, so as to The clarity of the collected video and/or photo of the object under inspection is improved.