JP7204848B2 - Inspection device and inspection program - Google Patents

Description

An embodiment of the present invention relates to an inspection device and an inspection program.

2. Description of the Related Art In an inspection system for inspecting packages passing through customs, an operator visually recognizes an image of the appearance (appearance image) and an X-ray image (X-ray image) of packages supplied to a sorter (sorting mechanism). The operator determines whether or not the package needs to be checked, and enters an operation into the inspection system. The inspection system classifies packages into packages that require confirmation and packages that do not require confirmation based on operational inputs.

In this method, since the operator decides where to sort packages, it takes time to decide where to sort packages, some packages that should be checked are overlooked, and packages that do not need to be checked are sorted for confirmation. There is

JP 2018-13939 A

The problem to be solved by the present invention is to provide an inspection apparatus and an inspection program that enable an operator to efficiently determine the sorting destination of packages.

An inspection device according to one embodiment includes a communication interface and a processor. The communication interface receives package information including address and name information obtained by character recognition processing from an image of the package being conveyed and an X-ray image of the package, and an operation signal generated based on an operator's operation. get. The processor newly extracts from the past history in which the inspection result information indicating whether or not the package is a restricted item candidate generated based on the operation signal is associated with the address and name information and the X-ray image. The inspection result information corresponding to the package information including the address and name information acquired from the transported package is extracted as an extraction result. When the processor determines that it is necessary to confirm that the package has been unsealed based on the operation signal, the processor receives an input of the result of unsealing confirmation, adds information indicating the result to the inspection result information, Controlled items exist on the X-ray image based on the X-ray image and parameters generated based on learning data in which the image is the problem and the position of the controlled item on the X-ray image is the answer. generating a candidate image indicating an area that is estimated to be affected, outputs the candidate image, adds an operator identification code for identifying an operator to the inspection result information, and the processor converts the learning data to The parameters are updated with different weights based on the learning data for each generated operator .

FIG. 1 is an explanatory diagram for explaining a schematic configuration example of an inspection system according to an embodiment. FIG. 2 is an explanatory diagram for explaining a configuration example of an inspection system according to one embodiment. FIG. 3 is an explanatory diagram for explaining an example of registration information according to one embodiment. FIG. 4 is an explanatory diagram for explaining an example of a confirmation screen according to one embodiment. FIG. 5 is a flow chart for explaining an example of the operation of the inspection system according to one embodiment. FIG. 6 is an explanatory diagram for explaining an example of a confirmation screen according to another embodiment. FIG. 7 is an explanatory diagram for explaining an example of registration information according to another embodiment.

Hereinafter, embodiments will be described with reference to the drawings.
FIG. 1 is an explanatory diagram for explaining a schematic configuration example of an inspection system 1 according to an embodiment.

The inspection system 1 is a system for classifying packages 2 to be inspected. The inspection system 1 is used at a customs office or the like to detect regulated goods. Regulated goods are those whose import into the country and export to the outside of the country are regulated. Controlled goods are, for example, weapons, narcotics, animals and plants.

A package 2 is to be inspected by an inspection system 1 . An Electronic Advance Data (EAD) tag 3 is attached to the luggage 2 . The EAD tag 3 is printed with an identification code (EAD identification code) included in the EAD information, which is the result of inspection by the customs of another country. The EAD identification code is printed as a bar code, for example. The EAD information is information including an EAD identification code, name and address information, and information (contents information) indicating the product name and weight of the content. The name and address information is, for example, information (recipient information) indicating the recipient (destination) of the parcel 2 and/or information indicating the sender (sender information).

A form 4 is attached to the package 2. - 特許庁The form 4 includes address and name information indicating recipient information and/or sender information, information indicating contents (content information), and the like.

As shown in FIG. 1, there are packages 2 to which both the EAD tag 3 and the form 4 are attached, and packages to which the form 4 is attached and the EAD tag 3 is not attached.

The inspection system 1 includes a sorter 11, a sorter control device 12, an EAD tag reader 13, a camera 14, an X-ray imaging device 15, a form reader 16, an operation terminal 17, a first storage device 18, a second storage device 19, and an inspection A device 20 is provided. The sorter 11, the sorter control device 12, the EAD tag reader 13, the camera 14, the X-ray imaging device 15, the form reader 16, the operation terminal 17, the first storage device 18, the second storage device 19, and the inspection device 20 are networked. 21 to communicate with each other.

The sorter 11 is a device that sorts the articles 2 under the control of the sorter control device 12 . The sorter 11 sorts the packages 2 into a first sorting destination 31 and a second sorting destination 32, for example. The first sorting destination 31 is a sorting destination to which packages 2 that have not been checked by the operator are transported. The second sorting destination 32 is the sorting destination to which the packages 2 to be checked by the operator are transported. The parcels 2 transported to the second sorting destination 32 are unsealed and checked by an operator, for example.

For example, sorter 11 comprises first conveyor 41 , second conveyor 42 and sorting mechanism 43 .

The first conveyor 41 conveys the articles 2 from the upstream side to the downstream side. A load 2 is supplied to the upstream end of the first conveyor 41 by a robot arm or the like. A first sorting destination 31 is provided at the downstream end of the first conveyor 41 . That is, the first conveyor 41 conveys the packages 2 supplied upstream to the first sorting destination 31 .

The second conveyor 42 conveys the articles 2 from the upstream side to the downstream side. The upstream end of the second conveyor 42 is provided adjacent to the first conveyor 41 . A second sorting destination 32 is provided at the downstream end of the second conveyor 42 . That is, the first conveyor 41 conveys the packages 2 supplied upstream to the second sorting destination 32 .

The sorting mechanism 43 is a mechanism that supplies the packages 2 conveyed on the first conveyor 41 to the second conveyor 42 . For example, the sorting mechanism 43 includes an arm that rotates to apply a horizontal force to the packages 2 being conveyed on the first conveyor 41 to move the packages 2 to the second conveyor 42. .

The sorter control device 12 controls the operations of the first conveyor 41 and the second conveyor 42 of the sorter 11 under the control of the inspection device 20 to transport the packages 2 . In addition, the sorter control device 12 controls the operation of the sorting mechanism 43, the first sorting destination 31 which is the downstream end of the first conveyor 41, and the downstream end of the second conveyor 42. The sorting destination of the package 2 is switched with the sorting destination 32 of No. 2.

The EAD tag reader 13 reads the EAD tag 3 from the package 2 being conveyed by the first conveyor 41 . The EAD tag reader 13 reads the EAD identification code from the EAD tag 3 and supplies the read EAD identification code to the inspection device 20 . For example, when the EAD identification code is printed on the EAD tag 3 as a barcode, the EAD tag reader 13 is configured as a barcode reader, for example.

The camera 14 acquires an image (appearance image) of the appearance of the package 2 being conveyed by the first conveyor 41 . The camera 14 supplies the acquired appearance image of the package 2 to the inspection device 20 . For example, the camera 14 is configured by combining a lens and an imaging device that converts light imaged by the lens into an image.

The X-ray imaging device 15 acquires an X-ray image of the package 2 being conveyed by the first conveyor 41 . The X-ray imaging device 15 supplies the acquired X-ray image of the package 2 to the inspection device 20 . For example, the X-ray imaging device 15 is configured by combining an X-ray tube that irradiates the baggage 2 with X-rays and an X-ray detector that detects X-rays that have passed through the baggage 2 .

The form reader 16 reads various information from the form 4 attached to the package 2 being conveyed by the first conveyor 41 . For example, the form reader 16 acquires recipient information, sender information, and contents information from the form 4 . Note that the recipient information, the sender information, and the content information obtained from the form 4 are hereinafter referred to as form information. The form reader 16 supplies the form information to the inspection device 20 . For example, the form reader 16 has an imaging device in which pixels that convert light into an image are arranged in a line, and a lens that forms an image of the light on the pixels, and acquires an image of the form 4 (form image). Equipped with a line image sensor. The form reader 16 also includes a processor that performs optical character recognition processing for recognizing form information such as recipient information, sender information, and content information from the form image read by the line image sensor.

Next, the operation terminal 17 will be explained.
The operation terminal 17 generates a signal (operation signal) based on the operation input and supplies the operation signal to the inspection device 20 . In addition, the operation terminal 17 provides various information to the operator.

FIG. 2 shows a configuration example of the operation terminal 17 and the inspection device 20. As shown in FIG. The operation terminal 17 includes a communication interface 51 , a control section 52 and a touch panel 53 .

A communication interface 51 is an interface for communicating with devices other than the operation terminal 17 . The communication interface 51 communicates with the inspection device 20 via the network 21 .

The control unit 52 is a processing unit that executes various processes. The control unit 52 has a processor 54 and a memory 55 .

The processor 54 is an arithmetic element that executes arithmetic processing. The processor 54 is configured as, for example, a CPU. Processor 54 performs various processes based on programs stored in memory 55 .

The memory 55 is a storage medium that stores programs and data. The memory 55 includes, for example, one or more of a ROM that is a read-only nonvolatile memory, a RAM that temporarily stores data, and a storage that stores data.

The touch panel 53 is a device that displays a screen and generates an operation signal based on an operation. The touch panel 53 includes a display 56 and a touch sensor 57 that are integrated. The operation terminal 17 may include a display that displays a screen instead of the touch panel 53 and an operation unit that generates an operation signal based on an operation. The operating unit may be any device such as a mouse, trackball, keyboard, or trackpad.

The display 56 displays a screen based on display data (screen data) supplied from the control unit 52 or a graphic controller (not shown).

The touch sensor 57 generates an operation signal indicating the position touched by the operator who operates the operation terminal 17 on the screen displayed on the display 56 .

The first storage device 18 stores registration information that is the result of processing in the inspection device 20 . FIG. 3 is an explanatory diagram for explaining an example of registration information. The registered information is a past history in which various pieces of information about past parcels 2 and inspection results are associated with each other. For example, the registration information includes the date and time when the registration information was registered, the operator identification code, package information, and inspection result information. The operator identification code is a code for identifying the operator. The parcel information is information about the parcels 2 being transported by the sorter 11 . Package information includes at least one of name and address information and an X-ray image. For example, package information includes EAD information, form information, an external image of the package, and an X-ray image of the package. The inspection result information includes the classification destination information and the information on the presence or absence of regulated products input by the operator.

The sorting destination information is information indicating to which of the first sorting destination 31 and the second sorting destination 32 the parcel 2 has been classified. When the operator determines that there is no need to check the contents of the package 2 , the operator operates the operation terminal 17 so as to classify the package 2 into the first sort destination 31 . In addition, if the operator needs to confirm the contents of the package 2, that is, if the operator determines that the package 2 is a candidate for restricted items, the operator operates the operation terminal 17 so as to classify the package 2 to the second sorting destination 32. Manipulate. In other words, the classification destination information is information indicating whether or not the operator has determined that the package 2 is a restricted item candidate. The inspection device 20 generates sorting destination information for each package 2 based on an operation signal generated as a result of the operator operating the operation terminal 17 .

The restricted item presence/absence information is information indicating whether or not the package 2 contains a restricted item. The operator unpacks the parcels 2 sorted to the second sorting destination 32 . The operator operates the operation terminal 17 based on the result of unsealing the package 2, depending on whether or not the restricted item is included. As a result, the inspection apparatus 20 generates regulated item presence/absence information.

The second storage device 19 stores a database generated based on registration information stored in the first storage device 18 . In the database, for example, sender information of EAD information, recipient information of EAD information, sender information of form information, recipient information of form information, etc., and past inspection result information are associated with each other. Specifically, the database is configured to be able to extract the number of times the contents of packages have been checked in the past and the number of times packages have contained restricted items for each sender information or recipient information. Also, the database may further have information such as the presence or absence of trouble for each sender information or each recipient information. The second storage device 19 may be configured as one storage device together with the first storage device 18 .

Next, the inspection device 20 will be described.
As shown in FIG. 2 , the inspection device 20 has a communication interface 61 and a control section 62 . The inspection device 20 is a device that provides information to an operator and discriminates between packages that do not require confirmation and packages that require confirmation based on the operation input by the operator. The operator logs into the inspection device 20 by inputting information for authentication (authentication information) into the inspection device 20 . When generating the registration information, the inspection apparatus 20 adds the identification information (operator identification code) of the logged-in operator to the registration information.

The inspection device 20 is configured by a device such as a personal computer (PC) capable of processing and storing data. The inspection device 20 causes the sorter control device 12 to convey the packages 2 that do not require confirmation to the first sorting destination 31 and the packages 2 that require confirmation to the second sorting destination 32. Control. The inspection device 20 includes a communication interface 61 and a control section 62 .

A communication interface 61 is an interface for communicating with other devices. The communication interface 61 communicates with the EAD tag reader 13, the camera 14, the X-ray imaging device 15, the document reader 16, the operation terminal 17, the first storage device 18, and the second storage device 19 via the network 21. Equipped with terminals and circuits that support the communication standards of

The control unit 62 is a processing unit that executes various processes. The control unit 62 has a processor 63 and a memory 64 .

The processor 63 is an arithmetic element that executes arithmetic processing. The processor 63 is configured as, for example, a CPU. The processor 63 performs various processes based on inspection programs stored in the memory 64 .

The memory 64 is a storage medium that stores programs and data. The program is a program (inspection program) for causing the processor 63 to execute processing for inspecting the package 2, which will be described later. The memory 64 includes, for example, at least one or more of a read-only non-volatile memory, ROM, and storage for storing data. That is, the memory 64 is a non-temporary recording medium in which the inspection program is recorded. Moreover, the memory 64 may further include a RAM for temporarily storing data.

Also, the memory 64 stores a plurality of pieces of EAD information. For example, the memory 64 stores EAD information imported from a storage medium such as a USB memory. The memory 64 may also store EAD information supplied via a network.

The processor 63 of the control unit 62 of the inspection apparatus 20 controls the operations of the EAD tag reader 13 , camera 14 , X-ray imaging apparatus 15 and form reader 16 by executing programs stored in the memory 64 . The processor 63 thereby acquires the EAD identification code from the EAD tag reader 13 . Also, the processor 63 acquires an external image of the package 2 from the camera 14 . Also, the processor 63 acquires an X-ray image of the luggage 2 from the X-ray imaging device 15 . Also, the processor 63 acquires the form information described in the form 4 attached to the package 2 from the form reader 16 .

The processor 63 also acquires EAD information from the memory 64 based on the EAD identification code acquired from the EAD tag reader 13 . Processor 63 extracts EAD information including the EAD identification code obtained from EAD tag reader 13 from memory 64 . Thereby, the processor 63 acquires the EAD information.

Furthermore, the processor 63 extracts the inspection history of packages with matching address and name information based on the newly acquired package information and the past history. For example, the processor 63 extracts the inspection history from the database stored in the second storage device 19 based on the name and address information as package information. Further, for example, the processor 63 may be configured to extract the inspection history from the past history stored in the first storage device 18 based on the address and name information as the package information. Information extracted from the database of the second storage device 19 or the past history of the first storage device 18 based on the address and name information is referred to as extracted information.

The address and name information is at least one or more information of the sender information of the EAD information, the recipient information of the EAD information, the sender information of the form information, and the recipient information of the form information.

Extracted information is information for calling the operator's attention based on the number of packages determined to be restricted item candidates. For example, the extracted information is information generated based on the number of packages determined to be restricted item candidates. Further, for example, the extracted information may be information generated based on the number of parcels that actually contained the controlled item.

Specifically, the processor 63 extracts from the database the number of times the sender information matches and the contents of the parcel have been confirmed in the past, and the number of times the sender information matches and the parcel contains restricted items in the past. do. In addition, the processor 63 extracts from the database the number of times the recipient information matches and the contents of the package have been confirmed in the past, and the number of times the recipient information matches and the package has contained restricted items in the past. . In addition, the processor 63 determines the number of times that both the sender information and the recipient information match and the contents of the parcel have been confirmed in the past, and the number of times that both the sender information and the recipient information match and the parcel has no restricted items in the past. It may be configured to extract the included number of times from a database.

In addition, the processor 63 estimates the position of the restricted item from the X-ray image using parameters generated by machine learning based on the past history. For example, the processor 63 superimposes the estimated location of the controlled item on the X-ray image to generate a candidate image. For example, the processor 63 calculates a score for each predetermined region on the X-ray image based on the possibility that the restricted product exists. The processor 63 generates candidate images by displaying each region differently according to the calculated score. For example, processor 63 generates candidate images by displaying each region in a different color according to the calculated score.

The parameters are adjusted based on a large amount of training data. Learning data has questions and answers. Training data questions and answers are arbitrary data of registration information. As described above, in the example of estimating the position of the regulated item from the X-ray image, the X-ray image corresponds to the problem, and the position of the regulated item in the X-ray image corresponds to the answer. That is, the parameters are machine-learned by, for example, a neural network for segmentation based on learning data having an X-ray image (problem) and the position (answer) of the restricted item in the X-ray image. It was generated by

The processor 63 generates a screen (confirmation screen) showing various information about the packages 2 being transported by the sorter 11, and transmits the screen to the operation terminal 17 for display. The processor 63 generates a confirmation screen based on the EAD information, the form information, the appearance image, the X-ray image, the candidate image, and the extraction information extracted from the database.

FIG. 4 is an explanatory diagram for explaining an example of the confirmation screen 71. As shown in FIG.
A confirmation screen 71 is a screen displayed on the display 56 of the operation terminal 17 . The confirmation screen 71 displays information used when the operator determines whether or not it is necessary to confirm that the package 2 has been opened. That is, the information displayed on the confirmation screen 71 is reference information that is used as a reference for the operator's judgment. The confirmation screen 71 has displays such as an appearance image 72, an X-ray image 73, a candidate image 74, EAD information 75, form information 76, extraction information 77, a delivery button 78, a confirmation button 79, and the like.

The appearance image 72 is an appearance image of the package 2 acquired by the camera 14 . An X-ray image 73 is an X-ray image of the baggage 2 acquired by the X-ray imaging device 15 . Candidate image 74 is an image generated by processor 63 based on the X-ray image and the above parameters. The EAD information 75 is EAD information acquired based on the EAD identification code acquired from the package 2 by the EAD tag reader 13 . If the EAD tag 3 is not attached to the package 2, the EAD identification code and the EAD information cannot be acquired, so the EAD information 75 in the confirmation screen 71 is blank. The form information 76 is form information read from the form 4 of the package 2 by the form reader 16 . That is, the EAD information 75 and the form information 76 include address and name information as parcel information.

The extracted information 77 is information extracted from the past history by the processor 63 based on the address and name information, as described above. For example, the extracted information 77 includes the number "YY" of packages judged to be restricted item candidates out of the number "ZZ" of packages whose recipient information matches the package 2 conveyed by the sorter 11, contains information such as the number of parcels "XX" in which was included. Further, the extracted information 77 includes the number "BB" of packages judged to be restricted item candidates, out of the number "CC" of packages whose recipient information matches the package 2 conveyed by the sorter 11, contains information such as the number of parcels that contained "AA". Furthermore, the extracted information 77 may include whether or not the sender or recipient of the packages 2 transported by the sorter 11 has had trouble in the past.

Also, the confirmation screen 71 may further include an alarm display 80 . In FIG. 4 , the confirmation screen 71 displays a character string “confirmation required” as the alarm display 80 . The processor 63 displays an alarm display 80 on the confirmation screen 71, for example, when the extracted information satisfies a predetermined condition. For example, the processor 63 displays an alarm display 80 on the confirmation screen 71 when the number of regulated items in the extracted information is equal to or greater than a preset threshold. Also, for example, the processor 63 displays an alarm display 80 on the confirmation screen 71 when the number of restricted item candidates in the extracted information is equal to or greater than a preset threshold. The above conditions may be set for each operator.

A delivery button 78 and a confirmation button 79 are buttons selectable by the touch sensor 57 . The operator confirms the reference information on the confirmation screen 71 and determines whether or not it is necessary to confirm that the parcel 2 has been opened. That is, the operator confirms the appearance image 72, the X-ray image 73, the candidate image 74, the EAD information 75, the form information 76, the extraction information 77, etc. on the confirmation screen 71, and whether or not the package 2 needs to be opened. Then, either the delivery button 78 or the confirmation button 79 is selected.

When the delivery button 78 is selected by the operator, the inspection device 20 determines that the package 2 is not a restricted item candidate, and controls the sorter control device 12 to convey the package 2 to the first sorting destination 31. .

When the confirmation button 79 is selected by the operator, the inspection device 20 determines that the package 2 is a restricted item candidate, and controls the sorter control device 12 to transport the package 2 to the second sorting destination 32. . Thereafter, the operator unpacks the package 2 transported to the second sorting destination 32 , confirms whether or not there is a regulated item, and inputs the confirmation result to the operation terminal 17 . As a result, the inspection device 20 generates registration information as shown in FIG. The inspection device 20 saves the generated registration information in the first storage device 18 . Thereby, the past history is accumulated in the first storage device 18 . Further, by using the sender information and the recipient information as an index, a database capable of extracting the number of parcels that have been judged to be candidates for restricted goods in the past and the number of parcels that have contained controlled goods is stored in the second storage. It can be generated in device 19 .

Next, operation of the inspection system 1 will be described.
FIG. 5 is a flowchart for explaining the operation of the inspection system 1. FIG.

The EAD tag reader 13 of the inspection system 1 reads the EAD identification code from the EAD tag 3 of the package 2 being conveyed by the first conveyor 41 (step S11). The EAD tag reader 13 supplies the EAD identification code to the inspection device 20 .

The camera 14 of the inspection system 1 acquires an appearance image of the package 2 being conveyed by the first conveyor 41 (step S12). Camera 14 supplies an appearance image to inspection device 20 .

The X-ray imaging device 15 of the inspection system 1 acquires an X-ray image of the package 2 being conveyed by the first conveyor 41 (step S13). Camera 14 supplies X-ray images to inspection device 20 .

The form reader 16 of the inspection system 1 acquires form information from the form 4 of the package 2 being conveyed by the first conveyor 41 (step S14). The form reader 16 supplies the form information to the inspection device 20 .

The processor 63 of the control unit 62 of the inspection device 20 determines whether or not the EAD identification code has been acquired by the EAD tag reader 13 (step S15). The processor 63 thereby determines whether or not the EAD identification code has been supplied from the EAD tag reader 13 .

When the processor 63 determines that the EAD identification code has been acquired by the EAD tag reader 13 (step S15, YES), the processor 63 acquires EAD information based on the EAD identification code (step S16). Through the above processing, the inspection device 20 acquires package information, which is various information about the package 2 .

Further, the processor 63 acquires extraction information from the database of the second storage device 19 based on the EAD information (step S17), and shifts to the process of step S19, which will be described later. That is, the processor 63 stores the number of past parcels that match the sender information and recipient information of the EAD information, the number of parcels that are judged to be restricted item candidates, and the number of parcels that are determined to contain restricted items in the database. Get from

If the processor 63 determines that the EAD identification code has not been acquired by the EAD tag reader 13 (step S15, NO), it acquires extracted information from the database of the second storage device 19 based on the form information (step S18 ), the process proceeds to step S19, which will be described later. That is, the processor 63 stores in the database the number of past parcels that match the sender information and recipient information of the form information, the number of parcels that are determined to be restricted item candidates, and the number of parcels that are determined to contain restricted items. Get from

The processor 63 uses the parameters generated by machine learning to estimate the position of the restricted item from the X-ray image and generate a candidate image (step S19).

The processor 63 generates the confirmation screen 71 shown in FIG. 4 based on the EAD information, the form information, the appearance image, the X-ray image, the candidate image, and the extraction information extracted from the database (step S20). The processor 63 outputs the confirmation screen 71 to the operation terminal 17 for display (step S21). This allows the operator to view the confirmation screen 71 and determine whether or not the package 2 is a restricted item candidate. The operator selects the confirmation button 79 on the confirmation screen 71 when determining that the package 2 is a restricted item candidate. The operator selects the delivery button 78 on the confirmation screen 71 when determining that the package 2 is not a restricted item candidate. The operation terminal 17 supplies an operation signal to the inspection device 20 based on the selection results of the confirmation button 79 and the delivery button 78 on the confirmation screen 71 .

The processor 63 of the inspection device 20 determines whether or not the package 2 is a restricted item candidate based on the operation signal from the operation terminal 17 (step S22). For example, when the processor 63 receives an operation signal from the operation terminal 17 indicating that the delivery button 78 has been selected, the processor 63 determines that the package 2 is not a restricted item candidate. Also, for example, when the processor 63 receives an operation signal from the operation terminal 17 indicating that the confirmation button 79 has been selected, the processor 63 determines that the package 2 is a restricted item candidate.

When the processor 63 determines that the package 2 is not a restricted item candidate (step S22, NO), the processor 63 inputs a control signal to the sorter control device 12 so that the package 2 is conveyed to the first sorting destination 31 ( step S23). Further, when the processor 63 determines that the package 2 is a restricted item candidate (step S22, YES), the processor 63 inputs a control signal to the sorter control device 12 so that the package 2 is conveyed to the second sorting destination 32. (step S24).

Thereafter, the operator unpacks the package 2 transported to the second sorting destination 32 , confirms whether or not there is a regulated item, and inputs the confirmation result to the operation terminal 17 . The processor 63 generates registration information based on the above processing result, stores the registration information in the first storage device 18 (step S25), and ends the processing. As a result, regulated item presence/absence information indicating whether or not a regulated item was actually included in the parcel 2 is added to the registration information. The operator who unpacks the parcels 2 transported to the second sorting destination 32 may be different from the operator who operates the operation terminal 17 . In this case, the inspection system 1 may further include a device for the operator to input whether or not the parcels 2 transported to the second sorting destination 32 are unsealed and contain restricted items. That is, the inspection system 1 may further include a device that transmits information indicating whether or not a regulated item is included to the inspection device 20 based on the operator's input.

Note that the registration information does not have to include the confirmation result of the presence or absence of the controlled item. In this case, the item of the number of restricted items is omitted from the extracted information 77 on the confirmation screen 71 as well.

As described above, the processor 63 of the inspection device 20 acquires, through the communication interface 61, the package information about the packages 2 being transported by the sorter 11 and the operation signal generated by the operator operating the operation terminal 17. do. Based on the operation signal, the processor 63 generates inspection result information indicating whether the package 2 is a restricted item candidate. The processor 63 outputs reference information based on the past history in which the package information of the past packages 2 and the inspection result information are associated with each other, and the newly acquired package information. As a result, the inspection device 20 can provide useful information for the operator to determine where to sort the packages. As a result, it is possible to provide an inspection apparatus that allows the operator to efficiently determine the sorting destination of the baggage.

The parcel information is address and name information corresponding to the parcel 2, and the processor 63 generates reference information based on the number of parcels that match the name and address information and are determined to be restricted item candidates. . As a result, the inspection device 20 can provide useful information for the operator to determine where to sort the packages.

In addition, when the processor 63 acquires an operation signal indicating that the package 2 contains a regulated item, the processor 63 adds information indicating that the package 2 includes a regulated item to the inspection result information. The processor 63 generates reference information based on the number of parcels with matching address and name information and containing restricted items. As a result, the inspection device 20 can provide useful information for the operator to determine where to sort the packages.

The processor 63 also acquires EAD information that matches the EAD identification code read from the package 2 through the communication interface 61 . The processor 63 uses at least one of sender information and recipient information included in the EAD information as address and name information. As a result, the inspection device 20 can provide useful information for the operator to determine where to sort the packages.

Also, the processor 63 acquires the sender information and the recipient information displayed on the parcel 2 through the communication interface 61 . The processor 63 uses at least one of sender information and recipient information as address and name information. As a result, the inspection device 1 can leave a history even if the EAD tag 3 is not attached to the package 2 .

The processor 63 of the inspection device 20 acquires the X-ray image of the package 2 from the X-ray imaging device 15 . The processor 63 infers the location of the restricted item from the X-ray image using parameters generated by machine learning. The processor 63 superimposes the estimated location of the restricted item on the X-ray image to generate a candidate image. The processor 63 adds the candidate image to the reference information and outputs it. This can prompt the operator's attention.

In the above-described embodiment, the confirmation screen 71 is a screen that allows the operator to select either the delivery button 78 or the confirmation button 79, but the configuration is not limited to this. Confirmation button 79 may be divided according to a plurality of classification reasons. In addition, it may be configured to cause the operator to indicate the position where the restricted item exists on the X-ray image.

FIG. 6 is an explanatory diagram for explaining a confirmation screen 71A that is another example of the confirmation screen 71 in FIG.

The processor 63 generates the confirmation screen 71A based on the EAD information, the form information, the appearance image, the X-ray image, the candidate image, and the extraction information extracted from the database.

The confirmation screen 71A is a screen displayed on the display 56 of the operation terminal 17 . The confirmation screen 71A displays information used when the operator determines whether or not it is necessary to confirm that the package 2 has been opened. That is, the information displayed on the confirmation screen 71A is reference information that is used as a reference for the operator's judgment. The confirmation screen 71A includes an appearance image 72, an X-ray image 73A, a candidate image 74, EAD information 75, form information 76, extraction information 77, a delivery button 78, a restricted item button 81, a dangerous goods button 82, a content mismatch button 83, It has displays such as a past history button 84 and an other button 85 .

The operator confirms the reference information on the confirmation screen 71A, determines whether or not it is necessary to confirm that the parcel 2 has been opened, and clicks the delivery button 78, the restricted goods button 81, the dangerous goods button 82, the content mismatch button 83, and the past history. Either button 84 or other button 85 is selected. The restricted item button 81 , the dangerous item button 82 , the content mismatch button 83 , the past history button 84 , and the other button 85 correspond to the confirmation button 79 on the confirmation screen 71 . That is, when the operator selects any one of the regulated item button 81, the dangerous item button 82, the content mismatch button 83, the past history button 84, and the other button 85, the inspection device 20 sorts the package 2 into the second sort. Control the sorter controller 12 to transport to destination 32 .

The restricted item button 81 is a button that is selected when the operator determines that there is a possibility that the package 2 contains a restricted item as a result of viewing the confirmation screen 71A.

The dangerous goods button 82 is selected when the operator visually confirms the confirmation screen 71A and determines that there is a possibility that the cargo 2 contains a controlled item.

The content mismatch button 83 is determined by the operator, as a result of viewing the confirmation screen 71A, that there is a possibility that the package 2 contains something that does not match the package 2 described in the EAD information 75 or the form information 76. is the button that is selected when

The past history button 84 is a button that is selected when the operator visually confirms the confirmation screen 71A and determines from the extracted information 77 that it is necessary to open the package 2 and confirm it.

The other button 85 is a button that is selected when the operator determines that it is necessary to open the package 2 and check it, although the above reason does not apply.

The X-ray image 73A is an X-ray image of the baggage 2 acquired by the X-ray imaging device 15. FIG. Furthermore, the X-ray image 73A is configured so that the touch sensor 57 can indicate a region on the image. That is, when the operator performs an operation to select (tap, drag, etc.) an area on the X-ray image 73A using the touch sensor 57, the operation terminal 17 displays information (X-ray image area information) indicating the area selected by the operator. to generate

For example, the operator selects an area in the X-ray image 73A where it is estimated that the restricted product exists. That is, the X-ray image area information is information indicating the position of the restricted product in the X-ray image 73A. As a result, it is possible to generate learning data in which the X-ray image 73A is the problem and the operator's region selection result (X-ray image region information) is the answer.

The operation terminal 17 supplies an operation signal to the inspection device 20 based on the button operation result on the confirmation screen 71A.

When the processor 63 of the inspection device 20 receives an operation signal indicating that the delivery button 78 has been selected from the operation terminal 17, it determines that the package 2 is not a restricted item candidate. In this case, the processor 63 inputs a control signal to the sorter control device 12 so that the packages 2 are transported to the first sorting destination 31 . Furthermore, the processor 63 generates registration information and stores it in the first storage device 18 .

Also, the processor 63 receives from the operation terminal 17 an operation signal indicating that any one of the regulated item button 81, the dangerous item button 82, the content mismatch button 83, the past history button 84, and the other button 85 has been selected. In this case, it is determined that it is necessary to confirm that the parcel 2 has been unsealed. In this case, the processor 63 inputs a control signal to the sorter control device 12 so that the packages 2 are transported to the second sorting destination 32 .

Thereafter, the operator unpacks the package 2 transported to the second sorting destination 32 , confirms the contents of the package 2 , and inputs the confirmation result into the operation terminal 17 . Processor 63 generates registration information based on the above processing results. As a result, registration information is generated that includes, in the inspection result information, regulated item presence/absence information indicating whether or not a regulated item was actually included in the parcel 2 .

In addition, the processor 63 selects a button such as a regulated item button 81, a dangerous item button 82, a content mismatch button 83, a past history button 84, and an other button 85 to classify the package 2 into the second sorting destination 32. Information (classification reason information) is added to the registration information. For example, when the regulated item button 81 is selected, the processor 63 adds "regulated item" to the registration information as classification reason information. For example, when the dangerous substance button 82 is selected, the processor 63 adds "dangerous substance" to the registration information as classification reason information. For example, when the content mismatch button 83 is selected, the processor 63 adds "content mismatch" to the registration information as the classification reason information. For example, when the past history button 84 is selected, the processor 63 adds "past history" to the registration information as the classification reason information. For example, when the other button 85 is selected, the processor 63 adds "other" to the registration information as the classification reason information.

In addition, the processor 63 adds X-ray image area information indicating the position of the restricted product on the X-ray image 73A to the registration information.

Thereby, the registration information shown in FIG. 7 is generated. The registration information in FIG. 7 includes the registration date and time when the registration information was registered, the operator identification code, package information, and inspection result information. The parcel information is information about the parcels 2 being transported by the sorter 11 . Package information includes at least one of name and address information and an X-ray image. For example, package information includes EAD information, form information, an external image of the package, and an X-ray image of the package. The inspection result information includes sorting destination information, sorting reason information, restricted item presence/absence information, and X-ray image area information input by the operator.

The processor 63 stores the registration information generated by the above processing in the first storage device 18 as past history. The processor 63 creates a database based on the past history saved in the first storage device 18 and saves it in the second storage device 19 . For example, the processor 63 associates the classification destination information, the classification reason information, and the presence/absence of regulated goods with each address/name information to generate a database. As a result, the processor 63 can extract the number of past parcels that have been determined to be candidates for restricted items and the number of past parcels that have included restricted items for each classification reason, based on the address and name information. A database can be generated.

According to such a configuration, the processor 63 can generate reference information based on the number of parcels to which a preset classification reason is added, which is extracted from the past history. That is, the processor 63 determines the past number of parcels for a preset sorting reason, the number of past parcels determined to be restricted goods candidates for the preset sorting reason, and the number of past parcels sorted by the preset sorting reason. Also, the number of parcels containing restricted items can be extracted from the database. Furthermore, the processor 63 can add the extracted information as extracted information 77 to the confirmation screen 71A.

Further, in the above embodiment, the processor 63 acquires extracted information from the database based on the address and name information, and displays an alarm based on the extracted information. However, the present invention is not limited to this configuration. The processor 63 may be configured not to display an alarm according to the classification reason information.

For example, in the above embodiment, processor 63 extracts extraction information from second storage device 19 based on EAD information or form information. Furthermore, it has been explained that the processor 63 causes the confirmation screen 71 to display the alarm display 80 when the number of restricted item candidates in the extracted information is equal to or greater than the preset threshold value. However, if the reason for classification is the past history, once the parcel 2 is determined to be a restricted item candidate, the alarm display will continue to be issued for the parcel 2 whose address and name information match. For this reason, the processor 63 may be configured so as not to be counted as a restricted item candidate for a classification reason. As a result, the processor 63 can count the number of parcels classified as restricted item candidates for the preset classification reason among the number of restricted item candidates of the extracted information whose address and name information match.

Further, as described above, the registration information in FIG. 7 has the X-ray image (question) and the X-ray image area information (answer) indicating the position of the restricted product on the X-ray image. That is, learning data can be generated from the registered information. The inspection device 20 can update the parameters by performing machine learning using the learning data, for example, using a neural network for segmentation. That is, the parameters can be updated based on the X-ray image area information input by the operator.

Furthermore, the inspection apparatus 20 may be configured to set, for each operator, weights for updating parameters in machine learning using learning data. The weight is information indicating the degree of parameter update, upper and lower limits, coefficients, or the like. The larger the weight, the larger the parameter changes in one learning. For example, processor 63 obtains the weight based on the operator identification code of the registration information. For example, the processor 63 obtains the weight by referring to a table that associates the operator identification code added to the registration information with the weight. The processor 63 updates parameters based on the acquired weights and learning data. As a result, learning data based on registered information of an operator who has a high detection accuracy of a regulated product in an X-ray image can be emphasized when updating parameters.

Furthermore, the inspection apparatus 20 may be configured to set the weight for updating parameters using the registration information in FIG. 7 for each classification reason information. As a result, if the reason for classification is "other", if the reason is "mismatched content", or if it is "past history", learning data generated based on registered information will not be emphasized when updating parameters. can be

Furthermore, the inspection apparatus 20 may be configured so as not to use the registered information in FIG. For example, as a result of confirming the cargo 2 actually sorted by the second sorting destination 32, if the restricted item is not included, the X-ray image (problem) and the X-ray image area information (answer) of the registration information are It is not preferable to use it for updating parameters. For this reason, for example, the inspection apparatus 20 is configured not to use registered information that does not contain any controlled items as a result of confirming the packages 2 actually sorted by the second sorting destination 32 for updating the parameters. may have been

As described above, the processor 63 acquires the X-ray image of the package 2 as package information, and outputs the confirmation screen 71A as reference information including the X-ray image 73 . The operator confirms the X-ray image 73 and inputs into the operation terminal 17 whether or not the package 2 is a restricted item candidate. Based on the operation signal, the processor 63 generates inspection result information indicating whether or not the operator has determined that the package 2 is a restricted item candidate. Furthermore, the processor 63 generates parameters by machine learning based on learning data in which the X-ray image is the question and the inspection result information is the answer. According to such a configuration, the processor 63 estimates whether or not the package 2 is a restricted item candidate based on the newly acquired X-ray image and parameters. The processor 63 can add the estimation result as to whether or not the parcel 2 is a restricted item candidate to the confirmation screen 71A as reference information. Thereby, the inspection device 20 can call the operator's attention.

The processor 63 also acquires an X-ray image of the package 2 as package information and outputs a confirmation screen 71A as reference information including the X-ray image 73 . The operator confirms the X-ray image 73 and determines whether or not the package 2 is a restricted item candidate. When the operator determines that the package 2 is a regulated item candidate, the operator inputs into the operation terminal 17 the reason for presuming that the package 2 is a regulated item candidate (that is, the classification reason). Based on the operation signal, the processor 63 performs an inspection indicating whether or not the operator has judged the package 2 to be a regulated product candidate, and a classification reason indicating the reason why the operator has decided that the package 2 is a regulated product candidate. Generate result information. Furthermore, the processor 63 updates the parameters by machine learning based on learning data in which the X-ray image is the question and the inspection result information is the answer. That is, the processor 63 takes the X-ray image as a problem and generates a parameter in which a classification reason indicating the reason why the operator has judged the package 2 to be a restricted item candidate is set as a classification destination. According to such a configuration, the processor 63 determines whether or not the package 2 is a regulated item candidate and the reason why the package 2 is a regulated item candidate based on the newly acquired X-ray image and the parameters. can be estimated. As a result, the processor 63 can add the estimated result of whether or not the package 2 is a regulated item candidate and the reason why the package 2 is a regulated item candidate to the confirmation screen 71A as reference information. Thereby, the inspection device 20 can call the operator's attention.

The processor 63 also acquires an X-ray image of the package 2 as package information and outputs a confirmation screen 71A as reference information including the X-ray image 73 . The operator confirms the X-ray image 73 and determines whether or not the package 2 is a restricted item candidate. When the operator determines that the package 2 is a regulated item candidate, the operator inputs into the operation terminal 17 the reason for presuming that the package 2 is a regulated item candidate (that is, the classification reason). Further, when the operator determines that the package 2 is a restricted item candidate, the operator inputs the position of the restricted item to the operation terminal 17 on the X-ray image 73A. Based on the operation signal, the processor 63 determines whether or not the operator has judged the package 2 to be a regulated product candidate, a classification reason indicating the reason why the operator has decided that the package 2 is a regulated product candidate, and a list of the regulated products. X-ray image region information indicating the position and inspection result information indicating the position are generated. Furthermore, the processor 63 updates the parameters by machine learning based on learning data in which the X-ray image is the question and the inspection result information is the answer. That is, the processor 63 treats the X-ray image as a problem, and estimates the classification reason indicating the reason why the operator has judged the package 2 to be a restricted item candidate, and the position where the restricted item exists on the X-ray image. Generate parameters for In other words, the processor 63 combines the X-ray image region information generated based on the operator's operation on the X-ray image 73A and the classification reason indicating the reason why the operator has judged the package 2 to be a restricted item candidate. Parameters are generated based on the learning data that is the answer. According to such a configuration, the processor 63 determines whether or not the package 2 is a restricted item candidate, the reason why the package 2 is a restricted item candidate, and the X and an area where it is estimated that the regulated item exists on the line image. Based on the parameters and the newly acquired X-ray image, the processor 63 generates a candidate image indicating an area on the X-ray image where it is estimated that the restricted item exists and the reason for classification. The processor 63 displays the generated candidate images on the confirmation screen 71A as reference information. Thereby, the inspection device 20 can call the operator's attention.

In addition, when the X-ray image is a problem and the parameters are updated by machine learning using the learning data in which the position of the controlled item on the X-ray image is the answer, the processor 63 updates the X-ray image used for machine learning. You can crop the image. For example, the processor 63 crops the X-ray image based on the X-ray image area information, and uses the cropped X-ray image as the training data problem. That is, the processor 63 uses the X-ray image of the region selected by the operator on the X-ray image as the learning data problem. As a result, the inspection apparatus 20 can generate parameters that facilitate the detection of regulated product candidates because unnecessary information is removed from the problem of the learning data.

Further, in the above-described embodiment, based on the selection of buttons such as the regulated item button 81, the dangerous item button 82, the content mismatch button 83, the past history button 84, and the other button 85, "regulated item", "dangerous item ”, “mismatched contents”, “past history”, and “other”, etc., are added to the inspection result information, but the configuration is not limited to this. "Restricted Goods" and "Dangerous Goods" may each be further divided into various items. For example, "controlled items" may be divided into "specific living organisms," "designated drugs," "guns and gun parts," and "counterfeit goods." Also, "dangerous goods" may be divided into "explosives", "explosives", and "specified chemical substances". By dividing the classification reason information in this way, more detailed classification reason information is added to the inspection result information. Thereby, the inspection device 20 can add a more detailed classification reason to the reference information.

Further, the execution of the above inspection program is not limited to the processor 63 of the inspection device 20, and any device having a communication interface and a processor may be used. That is, the inspection program is an inspection program executed by a processor of an apparatus having a communication interface and a processor, wherein the processor receives, through the communication interface, package information about packages being conveyed by a sorter that sorts packages; Acquisition of an operation signal generated based on an operation by an operator is performed. The inspection program also provides the processor with a past history in which inspection result information indicating whether or not a package generated based on an operation signal is a candidate for restricted items and package information are associated with each other, and a newly acquired package. Based on the information, outputting reference information is executed.

Further, as described above, the inspection program may be recorded on a non-temporary recording medium in a state readable by a device having a processor that executes the inspection program.

While several embodiments of the invention have been described, these embodiments have been presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and modifications can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the scope of the invention described in the claims and equivalents thereof.
The scope of claims as originally filed will be added below.
[C1]
a communication interface for acquiring package information about the packages being conveyed by a sorter that sorts the packages and an operation signal generated based on an operator's operation;
based on a past history in which inspection result information indicating whether or not the package is a restricted item candidate generated based on the operation signal is associated with the package information, and the newly acquired package information; a processor that outputs reference information;
An inspection device comprising:
[C2]
The package information is address and name information corresponding to the package,
The inspection device according to C1, wherein the processor generates the reference information based on the number of parcels that are candidates for restricted goods extracted from the past history with the matching address and name information.
[C3]
The package information includes address and name information corresponding to the package,
The processor
when receiving the operation signal indicating that the package includes a controlled item, adding information indicating that the package includes a controlled item to the inspection result information;
The inspection device according to C1, wherein the reference information is generated based on the number of parcels including restricted items extracted from the past history with the matching address and name information.
[C4]
The package information includes address and name information corresponding to the package,
The processor
adding, based on the operation signal, to the inspection result information, a classification reason indicating the reason why the operator has determined that the package is a candidate for restricted goods;
The inspection device according to C1, wherein the reference information is generated based on the number of parcels to which a preset classification reason is added, which is extracted from the past history.
[C5]
the package information includes an X-ray image of the package;
The processor
Whether or not the operator checks the X-ray image and determines that the package is a regulated item candidate based on the operation signal generated based on the input indicating whether the package is a regulated item candidate. generating the inspection result information indicating
C1, wherein the reference information is generated based on parameters generated based on learning data in which the X-ray image is the question and the inspection result information is the answer, and the newly acquired X-ray image inspection equipment.
[C6]
The processor
adding, based on the operation signal, to the inspection result information, a classification reason indicating the reason why the operator has determined that the package is a candidate for restricted goods;
The inspection apparatus according to C5, adding to the reference information a reason why the package is estimated to be a restricted item candidate based on the parameters and the X-ray image.
[C7]
The processor
Based on the X-ray image and the parameter generated based on learning data in which the X-ray image is the problem and the position of the regulated item on the X-ray image is the answer, Generating a candidate image showing an area where it is estimated that a regulated item exists,
The inspection apparatus according to C5, wherein the candidate image is added to the reference information.
[C8]
The inspection apparatus according to C7, wherein the learning data is data in which X-ray image area information indicating an area on the X-ray image is generated as the answer based on operator's operation on the X-ray image.
[C9]
The learning data includes X-ray image area information indicating the area on the X-ray image and the reason why the operator has determined that the baggage is a restricted item candidate based on the operator's operation on the X-ray image. The inspection apparatus according to C7, wherein the indicated reason for classification is the data generated as the answer. [C10]
The processor
The inspection according to C9, wherein, based on the parameters and the X-ray image, the candidate image is generated that indicates an area on the X-ray image in which the restricted item is estimated to exist and the reason for classification. Device.
[C11]
The inspection apparatus according to C5, wherein the processor updates the parameter based on the learning data.
[C12]
The processor adds an operator identification code for identifying an operator to the inspection result information,
The inspection apparatus according to C11, wherein the processor updates the parameters with different weights for each operator who has generated the learning data.
[C13]
the communication interface acquires address and name information from the sender information and recipient information displayed on the package;
The inspection device according to C1, wherein the parcel information includes at least one of the sender information and recipient information of the address and name information.
[C14]
The communication interface acquires EAD information matching the EAD identification code read from the parcel from a storage medium in which a plurality of pieces of EAD information including sender information and recipient information are stored in advance, and includes the EAD information in the acquired EAD information. Get the name and address information stored in the
The inspection device according to C1, wherein the parcel information includes at least one of the sender information and recipient information of the address and name information.
[C15]
An inspection program executed by an inspection device comprising a communication interface and a processor,
In the inspection device,
causing the communication interface to acquire package information about the packages being conveyed by a sorter that sorts packages and an operation signal generated based on an operator's operation;
A past history in which inspection result information indicating whether or not the package is a restricted item candidate generated by the processor based on the operation signal is associated with the package information; and the newly acquired package information. and to output reference information based on,
inspection program.

DESCRIPTION OF SYMBOLS 1... Inspection system, 2... Baggage, 3... EAD tag, 4... Form, 11... Sorter, 12... Sorter control device, 13... EAD tag reader, 14... Camera, 15... X-ray apparatus, 16... Form reader, 17 ... operation terminal, 18 ... first storage device, 19 ... second storage device, 20 ... inspection device, 21 ... network, 31 ... first sorting destination, 32 ... second sorting destination, 41 ... first Conveyor 42 Second conveyor 43 Sorting mechanism 51 Communication interface 52 Control unit 53 Touch panel 54 Processor 55 Memory 56 Display 57 Touch sensor 61 Communication interface 62... Control unit, 63... Processor, 64... Memory.

Claims (12)

A communication interface for acquiring package information including address and name information and an X-ray image of the package obtained by character recognition processing from an image of the package being conveyed, and an operation signal generated based on an operation by an operator. When,
The address obtained from the newly conveyed package from the past history in which the package information is associated with the inspection result information indicating whether the package is a candidate for restricted goods generated based on the operation signal. a processor that extracts the inspection result information corresponding to the package information including name information as an extraction result;
and
When the processor determines that it is necessary to confirm the opening of the package based on the operation signal, the processor receives an input of the result of the confirmation of opening, adds information indicating the result to the inspection result information ,
Based on the X-ray image and parameters generated based on learning data in which the X-ray image is the problem and the position of the restricted item on the X-ray image is the answer, generate a candidate image showing the area where the product is presumed to exist;
outputting the candidate image;
adding an operator identification code for identifying an operator to the inspection result information;
The processor updates the parameters with different weights based on the learning data for each operator who generated the learning data.
inspection equipment. 2. The inspection apparatus according to claim 1, wherein said processor outputs said inspection result information included in said extraction result on a confirmation screen. 3. The inspection apparatus according to claim 1, wherein the processor outputs an X-ray image of the newly transported baggage to a confirmation screen. 4. The inspection apparatus according to any one of claims 1 to 3, wherein the processor outputs an image of the newly transported package to a confirmation screen. 2. The inspection apparatus according to claim 1, wherein said processor outputs information based on the number of parcels, which are candidates for restricted goods, extracted from said past history with matching address and name information. The processor
when receiving the operation signal indicating that the package includes a controlled item, adding information indicating that the package includes a controlled item to the inspection result information;
2. The inspection apparatus according to claim 1, which outputs information based on the number of parcels including restricted items extracted from the past history with the matching address and name information. 2. The examination according to claim 1 , wherein said learning data is data in which X-ray image area information indicating an area on an X-ray image is generated as said answer based on an operator's operation on said X-ray image. Device. The learning data includes X-ray image area information indicating the area on the X-ray image and the reason why the operator has determined that the baggage is a restricted item candidate based on the operator's operation on the X-ray image. 2. The inspection apparatus according to claim 1 , wherein the indicated reason for classification is the data generated as the answer. The processor
9. The candidate image according to claim 8 , wherein said candidate image indicating an area on said X-ray image where it is estimated that a restricted product exists and said reason for classification is generated based on said parameter and said X-ray image. inspection equipment. The communication interface acquires sender information and recipient information displayed on the package,
2. The inspection apparatus according to claim 1, wherein said parcel information includes at least one of said sender information and receiver information as said address and name information. the communication interface acquires EAD information matching the EAD identification code read from the package from a storage medium in which a plurality of pieces of EAD information including sender information and recipient information are stored in advance;
2. The inspection apparatus according to claim 1, wherein said parcel information includes at least one of said sender information and receiver information as said address and name information. An inspection program executed by an inspection device comprising a communication interface and a processor,
In the inspection device,
Through the communication interface, package information including address and name information and an X-ray image of the package obtained by character recognition processing from an image of the package being conveyed, an operation signal generated based on an operation by an operator; and a function that performs
The processor obtains a new data from the past history in which the inspection result information indicating whether or not the package is a restricted item candidate generated based on the operation signal is associated with the address and name information and the X-ray image. a function of extracting, as an extraction result, the inspection result information corresponding to the package information including the address and name information acquired from the package transported to the
a function of accepting an input of a result of confirmation of opening when it is determined that confirmation of opening of the package is necessary based on the operation signal, and adding information indicating the result to the inspection result information;
Based on the X-ray image and parameters generated based on learning data in which the X-ray image is the problem and the position of the restricted item on the X-ray image is the answer, a function of generating and outputting a candidate image showing an area where it is estimated that a product exists;
a function of adding an operator identification code for identifying an operator to the inspection result information;
The processor has a function of updating the parameters with different weights based on the learning data for each operator who generated the learning data;
An inspection program that realizes

Images