JP2023010954A - Article management device, article management system, article management method, and article management program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an article management device capable of reducing a work burden regarding management of articles entering a warehouse or the like as a cargo.

SOLUTION: Article information concerning articles in cargos 7 and cargo identification information for uniquely identifying the individual cargos 7 are registered on a management DB 3 in association with each other. The cargo identification information is information indicated by an identification label 72 pasted on a cargo 7, and can be read without visual observation. For example, if the cargo identification information is represented by an optical code such as a bar code, the cargo identification information can be easily read by means of a device such as a bar code reader. The invention can thus significantly reduce a burden of collation work with visual observation in the case of managing articles entering a warehouse or the like as the cargos 7.

SELECTED DRAWING: Figure 3

COPYRIGHT: (C)2023,JPO&INPIT

Description

The present invention relates to an article management apparatus, an article management system, an article management method, and an article management program that perform processing related to management of warehousing of articles.

When an article is received as cargo in a warehouse or the like, an acceptance inspection is performed to confirm the content of the received cargo. In this warehousing inspection work, the delivery note attached to the cargo is compared with the cargo label (product label, etc.) attached to the cargo, and the information (product number, quantity, etc.) on the delivery note is matched. , the information on the goods on the cargo label is checked for consistency. In addition, when the information on the delivery note is provided in advance by e-mail or the like as warehousing data, the work of collating the information described on the delivery note with the warehousing data is also carried out.

After receiving and inspecting the cargo, the cargo is stored in a predetermined location such as a warehouse, and the information on the invoice (or the information on the received data) and the information on the storage location are registered in the warehouse management system. Also, an item slip containing this registration information is printed and attached to the cargo instead of the delivery note. At this time, an operation is performed to collate the cargo label and the tag.

When the shipment of goods is instructed by the shipping instruction, the work of picking the goods from a storage place such as a warehouse is carried out. In this picking operation, the information described in the shipping instruction is collated with the information described in the cargo label of the picked cargo. Also, in the shipping acceptance inspection work for finally shipping the goods, the work of collating the information described in the shipping instruction sheet and the information described in the cargo label is performed.

As mentioned above, from the time goods are stored as cargo in a warehouse, etc. until they are shipped, the information written on paper documents (delivery slips, shipping instructions) and the information on the cargo labels affixed to the cargo The work of matching is done many times. In general, this collation work may be performed visually, which poses a problem that the burden on the operator is heavy and mistakes are likely to occur.

The present invention has been made in view of such circumstances, and its object is to provide an article management apparatus, an article management system, an article management method, and an article management program capable of reducing the work load associated with the management of articles received as cargo in a warehouse or the like. is to provide

An article management apparatus according to a first aspect of the present invention is an article management apparatus capable of communicating with one or more terminal devices having an imaging function, comprising: a first processing unit; and the first processing unit is capable of accessing a management database that stores information about the received goods, and the first processing unit responds to the command of the first storage unit The processing to be executed in response is an image of the delivery note imaged by the terminal device, and based on the image of the delivery note attached to the cargo including the goods, the a first information acquisition step of acquiring delivery note information including article information about articles; and an image of the freight captured by the terminal device, the image of the freight including an image of a freight label affixed to the freight. a second information acquiring step of acquiring cargo label information including the item information indicated on the cargo label, and the item information of the acquired delivery note information and the acquired item of the cargo label information a first matching determination step of determining whether the information matches with the information; and if it is determined that the item information of the delivery note information and the item information of the cargo label information match, each of the cargoes is uniquely identified. and a registration step of associating the cargo identification information with the goods information of the matched cargo label information and registering it in the management database, wherein the image of the cargo captured by the terminal device is attached to the cargo. an image of an identification label including an image of the identification label in which the cargo identification information is indicated, wherein the second information acquisition step is performed based on the image of the cargo including the image of the identification label The registration step includes associating the acquired cargo identification information with the article information of the matched cargo label information and registering them in the management database.

Preferably, the processing executed by the first processing unit in response to the command of the first storage unit is a warehousing process for acquiring warehousing data including order identification information for identifying individual orders and the article information. a data acquisition step, a storage data specifying step of specifying the storage data corresponding to the delivery slip information acquired in the first information acquisition step, based on the order identification information included in the delivery slip information; 1. a second matching determination step of determining whether the article information included in the delivery note information acquired in the information acquisition step matches the article information included in the warehousing data specified in the warehousing data specifying step; said registering step, when said article information included in said warehousing data specified in said warehousing data specifying step and said article information included in said statement of delivery information acquired in said first information acquiring step match said first 2 the article information included in the delivery note information determined in the match determination step and acquired in the first information acquisition step and the article information included in the cargo label information acquired in the second information acquisition step; and registering them in the management database in association with the article information and the freight identification information of the freight label information when it is determined in the first matching determination step that the two match.

An article management system according to a second aspect of the present invention includes at least one terminal device having an imaging function and an article management device capable of communicating with the terminal device, wherein the article management device includes a first processing unit and a first storage unit that stores instructions executable in the first processing unit, the first processing unit is capable of accessing a management database that stores information about the received goods, and the terminal device is , an imaging unit, a second processing unit, and a second storage unit that stores instructions executable in the second processing unit, wherein the second processing unit executes according to the instructions in the second storage unit. The processing includes a delivery note imaging step of capturing an image of a delivery note attached to cargo including the goods with the imaging unit, and a cargo imaging step of capturing an image of the cargo with the imaging unit, wherein the first The process executed by the processing unit in response to the command of the first storage unit is based on the image of the delivery note imaged by the terminal device, based on the image of the delivery note. and a first information acquisition step for acquiring delivery note information containing, and an image of the cargo captured by the terminal device, based on the image of the cargo including the image of the cargo label attached to the cargo, a second information acquisition step of acquiring cargo label information including the item information indicated on the cargo label; and matching the item information in the acquired delivery note information with the item information in the acquired cargo label information. and a cargo identification for uniquely identifying each individual cargo when it is determined that the item information of the delivery note information and the item information of the cargo label information match. and a registration step of associating the information with the article information of the matched freight label information and registering it in the management database, wherein the freight imaging step is an image of an identification label affixed to the freight, capturing an image of the cargo including an image of the identification label in which cargo identification information is indicated, wherein the second information acquisition step is based on the image of the cargo including the image of the identification label; The registration step includes associating the acquired cargo identification information with the article information of the matched cargo label information and registering them in the management database.

An article management method according to a third aspect of the present invention is an article management method executed by a computer capable of communicating with one or more terminal devices having an image capturing function, wherein the computer stores information on goods received. Based on the image of the delivery note attached to the cargo including the goods, the image of the delivery note captured by the terminal device is accessible to a management database, and the contents of the cargo shown in the delivery note a first information acquisition step of acquiring statement of delivery information including article information about the article; and an image of the freight imaged by the terminal device, the image of the freight including an image of a freight label affixed to the freight. a second information acquiring step of acquiring cargo label information including the article information indicated on the cargo label based on the image; a first match determination step of determining whether the item information matches with the item information; and when it is determined that the item information of the delivery note information and the item information of the cargo label information match, each of the cargo is uniquely identified. and a registration step of associating the freight identification information for identifying the freight label information with the article information of the matched freight label information and registering it in the management database, wherein the image of the freight captured by the terminal device is attached to the freight. an image of the attached identification label, which includes an image of the identification label in which the cargo identification information is indicated; The registration step includes associating the acquired cargo identification information with the article information of the matched cargo label information and registering them in the management database.

An article management program according to a fourth aspect of the present invention is an article management program that causes a computer capable of communicating with one or more terminal devices having an image capturing function to execute processing, and the computer stores information about goods that have entered storage. The processing that the goods management program causes the computer to execute is an image of the statement of delivery captured by the terminal device, and an image of the statement of delivery attached to the cargo containing the goods. a first information acquisition step of acquiring delivery note information including article information related to the article in the cargo indicated on the delivery note, and an image of the cargo captured by the terminal device, wherein the a second information acquisition step of acquiring cargo label information including the article information indicated on the cargo label based on the image of the cargo including the image of the cargo label affixed to the cargo; and the acquired delivery note. a first matching determination step of determining whether the item information of the information and the item information of the acquired cargo label information match; and matching the item information of the delivery note information and the item information of the cargo label information. a registration step of associating freight identification information for uniquely identifying each freight with the article information of the matched freight label information and registering the same in the management database when it is determined that the terminal The image of the cargo imaged by the device is an image of an identification label affixed to the cargo, and includes an image of the identification label indicating the cargo identification information, and the second information acquisition step includes: acquiring the cargo identification information based on the image of the cargo including the image of the identification label, wherein the registration step includes combining the acquired cargo identification information with the item information of the matched cargo label information; are associated with each other and registered in the management database.

According to the present invention, it is possible to provide an article management apparatus, an article management system, an article management method, and an article management program that can reduce the work load associated with the management of articles that have been stored in a warehouse or the like as cargo.

FIG. 1 is a diagram showing an example of the configuration of an article management system according to this embodiment. FIG. 2A is a diagram illustrating an example of the configuration of an article management apparatus; FIG. 2B is a diagram illustrating an example of a configuration of a terminal device; FIG. 3 is a flowchart for explaining an example of an article management method. FIG. 4 is a flowchart for explaining an example of processing for acquiring statement of delivery information from an image of the statement of delivery. FIG. 5 is a flowchart for explaining a modified example of processing for acquiring statement of delivery information from an image of the statement of delivery. FIG. 6 is a flowchart for explaining an example of processing for acquiring cargo label information and cargo identification information from an image of cargo. FIG. 7 is a flowchart for explaining an example of processing for acquiring cargo label information and cargo identification information from an image of cargo. 8A to 8C are diagrams showing examples of screens of the terminal device. 9A to 9C are diagrams showing examples of screens of the terminal device. 10A to 10C are diagrams showing examples of screens of the terminal device. 11A to 11C are diagrams showing examples of screens of the terminal device. 12A to 12C are diagrams showing examples of screens of the terminal device. FIG. 13 is a flowchart for explaining a modified example of processing for acquiring statement of delivery information from an image of the statement of delivery.

FIG. 1 is a diagram showing an example of the configuration of an article management system according to this embodiment. The article management system shown in FIG. 1 is a system for managing articles received as cargo 7 in a warehouse or the like, and has an article management device 1 and a terminal device 2 . The article management device 1 and the terminal device 2 can communicate with each other via a communication network 9 such as the Internet.

The article management device 1 is a device that performs processing related to management of articles received as cargo 7 in a warehouse or the like, and accesses a database (hereinafter sometimes abbreviated as "DB") storing predetermined information. It is possible. In the example of FIG. 1, the article management apparatus 1 can access a management database 3, a statement of delivery format database 4, and a freight label format database 5. FIG. The article management apparatus 1 may access these databases via one or more arbitrary communication means. This communication means may include a communication network such as a LAN or the Internet. Also, the communication means may be wired or wireless, or may include both.

The management DB 3 stores information about the goods that have been stocked. For example, the management DB 3 associates with the cargo identification information for identifying each received cargo 7, information on the goods in the cargo 7 (product number, quantity, lot number, etc.), storage location of the cargo 7 in the warehouse etc. store information about

The delivery note format DB 4 stores information on the format (delivery note format) of the delivery note 6 attached to the cargo 7 including the goods. The delivery note format is a format related to the position and range of one or more items (delivery note items) included in the delivery note. For example, the delivery note format DB 4 associates the delivery note format identification information that identifies the delivery note format of the delivery note 6 with the delivery note items (order number, product number, quantity, lot number, business name) described on the delivery note 6. , a logo representing the company), information on the position and range of each item on the delivery note 6, information on the ruled lines included in the delivery note 6, information on the size of the delivery note 6, and the like. In addition, the delivery note format DB4 is used when the delivery note 6 includes a one-dimensional optical code (barcode, etc.) or a two-dimensional optical code (QR code (registered trademark), Data Matrix (registered trademark), PDF417, etc.). , information about the optical code (type of optical code, identifier information for identifying individual pieces of information included in the optical code, editing information of the optical code, etc.) may be stored.

The freight label format DB 5 stores information on the format (freight label format) of the freight label 71 such as the product label attached to each freight 7 . The cargo label format is a format related to the position and range of one or more items (freight label items) included in the cargo label. For example, the cargo label format DB 5 associates the cargo label format identification information identifying the cargo label format of the cargo label 71 with the cargo label items (product number, quantity, lot number, company name, company ), information on the position and range of each item on the cargo label 71, information on the ruled lines included in the cargo label 71, information on the size of the cargo label 71, and the like. Further, the cargo label format DB 5 stores information (such as product numbers) identifying the types of goods (models, etc.) and cargo label format identification information in association with each other. Furthermore, in the cargo label format DB5, if the cargo label 71 contains a one-dimensional optical code (barcode, etc.) or a two-dimensional optical code (QR code (registered trademark), Data Matrix (registered trademark), PDF417, etc.), Information about the optical code (type of optical code, identifier information for identifying individual pieces of information included in the optical code, editing information of the optical code, etc.) may be stored.

FIG. 2A is a diagram showing an example of the configuration of the article management apparatus 1. As shown in FIG. The article management apparatus 1 shown in FIG. 2A has a communication section 11, a first storage section 17, and a first processing section .

The communication unit 11 communicates with other devices (such as the terminal device 2 ) via the communication network 9 . For example, the communication unit 11 may include communication equipment such as a network interface card.

The first storage unit 17 stores a program PG1 including instructions executable by the first processing unit 18, data used for processing by the first processing unit 18, data generated by processing by the first processing unit 18, and the like. do. For example, the first storage unit 17 may include one or more arbitrary storage devices such as DRAM, SRAM, flash memory, SSD, and hard disk. The storage device of the first storage unit 17 may be connected to the first processing unit 18 via one or more arbitrary data transmission means.

The first processing unit 18 executes processing according to instructions of the program PG1 stored in the first storage unit 17 . For example, the first processing unit 18 may include one or more processors (CPU, microprocessor, DSP, etc.). One or more processors of the first processing unit 18 each execute processing according to instructions of a program, so that the first processing unit 18 operates as one or more computers. Note that the first processing unit 18 may execute at least part of the processing by dedicated hardware (FPGA, ASIC, etc.) instead of the processor.

The first processing unit 18 acquires statement of delivery information (order number, product number, quantity, lot number, etc.) based on the image of the statement of delivery 6 captured by the terminal device 2 . The delivery note information includes item information indicated on the delivery note 6 (information regarding the items in the cargo 7). For example, the statement of delivery information includes character information (printed characters, handwritten characters, etc.) and optical codes (barcode, QR code (registered trademark), etc.).

In addition, the first processing unit 18 acquires in advance warehousing data including order identification information (for example, an order number) for identifying each order and article information. The first processing unit 18 identifies warehousing data corresponding to the statement of delivery information acquired from the image of the statement of delivery 6 based on the order identification information (for example, the order number) included in the statement of delivery information. That is, the first processing unit 18 identifies the receipt data containing the same order identification information as that included in the statement of delivery information as the receipt data corresponding to the statement of delivery information. The first processing unit 18 determines whether the item information included in the identified warehousing data matches the item information included in the delivery note information acquired from the image of the delivery note 6 .
Note that the first processing unit 18 does not specify the warehousing data corresponding to the delivery slip information acquired from the image of the delivery slip 6 by the order identification information (for example, the same order identification information is included in a plurality of warehousing data). case, etc.), the storage data may be specified according to the user's instruction input from the terminal device 2 . For example, the first processing unit 18 causes the terminal device 2 to display a list of candidates for warehousing data corresponding to the delivery slip information acquired from the image of the delivery slip 6, and the user selects one warehousing data item from this list. may be input from the terminal device 2 and the warehousing data may be identified according to the input instruction.

Furthermore, based on the image of the cargo 7 captured by the terminal device 2, the first processing unit 18 determines the cargo label information (product number, quantity, lot number, etc.) indicated on the cargo label 71 and the identification label 72. obtain the cargo identification information.
An image of the cargo 7 captured by the terminal device 2 includes a cargo label 71 and an identification label 72 affixed to the cargo 7, as shown in FIG. The cargo label information includes the item information indicated on the cargo label 71 (information about the items in the cargo 7). For example, cargo label information includes character information (printed characters, handwritten characters, etc.) and optical codes (barcodes, QR codes (registered trademark), etc.). The freight identification information is information for uniquely identifying each freight 7, and includes, for example, an optical code (bar code, QR code (registered trademark), etc.).
Then, the first processing unit 18 determines whether the item information of the delivery note information acquired from the image of the delivery note 6 matches the item information of the cargo label information acquired from the image of the cargo 7 .

The first processing unit 18 determines that the product information in the delivery note information acquired from the image of the delivery note 6 and the product information in the cargo label information acquired from the image of the cargo 7 match, and from the image of the delivery note 6 When it is determined that the item information in the acquired delivery note information and the item information included in the warehousing data specified based on the order number, etc. match, the cargo identification information acquired from the image of the cargo 7 matches in the above determination. The product information (product number, quantity, lot number, etc.) determined to be related to each other is registered in the management DB 3 . The product information registered in the management DB 3 may be, for example, product information included in the cargo label information acquired from the image of the cargo 7 .

Note that when the warehousing data is not provided, the first processing unit 18 determines that the article information in the delivery note information acquired from the image of the delivery note 6 matches the article information in the cargo label information acquired from the image of the cargo 7. on the condition that the freight identification information obtained from the image of the freight 7 and the article information may be associated and registered in the management DB 3 .
Further, when the receipt data is not provided, the first processing unit 18 determines whether or not the information (for example, the item number) of the predetermined delivery statement items included in the product information of the delivery statement information acquired from the image of the delivery statement 6 is appropriate. However, only the statement of delivery information determined to be appropriate in this determination may be registered in the management DB 3 . For example, a list of known information suitable as predetermined delivery note items is stored in the first storage unit 17 or a database (not shown). If the information of a given invoice item included in the article information is included in this list, it is determined that the information is appropriate.

FIG. 2B is a diagram showing an example of the configuration of the terminal device 2. As shown in FIG. The terminal device 2 shown in FIG. 2B is a device such as a smartphone having an imaging function and a communication function, and includes a communication unit 21, an input unit 22, an imaging unit 23, a display unit 24, and a sound input/output unit 25. , a second storage unit 27 and a second processing unit 28 .

The communication unit 21 communicates with other devices (such as the article management device 1) via the communication network 9. FIG. For example, the communication unit 21 may include communication equipment such as a network interface card.

The input unit 22 is a device for inputting information according to user instructions, and includes, for example, a touch panel, buttons, switches, and the like.
The imaging unit 23 is a device that captures an image, and includes, for example, a camera.
The display unit 24 is a device that displays an image, and includes, for example, a liquid crystal panel and an organic EL panel.
The sound input/output unit 25 is a device for inputting/outputting sound, and includes, for example, a speaker and a microphone.

The second storage unit 27 stores a program PG2 including instructions that can be executed by the second processing unit 28, data used for processing by the second processing unit 28, data generated by processing by the second processing unit 28, and the like. do. For example, the second storage unit 27 may include one or more arbitrary storage devices such as DRAM, SRAM, flash memory, SSD, and hard disk. The storage device of the second storage section 27 may be connected to the second processing section 28 via one or more arbitrary data transmission means.

The second processing unit 28 executes processing according to instructions of the program PG2 stored in the second storage unit 27 . For example, the second processing unit 28 may include one or more processors (CPU, microprocessor, DSP, etc.). One or more processors of the second processing unit 28 each execute processing according to instructions of a program, so that the second processing unit 28 operates as one or more computers. Note that the second processing unit 28 may execute at least part of the processing by dedicated hardware (FPGA, ASIC, etc.) instead of the processor.

When the second processing unit 28 executes processing related to management of goods received based on the program PG2, the second processing unit 28 captures an image of the statement of delivery 6 based on the display on the screen of the display unit 24 and the sound emitted by the sound input/output unit 25. Then, an image of the invoice 6 photographed in response to this instruction is transmitted to the article management apparatus 1 . In addition, the second processing unit 28 instructs to capture an image of the cargo 7 (an image including the cargo label 71 and the identification label 72) by displaying the screen of the display unit 24 or by the sound emitted by the sound input/output unit 25. , and an image of the cargo 7 captured according to this instruction is transmitted to the article management apparatus 1 .

FIG. 3 is a flow chart for explaining an example of an article management method in the system shown in FIG.

The first processing unit 18 of the article management apparatus 1 acquires warehousing data including order identification information for identifying individual orders and statement of delivery information (ST100). For example, the first processing unit 18 imports the warehousing data from a file such as a CSV format and temporarily stores it in the first storage unit 17 .

The second processing unit 28 of the terminal device 2 outputs an instruction prompting to take a picture of the statement of delivery 6 on the screen of the display unit 24, the speaker of the sound input/output unit 25, or the like, and an image of the statement of delivery 6 captured in response to this instruction. to the article management apparatus 1 (ST105).

The first processing unit 18 of the article management apparatus 1 receives the image of the delivery slip 6 captured by the terminal device 2, and based on the received image, stores the delivery slip information (order number, product number, quantity, lot number, etc.) is acquired (ST110).

For example, in step ST<b>110 , the first processing unit 18 obtains character information included in the delivery note 6 by performing optical character recognition processing on the image of the delivery note 6 . In this case, the first processing unit 18 causes another server device connected to the communication network 9 to perform optical character recognition processing on the image of the statement of delivery 6, and converts the character information obtained as a result of the optical character recognition processing to You may acquire from a server apparatus. This server device may be a self-operated (on-premise) device, or may be a cloud-type device operated by an external business operator. If there are a plurality of optical character recognition processing units (server device, application program, etc.), the first processing unit 18 selects one of them according to the user's instruction, and delivers the data by the selected optical character recognition processing unit. Character information of the image of the calligraphy 6 may be obtained.

The first processing unit 18 also uses the learned model stored in the first storage unit 17 to perform processing for identifying the delivery note format of the delivery note 6 . This trained model is a machine-learned model (for example, generated by deep learning) to identify the delivery note format of the delivery note 6 from the given image of the delivery note 6 (for example, output delivery note format identification information). It is a model that constitutes a multi-layered neural network). The first processing unit 18 identifies the delivery note format of the delivery note 6 by applying the image of the delivery note 6 received from the terminal device 2 to this trained model. The first processing unit 18 acquires information on the delivery note format of the delivery note 6 identified by the learned model (information on the position and range of each delivery note item, etc.) from the delivery note format DB 4 .

Then, the first processing unit 18, based on the character information acquired by the optical character recognition processing and the information on the delivery note format of the delivery note 6 acquired from the delivery note format DB 4, to get

If the statement of delivery 6 contains a one-dimensional or two-dimensional optical code, the first processing unit 18 acquires information by decoding this optical code. In this decoding process, the first processing unit 18 collects information about the optical code in the delivery note 6 registered in the delivery note format DB 4 (optical code type, identifier for identifying each piece of information included in the optical code information, optical code editing information, etc.). Information about the optical code may be stored in a database different from the invoice format DB4.

Also, the trained model stored in the first storage unit 17 may be generated so as to directly estimate and output information regarding the delivery note format of the delivery note 6 from the given image of the delivery note 6 . In this case, the first processing unit 18 applies the image of the statement of delivery 6 received from the terminal device 2 to this learned model, thereby obtaining the format of the statement of delivery 6 from the learned model instead of the statement of delivery format DB 4 . You may obtain information about

On the other hand, if it does not have a learned model as described above, the first processing unit 18 of the article management device 1, in accordance with the user's instruction input at the terminal device 2, obtains information on the delivery note format of the delivery note 6. The delivery note information shown on the delivery note 6 may be obtained based on the information on the delivery note format obtained from the delivery note format DB 4 and the character information obtained by optical character recognition processing.
For example, when transmitting the image of the delivery note 6 to the article management apparatus 1 , the second processing unit 28 of the terminal device 2 converts the delivery note format of the delivery note 6 according to the user's instruction input in the input unit 22 . (for example, delivery note format identification information) is transmitted to the article management apparatus 1. The first processing unit 18 of the article management device 1 acquires information on the delivery note format of the delivery note 6 specified by the user of the terminal device 2 from the delivery note format DB 4 . For example, the first processing unit 18 determines the range of each delivery statement item of the delivery statement 6 based on the relationship between the ruled line information in the information on the delivery statement format of the delivery statement 6 acquired and the ruled lines appearing in the image of the delivery statement 6. The information of each statement of delivery item of the statement of delivery 6 is obtained from the character information included in the specified range. Alternatively, the first processing unit 18 acquires the position coordinates of each character appearing in the image of the delivery note 6 (coordinates when a predetermined position of the delivery note 6 is set as the origin), and converts the acquired position coordinates of each character to Based on this, it is possible to determine which item of the statement of delivery 6 each character is included in, and obtain information of each statement of delivery item of the statement of delivery 6 based on the result of this determination.

Also, in step ST110, the first processing unit 18 sends information about each delivery note item (order number, product number, quantity, lot number, etc.) of the delivery note information in the information about the delivery note format of the delivery note 6 to the terminal device 2. You may make it display on the display part 24. FIG.
For example, the first processing unit 18 transmits to the terminal device 2 information about the name and range of each delivery statement item in the delivery statement information in the information related to the delivery statement format of the delivery statement 6 . The second processing unit 28 of the terminal device 2 that has received this information displays the name and range of each item of the statement of delivery in the statement of delivery information on the image of the statement of delivery 6 displayed on the display unit 24 . Alternatively, the second processing unit 28 may display the name and range of each statement of delivery item in the statement of delivery information in a window separate from the image of the statement of delivery 6 displayed on the display unit 24 .

In this case, the second processing unit 28, according to the user's instructions input at the input unit 22, displays the name of each statement of delivery item and the range of each statement of delivery item superimposed on the image of the statement of delivery 6. may be modified. In addition, the second processing unit 28 adds new delivery note item information (name of delivery note item, range of delivery note item) to the image of the delivery note 6 in accordance with the user's input instructions. may The second processing unit 28 transmits to the goods management apparatus 1 information on the delivery note items of the delivery note 6 (the name of the delivery note item, the range of the delivery note item) that has been modified or added according to the user's instruction. do. The first processing unit 18 of the article management apparatus 1 updates the information on the delivery note format of the delivery note 6 according to this information received from the terminal device 2, and based on the updated information on the delivery note format and the character information to acquire the statement of delivery information indicated on the statement of delivery 6.

In addition, information on the delivery note format of the delivery note 6 (if there is a correction or addition according to the instruction of the user of the terminal device 2, updated information according to the correction or addition) and the image captured by the terminal device 2 The combination with the image of the invoice 6 obtained can be used as training data for generating the above-described learned model. Therefore, the first processing unit 18 of the article management apparatus 1 stores the teacher data (combination of the information on the delivery note format of the delivery note 6 and the image of the delivery note 6) obtained in step ST110 as the first storage unit 17 or other storage device (database, etc.).

When the statement of delivery information is acquired as described above, the first processing unit 18 next processes order identification information (for example, an order number) for identifying each order, which is included in the statement of delivery information. , the storage data corresponding to the statement of delivery information acquired from the image of the statement of delivery 6 is identified (ST115).

After identifying the warehousing data corresponding to the delivery note 6, the first processing unit 18 next identifies the article information included in the identified warehousing data and the article information included in the delivery note information obtained from the image of the delivery note 6. matches (ST125). For example, when the item information included in the specified warehousing data and the item information included in the delivery note information acquired from the image of the delivery note 6 match, the first processing unit 18 determines that the item information matches.

Note that the first processing unit 18 determines that the quantity of goods specified in the item information of the delivery note information acquired from the image of the delivery note 6 is smaller than the quantity of items specified in the item information of the identified warehousing data. Even in this case, if other items (product number, etc.) of the product information match, it may be determined that the product information matches. As a result, for example, when the quantity of goods specified in the goods information of the receipt data is received in multiple batches, the goods information of the goods receipt data and the goods information of the statement of delivery are not determined to be inconsistent. can be

If it is determined in step ST125 that the article information matches (Yes in ST125), the first processing section 18 temporarily stores the statement of delivery information in the first storage section 17 (ST130).

When it is determined in step ST125 that the article information is inconsistent (No in ST125), the first processing section 18 executes predetermined error processing (ST135). For example, the first processing unit 18 transmits an error notification to the terminal device 2 informing that the item information in the warehousing data and the item information in the invoice information are inconsistent. The second processing unit 28 of the terminal device 2 that has received this error notification causes the display unit 24 to display the error notification or causes the sound input/output unit 25 to output a sound indicating the error.

When the first processing unit 18 of the article management apparatus 1 determines that the article information matches in step ST125, it transmits a notification to that effect to the terminal device 2. FIG. The second processing unit 28 of the terminal device 2 that has received this notification instructs the screen of the display unit 24, the speaker of the sound input/output unit 25, or the like to prompt the photographing of the cargo 7 (range including the cargo label 71 and the identification label 72). , and an image of the cargo 7 picked up according to this instruction is sent to the article management apparatus 1 (ST140).

The identification label 72 is attached to a location near the cargo label 71 on the cargo 7 after the cargo 7 to which the cargo label 71 is attached is stored. The operation of attaching the identification label 72 to the cargo 7 may be performed immediately before the image of the cargo 7 is captured by the terminal device 2 at the latest. For example, if the identification label 72 is affixed after the terminal device 2 receives the notification that the statement of delivery information has been matched in step ST125, the identification label is applied to the cargo 7 for which the statement of delivery information has been determined to be inconsistent. 72 pasting can be avoided.

The first processing unit 18 of the article management device 1 receives the image of the cargo 7 (image including the cargo label 71 and the identification label 72) captured by the terminal device 2, and extracts the cargo label included in the received image of the cargo 7. Cargo label information (product number, quantity, lot number, etc.) is acquired based on the image 71, and cargo identification information is acquired based on the image of the identification label 72 included in the received image of the cargo 7 (ST145).

For example, in step ST<b>145 , the first processing section 18 acquires cargo identification information indicated on the identification label 72 based on the image of the identification label 72 included in the image of the cargo 7 . If the cargo identification information indicated on the identification label 72 is a predetermined optical code such as a bar code, the first processing unit 18 performs predetermined decoding processing corresponding to the predetermined optical code to convert information (character , numbers, symbols, etc.).

In step ST<b>145 , the first processing unit 18 acquires character information included in the cargo label 71 by performing optical character recognition processing on the image of the cargo 7 including the image of the cargo label 71 . In this case, the first processing unit 18 causes another server device connected to the communication network 9 to perform optical character recognition processing on the image of the cargo 7, and transmits character information obtained as a result of the optical character recognition processing to the server. may be obtained from the device. If there are a plurality of optical character recognition processing units (server device, application program, etc.), the first processing unit 18 selects one of them according to the user's instruction, and uses the selected optical character recognition processing unit to recognize the cargo. 7 may be acquired.

The first processing unit 18 also uses the learned model stored in the first storage unit 17 to perform processing for identifying the cargo label format of the cargo label 71 . This trained model is a machine-learned model (for example, a model generated by deep learning) to identify the cargo label format of the cargo label 71 from the given image of the cargo 7 (for example, output cargo label format identification information). It is a model that constitutes a multi-layer neural network). The first processing unit 18 identifies the cargo label format of the cargo label 71 by applying the image of the cargo 7 received from the terminal device 2 to this learned model. The first processing unit 18 acquires information on the cargo label format of the cargo label 71 identified by the learned model (information on the position and range of each cargo label item, etc.) from the cargo label format DB 5 .

Then, the first processing unit 18 converts the cargo label information indicated on the cargo 7 based on the character information acquired by the optical character recognition processing and the information on the cargo label format of the cargo label 71 acquired from the cargo label format DB 5. get.

When the cargo label 71 includes a one-dimensional or two-dimensional optical code, the first processing unit 18 acquires information by decoding this optical code. In this decoding process, the first processing unit 18 collects information about the optical code in the cargo label 71 registered in the cargo label format DB 5 (type of optical code, identifier for identifying individual information included in the optical code information, optical code editing information, etc.). Information about the optical code may be stored in a database different from the cargo label format DB5.

Also, the learned model stored in the first storage unit 17 may be generated so as to directly estimate and output information regarding the cargo label format of the cargo label 71 from the given image of the cargo 7 . In this case, the first processing unit 18 applies the image of the cargo 7 received from the terminal device 2 to this learned model, thereby obtaining the cargo label 71 from the learned model instead of the cargo label format DB 5. You may also get information about the format.

On the other hand, if it does not have a learned model as described above, the first processing unit 18 of the article management device 1 receives information about the cargo label format of the cargo label 71 according to the user's instruction input at the terminal device 2. Based on the information on the cargo label format of the cargo label 71 acquired from the cargo label format DB 5 and the character information acquired by optical character recognition processing, the cargo label information indicated on the cargo label 71 is acquired. may
For example, when transmitting the image of the cargo 7 to the article management device 1, the second processing unit 28 of the terminal device 2 changes the cargo label format of the cargo label 71 according to the user's instruction input in the input unit 22. Designated information (for example, cargo label format identification information) is transmitted to the article management apparatus 1 . The first processing unit 18 of the article management device 1 acquires information on the cargo label format of the cargo label 71 specified by the user of the terminal device 2 from the cargo label format DB 5 . The first processing unit 18, for example, based on the relationship between the ruled line information in the information on the cargo label format of the cargo label 71 acquired from the terminal device 2 and the ruled line appearing in the image of the cargo label 71, each cargo label of the cargo label 71 The range of the item is specified, and the information of each cargo label item of the cargo label 71 is acquired from the character information included in the specified range. Alternatively, the first processing unit 18 acquires the position coordinates of each character appearing in the image of the cargo label 71 (coordinates when a predetermined position of the cargo label 71 is set as the origin), and converts the acquired position coordinates of each character to Based on this, it may be determined which cargo label item of the cargo label 71 each character is included in, and the information of each cargo label item of the cargo label 71 may be acquired based on this determination result.

In step ST145, the first processing unit 18 displays information on each cargo label item (product number, quantity, lot number, etc.) of the cargo label information in the information on the cargo label format of the cargo label 71 on the display unit 24 of the terminal device 2. may be displayed in
For example, the first processing unit 18 transmits information on the name and range of each cargo label item of the cargo label information in the information on the cargo label format to the terminal device 2 . The second processing unit 28 of the terminal device 2 that has received this information displays the name and range of each cargo label item of the cargo label information superimposed on the image of the cargo label 71 displayed on the display unit 24 . Alternatively, the second processing unit 28 may display the name and range of each cargo label item of the cargo label information in a window separate from the image of the cargo label 71 displayed on the display unit 24 .

In this case, the second processing unit 28 displays the name of each cargo label item and the range of each cargo label item superimposed on the image of the cargo label 71 in accordance with the user's instruction input by the input unit 22. may be modified. In addition, the second processing unit 28 adds new cargo label item information (name of cargo label item, range of cargo label item) to the image of the cargo label 71 according to the input user's instruction. may The second processing unit 28 transmits information (name of the cargo label item, range of the cargo label item) regarding the cargo label items of the cargo label 71 that have been modified or added according to the user's instruction to the article management device 1. do. The first processing unit 18 of the goods management device 1 updates the information on the cargo label format of the cargo label 71 according to this information received from the terminal device 2, and based on the updated information on the cargo label format and the character information: to acquire the cargo label information indicated on the cargo label 71 .

In addition, information on the cargo label format of the cargo label 71 (if there is a correction or addition according to the instruction of the user of the terminal device 2, the updated information according to the correction or addition) and the image captured by the terminal device 2 The combination with the image of the cargo 7 obtained can be used as training data for generating the learned model described above. Therefore, the first processing unit 18 of the article management device 1 stores the teacher data (combination of information on the cargo label format of the cargo label 71 and the image of the cargo 7) obtained in step ST145 in the first storage unit 17 or It may be stored in another storage device (database, etc.).

After acquiring the cargo label information and the cargo identification information from the image of the cargo 7, the first processing unit 18 then extracts the item information included in the acquired cargo label information and the item information included in the invoice information saved in step ST130. matches (ST170). For example, the first processing unit 18 makes sure that the product information (product number, quantity, lot number, etc.) in the acquired cargo label information matches the product information (product number, quantity, lot number, etc.) in the delivery note information saved in step ST130. If so, it is determined that these pieces of product information match.

If it is determined in step ST175 that the article information in the cargo label and the article information in the delivery note match (Yes in ST175), the first processing unit 18 acquires the matching article information and the article information in step ST145. It is registered in the management DB 3 in association with the freight identification information obtained (ST185). The product information registered in the management DB 3 may be, for example, the product information included in the cargo label information acquired in step ST145. In this case, the first processing unit 18 notifies the terminal device 2 that the article information in the cargo label information associated with the cargo identification information has been registered in the management DB 3 in step ST185, and the second processing unit of the terminal device 2 28 displays this notification on the display unit 24 (ST190).

When it is determined in step ST175 that the cargo label information and the statement of delivery information are inconsistent (No in ST175), the first processing section 18 executes predetermined error processing (ST180). For example, the first processing unit 18 transmits an error notification to the terminal device 2 notifying that the warehousing data and the statement of delivery 6 are inconsistent, and the second processing unit 28 of the terminal device 2 displays this error notification on the display unit 24. , or the sound input/output unit 25 outputs a sound indicating an error.

As described above, according to the present embodiment, article information about articles in the freight 7 and freight identification information for uniquely identifying each freight 7 are associated and registered in the management DB 3. . The freight identification information is information indicated on the identification label 72 attached to the freight 7 and can be read without visual inspection. For example, when cargo identification information is represented by an optical code such as a barcode, the cargo identification information can be easily read by a device such as a barcode reader. Therefore, in the case of managing articles stored as cargo 7 in a warehouse or the like, it is possible to greatly reduce the burden of visual collation work.

For example, by printing the shipping instruction number associated with the article information in a barcode or the like on the shipping instruction sheet on which the article information of the freight label 71 is described, the shipping instruction number printed on the shipping instruction sheet can be used as the shipping instruction sheet. It indirectly represents the product information described in the document. Therefore, the shipping instruction number of the shipping instruction and the cargo identification information of the cargo label 71 are read by a bar code reader or the like, and the goods information associated with the shipping instruction number read from the shipping instruction and the cargo label 71 are read. If the computer compares the article information associated with the read cargo identification information, the trouble of visually checking the article information described in the shipping instruction sheet and the cargo label information indicated on the cargo label 71 can be eliminated. work can be omitted.

In this way, since the visual collation work can be omitted, it is possible to effectively reduce the work load associated with the management of the goods received as cargo in a warehouse or the like. In addition, since mistakes due to visual collation work are eliminated, it is possible to manage articles accurately and with high quality.

Further, according to this embodiment, the cargo label information and the cargo identification information are acquired from the image of the cargo 7 including the cargo label 71 and the identification label 72, and the article information based on the cargo label information is associated with the cargo identification information. Registered in the management DB3. Therefore, there is no need to perform visual collation work in order to associate the article information and the freight identification information, and errors in associating the article information and the freight identification information can be effectively suppressed.
The cargo label information and the cargo identification information acquired in step ST145 (FIG. 3) may be acquired based on a common image of the cargo 7, or may be acquired based on images of the cargo 7 separately photographed. may That is, the first processing unit 18 of the article management device 1 may acquire the cargo label information and the cargo identification information from the common image of the cargo 7 including both the image of the cargo label 71 and the image of the identification label 72. , the cargo label information and the cargo identification information can be obtained from separately captured images of the cargo 7 (the image of the cargo 7 including the image of the cargo label 71 and the image of the cargo 7 including the image of the identification label 72). good.

Next, a more specific example of processing in the flow chart of the article management method shown in FIG. 3 will be described with reference to flow charts of FIGS. 4 to 7. FIG.

FIG. 4 is a flow chart for explaining an example of the processing (ST110, FIG. 3) for acquiring the statement of delivery information from the image of the statement of delivery 6. As shown in FIG.

The second processing unit 28 of the terminal device 2 selects the delivery note format of the delivery note 6 from which the delivery note information is to be acquired according to the user's instruction input by the input unit 22 (ST200). For example, the second processing unit 28 inputs through the input unit 22 information for designating a specific delivery note format (delivery note format specification information) from among a plurality of delivery note formats registered in the delivery note format DB 4. , to the article management apparatus 1 . The delivery note format specification information may include, for example, information for identifying the type of goods (such as a product number) and information on the supplier of the goods.

FIG. 8A shows an example of the screen of the terminal device 2 when inputting the delivery note format designation information in step ST200. Screen A shown in FIG. 8A has an area A1 in which a list of supplier company names is displayed. When the user performs an operation to select one supplier from the list displayed in the area A1, the second processing unit 28 of the terminal device 2 stores the information of the supplier selected by the user in the form of a statement of delivery. It is transmitted to the article management apparatus 1 as designated information.

When the first processing unit 18 of the article management apparatus 1 receives the delivery note format designation information from the terminal device 2 (ST205), it creates a sample image of the delivery note 6 having the delivery note format designated by this delivery note format designation information. is transmitted to the terminal device 2 and displayed on the display section 24 of the terminal device 2 (ST210, ST215). For example, a sample image (thumbnail image) of the delivery note 6 is registered for each delivery note format in the delivery note format DB 4 . The first processing unit 18 of the article management apparatus 1 acquires a sample image registered in the delivery note format DB 4 for the delivery note format specified by the delivery note format specifying information, and transmits the sample image to the terminal device 2 .

The second processing unit 28 of the terminal device 2 indicates whether or not the delivery note format related to the sample image displayed on the display unit 24 is appropriate as the delivery note format of the delivery note 6 whose delivery note information is to be acquired. A user's instruction is input through the input unit 22 . As a result of comparing the actual delivery note 6 and the sample image displayed on the display unit 24, if it is determined that the two delivery note formats match, the delivery note format related to the sample image is appropriate. A user instruction is entered indicating that the

FIG. 8B shows an example of the screen of the terminal device 2 when displaying the sample image of the statement of delivery 6 in step ST215. A sample image of the statement of delivery 6 is displayed near the center of the screen B shown in FIG. 8B. When the button B1 is pressed on the screen B, the invoice format for the sample image is not appropriate (No in ST220). In this case, the second processing section 28 of the terminal device 2 returns to step ST200, and selects the invoice format again on the screen of FIG. 8A. On the other hand, if the button B2 is pressed on the screen B, the invoice format for the sample image is appropriate (Yes in ST220). In this case, the second processing unit 28 moves to step ST225 and photographs the statement of delivery 6 .

FIG. 8C shows an example of the screen of the terminal device 2 when the statement of delivery 6 is imaged in step ST225. A screen C illustrated in FIG. 8C has a display area C1 for an application program (camera application) that is started when the imaging unit 23 of the terminal device 2 performs imaging. The second processing unit 28 of the terminal device 2 displays the image of the subject in the display area C1, and when a predetermined operation (for example, an operation of pressing a shutter button of the camera) is performed, the image of the subject being displayed is displayed. Take an image. Note that if the button C2 is pressed on the screen C, the second processing unit 28 returns to step ST200 and redoes the selection of the invoice format on the screen of FIG. 8A.

FIG. 9A shows an example of the screen of the terminal device 2 displayed when the image of the statement of delivery 6 is captured in the display area C1 of the camera application on the screen C (ST225, FIG. 4) shown in FIG. 8C. An image (preview) of the statement of delivery 6 imaged in step ST225 is displayed near the center of the screen D shown in FIG. 9A. When the button D2 is pressed in FIG. 9A, the second processing unit 28 of the terminal device 2 returns to step ST225 (screen of FIG. 8C) and captures the image of the statement of delivery 6 again. When the button D3 in FIG. 9A is pressed, the second processing unit 28 of the terminal device 2 returns to step ST225 (screen of FIG. 8C) and captures an image of another delivery note 6 that is the target of acquisition of delivery note information. . Thereby, the second processing unit 28 can capture images of two or more statements of delivery 6 . When the button D<b>1 is pressed in FIG. 9A , the second processing unit 28 transmits the captured image of the subject (the image of the statement of delivery 6 ) to the article management apparatus 1 . It should be noted that the second processing unit 28 of the terminal device 2 may transmit an image of the object to the article management apparatus 1 each time the button D3 is pressed when capturing images of two or more statements of delivery 6 .

The first processing unit 18 of the article management apparatus 1 inputs the image of the delivery note 6 captured by the terminal device 2 in step ST230. The image of the delivery note 6 is an image confirmed by the user of the terminal device 2 as having the same delivery note format as the delivery note 6 indicated by the sample image (FIG. 8B) displayed on the terminal device 2 .

The first processing unit 18 of the goods management apparatus 1 determines the delivery note format specified by the delivery note format specification information input from the terminal device 2 in step ST205 (the format relating to the position and range of each delivery note item in the delivery note 6), Based on the image of the statement of delivery 6 input from the terminal device 2 in step ST230, at least part of the statement of delivery information is acquired (ST235).

For example, the first processing unit 18 of the goods management apparatus 1 inputs from the terminal device 2 a trained model (first learned model) given in advance for one delivery note format specified by the delivery note format specification information. By applying the image of the statement of delivery 6 obtained, the image range of one or more items of the statement of delivery in the image of the statement of delivery 6 input from the terminal device 2 is specified. The first trained model performs predetermined machine learning so as to identify one or more image ranges corresponding to one or more items of the delivery note 6 from the image of the delivery note 6 having one delivery note format. A model generated using an algorithm. Any machine learning algorithm may be used to generate the first trained model, such as an algorithm for learning a multilayer neural network by deep learning. For example, the first learned model is registered for each delivery note format in the delivery note format DB 4 . The first processing unit 18 uses the first learned model registered in the delivery note format DB 4 for the delivery note format specified by the delivery note format specifying information, and calculates 1 in the image of the delivery note 6 captured by the terminal device 2. Identify the image range of the delivery statement items above.
Then, the first processing unit 18 acquires the information of the statement of delivery items corresponding to the specified image range from each of the specified one or more image ranges. For example, the first processing unit 18 performs optical character recognition processing on each specified image range, thereby acquiring character information of the statement of delivery item included in this image range.

In the process shown in the flowchart of FIG. 4, when acquiring the delivery note information from the image of the delivery note 6, the delivery note format specification information (supplier's company name, etc.) input by the user of the terminal device 2 is used to obtain the delivery note information. The delivery note format of the delivery note 6 whose document information is to be acquired is specified, and the first learned model is determined from this specified delivery note format. By applying the image of the statement of delivery 6 captured by the terminal device 2 to the first learned model, the image range of one or more items of the statement of delivery in the image of the statement of delivery 6 is specified. In this process, the first trained model generated for each delivery note format is used to acquire the delivery note information. Highly accurate delivery note information can be obtained from the image of the delivery note 6 .

4, the delivery note confirmed by the user of the terminal device 2 as having the same delivery note format as the delivery note 6 indicated by the sample image (FIG. 8B) displayed on the terminal device 2 Based on the image of 6, the invoice information is obtained. Therefore, the accuracy of the statement of delivery information acquired by the first learned model can be improved as compared with the case where the user of the terminal device 2 does not confirm.

FIG. 5 is a flow chart for explaining another example of the process (ST110, FIG. 3) of acquiring the statement of delivery information from the image of the statement of delivery 6. As shown in FIG. In the processing of the flowchart shown in FIG. 4, the delivery note format of the delivery note 6 is specified by the delivery note format specifying information input by the user of the terminal device 2. In the processing of the flowchart shown in FIG. The delivery note format is discriminated based on the image of the delivered delivery note 6.例文帳に追加

The second processing unit 28 of the terminal device 2 captures an image of the statement of delivery 6 on the screen C shown in FIG. 8C, for example, and transmits the image to the article management device 1 (ST300).

In step ST305, the first processing unit 18 of the article management apparatus 1 inputs the image of the statement of delivery 6 captured by the terminal device 2 . Based on the input image of the delivery note 6, the first processing section 18 determines the delivery note format of the delivery note 6 in the image (ST310). For example, the first processing unit 18 uses the image of the delivery note 6 for the third trained model generated so as to determine the delivery note format of the delivery note 6 in this image, and the delivery document imaged by the terminal device 2. By applying the image of the document 6, the format of the delivery note 6 in the image captured by the terminal device 2 is determined. Any machine learning algorithm may be used to generate the third trained model, such as an algorithm for learning a multilayer neural network by deep learning.

When the first processing unit 18 of the goods management apparatus 1 determines the delivery note format in step ST310, it transmits a sample image of the delivery note 6 having this delivery note format to the terminal device 2, and displays it on the display section of the terminal device 2. 24 (ST315, ST320). For example, the first processing unit 18 acquires a sample image registered in the delivery note format DB 4 for the delivery note format determined in step ST<b>310 and transmits it to the terminal device 2 .

When displaying the sample image of the statement of delivery 6 in step ST320, the second processing unit 28 of the terminal device 2 displays, for example, screen B in FIG. 8B. If the button B1 is pressed on the screen B, the format of the statement of delivery for the sample image is not appropriate (No in ST325). Redo the image capture. On the other hand, if the button B2 is pressed on the screen B, the invoice format for the sample image is appropriate (Yes in ST325), so a response notifying it is transmitted to the article management apparatus 1. FIG.

The first processing unit 18 of the goods management apparatus 1 inputs a response indicating that the delivery note format of the delivery note 6 indicated by the sample image is appropriate from the terminal device 2 on which the sample image of the delivery note 6 is displayed. If so (ST330), the image of the statement of delivery 6 input in step ST305 (the image of the statement of delivery 6 captured by the terminal device 2) and the format of the statement of delivery determined in step ST310 (the position of each item of the statement of delivery in the statement of delivery 6 and range format), at least a part of the invoice information is acquired (ST335). For example, the first processing unit 18 applies the image of the delivery note 6 input from the terminal device 2 to the first learned model given in advance for the determined delivery note format. An image range of one or more statement of delivery items in the image of the statement of delivery 6 is specified, and information of the statement of delivery item corresponding to the image range is acquired from each of the one or more specified image ranges.

In the process shown in the flowchart of FIG. 5, based on the image of the delivery note 6 captured by the terminal device 2, the delivery note format of the delivery note 6 in this image is determined. Therefore, it is possible to save the user the trouble of inputting the delivery note format specification information, and reduce the user's workload.
In addition, in the processing shown in the flowchart of FIG. 5 as well, since the delivery note information is acquired using the first learned model generated for each delivery note format, the generated learning model can be generated without limiting the delivery note format. It is possible to obtain more accurate delivery note information from the image of the delivery note 6 than in the case of using the completed model.
Furthermore, in the processing shown in the flowchart of FIG. 5, when the user of the terminal device 2 confirms that the delivery note format of the delivery note 6 indicated by the sample image (FIG. 8B) displayed on the terminal device 2 is appropriate First, the delivery note information is acquired using the first trained model generated for this delivery note format. Therefore, the accuracy of the statement of delivery information acquired by the first learned model can be improved as compared with the case where the user of the terminal device 2 does not confirm. Note that if the third learned model has a sufficiently high determination accuracy of the statement of delivery format, the checking of the sample image in steps ST320 and ST325 may be omitted, thereby saving the user the trouble of checking the sample image. can be reduced.

FIG. 9B shows the case where it is determined that the article information in the statement of delivery acquired in step ST110 (FIGS. 3 to 5) matches the article information in the warehousing data specified in step ST115 (Yes in ST125, FIG. 3). 4 shows an example of a screen displayed on the terminal device 2 by the first processing unit 18 of the article management apparatus 1. FIG. The screen E shown in FIG. 9B includes an area E1 for displaying precautions for warehousing, and a button E2 for proceeding to the processing of step ST145 (FIGS. 3, 6, and 7) for acquiring cargo label information. .

FIG. 9C shows that the first processing unit 18 of the article management device 1 displays on the terminal device 2 when it is determined that the article information in the delivery slip and the article information in the warehousing data do not match (No in ST125, FIG. 3). An example of a screen that causes When the screen F shown in FIG. 9C is displayed on the terminal device 2, the first processing unit 18 proceeds to error processing in step ST135 (FIG. 3).

Screen F in FIG. 9C displays the reason why the item information in the delivery note information and the item information in the warehousing data are determined to be inconsistent. In the example of FIG. 9C , screen F displays the reason for inconsistency with warehousing data for each of the two delivery note information acquired for the two delivery notes. When one of the two buttons F1 or F2 corresponding to the two pieces of delivery note information determined to be inconsistent with the incoming data is pressed, the second processing unit 28 of the terminal device 2 selects the button corresponding to the pressed button. A screen G (FIG. 10A) for correcting the delivery slip information is displayed on the display unit 24 .
When the button F3 is pressed on the screen F in FIG. 9C, the second processing unit 28 proceeds to step ST200 (FIG. 4) and displays the screen A shown in FIG. 8A on the display unit 24. FIG.
When the button F4 is pressed on the screen F in FIG. 9C, the second processing unit 28 proceeds to step ST225 (FIG. 4) and displays the screen C shown in FIG. 8C on the display unit 24. FIG.

FIG. 10A is a diagram showing an example of the screen of the terminal device 2 when correcting the acquired delivery note information in the error processing (ST135, FIG. 3) when it is determined that there is a mismatch between the delivery note information and the warehousing data. be. The screen G shown in FIG. 10A includes an area G1 that displays the reason why each item of item information included in the delivery note information is determined to be inconsistent, and individual information (order number, item number, quantity, etc.) included in each item of item information. etc.), and input fields G2 to G4 for inputting characters and the like. When the button G5 on the screen G is pressed, information including correction contents of each item information entered in the input fields G2 to G4 is transmitted to the item management apparatus 1 as an instruction to correct the delivery note information. When the first processing section 18 of the article management apparatus 1 inputs an instruction to correct each article information from the terminal device 2 in the error processing of step ST135 (FIG. 3), the process returns to step ST120 (FIG. 3). In step ST120, the first processing unit 18 determines again whether or not the article information of the delivery note information corrected according to the correction instruction from the terminal device 2 matches the article information of the warehousing data.

In the above-described error processing (ST135, FIG. 3) of the present embodiment, when it is determined in the determination processing in step ST120 that the item information in the delivery note and the item information in the warehousing data are inconsistent, the item information in the delivery note The information is corrected according to the correction instruction from the terminal device 2, and the determination process of step ST120 is performed again for the corrected statement of delivery information. As a result, when the delivery note information cannot be acquired successfully due to dirt on the delivery note 6 or the like, the processing can be continued after manually changing the delivery note information.

Further, in the above-described error processing (ST135, FIG. 3) of the present embodiment, when it is determined in step ST120 that the article information in the delivery note and the article information in the warehousing data match, the step of acquiring the cargo label information. The process of ST145 (FIGS. 3, 6 and 7) is executed. Therefore, depending on the result (match/mismatch) of the determination process of step ST120, it is possible to prevent the user's work (such as capturing an image of the cargo label 71) in the determination process of step ST145 from being wasted.

FIG. 6 is a flow chart for explaining an example of the process (ST145, FIG. 3) of acquiring the cargo label information and the cargo identification information from the image of the cargo 7. As shown in FIG. The flow chart shown in FIG. 6 is a process when there is one statement of delivery 6 imaged in step ST105 (step ST225, FIG. 4) and one item information is included in the statement of delivery information of the statement of delivery 6. indicates

Here, one article information shall include one article type identification information. It is also assumed that one product information item is associated with one order identification information item. The article information is information about articles in the cargo 7, and includes, for example, article numbers, quantities, lot numbers, and the like. The order identification information is information for identifying individual orders, and includes order numbers, for example. The product type identification information is information for identifying the product type (type, etc.), and includes, for example, product number, model number, product name, and model name. The combination of the item type identification information and the order identification information included in the item information differs for each item information.

Further, here, it is assumed that the cargo label format (the format of the cargo label 71) is associated with the product type identification information. That is, when the type of a specific product is specified by the product type identification information, the cargo label format of the cargo label 71 used for that type of product is also specified. For example, in the cargo label format DB 5, for each of a plurality of cargo label formats, correspondence between the cargo label format and the product type identification information is registered.

The first processing unit 18 of the article management device 1 identifies one freight label format associated with one article type identification information included in the article information of the delivery note information acquired in step ST110 (FIG. 3) ( ST 400). For example, the first processing unit 18 acquires the information of the cargo label format associated with the one article type identification information from the cargo label format DB 5 .

When the item information included in the statement of delivery information acquired in step ST110 (FIG. 3) is one (No in ST405), the first processing unit 18 of the item management apparatus 1 generates an image of the cargo 7 (an image of the cargo label 71, image of the identification label 72) is instructed to the terminal device 2 (ST425). The second processing unit 28 of the terminal device 2 that has received this instruction uses the imaging unit 23 to read characters appearing on at least one of the cargo label 71 and the identification label 72 included in the image of the cargo 7 by optical character recognition processing. A still image of the cargo 7 is captured by the imaging unit 23 (ST430).

FIG. 10C shows an example of the screen of the terminal device 2 when capturing an image (still image) of the cargo 7 in step ST430. A screen J shown in FIG. 10C has a display area J1 for a camera application that is activated when the imaging unit 23 performs imaging. The image of the subject is displayed in the display area J1, and the image of the subject being displayed is picked up when a predetermined operation is performed.

First, the second processing unit 28 of the terminal device 2 captures a still image of the cargo 7 for reading characters appearing on at least one of the cargo label 71 and the identification label 72 included in the image of the cargo 7 by optical character recognition processing. The image is taken at 23 . This still image is captured, for example, by pressing the shutter button in the display area J1 of the camera application on the screen J shown in FIG. 10C. The second processing unit 28 transmits the captured still image of the freight 7 to the article management device 1 .

When the first processing unit 18 of the article management device 1 receives the still image of the cargo 7 captured by the terminal device 2 (ST435), the first processing unit 18 appears in at least one of the cargo label 71 and the identification label 72 included in the input still image. The characters are read by optical character recognition processing.

That is, the first processing unit 18 of the goods management device 1 determines the cargo label format specified in step ST400 (the format related to the position and range of each cargo label item in the cargo label 71) and the cargo input from the terminal device 2 in step ST435. 7 (still image including the image of the cargo label 71), at least a part of the cargo label information is acquired (ST440).
For example, the first processing unit 18 compares the image of the cargo 7 captured by the terminal device 2 (the cargo label 71 of the The image range of one or more cargo label items in the image of the cargo 7 input from the terminal device 2 is specified by applying the still image including the image). The second trained model performs predetermined machine learning so as to identify one or more image ranges corresponding to one or more cargo label items in the cargo label 71 from the image of the cargo label 71 having one cargo label format. A model generated using an algorithm. Any machine learning algorithm may be used to generate the second trained model. For example, an algorithm for learning a multilayer neural network by deep learning may be used. For example, the second learned model is registered for each cargo label format in the cargo label format DB 5 . The first processing unit 18 uses the second learned model registered in the cargo label format DB 5 for the cargo label format specified in step ST400 to determine the cargo label 71 included in the image of the cargo 7 captured by the terminal device 2. Get cargo label information according to
Then, the first processing unit 18 acquires the information of the cargo label item corresponding to the image range from each of the identified one or more image ranges. For example, the first processing unit 18 performs optical character recognition processing on each identified image range to acquire character information of the cargo label item included in this image range.

In addition, when the characters appearing on the identification label 72 are read by optical character recognition processing, the first processing unit 18 of the article management apparatus 1 specifies the image range of the characters in the identification label 72 from the image of the identification label 72. A generated trained model (trained model for identification label) may be used. For example, the first processing unit 18 identifies the image range of characters in the identification label 72 by applying the image of the identification label 72 input from the terminal device 2 to the trained model for identification label, and identifies the image range of the character in the identification label 72. The textual information in the identification label 72 included in the image area may be obtained by performing an optical character recognition process on the image area.

Following the input of the still image in step ST430, the second processing unit 28 of the terminal device 2 receives the cargo for decoding the optical code appearing in at least one of the cargo label 71 and the identification label 72 included in the image of the cargo 7. 7 is picked up (ST445). This moving image is captured, for example, continuously after the still image is captured in step ST430 in the display area J1 of the camera application on the screen J shown in FIG. 10C. The second processing unit 28 streams the imaged moving image of the freight 7 to the article management apparatus 1 .

When the first processing unit 18 of the article management device 1 receives the moving image of the cargo 7 captured by the terminal device 2 (ST450), the first processing unit 18 detects the optical image appearing in at least one of the cargo label 71 and the identification label 72 included in the input moving image. A process of decoding the code (bar code, etc.) is performed (ST455). The first processing unit 18 acquires at least part of each of the cargo identification information and the cargo label information by decoding the optical code. For example, the first processing unit 18 may acquire cargo label information through optical character recognition processing in step ST440, and acquire cargo identification information through decoding processing in step ST455.

The second processing unit 28 of the terminal device 2 determines that the imaging (imaging of the cargo labels 71 and 72) of one cargo (the cargo 7 corresponding to one cargo label 71) has been completed in step ST145 (ST440, ST455). When the user's instruction indicating is input, the end of the imaging is notified to the article management apparatus 1 (ST457). For example, when the button J4 is pressed on the screen J (FIG. 10C) on which the camera application is activated, the second processing unit 28 notifies the article management apparatus 1 that the most recent imaging for one cargo has been completed. Further, when the button J3 is pressed on the screen J (FIG. 10C), the second processing unit 28 notifies the article management device 1 that the most recent imaging of all the cargoes 7 including one cargo has been completed. .

The first processing unit 18 of the article management device 1 that has received the notification of the end of imaging for one freight, replaces the article information included in the freight label information for one freight acquired in step ST145 with the statement of delivery information acquired in step ST110. (ST150). For example, the first processing unit 18 determines whether the goods type identification information (product number, etc.) and the order identification number (order number, etc.) included in the statement of delivery information acquired in step ST110 are included in the freight label information acquired in step ST145. (i.e., the cargo label information is unrelated to the specific item information indicated by the combination of the item type identification information and the order identification number), the item information of this cargo label information matches the item information of the delivery note information. determine that it is not. If it is determined that the item information in the invoice information and the item information in the cargo label information do not match (No in ST155), the first processing section 18 executes predetermined error processing (ST160). For example, when the first processing unit 18 shifts to error processing in step ST160, the first processing unit 18 inputs a correction instruction given by the user to correct the cargo label information acquired in step ST145 from the terminal device 2, and responds to this correction instruction. The consistency determination in step ST150 is performed again for the corrected cargo label information.

FIG. 11A is a diagram exemplifying the screen of the terminal device 2 when shifting to error processing in step ST160. For example, the first processing unit 18 of the article management apparatus 1 causes the terminal device 2 to display a screen K shown in FIG. 11A when proceeding to error processing in step ST160. On this screen K, the freight label information acquired in steps ST440 and ST455 is displayed in a modifiable manner. In the example of FIG. 11A, an input field K1 for correcting the data of the optical code (barcode) read in step ST455 and input fields K2 to K4 for correcting the product information acquired in step ST440 are displayed on the screen. It is set in K.

When the button K7 on the screen K in FIG. 11A is pressed, the first processing unit 18 of the article management device 1 performs the determination process of step ST150 on the edited cargo label information. Returning to the error processing of step ST160, screen K (FIG. 11A) is displayed.

When the button K6 is pressed on the screen K of FIG. 11A, the first processing unit 18 of the goods management apparatus 1 causes the terminal device 2 to display the screen J of FIG. , ST445), and acquires cargo label information and cargo identification information again (ST435, ST440, ST450, ST455).

When the button K5 is pressed on the screen K of FIG. 11A, the first processing unit 18 of the article management device 1 causes the terminal device 2 to display the screen L of FIG. The input and decoding of the optical code are performed (ST455). A screen L in FIG. 11B has a display area L1 for a camera application for shooting a moving image for reading an optical code. When the button L2 on the screen L is pressed, the first processing unit 18 performs the determination process of step ST150 based on the optical code read in step ST455. Returning to error processing, the screen K (FIG. 11A) is displayed on the terminal device 2 . If the determination process of step ST150 matches, the first processing unit 18 causes the terminal device 2 to display the screen J (FIG. 10C).

When the first processing unit 18 of the article management apparatus 1 determines in step ST150 that the article information in the delivery note information and the article information in the cargo label information match (Yes in ST155), It is determined whether or not there is another cargo 7 containing an item related to the item information of the invoice information (an item related to a combination of one item type identification information and one order identification information included in the invoice information) (ST165). For example, the first processing unit 18 determines whether the end of imaging notified in step ST457 indicates that the imaging of all the freight 7 has been completed. When the first processing unit 18 determines that there are other cargoes 7 (imaging of all the cargoes 7 has not been completed) by pressing the button J4 on the screen J (FIG. 10C) (Yes in ST165). , display the screen J (FIG. 10C) in which the camera application is activated on the terminal device 2, and photograph the other freight 7 on the terminal device 2 (ST430, ST445), based on the photographed image of the freight 7. Obtain cargo label information and cargo identification information (ST435 to ST455). In this case, the first processing unit 18 increments by one the number of photographed cargoes displayed in the area J5 of the screen J (FIG. 10C) (the number of cargoes determined to match in step ST150).

When the first processing unit 18 of the article management apparatus 1 determines that there is no other cargo 7 (imaging of all the cargo 7 is completed) by pressing the button J3 on the screen J (FIG. 10C) (ST165 No), one item information of the statement of delivery information acquired in step ST110 and the item information of one or more cargo label information acquired for all the cargoes 7 containing the items related to the one item information are matched. It is determined whether to do so (ST170). For example, when there are a plurality of cargoes 7 including items related to the item information in the delivery note, the first processing unit 18 calculates the number of all cargoes based on the item information in the cargo label information acquired for all the cargoes 7. The total quantity of goods (total quantity of goods included in each cargo 7) is collated with the quantity of goods contained in the goods information of the invoice information acquired in step ST110, and if they match, It is determined that the article information of the freight label information of all the freight and the article information of the statement of delivery are consistent (Yes in ST175).

When the first processing unit 18 of the article management apparatus 1 determines that one article information of the delivery note information acquired in step ST110 and all the article information of the cargo label information acquired in step ST145 match ( Yes in ST175), for all cargoes 7 that include an item related to one piece of item information in the delivery note information, the item information in the cargo label information acquired based on the image of the cargo 7 and based on the obtained cargo identification information and registered in the management DB 3 (ST185). In this case, the first processing unit 18 notifies the terminal device 2 that the article information of the freight label information associated with the freight identification information has been registered in the management DB 3, and the second processing unit 28 of the terminal device 2 The notification is displayed on the display unit 24 (ST190). FIG. 12A shows an example of a screen displayed on the terminal device 2 in step ST190. On the screen N shown in FIG. 12A, the article type identification information (article number) and the total number of articles in the article information of the cargo label information registered in the management DB 3 are displayed. When the button N1 is pressed on the screen N (FIG. 12A), the first processing unit 18 returns the screen of the terminal device 2 to the screen B of FIG. 8B.

When the first processing unit 18 of the article management apparatus 1 determines that the statement of delivery information and the cargo label information do not match (No in ST175), it executes predetermined error processing (ST180). For example, the first processing unit 18 causes the terminal device 2 to display the screen M shown in FIG. 11C in the error processing of step ST180. The screen M displays the reason why the item information in the invoice information and the item information in the cargo label is inconsistent, and also displays the item type identification information (item number) and the total number of items in the item information in the cargo label information. be. When the button M1 is pressed on the screen M, the first processing unit 18 causes the terminal device 2 to display the screen J (FIG. 10C) in which the camera application is started, and causes the terminal device 2 to photograph the cargo 7 again. (ST430, ST445), based on the photographed image of the cargo 7, the cargo label information and cargo identification information are acquired again (ST435 to ST455). When the button M2 is pressed on the screen M, the first processing unit 18 returns the screen of the terminal device 2 to the screen B of FIG. 8B.

In the process shown in the flowchart of FIG. 6, when a plurality of cargoes 7 includes an item related to one piece of item information in the statement of delivery information acquired in step ST110, for each of the plurality of cargoes 7, the cargo 7 A process (ST435 to ST455) is performed to acquire cargo label information and cargo identification information based on the image. When the cargo label information and the cargo identification information are acquired for each cargo 7, one item information of the statement of delivery acquired in step ST110 and a plurality of cargoes 7 including items related to the one item information are A process (ST150, ST170) is performed to determine whether or not the acquired plural cargo label information matches the article information. Then, when it is determined that one piece of article information in the delivery note matches the piece of article information in the plurality of pieces of cargo label information, for each of the plurality of pieces of freight 7 that include an article related to the piece of article information, the pieces of freight 7 The article information of the cargo label information acquired based on the image of 1 and the cargo identification information acquired based on the image of the cargo 7 are associated with each other and registered in the management DB 3 (ST185). As a result, even if a plurality of cargoes 7 contain an item related to one piece of item information in the delivery note information, the matching between the cargo label information and the delivery note information in the plurality of cargoes 7 is determined, and this determination is passed. The article information and the freight identification information of the freight label information of each freight 7 can be associated and registered in the management DB 3 .

Further, in the processing shown in the flowchart of FIG. 6, the cargo label format associated with the product type identification information is specified according to the product type identification information included in the product information, and the specified cargo label format is used as the first label format. 2 A trained model is determined. Then, by applying the image of the cargo 7 captured by the terminal device 2 (the image including the cargo label 71) to this second learned model, the image range of one or more cargo label items in the image of the cargo 7 is From each of the one or more identified image areas, information for the cargo label item corresponding to the image area is obtained, such as by optical character recognition processing. In this process, cargo label information is acquired using the second trained model generated for each cargo label format. Highly accurate cargo label information can be acquired from the cargo label 71 included in the image of the cargo 7 .

Further, in the processing shown in the flowchart of FIG. 6, a still image of the cargo 7 for reading the characters appearing on the cargo label 71 and the identification label 72 is captured by the terminal device 2 by the optical character recognition processing. Subsequently, the moving image of the cargo 7 for decoding the optical code appearing on the cargo label 71 and the identification label 72 is captured by the terminal device 2 . Then, in the article management device 1, at least a part of each of the cargo label information and the cargo identification information is acquired by optical character recognition processing based on the captured still image of the cargo 7, and based on the captured moving image of the cargo 7 , at least a portion of each of the cargo label information and the cargo identification information is obtained by decoding the optical code. Therefore, by continuously capturing the still image and the moving image of the cargo 7, it is possible to ensure the association between the cargo label information and the cargo identification information obtained based on the still image and the moving image.
In the processing shown in the flowchart of FIG. 6, the still image of the cargo 7 used for the optical character recognition processing is followed by the moving image of the cargo 7 used for decoding the optical code. Conversely, the still image of the cargo 7 may be captured after the moving image of the cargo 7 is captured.

FIG. 7 is a flowchart for explaining an example of the process (ST145, FIG. 3) for acquiring cargo label information and cargo identification information from the image of cargo 7. One or more images captured in step ST105 (ST225, FIG. 4) 2 shows the processing when the delivery note information of the delivery note 6 contains a plurality of item information.

The first processing unit 18 of the article management apparatus 1 identifies the freight label format associated with the article type identification information included in the article information of the delivery note information acquired in step ST110 (FIG. 3) (ST400). If the statement of delivery information acquired in step ST110 includes a plurality of item information, the first processing unit 18 converts each of the items of item information into a cargo label format associated with the item type identification information included in the item information. Identify.

If there is a plurality of item information included in the one or more statement of delivery information acquired in step ST110 (FIG. 3) (Yes in ST405), the first processing unit 18 of the item management apparatus 1 generates information representing the plurality of item information. is provided to the terminal device 2 and displayed (ST410). The second processing section 28 of the terminal device 2 displays the information provided from the article management device 1 on the display section 24 (ST412).

FIG. 10B shows an example of the screen displayed by the terminal device 2 in step ST412 (FIG. 7). The screen H shown in FIG. 10B displays information representing a plurality of pieces of article information included in one or more items of statement of delivery information acquired in step ST110 (FIG. 3). In the example of FIG. 10B, screen H displays two items ("delivery note 1" and "delivery note 2") corresponding to the two delivery notes 6 acquired in step ST110 (FIG. 3). One item of delivery note 6 (“delivery note 1”) includes three buttons (H1 to H3) indicating three parts information. The two items of product information indicated by button H1 and button H2 include the same product number (item type identification information), and the associated order numbers (order identification information) are different from each other. The article information indicated by the button H3 includes an article number (article type identification information) different from the article information of the buttons H1 and H2. In this way, on screen H, for each of a plurality of items of item information included in one or more items of delivery note information acquired in step ST110 (FIG. 3), the item number (item type identification information) and order number (order identification information) are displayed. combinations are displayed.

On the right side of these buttons (H1 to H3) in the screen H of FIG. 10B, the relationship between the quantity included in the item information of the cargo label information and the quantity included in the item information of the delivery note is displayed. be. The former quantity is displayed to the left of "/" and the latter quantity is displayed to the right of "/". In the example of FIG. 10B, since the cargo label information has not yet been acquired, the quantities contained in the article information in the cargo label information are all zero. If it is determined in step ST150 that the information matches the statement of delivery information, the quantity included in the article information of the cargo label information is displayed to the left of "/". If the goods related to the goods information of the delivery note information are included in multiple shipments 7, the total quantity included in the goods information of the multiple cargo label information acquired for the multiple shipments 7 is calculated, and the "/" displayed on the left. When the quantity included in the product information in the cargo label information matches the quantity included in the product information in the delivery note information, the quantity on the left side of "/" is the same as the quantity on the right side.

When any one of the buttons H1 to H3 is pressed on the screen H in FIG. 10B, the second processing unit 28 of the terminal device 2 transmits an instruction to select the item information corresponding to the pressed button to the item management apparatus 1. At the same time (ST415), the screen shifts to screen J in FIG. 10C, and the cargo 7 is imaged (ST430, ST445, ST457) in the same manner as in the flowchart of FIG. Further, when the first processing unit 18 of the article management apparatus 1 inputs an article information selection instruction from the terminal device 2, similar to the flowchart in FIG. The cargo label information and order identification information of each cargo 7 are obtained (ST435, ST440, ST450, ST455). Further, the first processing unit 18 checks whether the item information in the delivery note information selected on the screen H (FIG. 10B) matches the item information in the cargo label information acquired for each cargo 7 according to the flow chart of FIG. A similar determination is made (ST150 to ST180). Furthermore, when the first processing unit 18 determines that the item information in the delivery note and the item information in the cargo label are consistent, the item information in the matching cargo label and the item information in the order are matched in the same manner as in the flowchart of FIG. It is registered in the management DB 3 in association with the identification information (ST185, ST190). The processes in steps ST430 to ST457 and steps ST150 to ST190 are substantially the same as those described with reference to the flowchart of FIG. 6, so descriptions thereof will be omitted. However, when the button N1 is pressed on the screen N (FIG. 12A) of step ST190, the first processing unit 18 returns the screen of the terminal device 2 to the screen H of FIG. 10B. Further, when the button M2 is pressed on the screen M (FIG. 11C) during error processing in step ST180, the first processing unit 18 shifts the screen of the terminal device 2 to the screen O of FIG. 12B, which will be described later.

When the first processing unit 18 of the article management device 1 registers in the management DB 3 the article information of the cargo label information that matches one article information of the delivery slip information selected on the screen H (FIG. 10B) (ST185), If there is article information that has not yet been judged to be consistent with cargo label information in the selected delivery note information (Yes in ST195), the processing of steps ST410 to ST455 and steps ST150 to ST185 for this unjudgment article information repeat again.

The first processing unit 18 of the article management apparatus 1 displays information (buttons H1 to H3 in the example of FIG. 10B) representing individual article information in a plurality of article information on the screen H of FIG. It is displayed in a manner in which it is possible to determine whether or not it is determined that the product information in the invoice information matches the product information in the cargo label information (ST410). For example, the first processing unit 18 displays the item information button on the screen H in a different color depending on whether or not it is determined to match in step ST170. In step ST415, the first processing unit 18 prevents the user from selecting the item information button determined to match in step ST170. As a result, the user's selection instruction input by the article management apparatus 1 from the terminal device 2 in step ST420 is selected from among a plurality of pieces of article information included in one or more statement of delivery information acquired in step ST110 (FIGS. 3 to 6). , the item information for which the determination result of match has not been obtained in the determination processing of step ST170. The first processing section 18 of the article management apparatus 1 repeats the above-described steps ST435 to ST455 and steps ST150 to ST185 each time an instruction to select article information is input in step ST420.

When the button H5 is pressed on the screen H of FIG. 10B, the first processing unit 18 of the article management apparatus 1 selects one of the pieces of article information included in the one or more statement of delivery information acquired in step ST110 (FIG. 3). 12B is displayed on the terminal device 2 if there is a section for which the determination of step ST170 has not yet been performed. When the button O1 is pressed on the screen O of FIG. 12B, the first processing unit 18 returns the screen of the terminal device 2 to the screen H of FIG. 10B. When the button O2 is pressed on the screen O of FIG. 12B, the first processing unit 18 returns the screen of the terminal device 2 to the screen A of FIG. 8A. In this case, the article information for which the determination of step ST170 has been performed has already been registered in the management DB 3 by the process of step ST185. The rest of the product information that has not been judged in step ST170 is registered in the management DB 3 by another method (for example, the user directly inputs the information into the management DB 3).
On the other hand, when the button H5 is pressed on the screen H of FIG. 10B, the first processing unit 18 performs the determination of ST170 on all the article information included in the one or more statement of delivery information acquired in step ST110 (FIG. 3). If the result indicates matching, the screen P in FIG. 12C is displayed on the terminal device 2 . When the button P1 is pressed on the screen P, the first processing unit 18 returns the screen of the terminal device 2 to the screen A shown in FIG. 8A.

In the process shown in the flowchart of FIG. 7, when a plurality of item information is included in the one or more delivery note information acquired in step ST110, each of the plurality of item information is processed based on the image of the cargo 7. A process (ST435 to ST455) is performed to acquire one or more cargo label information and one or more cargo identification information, and further, for each of the plurality of item information, one item information of the delivery note information and the one item information A process (ST150, ST170) is performed to determine whether or not one or more cargo label information obtained for one or more cargoes 7 containing an item related to the product information matches the product information. Then, when it is determined that at least one article information in the plurality of article information matches the article information in the one or more freight label information, one or more articles 7 containing articles related to the at least one article information For each, a process of associating the article information of the cargo label information acquired based on the image of the cargo 7 and the cargo identification information acquired based on the image of the cargo 7 and registering them in the management DB 3 (ST185) is performed. As a result, even if the one or more items of delivery note information acquired in step ST110 contain a plurality of pieces of article information, it is possible to determine the consistency between the cargo label information and the delivery note information for each of the pieces of article information. , the article information of the freight label information that has passed this judgment can be registered in the management DB 3 in association with the freight identification information.

The present invention is not limited to the above-described embodiments, but includes various variations.

Cargo can be, for example, cardboard boxes or plastic containers containing goods.

The terminal device is not limited to a device such as a smart phone that can be carried by the worker, and may be a fixedly installed camera device. For example, a fixed camera device (terminal device) automatically captures an image of cargo transported on a transport roller, and the image of the captured cargo (image including cargo labels and identification labels) is sent from the camera device (terminal device). It may be automatically transmitted to the article management device.

A terminal device that captures an image of a statement of delivery and an imaging device that captures an image of cargo may be the same device or may be different devices.

When optical character recognition processing is performed in the processing of step ST110 or step ST145 in FIG. Accordingly, the character information resulting from the optical character recognition process may be modified.

When optical character recognition processing is performed in the processing of steps ST110 and ST145 of FIG. good.

When optical character recognition processing is performed in the processing of steps ST110 and ST145 in FIG. may be displayed.

When a plurality of order numbers are included in the statement of delivery and the cargo 7 is received for each order number, the processing of steps ST140 to ST190 in FIG. 3 may be executed for the cargo 7 corresponding to each order number.

If a plurality of product numbers correspond to one order number in the delivery note, and cargo 7 is received for each product number, the processing of steps ST140 to ST190 in FIG. 3 is executed for cargo 7 corresponding to each product number. good.

When one order number and one product number are described in the delivery note, and a plurality of cargoes 7 are stored for this one product number, steps ST140 to 3 in FIG. The process of ST190 may be executed.

In step ST105 and step ST140 of FIG. 3, when the terminal device 2 captures an image of the target object (delivery note 6, cargo 7), the image capturing is repeatedly re-taken (the captured image is canceling and capturing a new image).

If the quantity of goods scheduled to be received in the warehousing data is greater than the quantity of goods described in the statement of delivery, the processing of step ST185 in FIG. information registration process) is executed, the quantity of goods in the goods information registered in the management DB 3 (quantity of goods confirmed to be in stock) is subtracted from the quantity of goods scheduled to be in stock in the warehousing data, and after subtraction The remaining number (the remaining number of articles to be stocked) may be displayed on the terminal device 2 . Moreover, each time this subtraction is performed, the quantity of articles to be stored in the storage data may be updated to the remaining number after the subtraction (remaining number of articles to be stored). As a result, each time a cargo 7 having the same order identification information is received, the quantity of goods scheduled to be stored in the receipt data is reduced by the number of goods included in the received cargo 7 .

If the statement of delivery 6 does not exist and only the warehouse data is acquired, the processing of steps ST105 to ST130 in the flowchart shown in FIG. 3 may be omitted. In this case, in step ST170, the first processing unit 18 of the article management device 1 determines that the article information included in the cargo label information acquired from the image of the cargo 7 and the article information included in the warehousing data acquired in step ST100 are It is determined whether or not they match, and if it is determined that these pieces of article information match, the process of step ST185 may be executed.

In the flowchart shown in FIG. 4, based on the delivery note format specified by the delivery note format specification information input from the terminal device 2, the position and range of the image range of each delivery note item in the image of the delivery note 6 are specified, Although the information of each statement of delivery item is acquired from the image range obtained, the present invention is not limited to this example. That is, if the delivery note 6 contains an optical code (such as a bar code), the still image of the delivery note 6 is subjected to optical character recognition processing in the same manner as in steps ST430 to ST455 in FIGS. The step of acquiring the invoice information and the step of decoding the optical code from the moving image of the invoice 6 and acquiring the invoice information may be performed separately.

FIG. 13 is a flow chart for explaining a modified example of the process of acquiring the statement of delivery information from the image of the statement of delivery 6 (ST110, FIG. 3). 13, step ST225 in the flowchart of FIG. 4 is replaced with steps ST225A and ST225B, step ST230 in the flowchart of FIG. 4 is replaced with steps ST230A and ST230B, and step ST235 in the flowchart of FIG. ST235B is replaced, and other steps are the same as the flow chart shown in FIG.
Steps ST225A, ST230A, ST235A, ST225B, ST230B, and ST235B in the flowchart of FIG. 13 respectively correspond to steps ST430, ST435, ST440, ST445, ST450, and ST455 in the flowchart of FIG. That is, each step of the former (Fig. 13) replaces the image (still image, moving image) of the cargo 7 in each step of the latter (Fig. 6) with the image (still image, moving image) of the delivery note 6, and converts the cargo label information. It corresponds to what is read as delivery note information.

In the flowchart of FIG. 13, the first processing unit 18 inputs a still image of the delivery note 6 captured by the terminal device 2 (ST230A), and based on the input still image of the delivery note 6, The characters appearing on the delivery note 6 included in the are read by optical character recognition processing (ST235A), the moving image of the delivery note 6 captured by the terminal device 2 is input (ST230B), and based on the input moving image of the delivery note 6, The optical code appearing on the delivery note 6 included in the moving image of the delivery note 6 is decoded (ST235B). Step ST230A of inputting the still image of the statement of delivery 6 and step ST230B of inputting the moving image of the statement of delivery 6 are continuously performed.

DESCRIPTION OF SYMBOLS 1... Article management apparatus, 11... Communication part, 17... 1st memory|storage part, 18... 1st process part, 2... Terminal device, 21... Communication part, 22... Input part, 23... Imaging part, 24... Display part, 25... Sound input/output unit, 27... Second storage unit, 28... Second processing unit, 3... Management database, 4... Delivery note format database, 5... Freight label format database, 6... Delivery note, 7... Freight, 71 ... cargo label, 72 ... identification label, 9 ... communication network

Claims (24)

An article management device capable of communicating with one or more terminal devices having an imaging function,
a first processing unit;
a first storage unit that stores executable instructions in the first processing unit;
The first processing unit is capable of accessing a management database that stores information about goods that have been stored,
The process executed by the first processing unit in response to the instruction stored in the first storage unit includes:
An image of the delivery note imaged by the terminal device, which contains article information related to the article in the cargo shown in the delivery note, based on the image of the delivery note attached to the cargo containing the article. a first information acquisition step of acquiring delivery note information;
Cargo label information including the article information indicated on the cargo label based on the image of the cargo captured by the terminal device, the image including the image of the cargo label attached to the cargo. a second information acquisition step of acquiring
a first match determination step of determining whether the item information in the acquired delivery note information and the item information in the acquired cargo label information match;
When it is determined that the article information in the delivery note and the article information in the freight label information match, the freight identification information for uniquely identifying each freight and the matching freight label information a registration step of associating with article information and registering it in the management database;
The image of the cargo imaged by the terminal device is an image of an identification label affixed to the cargo, and includes an image of the identification label showing the cargo identification information,
The second information acquisition step includes acquiring the cargo identification information based on the image of the cargo including the image of the identification label,
The registration step includes associating the acquired freight identification information with the goods information of the matched freight label information and registering them in the management database.
Goods management device. each item information includes one item type identification information,
The product type identification information is information for identifying the type of the product,
each piece of product information is associated with one piece of order identification information;
The order identification information is information for identifying individual orders,
a combination of the item type identification information included in the item information and the order identification information associated with the item information differs for each item information;
There are cases where the goods related to one of the goods information are included in a plurality of the goods,
The second information acquisition step includes obtaining the cargo label information and the cargo identification based on the image of the cargo for each of the one or more cargoes containing the goods related to one of the goods information of the delivery note information. including obtaining information;
The first match determination step comprises: one item of the item information of the delivery note information; including determining whether the product information matches,
In the registration step, when it is determined that one piece of article information in the delivery note information and one or more pieces of article information in the cargo label information match, one or more pieces of article information related to the piece of article information are included. for each of the cargoes, the article information of the cargo label information acquired based on the image of the cargo and the cargo identification information acquired based on the image of the cargo are associated and registered in the management database. including,
The article management device according to claim 1. The first information acquisition step includes acquiring one or more items of delivery note information based on one or more images of the delivery note captured by the terminal device,
The one or more delivery note information may include a plurality of the item information,
In the second information acquisition step, when the one or more items of delivery note information acquired in the first information acquisition step include a plurality of items of item information, each of the items of item information is obtained based on the image of the cargo. Acquiring one or more of the cargo label information and one or more of the cargo identification information. When information is included, for each of the plurality of item information, one item information of the delivery note information and one or more items acquired for one or more cargoes containing the item related to the one item information determining whether the cargo label information matches the item information;
In the registration step, when it is determined that at least one piece of article information in a plurality of pieces of article information included in one or more of the delivery note information matches the article information of one or more pieces of the cargo label information, the at least one For each of the one or more cargoes containing the goods related to the cargo information, the cargo label information acquired based on the cargo image, and the cargo identification acquired based on the cargo image. including registering in the management database in association with information;
The article management device according to claim 2. The second information acquisition step includes:
if the one or more items of delivery note information acquired in the first information acquisition step include a plurality of items of item information, displaying information representing the items of item information on the terminal device;
a step of inputting a user's instruction to select one of the plurality of article information from the terminal device on which the information representing the plurality of article information is displayed;
Each time the instruction to select one item of article information is input from the terminal device, one or more of the cargo label information and one or more of the item information selected by the instruction are selected based on the image of the cargo. and obtaining the cargo identification information of
In the first consistency determination step, every time the instruction to select one piece of article information is input from the terminal device, determining the match of the obtained one or more of the cargo label information with the article information;
The article management device according to claim 3. The step of displaying information representing a plurality of the item information on the terminal device includes displaying the combination of the item type identification information and the order identification information on the terminal device for each item information.
The article management device according to claim 4. The step of displaying information representing a plurality of items of article information on the terminal device includes displaying information representing individual pieces of item information in the plurality of pieces of article information, the item information of the delivery note information and the item information of the cargo label information. Including displaying in a manner in which it is possible to determine whether or not a determination result that matches the product information has been obtained,
The step of inputting a user's instruction to select one piece of article information from the terminal device includes the article information of the delivery note information and the cargo label information among the plurality of pieces of article information included in the acquired delivery note information. inputting a user's instruction to select one piece of article information for which a determination result has not been obtained that it matches the article information of
The article management device according to claim 4. the delivery note includes one or more delivery note items;
the delivery note information includes information about at least some of the delivery note items on the delivery note;
The first information acquisition step includes:
input from the terminal device delivery note format specification information specifying the delivery note format of the delivery note for which the delivery note information is to be acquired, and specifying the delivery note format related to the position and range of one or more of the delivery note items; and
a step of inputting the image of the statement of delivery imaged by the terminal device;
obtaining at least part of the delivery note information based on the delivery note format specified by the delivery note format specifying information input from the terminal device and an image of the delivery note input from the terminal device; including,
The article management device according to claim 1. The step of acquiring the delivery note information based on the delivery note format specified by the delivery note format specifying information and the image of the delivery note,
A first trained model given in advance for one of the delivery note formats specified by the delivery note format specification information, wherein one or more of the delivery notes are obtained from an image of the delivery note having the one delivery note format. input from the terminal device by applying the image of the invoice input from the terminal device to the first trained model generated so as to specify one or more image ranges corresponding to the item identifying one or more of the image areas in the image of the invoice;
obtaining, from each of the identified one or more image ranges, information of the delivery note item corresponding to the image range;
The article management device according to claim 7. The first information acquisition step includes a step of displaying, on the terminal device, a sample image of the delivery note having the delivery note format designated by the delivery note format specifying information input from the terminal device,
The step of inputting the image of the statement of delivery imaged by the terminal device includes the image of the statement of delivery confirmed by the user of the terminal device as having the same format of the statement of delivery as that of the statement of delivery indicated by the image for sample. including entering
The article management device according to claim 7. the delivery note includes one or more delivery note items;
the delivery note information includes information about at least some of the delivery note items on the delivery note;
The first information acquisition step includes:
a step of inputting the image of the statement of delivery imaged by the terminal device;
Based on the image of the statement of delivery captured by the terminal device, the format of the statement of delivery of the statement of delivery in the image and the format of the statement of delivery related to the position and range of one or more items of the statement of delivery is discriminated. process and
Acquiring at least part of the delivery note information based on the determined delivery note format and the image of the delivery note input from the terminal device,
The article management device according to claim 1. The first information acquisition step includes a step of displaying a sample image of the delivery note having the determined delivery note format on the terminal device,
The step of acquiring the delivery note information based on the determined delivery note format and the image of the delivery note comprises: from the terminal device on which the sample image of the delivery note is displayed, the When a response indicating that the delivery note format of the delivery note is appropriate, obtaining the delivery note information based on the determined delivery note format and the image of the delivery note,
The article management device according to claim 10. the cargo label includes one or more cargo label items;
the cargo label information includes information about at least some of the cargo label items on the cargo label;
a cargo label format possessed by the cargo label, wherein the cargo label format relating to the position and range of one or more of the cargo label items included in the cargo label is associated with the goods type identification information;
The second information acquisition step includes:
a step of identifying the cargo label format associated with the product type identification information included in the product information of the delivery note information acquired in the first information acquisition step;
For each of the one or more cargoes including the goods related to the goods information in the delivery note information acquired in the first information acquisition step, the cargo including the image of the cargo label imaged by the terminal device inputting an image;
The specified cargo label format and the cargo input from the terminal device for each of the one or more cargoes containing the goods related to the goods information in the delivery note information acquired in the first information acquisition step obtaining at least some of the cargo label information based on the images of
The article management device according to claim 2. obtaining the cargo label information based on the identified cargo label format and the image of the cargo,
one or more of the cargo label items from a second trained model previously given for the specified cargo label format, the image of the cargo including the image of the cargo label having the specified cargo label format; By applying the image of the cargo input from the terminal device to the second trained model generated so as to specify one or more corresponding image ranges, the image of the cargo input from the terminal device is applied. identifying one or more of said image regions in an image;
from each of the identified one or more of the image areas, obtaining information of the cargo label item corresponding to the image area;
The article management device according to claim 12. The first information acquisition step includes acquiring one or more items of delivery note information based on one or more images of the delivery note captured by the terminal device,
The one or more delivery note information may include a plurality of the item information,
In the second information acquisition step, when the one or more items of statement of delivery information acquired in the first information acquisition step include a plurality of items of item information, the item information included in the item information is obtained for each of the items of item information. specifying the cargo label format associated with the type identification information; inputting one or more images of the cargo captured by the terminal device; obtaining one or more of the cargo label information based on an image; and obtaining one or more of the cargo identification information based on the input one or more images of the cargo;
When the one or more pieces of delivery note information acquired in the first information acquisition step include a plurality of pieces of item information, the first consistency determination step includes, in the first information acquisition step, for each piece of item information Determining whether the item information of the acquired delivery note information and the item information of one or more of the cargo label information acquired in the second information acquisition step match,
In the registration step, when it is determined that at least one piece of article information included in the one or more items of the delivery note information acquired in the first information acquisition step matches the item information of the one or more items of the cargo label information, obtained based on the image of the cargo and the item information of the cargo label information obtained based on the image of the cargo, for each of the one or more shipments containing the item associated with at least one item information; Registering in the management database in association with the cargo identification information,
The article management device according to claim 12. The second information acquisition step includes:
if the one or more items of delivery note information acquired in the first information acquisition step include a plurality of items of item information, displaying information representing the items of item information on the terminal device;
a step of inputting a user's instruction to select one of the plurality of article information from the terminal device on which the information representing the plurality of article information is displayed;
Each time the instruction to select one piece of article information is input from the terminal device, the cargo associated with the article type identification information included in the article information for the piece of article information selected by the instruction inputting one or more images of the cargo captured by the terminal device; determining one or more cargoes based on the identified cargo label format and one or more input images of the cargo; obtaining label information; and obtaining one or more of the cargo identification information based on one or more input images of the cargo;
In the first consistency determination step, every time the instruction to select one piece of article information is input from the terminal device, determining the match of the obtained one or more of the cargo label information with the article information;
The article management device according to claim 14. The processing executed by the first processing unit in response to the command of the first storage unit is, when it is determined that the product information in the delivery note information and the product information in the cargo label information do not match, 2 including a step of inputting an instruction to correct the article information included in the cargo label information acquired in the information acquisition step from the terminal device;
In the first match determination step, when the correction instruction of the article information of the cargo label information is input from the terminal device, the article information and the delivery note information of the cargo label information corrected in accordance with the correction instruction are input. comprising determining whether the item information of
The article management device according to claim 1. The second information acquisition step includes:
inputting a still image of the cargo captured by the terminal device;
a step of inputting a moving image of the cargo captured by the terminal device;
a step of reading characters appearing on at least one of the cargo label and the identification label included in the still image of the cargo by optical character recognition processing based on the input still image of the cargo; and based on the input moving image of the cargo. and decoding an optical code appearing on at least one of the cargo label and the identification label included in the cargo animation,
The step of inputting a still image of the cargo and the step of inputting the moving image of the cargo are performed in succession,
The article management device according to claim 1. The first information acquisition step includes:
inputting a still image of the statement of delivery captured by the terminal device;
a step of inputting a moving image of the statement of delivery captured by the terminal device;
a step of reading characters appearing on the delivery note contained in the still image of the delivery note by optical character recognition processing based on the input still image of the delivery note; decoding the optical code appearing on the delivery note included in the video of the document;
The step of inputting the still image of the delivery note and the step of inputting the moving image of the delivery note are continuously performed.
The article management device according to claim 1. The process executed by the first processing unit in response to the instruction stored in the first storage unit includes:
a warehousing data obtaining step of obtaining warehousing data including order identification information for identifying each order and the article information;
a warehousing data identifying step of identifying the warehousing data corresponding to the statement of delivery information acquired in the first information acquisition step based on the order identification information included in the statement of delivery information;
A second match determination step of determining whether the article information included in the delivery note information acquired in the first information acquisition step matches the article information included in the warehousing data specified in the warehousing data specifying step. and
In the registration step, when the article information included in the warehousing data specified in the warehousing data specifying step and the article information included in the statement of delivery information acquired in the first information acquisition step match, the second matching is performed. The article information included in the invoice information determined in the determination step and obtained in the first information obtaining step matches the article information included in the cargo label information obtained in the second information obtaining step. Then, when it is determined in the first matching determination step, the article information of the cargo label information and the cargo identification information are associated and registered in the management database,
The article management device according to any one of claims 1 to 18. The process executed by the first processing unit in response to the command of the first storage unit is performed in the second match determination step if the item information in the delivery note information and the item information in the warehousing data do not match. If determined, inputting from the terminal device an instruction to correct the article information included in the delivery note information acquired in the first information acquisition step;
In the second consistency determination step, when the correction instruction of the article information in the delivery note information is input from the terminal device, the article information and the warehousing data in the delivery note information corrected in accordance with the correction instruction. determining whether the item information matches;
An article management device according to claim 19. The second information acquisition step is executed when it is determined in the second matching determination step that the article information in the delivery note and the article information in the warehousing data match.
An article management device according to claim 19. one or more terminal devices having an imaging function;
an article management device communicable with the terminal device;
The article management device
a first processing unit;
a first storage unit that stores executable instructions in the first processing unit;
The first processing unit is capable of accessing a management database that stores information about goods that have been stored,
The terminal device
an imaging unit;
a second processing unit;
a second storage unit that stores executable instructions in the second processing unit;
The process executed by the second processing unit in response to the command stored in the second storage unit includes:
a delivery statement imaging step of capturing an image of a delivery statement attached to a cargo including the goods in the imaging unit;
and a cargo imaging step of capturing an image of the cargo in the imaging unit,
The process executed by the first processing unit in response to the instruction stored in the first storage unit includes:
a first information acquisition step of acquiring delivery note information including article information related to the article in the cargo indicated on the delivery note based on the image of the delivery note imaged by the terminal device;
Cargo label information including the article information indicated on the cargo label based on the image of the cargo captured by the terminal device, the image including the image of the cargo label attached to the cargo. a second information acquisition step of acquiring
a first match determination step of determining whether the item information in the acquired delivery note information and the item information in the acquired cargo label information match;
When it is determined that the article information in the delivery note and the article information in the freight label information match, the freight identification information for uniquely identifying each freight and the matching freight label information a registration step of associating with article information and registering it in the management database;
The cargo imaging step includes capturing an image of the cargo, which is an image of an identification label affixed to the cargo and includes an image of the identification label indicating the cargo identification information,
The second information acquisition step includes acquiring the cargo identification information based on the image of the cargo including the image of the identification label,
The registration step includes associating the acquired freight identification information with the goods information of the matched freight label information and registering them in the management database.
Goods management system. An article management method executed by a computer capable of communicating with one or more terminal devices having an imaging function,
The computer has access to a management database that stores information about items received;
An image of the delivery note imaged by the terminal device, which contains article information related to the article in the cargo shown in the delivery note, based on the image of the delivery note attached to the cargo containing the article. a first information acquisition step of acquiring delivery note information;
Cargo label information including the article information indicated on the cargo label based on the image of the cargo captured by the terminal device, the image including the image of the cargo label attached to the cargo. a second information acquisition step of acquiring
a first match determination step of determining whether the item information in the acquired delivery note information and the item information in the acquired cargo label information match;
When it is determined that the article information in the delivery note and the article information in the freight label information match, the freight identification information for uniquely identifying each freight and the matching freight label information a registration step of associating with article information and registering it in the management database;
The image of the cargo imaged by the terminal device is an image of an identification label affixed to the cargo, and includes an image of the identification label showing the cargo identification information,
The second information acquisition step includes acquiring the cargo identification information based on the image of the cargo including the image of the identification label,
The registration step includes associating the acquired freight identification information with the goods information of the matched freight label information and registering them in the management database.
Goods management method. An article management program that causes a computer capable of communicating with one or more terminal devices having an imaging function to execute processing,
The computer has access to a management database that stores information about items received;
The processing that the article management program causes the computer to execute includes:
An image of the delivery note imaged by the terminal device, which contains article information related to the article in the cargo shown in the delivery note, based on the image of the delivery note attached to the cargo containing the article. a first information acquisition step of acquiring delivery note information;
Cargo label information including the article information indicated on the cargo label based on the image of the cargo captured by the terminal device, the image including the image of the cargo label attached to the cargo. a second information acquisition step of acquiring
a first match determination step of determining whether the item information in the acquired delivery note information and the item information in the acquired cargo label information match;
When it is determined that the article information in the delivery note and the article information in the freight label information match, the freight identification information for uniquely identifying each freight and the matching freight label information a registration step of associating with article information and registering it in the management database;
The image of the cargo imaged by the terminal device is an image of an identification label affixed to the cargo, and includes an image of the identification label showing the cargo identification information,
The second information acquisition step includes acquiring the cargo identification information based on the image of the cargo including the image of the identification label,
The registration step includes associating the acquired freight identification information with the goods information of the matched freight label information and registering them in the management database.
Goods management program.

Images