JP7243066B2 - Automated warehouse system - Google Patents

Description

The present invention relates to an automated warehouse system that manages packages stored in an automated warehouse.

Patent Literature 1 discloses an automated warehouse that detects the type of a bucket that is loaded into and unloaded from the automated warehouse by reading a barcode provided on the bucket with a barcode reader. In this automated warehouse, the types of buckets detected by a barcode reader are used to manage the entry and exit of buckets into and out of the automated warehouse.

Japanese Utility Model Laid-Open No. 3-127606

However, with the technique of Patent Document 1, there is a possibility that the barcode of the bucket cannot be read depending on the status of the barcode or the barcode reader. In other words, if the barcode is dirty or damaged, the barcode reader may not be able to read the barcode. Similarly, if the barcode reader is dirty, it may not be possible to read the barcode. In particular, for example, when capturing multiple barcodes of multiple packages and recognizing multiple barcodes included in the images obtained by capturing images at once, when some barcodes included in the image cannot be recognized. In addition, since it is not possible to obtain parcel data related to parcels to which the partial barcodes have been assigned, the parcels are lost.

In addition, in Patent Document 1, OCR (Optical Character Recognition/Reader), which reads characters on the outer surface of one package using an image obtained by imaging the package, is applied to recognize the type of package. It is also possible. However, even when OCR is used, if characters are erroneously recognized, the parcel is managed with wrong parcel data. For this reason, there is a risk of losing sight of packages managed with incorrect package data.

In order to prevent recognition errors such as barcode reading errors and character misrecognition as described above, it is conceivable to have the worker check whether the package has been correctly recognized by the automated warehouse when the package enters the automated warehouse. be done. However, in this case, the cargo is kept waiting at the entrance of the automated warehouse until the worker correctly recognizes the cargo. As a result, there is a problem that the cargo stays at the entrance of the automated warehouse, and the efficiency of loading the cargo into the automated warehouse decreases.

Therefore, the present invention has been made in view of such circumstances, and provides an automated warehouse system capable of reducing recognition errors of packages entering an automated warehouse and efficiently storing packages into the automated warehouse. intended to provide

In order to achieve the above object, an automated warehouse system according to one aspect of the present invention is an automated warehouse system comprising an automated warehouse having shelves and a transport device, wherein images of packages entering the automated warehouse are captured. an imaging device, a display device capable of displaying an image obtained by the imaging device, (i) causing the transport device to store the package on the shelf, (ii) acquiring package data relating to the package, and (iii) ) a controller that causes the display device to display the image together with the acquired parcel data.

According to this, since the automated warehouse receives the packages imaged by the imaging device without obtaining the permission of the operator, it is possible to reduce the stagnation of the packages at the entrance of the automated warehouse. In addition, the controller displays an image of a package entering the automated warehouse on the display device together with package data related to the package. It is possible to easily confirm whether or not the parcel data regarding the parcel is correct. Therefore, the operator can easily identify packages with incorrect package data, and can effectively reduce misrecognition of packages entering the automated warehouse.

Further, a recognition device that acquires the image and executes image recognition processing on the acquired image to generate the luggage data related to the luggage included in the image, wherein the controller comprises the Package data may be obtained from the recognition device.

Therefore, the worker can effectively reduce recognition errors of the packages entering the automated warehouse by the recognition device.

Further, the controller causes the display device to display the plurality of acquired parcel data and the plurality of images obtained by imaging by the imaging device in an order rearranged based on a predetermined condition. good too.

Therefore, the worker can continuously check the images of similar packages under predetermined conditions, and can complete the checking work in a short time.

Further, the automated warehouse system may include a plurality of the display devices, and the controller may cause the plurality of display devices to display the parcel data and the images different from each other.

Therefore, a plurality of workers can share the checking work, and the checking work can be completed in a short time.

Further, the plurality of packages are grouped into a plurality of groups for each of a predetermined number of one or more, and the image pickup device selects the predetermined number of packages included in each group for each of the plurality of groups. may be imaged, and the controller may cause the display device to display, for each of the plurality of groups, the package data corresponding to the group and the image including the group.

Therefore, the worker can perform confirmation work for each group, and can complete the confirmation work in a short time.

Also, the plurality of packages are grouped into a plurality of groups for each of a predetermined number of one or more, the imaging device captures an image of each of the plurality of groups, and the recognition device is configured to: (i) recognizing the number of packages in the group included in the image by executing the image recognition process; and (ii) obtaining the package data including the number of packages obtained by recognition. Further, the controller acquires the number of received goods, which is the number of goods received as the group, for each of the plurality of groups, and combines the acquired number of received goods with the recognized number of goods included in the goods data. are matched, and the display device does not display the parcel data and the image corresponding to the group in which the received number and the recognized number match, and the group in which the received number and the recognized number do not match may be displayed on the display device.

According to this, the controller judges that a group in which the number of received goods and the number of recognized goods are the same is correctly recognized, and does not display the baggage data and image corresponding to the group on the display device. Therefore, the number of images to be checked by the worker can be reduced, and the worker can complete the checking work in a short time.

In addition, the plurality of packages are grouped into a plurality of groups by a predetermined number of one or more, and the transport device selects from among the plurality of groups stored in the automated warehouse in response to a shipping instruction. The other group is taken out, and the one group after being picked by the worker is re-stocked in the automated warehouse, and the recognition device detects that the re-stocked one group is imaged by the imaging device. By executing the image recognition processing on the image that has been stored, the number of the packages in the one group when restocked is recognized, and the packages including the recognized number, which is the number obtained by recognizing Data is generated, and the controller further calculates the number of parcels in the one group before picking minus the number of parcels picked by the worker according to the delivery instruction. If the planned number does not match the recognized number, which is the number of parcels included in the acquired parcel data, information indicating that the planned restocking number and the recognized number do not match may be notified.

Therefore, it is possible to easily identify a package that has been erroneously picked.

It should be noted that these general or specific aspects may be realized by methods, integrated circuits, computer programs, or recording media such as computer-readable CD-ROMs. Any combination may be used.

According to the automated warehouse system according to the present invention, it is possible to reduce recognition errors of packages to be stored in the automated warehouse, and to efficiently store the packages in the automated warehouse.

FIG. 1 is a plan view showing a schematic configuration of an automated warehouse system according to an embodiment. FIG. 2 is a block diagram showing an example of the functional configuration of the automated warehouse system according to the embodiment. FIG. 3 is a schematic diagram for explaining an imaging device and an imaging target of the imaging device according to the embodiment. FIG. 4 is a diagram showing an example of an image captured by the imaging device according to the embodiment. FIG. 5 is a diagram showing an example of parcel data generated by the recognition device. 6 is a diagram illustrating an example of a UI displayed on the display device according to the embodiment; FIG. 7 is a diagram illustrating an example of a UI displayed on the display device according to the embodiment; FIG. FIG. 8 is a diagram showing an example of updated parcel data. FIG. 9 is a sequence diagram for explaining the operation of the automated warehouse system according to the embodiment. FIG. 10 is a sequence diagram for explaining the operation of the automated warehouse system according to Modification 1. As shown in FIG. FIG. 11 is a block diagram showing an example of the functional configuration of an automated warehouse system according to Modification 2. As shown in FIG. FIG. 12 is a sequence diagram for explaining the re-entry operation of the automated warehouse system according to Modification 2. As shown in FIG. 13A and 13B are schematic diagrams for explaining an imaging device and an imaging target of the imaging device according to Modification 3. FIG. 14A and 14B are diagrams illustrating an example of an image captured by an imaging device according to Modification 3. FIG. FIG. 15 is a diagram showing an example of parcel data generated by the recognition device according to Modification 3. As shown in FIG. 16 is a diagram illustrating an example of a UI displayed on a display device according to Modification 3. FIG. 17A and 17B are diagrams for explaining parcel data and images to be transmitted to the display device of the automated warehouse system according to Modification 4. FIG. 18A and 18B are diagrams for explaining parcel data and images to be transmitted to the display device of the automated warehouse system according to Modification 5. FIG.

Hereinafter, an automated warehouse system according to one aspect of the present invention will be specifically described with reference to the drawings.

It should be noted that each of the embodiments described below is a specific example of the present invention. Numerical values, shapes, materials, components, arrangement positions and connection forms of components, steps, order of steps, and the like shown in the following embodiments are examples and are not intended to limit the present invention. In addition, among the constituent elements in the following embodiments, constituent elements that are not described in independent claims representing the highest concept will be described as arbitrary constituent elements.

Each figure is a schematic diagram and is not necessarily strictly illustrated. Moreover, in each figure, the same code|symbol is attached|subjected with respect to substantially the same structure, and the overlapping description may be abbreviate|omitted or simplified.

(Embodiment)
The configuration of an automated warehouse system according to an embodiment will be described with reference to FIGS. 1 and 2. FIG.

FIG. 1 is a plan view showing a schematic configuration of an automated warehouse system according to an embodiment. FIG. 2 is a block diagram showing an example of the functional configuration of the automated warehouse system according to the embodiment.

The automated warehouse system 1 according to the present embodiment is a system for accurately managing packages entering and leaving the automated warehouse 100 . The automated warehouse system 1 includes an automated warehouse 100 , an imaging device 200 , a controller 300 and a display device 400 . The automated warehouse system 1 may further include an indicating device 500 .

The automated warehouse 100 has shelves 110 and transport devices 120 and 130 .

Shelves 110 store packages 20 . The shelf 110 stores, for example, a pallet 10 on which a plurality of packages 20 are placed. As shown in FIG. 1, the shelf 110 may have two rows in the horizontal direction, and may have a configuration in which a plurality of pallets 10 can be arranged in each row, or a configuration in which a plurality of pallets 10 can be arranged in the vertical direction. may Also, the shelf 110 may store packages 20 that are not placed on the pallet 10 .

The transport device 120 has an incoming conveyor 121 for incoming goods and an outgoing conveyor 122 for outgoing goods. The transport device 120 may further have a restocking conveyor 123 for restocking. In addition, although the transport device 120 is configured by a conveyor, it may be configured by a transport vehicle that travels around a circular route.

The warehousing conveyor 121 is a conveyor that conveys the pallets 10 to be stored on the racks 110 to the racks 110 , that is, that warehousing the pallets 10 into the automated warehouse 100 . The unloading conveyor 122 is a conveyor that transports the pallets 10 stored on the racks 110 , that is, unloads the pallets 10 from the automated warehouse 100 . The re-entering conveyor 123 is a conveyor for re-entering the pallets 10 after predetermined packages 20 have been picked by the worker U at the picking station 140 among the pallets 10 delivered from the delivery conveyor 122 . The re-receiving conveyor 123 conveys the pallet 10 from the picking station 140 to the receiving conveyor 121 .

The transport device 130 is a transfer device that receives the pallet 10 from the warehousing conveyor 121 and transfers the received pallet 10 to a predetermined position on the shelf 110 . Further, the transport device 130 is a transfer device that pulls out the pallet 10 stored on the shelf 110 from the shelf 110 and transfers it to the delivery conveyor 122 . The transport device 130 is, for example, a stacker crane.

Next, the imaging device 200 and the object to be imaged by the imaging device 200 will be described using FIGS. 3 and 4 in addition to FIGS. 1 and 2. FIG. FIG. 3 is a schematic diagram for explaining an imaging device and an imaging target of the imaging device according to the embodiment. FIG. 4 is a diagram showing an example of an image captured by the imaging device according to the embodiment.

As shown in FIGS. 1 and 3, the imaging device 200 images the pallet 10 entering the automated warehouse 100 . The imaging device 200 is fixed at a position and posture for imaging the space A1 on the incoming conveyor 121 of the automated warehouse 100 so as to capture the space A1. The imaging device 200 is, for example, a camera having an optical system such as a lens and an image sensor.

The imaging device 200 detects that there is a pallet 10 or a package 20 in the space A1, and performs imaging when the pallet 10 or the package 20 is detected, thereby capturing an image of the pallet 10 or the package 20 stored in the automated warehouse 100. You may In this case, the imaging device 200 may detect the presence of the pallet 10 or the load 20 in the space A1 to be imaged using a distance sensor (for example, an infrared sensor) that detects objects. The imaging device 200 images the pallet 10 and the packages 20 placed on the pallet 10 for each of the pallets 10 .

As shown in FIG. 3, the pallet 10 has a label 11 containing a bar code on its side. A plurality of packages 20 are placed on the pallet 10 . That is, a plurality of packages 20 are grouped by a plurality of pallets 10 and classified into a plurality of groups. That is, the first number (one or more) of packages 20 placed on one pallet 10 belongs to one group (that is, the same group) corresponding to the one pallet 10 . Therefore, the plurality of packages 20 are classified into the same number of groups as the number of pallets 10 . A label 21 including a barcode is attached to each of the plurality of packages 20 on the side. The labels 11 and 21 may contain two-dimensional codes instead of barcodes, or other optical reading codes. The optical reading codes included in the labels 11 and 21 are identifiers for identifying the pallet 10 and the packages 20, and indicate group IDs and package IDs, respectively.

Although one group corresponds to one pallet 10 and the first number of packages 20 placed on the one pallet 10 belongs to the same group, the present invention is not limited to this. One group may be a collection for facilitating management of multiple products. For example, multiple products of the same type may belong to the same group.

The label 11 is affixed to the pallet 10 in advance. The label 21 is attached before the package 20 is stored. Therefore, the same number of labels 21 as the number of parcels 20 is issued. Also, the labels 11 and 21 are attached to the side surfaces of the pallet 10 and the package 20 at least on the side where the imaging device 200 is arranged with respect to the incoming conveyor 121 .

In addition, the image capturing device 200 captures an image of a predetermined number of packages 20 included in each of a plurality of groups. In other words, the imaging device 200 images the pallet 10 and one or more packages 20 placed on the pallet 10 for each of the plurality of pallets 10 . In addition, since the label 11 is attached to the pallet 10 and the label 21 is attached to the package 20, the imaging device 200 captures the label 11 of the pallet 10 and the package 20 when the pallet 10 and the package 20 are imaged. The label 21 of 20 is also imaged together. As a result, as shown in FIG. 4, the imaging device 200 obtains an image 201 including the pallet 10 and its label 11 and the parcel 20 and its label 21 .

Although the imaging device 200 detects that the pallet 10 or the load 20 is in the space A1 using the distance sensor, the present invention is not limited to this. The imaging device 200 may detect that there is a pallet 10 or a parcel 20 in the space A1 to be imaged by performing image processing on an image (for example, moving image) captured by the imaging device 200 . When the imaging device 200 detects the presence of the pallet 10 or the parcel 20 by image processing, the moving image being captured is used for the detection. It may be detected using a moving image that has been adjusted. Further, in this case, the imaging device 200 stores the pallet 10 or the load 20 in the auxiliary storage device as a moving image, and extracts the image showing the pallet 10 or the load 20 from the stored moving image. 20 may be obtained. Note that the auxiliary storage device is, for example, a HDD (Hard Disk Drive), an SSD (Solid Stated Drive), a non-volatile memory, or the like. Also, the main storage device is, for example, a volatile memory such as a RAM (Random Access Memory).

The controller 300 is a controller that controls and manages the automated warehouse system 1 . That is, the controller 300 is a host computer, and for example, by exchanging information with the transport devices 120 and 130 of the automated warehouse 100, the pallets 10 that are put in and out of the racks 110 or the pallets 10 that are placed on the pallets 10 are stored. It manages the baggage 20 that is in the state. The controller 300 transmits a warehousing instruction or a warehousing instruction to the transport devices 120 and 130, and receives completion information indicating warehousing completion or warehousing completion from the transport devices 120 and 130. FIG. As a result, the controller 300 can update the management information indicating which type of package 20 is placed at which position on the shelf 110 to the latest state. That is, the controller 300 manages the packages 20 by updating the management information in real time according to the pallets 10 placed on the shelf 110 or the packages 20 placed on the pallets 10 .

For example, when the pallet 10 is stored in the automated warehouse 100 using the transport devices 120 and 130 , the controller 300 stores the pallet 10 after imaging the pallet 10 with the imaging device 200 . That is, the controller 300 stores the pallet 10 imaged by the imaging device 200 on the shelf 110 by the transport devices 120 and 130 without obtaining permission from the operator or an external device. Note that, when receiving an instruction to store the cargo 20 from the controller 300, the conveying devices 120 and 130 obtain the instruction from the controller 300 if it can be confirmed that the imaging of the cargo 20 has been completed by the imaging device 200. The package 20 may be stored in the automated warehouse 100 even if there is no such package. At this time, the conveying devices 120 and 130 may detect that the imaging device 200 has completed the imaging of the package 20 by receiving a completion report from the imaging device 200. It may be detected when a predetermined period of time has elapsed.

The controller 300 may also have a recognition device 310 . The recognition device 310 acquires an image obtained by the imaging device 200 and performs image recognition processing on the acquired image to generate package data related to the package included in the image. While the controller 300 stores the pallet 10 imaged by the imaging device 200 in the automated warehouse 100, or after storing it in the automated warehouse 100, the recognition device 310 performs image recognition on each of the plurality of images. processing may be performed. The recognition device 310 has a storage device, and may store a plurality of images captured by the imaging device 200 during a predetermined period in the storage device. The recognition device 310 may perform image recognition processing on a plurality of images stored in the storage device. The storage device included in the recognition device 310 is, for example, an HDD (Hard Disk Drive), an SSD (Solid Stated Drive), a non-volatile memory, or the like.

Here, a case where the image recognition processing by the recognition device 310 is performed on the image 201 in FIG. 4 will be described as an example. Specifically, the recognition device 310 recognizes the group ID by recognizing the label 11 attached to the pallet 10 from the image 201 . Further, the recognition device 310 recognizes the parcel ID by recognizing the plurality of labels 21 attached to the plurality of parcels 20 from the image 201 . The recognition device 310 also recognizes the number of packages 20 (hereinafter referred to as “the number of recognized items”) by counting the number of recognized labels 21 . As a result, the recognition device 310 recognizes the group ID, the parcel ID, and the number of recognized parcels 20 of the pallet 10 and the plurality of parcels 20 included in the single image 201 from the single image 201, and associates them with each other. 5 to generate parcel data. Note that the recognition device 310 not only recognizes the group ID, package ID, and the number of recognized items by recognizing the labels 11 and 21, but also recognizes the characters written on the side of the package 20 to identify the product name, manufacturing date, and so on. The vendor, expiration date, model number, serial number, etc. may be recognized. FIG. 5 is a diagram showing an example of parcel data generated by the recognition device.

As shown in FIG. 5, the parcel data includes a group ID "G01" indicated by the label 11 of the pallet 10 recognized from the image P1, and parcel IDs indicated by the labels 21 of the plurality of parcels 20 recognized from the image P1. are 'B11', 'B12', 'B13', . In other words, the recognition device 310 recognizes ten packages 20 with package IDs "B11" to "B20" on the pallet 10 with the group ID "G01" by performing image recognition processing on the image P1. indicated by the data.

Status information indicating the status may be added to the parcel data for each image, that is, for each group. The status includes, for example, "temporary" and "confirmed". The status is set to "provisional" at the time the package data is generated by the recognition device 310 . When the status is "temporary", it indicates that the pallet 10 and the plurality of packages 20, which are the group of the package data, have not been confirmed to be stored in the automated warehouse 100. FIG. The status is changed to "confirmed" when the worker finishes confirming the package data and images using the display device 400, which will be described later. When the status is "confirmed", it indicates that the pallet 10 and the plurality of packages 20, which are the package data group of the package data, are confirmed to be delivered to the automated warehouse 100. FIG. For example, the controller 300 does not include a plurality of parcels 20 included in a group whose status is "provisional" in the search targets for shipping. As a result, the controller 300 can reduce the number of deliveries from the automated warehouse 100 of packages 20 managed with incorrect package data due to erroneous recognition.

Note that the image item in the package data may not be the image itself, and may be information for specifying the image, such as a file name and a link destination to the image, for example. It is also assumed that the image P1 is the same image as the image 201 described with reference to FIG.

Note that the recognition device 310 may be implemented by the same computer as the controller 300 . Also, the recognition device 310 may be implemented by a computer (not shown) that is separate from the controller 300 .

When acquiring package data, the controller 300 stores the acquired package data in the storage device, and transmits an image obtained by the imaging device 200 together with the package data to the display device 400 . Thereby, the controller 300 causes the display device 400 to display the package data and the image. At this time, as shown in FIG. 5, the controller 300 transmits a plurality of images and parcel data associated with each of the plurality of images to the display device 400 so that each of the plurality of groups can be displayed. The parcel data corresponding to the group and the image including the group are displayed on the display device 400 . Further, the controller 300 is configured to correspond to the plurality of images and to each of the plurality of images while the pallet 10 imaged by the imaging device 200 is being stored in the automated warehouse 100 or after being stored in the automated warehouse 100. The attached package data may be displayed on the display device 400 .

In addition, although it is assumed that a package on one pallet belongs to one group, packages on two or more pallets may belong to one group. Therefore, when packages on two or more pallets belong to one group, packages belonging to one group may be included across two or more images. Also, even if products of the same type belong to one group, packages belonging to one group may be included across two or more images.

The package data to be displayed on the display device 400 is not limited to the package data recognized by the recognition device 310. Using the recognized package data, information equipment such as an external server or a database stored in a storage device can be displayed. Detailed data associated with the recognized package data obtained by matching may be included.

The display device 400 is a device that displays an image. Display device 400 has communication unit 410 , display unit 420 , and input reception unit 430 .

Communication unit 410 receives package data and images from controller 300 . The communication unit 410 also transmits input data, which will be described later, to the controller 300 . The communication unit 410 is implemented by, for example, a processor that executes a program, a memory that stores the program, a communication interface that performs wireless communication or wired communication, and the like.

Display unit 420 displays package data and images received by communication unit 410 . Specifically, the display unit 420 displays a UI (User Interface) for receiving input from the operator, including parcel data and images. The display unit 420 is realized by, for example, a processor executing a program, a memory storing the program, and a display. The display is, for example, a liquid crystal display, an organic EL (Electro Luminance) display, or the like.

For example, the display unit 420 may use package data and images to display, for each group, package data belonging to the group and an image associated with the group. That is, the display device 400 may display at least one of the group ID, package ID, number of recognized items, and status belonging to the group, and an image for each group.

The input reception unit 430 receives input from the operator to the UI displayed on the display unit 420 . The input data transmitted by the communication unit 410 indicates the input received by the input receiving unit. The input reception unit 430 is implemented by an input interface such as a mouse, keyboard, touch panel, or touch pad, for example.

The display device 400 is configured by a computer having a display, such as a desktop computer, laptop computer, tablet terminal, or smart phone.

6 and 7 are diagrams showing examples of UIs displayed on the display device according to the embodiment.

As shown in FIG. 6 , UI 441 includes package data 442 and image 443 . UI 441 may further include operation buttons 444 , message 445 , and parcel ID button 446 . The parcel data 442 is the number of parcels 20 included in the group with the group ID "G01" in the parcel data shown in FIG. 5, that is, the number of recognized parcels. The package data 442 is an input box that can be changed by the operator. In other words, “10” in package data 442 can be changed according to the input from the worker received by input receiving unit 430 . Note that the UI 441 may include a parcel ID as the parcel data. An image 443 is an image P1 associated with the group ID "G01" in the parcel data.

The operation button 444 is a "next button", and by clicking it with a pointing device such as a mouse, the numerical value entered in the input box of the parcel data 442 is determined. That is, the operation button 444 is a button for confirming the number of recognitions. When the operation button 444 is pressed, the display unit 420 may display, for example, the recognized number of parcel data corresponding to the next group ID "G02" among the parcel data shown in FIG. 5 and the image P2. .

A message 445 is a message for prompting the operator to input. The message 445 is, for example, a message prompting the worker to confirm the number of packages 20 in the image 443 and the numerical value in the package data 442, that is, the number of recognized packages. As a result, if the number of packages 20 in the image 443 and the numerical value in the package data 442 match, the operator determines the numerical value as the number of packages 20 to be managed.

Conversely, if the number of parcels 20 in the image 443 and the numerical value in the parcel data 442 do not match, the operator inputs the correct numerical value in the input box of the parcel data 442 and presses the operation button 444 . The numerical value input in is determined as the number of packages 20 to be managed. For example, in FIG. 6, since the number of packages 20 in the image 443 does not match the numerical value in the package data 442, the worker inputs "11", which is the correct number of packages 20, into the package data 442. Input in the box and confirm with the operation button 444 . As a result, the recognized number associated with the group ID "G01" is changed from "10" to "11".

The parcel ID button 446 is a button for displaying the UI 450 for editing the parcel IDs of a plurality of parcels 20 included in the group of the group ID "G01" among the parcel data. When the package ID button 446 is pressed, the display unit 420 displays the UI 450 shown in FIG. If the number of packages 20 in the image 443 does not match the numerical value in the package data 442, the operator presses the package ID button 446 to display the UI 450 on the display unit 420 and edit the package ID. It will be done. The display unit 420 displays, for example, the UI 450 superimposed on the UI 441 . Note that the display unit 420 may display the UI 450 when the number of recognized items is changed by editing the package data 442 without pressing the package ID button 446 . That is, in this case, the package ID button 446 may not be displayed on the UI441.

As shown in FIG. 7, the UI 450 includes, for example, a list 451 of package IDs included in the group with the group ID "G01", an add button 452, a delete button 453, an add input box 454, an OK button 455, and a cancel button. 456 included.

The package ID list 451 displays a list of package IDs of packages recognized in the group with the group ID "G01". In the example shown in FIG. 7, package IDs of ten packages with package IDs B11 to B20 are shown.

The add button 452 is an additional input box for entering the package ID of the unrecognized package in the package ID list 451 when the image 443 includes an unrecognized package in the package ID list 451 . 454 is added. When the add button 452 is pressed, the display unit 420 additionally displays an additional input box 454 . FIG. 7 shows an example in which an additional input box 454 with number 11 is additionally displayed.

The delete button 453 is a button for deleting the added additional input box 454 . When the delete button 453 is pressed in the state shown in FIG. 7, the display unit 420 displays a list in which the number 11 additional input box 454 has been deleted.

The additional input box 454 is an input box for inputting the package ID of the unrecognized package in the package ID list 451, as described above.

An OK button 455 is a button for confirming editing of the package ID on the UI 450 . When the OK button 455 is pressed, editing on the UI 450 is confirmed.

A cancel button 456 is a button for canceling editing of the package ID on the UI 450 . When the cancel button 456 is pressed, the editing on the UI 450 is returned to the state before editing.

In this way, by editing the package IDs on the UI 450, the worker can add the package IDs of the packages included in the image 443 that are not included in the package ID list 451 to the package data. can be done. In addition, in FIG. 7, although the form which the image 443 is not displayed on UI450 was illustrated, the form which the image 443 is displayed may be sufficient. This is because the worker can edit the package ID while viewing the image 443 .

Even if the numerical value of the package data 442 is not edited on the UI 441, if the package ID is edited on the UI 450, the numerical value of the package data 442 may be changed according to the editing of the package ID. That is, in the UI 450, if a package ID is added, the number indicating the number of packages in the package data 442 is increased by the number of added package IDs, and if the package ID is deleted, the number of deleted package IDs is increased. The numerical value indicating the number of packages in the package data 442 may be decreased by the amount.

The display device 400 transmits to the controller 300 the input data including the numeric value and package ID determined by the operator's input to the UIs 441 and 450 . The input data includes, for example, change data in which a group ID, the number of recognized items, which is changed package data, and an edited package ID are associated with each other. In addition, the input data includes, for example, fixed data indicating the group ID in which the changed number of recognized packages and the edited package ID are not associated and the confirmation work has been performed. The fixed data may be data in which the unaltered recognized number and the unedited package ID are associated with the group ID.

Then, when the input data is received, the controller 300 updates the package data according to the input indicated by the input data, and manages the package using the updated package data. Specifically, the controller 300 associates the number of packages associated with the group ID indicated by the input data in the parcel data stored in the controller 300 with the group ID in the input data. Change to number. Also, the controller 300 changes the parcel ID associated with the group ID indicated by the input data to the parcel ID associated with the group ID in the input data. Also, the controller 300 changes the status from "provisional" to "fixed" along with these changes. For example, when the controller 300 receives the input data input by the worker on the UI 441 of FIG. 11”, B201 is added to the 11 package IDs B11 to B20, and the status is changed from “temporary” to “fixed”. FIG. 8 is a diagram showing an example of package data after updating.

In this way, the controller 300 updates the package data, which is the result of recognition by the recognition device 310, to the input data obtained by having the operator confirm the package data, thereby changing the package data to correct information. can. In addition, the controller 300 confirms the status of the package data confirmed by the worker based on the input data obtained by having the worker confirm the package. can be managed.

Note that the display device 400 may be arranged in a space different from the space in which the automated warehouse 100 is arranged, for example, in an air-conditioned space. As a result, the worker can use the display device 400 to check images and package data in a comfortable space. Therefore, working efficiency can be improved.

FIG. 9 is a sequence diagram for explaining the operation of the automated warehouse system according to the embodiment.

First, the imaging device 200 determines whether or not baggage is detected (S1).

If the imaging device 200 detects a package (Yes in S1), it captures an image of the detected package (S2). Repeat detection.

The imaging device 200 transmits an image obtained by imaging to the controller 300 (S3).

When the image is received from the imaging device 200, the controller 300 stores the received image in the storage device of the recognition device 310 of the controller 300 (S4).

Note that steps S1 to S4 are repeatedly executed in a predetermined period, and the controller 300 stores a plurality of images captured by the imaging device 200 in the predetermined period. Note that steps S1 and S2 may be repeatedly executed for a predetermined period, and a plurality of images captured by the imaging device 200 during the predetermined period may be transmitted to the controller 300 in step S3.

The recognition device 310 of the controller 300 performs image recognition processing on each of the plurality of images stored in the storage device, and generates parcel data as a recognition result (S5).

The controller 300 stores the image and the parcel data corresponding to the image in the storage device of the recognition device 310, and transmits them to the display device 400 (S6).

Display unit 420 of display device 400 receives the image and package data, and displays UI 441 including the received image and package data (S7).

The input reception unit 430 of the display device 400 receives input to the UI 441 (or UI 450 in some cases) displayed on the display unit 420 (S8). Then, the communication unit 410 of the display device 400 transmits input data based on the input accepted by the input accepting unit 430 to the controller 300 .

When the input data is received from the display device 400, the controller 300 confirms the status of the managed parcel data (S9).

An automated warehouse system 1 according to the present embodiment includes an automated warehouse 100 having shelves 110 and transport devices 120 and 130, and includes an imaging device 200, a display device 400, and a controller 300. and The imaging device 200 images the package 20 entering the automated warehouse 100 . The display device 400 can display an image obtained by the imaging device 200 . The controller 300 (i) causes the transport devices 120 and 130 to store the package 20 on the shelf 110 without obtaining permission from the operator, (ii) acquires package data regarding the package 20, and (iii) stores the acquired package data. At the same time, the image is displayed on the display device 400 .

According to this, since the automated warehouse 100 receives the packages 20 captured by the imaging device 200 without obtaining permission from the operator, it is possible to reduce the stagnation of the packages 20 at the entrance of the automated warehouse 100. be able to. In addition, since the controller 300 causes the display device 400 to display the image of the package 20 entering the automated warehouse 100 together with the package data related to the package 20, the operator can display the package data and the image displayed on the display device 400. By comparing, it is possible to easily confirm whether or not the package data regarding the package 20 is correct. Therefore, the operator can easily identify packages 20 with incorrect package data, and can effectively reduce misrecognition of packages 20 entering the automated warehouse 100 .

Moreover, the automated warehouse system 1 according to this embodiment further includes a recognition device 310 . The recognition device 310 acquires an image obtained by the imaging device 200 and performs image recognition processing on the acquired image to generate package data related to the package included in the image. The controller 300 then acquires the parcel data from the recognition device 310 . Therefore, the worker can effectively reduce recognition errors by the recognition device 310 of the packages 20 entering the automated warehouse 100 . In addition, since the recognition device 310 can collectively perform image recognition processing on a plurality of images without waiting for the goods 20 to enter the automated warehouse 100, the accumulation of the goods 20 at the entrance can be reduced. It is possible to perform image recognition processing efficiently.

Moreover, in the automated warehouse system 1 according to the present embodiment, the plurality of packages 20 are grouped into a plurality of groups for each first number of one or more. In addition, the imaging device 200 images each of the plurality of groups. For example, the imaging device 200 obtains one image per group by imaging each group once. Then, the controller 300 causes the display device 400 to display package data corresponding to each group and an image including the group for each of the plurality of groups. Therefore, the worker can perform confirmation work for each group, and can complete the confirmation work in a short time.

(Modification 1)
An automated warehouse system according to Modification 1 will be described.

In the automated warehouse system 1 according to the above-described embodiment, the controller 300 transmits images and parcel data for all groups to the display device 400 and causes the worker to confirm the images and parcel data. It is not necessary to perform confirmation work for all groups.

FIG. 10 is a sequence diagram for explaining the operation of the automated warehouse system according to Modification 1. As shown in FIG.

The automated warehouse system 1 according to Modification 1 differs from the automated warehouse system 1 according to the embodiment in that the controller 300 further performs steps S11 and S12. Other operations of the automated warehouse system 1 according to Modification 1 are the same as those of the automated warehouse system 1 according to the embodiment, so detailed description thereof will be omitted.

After step S5, the controller 300 acquires the number of stocked items in each of the plurality of groups (S11). For example, the controller 300 obtains the number of goods received by obtaining the number of labels 21 issued to each of the plurality of packages 20 corresponding to one pallet 10 from the label 21 issuing device. Further, for example, the controller 300 may acquire the number of parcels to be stored by acquiring the number of parcels to be stored from an external device. Note that the controller 300 does not have to acquire the number of stored packages 20 on a pallet basis, and may acquire the number of stored packages 20 on a second number (predetermined number of 2 or more) of pallets. For example, when 20 labels 21 are issued to each of 20 packages 20 for two pallets 10 , the controller 300 acquires 20 as the number of warehousing for the two pallets 10 . When the controller 300 acquires the number of goods received in units of the second number of pallets, the controller 300 may recognize the second number of pallets as one group.

For each of the plurality of groups, the controller 300 determines whether or not the received number, which is the number of packages to be stored as the group, matches the recognized number included in the package data (S12).

If the number of received goods and the number of recognized goods do not match (No in S12), the controller 300 transmits the parcel data and image corresponding to the group in which the number of received goods and the recognized number do not match to the display device 400 (S6). The image is displayed on the display device 400 (S7).

On the other hand, if the entered quantity and the recognized quantity match (Yes in S12), the controller 300 does not cause the display device 400 to display the parcel data and images corresponding to the group in which the entered quantity and the recognized quantity match. Without transmitting the parcel data and the relevant image to the display device 400, the status of the parcel data corresponding to the group is determined and stored in the storage device of the recognition device 310 (S9). The reason why the controller 300 does not transmit the parcel data and image corresponding to the case where the number of received goods and the number of recognized goods match to the display device 400 is considered to be the result of correctly recognizing that the number of received goods and the recognized number of goods match. , and in this case, it is considered that there is no need for checking by the operator.

According to this, the controller 300 determines that a group with the same number of received goods and the same number of recognized goods is correctly recognized, and does not display the parcel data and images corresponding to the group on the display device 400 . Therefore, the number of images to be checked by the worker can be reduced, and the worker can complete the checking work in a short time.

Although the controller 300 acquires the number of recognized items obtained by the recognition device 310, instead of acquiring the number of recognized items, if a plurality of packages 20 are attached with RFID (Radio Frequency Identifier) tags, The number of parcels read by the RFID reader may be acquired, or the number of parcels included in data obtained from an external device may be acquired. That is, in Modification 1, the controller 300 acquires a predetermined number of parcels included in the group, and depending on whether or not the received number and the recognized number match, either executes step S6 or performs step S6. Any configuration may be used as long as it determines whether to execute S9.

(Modification 2)
An automated warehouse system according to Modification 2 will be described.

In the automated warehouse system 1 according to the above-described embodiment, furthermore, when re-stocking packages after some of the packages in the group have been picked in response to the delivery instruction, whether the picking has been performed correctly by the worker. The number of recognized items in the updated parcel data may be used to determine whether or not.

FIG. 11 is a block diagram showing an example of the functional configuration of an automated warehouse system according to Modification 2. As shown in FIG.

The automated warehouse system 1A according to Modification 2 is different from the automated warehouse system 1 according to the embodiment in that it further includes an indicating device 500 . Since other configurations of the automated warehouse system 1A according to Modification 2 are the same as those of the automated warehouse system 1 according to the embodiment, detailed description thereof will be omitted.

When the goods are re-stocked, the transport devices 120 and 130 first deliver one group to the automated warehouse 100 according to a delivery instruction from the controller 300 from a plurality of groups. The group of positions to be delivered here is one pallet 10 . If the one group includes the package 20 even after it has been picked by the worker U, the transport devices 120 and 130 re-stock the one group in the automated warehouse 100 .

The instruction device 500 is a device having a notification unit 510 for notifying the operator U working at the picking station 140 of an instruction to pick up the package specified by the delivery instruction from the pallet 10 delivered from the delivery conveyor 122. be. The notification unit 510 may be a display that notifies by displaying an image, or may be a speaker that notifies by outputting sound. The instruction device 500 is configured by, for example, a computer having a display or speaker, such as a desktop computer, a laptop computer, a tablet terminal, a smart phone, or the like.

The recognition device 310 recognizes the number of parcels 20 in one group to be restocked by executing image recognition processing on an image captured by the imaging device 200 of the one group to be restocked. , the parcel data including the recognized number obtained by the recognition as the restocked number is generated.

The controller 300 determines whether the number of packages to be restocked, which is the number obtained by subtracting the number of packages picked by the worker U according to the delivery instruction from the number of packages in one group before being picked, matches the number of packages to be restocked. determine whether or not When the planned restocking quantity does not match the restocking quantity, the controller 300 transmits notification information indicating that the planned restocking quantity and the restocking quantity do not match to the instruction device 500 . Thereby, the instruction device 500 notifies the worker U that the scheduled restocking quantity and the restocking quantity do not match.

Note that the notification information may be, for example, information notifying that the picking was not performed in accordance with the delivery instruction, or information indicating that the recognition device 310 has made an erroneous recognition.

Although the controller 300 acquires package data including the number of recognized items obtained by the recognition device 310 as the number of restocked items, the present invention is not limited to this, and a plurality of packages 20 are provided with RFID (Radio Frequency Identifier) tags. If so, the number of parcels read by the RFID reader may be acquired as parcel data as the number of parcels restocked, or the parcel data including the number of parcels restocked as the number of parcels obtained from an external device may be acquired. may

FIG. 12 is a sequence diagram for explaining the re-entry operation of the automated warehouse system according to Modification 2. As shown in FIG.

In the automated warehouse system 1A according to Modification 2, steps S11a, S12a, and S13 are further performed in the controller 300, and step S14 is performed in the instruction device 500, as compared with the automated warehouse system 1 according to the embodiment. point is different. Other operations of the automated warehouse system 1A according to Modification 2 are the same as those of the automated warehouse system 1 according to the embodiment, so detailed description thereof will be omitted.

In steps S1a to S5a, basically the same operations as steps S1 to S5 described in the embodiment are performed. A different point is that identification information for identifying restocking is added to an image of a group to be restocked. The restocked group may be detected by tracking the group that has been taken out, or by reading the label 11 attached to the pallet 10 of the group.

After step S5a, the controller 300 acquires the scheduled restocking number, which is the number of stocks in the group scheduled to be restocked (S11a). As described above, the number of packages to be restocked is the number of packages to be picked up by the delivery instruction based on the number of packages recognized before picking of the group to be restocked, that is, the number of packages to be picked up based on the number of packages associated with the group in the updated package data. Calculated by subtracting the number.

The controller 300 determines whether or not the planned restocking quantity matches the recognized quantity included in the parcel data, which is the recognition result of the parcels in the group scheduled to be restocked (S12a).

When the planned restocking quantity and the recognized quantity do not match (No in S12a), the controller 300 transmits notification information to the instruction device 500 (S13).

When the notification information is received, the instruction device 500 notifies that the scheduled restocking quantity and the restocking quantity do not match (S14). For example, the instruction device 500 notifies the worker U that picking was not correctly performed according to the delivery instruction or that an erroneous recognition has occurred, according to the notification information.

On the other hand, when the planned restocking quantity and the recognized quantity match (Yes in S12a), the controller 300 updates the recognized quantity in the parcel data to the planned restocking quantity (S15).

According to the automated warehouse system 1A according to the modified example 2, for the group that has been restocked, the number of packages recognized by image processing is compared with the planned number of packages to be restocked calculated from the package data and the delivery instruction. , it is determined whether or not the picking was correctly performed by the worker U, and if the picking was not correctly performed by the worker U, the fact is notified. Therefore, it is possible to easily identify a package that has been erroneously picked.

(Modification 3)
An automated warehouse system according to Modification 3 will be described.

In the automated warehouse system 1 according to the above embodiment, the recognition device 310 performs image recognition processing for recognizing an optical reading code such as a barcode in an image. The configuration may be such that OCR is performed to recognize character strings in an image.

13A and 13B are schematic diagrams for explaining an imaging device and an imaging target of the imaging device according to Modification 3. FIG. 14A and 14B are diagrams illustrating an example of an image captured by an imaging device according to Modification 3. FIG.

As shown in FIG. 13, in this case, the warehousing conveyor 121 conveys the packages 20A in units of one. Therefore, the imaging device 200 captures an image of each of the packages 20A. As a result, as shown in FIG. 14, the imaging device 200 obtains an image 202 including the label 21, the product name 22, the manufacturer 23, the expiration date 24, and the bar code 25 arranged on the side of the package 20A. be done. Note that the package 20A may not include the label 21 or the bar code 25, and may include any one of the product name 22, the manufacturer 23, and the expiration date 24. FIG.

The recognition device 310 performs image recognition processing including OCR on the image 202 obtained by the imaging device 200 . Thereby, the recognition device 310 recognizes the parcel ID, product name, manufacturer, and expiration date. Specifically, the recognition device 310 recognizes the package ID by recognizing the label 21 . Note that the recognition device 310 may recognize the parcel ID by recognizing a bar code arranged on the side of the parcel 20A. Further, the recognition device 310 performs OCR on the product name 22, the manufacturer 23, and the expiration date 24 on the side of the package 20A, thereby recognizing the manufacturer, the product name, and the expiration date, respectively. As a result, the recognition device 310 recognizes, from the image 202, the package ID, product name, manufacturer, and best-before date of the package included in the image 202, and associates them to create packages as shown in FIG. Generate data. Note that the recognition device 310 may recognize the manufacturer, product name, and best-before date by performing OCR without recognizing the label 21 or barcode, and generate package data. Note that FIG. 15 is a diagram showing an example of parcel data generated by the recognition device according to Modification 3. As shown in FIG.

As shown in FIG. 15, in the parcel data, the parcel ID indicated by the label 21 of the parcel 20A recognized from the image P11 is "B11", and the product name, manufacturer and expiration date recognized from the image P11 are respectively " Product a11”, “Manufacturer A”, and “2018/08”. That is, the recognition device 310 recognizes the package 20A with the package ID "B11", the product name "product a11", the manufacturer "manufacturer A", and the expiration date "2018/08" by performing image recognition processing on the image P11. This is shown by the parcel data. Also, as in the embodiment, status information indicating a status may be added to the parcel data for each image, that is, for each parcel.

16 is a diagram illustrating an example of a UI displayed on a display device according to Modification 3. FIG.

As shown in FIG. 16, UI 441A includes package data 442a-442c and image 443A. UI 441A may further include operation buttons 444 and message 445A. Package data 442a to 442c are the product name, manufacturer, and expiration date associated with package ID "B11" in the package data shown in FIG. 15, respectively. Each of the package data 442a to 442c is an input box that can be changed by the operator. In other words, the “product a11” of the package data 442a, the “manufacturer A” of the package data 442b, and the “2018/08” of the package data 442c can be changed according to the input received by the input receiving unit 430 from the worker. In addition, the package ID may be included in the UI 441A as the package data. Image 443A is image P11 associated with package ID "B11" in the package data.

The operation button 444 is the same "next button" as the operation button 444 in the UI 441 of the embodiment, and by clicking with a pointing device such as a mouse, input is made to the input boxes of the package data 442a to 442c. String is fixed. As a result, if the product name 22, manufacturer 23, and expiration date 24 of the package 20A in the image 443A match the character strings in the package data 442a to 442c, the worker can manage the character strings. It is determined as the parcel data of the parcel 20A to be delivered. Conversely, if the product name 22, manufacturer 23, and best-before date 24 of the package 20A in the image 443A do not match the character strings in the package data 442a to 442c, the worker will insert the correct character strings into the package data. By inputting in the input boxes 442a to 442c and pressing the operation button 444, the input character string is confirmed as the parcel data of the parcel 20A to be managed. For example, in FIG. 16, the product name 22 and manufacturer 23 in the image 443A match the character strings in the package data 442a and 442b, but the expiration date 24 in the image 443A and the package data 442c Since the character string does not match the character string, the worker enters "2018/09", which is the correct expiration date 24 of the package 20A, into the input box of the package data 442c and confirms it with the operation button 444. As a result, the expiration date associated with the parcel ID "B11" is changed from "2018/08" to "2018/09".

Then, when the input data is received, the controller 300 updates the package data according to the input indicated by the input data, and manages the package using the updated package data. Subsequent processing is the same as that of the embodiment, so detailed description is omitted.

In this way, even if the package data is obtained by recognizing the character strings included in the side surface of the package 20A through the OCR performed by the recognition device 310, the worker can check the package data using the display device 400. As a result, since the correct character string can be determined, it is possible to effectively reduce misrecognition of packages to be stored in the automated warehouse.

Although the warehousing conveyor 121 conveys the articles 20A in units of one, the articles may be conveyed in units of pallets. In this case, the imaging device 200 takes an image in units of pallet, and the recognition device 310 performs image processing including OCR on the image obtained by the imaging device 200 after the pallet is stored in the automated warehouse. In this case, the recognition device 310 may perform OCR on the characters written on each of the packages on the pallet, or may perform OCR on the characters written on the pallet.

(Modification 4)
An automated warehouse system according to Modification 4 will be described.

17A and 17B are diagrams for explaining parcel data and images to be transmitted to the display device of the automated warehouse system according to Modification 4. FIG.

In the automated warehouse system according to Modified Example 4, in the automated warehouse system 1 according to Modified Example 3, as shown in FIG. They are displayed on the display device 400 in the sorted order based on the conditions. Specifically, for example, the controller 300 rearranges data having common items such as manufacturer name and product name as predetermined conditions, thereby sorting a plurality of images and parcel data by product name or by manufacturer. It is displayed collectively or continuously for each trader. As a result, the display device 400 displays a plurality of separately captured images regardless of the product name or manufacturer name, or separately recognized parcel data for each of the same product name or the same manufacturer. can be displayed. In other words, since the worker can continuously check images of similar packages under predetermined conditions, mistakes in checking work can be reduced, and the checking work can be completed in a short time. .

(Modification 5)
An automated warehouse system according to modification 5 will be described.

Although the automated warehouse system 1 according to the embodiment is configured to include one display device 400, the configuration is not limited to this and may be configured to include a plurality of display devices.

18A and 18B are diagrams for explaining parcel data and images to be transmitted to the display device of the automated warehouse system according to Modification 5. FIG.

In this case, the controller 300 causes the plurality of display devices 400A and 400B to display different package data and images. The controller 300 divides the acquired parcel data by the number of display devices (2 in this modified example), and causes the plurality of divided parcel data obtained by the division to be displayed on the respective display devices. That is, controller 300 does not cause display device 400B to display the package data and images to be displayed on display device 400A, and does not cause display device 400A to display the package data and images to be displayed by display device 400B. In the example shown in FIG. 18, display device 400A displays package data whose manufacturer is maker A, and display device 400B displays package data whose manufacturer is maker B. In the example shown in FIG. Therefore, a plurality of workers can share the checking work, and the checking work can be completed in a short time.

Note that the controller 300 may cause the display device 400A and the display device 400B to display overlapping package data and images. In this case, the controller 300 displays the confirmed package data and image on one of the display devices 400A and 400B, and on the other indicates that the confirmed work has already been performed, in order to avoid duplication of work by a plurality of workers. It may be displayed in the manner shown. The display in a manner indicating that the confirmation work has already been performed is, for example, a grayed-out display, a display with a message indicating that confirmation has been completed, or the like.

(others)
The automated warehouse system of the present invention has been described above based on the embodiments. However, the present invention is not limited to the above embodiments. As long as it does not deviate from the spirit of the present invention, various modifications that a person skilled in the art can think of are applied to this embodiment, or a form constructed by combining a plurality of the above-described constituent elements is within the scope of the present invention. include.

In the embodiment, the controller 300 acquires package data as the recognition result of the recognition device 310, but is not limited to this. may acquire data read by an RFID reader (for example, the number of parcels) as parcel data. Similarly, the controller 300 may acquire data obtained from an external device as package data. Even in this case, the operator can use the display device 400 to compare the package data and the image to confirm whether the package data obtained from the RFID reader or the external device is correct information. Incorrect information can be changed to correct information.

In the confirmation work performed by the worker using the display device 400 according to the embodiment, the image 443 displayed on the UI 441 is blurred, the image 443 contains dirt, or the image 443 contains noise. If the quality of the image 443 is poor, the display device 400 may receive an input from the operator indicating that the quality of the image 443 is poor. As a result, the display device 400 transmits information indicating the input to the controller 300, and the controller 300 takes out and re-enters the package or group corresponding to the relevant image, and sends the imaging device 200 again. A group may be imaged. Also, in this case, the controller 300 may notify the operator of information indicating that the imaging device 200 may be malfunctioning.

The recognition device 310 according to Modification 3 executes OCR of different engines, and when the OCR result of the first engine and the OCR result of the second engine match, the process of determining the status of the parcel data. may be performed. As a result, confirmation work by the operator can be reduced.

The recognition device 310 according to Modification 3 performs OCR on the image 202 to recognize the product name, manufacturer, and expiration date. Recognizing the code may recognize at least one of the product name, manufacturer and expiration date associated with the code.

In Modified Example 3, the expiration date 24 is included on the side of the package 20A, but the date of manufacture may be included instead of the expiration date 24. FIG. In other words, the package may include the date of manufacture of the product. In this case, the recognition device 310 recognizes the time by image recognition processing.

INDUSTRIAL APPLICABILITY The present invention is useful as an automated warehouse system or the like that can reduce recognition errors of packages entering an automated warehouse and efficiently store packages into the automated warehouse.

1, 1A Automated Warehouse System 10 Pallet 11, 21 Label 20, 20A Package 22 Product Name 23 Manufacturer 24 Expiration Date 25 Barcode 100 Automated Warehouse 110 Shelves 120, 130 Transfer Device 121 Incoming Conveyor 122 Outgoing Conveyor 123 Re-Incoming Conveyor 140 Picking Station 200 Imaging devices 201, 202 Image 300 Controller 310 Recognition device 400, 400A, 400B Display device 410 Communication unit 420 Display unit 430 Input receiving unit 441, 441A, 450 UI (User Interface)
442, 442a, 442b, 442c Package data 443, 443A Image 444 Operation buttons 445, 445A Message 446 Package ID button 451 List 452 Add button 453 Delete button 454 Add input box 455 OK button 456 Cancel button 500 Instruction device 510 Notification unit A1 Space

Claims (7)

An automated warehouse system comprising an automated warehouse having shelves and a transport device,
an image pickup device that picks up an image of a package entering the automated warehouse;
a display device capable of displaying an image obtained by the imaging device;
(i) causing the transport device to store the cargo on the shelf without obtaining permission from an operator or an external device to store the cargo in the automated warehouse ; and (ii) acquiring cargo data related to the cargo. , (iii) during or after the cargo is stored on the rack by the transport device, the image is displayed together with the cargo data for confirming whether or not the acquired cargo data is correct; a controller for displaying on the display device;
an input reception unit capable of changing the parcel data. moreover,
a recognition device that acquires the image and performs image recognition processing on the acquired image to generate the package data related to the package included in the image;
The automated warehouse system according to claim 1, wherein the controller acquires the parcel data from the recognition device. 2. The controller causes the display device to display the plurality of acquired parcel data and the plurality of images obtained by imaging by the imaging device in a rearranged order based on a predetermined condition. Or the automatic warehouse system according to 2. The automated warehouse system includes a plurality of the display devices,
4. The automated warehouse system according to any one of claims 1 to 3, wherein the controller causes each of the plurality of display devices to display the package data and the image that are different from each other. The plurality of packages are grouped into a plurality of groups by a predetermined number of one or more,
The imaging device captures an image of the predetermined number of packages included in each of the plurality of groups,
5. The controller according to any one of claims 1 to 4, wherein for each of the plurality of groups, the controller causes the display device to display the package data corresponding to the group and the image including the group. Automated warehouse system. An automated warehouse system comprising an automated warehouse having shelves and a transport device,
an image pickup device that picks up an image of a package entering the automated warehouse;
a display device capable of displaying an image obtained by the imaging device;
(i) a controller that causes the transport device to store the package on the shelf, (ii) acquires package data related to the package, and (iii) displays the image together with the acquired package data on the display device;
a recognition device that acquires the image and performs image recognition processing on the acquired image to generate the luggage data related to the luggage included in the image,
The controller acquires the parcel data from the recognition device,
The plurality of packages are grouped into a plurality of groups by a predetermined number of one or more,
The imaging device captures an image of each of the plurality of groups,
The recognition device (i) recognizes the number of packages in the group included in the image by executing the image recognition process, and (ii) recognizes the number of packages obtained by recognition. generating said package data including;
The controller is
Further, for each of the plurality of groups, the number of goods received, which is the number of goods received as the group, is acquired, and whether or not the acquired number of goods received matches the recognized number contained in the goods data. judge,
preventing the display device from displaying the parcel data and the image corresponding to the group in which the number of items received and the number of recognized items match;
An automated warehouse system that causes the display device to display the parcel data and the image corresponding to a group in which the number of goods received and the number of recognized goods do not match. An automated warehouse system comprising an automated warehouse having shelves and a transport device,
an image pickup device that picks up an image of a package entering the automated warehouse;
a display device capable of displaying an image obtained by the imaging device;
(i) a controller that causes the transport device to store the package on the shelf, (ii) acquires package data related to the package, and (iii) displays the image together with the acquired package data on the display device;
a recognition device that acquires the image and performs image recognition processing on the acquired image to generate the luggage data related to the luggage included in the image,
The controller acquires the parcel data from the recognition device,
The plurality of packages are grouped into a plurality of groups by a predetermined number of one or more,
The transport device issues one group according to a delivery instruction from among the plurality of groups stored in the automated warehouse, and re-stores the one group after being picked by a worker into the automated warehouse. in stock,
The recognition device executes the image recognition processing on an image of the one group to be restocked captured by the imaging device, thereby determining the number of packages in the one group when the one group is restocked. recognizing the number of items, generating the parcel data including the recognized number of items obtained by recognizing the number of items;
The controller further obtains a scheduled re-stocking quantity, which is the number of packages in the one group before picking minus the number of packages picked by the worker according to the delivery instruction. an automated warehouse system for notifying information indicating that the scheduled restocking number and the recognized number do not match when the number of packages included in the package data obtained does not match the recognized number.

Images