JP2011150460A - System and method for managing warehousing/shipping - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To inexpensively manage the warehousing/shipping state of an article placed in a yard. <P>SOLUTION: A warehousing/shipping management system includes: a camera 1 for imaging an article placed in a yard and added with a bar code; and an inventory management processor 2 for managing the inventory state of the article in the yard on the basis of information of the bar code imaged by the camera 1. The inventory management processor 2 controls the camera 1 which images the bar code attached to the article, and extracts the bar code image on the basis of the featured value of the bar code from the image picked up by the camera 1, and reads information of the extracted bar code image, and detects the position of the bar code in the yard, and updates the inventory management data on the basis of the information. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a technique for managing a state of goods entering and leaving (inventory) of articles placed in a storage place such as a warehouse using a camera.

  Conventionally, in order to manage articles in a warehouse, a barcode is attached to an article and a person reads the barcode information using the barcode reader of the handy terminal, or RFID (Radio Frequency IDentification) is applied to the article. Entry / exit management is performed by attaching a tag and reading information of the RFID tag by a warehouse reader.

  For example, in Patent Document 1, as a coil placement management method, a technique for managing coil placement by embedding an RFID tag in the placement section in advance or attaching an RFID tag to the coil and reading information on the RFID tag. Is disclosed.

  Further, in Patent Document 2, storage management at a warehouse is performed by reading a location code (such as a barcode) affixed to a shelf in a warehouse and a commodity code (such as a barcode) affixed to a product with a handy terminal. The technology is disclosed.

  Patent Document 3 discloses a technique for reading information on each barcode of a plurality of products at a time by imaging a plurality of products with barcodes attached thereto using a digital camera.

  Japanese Patent Application Laid-Open No. H10-228688 discloses a technique for reading barcode information by imaging a barcode attached to a surface of a rectangular parallelepiped article conveyed by a belt conveyor or the like with a camera.

JP 2007-246278 A JP 10-35830 A JP-A-9-114913 Japanese Patent No. 4217143

  However, in the technique of Patent Document 1, since an RFID tag is used, there is a problem that the cost is higher than when a barcode is used. Further, in the technique of Patent Document 2, there is a trouble that the clerk manually reads the product code and the location code using the handy terminal. The trouble of turning and rereading these codes occurs.

  Moreover, in the technique of patent document 3, the trouble that a staff member takes an image manually on a tray on which a plurality of products are placed using a digital camera is generated. Further, in the technique of Patent Document 4, there are restrictions on the installation position of the imaging camera relative to the belt conveyor and the installation of imaging illumination, and the article placed flat in the warehouse (placed on the floor as it is) There is a problem that it is not suitable for reading the barcode.

  Therefore, the present invention has been made to solve the above-described problems, and an object thereof is to manage the entry / exit state of articles placed in the storage area at a low cost.

  The present invention relates to a camera that captures an article that is placed at a storage location and that has a barcode attached thereto, and an inventory management processing device that manages the inventory status of the article at the storage location based on the barcode information captured by the camera. , A warehouse management system. The inventory management processing device controls a camera that captures a barcode attached to an article, extracts a barcode image from an image captured by the camera based on the feature amount of the barcode, and extracts the extracted barcode image information , And detects the position of the barcode in the storage area, and updates the inventory management data based on the information.

  ADVANTAGE OF THE INVENTION According to this invention, the entering / exiting state of the articles | goods put in a storage place can be managed cheaply.

In this embodiment, it is a block diagram which shows the warehouse which installed the camera. In this embodiment, it is explanatory drawing which shows the example of the area | region division of the floor surface in the case of imaging the inside of a warehouse with a camera. It is a block block diagram containing the inventory management processing apparatus of this embodiment. In this embodiment, it is explanatory drawing which shows the example which extracts a barcode image from the imaged image. It is a figure which shows the example of the information display screen of the storage / exit management system of this embodiment. It is a flowchart which shows the flow of a process of the inventory management processing apparatus of this embodiment. It is a flowchart for extracting a barcode image. It is a flowchart which shows the process for reading the information of the imaged barcode.

  Hereinafter, modes for carrying out the present invention (hereinafter referred to as embodiments) will be described with reference to the drawings (refer to drawings other than the referenced drawings as appropriate).

  In the present embodiment, as shown in FIG. 1, a plurality of articles 11 with barcodes B (hereinafter simply referred to as “barcodes”) attached to a floor 20 of a warehouse 10 are placed flat. In addition, a camera 1 is installed in a portion near the ceiling of a corner of the warehouse 10 so as to be able to pan, tilt, and zoom. The size of the warehouse 10 is, for example, about several meters in height and about several meters to 100 meters in length and width.

  As shown in FIG. 2, the area to be imaged can be divided into nine areas (A1 to A3, B1 to B3, and C1 to C3) for the floor 20 of the warehouse 10. For example, when the image of the entire floor surface 20 of the warehouse 10 is picked up by the camera 1 at once, there is a problem in reading the barcode due to the resolution or the like, the resolution of the camera 1 or the floor surface 20 from the camera 1 as described above. The area of the floor surface 20 can be divided into a plurality of images so that the barcode of the article 11 placed on the floor surface 20 can be read in consideration of the distance to each article 11 placed on the floor. In this case, the article 11 may be placed on the floor surface 20 across a plurality of regions. In this case, the camera 1 is then panned, tilted, and zoomed to capture the entire article 11. You can do it.

  As shown in FIG. 3, the warehouse management system 100 includes a camera 1, an inventory management processor 2, and a display unit 9. The inventory management processing device 2 is a computer device, and includes a camera control means 3, a barcode image extraction means 31, a barcode reading means 4, a position detection means 5, an inventory management means 6, an inventory management data storage means 7 and an input means 8. It is configured with.

  Specifically, the camera control means 3, barcode image extraction means 31, barcode reading means 4, position detection means 5 and inventory management means 6 have a CPU (Central Processing Unit) with a ROM (Read Only Memory) or a HDD (HDD). This is realized by expanding and executing an operation program stored in a hard disk drive) in a memory. The inventory management data storage unit 7 is realized by a storage unit such as an HDD, and stores inventory management data. The input means 8 is realized by a keyboard or a mouse. In addition, the inventory management processing device 2 includes communication means and the like.

  An image captured by the camera 1 is input to the inventory management processing device 2. The camera control means 3 controls the camera 1 so as to sequentially image a predetermined area in the warehouse 10 by panning, tilting, and zooming, and acquires an image captured by the camera 1.

  The camera control unit 3 outputs the image acquired from the camera 1 to the barcode image extraction unit 31. The barcode image extraction unit 31 extracts a barcode image (an image of the barcode area) from the input image and outputs the extracted barcode image to the barcode reading unit 4.

  The bar code reading unit 4 reads bar code information from the input bar code area image. The position detection unit 5 detects the position of the barcode from the imaging direction of the camera 1 when the barcode image (image including the barcode) is captured. The inventory management means 6 updates the inventory management data stored in the inventory management data storage means 7 on the basis of information such as the read article information of the barcode, the position of the article 11 and the entry / exit date, and the liquid crystal display To the display means 9.

  Next, a method for extracting a barcode image from a captured image will be described with reference to FIG. An example of the captured image is as shown in FIG. FIG. 4B shows the detection of the end points (including the corners) of the line segment of the image as shown in FIG. 4A and displays the detected end points.

  In the image as shown in FIG. 4B, the adjacent linear portions of the plurality of end points are detected as the upper and lower sides of the barcode (see the elliptical region 41 in FIG. 4C). Then, a rectangular area 42 (see FIG. 4D) surrounding the portions detected as the upper and lower sides of the barcode is detected as a barcode area. In other words, when two linear portions, which are portions where end points are close to each other and are aligned in a straight line, are detected in parallel (including substantially parallel), areas inside the two linear portions are detected as barcode regions. . Next, the original image of the rectangular area 42 is three-dimensionally deformed so as to be seen in a plan view as necessary to create a deformed barcode image (reference numeral 43) (FIG. 4E). reference).

  Next, an example of information corresponding to a barcode will be described with reference to FIG. Examples of such information include an article code, an article name, a warehousing date and time, a storage location (such as the x-coordinate and y-coordinate of the floor 20), and a warehousing date and time. These pieces of information are displayed on the display unit 9 as necessary.

Next, processing of the inventory management processing device 2 will be described with reference to FIGS.
First, the camera control means 3 performs pan, tilt, and zoom control on the camera 1 so as to sequentially capture target areas in the warehouse 10 (9 areas A1 to C3 in FIG. 2) (step S1). The start of the imaging may be triggered by an instruction operation by the administrator using the inventory management processing device 2 or based on a program that becomes regular, such as once every hour or once a day. There may be.

  Thereafter, the barcode image extraction unit 31 acquires an image from the camera control unit 3 and extracts a barcode image based on the feature amount of the barcode (step S2: details will be described later). In step S2, if there are a plurality of barcode images in the image, all the barcode images are extracted. Also, there may be no barcode in the image.

  Next, the barcode image extraction means 31 determines whether or not there is a barcode area in the image (step S3). If Yes, the process proceeds to step S4. If No, the process proceeds to step S7.

In step S4, the barcode reading means 4 reads barcode information from the barcode image.
Next, in step S5, the position detection means 5 detects the orientation of the camera when an image including the target barcode is captured, the position of the barcode in the image, and the warehouse 10 of the camera 1. The position of the barcode in the warehouse 10 is detected geometrically using the three-dimensional installation position at.

  Next, in step S6, the inventory management unit 6 uses the barcode information read in step S4, the barcode position information detected in step S5, and the current date and time information to store inventory management data. 7 is updated (see FIG. 5). For example, when a barcode that has not been registered in the past is detected, the article 11 is newly received, and when a barcode that has been registered in the past cannot be detected, the article 11 is updated. In addition, when the position is changed, the information on the placement position is updated.

  In step S7, the barcode image extracting means 31 determines whether or not the processing in steps S1 to S3 has been completed for all the target areas in the warehouse 10, and in the case of Yes, the process proceeds to step S8. If so, the process returns to step S1.

  In step S8, as a result of updating all the inventory management data in the warehouse 10, the inventory management means 6 as shown in the example shown in FIG. 5, the article code corresponding to each barcode, the article name, the warehousing date and time, the storage location The position, date and time of delivery, etc. are displayed on the display means 9, and the process is terminated.

  Next, the barcode image extraction process in step S2 will be described with reference to FIG. First, the barcode image extraction means 31 performs barcode endpoint detection processing on the captured image (step S21: see FIG. 4B).

Next, the barcode image extraction means 31 performs a barcode end point linearity detection process (step S22: see FIG. 4C).
Next, the barcode image extraction unit 31 performs barcode area detection processing (step S23: see FIG. 4D).

  Next, the barcode reading process in step S4 (see FIG. 6) will be described with reference to FIG. First, the barcode reading unit 4 creates a barcode image in which the deformation is corrected based on the deformation information on the barcode area obtained in step S23 and the information on the aspect ratio of the known barcode. Then, a shape conversion process is performed (step S41: see FIG. 4E).

  Thereafter, the barcode reading unit 4 performs barcode content reading processing (step S42). That is, barcode information is acquired by reading a change in luminance value in the horizontal direction for the barcode image corrected in step S41.

  As described above, according to the warehouse management system 100 according to the present embodiment, the camera 11 captures an image of the article 11 attached to the barcode, which is placed in the warehouse 10, and the barcode image is obtained from the captured image. Can be extracted, the barcode information can be read, the position of the barcode can be detected, and the inventory status of the article 11 of the barcode can be managed.

  Therefore, for example, even when the article 11 is laid flat in a huge warehouse 10 having a vertical or horizontal length of 100 meters or more, a high-definition camera 1 having pan, tilt, and zoom functions is provided in the warehouse 10. The bar code affixed to the article 11 can be read by imaging the inside of the warehouse 10. This eliminates the need for special lighting. Further, it is not necessary for the staff to go around to read the bar code with the handy scanner in the warehouse 10. In addition, entry / exit management including the position information of the articles 11 in the wide warehouse 10 can be performed.

As mentioned above, although embodiment of this invention was described, this invention is not limited to this, It can implement in the range which does not change the meaning.
For example, after detecting the position of the barcode, the camera 1 may be further panned, tilted, and zoomed to obtain a high-definition barcode image and read the barcode.

Further, as the storage place, the warehouse 10 has been described as an example, but any other place may be used as long as the article 11 to which the barcode is attached is placed, such as a factory.
In addition, when the warehouse 10 is large, in addition to increasing the resolution of the camera 1, the size of the barcode attached to the article 11 may be increased.

In this embodiment, a one-dimensional barcode (such as a JAN (Japan Article Number) code) has been described as an example, but in addition, a two-dimensional barcode (such as a QR code (registered trademark)) is used. Also good.
Further, the barcode may be attached to the side surface of the article 11 instead of the surface that becomes the upper surface when the article 11 is placed in the warehouse 10. Then, even when the articles 11 are stacked, all the barcodes of the articles 11 can be captured by the camera 1.

  Further, a color (for example, red) that is not used at the site is assigned to the entire barcode or the frame portion, and it is recognized that the barcode portion has a barcode on the screen imaged by the camera 1. In this way, the barcode image extraction process (step S2 in FIG. 6) may be performed.

  In addition, a plurality of cameras 1 are provided in the warehouse 10, and the article 11 placed in the warehouse 10 is the camera 1 that is closer to the article 11 among the plurality of cameras 1, or the article 11 in an angle. You may make it image with the camera 1 suitable for imaging | photography. In this case, which camera 1 is suitable for photographing in terms of angle can be dealt with by, for example, determining a correspondence relationship between the position where the article 11 is placed and the camera 1 to be photographed in advance.

Further, as a means for attaching a barcode to the article 11, in addition to attaching a barcode (such as paper) to the article 11, a barcode is directly printed on the article 11, or a tag with a barcode is attached to the article 11. Other means such as attachment may be used.
In addition, specific configurations of hardware and software can be appropriately changed without departing from the gist of the present invention.

  DESCRIPTION OF SYMBOLS 1 ... Camera, 2 ... Inventory management processing apparatus, 3 ... Camera control means, 31 ... Barcode image extraction means, 4 ... Barcode reading means, 5 ... Position detection means, 6 ... Inventory management means, 7 ... Inventory management data storage Means 8 ... Input means 9 ... Display means

Claims (4)

A camera that captures an article that is placed at a storage location and that has a barcode attached thereto; and an inventory management processing device that manages an inventory status of the article at the storage location based on information about the barcode captured by the camera. In the warehouse management system that has
The inventory management processing device includes:
Inventory management data storage means for storing inventory management data relating to the article;
Camera control means for controlling pan, tilt and zoom of a camera for imaging the article to which the barcode is attached;
Barcode image extraction means for extracting a barcode image from an image captured by the camera based on a feature amount of the barcode;
Barcode reading means for reading information of the extracted barcode image;
Position detecting means for detecting the position of the barcode in the storage area;
Stock for updating the stock management data of the article with the barcode attached to the stock management data storage unit based on the read barcode information and the detected barcode position information. Management means;
A warehouse management system characterized by comprising: The barcode image extraction means includes:
When an end point of a line segment is detected as a bar code feature amount from an image captured by the camera, and two straight line portions, which are portions where the end points are close to each other and arranged in a straight line, are detected in parallel, the 2 The original image corresponding to the area | region inside the linear part of a location is extracted as a barcode image. The entrance / exit management system of Claim 1 characterized by the above-mentioned. A plurality of the cameras are provided,
The article placed in the storage area is picked up by a camera that is closer to the article among the plurality of cameras or a camera that is suitable for photographing the article in terms of angle. The entry / exit management system described in 1. A camera that captures an article that is placed at a storage location and that has a barcode attached thereto; and an inventory management processing device that manages an inventory status of the article at the storage location based on information about the barcode captured by the camera. A storage management method in a storage management system having
The inventory management processing device includes:
Inventory management data storage means for storing inventory management data related to the article, camera control means, barcode image extraction means, barcode reading means, position detection means, and inventory management means,
The camera control means controls pan, tilt and zoom of a camera that captures a barcode attached to the article,
The barcode image extraction means extracts a barcode image from an image captured by the camera based on a feature amount of the barcode,
The barcode reading means reads information of the extracted barcode image,
The position detecting means detects the position of the barcode in the storage area,
The inventory management means, based on the read barcode information and the detected barcode position information, in the inventory management data storage means, the inventory of the article to which the barcode is attached. Entry / exit management method characterized by updating management data.

Images