JP6230355B2 - Article management system and method - Google Patents

Description

  The present invention relates to an article management system and method.

  Conventionally, an identification code such as a one-dimensional code (for example, a barcode) or a two-dimensional code (for example, a QR code (registered trademark)) that can be read as an image is photographed, and information corresponding to the identification code in the photographed image ( That is, an identification code reading system that acquires overlay information) is known. Patent Documents 1 to 3 propose that the acquired information (for example, the name of an article to which an identification code is attached) is superimposed on a captured image and displayed on the screen of the display unit. According to this system, the information acquired in this way is superimposed on the captured image and displayed on the screen of the display unit. Therefore, information about the article with the identification code in the captured image (for example, the article name) Can be grasped on the screen of the display unit.

  The identification code is also used in an article management system that manages the storage position of the article (for example, Patent Documents 4 to 7), and a management system that uses an RFID tag to manage the storage position of the article (for example, Patent Documents 8 to 8). 11) and a management system using a color bit (registered trademark) for managing articles (for example, Patent Document 12) has also been proposed.

JP 2012-215989 A JP 2012-181705 A JP 2011-55250 A Japanese Patent Laid-Open No. 10-35827 JP 2005-96956 A JP 2000-259717 A JP 2012-16883 A JP 2004-186057 A JP 2006-8301 A JP 2011-37571 A JP 2010-44724 A JP 2011-24663 A

  However, in the conventional position information display system and the article management system, the presence of the article is confirmed by recognizing the identification code. However, since the state of the article is not recorded, the state of the article cannot be confirmed. Therefore, it is impossible to determine whether or not the state of the article with the recognized identification code is an abnormal state (a state in which the article is stored in an invalid state, a state in which the article is damaged, or the like). For example, when recognizing an identification code attached to a hanger, the hanger is not worn or the clothes hung on the hanger are different from the clothes that should be put on the hanger (for example, a hanger for applying a jacket). Even if the cardigan is on, the article (clothing) may be judged to be normal.

  An object of the present invention is to provide an article management system and method capable of accurately determining the state of an article when recognizing an identification code attached to the article.

  An article management system according to the present invention includes an imaging unit that photographs an article with an identification code that can be read as an image, an identification code recognition unit that recognizes an identification code in an article image including the photographed article, and an identification code Article information extracting means for extracting the article information relating to the attached article from the identification code, first display means for displaying the article information superimposed on the article image, and a database for storing the article image in association with the article information; And an article image extracting means for extracting the article image from the database, and a second display means for displaying the article image extracted by the article image extracting means.

  Preferably, the database stores a plurality of article images acquired each time the photographing unit photographs the article with the identification code in association with the article information.

  An article management method according to the present invention includes a photographing step of photographing an article with an identification code readable as an image by a camera, and an identification code recognition step of recognizing an identification code in the article image including the photographed article by a computer. An article information extraction step in which the computer extracts article information relating to the article to which the identification code is attached from the identification code; a first display step in which the article information is superimposed on the article image and displayed on the first display; A storage step in which the computer stores the article image in the database in association with the article information, an article image extraction step in which the computer extracts the article image from the database, and the article image extracted in the article image extraction step on the second display And a second display step for displaying.

  According to the present invention, an article image including a photographed article is stored in a database in association with article information related to the article with the identification code, the article image is extracted from the database, and the extracted article image is displayed. When the identification code attached to the article is recognized, the state of the article can be accurately determined.

It is a block diagram of an embodiment of an article management system according to the present invention. It is a figure which shows an example of the data stored in the database of FIG. It is a figure which shows an example of the identification code used with the article | item management system shown in FIG. 2 is a flowchart of an operation of storing an article image in a database in association with article information in the article management system of FIG. 1. 2 is a flowchart of an operation of storing an article image in a database in association with article information in the article management system of FIG. 1. It is a figure which shows the example of a display of the image | photographed article | item image. It is a figure which shows the example of a display of the article image on which article information was superimposed. It is a figure for demonstrating calculation of the center coordinate of an identification code. It is a flowchart of the operation | movement which extracts the article image image | photographed in the article management system of FIG. 1, and displays it on the screen of a display. It is a figure which shows the example of a display of the article image in the case of article confirmation. It is a figure which shows an example of the data stored in a database after goods confirmation.

Embodiments of an article management system and method according to the present invention will be described in detail with reference to the drawings.
FIG. 1 is a block diagram of an embodiment of an article management system according to the present invention. The article management system shown in FIG. 1 includes a terminal 1, a network (communication path) 2, a server 3, and a terminal 4.

  In this embodiment, a case where a two-dimensional code having four position detection patterns is used as an identification code will be described. The coordinates of the position detection pattern can be detected, for example, by analyzing a captured image.

  The terminal 1 is realized as a smart phone with a camera function, a personal computer (PC) to which a camera is connected, and the like. The terminal (camera unit) 1A as a photographing unit, and a computer (an identification code recognizing unit and an article information extracting unit) (Identification code recognition unit and article information extraction unit) 1B, a display 1C as a first display unit, and a communication interface 1D as a communication unit.

  The camera 1A takes an image of an article with an identification code that can be read as an image. For this purpose, the camera 1A includes a lens 1a, an image sensor 1b, and an analog / digital converter (AD) 1c, and outputs digital image data of a photographed identification code to the computer 1B.

  The computer 1B is realized by the same configuration as a normal computer and controls the operation of the terminal 1. In the present embodiment, the computer 1B recognizes an identification code of an article image including an article photographed by the camera 1A, converts the recognized identification code into identification code information, and communicates the converted identification code information together with the article image. The data is transmitted to the server 3 via the interface 1D and the network 2. The computer 1B also transmits position coordinate information about the center coordinates of the identification code calculated based on the identification code information to the server 3 via the communication interface 1D and the network 2 as described later. Further, the computer 1B has a built-in timer (not shown) that records the time (date and time) when the identification code is recognized, and the time information about the time (date and time) when the identification code is recognized is also transmitted via the communication interface 1D and the network 2 to the server 3. Send to.

  The display 1C displays article information (overlay information) related to the article with the identification code superimposed on the article image. The article information is extracted from the identification code by the computer 1B as will be described later.

  The server 3 includes a database 3A, a computer (article image extraction unit) 3B as an article image extraction unit, and a communication interface 3C. The database 3A stores the article image in association with the article information. An example of data stored in the database 3A is shown in FIG. In the example shown in FIG. 2, the information about the ID, the product name, and the manager corresponds to the product information included in the identification code, and the information about the actual product confirmation, the confirmation date and time, the product image, etc. is stored only in the database 3A. The The database 3A can also store a plurality of article images obtained each time the camera 1A photographs an article with an identification code in association with the article information.

  The computer 3B controls the operation of the server 3. In the present embodiment, the computer 3B receives the identification code information from the computer 1B via the communication interface 1D, the network 2, and the communication interface 3C. Then, the computer 3B stores the article image in the database 3A in association with the article information based on the received identification code information. More specifically, the computer 3B determines whether or not the ID included in the identification code information exists in the data stored in the database 3A, and the ID included in the identification code information is included in the data stored in the database 3A. If it does not exist, the article image is stored in the database 3A in association with the ID. On the other hand, when the ID included in the identification code information is present in the data stored in the database 3A, the computer 3B does not store the article image in the database 3A. Further, as will be described later, the computer 3B extracts an article image corresponding to the article designated by the terminal 4 from the database 3A according to the article designated by the terminal 4 using an operation unit such as a mouse (not shown). The extracted article image is transmitted to the terminal 4 via the communication interface 3C and the network 2.

  The terminal 4 is realized as a smart phone, a personal computer (PC), or the like, and includes a computer 4A, a display 4B as second display means, and a communication interface 4C as communication means.

  The computer 4A designates an article corresponding to the article image to be displayed on the display 4B by using an operation unit such as a mouse (not shown), and issues a command for extracting the article image corresponding to the designated article to the communication interface 4C. The data is transmitted to the computer 3B through the network 2 and the communication interface 3C. Then, the computer 4A receives the article image extracted from the database 3A by the computer 3B via the communication interface 3C, the network 2, and the communication interface 4C, and displays the received article image on the display 4B.

  In the present embodiment, the computer 1B determines the number of identification codes extracted from the article image when the article image in the screen of the display 1C is raster-scanned. Recognize multiple identification codes. When the computer 1B recognizes a single identification code existing in the screen of the display 1C, the computer 1B converts the article information corresponding to the single identification code extracted by the computer 1B into a single identification code in the screen of the display 1C. To display on the display 1C. On the other hand, when the computer 1B recognizes a plurality of identification codes existing on the screen of the display 1C, the display 1C displays a plurality of article information corresponding to the plurality of identification codes extracted by the computer 1B on the screen of the display 1C. Is displayed on the display 1C in association with the identification code.

  In the present embodiment, the computer 1B extracts the article information included in the identification code, and displays the extracted article information superimposed on the article image taken by the camera 1A. Next, the computer 1B displays the article image extracted by the computer 3B on the display 1C before the camera 1A photographs the article with the identification code. For this purpose, the computer 1B designates an article corresponding to the article image to be displayed on the display 1C using an operation unit such as a numeric keypad (not shown), and issues a command for extracting the article image corresponding to the designated article. The data is transmitted to the computer 3B via the communication interface 1D, the network 2, and the communication interface 3C. Then, the computer 1B receives the article image extracted from the database 3A by the computer 3B via the communication interface 3C, the network 2, and the communication interface 1D so that the article to be photographed by the camera 1A can be quickly found. Therefore, the received article image is displayed on the display 1C.

  FIG. 3 is a diagram showing an example of an identification code used in the identification code reading system shown in FIG. The identification code 11 shown in FIG. 3 is a two-dimensional code having a size of 35 × 35 cells, divided into 9 × 9 blocks, and having one cell of bright separation space 23 between adjacent blocks. Therefore, the separation space is a lattice-like pattern with 8 × 8 columns and a cell interval of 1 cell width. The first position detection pattern 12A is in the lower right 3 × 3 block and the 3 × 3 separation space, and the second position detection pattern 12D is in the upper right 2 × 2 block and the 2 × 2 separation space. The third position detection pattern 12B is located in the 3 (horizontal) × 2 (vertical) block and the 3 × 2 separation space portion, and the lower left 2 (horizontal) × 3 (vertical) block and the 2 × 3 separation space portion. Are provided with fourth position detection patterns 12C, respectively. Therefore, a continuous pattern having a size larger than that of the first to fourth position detection patterns does not appear in the blocks other than the first to fourth position detection patterns of the identification code 11.

  The minimum unit of the code portion of the identification code 11 is a cell. The identification code 11 usually takes a square or rectangular shape. Although other shapes are possible, most of the two-dimensional codes are quadrangular, and the two-dimensional code of the first embodiment is also square. However, the shape is not limited to this, and may be rectangular or other shapes.

  In general, the two-dimensional code represents data in light and dark cells, and the identification code 11 also represents data in light and dark cells. Furthermore, although the identification code 11 is a 35 × 35 cell square, it can be formed into a code having a larger size or a shape such as a rectangle whose vertical and horizontal sizes are changed. A square two-dimensional code of 35 × 35 cells is referred to as version 2 × 2. Here, the minimum version is 1 × 1, and the cell size at this time is 27 × 27. The embedding of the pattern is possible when both the vertical and horizontal versions are 2 or more. The reason for not embedding a picture when the version is 1 × 1 is that even though the amount of data is small, if the pattern is embedded, the amount of data is further reduced, and even if it is recognized, almost no data can be obtained. The above restrictions were added. The identification code 11 can be extended in the vertical direction and the horizontal direction, respectively. When the horizontal version is 2 and the vertical version is 3, it is written as version 2 × 3. As the version increases by 1, the cell size increases by 8 and the number of blocks increases by 2. Therefore, in version 3 × 4, the cell size is 43 × 51. The version can be selected from 1 to 20, but is not limited to this.

  In the first position detection pattern 12A, the dark cell portion includes a square frame having a width of 1 cell of 8 × 8 cells and a 2 × 2 square at the center of the square frame. In the second position detection pattern 12D, the dark cell portion has a square frame of 1 × 4 cells of 4 × 4 cells. The third position detection pattern 12B is a horizontally long rectangular frame in which the dark cell portion has a rectangular cell with a width of 1 cell of 8 × 4 cells. The fourth position detection pattern 12C is a vertically long rectangular frame in which a dark cell portion has a rectangular cell with a width of 1 × 4 × 8 cells.

  In the identification code 11, four different position detection patterns are arranged at the four corners of the square two-dimensional code. Note that the position detection patterns are different when the shape, the size, and the arrangement direction on the two-dimensional code are different, and also include the case where the line width ratios are different. However, since it is affected by shooting conditions and the like, the difference in color is not targeted, but a light and dark binary image is targeted.

  In the identification code 11, the position detection pattern is arranged near each vertex of a square or a rectangle. This is because the influence of dirt can be dispersed by arranging them as far as possible rather than arranging them at one place. However, the position of the position detection pattern is not limited to the four corners. Like the identification code 11, not only a square but also a rectangular shape is used as a position detection pattern, so that the shape, the inclination, and the size can be easily distinguished, so that it can be recognized at high speed. In addition, the hollowed rectangle is easy to distinguish from other reflections, and there is little waste of data.

  The reason for arranging the four position detection patterns is that in the two-dimensional projective transformation used to calculate the mapping of coordinates with high accuracy in the analysis, the cell of the code and the coordinates of the captured image corresponding to the cell are calculated. This is because it is desirable to give four sets of coordinates as parameters. Even if there are only two or three position detection patterns, it is possible to perform projective transformation after calculating four points by interpolating the coordinates, but shooting from the lick, distortion, blurring, etc. In the identification code 11, four position detection patterns are arranged because it is difficult to obtain accurate coordinates and greatly affects the accuracy of data extraction.

  Also, the reason why the position detection pattern is different is that even if there is a position detection pattern that could not be recognized, the position detection pattern that could not be recognized can be reliably identified, and the coordinates of the position detection pattern that could not be recognized can be predicted. This is because the position detection pattern can be corrected. When all the same position detection patterns are used, it is not easy to specify the position detection patterns that could not be recognized as much as when different position detection patterns are used, and correction of the position detection patterns becomes difficult.

  56 blocks other than the four position detection patterns of the identification code 11 are data portions, and include an actual data block, an error correction code block, a version information block, a format information block, and a design embedding information block.

  As described above, the data portion includes 3 × 3 cells as one block and embeds data in units of blocks. The data section includes version information blocks 15 and 16, a format information block 17, and pattern embedding information blocks 18A, 18B, 19A and 19B, and the remaining blocks are actual data blocks 22. In the identification code 11, a part of the actual data block 22 is used as an error correction code and a position correction pattern.

  Therefore, the remaining blocks 22 excluding the position detection pattern, version information block, format information block, picture embedding information block, block provided with the position correction pattern, and error correction code block are actual data blocks. If the pattern is embedded, the pattern embedded block indicated by the pattern embedded information block is also excluded from the actual data block. The actual data is recorded in order such that the blocks belonging to the actual data block are laid out in order from the upper left to the right, and laid from the left one block below when the laying is completed.

  A block has 3 × 3 cells, and each cell represents one bit of light and dark, so one block has a maximum of 9-bit information (9-bit representation), but here is resistant to blurring and blurring of the image Therefore, the data amount per block can be set smaller than the 9-bit data amount. In the identification code 11, the block size is 3 × 3 cells, but the block size is not limited to this, and the minimum 1 × 1 cell size and the vertical and horizontal cell sizes are different. Block sizes such as are also possible.

  The version information block records information related to the size of the identification code 11, and there are two types of versions, the vertical version information block 15 and the horizontal version information block 16, and corresponding version information is recorded. The vertical version information block 15 and the horizontal version information block 16 disperse the risk of missing due to dirt or the like by disposing two blocks each storing the same information at two locations apart from each other. As version information, a block representing a numerical value of the version number (vertical and horizontal 1 to 20) is arranged.

  The format information block 17 records format information composed of a pattern embedding flag (1 bit) and data block type data (2 bits), and arranges three blocks storing the same information at three positions apart. The pattern embedding flag indicates whether or not a pattern is embedded, that is, whether or not a pattern embedding area is provided. When the pattern embedding is present, a pattern embedding information block is provided. The data block type data indicates the type of the data block. The data block type is the data capacity per block, and any of 6, 7, and 9 bits / block is selected. The amount of data decreases in the order of 9 bits> 7 bits> 6 bits, but the readability of the data is in the order of 6 bits> 7 bits> 9 bits. Take into account and choose. This will be described later.

  The design to be embedded is embedded in units of blocks, and when a plurality of adjacent blocks are design embedding regions, a separation space between them is also included in the design embedding region. The external shape of the pattern to be embedded is a rectangle, and the image of the pattern is not limited to a binary image in cell units, and any image may be used. Also, there may be a plurality of rectangular blocks in which the pattern is embedded. For example, the pattern may be a multi-value image having a higher resolution than the cell, a color image, or, of course, a binary image in units of cells. In the first embodiment, as a limitation of embedding the pattern, it is assumed that the pattern is not embedded in the upper code block 2 rows, the left block 2 columns, the lower block 3 rows, and the right block 3 columns. In this range, according to the specification of the two-dimensional code, a pattern embedding information block having image information is arranged in a portion outside the pattern embedding range.

  The pattern embedding information block records information on the size and block position of the area in which the pattern is embedded in the vertical and horizontal directions, and there are two types of vertical embedding information blocks 18A and 18B and horizontal embedding information blocks 19A and 19B. Corresponding version information is recorded. The vertical embedding information blocks 18A and 18B record the design embedding height (3 bits or 6 bits) and the design embedding offset height (3 bits or 6 bits). The horizontal embedding information blocks 19A and 19B designate a picture embedding width (3 bits or 6 bits) and a picture embedding offset width (3 bits or 6 bits). Whether to use 3 bits or 6 bits is related to version information as will be described later. If the version is 2 to 4, 3 bits are required, and if the version is 5 to 20, 6 bits are required. In the case of 2 to 4, the vertical embedding information block 18B and the horizontal embedding information block 19B are unnecessary.

  The pattern embedding information block exists only when the pattern embedding flag is set in the format information block. The identification code 11 assumes that the number of embedding patterns is only one, and if it is assumed that a plurality of embedding patterns are embedded in a plurality of areas, the bit of the pattern embedding flag in the format information block The number is increased to indicate the number of pattern embedding areas, and the above-mentioned pattern embedding information blocks are provided for the number of patterns. The design size and design embedding start position are specified in units of blocks. The block coordinates are expressed as (n, m) with the block at the upper left corner as the origin, the number of horizontal blocks is blW, and the number of vertical blocks is blH. In the first embodiment, the pattern embedding area is limited to a rectangular area consisting of upper left (2, 2) and lower right ((blW-4, blH-4). The maximum number of horizontal blocks of the pattern is blW-. Five and the maximum number of vertical blocks is blH-5.

  The position of the picture is embedded in the code as block embedding information blocks with the block coordinates that are the starting point (upper left) and the block size so that the position of the picture can be recognized during code analysis. . Similar to the version information block, it is handled separately in the horizontal and vertical directions. In the horizontal direction, the amount of data is divided when blW-5 is less than 8 (horizontal version 2 to 4) and in other cases (horizontal version 5 to 20), and the vertical length is the same. The values of blW and blH can be obtained by analyzing the horizontal and vertical versions.

  When blW is less than 13, the horizontal block size is a minimum of 1 and a maximum of 8 blocks, 8 can be represented by 3 bits, and similarly there are 7 horizontal offset blocks, 2 to 8, Since it can be represented by 3 bits, the total is 6 bits. Therefore, a block is represented by 6 bits, and these can be represented by one block. The same applies to the vertical. When blW is 13 or more, the horizontal block size is represented by 6 bits, and similarly, the number of horizontal offset blocks is represented by 6 bits. Therefore, it is expressed using 2 blocks. The same applies to the vertical.

  The horizontal embedding information blocks 19A and 19B are outside the upper left and lower right horizontal version information blocks (upper and lower sides), and the vertical embedding information blocks 18A and 18B are outside the lower left and lower right vertical version information blocks. (Left side and right side)

  When the pattern is not embedded, that is, when the pattern embedding flag of the format information block indicates “None”, the code embedding information block and the pattern embedding area become unnecessary, and the code becomes efficient.

  The position correction pattern is a target pattern used for the coordinate correction of the actual data block, the error correction code block, and the pattern embedding information block when the pattern is embedded. Although the approximate coordinates in the identification code 11 can be acquired from the position detection pattern, an error occurs in the coordinates of the data portion due to paper warping, bending, lens distortion, and displacement at the time of position detection pattern acquisition. Provide. Unlike the position detection pattern, the position correction pattern does not need to be distinguished from other noises. If the position detection pattern can be calculated, the position of the position correction pattern can be easily determined. Therefore, it is desirable that the position correction pattern has a shape that facilitates fine coordinate correction.

  In the identification code 11, the position correction pattern arranges blocks (position correction blocks) composed of predetermined cell combinations at regular intervals instead of actual data. A block in which the center cell of the block is dark and the surrounding area is bright is arranged if the block coordinates (7n, 7m) (n and m are integers of 0 or more) are data portions. However, when the position detection block, the version information block, the format information block, the design embedding information block and the design should exist at the coordinates, they are not arranged. Here, with respect to the block coordinates, the upper left coordinate reference coordinate of the block is (0, 0), and the block on the right is expressed as (1, 0). The block for providing the position correction pattern is not limited to the above.

  In the actual data, a message and a segment combining the header (message type (message encoding) and message size) that qualifies the message are arranged by the number of messages. As a special segment, a segment that does not include a message and contains only a termination flag is prepared. When the capacity of actual data is excessive, a segment of the termination flag is arranged, and then padding is arranged. The actual data is divided into blocks according to the data capacity per block indicated by the data block type data. Similarly, the error correction code is also divided into blocks. The computer 1B recognizes the identification code and also extracts information included in the actual data.

  When a Reed-Solomon code is used as the error correction code, error correction is performed in units of words, so it is desirable to make one word into one block. When one word spans a plurality of blocks, even when one block is contaminated, all words related to the block are subjected to error correction, and the correction efficiency is deteriorated. Dirt that causes corrections and color jumps due to spotlights are often concentrated in one place, but by making a block, the data to be corrected can be gathered in one place at the same time, enabling efficient correction. And increase the possibility of recognizing the code.

  4 and 5 are flowcharts of operations for storing the article image in the database in association with the article information in the article management system of FIG. Here, an article image including an article designated by the terminal 1 is stored in advance in the database 3A, and the identification codes shown in FIG. 3 attached to the storage box A and the storage box C shown in FIG. The case will be described. Further, as the article image stored in advance in the database 3A, either a previously photographed article image or an article image prepared in advance at the time of registration may be used.

  First, since an article corresponding to an article image to be displayed on the display 1C is designated by using an operation unit such as a numeric keypad (not shown), the computer 1B instructs to extract an article image corresponding to the designated article. Is transmitted to the computer 3B (step S1).

  Next, the computer 3B receives from the computer 1B a command for extracting an article image corresponding to the article designated by the computer 1B (step S2). Next, the computer 3B accesses the database 3A and extracts an article image corresponding to the article designated by the computer 1B (step S3).

  Next, the computer 3B transmits the article image extracted from the database 3A to the computer 1B (step S4). Next, the computer 1B receives the article image extracted by the computer 3B from the database 3A (step S5), and in order to be able to quickly find the article to be photographed by the camera 1A, It is displayed on the screen of the display 1C (step S6).

  Next, the camera 1A photographs the article (step S7), and the computer 1B displays an article image including the article photographed by the camera 1A on the screen of the display 1C (step S8). FIG. 6 is a diagram illustrating a display example of a photographed article image. In FIG. 6, articles 31 and 32 included in one article image 30 ′ displayed on the screen 30 correspond to storage boxes A and C, respectively, and printed identification codes 31A and 32A are assigned to articles 31 and 32, respectively. It is pasted.

  The identification codes 31A and 32A are photographed by the camera 1A and read by the computer 1B. In the example shown in FIG. 6, if the width and length of the screen 30 (article image 30 ′) are w and h, respectively, and the coordinates of the upper left corner are the origin O (ie (0, 0)), the upper right corner. The coordinates of A, the coordinates of the lower right corner B, and the coordinates of the lower left corner C are represented by (w-1, 0), (w-1, h-1) and (0, h-1), respectively. .

  Next, the computer 1B recognizes the identification codes 31A and 32A in the image photographed by the camera 1A, and extracts the article information that is information about the article name and the manager from the identification codes 31A and 32A, respectively (step S9). The extracted article information is displayed superimposed on the article image 30 ′ (step S10).

  FIG. 7 is a diagram illustrating a display example of an article image on which article information is superimposed. In the article image 30 ′ of FIG. 7, the article name is the storage box A, and the article information 31B indicating that the manager is the manager 1 is on the image of the article 31 including the identification code 31A. The article information 32B indicating that the manager is the manager 2 is displayed on the image of the article 32 including the identification code 32A.

  Next, the computer 1B transmits the article image and article information to the computer 3B (step S11), and the computer 3B receives the article image and article information from the computer 1B (step S12). Next, the computer 3B stores the article image in the database 3A in association with the article information, and ends the processing flow.

  Therefore, the article image 30 ′ including the article 31 corresponding to the storage box A has article information 31B (information indicating that the ID is 0001, the article name is the storage box A, and the manager is the manager 1). The article image 30 ′ including the article 32 corresponding to the storage box C and stored in the database 3A is related to the article information 32B (ID is 0003, the article name is the storage box C, and the manager is the manager. 2) is stored in the database 3A.

  In the present embodiment, the computer 1B extracts the article information from the identification codes 31A and 32A, and simultaneously converts the recognized identification codes 31A and 32A into identification code information. In the present embodiment, the computer 1B uses the identification code 31A, based on the converted identification code information to determine the display position of the article information 31B, 32B in the screen 30 (article image 30 ′). The center coordinates CA (cxa, cya) and CB (cxb, cyb) of 32A are calculated. FIG. 8 is a diagram for explaining the calculation of the center coordinates of the identification code. The identification code X shown in FIG. 8 has the same format as the identification code shown in FIG. 2, and corresponds to the identification codes 31A and 32A, respectively.

  The computer 1B analyzes the article image 30 ′, thereby detecting the coordinates (px0, py0) of the corner P0 of the position detection pattern X0 of the identification code X, the coordinates (px1, py1) of the corner P1 of the position detection pattern X, and the position detection. The coordinates (px2, py2) of the corner P2 of the pattern X2 and the coordinates (px3, py3) of the corner P3 of the position detection pattern X3 can be acquired.

  The center coordinates C (cx, cy) of the position detection pattern X are on the coordinates of the corners P0, P1, P2, P3, the coordinates of the corners P0, P2 on the diagonal line of the identification code X, or the diagonal line of the identification code X. It can be obtained from the coordinates of the corners P1 and P3. When the central coordinate C (cx, cy) is obtained from the coordinates of the corners P0, P1, P2, and P3, the x coordinate cx of the central coordinate C is (px0 + px1 + px2 + px3) / 4, and the y coordinate cy of the central coordinate C is (py0 + py1 + py2 + py3). ) / 4. When the center coordinate C (cx, cy) is obtained from the coordinates of the corners P0 and P2 on the diagonal line of the identification code X, the x coordinate cx of the center coordinate C is (px0 + px2) / 2, and y of the center coordinate C The coordinate cy is (py0 + py2) / 2.

  The computer 1B converts the center coordinates CA (cxa, cya) and CB (cxb, cyb) of the identification codes 31A and 32A into position coordinate information in the same format as the identification code information, and the identification code information and the position coordinate information Are transmitted to the computer 3B together with time information about the time (date and time) when the product image, product information and identification code are recognized.

  FIG. 9 is a flowchart of an operation for extracting an article image photographed in the article management system of FIG. 1 and displaying it on the display screen. This processing flow is shown immediately after the end of the processing flow shown in FIGS. 4 and 5 or in FIGS. 4 and 5 in order to confirm the state of the article in the article image photographed in the processing flow shown in FIGS. It is executed after a predetermined period (for example, one day) has elapsed since the end of the processing flow. Here, a case where an article image 30 ′ including articles corresponding to the storage box A or the storage box C shown in FIG. 2 is extracted from the database 3 </ b> A will be described.

  First, since an article corresponding to an article image to be displayed on the display 4B is designated using an operation unit such as a mouse (not shown), the computer 4A instructs to extract an article image corresponding to the designated article. Is transmitted to the computer 3B (step S21).

  Next, the computer 4B receives from the computer 4B a command for extracting an article image corresponding to the article designated by the computer 4A (step S22). Next, the computer 3B accesses the database 3A and extracts an article image corresponding to the article designated by the computer 4A (step S23).

  Next, the computer 3B transmits the article image extracted from the database 3A to the computer 4A (step S24). Next, the computer 4A receives the article image extracted from the database 3A by the computer 3B (step S25), displays the received article image on the screen of the display 4B (step S26), and ends the processing flow.

  FIG. 10 is a diagram illustrating a display example of an article image at the time of article confirmation. As shown in FIG. 10, the article name is the storage box A, the manager is the manager 1, the article information 31B ′ indicating that the confirmation date is April 1, 2013, and the article name is the storage box. The article information 32B ′ indicating that the manager is the manager 2 and the confirmation date is April 1, 2013 is superimposed on the article image 30 ′.

  FIG. 11 is a diagram illustrating an example of data stored in the database after article confirmation. As shown in FIG. 11, article images 30 ′ are stored in the column of article images corresponding to the storage box A and the storage box C, respectively, and the article 31 corresponding to the storage box A and the article corresponding to the storage box C are stored. In order to show that 32 is in a normal state, “performed” is entered in the article confirmation column corresponding to each of the storage box A and the storage box C, and the date and time of actual confirmation ( April 1, 2013) is entered. On the other hand, when the state of the article included in the article image 30 ′ is abnormal (for example, the storage box A is adjacent to the storage box B instead of the storage box C), the article confirmation column remains “not implemented”. And confirming that the state of the article included in the article image 30 ′ is abnormal, and that the problem is solved because the article is in an abnormal state. It is possible to contact the terminal 1 side (for example, the inventory trader side) from the manager side.

  According to the present embodiment, the article image 30 ′ including the photographed articles 31 and 32 is stored in the database 3A in association with the article information 31B and 32B related to the articles 31 and 32 with the identification codes 31A and 32A. By extracting the article image 30 ′ from the database 3A and displaying the extracted article image 30 ′ on the screen of the display 4B, the identification codes 31A and 32A attached to the articles 31 and 32 are recognized. The state can be determined accurately. Therefore, even if the terminal 1 side does not know the normal state of the articles 31, 32, whether or not the articles 31, 32 are in a normal state on the terminal 4 side (whether the storage location of the articles 31, 32 is accurate). Or whether or not the articles 31 and 32 are damaged, etc.).

  Further, according to the present embodiment, before the camera 1A photographs the articles 31, 32 with the identification codes 31A, 32A, the article image extracted from the database 3A by the computer 3B is displayed on the screen of the display 1C. Therefore, even when the terminal 1 does not know the shape of the articles 31 and 32, the articles 31 and 32 can be quickly found. Therefore, since the search of the articles 31 and 32 and the confirmation operation of the number of articles 31 and 32 can be performed after confirming the state of the articles 31 and 32, the time for searching for the articles 31 and 32 can be shortened.

  When a plurality of article images acquired each time the camera 1A photographs an article with an identification code is stored in the database 3A in association with the article information, the plurality of article images stored in the database 3A are stored. By comparing each other, the state change of the articles 31 and 32 can be confirmed.

  Further, by using the two-dimensional code as the identification codes 31A and 32A, the position coordinates (for example, center coordinates) in the article image 30 ′ can be acquired, so that the article information 31B and 32B are used as the identification codes 31A and 32A. The positions of the articles 31 and 32 in the article image 30 ′ can be shown by displaying them superimposed on each other.

  Further, since the data amount of the two-dimensional code is larger than the data amount of the one-dimensional code, a large amount of information can be superimposed and displayed on the article image only by code analysis. Furthermore, since the computer 1B can simultaneously recognize a plurality of identification codes in one image, the arrangement state of the articles can be indicated by displaying a plurality of article information in the article image 30 '.

  The present invention is not limited to the above-described embodiment, and many changes and modifications can be made. For example, the database can be provided in the terminal instead of the server. Also, steps S1 to S6 can be omitted in the processing flows of FIGS. Moreover, you may display the article image shown in FIG. 6 or FIG. 7 on the screen of a display as an article image in the case of article confirmation.

  As the position coordinates obtained by analyzing the identification code, instead of the center coordinates of the identification code, the coordinates of an arbitrary position (for example, the corner of the position detection pattern) of the position detection pattern included in the identification code, the upper end of the identification code The coordinates of a position that is a predetermined distance (for example, 10 pixels) away from can be used. The number of position coordinates obtained by analyzing the identification code may be singular or plural.

1,4 terminals 1A Camera (shooting unit)
1a lens 1B computer (identification code recognition unit and article information extraction unit)
1b Image sensor 1C, 4B Display 1c Analog to digital converter (AD)
1D, 3C, 4C Communication interface 2 Network (communication route)
3 server 3A database 3B computer (article image extraction unit)
4A Computer 11, 31A, 32A Identification code 12A First position detection pattern 12B Third position detection pattern 12C Fourth position detection pattern 12D Second position detection pattern 15 Version information block (vertical)
16 Version information block (horizontal)
17 Format information block 18A, 18B Pattern embedding information block (vertical)
19A, 19B Pattern embedding information block (horizontal)
30 screen 30 ′ article image 31, 32 article 31B, 32B, 31B ′, 32B ′ article information

Claims (4)

Photographing means for photographing an article with an identification code readable as an image;
Identification code recognition means for recognizing an identification code in an article image including a photographed article;
Article information extracting means for extracting article information relating to the article to which the identification code is attached from the identification code;
First display means for displaying the article information superimposed on the article image;
A database for storing the article image in association with the article information;
Article image extraction means for extracting the article image from the database;
Second display means for displaying the article image extracted by the article image extraction means;
With
The article information includes ID information,
The database stores the ID information included in the article information in association with an article image in which the article was previously photographed,
The article image extracting means is the article image photographed by the photographing means in association with the ID information stored in the database that matches the ID information included in the article information extracted from the identification code. Is newly stored in the database ,
The identification code is
A two-dimensional code in which data represented by a binary code is converted into a cell and arranged as a pattern in a two-dimensional matrix,
A position detection pattern;
A plurality of data blocks obtained by dividing an area other than the position detection pattern of the two-dimensional matrix;
A separation space provided between the plurality of adjacent data blocks, and
The article management system, wherein the plurality of data blocks are two-dimensional codes divided according to error correction units .   The article image extracting means stores in the database the confirmation result of the article and the date and time when the article was confirmed in association with the ID information included in the article information extracted from the identification code. The article management system according to claim 1.   The article management system according to claim 1, wherein the article information includes manager information. A photographing step of photographing an article with an identification code readable as an image with a camera;
An identification code recognition step for recognizing an identification code in an article image including the photographed article by a computer;
An article information extracting step in which the computer extracts article information relating to the article to which the identification code is attached from the identification code;
A first display step of superimposing the article information on the article image and displaying it on a first display;
A storage step in which the computer stores the article image in a database in association with the article information;
An article image extraction step in which the computer extracts the article image from the database;
A second display step of displaying the article image extracted in the article image extraction step on a second display;
With
The article information includes ID information,
The database previously stores the ID information included in the article information in association with an article image in which the article has been previously photographed,
In the storage step, the article image photographed in the photographing step is associated with the ID information stored in the database that matches the ID information included in the article information extracted from the identification code. Memorize a new database ,
The identification code is
A two-dimensional code in which data represented by a binary code is converted into a cell and arranged as a pattern in a two-dimensional matrix,
A position detection pattern;
A plurality of data blocks obtained by dividing an area other than the position detection pattern of the two-dimensional matrix;
A separation space provided between the plurality of adjacent data blocks, and
The article management method, wherein the plurality of data blocks are two-dimensional codes divided according to error correction units .