JP2017057041A - Method, device and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a method capable of recognizing the position of an image of optical reading information including identification information related to two or more kinds of article information on the basis of a photographic image obtained by photographing a plurality of pieces of optical reading information including identification information for identifying an article.SOLUTION: The method recognizes identification information of a plurality of pieces of optical reading information on the basis of a photographic image obtained by photographing a plurality of pieces of optical reading information including identification information for identifying an article, and displays a specific image which specifies a position in the photographic image of optical reading information whose identification information is recognized and is determined on the basis of article information belonging to an article related to identification information in the photographic image. The article information belonging to the article has two or more kinds of article information.SELECTED DRAWING: Figure 3

Description

  The present invention relates to a method, an apparatus, and a program.

  Conventionally, optical reading information such as a two-dimensional code has been used. The two-dimensional code can hold a large amount of information in a small area, and is widely used for various purposes such as article management and web guidance using a mobile phone.

  For example, in order to manage a plurality of articles, a two-dimensional code including identification information for identifying the articles is attached to each article, thereby managing the plurality of articles.

  Management information for managing articles is stored in a database as a management table associated with identification information. When the management information for articles is changed, the contents of the management table are changed synchronously.

  Specifically, a process of recognizing the two-dimensional code by photographing the two-dimensional code attached to each article with a terminal and changing the management information in the article management table based on the recognized identification information is performed. .

  In such a process, a process of photographing the two-dimensional code of each article one by one and recognizing the photographed two-dimensional code has been performed.

  Therefore, it has been proposed to capture a plurality of two-dimensional codes at a time by photographing a two-dimensional code attached to a plurality of articles on one screen.

JP 2000-148797 A JP 2001-28033 A

  For example, in Patent Document 1, a two-dimensional code affixed to a plurality of magnetic storage media is photographed on one screen, a plurality of two-dimensional codes are recognized at once, and a plurality of two-dimensional codes are photographed on a photographing screen, It has been proposed to display a cursor at the position of a two-dimensional code corresponding to search information input in advance. Since each two-dimensional code is displayed together with the attached magnetic storage medium on the photographing screen, the magnetic storage medium corresponding to the search information is determined based on the cursor display.

  When managing an article using a two-dimensional code, based on the article management information, recognizes whether or not the article is an object to be processed on a shooting screen on which a plurality of two-dimensional codes are shot. There is a need to be able to do it.

  Here, when there are two or more kinds of article management information, it is desirable that each article having different management information can be recognized even if the articles are the same.

  However, in the method proposed by Patent Document 1, the position (magnetic storage medium) of the two-dimensional code corresponding to the search information can be obtained. However, when there are two or more types of article management information, it is displayed on the shooting screen. It is not possible to recognize the management information of each article being photographed.

  Patent Document 2 proposes that a form on which a plurality of barcodes are printed is photographed and a recognized barcode area portion is highlighted and displayed as well as data represented by the barcode. ing.

  However, the method proposed by Patent Document 2 does not satisfy the above-described requirements.

  In the present specification, the position of an image of optical reading information including identification information associated with two or more types of article information based on a photographed image obtained by photographing a plurality of pieces of optical reading information including identification information for identifying an article. It is an object of the present invention to provide a method for recognizing an image.

  Further, in the present specification, an image of optical reading information including identification information associated with two or more types of article information based on a photographed image obtained by photographing a plurality of pieces of optical reading information including identification information for identifying an article. It is an object of the present invention to provide a device that can recognize the position of the camera.

  Furthermore, in this specification, based on a photographed image obtained by photographing a plurality of pieces of optical reading information including identification information for identifying an article, an image of optical reading information including identification information associated with two or more types of article information It is an object of the present invention to provide a program that can recognize the position of an object.

  According to the method disclosed in the present specification, the identification information of the plurality of optical reading information is recognized based on a captured image obtained by photographing the plurality of optical reading information including identification information for identifying an article, and the identification is performed. A specific image for identifying a position in the captured image of the optical reading information whose information has been recognized, and a specific image determined based on article information of an article associated with the identification information is included in the captured image. There are two or more types of the item information displayed on the item.

  Further, according to the apparatus disclosed in the present specification, an image acquisition unit that acquires a captured image by capturing a plurality of pieces of optical reading information including identification information for identifying an article, and a display unit that displays the acquired captured image A storage unit that associates and stores the identification information and article information included in the article, and recognizes the identification information of the plurality of optical reading information, and shoots the optical reading information in which the identification information is recognized. A specific image for specifying a position in the image, and displaying a specific image determined on the basis of article information included in the article associated with the identification information in the photographed image. There are two or more types of article information.

  Furthermore, according to the program disclosed in the present specification, the identification information of the plurality of optical reading information is recognized based on a photographed image obtained by photographing the plurality of optical reading information including identification information for identifying an article. A specific image for identifying a position in the captured image of the optical read information in which the identification information is recognized, and the specific image determined based on article information included in an article associated with the identification information The computer executes that the item information displayed in the image and possessed by the item is two or more types.

  According to the method disclosed in the present specification described above, identification information associated with two or more types of article information is obtained based on a photographed image obtained by photographing a plurality of optical reading information including identification information for identifying an article. It is possible to recognize the position of the optical reading information including

  Moreover, according to the apparatus disclosed in the present specification described above, identification associated with two or more types of article information based on a photographed image obtained by photographing a plurality of pieces of optical reading information including identification information for identifying the article. The position of optical read information including information can be recognized.

  Furthermore, according to the program disclosed in the present specification described above, identification associated with two or more types of article information based on a photographed image obtained by photographing a plurality of pieces of optical reading information including identification information for identifying the article. The position of optical read information including information can be recognized.

1 is a diagram illustrating a first embodiment of a system disclosed in this specification. FIG. It is a figure explaining a user's terminal. It is a flowchart explaining operation | movement of a terminal. It is a figure where a user's terminal picturizes a plurality of two-dimensional codes. It is a figure explaining an inventory management table | surface, (A) has shown before the change of the stock quantity, (B) shows after the change of the stock quantity. It is FIG. (1) which shows the process which changes the stock quantity of a box. It is FIG. (2) which shows the process which changes the stock quantity of a box. It is FIG. (3) which shows the process which changes the stock quantity of a box. It is a figure explaining the process of the modification 1. FIG. It is a figure explaining the inventory management table | surface of the modification 1, (A) has shown before the change of an inventory status, (B) shows after the change of an inventory status. It is a figure explaining the process of the modification 2. FIG. It is a figure explaining the inventory management table | surface of the modification 2, (A) has shown before the change of an inventory status, (B) shows after the change of an inventory status. In a 2nd embodiment of a system indicated to this specification, a user's terminal is a figure which picturizes a plurality of two-dimensional codes. It is a flowchart explaining the approval process of documents. It is a figure explaining a document management table | surface, (A) has shown before change of the state of a document, (B) shows after change of the state of a document. It is a figure which shows the process which changes the state of a document. It is a figure explaining estimating the position of the two-dimensional code in a picked-up image.

  Hereinafter, a preferred embodiment of the system disclosed in the present specification will be described with reference to the drawings. However, the technical scope of the present invention is not limited to these embodiments, but extends to the invention described in the claims and equivalents thereof.

  FIG. 1 is a diagram illustrating a first embodiment of a system disclosed in this specification.

  The system 1 is a system that manages two or more types of article information of articles using a two-dimensional code that is optical reading information. Specifically, in the present embodiment, the article is a box that stores the product, and the article information is the number of products in stock in the box.

  The system 1 includes a server 20, a database 21, a two-dimensional code manager terminal 30 that issues a two-dimensional code, an issuing unit 31, and a user terminal 10 that uses the two-dimensional code. The server 20, the terminal 30, and the terminal 10 are communicably connected via the network N. Instead of the network N, the server 20 may communicate with the terminal 30 directly by serial communication or the like.

  The server 20 is communicably connected to a database 21 that stores an inventory management table having a relationship between identification information for identifying a box as an article and the number of products in stock associated with the identification information. The server 20 communicates with the administrator's terminal 30 or the user's terminal 10 and manages the inventory management table stored in the database 21.

  The terminal 30 of the manager of the two-dimensional code issues a two-dimensional code C including identification information for identifying the box by printing it on a sticker, for example, using the issuing unit 31. The two-dimensional code C is affixed to the box B identified by the identification information included in the two-dimensional code C. The administrator of the two-dimensional code creates an inventory management table by associating the number of products in the box B with the identification information of the box B, and transmits the created inventory management table to the server 20. The server 20 stores the received inventory management table in the database 21.

  The two-dimensional code user terminal 10 captures the two-dimensional code affixed to the plurality of boxes B, recognizes the identification information of the two-dimensional code, and manages the inventory management stored in the database 21 from the server 20. Receive a table. The terminal 10 updates the contents of the inventory management table by changing the number of products in stock in the box based on the user's operation. The terminal 10 transmits the inventory management table whose contents are updated to the server 20. The server 20 stores the received inventory management table in the database 21, so that the contents of the updated inventory management table are synchronized with the inventory management table stored in the database 21. The detailed operation of the terminal 10 will be further described later.

  FIG. 2 is a diagram illustrating the user terminal 10.

  The terminal 10 includes a calculation unit 11, a storage unit 12, an operation unit 13, a display unit 14, an image acquisition unit 15, and a communication unit 16.

  The arithmetic unit 11 controls each element of the terminal 10 and performs various processes according to a predetermined program stored in advance in the storage unit 12, and uses the storage unit 12 to temporarily store data generated during the processing. To do. The storage unit 12 may include a primary storage device and a secondary storage device. The storage unit 12 may have a drive that can read a storage medium that stores a predetermined program.

  The operation unit 13 is operated by the user of the terminal 10 and inputs various types of information. As the operation unit 13, for example, a touch panel can be used. The calculation unit 11 performs various processes using various types of information input from the operation unit 13.

  The display unit 14 displays various information according to the operation of the calculation unit 11. For example, a liquid crystal panel can be used as the display unit 14.

  The image acquisition unit 15 is controlled by the calculation unit 11 to capture a plurality of two-dimensional codes as one image. As the image acquisition unit 15, for example, a CCD or a CMOS imaging element can be used. The captured image captured by the image acquisition unit 15 is displayed on the display unit 14 described above. In addition, the captured image captured by the image acquisition unit 15 may be temporarily stored in the storage unit 12.

  The communication unit 16 transmits and receives information to and from the server 20 via the network N. As the network N, a wired or wireless network or a network including wired and wireless can be used.

  As the terminal 10, for example, a multi-function mobile phone, a tablet terminal, a notebook personal computer, a desktop personal computer, a handy terminal, or the like can be used.

  Next, the detailed operation of the user terminal 10 will be described below with reference to the flowchart shown in FIG.

  First, in step S10, the terminal 10 captures a plurality of two-dimensional codes.

  FIG. 4 is a diagram in which the user terminal 10 captures a plurality of two-dimensional codes.

  In the example shown in FIG. 4, six boxes B1 to B6 are stacked side by side in the vertical and horizontal directions. Two-dimensional codes C1 to C6 including identification information for identifying the boxes are affixed to the boxes B1 to B6. The six boxes B1 to B6 are arranged with the surfaces to which the two-dimensional codes C1 to C6 are attached facing in the same direction. The terminal 10 includes a touch panel 13 a and buttons 13 b as the operation unit 13. For shooting, for example, an application is started up, the camera is started, and capture is always performed. The captured image is displayed on the display unit 14. Further, the display unit 14 can display buttons, labels, and switches in an overlapping manner. Further, these buttons and the like can be made transparent. And the button etc. which were displayed on the display part 14 can be pushed by tapping the touch panel 13a.

  The user uses the terminal 10 to photograph the two-dimensional codes C1 to C6 attached to the boxes B1 to B6. The photographed two-dimensional codes C1 to C6 are displayed on the display unit 14 together with the attached boxes B1 to B6.

  Next, in step S12, the terminal 10 analyzes the captured image and recognizes identification information of the captured two-dimensional code. In the present embodiment, it is assumed that the identification information of all the two-dimensional codes C1 to C6 has been recognized.

  Next, in step S14, the terminal 10 receives the inventory management table T1 from the database 21 via the server 20 connected to the network N.

  FIG. 5 is a diagram for explaining the inventory management table T1, FIG. 5 (A) shows before the change in inventory quantity, and FIG. 5 (B) shows after the change in inventory quantity.

  The six boxes B1 to B6 are identified using identification numbers 001 to 006 as identification information. In the box identified by each identification number, the number of products shown in the inventory management table T1 is stored. For example, in the example shown in FIG. 5A, 35 products are stored in the box B1 having the identification number 001, and 48 products are stored in the box B6 having the identification number 006.

  Next, in step S <b> 16, the terminal 10 acquires the number of stocks that are article information included in a box that is associated with an identification number that is identification information, based on the received inventory management table T <b> 1. Specifically, the terminal 10 obtains the relationship between the boxes B1 to B6 identified using the identification numbers 001 to 006 and the number of stocks of the boxes B1 to B6 based on the inventory management table T1. The inventory management table received in step S14 or the relationship obtained in step S16 may be saved as a cache in the storage unit 12 in whole or in part. Further, the process of step S14 may be performed before step S10 or step S12, and all or a part of the inventory management slip may be stored in the storage unit 12 as a cache. As a result, the amount of communication with the server for each recognition can be reduced, and the response can be accelerated.

  Next, in step S <b> 18, the terminal 10 captures the specific images F <b> 1 to F <b> 6 determined based on the number of stocks (article information possessed by the article) that the boxes B <b> 1 to B <b> 6 have, It is displayed in the captured image so as to specify the position inside.

  In the example illustrated in FIG. 4, the specific images F1 to F6 have rectangular outlines and are displayed on the display unit 14 so as to overlap the images G1 to G6 of the respective two-dimensional codes. Each of the specific images F1 to F6 has the same translucent color.

  In addition, the number of products in stock in each box is displayed in the captured image in association with the specific images F1 to F6. Specifically, the stock quantity of each box is displayed inside the specific images F1 to F6. For example, in the specific image F1, the product inventory number 35 included in the box B1 identified by the identification number 001 is displayed and displayed on the display unit 14 so as to overlap the image G1 of the two-dimensional code including the identification number 001. The number of boxes B1 in stock can be recognized by the user. For other boxes, the number of products stored in the box can be recognized by the user.

  In this way, the specific images F1 to F6 are images determined based on the number of stocks that the boxes B1 to B6 have by displaying the number of stocks of the products that the boxes B1 to B6 have inside. Depending on the number of stocks to be made, the difference in the number of stocks in each box is immediately recognized by the user.

  In the example shown in FIG. 4, the specific image has a rectangular outline and the number of stocks is displayed inside, but the method of expressing the specific image has an article associated with the identification information. It is not limited to this as long as it is determined based on the article information. For example, the color, shape, position, and size of the specific image can be changed based on the article information. Furthermore, the color, shape, position, and size of the specific image may be changed based on the number of article information. For example, when all six correct two-dimensional codes in FIG. 4 are recognized, the specific image is changed to red to indicate that the correct six codes are recognized. The specific image may include characters.

  The color of the specific image may be opaque or translucent. Further, the color of the specific image may be changed to gradation.

  The shape of the specific image may be a rectangle (square), a triangle, or a circle. The specific image may have a shape like a balloon by extending a leader line from the image of the two-dimensional code.

  The position of the specific image is not particularly limited as long as it is within the captured image. For example, the specific image may be arranged so as to partially or entirely overlap with the image of the two-dimensional code. Further, the specific image may be arranged adjacent to the two-dimensional code image and at the upper right or upper left of the two-dimensional code image. Furthermore, the specific image may be arranged in the vertical direction at the right end of the captured image.

  The size of the specific image may be the same as the size of the image of the two-dimensional code. Further, the size of the specific image may be changed in correspondence with the size of the image of the two-dimensional code. The size of the specific image may be fixed based on the size of the captured image. Or you may determine the magnitude | size of a specific image combining the variation mentioned above.

  Further, the specific image may be stationary in the captured image as in the example illustrated in FIG. 4, but may have movement. For example, the specific image may blink in the captured image. Further, the specific image may vibrate within the captured image. Furthermore, the specific image may be rotated within the captured image. Further, this rotation may be performed according to the space of the two-dimensional code. Further, if the label shape is known in advance, the shape may be changed according to this.

  As described above, in the photographed image, the number of products in stock contained in the box, which is the item information of the item, is displayed in association with the specific image. Furthermore, information other than article information may be displayed in association with the specific image.

  For example, information included in the two-dimensional code may be displayed in association with the specific image. Specifically, the information that the two-dimensional code has includes an article name (for example, a box), a product name, and code information of the two-dimensional code. As code information, for example, the size of the code, in the case of a code in which a picture can be implanted, the presence or absence of an embedded picture, error correction information, the coordinates of the code in the photographed image (center coordinates, corner coordinates), stored in the database Code name, registration date, and issuer information. Further, the order of the positions where the two-dimensional code is displayed may be displayed in association with the specific image.

  In addition, an image or a moving image associated with information included in the two-dimensional code may be displayed in the captured image in association with the specific image.

  Furthermore, in association with a specific image, web content (web page, image or video) may be downloaded based on URL information included in the two-dimensional code and displayed in the captured image.

  Even if the font of the character included in the specific image or the character displayed in association with the specific image is set with an initial value, it is preferable that the setting can be appropriately changed from the viewpoint of improving the visibility of the user.

  In addition, when the specific image has a motion, it is preferable that the speed of the motion of the image can be appropriately changed from the viewpoint of improving the visibility of the user even if the speed of the image is set by the initial value.

  Next, in step S <b> 20, the terminal 10 changes the number of products in the box based on the user's operation on the specific image in the captured image.

  The user may take out a part of the product in the boxes B1 to B6 or perform a work such as adding a new product. Thus, when there is a change in the number of stocks of products included in the boxes B1 to B6, the user operates the terminal 10 to change the contents of the inventory management table. Here, a process when one product is added to the box B1 will be described below.

  As shown in FIG. 6, when the user touches the specific image F1 in the shooting screen displayed on the display unit 14 of the terminal 10, that is, touches the specific image F1 portion on the touch panel 13a, the specific image F1 is displayed. The processing contents are displayed in a cross shape on the top, bottom, left and right. A process of increasing the stock quantity by 1 is displayed on the right side of the specific image F1, a process of reducing the stock quantity by 1 is displayed on the left side of the specific image F1, and a process of increasing the stock quantity by 10 on the upper side of the specific image F1. Is displayed, and a process of reducing the stock quantity by 10 is displayed below the specific image F1.

  The user selects a process by an operation of sliding a fingertip placed on the specific image F1 of the touch panel 13a in any of the upper, lower, left and right directions of the specific image F1. Such an operation is an operation called a so-called flick input.

  Here, since the stock quantity of the product stored in the box B1 is increased by 1, the user slides the fingertip placed on the specific image F1 of the touch panel 13a in the right direction of the specific image F1 to determine the stock quantity. A process of increasing one is selected.

  As shown in FIG. 5B, the terminal 10 changes the number of stocks of the identification number 001 in the stock management table T1 from 35 to 36 based on the user's operation on the specific image F1 in the captured image.

  Further, as illustrated in FIG. 7, the terminal 10 changes the inventory quantity in the specific image F1 displayed on the display unit 14 from 35 to 36 based on the changed inventory management table T1. That is, the specific image F1 for specifying the position of the image G1 of the two-dimensional code including the identification number 001 is changed with a change in the number of products stored in the box B1 identified by the identification number 001. . Note that when the number of stocks in the specific image F1 is changed, the image of the specific image F1 may be changed (for example, the color of the specific image F1) to recognize that the stock number has changed. Further, the change in the image of the specific image F1 may be changed differently when the number of stocks increases and when the number decreases. Furthermore, the change in the image of the specific image F1 may be further changed in accordance with the amount of change in the stock quantity. For example, the specific image F1 may be darker as the stock quantity changes.

  In the example described above, an example in which the stock quantity is increased by one is shown. However, for example, when the number is increased by three, the fingertip placed on the specific image F1 of the touch panel 13a is moved in the right direction of the specific image F1. The operation of sliding may be repeated three times.

  Further, when the number of stocks is increased by 19, the operation of sliding the fingertip placed on the specific image F1 of the touch panel 13a in the direction above the specific image F1 is repeated twice, and then the left side of the specific image F1. The operation of sliding in the direction may be performed once.

  The process of changing the stock quantity to an arbitrary number can be operated by appropriately combining the four process contents.

  Moreover, in the example mentioned above, although the stock quantity of the product contained in box B1 was changed, the process which changes the stock quantity of the product contained in other boxes B2-B6 can be performed similarly.

  In addition, for example, when the number of products in the box B2 is originally changed, the number of products in the box B1 is changed by mistake, as shown in FIG. Can put the fingertips on the specific image F1 of the touch panel 13a for a predetermined time and perform a so-called long press to return the stock quantity of the box B1 to the original 35 pieces. Thereafter, an operation for the specific image F2 is performed in order to change the number of products in stock in the box B2.

  In the operation on the touch panel 13a described above, a specific image is operated by using a so-called flick input to change the number of boxes in the box which is the article information of the article. It is not limited.

  For example, operations such as double tap, drag, swipe, pinch in, and pinch out may be used as operations for a specific image using the touch panel 13a. Moreover, you may use operation which changes a several state cyclically by tapping a specific image like toggle input. Furthermore, an ON / OFF switching operation using a check box may be used.

  Further, the change contents for the article information may be different based on the time for tapping the specific image. For example, if the inventory quantity increases in proportion to the time the touch panel 13a and the user's finger are in contact, or if the touch panel 13a and the user's finger are in contact for a certain period of time, the change in the inventory quantity is reset. You may make it let it. In addition, the increase rate of the stock quantity may be changed according to the pressure of the user's finger on the touch panel 13a, or if the pressure of the user's finger on the touch panel 13a is equal to or greater than a predetermined value, the change in the stock quantity may be reset. good.

  Next, in step S <b> 22, the terminal 10 transmits the changed inventory management table T <b> 1 to the server 20 via the network N. The server 20 stores the received inventory management table T1 in the database 21 so that the updated contents of the inventory management table are synchronized with the inventory management table T1 stored in the database 21.

  According to the system of the present embodiment described above, a box associated with the stock quantity of two or more types of products is identified based on a photographed image obtained by photographing a plurality of two-dimensional codes including an identification number for identifying the box. The position of each image of the two-dimensional code including the identification number to be recognized can be recognized. In addition, the number of products in stock can be changed based on an operation on a specific image in the captured image.

  In the first embodiment described above, the terminal 10 receives the inventory management table stored in the database 21 and stores the changed inventory management table in the database 21 again. The inventory quantity may be directly changed with respect to the inventory management table stored in.

  In the first embodiment described above, the number of stocks is changed by operating a specific image. However, when processing is performed to uniformly increase the number of stocks of all boxes displayed in the captured image by one. Alternatively, a part other than the specific image in the captured image may be operated, for example, a flick operation may be performed so that the number of stocks of all boxes is increased by one. Similarly, a part other than the specific image in the captured image may be operated, for example, a flick operation may be performed so that the number of stocks of all boxes is reduced by one.

  In the first embodiment described above, a plurality of articles of the same type, ie, a box to which a two-dimensional code is attached, are photographed on one screen. You may shoot on the screen. Also in this case, the terminal specifies the position in the captured image of the recognized two-dimensional code, in the captured image displayed on the display unit, the specific image determined based on the product information of each different product. As shown in the captured image. For example, different types of articles, such as article A (sake) and article B (juice), are photographed on one screen, and article information (sake and juice) possessed by different types of articles A (sake) and article B (juice), respectively. The specific image determined based on the image is displayed in the captured image so as to identify the position of the recognized two-dimensional code in the captured image. For example, the article A (alcohol) is displayed as a rectangular image, and the article B (juice) is displayed as a circular image. Further, when the article A (alcohol) and the article B (juice) have the second article information associated with their identification information, the second article information is displayed in association with the specific image. It may be. For example, the inventory number (four) of the article A (liquor), which is the second article information, is displayed in association with a rectangular specific image for identifying the article A (liquor), and the circular shape for identifying the article B (juice) is displayed. You may make it display the stock quantity (ten) of the articles | goods B (juice) which are 2nd article information in relation with a specific image.

  Next, Modification 1 and Modification 2 of the system of the first embodiment described above will be described below.

  FIG. 9 is a diagram for explaining the processing of the first modification.

  The system of this modification also manages article information of articles using a two-dimensional code that is optical read information. Specifically, in this modified example, the box in which the product, which is an article, is received is in the “Received” state that has been received in the warehouse, and a delivery request is received for the box that has been received in the warehouse. In addition, there are three states (article information): a “waiting for delivery” state and a “delivered” state where the box is delivered from the warehouse.

  9, as in FIG. 4, four boxes are stacked side by side in the vertical and horizontal directions, and a two-dimensional code including identification information for identifying the box is attached to each box. The four boxes are arranged with the surface on which the two-dimensional code is attached facing in the same direction. The user uses the terminal 10 to photograph the two-dimensional code attached to each box.

  10A and 10B are diagrams for explaining the inventory management table T2 according to the first modification. FIG. 10A shows a state before the inventory status is changed, and FIG. 10B shows a state after the inventory status is changed. The inventory management table T2 is stored in the database 21.

  The four boxes are identified using identification numbers 001 to 004 as identification information. The state of the box identified by each identification number is managed by the state associated with the identification number. For example, in the example shown in FIG. 10A, the box having the identification number 001 is in the “waiting for delivery” state, and the box having the identification numbers 002 to 004 is in the “stored” state.

  Hereinafter, a main part of the operation of the terminal 10 will be described.

  The terminal 10 analyzes the captured image and recognizes identification information of the captured two-dimensional code. In this modified example, it is assumed that identification information of all two-dimensional codes is recognized. If the identification information of the photographed two-dimensional code is not in the inventory management table, the two-dimensional code is not recognized so that the identification information overlaps with the image of the two-dimensional code that was not recognized. A display (for example,? Mark) may be displayed.

  The terminal 10 receives the inventory management table T2 from the database 21 via the server 20 connected to the network N.

  The terminal 10 acquires the state of the box associated with the identification number that is the identification information, based on the received inventory management table T2. Specifically, the terminal 10 obtains the relationship between the box identified using the identification numbers 001 to 004 and the state of each box based on the inventory management table T2.

  As illustrated in FIG. 9, the terminal 10 identifies specific images F1 to F4 that are determined based on a state of the box (article information that the article has) in the captured image of the recognized two-dimensional code. Is displayed in the captured image.

  In the example illustrated in FIG. 9, the specific images F1 to F4 have a rectangular outline and are displayed on the display unit 14 so as to overlap the images G1 to G4 of the two-dimensional codes. For easy understanding, the display unit 14 shows only the images G1 to G4 of each two-dimensional code, and does not show the box image.

  The state of each box is displayed in the captured image in association with the specific images F1 to F4. Specifically, the state of each box is displayed inside the specific images F1 to F4. For example, in the specific image F1, the state of “waiting for delivery” of the box identified by the identification number 001 is displayed, and is displayed on the display unit 14 so as to overlap the image G1 of the two-dimensional code including the identification number 001. The state of the box is recognizable to the user. The color of the specific image F1 in the “waiting for delivery” state is displayed in a color different from that of the specific images F2 to F4 in the “stored” state, and the state of the box can be recognized by the user. It has become. Furthermore, the user may input a conditional sentence for the identification information or the article information through the terminal 10 or the like, and the display of the specific image may be changed according to the conditional sentence. For example, when a conditional statement “article information = waiting for delivery” is input, only the two-dimensional code in the “waiting for delivery” state may be displayed.

  The terminal 10 changes the state of the box based on the user's operation on the specific image in the captured image.

  When there is a change in the state of the box in which the product that is the article is stored, the user operates the terminal 10 to change the contents of the inventory management table. Here, a process in the case where the state of the box identified by the identification number 001 is changed from the “waiting for delivery” state to the “shipped” state will be described below.

  In this modified example, every time the part of the specific image on the touch panel 13a is tapped, the terminal 10 circulates and inputs the state of the box as “waiting for delivery” → “already delivered” → “already received”. It is made like that. So-called toggle input is used.

  As illustrated in FIG. 9, the user taps the specific image F1 in the shooting screen displayed on the display unit 14 of the terminal 10, that is, taps the specific image F1 portion on the touch panel 13a.

  As shown in FIG. 10B, the terminal 10 changes the status of the identification number 001 in the inventory management table T2 from “Waiting for delivery” to “Outgoing delivery” based on an operation on the specific image F1 in the captured image by the user. Change to

  In addition, the terminal 10 changes the color of the specific image F1 displayed on the display unit 14 to a color indicating a “shipped” state based on the changed inventory management table T2, and at the same time within the specific image F1. Displays the status of “issued”.

  The terminal 10 transmits the changed inventory management table T2 to the server 20 via the network N. The server 20 stores the received inventory management table T2 in the database 21 so that the updated contents of the inventory management table are synchronized with the inventory management table T2 stored in the database 21. The above is the description of the first modification.

  FIG. 11 is a diagram for explaining the processing of the second modification.

  The system of this modification also manages article information of articles using a two-dimensional code that is optical read information. Specifically, in this modified example, the box in which the product that is the article is stored has two states (article information): a state before confirmation of the inventory and a state of confirmation before the box is confirmed (article information). have.

  In FIG. 11, as in FIG. 4, four boxes are stacked in the vertical and horizontal directions, and a two-dimensional code including identification information for identifying the boxes is attached to each box. The four boxes are arranged with the surface on which the two-dimensional code is attached facing in the same direction. The user uses the terminal 10 to photograph the two-dimensional code attached to each box.

  12A and 12B are diagrams for explaining an inventory management table T3 according to the second modification. FIG. 12A shows a state before the inventory status is changed, and FIG. 12B shows a state after the inventory status is changed. The inventory management table T3 is stored in the database 21.

  The four boxes are identified using identification numbers 001 to 004 as identification information. The state of the box identified by each identification number is managed by the state associated with the identification number. For example, in the example shown in FIG. 12A, a box having identification numbers 001 to 003 is in a “before confirmation” state, and a box having an identification number 004 is in a “confirmed” state.

  Hereinafter, a main part of the operation of the terminal 10 will be described.

  The terminal 10 analyzes the captured image and recognizes identification information of the captured two-dimensional code. In this modified example, it is assumed that identification information of all two-dimensional codes is recognized.

  The terminal 10 receives the inventory management table T3 from the database 21 via the server 20 connected to the network N.

  The terminal 10 acquires the state of the box associated with the identification number that is identification information, based on the received inventory management table T3. Specifically, the terminal 10 obtains the relationship between the box identified using the identification numbers 001 to 004 and the state of each box based on the inventory management table T3.

  As illustrated in FIG. 11, the terminal 10 specifies the positions in the captured image of the recognized two-dimensional code from the specific images F <b> 1 to F <b> 4 that are determined based on the state of the box (article information that the article has). Is displayed in the captured image.

  In the example illustrated in FIG. 11, the specific images F1 to F4 have a rectangular outline and are displayed on the display unit 14 so as to overlap the images G1 to G4 of the two-dimensional codes. For easy understanding, the display unit 14 shows only the images G1 to G4 of each two-dimensional code, and does not show the box image.

  The state of each box is displayed in the captured image in association with the specific images F1 to F4. Specifically, the state of each box is displayed inside the specific images F1 to F4. For example, the state “before confirmation” of the box identified by the identification number 001 is displayed in the specific image F1, and is displayed on the display unit 14 so as to overlap the image G1 of the two-dimensional code including the identification number 001. The state of the box is recognizable to the user. The colors of the specific images F1 to F3 in the “before confirmation” state are displayed in colors different from those of the specific image F4 in the “confirmed” state, and the state of the box can be recognized by the user. It has become. In this way, the user can recognize that the inventory has already been performed for one of the four boxes photographed for the inventory by the user. Therefore, the user only has to perform the inventory work for the remaining three boxes in the “before confirmation” state.

  Therefore, the user performs an inventory work for the remaining three boxes in the “before confirmation” state.

  The terminal 10 changes the state of the box based on the user's operation on the specific image in the captured image.

  In this modified example, every time the specific image portion on the touch panel 13a is tapped, the terminal 10 circulates and inputs the state of the box “before confirmation” → “confirmed”. . So-called toggle input is used.

  As shown in FIG. 11, the user taps each of the specific images F1 to F3 in the shooting screen displayed on the display unit 14 of the terminal 10, that is, taps each of the specific images F1 to F3 on the touch panel 13a. To do.

  As illustrated in FIG. 12B, the terminal 10 changes the status of the identification numbers 001 to 003 in the inventory management table T3 from “before confirmation” to “confirmation” based on an operation on the specific image F1 in the captured image by the user. Change to "Done".

  Further, the terminal 10 changes the color of the specific images F1 to F3 displayed on the display unit 14 to a color indicating the “confirmed” state based on the changed inventory management table T3, and also the specific image. The “confirmed” state is displayed in F1 to F3.

  The terminal 10 transmits the changed inventory management table T3 to the server 20 via the network N. The server 20 stores the received inventory management table T3 in the database 21 so that the updated contents of the inventory management table are synchronized with the inventory management table T3 stored in the database 21. The above is the description of the second modification.

  Next, a second embodiment of the above-described system will be described below with reference to FIGS. For points that are not particularly described in the second embodiment, the description in detail regarding the first embodiment is applied as appropriate. Moreover, the same code | symbol is attached | subjected to the same component.

  FIG. 13 is a diagram in which a user terminal captures a plurality of two-dimensional codes in the second embodiment of the system disclosed in this specification.

  The user terminal 10 of the two-dimensional code captures the two-dimensional code C1 to C4 attached to the four documents D1 to D4, recognizes the identification information of the two-dimensional code, and stores it from the server 20 to the database 21. Received inventory management table. The terminal 10 changes the approval state of the document based on the user's operation, and the contents of the inventory management table are updated. The terminal 10 transmits the inventory management table whose contents are updated to the server 20. The server 20 stores the received inventory management table in the database 21, so that the contents of the updated inventory management table are synchronized with the inventory management table stored in the database 21.

  FIG. 14 is a flowchart for explaining the document approval process.

  First, the drafted document is in a “pending” state as shown in step S30. The document drafter applies to the first approver for approval of the document.

  Next, in step S32, the first approver determines whether to approve or reject the document that is in the “pending” state. The rejected document returns to step 32. On the other hand, the approved document changes to a state of “approval 1 processed”, and proceeds to the determination of the approval of the second approver in step S34.

  If the process proceeds to step 34, the second approver determines whether to approve or reject the document in the “Approved 1 Processed” state. The rejected document returns to before step 34. On the other hand, the approved document changes to the state of “Approval 2 Processed”, and proceeds to the determination of the approval of the final approver in step S36.

  If the process proceeds to step 36, the final approver determines whether to approve or reject the document in the “Approved 2 Processed” state. The rejected document returns to step 36. On the other hand, the approved document changes to a “final approval process completed” state, and the document application process is completed. As described above, the document has four states as the article information: “Applying” state, “Approval 1 processed” state, “Approval 2 processed” state, and “Final approval processed” state. .

  In the example shown in FIG. 13, four documents D1 to D4 are arranged side by side in the vertical and horizontal directions. Two-dimensional codes C1 to C4 including identification information for identifying the documents are affixed to the documents D1 to D4. The four documents D1 to D4 are arranged with the surface to which the two-dimensional codes C1 to C4 are attached facing the same direction (upward).

  Hereinafter, a main part of the operation of the terminal 10 will be described.

  The user who is the first approver uses the terminal 10 to photograph the two-dimensional codes C1 to C4 attached to the documents D1 to D4. The photographed two-dimensional codes C1 to C4 are displayed on the display unit 14 together with the attached documents D1 to D4.

  The terminal 10 analyzes the captured image and recognizes identification information of the captured two-dimensional code. In the present embodiment, it is assumed that the identification information of all the two-dimensional codes C1 to C4 has been recognized.

  The terminal 10 receives the inventory management table T4 from the database 21 via the server 20 connected to the network N.

  15A and 15B are diagrams for explaining the document management table T4. FIG. 15A shows the document state before the change, and FIG. 15B shows the document state after the change.

  The four documents D1 to D4 are identified using identification numbers 001 to 004 as identification information. The document identified by each identification number is managed according to the document status shown in the document management table T4. For example, in the example shown in FIG. 15A, the document D1 having the identification number 001 is in the “pending” state, and the document D2 having the identification number 002 is in the “approved 1 processed” state. The document D3 having the identification number 003 is in the “approval 2 processed” state, and the document D4 having the identification number 004 is in the “final approval processed” state.

  The terminal 10 acquires the state of the document associated with the identification number that is identification information based on the received inventory management table T4. Specifically, the terminal 10 obtains the relationship between the documents D1 to D4 identified using the identification numbers 001 to 004 and the states of the documents D1 to D4 based on the document management table T4.

  The terminal 10 specifies the positions in the captured images of the recognized two-dimensional codes C1 to C4 with respect to the specific images F1 to F4 that are determined based on the states (article information that the article has) of the documents D1 to D4. Display in the captured image.

  In the example illustrated in FIG. 13, the specific images F1 to F4 have a rectangular outline and are displayed on the display unit 14 so as to overlap the images G1 to G4 of the two-dimensional codes.

  The states of the documents D1 to D4 are displayed in the captured image in association with the specific images F1 to F4. Specifically, the states of the documents D1 to D4 are displayed inside the specific images F1 to F4. For example, in the specific image F1, the “pending” state of the document identified by the identification number 001 is displayed and displayed on the display unit 14 so as to overlap the image G1 of the two-dimensional code including the identification number 001. The state of the document to be recognized is recognizable to the user. The color of the specific image differs depending on the state of the document. The color of the specific image F1 in the “pending” state is different from the colors of the specific images F2 to F4 in the other “approved 1 processed”, “approved 2 processed”, and “final approved processed” states. The document state is recognizable to the user who is the first approver.

  Therefore, the user who is the first approver looks at the image displayed on the display unit 14, and the document D1 indicated by the specific image F1 in which the document to be judged is “pending” is displayed. It is possible to recognize that there is. The terminal 10 excludes the operated specific image from the operation target based on the operation by the user who is the first approver for the specific image other than the specific image F1 in the “pending” state. May be.

  The user who is the first approver determines whether to approve or reject the document D1. Here, it is assumed that a decision to approve the document D1 is made.

  The terminal 10 changes the state of the document based on an operation on a specific image in the captured image by the user who is the first approver.

  In this modified example, each time the specific image F1 portion on the touch panel 13a is tapped, the terminal 10 circulates and inputs the state of the document as “Applying” → “Approval 1 processed”. Has been made. So-called toggle input is used. When the user who is the first approver makes a decision to reject the document D1, the state of the document remains “pending” and is not changed.

  When the user is the second approver, every time the part of the specific image F2 on the touch panel 13a is tapped, the state of the document cycles from “approved 1 processed” → “approved 2 processed”. To be input. If the user is the final approver, every time the specific image F2 on the touch panel 13a is tapped, the document status changes from “Approved 2 processed” → “Final approved processed”. It is designed to be input in a circulating manner.

  As shown in FIG. 16, the user who is the first approver taps the specific image F1 in the shooting screen displayed on the display unit 14 of the terminal 10, that is, the specific image F1 on the touch panel 13a. Tap.

  As shown in FIG. 15B, the terminal 10 changes the status of the identification number 001 in the document management table T4 from “Applying” to “Approval 1 processing” based on the user's operation on the specific image F1 in the captured image. Change to "Done".

  Further, the terminal 10 changes the color of the specific image F1 displayed on the display unit 14 to a color indicating the state of “approved 1 processed” based on the changed inventory management table T4, and also the specific image The status of “Approval 1 processed” is displayed in F1.

  The operation on the specific image may be different based on the state of the document that is the article information. For example, a change from “Applying” to “Approved 1 processed” is performed by an operation of tapping a specific image. In addition, a change from “Approved 1 Processed” to “Approved 2 Processed” is performed by flicking the specific image. In addition, a change from “Approved 2 Processed” to “Final Approved Processed” may be performed by a double tap operation on a specific image.

  The terminal 10 transmits the changed document management table T4 to the server 20 via the network N. The server 20 stores the received document management table T4 in the database 21 so that the contents of the updated document management table are synchronized with the document management table T4 stored in the database 21.

  According to the system of the present embodiment described above, documents associated with two or more types of document states are identified based on captured images obtained by photographing a plurality of two-dimensional codes including identification numbers for identifying documents. The position of each image of the two-dimensional code including the identification number can be recognized. Further, the state of the document can be changed based on an operation on a specific image in the captured image.

  In each of the above-described embodiments and modifications, the user captures a plurality of two-dimensional codes by holding the terminal 10 with one hand. Therefore, the user is not necessarily captured in a stationary state so as to face the two-dimensional code. Is not limited. Since the terminal 10 repeatedly performs imaging and recognition processing of a plurality of two-dimensional codes at a predetermined interval, the terminal 10 is recognized in the previous imaging due to shaking of the hand holding the terminal or a change in imaging angle. The two-dimensional code may not be recognized in the next shooting.

  Therefore, the terminal 10 estimates and displays the specific image that specifies the position of the two-dimensional code that has not been recognized based on the position of the two-dimensional code that was recognized in the previous shooting. Hereinafter, this process will be described with reference to the drawings.

  FIG. 17 is a diagram illustrating the estimation of the position of the two-dimensional code in the captured image.

  In photographing at time T = t0, four two-dimensional codes are photographed and four two-dimensional codes are recognized. On the display unit 14 of the terminal 10, four two-dimensional code images G <b> 1 to G <b> 4 are displayed together with the image of the article to which the two-dimensional code is attached.

  Next, it is assumed that in the photographing at time T = t1, four two-dimensional codes are photographed and three of the four two-dimensional codes are recognized. Assume that three two-dimensional code images G1 to G3 are recognized, but a two-dimensional code image G4 is not recognized.

  The terminal 10 changes the position of the two-dimensional code image G2 closest to the position of the two-dimensional code image G4 in the previous photographed image with respect to the two-dimensional code image G4 that was recognized last time but not recognized this time. Based on this, the position of the image G4 of the two-dimensional code not recognized this time is estimated.

  The coordinates representative of the position of the image G2 of the two-dimensional code in the captured image are (Xa0, Ya0) at time T = t0, and the coordinates representative of the position of the image G4 of the two-dimensional code are at time T = t0. Assume that (Xb0, Yb0).

  At time T = t1, it is assumed that the coordinates representative of the position of the two-dimensional code image G2 have changed to (Xa1, Ya1).

  The terminal 10 obtains ΔXa = Xa1-Xa0 and ΔYa = Ya1-Xa0 as changes in the coordinates of the position of the two-dimensional code image G2 from time T = t0 to T = t1.

  The terminal 10 obtains Xb1 = Xb0 + ΔXa and Yb1 = Yb0 + ΔYa as the positions of the two-dimensional code image G4 at time T = t1.

  And the terminal 10 displays the specific image which specifies the position of the image G4 so that the position (Xb1, Yb1) which estimated the image G4 of the two-dimensional code which could not be recognized is specified.

  The above-described processing can be performed for a predetermined period from the time when the two-dimensional code cannot be recognized. For a two-dimensional code that is not recognized even after a predetermined period, the estimation of the position of the two-dimensional code and the display of the specific image may be stopped.

  In the present invention, the above-described embodiment method, apparatus, and program can be appropriately changed without departing from the gist of the present invention. In addition, the configuration requirements of one embodiment or modification can be applied to other embodiments as appropriate.

  In each of the embodiments and modifications described above, a two-dimensional code is used as the optical reading information. However, the optical reading information is not limited to the two-dimensional code. The optical reading information is not particularly limited as long as it is optically read information, and includes, for example, character information recognized by a one-dimensional code, a digital watermark, and OCR.

DESCRIPTION OF SYMBOLS 1 System 10 Terminal 11 Calculation part 12 Storage part 13 Operation part 13a Touch panel 13b Button 14 Display part 15 Image acquisition part 16 Communication part 20 Server 21 Database 30 Terminal 31 Issuing part N Network B, B1-B6 Box D1-D4 Document C, C1-C6 Two-dimensional code G1-G6 Two-dimensional code image F1-F6 Specific image

Claims (8)

Recognizing the identification information of the plurality of optical reading information based on a photographed image obtained by photographing a plurality of optical reading information including identification information for identifying an article;
A specific image for identifying a position in the captured image of the optical reading information in which the identification information is recognized, and the specific image determined based on article information included in an article associated with the identification information Displayed in the image,
A method in which the article information of an article is two or more types.   The method according to claim 1, wherein the article information is changed based on an operation on the specific image.   The method according to claim 2, wherein the operation on the specific image is different based on the article information.   The method according to claim 1, wherein the article information is displayed in the captured image in association with the specific image.   The method according to claim 4, wherein the article information is displayed in the specific image.   The method according to any one of claims 1 to 5, wherein second article information included in an article associated with the identification information is displayed in the captured image in association with the specific image. An image acquisition unit that acquires a captured image by capturing a plurality of pieces of optical reading information including identification information for identifying an article;
A display unit for displaying the acquired captured image;
A storage unit that associates and stores the identification information and article information that the article has;
Recognizing the identification information of a plurality of the optical reading information;
A specific image for identifying a position in the captured image of the optical reading information in which the identification information is recognized, and the specific image determined based on article information included in an article associated with the identification information An arithmetic unit to be displayed in the image;
With
The device has two or more types of product information. Recognizing the identification information of the plurality of optical reading information based on a photographed image obtained by photographing a plurality of optical reading information including identification information for identifying an article;
A specific image for identifying a position in the captured image of the optical reading information in which the identification information is recognized, and the specific image determined based on article information included in an article associated with the identification information Displayed in the image,
A program that causes a computer to execute that the item information of an item is two or more types.

Images