WO2016052383A1 - 情報処理装置、制御方法、及びプログラム - Google Patents
情報処理装置、制御方法、及びプログラム Download PDFInfo
- Publication number
- WO2016052383A1 WO2016052383A1 PCT/JP2015/077268 JP2015077268W WO2016052383A1 WO 2016052383 A1 WO2016052383 A1 WO 2016052383A1 JP 2015077268 W JP2015077268 W JP 2015077268W WO 2016052383 A1 WO2016052383 A1 WO 2016052383A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- product
- shelf
- shelf label
- relationship
- information processing
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/08—Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
- G06Q10/087—Inventory or stock management, e.g. order filling, procurement or balancing against orders
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
- B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
- B65G1/00—Storing articles, individually or in orderly arrangement, in warehouses or magazines
- B65G1/02—Storage devices
- B65G1/04—Storage devices mechanical
- B65G1/137—Storage devices mechanical with arrangements or automatic control means for selecting which articles are to be removed
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
Definitions
- the present invention relates to an information processing apparatus, a control method, and a program.
- shelf tags with information such as product names and prices are attached near the products.
- systems that support the management of such shelf labels have been developed.
- Japanese Patent Laid-Open No. 2004-228688 manages shelf labels by capturing and recognizing the shelf label identification information of each shelf label with a camera in a situation where a shelf label displaying product information and shelf label identification information is attached to the product shelf.
- a system is disclosed. Specifically, this system generates a map indicating the position of each shelf label, or detects and notifies a shelf label that has expired.
- Patent Literature 1 does not disclose a technique for managing the consistency of the relationship between the number and position between a shelf label and a product.
- An object of the present invention is to provide a technique for supporting confirmation of the arrangement of products or shelf labels.
- the information processing apparatus includes product recognition means for recognizing the number of product types or the position of the product for each type from an image of products and shelf labels, and information on each product from the image.
- product recognition means for recognizing the number of product types or the position of the product for each type from an image of products and shelf labels, and information on each product from the image.
- a shelf label recognizing means for recognizing the number or position of a shelf label to be displayed, the relationship between the number of recognized product types and the number of shelf labels, or the position of the product and the position of the shelf label for each recognized type.
- Determining means for determining whether or not there is an error in the relationship.
- the control method provided by the present invention is executed by a computer.
- the control method includes a product recognition step for recognizing the number of types of products or the position of the product for each type from the images of the products and shelf labels, and the number of shelf labels indicating information on each product from the images. Or, there is an error in the shelf label recognition step for recognizing the position and the relationship between the number of recognized product types and the number of shelf labels, or the relationship between the product position for each recognized type and the position of the shelf label. And a determination step of determining whether or not there is.
- the program provided by the present invention causes a computer to have a function of operating as an information processing apparatus provided by the present invention.
- 1 is a block diagram illustrating an information processing apparatus according to a first embodiment.
- 3 is a flowchart illustrating a flow of processing executed by the information processing apparatus according to the first embodiment. It is a block diagram which illustrates the hardware constitutions of the computer which implement
- FIG. 6 is a block diagram illustrating an information processing apparatus according to a second embodiment. 6 is a flowchart illustrating a flow of processing performed by the information processing apparatus according to the second embodiment.
- FIG. 1 is a block diagram illustrating an information processing apparatus 2000 according to the first embodiment.
- arrows indicate the flow of information.
- each block represents a functional unit configuration, not a hardware unit configuration.
- the information processing apparatus 2000 includes a product recognition unit 2020, a shelf label recognition unit 2040, and a determination unit 2060.
- the product recognition unit 2020 recognizes the number of types of products or the position of the product for each type from an image (hereinafter referred to as a target image) in which the products and shelf labels are captured.
- “recognizing the number of product types” means that when a plurality of products of the same type are placed adjacent to each other, the group of products of the same type is recognized as one. For example, it is assumed that the product A is arranged in 3 rows, the product B in 2 rows, and the product C in 2 rows. In this case, the number of product types is three.
- a group of the same type of products arranged adjacent to each other in this way is referred to as a product group. Note that the number of products included in the product group may be one.
- the position of the product for each type means the position of the product group. More specifically, as described above, when the product A is arranged in three rows, the product B in two rows, and the product C in two rows, the position of the product group of the product A, Each of the position and the position of the product group of the product C is the “position of the product for each type”. A specific method of expressing the “product group position” will be described later.
- the shelf label recognition unit 2040 recognizes the number or position of the shelf label indicating the information of each product from the target image.
- the determination unit 2060 determines the relationship between the number of recognized product types (the number of product groups) and the number of shelf labels, or the relationship between the product position (product group position) and the shelf label position for each type. Determine the error.
- FIG. 2 is a flowchart illustrating the flow of processing executed by the information processing apparatus 2000 according to the first embodiment.
- the information processing apparatus 2000 acquires the target image (S102).
- the product recognition unit 2020 recognizes the number or position of product groups from the target image (S104).
- the shelf label recognition unit 2040 recognizes the number or position of the shelf labels from the target image (S106).
- the determination unit 2060 determines an error in the relationship between the number of recognized product groups and the number of shelf labels, or the relationship between the position of recognized product groups and the position of shelf labels (S108).
- An error in the relationship between (the position of the product for each type) and the position of the shelf label is determined. Therefore, if there is an error in the relationship between the number of product groups and the number of shelf labels, or the relationship between the position of the product group and the location of the shelf label, a store clerk corrects the number or location of the shelf label or product group.
- the relationship between the shelf label and the product group can be made appropriate. For specific situations in which the relationship between the number of product groups and the number of shelf labels is incorrect or the relationship between the position of product groups and the location of shelf labels is incorrect, a specific example will be given later. To explain.
- Each functional component of the information processing apparatus 2000 may be realized by hardware (eg, a hard-wired electronic circuit) that implements each functional component, or a combination of hardware and software (eg: It may be realized by a combination of an electronic circuit and a program for controlling it).
- hardware eg, a hard-wired electronic circuit
- software eg: It may be realized by a combination of an electronic circuit and a program for controlling it.
- the information processing apparatus 2000 is realized as various computers such as a portable terminal, a PC (Personal Computer), or a server.
- the information processing apparatus 2000 may be realized by a dedicated computer for mounting the information processing apparatus 2000, or may be realized by a general-purpose computer that operates other applications and the like.
- FIG. 3 is a block diagram illustrating a hardware configuration of a computer 5000 that implements the information processing apparatus 2000.
- the computer 5000 includes a bus 5020, a processor 5040, a memory 5060, a storage 5080, and an input / output interface 5100.
- the bus 5020 is a data transmission path through which the processor 5040, the memory 5060, the storage 5080, and the input / output interface 5100 transmit / receive data to / from each other.
- the method of connecting the processors 5040 and the like to each other is not limited to bus connection.
- the processor 5040 is an arithmetic processing device such as a CPU (Central Processing Unit) and a GPU (Graphics Processing Unit).
- the memory 5060 is a memory such as a RAM (Random Access Memory) or a ROM (Read Only Memory).
- the storage 5080 is a storage device such as a hard disk, SSD (Solid State Drive), or memory card.
- the storage 5080 may be a memory such as a RAM or a ROM.
- the input / output interface 5100 is an input / output interface for the computer 5000 to transmit / receive data to / from an external device or the like.
- the computer 5000 that implements the information processing apparatus 2000 is connected to the external apparatus via the input / output interface 5100.
- this connection is a bus connection via a bus line (for example, a USB (Universal Serial Bus) line) or a network connection via a network line.
- the network line may be a wireless line or a wired line.
- the storage 5080 stores a program for realizing the functions of the information processing apparatus 2000. Specifically, program modules that realize the functions of the product recognition unit 2020, the shelf label recognition unit 2040, and the determination unit 2060 are stored.
- the processor 5040 implements the functions of the product recognition unit 2020, the shelf label recognition unit 2040, and the determination unit 2060 by executing these program modules.
- the processor 5040 may execute the modules after reading them onto the memory 5060 or without reading them onto the memory 5060.
- each program module may be stored in the memory 5060.
- the computer 5000 may not include the storage 5080.
- the target image is captured by a camera installed in a store or the like.
- a camera installed in a store or the like.
- only one type of product or one shelf label may be shown, or a plurality of different products or a plurality of shelf labels may be shown.
- the information processing apparatus 2000 acquires a target image stored in the camera.
- the information processing apparatus 2000 may acquire the target image from the storage device.
- the camera may be configured to store the captured target image in a storage device provided inside the information processing apparatus 2000. In this case, the information processing apparatus 2000 acquires a target image from a storage unit provided inside the information processing apparatus 2000.
- the camera may be provided integrally with a computer that implements the information processing apparatus 2000 or may be provided outside the computer.
- the information processing apparatus 2000 may be implemented as a mobile terminal with a camera. In this case, the information processing apparatus 2000 processes the target image captured by the camera of the mobile terminal.
- the product recognition unit 2020 recognizes a product by analyzing the target image.
- a technique for recognizing an object such as a product shown in an image is a known technique, and various known techniques can be used for object recognition.
- processing performed by the product recognition unit 2020 will be described.
- FIG. 4 is a diagram illustrating the target image 10.
- the target image 10 shows a product shelf on which products are displayed. Note that the target image only needs to include the product and the shelf label, and the display method of the product is not limited to the method of displaying on the product shelf.
- the outer frame 20 is an outer frame of the product shelf.
- the shelf board 30 is a board on which products are placed.
- the product group 40 represents a product group.
- Three product groups are shown in the target image 10 of FIG.
- the shelf label 50 is a tag that displays product information. In the target image 10 of FIG. 4, three shelf labels are shown.
- the shelf label 50 may be a shelf label made of an analog medium such as paper, or may be a shelf label made of an electronic medium.
- the product recognition unit 2020 recognizes a product from the target image 10. Then, the product recognition unit 2020 recognizes a group of products that are adjacent and have similar feature quantities among the recognized products as one product group 40. For example, the product group 40-1, the product group 40-2, and the product group 40-3 are recognized from the target image 10 in FIG.
- the product recognizing unit 2020 classifies each product into the product group 40 by comparing feature quantities of adjacent products in order from either the left or right. Specifically, the product recognition unit 2020 categorizes those products into the same product group 40 when the feature quantities of adjacent products are the same or similar. On the other hand, if the feature quantities of adjacent products are not similar, the product recognition unit 2020 classifies the products into different product groups 40.
- the product recognition unit 2020 compares the feature quantities of the products placed on the shelf 30-1 in order from the left. First, the product recognition unit 2020 determines that the feature values of the first product and the second product are similar, and classifies the first product and the second product into the same product group 40-1. Similarly, the product recognition unit 2020 determines that the feature values of the second and third products are similar, and also classifies the third product into the product group 40-1. On the other hand, as a result of comparing the feature values of the third product and the fourth product, the product recognition unit 2020 determines that these feature values are not similar. As a result, the fourth product is classified into a product group 40-2, which is a product group different from the product group 40-1.
- the product recognizing unit 2020 does not need to grasp the feature amount of each product in advance. Therefore, computer resources necessary for realizing the information processing apparatus 2000 can be reduced.
- the product recognition unit 2020 may recognize the product group 40 using information (hereinafter, product information) in which a product is associated with a feature amount that represents an appearance feature of the product.
- product information is stored in advance in a storage unit provided inside or outside the information processing apparatus 2000.
- the product recognition unit 2020 acquires product information from the storage unit.
- Product information associates one or more feature quantities with one product.
- these feature amounts are feature amounts representing the features of the product viewed from different directions.
- Some products have a very different appearance depending on the viewing direction. For example, there is a product in which the pattern of the label attached to the product is greatly different between when viewed from one direction and when viewed from another direction. Since the displayed products are not always displayed in the same direction, in the case of a product whose appearance differs greatly depending on the viewing direction, the product extracted from the target image is the same product even if it is the same product.
- the feature amount may not be similar.
- the product recognition unit 2020 determines the product corresponding to each calculated feature value by comparing the feature value of each product calculated from the target image 10 with the feature value indicated in the product information. Then, the product recognition unit 2020 classifies adjacent products that are the same product into the same product group 40.
- the product recognition unit 2020 recognizes the number of product groups 40 by counting the number of recognized product groups 40.
- the product recognition unit 2020 recognizes the coordinates on the target image 10 of each product group 40 as the position of the product group 40.
- the coordinates of the product group 40 are coordinates that match a predetermined condition in the region representing the product group 40.
- this condition is the center, left end, or right end of the region representing the product group 40.
- the merchandise recognition unit 2020 may represent the position of the merchandise group 40 with two-dimensional coordinates (a combination of the horizontal direction and the vertical direction) or with one-dimensional coordinates (horizontal direction coordinates).
- the shelf label recognition unit 2040 analyzes the target image and recognizes the shelf label.
- the shelf label recognition unit 2040 can use various existing technologies for recognizing an object from an image.
- an example of processing performed by the shelf label recognition unit 2040 will be exemplified.
- the shelf label recognition unit 2040 recognizes the shelf label 50 by acquiring information indicating the feature value of the shelf label 50 and recognizing an object that matches the feature value from the target image.
- the feature amount of the shelf label 50 is stored in advance in a storage unit provided inside or outside the information processing apparatus 2000.
- the shelf label recognition unit 2040 may recognize an area representing the shelf board 30 and recognize an object having a predetermined shape (such as a rectangle) included in the area representing the shelf board 30 as the shelf label 50.
- the shelf label recognition unit 2040 recognizes the shelf board 30 by, for example, acquiring and using a feature amount representing the shelf board 30.
- the predetermined shape representing the shelf label 50 and the feature amount of the shelf board 30 are stored in advance in a storage unit provided inside or outside the information processing apparatus 2000.
- the shelf label recognition unit 2040 recognizes the number of shelf labels 50 by counting the number of shelf labels 50 recognized by the above-described method.
- the method by which the shelf label recognition unit 2040 recognizes the position of the shelf label 50 is the same as the method by which the product recognition unit 2020 recognizes the position of the product group 40.
- the determination unit 2060 determines an error in the relationship between the number of recognized product groups 40 and the number of shelf labels 50 or the relationship between the position of the product group 40 and the position of the shelf label 50.
- the determination unit 2060 compares the number of product groups 40 with the number of shelf labels 50. For example, when the number of the product groups 40 and the number of the shelf labels 50 do not match, the determination unit 2060 determines that the relationship between these numbers is incorrect.
- the determination unit 2060 determines that the relationship between the number of product groups 40 and the number of shelf labels 50 is correct.
- FIG. 5 is a first diagram illustrating a target image representing a state in which there is an error in the number relationship.
- the number of product groups 40 is 3, while the number of shelf labels 50 is 2. Therefore, the determination unit 2060 determines that the relationship between the number of product groups 40 and the number of shelf labels 50 is incorrect. For example, the situation shown in FIG. 5 occurs when the user forgets to add the shelf label 50-3 or drops the shelf label 50-3 even though the product of the product group 40-3 is newly displayed. Can happen. By using the determination result by the determination unit 2060, the store clerk and the like can grasp that such a situation is occurring.
- FIG. 6 is a second diagram illustrating a target image representing a state in which there is an error in the number relationship.
- the number of product groups 40 is 2, while the number of shelf labels 50 is 3.
- the determination unit 2060 determines that the relationship between the number of product groups 40 and the number of shelf labels 50 is incorrect. For example, the user has forgotten to remove the shelf label 50-3 despite stopping the display of the product in the product group 40-3, or added the shelf label 50-3 to display a new product in the product group 40-3.
- the situation shown in FIG. 6 may occur when the user forgets to add a product or the product in the product group 40-3 is sold out.
- the store clerk and the like can grasp that such a situation is occurring.
- the determination unit 2060 determines that the relationship between the position of the product group 40 and the position of the shelf label 50 is incorrect.
- the predetermined direction is, for example, up, down, left, or right.
- the determination unit 2060 determines that the relationship between the position of the product group 40 and the position of the shelf label 50 is incorrect if there is no shelf label 50 on the product group 40. It is determined that
- the processing performed by the determination unit 2060 will be specifically described with reference to FIGS. In these drawings, it is assumed that the shelf label 50 is attached under the product group 40.
- the determination unit 2060 determines that the relationship between the position of the product group 40 and the position of the shelf label 50 is correct.
- FIG. 7 is a diagram exemplifying a target image representing a state in which there is an error in the positional relationship.
- the determination unit 2060 determines that the relationship between the position of the product group 40 and the position of the shelf label 50 is incorrect.
- FIG. 8 is a diagram illustrating a target image representing a state in which a shelf label is located at the boundary between two product groups.
- the shelf label 50 is located at the boundary between two product groups 40-1 and 40-2.
- the determination unit 2060 needs to determine that the shelf label is under one of the product groups.
- the determination result by the determination unit 2060 differs depending on which product group 40 the shelf label 50 is considered to be located under. If it is determined that the shelf label 50 is under the product group 40-1, the shelf label 50 is attached under each product group 40. Therefore, the determination unit 2060 determines that the relationship between the position of the product group 40 and the position of the shelf label 50 is correct. On the other hand, if it is judged that the shelf label 50 is under the product group 40-2, the shelf label 50 is not under the product group 40-1. Therefore, the determination unit 2060 determines that the relationship between the position of the product group 40 and the position of the shelf label 50 is incorrect.
- FIG. 9 is an enlarged view of the vicinity of the boundary between the product group 40-1 and the product group 40-2 in FIG. In order to make the drawing easier to see, the description of the shelf label 50-1 is omitted.
- the horizontal distance between the right end of the product group 40-1 and the center of the shelf label 50-1 is d1.
- the horizontal distance between the left end of the product group 40-2 and the center of the shelf label 50-1 is d2.
- d2 is smaller than d1, it can be said that the product group 40-2 is located closer to the shelf label 50-1 than the product group 40-1. Therefore, the determination unit 2060 determines that the shelf label 50-1 is under the product group 40-2.
- the determination unit 2060 determines that the relationship between the position of the product group 40 and the position of the shelf label 50 is incorrect.
- the determination unit 2060 may consider which product group 40 and which shelf label 50 are included in the same stage. Specifically, the determination unit 2060 limits the products and shelf labels to be determined whether there is no error in the positional relationship or the number relationship to the products and shelf labels included in the same level.
- the product group 40 corresponding to the shelf label 50 is placed on the shelf label 50, but there is also a display method in which the product group 40 corresponding to the shelf label 50 is placed under the shelf label 50. That is, a certain level of the product shelf is 1) an area including the shelf board 30 and the product group 40 placed on the shelf board 30, or 2) placed under the shelf board 30 and the shelf board 30. It becomes an area including the merchandise group 40.
- the determination unit 2060 should recognize 1) or 2) as a step is set in advance. For example, information for specifying whether 1) or 2) should be recognized as a stage (information indicating whether the shelf label 50 is attached above or below the product group 40) is stored in the information processing apparatus 2000. Alternatively, it is stored in advance in a storage unit provided outside.
- the merchandise recognizing unit 2020 refers to this information and determines an area to be recognized as one stage. Then, the product recognition unit 2020 determines the relationship between the product group 40 and the shelf label 50 included in the same level.
- the determination unit 2060 may determine that the relationship between the position of the product group 40 and the position of the shelf label 50 is incorrect when there is no shelf label 50 within a predetermined distance from a certain product group 40. In this case, it is assumed that the predetermined distance is stored in an internal or external storage unit of the information processing apparatus 2000. Furthermore, the determination unit 2060 may consider both the direction and the distance. Specifically, for each product group 40, the determination unit 2060 is a shelf label that satisfies the condition that “the product group 40 is in a predetermined direction and the distance to the product group 40 is a predetermined distance or less”. When there is no 50, it is determined that the positional relationship between the product group 40 and the shelf label 50 is incorrect.
- the determination unit 2060 may determine an error in the relationship between the product group 40 and the shelf label 50 by paying attention to both the number relationship and the position relationship. This will be specifically described with reference to FIG.
- the determination unit 2060 determines an error in the relationship between the position of the commodity group 40 and the position of the shelf label 50 in the situation of FIG. 5, it is determined that the positional relationship is incorrect. This is because there is no shelf label 50 under the product group 40-3.
- the situation of FIG. 5 is “there is no error in the positional relationship and there is an error in the number relationship”.
- the determination unit 2060 determines whether or not there is an error in the relationship between the position of the product group 40 and the position of the shelf label 50 only when the relationship between the number of product groups 40 and the number of shelf labels 50 is correct. You may do it. A flow chart illustrating the flow of this processing is shown in FIG.
- the information processing apparatus 2000 acquires the target image (S202).
- the product recognition unit 2020 recognizes the number and position of the product group 40 from the target image (S204).
- the shelf label recognition unit 2040 recognizes the number and position of the shelf labels 50 from the target image (S206).
- the determination unit 2060 compares the number of product groups 40 with the number of shelf labels 50 (S208).
- step S212 the determination unit 2060 determines that there is an error in the relationship between the number of product groups 40 and shelf labels 50.
- step S214 the determination unit 2060 compares the position of the product group 40 with the position of the shelf label 50. If there is a merchandise group 40 that does not have a corresponding shelf label 50 (S216: YES), the process of FIG. 10 proceeds to step S218. In step S218, the determination unit 2060 determines that there is an error in the positional relationship between the product group 40 and the shelf label 50. On the other hand, when there is no product group 40 that does not have the corresponding shelf label 50 (S216: NO), the process of FIG. 10 ends.
- the determination result by the determination unit 2060 becomes more accurate by performing determination using both the number relationship and the position relationship.
- Timing at which information processing apparatus 2000 executes processing There are various timings at which the information processing apparatus 2000 executes the processes described above. For example, the information processing apparatus 2000 periodically performs processing. In this case, the date and time of execution and the cycle are set in the information processing apparatus 2000 in advance. Further, for example, the information processing apparatus 2000 may execute processing at a timing when an operation by a store clerk or the like is received. Furthermore, the information processing apparatus 2000 may execute processing at the timing when the target image is generated or when the target image is acquired.
- FIG. 11 is a block diagram illustrating an information processing apparatus 2000 according to the second embodiment.
- arrows indicate the flow of information.
- each block represents a functional unit configuration, not a hardware unit configuration.
- the information processing apparatus 2000 includes a notification unit 2080.
- the notification unit 2080 performs notification or display when an error is determined by the determination unit 2060. By performing notification or display in this manner, a clerk or the like can easily grasp the determination result by the determination unit 2060.
- FIG. 12 is a flowchart illustrating the flow of processing performed by the information processing apparatus 2000 according to the second embodiment.
- steps S102 to S108 are the same as those in the flowchart of FIG.
- the process of FIG. 12 branches in step S302. Specifically, when it is determined in step S108 that there is no error in the number or position relationship between the product group 40 and the shelf label 50 (step S302: NO), the processing in FIG. 12 ends. On the other hand, if it is determined in step S108 that there is an error in the number or position relationship between the merchandise group 40 and the shelf label 50 (step S302: YES), the processing in FIG. 12 proceeds to step S304. In step S304, the notification unit 2080 notifies or displays that there is an error in the number or position relationship between the product group 40 and the shelf label 50.
- a store clerk or the like in a store where the information processing device 2000 is installed may directly use the information processing device 2000, or another terminal (hereinafter referred to as a user terminal) connected to the information processing device 2000 so as to be communicable. May be used.
- the user terminal is a portable terminal carried by each store clerk.
- the notification unit 2080 is configured to receive information when the determination unit 2060 determines that the number or position relationship between the product group 40 and the shelf label 50 is incorrect. That effect is displayed on a display screen connected to the processing device 2000.
- the information processing apparatus 2000 makes a determination with respect to the user terminal when it is determined that the number or position relationship between the product group 40 and the shelf label 50 is incorrect.
- the determination result by the unit 2060 is notified.
- the user terminal displays the determination result on the display screen of the user terminal.
- the notification unit 2080 may perform both display on the information processing apparatus 2000 and notification to the user terminal.
- the processing performed by the information processing device 2000 and the user terminal when it is determined that the number or position relationship between the product group 40 and the shelf label 50 is incorrect is not limited to output on the display screen.
- the information processing apparatus 2000 or the user terminal may output a sound notifying that an error has been determined or perform a process of turning on a light.
- the notification unit 2080 may perform not only notification or display of “there is an error” but also notification or display of “what kind of error is present”. For example, the notification unit 2080 notifies information specifying a place (product shelf, stage, etc.) determined to have an error. As a result, the store clerk and the like can easily grasp the place where the product or shelf label needs to be added or removed. Note that the notification unit 2080 performs display on a display screen or the like by a method similar to various notification methods described below.
- the notification unit 2080 makes a notification with an attached target image showing a location to be notified (a location where an error is found in the relationship between the product group 40 and the shelf label 50).
- the notification unit 2080 attaches an image in which the target location is highlighted or an image obtained by cutting out only the target location. It may be attached.
- the notification unit 2080 may identify a location to be notified and notify information about the location. For example, this information is the ID of the product shelf or the position in the store.
- the notification unit 2080 When the ID of the product shelf is displayed on each product shelf, the notification unit 2080 recognizes the ID of the product shelf to be notified in the target image. The notification unit 2080 notifies the recognized product shelf ID. In addition, the notification unit 2080 may identify the position of the product shelf in the store using the ID of the product shelf and notify the position. In this case, information (hereinafter, “product shelf information”) that associates the ID of the product shelf with the position of the product shelf of the ID in the store is stored in advance in an internal or external storage unit of the information processing apparatus 2000.
- product shelf information information that associates the ID of the product shelf with the position of the product shelf of the ID in the store is stored in advance in an internal or external storage unit of the information processing apparatus 2000.
- the notification unit 2080 specifies the position of the product shelf to be notified in the store by using information on the imaging range of the camera that captured the target image and information on the arrangement of the product shelf (store map, etc.) You may notify the position.
- the information regarding the imaging range of the camera that captured the target image may be acquired from the camera, or may be acquired from a storage unit that stores information about the camera.
- the notification unit 2080 may specify the ID of the product shelf from the position in the store of the product shelf to be notified by further using the above-described product shelf information, and may notify the ID.
- the notification unit 2080 notifies the information on the notification target stage (the stage in which an error is found in the relationship between the product group 40 and the shelf label 50) in the same manner as the above-described method for notifying information on the product shelf. Also good.
- Notification method of the notification target product group 40 when there is no shelf label 50 above or below the product group 40, the notification unit 2080 preferably notifies that there is no shelf label 50 corresponding to the product group 40.
- the notification unit 2080 performs notification with a target image in which the notification target product group 40 is highlighted or an image obtained by cutting out only the notification target product group 40 from the target image.
- the notification unit 2080 specifies the product group 40 to be notified by using the above-described product information (information in which a product is associated with a feature amount that represents an appearance feature of the product).
- the feature amount of the product of each product group 40 has already been calculated by the product recognition unit 2020. Therefore, the notification unit 2080 specifies the product corresponding to the feature amount of the product of the product group 40 to be notified, using the product information. And the notification part 2080 notifies ID etc. of the specified merchandise group 40, for example.
- an ID for identifying the product may be attached to the product.
- This ID may be represented by a character string such as alphanumeric characters, or may be represented by an image such as a barcode or a two-dimensional code.
- This ID is recognized by the product recognition unit 2020. In this case, the notification unit 2080 notifies the ID of the notification target product.
- the notification unit 2080 when there is no product group 40 above or below the shelf label 50, the notification unit 2080 preferably notifies that there is no product corresponding to the shelf label 50. For example, the notification unit 2080 performs notification with a target image in which the notification-target shelf label 50 is highlighted or an image obtained by cutting out only the notification-target shelf label 50 from the target image.
- the ID may be attached to the shelf label by the same method as the method of attaching the ID to the above-described product.
- This ID is recognized by the image shelf label recognition unit 2040.
- the notification unit 2080 notifies the ID of the shelf label to be notified.
- the notification unit 2080 may notify or display that there is no error when it is determined that there is no error in the relationship between the product group 40 and the shelf label 50. In addition, the notification unit 2080 may notify or display information related to a place, a product group, or a shelf label that has been determined to have no error.
- Product recognition means for recognizing the number of product types or the position of the product for each type from the image; From the image, shelf label recognition means for recognizing the number or position of shelf labels indicating information of each product, Determining means for determining whether or not there is an error in the relationship between the number of recognized product types and the number of shelf labels, or the relationship between the product position and shelf label position for each of the recognized types; , An information processing apparatus. 2. The determination means determines that there is an error in the relationship between the number of recognized product types and the number of shelf labels when the number of recognized product types does not match the number of shelf labels. 1. The information processing apparatus described in 1. 3.
- the determination unit determines that there is an error in the relationship between the position of the product for each recognized type and the position of the shelf label when a shelf label is not attached in a predetermined direction for a certain type of product. 1. Or 2. The information processing apparatus described in 1. 4). When the determination means has an error in the relationship between the position of the product for each recognized type and the position of the shelf label when no shelf label is attached within a predetermined distance from a certain type of product. Judgment 1. To 3. The information processing apparatus according to any one of the above. 5. When the determination unit determines that there is an error in the relationship between the number of recognized product types and the number of shelf labels, the relationship between the position of the product for each recognized type and the position of the shelf label. 1. Determine whether or not there is an error To 4.
- the information processing apparatus according to any one of the above. 6).
- a notification means for performing notification or display To 5.
- a control method executed by a computer A product recognition step for recognizing the number of types of products or the position of the products for each type from the images of the products and shelf labels; From the image, a shelf label recognition step for recognizing the number or position of shelf labels indicating information of each product, A determination step for determining whether or not there is an error in the relationship between the number of recognized product types and the number of shelf labels, or the relationship between the position of products for each recognized type and the position of shelf labels; , A control method. 8). The determination step determines that there is an error in the relationship between the number of recognized product types and the number of shelf labels when the number of recognized product types does not match the number of shelf labels. 7). The control method described in 1. 9.
- the determination step determines that there is an error in the relationship between the position of the product for each recognized type and the position of the shelf label when a shelf label is not attached in a predetermined direction for a certain type of product. 7. Or 8. The control method described in 1. 10. In the determination step, there is an error in the relationship between the position of the product for each recognized type and the position of the shelf label when no shelf label is attached within a predetermined distance from a certain type of product. Judgment 7 To 9. The control method as described in any one. 11. If the determination step determines that there is an error in the relationship between the number of recognized product types and the number of shelf labels, the relationship between the position of the product for each recognized type and the position of the shelf label 6. It is determined whether or not there is an error. To 10.
- the control method as described in any one. 12 When it is determined in the determination step that there is an error in the relationship between the number of recognized product types and the number of shelf labels, or the relationship between the position of products for each recognized type and the position of the shelf label And a notification step for performing notification or display.
- the control method as described in any one. 13 Computer.
- To 6. A program for operating as the information processing apparatus according to any one of the above.
Abstract
Description
図1は、実施形態1に係る情報処理装置2000を例示するブロック図である。図1において、矢印は情報の流れを示している。また図1において、各ブロックは、ハードウエア単位の構成ではなく、機能単位の構成を表している。
図2は、実施形態1の情報処理装置2000によって実行される処理の流れを例示するフローチャートである。情報処理装置2000は、対象画像を取得する(S102)。商品認識部2020は、対象画像から、商品グループの数又は位置を認識する(S104)。棚札認識部2040は、対象画像から、棚札の数又は位置を認識する(S106)。判定部2060は、認識された商品グループの数と棚札の数との関係、又は認識された商品グループの位置と棚札の位置との関係の誤りを判定する(S108)。
情報処理装置2000の各機能構成部は、各機能構成部を実現するハードウエア(例:ハードワイヤードされた電子回路など)で実現されてもよいし、ハードウエアとソフトウエアとの組み合わせ(例:電子回路とそれを制御するプログラムの組み合わせなど)で実現されてもよい。以下、各機能構成部をハードウエアとソフトウエアとの組み合わせで実現する場合について、その構成を具体的に例示する。
対象画像は、店舗等に設置されたカメラによって撮像される。1つの対象画像には、1種類の商品又は1つの棚札のみが写っていてもよいし、異なる複数の商品又は複数の棚札が写っていてもよい。
商品認識部2020は、対象画像を解析して商品を認識する。ここで、画像に写っている商品等のオブジェクトを認識する技術は既知の技術であり、オブジェクトの認識には様々な既知の技術が利用できる。以下、商品認識部2020が行う処理の一例を説明する。
例えば商品認識部2020は、隣接する商品の特徴量を左右いずれかから順に比較していくことで、各商品を商品グループ40に分類する。具体的には、商品認識部2020は、隣接する商品の特徴量が同一又は類似である場合、それらの商品を同じ商品グループ40に分類する。一方、商品認識部2020は、隣接する商品の特徴量が類似してない場合、それらの商品を異なる商品グループ40に分類する。
商品認識部2020は、商品とその商品の外見の特徴を表す特徴量とを対応付けた情報(以下、商品情報)を利用して、商品グループ40を認識してもよい。商品情報は、情報処理装置2000の内部又は外部に設けられている記憶部に予め記憶しておく。商品認識部2020は、この記憶部から商品情報を取得する。
商品認識部2020は、認識した商品グループ40の数をカウントすることで、商品グループ40の数を認識する。
例えば商品認識部2020は、各商品グループ40の対象画像10上の座標を、商品グループ40の位置として認識する。ここで、商品グループ40の座標は、商品グループ40を表す領域の内、予め定められた条件に合致する座標である。例えばこの条件は、商品グループ40を表す領域の中心、左端、又は右端などである。なお、商品認識部2020は、商品グループ40の位置を2次元座標(水平方向と垂直方向の組み合わせ)で表してもよいし、一次元座標(水平方向の座標)で表してもよい。
棚札認識部2040は、対象画像を解析して棚札を認識する。ここで商品認識部2020と同様に、棚札認識部2040も、画像からオブジェクトを認識する各種の既存技術を利用できる。以下、棚札認識部2040が行う処理の一例を例示する。
商品認識部2020の場合と同様に、図4を用いて説明する。例えば棚札認識部2040は、棚札50の特徴量を表す情報を取得し、対象画像からその特徴量に合致するオブジェクトを認識することで、棚札50を認識する。ここで、棚札50の特徴量は、情報処理装置2000の内部又は外部に設けられている記憶部に予め記憶しておく。
棚札認識部2040は、上述の方法で認識した棚札50の数をカウントすることで、棚札50の数を認識する。
棚札認識部2040が棚札50の位置を認識する方法は、商品認識部2020が商品グループ40の位置を認識する方法と同様である。
判定部2060は、前述のように、認識された商品グループ40の数と棚札50の数との関係、又は商品グループ40の位置と棚札50の位置との関係の誤りを判定する。
判定部2060は、商品グループ40の数と棚札50の数とを比較する。そして判定部2060は、例えば商品グループ40の数と棚札50の数とが一致しない場合に、これらの数の関係が誤っていると判定する。
例えば判定部2060は、商品グループ40に対して所定方向に棚札50が無ければ、商品グループ40の位置と棚札50の位置との関係が誤っていると判定する。所定方向とは、例えば上、下、左、又は右などである。
判定部2060は、数の関係と位置の関係との双方に着目して、商品グループ40と棚札50との関係の誤りを判定してもよい。図5を用いて具体的に説明する。図5の状況で判定部2060が上述した商品グループ40の位置と棚札50の位置との関係の誤りを判定すると、位置の関係が誤っていると判定される。商品グループ40-3の下に棚札50が無いためである。しかし、見方によっては、図5の状況は、「位置関係に誤りはなく、数の関係に誤りがある」ともいえる。
情報処理装置2000が上述した各処理を実行するタイミングは様々である。例えば情報処理装置2000は、定期的に処理を実行する。この場合、処理を実行する日時や周期などを、予め情報処理装置2000に設定しておく。また例えば、情報処理装置2000は、店員等による操作を受け付けたタイミングで処理を実行してもよい。さらに、情報処理装置2000は、対象画像が生成されたタイミングや対象画像を取得したタイミングで処理を実行してもよい。
図11は、実施形態2に係る情報処理装置2000を例示するブロック図である。図11において、矢印は情報の流れを示している。また図11において、各ブロックは、ハードウエア単位の構成ではなく、機能単位の構成を表している。
図12は、実施形態2の情報処理装置2000が行う処理の流れを例示するフローチャートである。ここで、ステップS102からS108については図2のフローチャートと同様であるため、説明を省略する。図12の処理は、ステップS302で分岐する。具体的には、ステップS108において商品グループ40と棚札50との間の数又は位置の関係に誤りがないと判定された場合(ステップS302:NO)、図12の処理は終了する。一方、ステップS108において商品グループ40と棚札50との間の数又は位置の関係に誤りがあると判定された場合(ステップS302:YES)、図12の処理はステップS304に進む。ステップS304において、通知部2080は、商品グループ40と棚札50との間の数又は位置の関係に誤りがある旨の通知又は表示を行う。
情報処理装置2000が導入されている店舗等における店員等は、情報処理装置2000を直接利用してもよいし、情報処理装置2000と通信可能に接続されている別の端末(以下、ユーザ端末)を利用してもよい。例えばユーザ端末は、各店員が携帯する携帯型端末である。
通知部2080は、「誤りがあるという旨」の通知又は表示だけでなく、「どのような誤りがあるか」の通知又は表示を行ってもよい。例えば通知部2080は、誤りがあると判定された場所(商品棚や段など)を特定する情報を通知する。これにより、店員等は、商品や棚札を追加したり取り除いたりする必要がある箇所を容易に把握できるようになる。なお通知部2080は、以下で説明する各種通知方法と同様の方法で、表示画面などへの表示を行う。
例えば通知部2080は、通知対象の場所(商品グループ40と棚札50との関係に誤りが見つかった場所)が写っている対象画像を添付した通知を行う。ここで、対象画像に商品を陳列する場所(商品棚など)が複数写っている場合、通知部2080は、対象の場所を強調表示した画像を添付したり、対象の場所のみを切り出した画像を添付したりしてもよい。
例えば商品グループ40の上又は下に棚札50が無い場合、通知部2080は、その商品グループ40に対応する棚札50がないことを通知することが好ましい。ここで、この通知対象の商品グループ40を通知する方法は様々である。例えば通知部2080は、通知対象の商品グループ40を強調表示した対象画像や、対象画像から通知対象の商品グループ40のみを切り出した画像を添付した通知を行う。
例えば棚札50の上又は下に商品グループ40がない場合、通知部2080は、その棚札50に対応する商品が無いことを通知することが好ましい。例えば通知部2080は、通知対象の棚札50を強調表示した対象画像や、対象画像から通知対象の棚札50のみを切り出した画像を添付した通知を行う。
通知部2080は、商品グループ40と棚札50との関係に誤りがないと判定された場合に、誤りがない旨を通知又は表示してもよい。また、通知部2080は、誤りがないと判定された場所、商品グループ、又は棚札に関する情報を通知又は表示してもよい。
1. 画像から、商品の種類の数又は種類ごとの商品の位置を認識する商品認識手段と、
前記画像から、各商品の情報を示す棚札の数又は位置を認識する棚札認識手段と、
前記認識された商品の種類の数と棚札の数との関係、又は前記認識された種類ごとの商品の位置と棚札の位置との関係に誤りがあるか否かを判定する判定手段と、
を有する情報処理装置。
2. 前記判定手段は、前記認識された商品の種類の数と棚札の数とが一致しない場合に、前記認識された商品の種類の数と棚札の数との関係に誤りがあると判定する1.に記載の情報処理装置。
3. 前記判定手段は、或る種類の商品に対して所定方向に棚札が付されていない場合に、前記認識された種類ごとの商品の位置と棚札の位置との関係に誤りがあると判定する1.又は2.に記載の情報処理装置。
4. 前記判定手段は、或る種類の商品から所定距離の範囲内に棚札が付されていない場合に、前記認識された種類ごとの商品の位置と棚札の位置との関係に誤りがあると判定する1.乃至3.いずれか一つに記載の情報処理装置。
5. 前記判定手段は、前記認識された商品の種類の数と棚札の数との関係に誤りがあると判定した場合に、前記認識された種類ごとの商品の位置と棚札の位置との関係に誤りがあるか否かを判定する1.乃至4.いずれか一つに記載の情報処理装置。
6. 前記判定手段によって前記認識された商品の種類の数と棚札の数との関係、又は前記認識された種類ごとの商品の位置と棚札の位置との関係に誤りがあると判定された場合に、通知又は表示を行う通知手段を有する1.乃至5.いずれか一つに記載の情報処理装置。
7. コンピュータによって実行される制御方法であって、
商品及び棚札が撮像された画像から、商品の種類の数又は種類ごとの商品の位置を認識する商品認識ステップと、
前記画像から、各商品の情報を示す棚札の数又は位置を認識する棚札認識ステップと、
前記認識された商品の種類の数と棚札の数との関係、又は前記認識された種類ごとの商品の位置と棚札の位置との関係に誤りがあるか否かを判定する判定ステップと、
を有する制御方法。
8. 前記判定ステップは、前記認識された商品の種類の数と棚札の数とが一致しない場合に、前記認識された商品の種類の数と棚札の数との関係に誤りがあると判定する7.に記載の制御方法。
9. 前記判定ステップは、或る種類の商品に対して所定方向に棚札が付されていない場合に、前記認識された種類ごとの商品の位置と棚札の位置との関係に誤りがあると判定する7.又は8.に記載の制御方法。
10. 前記判定ステップは、或る種類の商品から所定距離の範囲内に棚札が付されていない場合に、前記認識された種類ごとの商品の位置と棚札の位置との関係に誤りがあると判定する7.乃至9.いずれか一つに記載の制御方法。
11. 前記判定ステップは、前記認識された商品の種類の数と棚札の数との関係に誤りがあると判定した場合に、前記認識された種類ごとの商品の位置と棚札の位置との関係に誤りがあるか否かを判定する7.乃至10.いずれか一つに記載の制御方法。
12. 前記判定ステップによって前記認識された商品の種類の数と棚札の数との関係、又は前記認識された種類ごとの商品の位置と棚札の位置との関係に誤りがあると判定された場合に、通知又は表示を行う通知ステップを有する7.乃至11.いずれか一つに記載の制御方法。
13. コンピュータを、1.乃至6.いずれか一つに記載の情報処理装置として動作させるプログラム。
Claims (8)
- 商品及び棚札が撮像された画像から、商品の種類の数又は種類ごとの商品の位置を認識する商品認識手段と、
前記画像から、各商品の情報を示す棚札の数又は位置を認識する棚札認識手段と、
前記認識された商品の種類の数と棚札の数との関係、又は前記認識された種類ごとの商品の位置と棚札の位置との関係に誤りがあるか否かを判定する判定手段と、
を有する情報処理装置。 - 前記判定手段は、前記認識された商品の種類の数と棚札の数とが一致しない場合に、前記認識された商品の種類の数と棚札の数との関係に誤りがあると判定する請求項1に記載の情報処理装置。
- 前記判定手段は、或る種類の商品に対して所定方向に棚札が付されていない場合に、前記認識された種類ごとの商品の位置と棚札の位置との関係に誤りがあると判定する請求項1又は2に記載の情報処理装置。
- 前記判定手段は、或る種類の商品から所定距離の範囲内に棚札が付されていない場合に、前記認識された種類ごとの商品の位置と棚札の位置との関係に誤りがあると判定する請求項1乃至3いずれか一項に記載の情報処理装置。
- 前記判定手段は、前記認識された商品の種類の数と棚札の数との関係に誤りがあると判定した場合に、前記認識された種類ごとの商品の位置と棚札の位置との関係に誤りがあるか否かを判定する請求項1乃至4いずれか一項に記載の情報処理装置。
- 前記判定手段によって前記認識された商品の種類の数と棚札の数との関係、又は前記認識された種類ごとの商品の位置と棚札の位置との関係に誤りがあると判定された場合に、通知又は表示を行う通知手段を有する請求項1乃至5いずれか一項に記載の情報処理装置。
- コンピュータによって実行される制御方法であって、
商品及び棚札が撮像された画像から、商品の種類の数又は種類ごとの商品の位置を認識する商品認識ステップと、
前記画像から、各商品の情報を示す棚札の数又は位置を認識する棚札認識ステップと、
前記認識された商品の種類の数と棚札の数との関係、又は前記認識された種類ごとの商品の位置と棚札の位置との関係に誤りがあるか否かを判定する判定ステップと、
を有する制御方法。 - コンピュータを、請求項1乃至6いずれか一項に記載の情報処理装置として動作させるプログラム。
Priority Applications (7)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/506,299 US10579962B2 (en) | 2014-09-30 | 2015-09-28 | Information processing apparatus, control method, and program |
JP2016552004A JP6269851B2 (ja) | 2014-09-30 | 2015-09-28 | 情報処理装置、制御方法、及びプログラム |
US16/744,947 US11288627B2 (en) | 2014-09-30 | 2020-01-16 | Information processing apparatus, control method, and program |
US17/675,113 US11900316B2 (en) | 2014-09-30 | 2022-02-18 | Information processing apparatus, control method, and program |
US18/234,093 US20230394428A1 (en) | 2014-09-30 | 2023-08-15 | Information processing apparatus, control method, and program |
US18/234,683 US20230394430A1 (en) | 2014-09-30 | 2023-08-16 | Information processing apparatus, control method, and program |
US18/234,644 US20230394429A1 (en) | 2014-09-30 | 2023-08-16 | Information processing apparatus, control method, and program |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2014-201363 | 2014-09-30 | ||
JP2014201363 | 2014-09-30 |
Related Child Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/506,299 A-371-Of-International US10579962B2 (en) | 2014-09-30 | 2015-09-28 | Information processing apparatus, control method, and program |
US16/744,947 Continuation US11288627B2 (en) | 2014-09-30 | 2020-01-16 | Information processing apparatus, control method, and program |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2016052383A1 true WO2016052383A1 (ja) | 2016-04-07 |
Family
ID=55630419
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2015/077268 WO2016052383A1 (ja) | 2014-09-30 | 2015-09-28 | 情報処理装置、制御方法、及びプログラム |
Country Status (3)
Country | Link |
---|---|
US (6) | US10579962B2 (ja) |
JP (4) | JP6269851B2 (ja) |
WO (1) | WO2016052383A1 (ja) |
Cited By (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2018131331A (ja) * | 2017-02-16 | 2018-08-23 | 東芝テック株式会社 | 物品管理装置及び物品管理方法 |
WO2019064926A1 (ja) * | 2017-09-29 | 2019-04-04 | 日本電気株式会社 | 情報処理装置、情報処理方法、およびプログラム |
WO2019107157A1 (ja) * | 2017-11-29 | 2019-06-06 | 株式会社Nttドコモ | 棚割情報生成装置及び棚割情報生成プログラム |
JP2019125144A (ja) * | 2018-01-16 | 2019-07-25 | 株式会社富士通アドバンストエンジニアリング | 商品情報管理プログラム、方法及び装置、並びに商品管理プログラム、方法及び装置 |
JP2019174959A (ja) * | 2018-03-27 | 2019-10-10 | Awl株式会社 | 商品棚位置登録プログラム、及び情報処理装置 |
JP2020009466A (ja) * | 2019-09-05 | 2020-01-16 | 株式会社マーケットヴィジョン | 陳列状況判定システム |
JP2020160806A (ja) * | 2019-03-27 | 2020-10-01 | 中外炉工業株式会社 | 在庫管理方法 |
JP2020184356A (ja) * | 2016-05-19 | 2020-11-12 | シムビ ロボティクス, インコーポレイテッドSimbe Robotics, Inc. | 店舗の棚への製品の配置を追跡する方法 |
US11531960B2 (en) | 2017-09-29 | 2022-12-20 | Nec Corporation | Information processing apparatus, information processing system, control method, and program |
US11556729B2 (en) | 2018-03-20 | 2023-01-17 | Nec Corporation | Information processing apparatus, control method, and program |
JP7416571B2 (ja) | 2018-10-22 | 2024-01-17 | 東芝テック株式会社 | 物品認識装置 |
US11966435B2 (en) | 2018-03-20 | 2024-04-23 | Nec Corporation | Information processing apparatus, control method, and program |
Families Citing this family (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP7019357B2 (ja) * | 2017-09-19 | 2022-02-15 | 東芝テック株式会社 | 棚情報推定装置及び情報処理プログラム |
US11049279B2 (en) * | 2018-03-27 | 2021-06-29 | Denso Wave Incorporated | Device for detecting positional relationship among objects |
US20200125883A1 (en) | 2018-10-22 | 2020-04-23 | Toshiba Tec Kabushiki Kaisha | Article recognition apparatus |
CN109754209B (zh) * | 2019-01-02 | 2022-06-17 | 京东方科技集团股份有限公司 | 货品摆放区域确定方法及装置 |
JP6847137B2 (ja) * | 2019-01-18 | 2021-03-24 | 株式会社パン・パシフィック・インターナショナルホールディングス | 情報処理装置、棚管理システム、情報処理方法、及びプログラム |
CN109961101B (zh) * | 2019-03-29 | 2021-04-27 | 京东方科技集团股份有限公司 | 货架状态确定方法及装置、电子设备、存储介质 |
WO2021005135A1 (en) * | 2019-07-09 | 2021-01-14 | Pricer Ab | Stitch images |
US20230419702A1 (en) * | 2020-11-20 | 2023-12-28 | Omni Consumer Products, Llc | System, method and apparatus for price label modeling tool |
WO2023062723A1 (ja) * | 2021-10-12 | 2023-04-20 | 日本電気株式会社 | 画像解析システム、画像解析方法およびプログラム |
JP7343115B1 (ja) | 2022-02-28 | 2023-09-12 | 株式会社マーケットヴィジョン | 情報処理システム |
WO2024073041A1 (en) | 2022-09-30 | 2024-04-04 | L'oreal | Curl diagnosis system, apparatus, and method |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2010238007A (ja) * | 2009-03-31 | 2010-10-21 | Fujitsu Ltd | 配置管理装置および配置管理プログラム |
JP2013250647A (ja) * | 2012-05-30 | 2013-12-12 | Dongjoo Shin | 商品陳列情報集計方法とデータ構造およびそれを記録した記録媒体 |
Family Cites Families (76)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5493107A (en) * | 1993-05-07 | 1996-02-20 | Digicomp Research Corporation | Shelf price label and product placement verification method and apparatus |
AU1333895A (en) * | 1993-11-30 | 1995-06-19 | Raymond R. Burke | Computer system for allowing a consumer to purchase packaged goods at home |
JP2001247209A (ja) | 2000-03-06 | 2001-09-11 | Sony Corp | 情報検査装置および情報検査方法 |
JP2002293416A (ja) * | 2001-03-29 | 2002-10-09 | Fujitsu Ltd | 遠隔棚卸システム並びに同システム用店舗側端末装置および遠隔管理装置 |
US20020147597A1 (en) * | 2001-04-05 | 2002-10-10 | Connors Daniel Patrick | System and method for restocking and repricing merchandise |
US20030033217A1 (en) * | 2001-05-18 | 2003-02-13 | International Business Machines Corporation | Method and system for mapping shelf space |
US20030036985A1 (en) * | 2001-08-15 | 2003-02-20 | Soderholm Mark J. | Product locating system for use in a store or other facility |
US20030154141A1 (en) * | 2001-09-18 | 2003-08-14 | Pro Corp Holdings International Ltd. | Image recognition inventory management system |
US7536283B2 (en) * | 2003-01-03 | 2009-05-19 | L&P Property Management Company | Storage optimization system and method |
US7493336B2 (en) * | 2003-07-22 | 2009-02-17 | International Business Machines Corporation | System and method of updating planogram information using RFID tags and personal shopping device |
US6897763B2 (en) * | 2003-08-07 | 2005-05-24 | Eastman Kodak Company | Retail signage management system |
US20050203790A1 (en) * | 2004-03-09 | 2005-09-15 | Cohen Robert M. | Computerized, rule-based, store-specific retail merchandising |
US7885865B2 (en) * | 2004-05-11 | 2011-02-08 | The Kroger Co. | System and method for mapping of planograms |
US8725595B1 (en) * | 2004-06-09 | 2014-05-13 | Amazon Technologies, Inc. | Method and system for appraising a collection of products |
US7440903B2 (en) * | 2005-01-28 | 2008-10-21 | Target Brands, Inc. | System and method for evaluating and recommending planograms |
JP2006218030A (ja) * | 2005-02-09 | 2006-08-24 | Seiko Epson Corp | 棚札、棚札作成システム、棚札作成方法、プログラム及び記憶媒体 |
BRPI0610589A2 (pt) * | 2005-04-13 | 2010-07-06 | Store Eyes Inc | sistema e método para medir conformidade de expositor |
WO2007114935A2 (en) * | 2006-04-04 | 2007-10-11 | Gladson, Llc | Apparatus and method for maintaining a consumer products database |
US20100171826A1 (en) * | 2006-04-12 | 2010-07-08 | Store Eyes, Inc. | Method for measuring retail display and compliance |
US20070288296A1 (en) * | 2006-05-05 | 2007-12-13 | Graham Lewis | System and method for automatic placement of products within shelving areas using a planogram with two-dimensional sequencing |
US7693757B2 (en) * | 2006-09-21 | 2010-04-06 | International Business Machines Corporation | System and method for performing inventory using a mobile inventory robot |
FR2909202B1 (fr) * | 2006-11-23 | 2009-02-13 | Inc 01 Soc Par Actions Simplif | Procede d'analyse de la disposition de produits dans un lineaire de magasin. |
US7690732B2 (en) | 2007-02-22 | 2010-04-06 | Series International, Llc | Molded seat assembly with flexible weaving |
US20080208719A1 (en) * | 2007-02-28 | 2008-08-28 | Fair Isaac Corporation | Expert system for optimization of retail shelf space |
US8630924B2 (en) * | 2007-08-31 | 2014-01-14 | Accenture Global Services Limited | Detection of stock out conditions based on image processing |
US9135491B2 (en) * | 2007-08-31 | 2015-09-15 | Accenture Global Services Limited | Digital point-of-sale analyzer |
US8189855B2 (en) * | 2007-08-31 | 2012-05-29 | Accenture Global Services Limited | Planogram extraction based on image processing |
US7949568B2 (en) * | 2007-08-31 | 2011-05-24 | Accenture Global Services Limited | Determination of product display parameters based on image processing |
US20090094140A1 (en) * | 2007-10-03 | 2009-04-09 | Ncr Corporation | Methods and Apparatus for Inventory and Price Information Management |
US20090192921A1 (en) * | 2008-01-24 | 2009-07-30 | Michael Alan Hicks | Methods and apparatus to survey a retail environment |
JP2009189736A (ja) * | 2008-02-18 | 2009-08-27 | Ishida Co Ltd | 電子棚札及び電子棚札システム |
JP5372396B2 (ja) * | 2008-03-25 | 2013-12-18 | 株式会社イシダ | 電子棚札システム |
JP2010134635A (ja) * | 2008-12-03 | 2010-06-17 | Ishida Co Ltd | 電子棚札及び商品管理システム |
US20100217681A1 (en) * | 2009-02-25 | 2010-08-26 | James Geikie | Shopping Cart Planogram Ordering System |
US20110035257A1 (en) * | 2009-08-06 | 2011-02-10 | Rajendra Singh Solanki | Systems And Methods For Generating Planograms In The Presence Of Multiple Objectives |
US8941468B2 (en) * | 2009-08-27 | 2015-01-27 | Sap Se | Planogram compliance using automated item-tracking |
US9367851B2 (en) * | 2009-09-17 | 2016-06-14 | Information Planning & Management Service, Inc. | System and method for managing compliance with retail display regulations across a plurality of jurisdictions |
JP2011093672A (ja) | 2009-10-30 | 2011-05-12 | Seiko Instruments Inc | 位置情報取得装置および位置情報取得方法 |
US10269026B2 (en) * | 2010-05-27 | 2019-04-23 | One Door, Inc. | Generating a layout of products |
US20120022913A1 (en) * | 2010-07-20 | 2012-01-26 | Target Brands, Inc. | Planogram Generation for Peg and Shelf Items |
JP4914528B1 (ja) * | 2010-08-31 | 2012-04-11 | 新日鉄ソリューションズ株式会社 | 拡張現実提供システム、情報処理端末、情報処理装置、拡張現実提供方法、情報処理方法、及びプログラム |
JP2012053711A (ja) * | 2010-09-01 | 2012-03-15 | Toshiba Tec Corp | 情報処理装置、店舗システム及びプログラム |
US8577136B1 (en) * | 2010-12-28 | 2013-11-05 | Target Brands, Inc. | Grid pixelation enhancement for in-stock analytics |
JP2012174154A (ja) | 2011-02-24 | 2012-09-10 | Fujitsu Frontech Ltd | 在庫状況管理方法および在庫状況管理装置 |
MX345442B (es) * | 2011-03-01 | 2017-01-31 | Procter & Gamble | Visualizar informacion de un entorno fisico de tienda minorista en una ilustracion virtual del entorno fisico de tienda minorista. |
EP2509034A1 (de) * | 2011-04-09 | 2012-10-10 | Hoffrogge Consulting Company GmbH | Verfahren zum Erstellen von individuellen Regalbildern für verschiedene Verkaufsstellen |
US9041707B2 (en) * | 2011-06-01 | 2015-05-26 | Rbm Technologies | Confirming compliance with a configuration |
US8707372B2 (en) * | 2011-06-14 | 2014-04-22 | Convergent Media Systems Corporation | Remote control system for electronic devices |
US9785898B2 (en) * | 2011-06-20 | 2017-10-10 | Hi-Tech Solutions Ltd. | System and method for identifying retail products and determining retail product arrangements |
JP5400112B2 (ja) | 2011-09-06 | 2014-01-29 | 東芝テック株式会社 | 情報処理装置およびプログラム |
US9033239B2 (en) * | 2011-11-11 | 2015-05-19 | James T. Winkel | Projected image planogram system |
EP2791860A4 (en) * | 2011-12-16 | 2015-05-27 | Thomas Michael Cozad Jr | SYSTEMS AND METHODS FOR MANAGING PRODUCT LOCATION INFORMATION |
US9390361B2 (en) * | 2011-12-19 | 2016-07-12 | Symbol Technologies, Llc | Method and apparatus for verifying information associated with electronic labels |
US8600844B2 (en) * | 2012-02-02 | 2013-12-03 | W.W. Grainger, Inc. | Methods and systems for customizing inventory in an automated dispensing cabinet |
US20130226825A1 (en) * | 2012-02-28 | 2013-08-29 | Target Brands, Inc. | Automated mapping of product adjacency groups with merchandising persistence logic |
WO2013138333A1 (en) * | 2012-03-12 | 2013-09-19 | Numerex Corp. | System and method of on-shelf inventory management |
US20140201040A1 (en) * | 2012-03-30 | 2014-07-17 | Thomas A. Birch | Presentation-structure-aware display of planograms |
US8930235B2 (en) * | 2012-04-17 | 2015-01-06 | Oracle International Corporation | Shelf space product placement optimizer |
US20150086701A1 (en) | 2012-05-24 | 2015-03-26 | Conopco, Inc., D/B/A Unilever | Aerated oil containing sucrose fatty acid ester and hydrophobin |
US8923893B2 (en) * | 2012-08-07 | 2014-12-30 | Symbol Technologies, Inc. | Real-time planogram generation and maintenance |
US20140058781A1 (en) * | 2012-08-24 | 2014-02-27 | Kishore Padmanabhan | Assortment planning and optimization |
JP2014048752A (ja) | 2012-08-29 | 2014-03-17 | Teraoka Seiko Co Ltd | 表示札処理システム |
US9336508B2 (en) * | 2012-11-02 | 2016-05-10 | Patrick Soon-Shiong | Virtual planogram management, systems, and methods |
CN104871198A (zh) * | 2012-12-04 | 2015-08-26 | 日本电气株式会社 | 商品信息处理装置、其数据处理方法和程序 |
US9280757B2 (en) * | 2013-05-14 | 2016-03-08 | DecisionGPS, LLC | Automated inventory management |
US20150046299A1 (en) * | 2013-08-12 | 2015-02-12 | Sap Ag | Inventory Assessment with Mobile Devices |
US9400968B2 (en) * | 2013-08-14 | 2016-07-26 | Ricoh Company, Ltd. | Three-dimensional indexing protocol |
US20150088701A1 (en) * | 2013-09-23 | 2015-03-26 | Daniel Norwood Desmarais | System and method for improved planogram generation |
US9886678B2 (en) * | 2013-09-25 | 2018-02-06 | Sap Se | Graphic representations of planograms |
US9547838B2 (en) * | 2013-11-06 | 2017-01-17 | Oracle International Corporation | Automated generation of a three-dimensional space representation and planogram verification |
US20150166210A1 (en) * | 2013-12-12 | 2015-06-18 | S.C. Johnson & Son, Inc. | Accurate Product Placement |
US20150220783A1 (en) * | 2014-02-06 | 2015-08-06 | Rf Spot Inc. | Method and system for semi-automated venue monitoring |
US9659204B2 (en) * | 2014-06-13 | 2017-05-23 | Conduent Business Services, Llc | Image processing methods and systems for barcode and/or product label recognition |
US10453046B2 (en) * | 2014-06-13 | 2019-10-22 | Conduent Business Services, Llc | Store shelf imaging system |
GB2530769B (en) * | 2014-10-01 | 2017-05-17 | Asda Stores Ltd | System and method for monitoring display unit compliance |
US9710926B2 (en) * | 2015-01-30 | 2017-07-18 | Hewlett-Packard Development Company, L.P. | Image processing of a retail shelf area |
-
2015
- 2015-09-28 US US15/506,299 patent/US10579962B2/en active Active
- 2015-09-28 WO PCT/JP2015/077268 patent/WO2016052383A1/ja active Application Filing
- 2015-09-28 JP JP2016552004A patent/JP6269851B2/ja active Active
-
2017
- 2017-12-27 JP JP2017250637A patent/JP6897555B2/ja active Active
-
2020
- 2020-01-16 US US16/744,947 patent/US11288627B2/en active Active
- 2020-08-05 JP JP2020133060A patent/JP7279896B2/ja active Active
-
2022
- 2022-02-18 US US17/675,113 patent/US11900316B2/en active Active
- 2022-08-09 JP JP2022126907A patent/JP7456464B2/ja active Active
-
2023
- 2023-08-15 US US18/234,093 patent/US20230394428A1/en active Pending
- 2023-08-16 US US18/234,644 patent/US20230394429A1/en active Pending
- 2023-08-16 US US18/234,683 patent/US20230394430A1/en active Pending
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2010238007A (ja) * | 2009-03-31 | 2010-10-21 | Fujitsu Ltd | 配置管理装置および配置管理プログラム |
JP2013250647A (ja) * | 2012-05-30 | 2013-12-12 | Dongjoo Shin | 商品陳列情報集計方法とデータ構造およびそれを記録した記録媒体 |
Cited By (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP7082160B2 (ja) | 2016-05-19 | 2022-06-07 | シムビ ロボティクス,インコーポレイテッド | 店舗の棚への製品の配置を追跡する方法 |
JP2020184356A (ja) * | 2016-05-19 | 2020-11-12 | シムビ ロボティクス, インコーポレイテッドSimbe Robotics, Inc. | 店舗の棚への製品の配置を追跡する方法 |
US11341454B2 (en) | 2016-05-19 | 2022-05-24 | Simbe Robotics, Inc. | Method for tracking placement of products on shelves in a store |
JP2018131331A (ja) * | 2017-02-16 | 2018-08-23 | 東芝テック株式会社 | 物品管理装置及び物品管理方法 |
US11308516B2 (en) | 2017-09-29 | 2022-04-19 | Nec Corporation | Information processing apparatus, information processing method, and program for identifying whether an advertisement is positioned in association with a product |
WO2019064926A1 (ja) * | 2017-09-29 | 2019-04-04 | 日本電気株式会社 | 情報処理装置、情報処理方法、およびプログラム |
JP7476938B2 (ja) | 2017-09-29 | 2024-05-01 | 日本電気株式会社 | 情報処理装置、情報処理方法、およびプログラム |
US11531960B2 (en) | 2017-09-29 | 2022-12-20 | Nec Corporation | Information processing apparatus, information processing system, control method, and program |
JP7167926B2 (ja) | 2017-09-29 | 2022-11-09 | 日本電気株式会社 | 情報処理装置、情報処理方法、およびプログラム |
JPWO2019064926A1 (ja) * | 2017-09-29 | 2020-11-26 | 日本電気株式会社 | 情報処理装置、情報処理方法、およびプログラム |
JP7191851B2 (ja) | 2017-11-29 | 2022-12-19 | 株式会社Nttドコモ | 棚割情報生成装置及び棚割情報生成プログラム |
JPWO2019107157A1 (ja) * | 2017-11-29 | 2020-11-19 | 株式会社Nttドコモ | 棚割情報生成装置及び棚割情報生成プログラム |
WO2019107157A1 (ja) * | 2017-11-29 | 2019-06-06 | 株式会社Nttドコモ | 棚割情報生成装置及び棚割情報生成プログラム |
JP7069736B2 (ja) | 2018-01-16 | 2022-05-18 | 富士通株式会社 | 商品情報管理プログラム、方法及び装置 |
JP2019125144A (ja) * | 2018-01-16 | 2019-07-25 | 株式会社富士通アドバンストエンジニアリング | 商品情報管理プログラム、方法及び装置、並びに商品管理プログラム、方法及び装置 |
US11556729B2 (en) | 2018-03-20 | 2023-01-17 | Nec Corporation | Information processing apparatus, control method, and program |
US11966435B2 (en) | 2018-03-20 | 2024-04-23 | Nec Corporation | Information processing apparatus, control method, and program |
JP2019174959A (ja) * | 2018-03-27 | 2019-10-10 | Awl株式会社 | 商品棚位置登録プログラム、及び情報処理装置 |
JP7416571B2 (ja) | 2018-10-22 | 2024-01-17 | 東芝テック株式会社 | 物品認識装置 |
JP2020160806A (ja) * | 2019-03-27 | 2020-10-01 | 中外炉工業株式会社 | 在庫管理方法 |
JP2020009466A (ja) * | 2019-09-05 | 2020-01-16 | 株式会社マーケットヴィジョン | 陳列状況判定システム |
Also Published As
Publication number | Publication date |
---|---|
JP2022161949A (ja) | 2022-10-21 |
US20230394428A1 (en) | 2023-12-07 |
US11288627B2 (en) | 2022-03-29 |
JP2020194565A (ja) | 2020-12-03 |
US11900316B2 (en) | 2024-02-13 |
JP7279896B2 (ja) | 2023-05-23 |
US20170278056A1 (en) | 2017-09-28 |
JP6897555B2 (ja) | 2021-06-30 |
JP6269851B2 (ja) | 2018-01-31 |
US20230394429A1 (en) | 2023-12-07 |
US10579962B2 (en) | 2020-03-03 |
US20200151657A1 (en) | 2020-05-14 |
JP2018097881A (ja) | 2018-06-21 |
JP7456464B2 (ja) | 2024-03-27 |
JPWO2016052383A1 (ja) | 2017-06-08 |
US20230394430A1 (en) | 2023-12-07 |
US20220172157A1 (en) | 2022-06-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP7456464B2 (ja) | 情報処理装置、制御方法、及びプログラム | |
JP6202215B2 (ja) | 情報処理装置、棚札管理システム、制御方法、及びプログラム | |
US10445870B2 (en) | Linear grouping of recognized items in an image | |
CN109522780B (zh) | 货架信息推定装置、信息处理方法及终端设备 | |
US11367092B2 (en) | Method and apparatus for extracting and processing price text from an image set | |
WO2016052382A1 (ja) | 情報処理装置、棚札管理システム、制御方法、及びプログラム | |
JP2022002100A (ja) | 画像処理装置、画像処理方法、および、プログラム | |
JP2016194834A (ja) | 整合判定方法、整合判定プログラム、及び整合判定装置 | |
JP7259754B2 (ja) | 情報処理装置、情報処理方法、およびプログラム | |
US20220292445A1 (en) | Work assistance system, work assistance device, work assistance method, and program | |
JP2022183305A (ja) | 情報処理装置、情報処理方法、およびプログラム | |
US10631668B2 (en) | Inspection system, information collection apparatus, inspection method, information collection method, and non-transitory storage medium | |
JP7485140B2 (ja) | 情報処理装置、情報処理方法、およびプログラム | |
US20170161529A1 (en) | Object recognition encoder | |
JP6532114B1 (ja) | 情報処理装置、情報処理方法、およびプログラム | |
JP4862577B2 (ja) | Icタグ、商品管理システムおよび商品管理方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 15848053 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2016552004 Country of ref document: JP Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 15506299 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 15848053 Country of ref document: EP Kind code of ref document: A1 |