JP7466340B2 - Information processing device and program - Google Patents

Description

An embodiment of the present invention relates to an information processing device and a program.

In recent years, in stores such as supermarkets and convenience stores, stickers such as discount stickers are sometimes affixed to products to reduce (or discount) the prices of products they sell. In this case, a mark indicating that a sticker is affixed is affixed near a code symbol (e.g., a barcode or two-dimensional code) affixed to the product. When an operator operating a POS (Point of Sales) terminal processes product data for a product, he or she uses a code reader to capture an image of the product's code symbol. At the same time, the code reader captures an image of the mark affixed near the code symbol. When the POS terminal recognizes that an image of the mark has been captured, it recognizes that a sticker is affixed to the product, analyzes the contents of the sticker from the image captured by the code reader, and executes a process for the sticker (e.g., a discount process).

Recently, when a product is eaten in, a sticker indicating that the product is eligible for eat-in may be affixed to the product. In this case as well, when an image of the mark is captured, the code reader analyzes the contents of the sticker from the captured image and performs processing on the sticker (taxation processing in which the tax amount is 10% of the product price).

However, when two or more patches are attached to the same product, it is difficult to process all of the patches.

The problem that this invention aims to solve is to provide an information processing device and program that can process all of the stickers attached to a single product when multiple stickers are attached to the product.

The information processing device of the embodiment includes a receiving means for receiving an image of a sticker attached to a product, the image being captured by an imaging unit, the image including additional information related to the product and a surrounding area surrounding the additional information, and an image of a mark which is attached to the product in a position different from the sticker on the product and indicates that the sticker is attached to the product; a counting means for counting the number of marks which indicate the presence of a sticker attached to the product based on the captured image of the mark; an analyzing means for analyzing content of the sticker based on the additional information based on the image of the sticker; and a processing means for performing processing related to the additional information on the product when the analyzing means has analyzed the stickers for the number of marks counted by the counting means .

FIG. 1 is a perspective view showing a POS terminal according to an embodiment. FIG. 2 is a block diagram showing the hardware configuration of the POS terminal. FIG. 3 is a diagram showing the structure of the patch. FIG. 4 is a diagram showing a state in which the sticker is attached to the product. FIG. 5 is a functional block diagram showing the functional configuration of the POS terminal. FIG. 6 is a flowchart showing the flow of control processing of the POS terminal.

The following describes the embodiments in detail with reference to the drawings. In the embodiments, a POS (Point of Sales) terminal is described as an example of an information processing device. Note that the present invention is not limited to the embodiments.

First, the POS terminal 1 will be described. Fig. 1 is a perspective view showing the appearance of the POS terminal 1 according to the embodiment as seen from the store clerk's side. As shown in Fig. 1, the POS terminal 1 has a main body 2 and a money storage box 3. The money storage box 3 has a drawer, and stores cash such as bills and coins received from customers, securities such as gift certificates, and change to be paid to customers.

The main body 2 has an operation unit 21 such as a keyboard with numeric keys and touch keys, an operator display unit 22 that displays information to the operator, and a customer display unit 23 that displays information to the customer who is shopping. The main body 2 also has an imaging unit 24 that images the product. The imaging unit 24 images and reads the entire product or a code symbol such as a barcode or two-dimensional code attached to the product. The POS terminal 1 analyzes the code symbol imaged by the imaging unit 24 and obtains a product code that identifies the product to which the code symbol is attached. The main body 2 also has a printing unit 25 that prints product information (product name, product price, etc.) of the product being sold and payment information (total amount, amount received, change, etc.) to issue a receipt.

From here, the hardware configuration of the POS terminal 1 will be described. FIG. 2 is a block diagram showing the hardware configuration of the POS terminal 1. As shown in FIG. 2, the POS terminal 1 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a memory section 14, and the like. The CPU 11 is the main controller. The ROM 12 stores various programs. The RAM 13 expands programs and various data. The memory section 14 stores various programs. The CPU 11, the ROM 12, the RAM 13, and the memory section 14 are connected to one another via a bus 15. The CPU 11, the ROM 12, and the RAM 13 constitute the control section 100. That is, the control section 100 executes control processing related to the POS terminal 1, which will be described later, by the CPU 11 operating according to the control programs stored in the ROM 12 and the memory section 14 and expanded in the RAM 13.

The RAM 13 includes a product information section 131, an image storage section 132, and a count storage section 133. The product information section 131 stores product information (product price, product name, etc.) of products that have undergone product data processing. The image storage section 132 stores image data captured by the imaging section 24. The count storage section 133 stores the number of stickers and the number of marks attached to the product, which will be described later.

The memory unit 14 is composed of a non-volatile memory such as a hard disk drive (HDD) or flash memory that retains stored information even when the power is turned off. The memory unit 14 includes a control program unit 141 and a product master 142. The control program unit 141 stores a control program for controlling the POS terminal 1. The product master 142 stores product information related to each product for each product code that identifies the product.

The control unit 100 is also connected to the operation unit 21, the operator display unit 22, the customer display unit 23, the imaging unit 24, and the printing unit 25 via the bus 15 and the controller 16. The operation unit 21 is a keyboard or the like for operating the POS terminal 1, and includes a payment key 211. The payment key 211 is operated by the operator when terminating product data processing related to the product purchased by the customer and proceeding to payment processing.

The operator display unit 22 is a display unit made up of, for example, a liquid crystal display, and displays information to the operator operating the POS terminal 1. The customer display unit 23 is a display unit made up of, for example, a liquid crystal display, and displays information to customers purchasing products. In addition, the controller 16 receives instructions from the control unit 100 and controls the operation unit 21, the operator display unit 22, the customer display unit 23, the imaging unit 24, and the printing unit 25. For the sake of convenience, the following description will be given assuming that the control actually performed by the controller 16 is directly performed by the control unit 100.

The control unit 100 is also connected to the communication unit 26 via the bus 15. The communication unit 26 is connected to a higher-level server (not shown) via the communication line L, and transmits and receives information to and from the higher-level server (not shown).

Next, the sticker will be described. The sticker 52 is attached to the surface of the product S (see FIG. 4) by, for example, an adhesive applied to the back side of a sheet such as a mount, and is specifically configured as a discount sticker, a points sticker, or the like. As shown in FIG. 3, the sticker 52 includes additional information 54 and an image 53.

The additional information 54 is information about the product S, the store, the manufacturer's services, and the like. The additional information 54 is information added by attaching the sticker 52 to the product S. The additional information 54 can be, for example, letters, numbers, images, information codes, and the like. It is preferable that the additional information 54 can be visually distinguished by operators, store clerks, customers, and the like. The additional information 54 can indicate, for example, that the product 50 is subject to a discount, the discount amount, that the product is subject to points, the value of the points, and the like. The sticker 52 is attached to the product S in a position that is easily visible to operators and customers. In the embodiment, the additional information 54 will be described below as two types of information: discount information that discounts the price of the product, and information indicating that the product to which the sticker 52 is attached is an eat-in product.

Image 53 is a separate image from additional information 54. Image 53 can have a function of making it easier to identify the correspondence between sticker 52 (additional information 54) and code symbol 51 (see FIG. 4) by image processing, for example. Image 53 can also have a function of making sticker 52 visually stand out, for example. In the present embodiment, image 53 includes, for example, surrounding portion 53a. Surrounding portion 53a surrounds additional information 54. Surrounding portion 53a can be formed, for example, in an annular shape (circular ring or rectangular ring).

The sticker 52 also has a base portion 52a and a protruding portion 52b. The base portion 52a includes additional information 54 about the product and an enclosure portion 53a. The protruding portion 52b protrudes from the base portion 52a.

Furthermore, image 53 and additional information 54 are colored, for example, with a color or density that provides a striking contrast with the background of image 53 and additional information 54 in paste 52. Furthermore, image 53 and additional information 54 are positioned, for example, so as not to overlap each other (so as to leave gaps). The color of the background of paste 52, the color of image 53, and the color of the text in additional information 54 can each be different colors. Specifically, for example, the color of the background of paste 52 can be yellow, the color of image 53 can be red, and the color of the text in additional information 54 can be blue.

The image 53 may have a mark 53e on the protruding portion 52b. In the embodiment, the mark 53e is arranged apart from the surrounding portion 53a and formed as a multiple circle (double circle in this example), as an example. However, the embodiment is merely an example, and the mark 53e may be formed as any predetermined shape (for example, a star, a square, a triangle, a rectangular ring, a multiple rectangular ring, etc.). The part 52c of the sticker 52 to which the mark 53e is applied can be cut off from the protruding portion 52b with the cut line (perforation, etc.) 52d as a boundary. The mark 53e is a mark that indicates that the sticker 52 is attached. The POS terminal 1 judges whether the sticker 52 needs to be attached to the product depending on whether the mark 53e is attached near the code symbol 51. Therefore, it is desirable that the mark 53e be attached as close to the code symbol 51 as possible.

Next, a state in which a code symbol 51 is attached to a product, and a sticker 52 and a mark 53e are attached to the product S will be described. FIG. 4 is a diagram showing the state in which a sticker is attached to a product. The code symbol 51 is printed or attached to the product S or the packaging of the product S. The code symbol 51 contains information for identifying the product S and distinguishing it from other products. For example, the code symbol 51 contains a symbolized product code that identifies the product S. Note that the code symbol 51 may contain information other than the product code that identifies the product S. In this case, the POS terminal 1 acquires the product code of the product S based on information obtained by analyzing the captured code symbol 51.

The sticker 52 is affixed to the product S or to the packaging of the product S. It is desirable that the sticker 52 is affixed in a position that is easily visible to the operator and customers of the product S. In the example of FIG. 4, two types of stickers 52 are affixed to the product S: a sticker 521 indicating that the price of the product S is half price, and a sticker 522 indicating that the product S is an eat-in product to be consumed in the store.

The mark 53e is affixed to the product S or to the packaging of the product S. In the example of FIG. 4, two types of marks 53e are affixed to the product S: a mark 53e1 indicating that a sticker 521 is affixed, and a mark 53e2 indicating that a sticker 522 is affixed. It is desirable that the mark 53e be affixed near the code symbol 51. The operator captures an image of the code symbol 51 with the imaging unit 24. If the mark 53e is affixed near the code symbol 51, the mark 53e can be imaged at the same time as the code symbol 51 is imaged. Therefore, the POS terminal 1 can obtain information on the code symbol 51 and the mark 53e with a single image capture.

From here, the functional configuration of the POS terminal 1 will be explained. Figure 5 is a functional block diagram showing the functional configuration of the POS terminal 1. The control unit 100 functions as an image acquisition means 101, a mark determination means 102, a counting means 103, an analysis means 104, a detection determination means 105, a processing means 106, and a price acquisition means 107 by following the control program stored in the ROM 12 or the control program section 141 of the memory unit 14.

The image acquisition means 101 acquires images captured by the imaging unit 24. Specifically, the image acquisition means 101 stores the images captured by the imaging unit 24 in the image storage unit 132. The image acquisition means 101 stores image data for the number of images captured by the imaging unit 24 in the image storage unit 132. For example, if the sticker 52 is affixed to multiple surfaces of the product S, the operator uses the imaging unit 24 to capture images of the surface to which the code symbol 51 is affixed and the surface to which the sticker 52 is affixed. The image storage unit 132 stores images of the surface to which the code symbol 51 is affixed and the surface to which the sticker 52 is affixed.

The mark determination means 102 determines whether mark 53e is present in the captured image data. Specifically, the mark determination means 102 determines whether mark 53e has been detected from the image data stored in the image storage unit 132. Since it is previously stored in the memory unit 14 that mark 53e is an image of a double circle, the mark determination means 102 determines whether mark 53e has been captured in the captured image (whether mark 53e has been detected) based on the data of the image of the double circle stored in the memory unit 14.

The counting means 103 counts the number of marks 53e indicating the presence of a sticker 52 attached to the product S based on image data of the captured product S. Specifically, the counting means 103 counts the number of marks 53e included in image data in which the code symbol 51 is captured, among the image data stored in the image storage unit 132. Since the marks 53e are attached near the code symbol 51, the number of marks 53e included in the image data in which the code symbol 51 is captured is the number of marks 53e attached to the product S. In addition, the counting means 103 counts the number of marks 53e when the mark determination means 102 determines that a mark 53e exists in the captured image. The counting means 103 stores the counted marks 53e in the count storage unit 133.

The analysis means 104 analyzes the contents of the information written on the detected patch 52. Specifically, the analysis means 104 analyzes the type of patch 52 based on the data stored in the image storage unit 132. More specifically, the analysis means 104 analyzes the contents of the patch 52 based on the contents of the additional information 54 among the data stored in the image storage unit 132. The analysis is performed, for example, as follows. That is, multiple types of patterns of additional information 54 and the contents of each pattern are stored in advance in the memory unit 14 in association with each other, a pattern stored in the memory unit 14 that matches the pattern of the captured additional information 54 is extracted, and the contents of the pattern are taken as the contents of the captured additional information 54.

For example, in the case of FIG. 4, the analysis means 104 analyzes the contents of the captured additional information 54 and determines that two types of stickers 52 are attached: a sticker 521 indicating that the price of product S is reduced by half, and a sticker 522 indicating that product S is an eat-in product for consumption within the store. In addition, the analysis means 104 analyzes the type of sticker 52 when the mark determination means 102 determines that mark 53e is present in the captured image. The analysis means 104 stores the number of stickers 52 of the analyzed type in the count memory unit 133.

The detection and judgment means 105 judges whether the number of marks 53e counted by the counting means 103 is equal to the number of patches 52 analyzed by the analysis means 104 as having been affixed. Specifically, the detection and judgment means 105 judges whether the number of types of analyzed patches 52 stored in the count memory unit 133 by the analysis means 104 is equal to the number of marks 53e counted by the counting means 103 and stored in the count memory unit 133. In other words, the detection and judgment means 105 judges whether the analysis means 104 has analyzed the number of types of patches 52 equal to the number of marks 53e counted by the counting means 103. For example, if the number of marks 53e counted by the counting means 103 is "2", the detection and judgment means 105 judges whether the analysis means 104 has analyzed two types of patches 52.

For example, when the price of product S is to be discounted by 40%, if there is no 40% off sticker 52, two 20% off stickers 52 may be affixed to the product. In this case, the analysis means 104 determines that the stickers 52 are the same type, but because two marks 53e are affixed, the detection and judgment means 105 determines that two 20% off stickers 52 are affixed.

When the processing means 106 detects the number of stickers 52 corresponding to the number of marks 53e counted by the counting means 103, the processing means 106 performs processing on the product S related to the information described on the detected stickers 52. Specifically, when the processing means 106 determines that the detection and judgment means 105 has analyzed the number of stickers 52 corresponding to the number of marks 53e, the processing means 106 executes processing on the product S based on the contents (additional information 54) of the analyzed stickers 52.

The price acquisition means 107 acquires the price of the product S based on image data of the product S. Specifically, the price acquisition means 107 searches the product master 142 for the product code acquired based on the code symbol 51 captured by the imaging unit 24, and acquires the price of the product S.

For example, if the content (additional information 54) of the sticker 52 analyzed by the analysis means 104 is information to discount the price of the product S (e.g., information that states "half price"), the processing means 106 executes processing to discount the price of the product S acquired by the price acquisition means 107 by half price. Also, for example, if the content (additional information 54) of the sticker 52 analyzed by the analysis means 104 is information to discount the price of the product S and information about an eat-in product, the processing means 106 discounts the price of the product S acquired by the price acquisition means 107 by half price and adds 10% consumption tax on the eat-in product to the discounted price.

Next, the control of the POS terminal 1 will be described. FIG. 6 is a flowchart showing the flow of the control process of the POS terminal 1. The operator uses the imaging unit 24 to capture an image of the vicinity of the code symbol 51 of the product S or the area where the sticker 52 is attached. As shown in FIG. 6, the control unit 100 of the POS terminal 1 judges whether an image captured by the imaging unit 24 has been input (S11). If it is judged that an image has been input (Yes in S11), the image acquisition means 101 stores the input image data in the image storage unit 132 (S12). Then, the price acquisition means 107 acquires a product code that identifies the product S based on the code symbol 51 stored in the image storage unit 132. Then, the price acquisition means 107 searches the product master 142 based on the acquired product code, and reads out product information of the product S (product name, price of the product S, etc.) that corresponds to the product code (S13).

Next, the mark determination means 102 determines whether a mark 53e is present in the image (whether a mark 53e has been detected) based on an image of the code symbol 51 among the image data stored in the image storage unit 132 (S14). If it is determined that a mark 53e is present in the image of the code symbol 51 (Yes in S14), the counting means 103 counts the number of marks 53e included in the image data of the code symbol 51 (S15). The control unit 100 then stores the number of marks 53e counted by the counting means 103 in the count storage unit 133 (S16).

Next, the control unit 100 judges whether a patch 52 has been detected in the image data stored in the image storage unit 132 (S17). The control unit 100 waits until a patch 52 is detected (No in S17), and if it is judged that a patch 52 has been detected (Yes in S17), the analysis means 104 analyzes the contents of the detected patch 52 based on the contents of the additional information 54 (S18). The analysis means 104 stores the number of analyzed patches 52 in the count storage unit 133 (S18).

Next, the detection and judgment means 105 judges whether the number of marks 53e counted by the counting means 103 is equal to the number of contents (types) of the stickers 52 analyzed by the analysis means 104 from the information stored in the count memory unit 133 (S19). If it is judged that the number of marks 53e is equal to the number of contents of the stickers 52 (Yes in S19), the processing means 106 performs product data processing on the product S according to the contents of the additional information 54 of the detected stickers 52 (S20). The product data processing is a process of storing information based on the product information read in S13 in the product information unit 131. For example, if the contents of the additional information 54 are information to reduce the price of the product S by half, the processing means 106 performs product data processing to reduce the price of the product S by half and store it in the product information unit 131 together with other product information. Furthermore, if the content of the additional information 54 is information to halve the price of the product S and information indicating that the product S is an eat-in item, the processing means 106 performs product data processing to halve the price of the product S, calculate the price of the product by adding 10% consumption tax to the halved price, and store the calculated price in the product information section 131 together with other product information. The control section 100 then returns to S11.

In addition, in S19, if it is determined that the number of marks 53e counted by the counting means 103 is not equal to the number of contents (types) of the patches 52 analyzed by the analyzing means 104 (i.e., the number of marks 53e is greater than the number of contents of the patches 52) (No in S19), the control unit 100 determines whether a predetermined time has passed since the processing of S12 (S21). If it is determined that the predetermined time has not passed since the processing of S12 (No in S21), the control unit 100 returns to S17 and repeats the processing of S17 to S19. In addition, if it is determined that the predetermined time has passed since the processing of S12 (Yes in S21), the processing means 106 executes error processing (S22). This error indicates that the number of patches 52 has not been detected in the number of marks 53e. In this case, since there is a possibility that not all of the stickers 52 attached to the product S have been captured, the processing means 106 executes error processing, for example, displaying a message to that effect on the operator display unit 22, and prompts the operator to capture an image of the product S again. The control unit 100 then returns to S11.

In addition, in S14, if the mark 53e is not present in the image in which the code symbol 51 is captured (the mark 53e is not detected) (No in S14), the control unit 100 executes the process of S20 without executing the processes of S15 to S19 and S21 and S22. In this case, the price of the product S stored in the product information unit 131 is not changed. Also, the product is not designated as an eat-in product (the consumption tax is set to 8%).

On the other hand, if it is determined in S11 that the input is not an image capture (No in S11), the control unit 100 determines whether the payment key 211 has been operated (S31). If it is determined that the payment key 211 has been operated (Yes in S31), the control unit 100 executes a payment process based on the product information stored in the product information unit 131 (S32). The payment process refers to a process that displays the total amount of the transaction based on the product information stored in the product information unit 131, displays the deposit received from the customer, calculates and displays the change if there is any, and drives the printing unit 25 to issue a receipt on which the product information and payment information related to the transaction are printed. If it is determined that the payment key 211 has not been operated (No in S31), the control unit 100 returns to S11.

According to this embodiment, the POS terminal 1 includes a counting means 103 that counts the number of marks 53e indicating the presence of stickers 52 affixed to the product S based on image data of the product S, and a processing means 106 that, when the counting means 103 detects stickers 52 equal to the number of marks 53e counted, performs processing related to the information described on the stickers 52 detected on the product S. Since this type of POS terminal 1 detects all stickers 52 affixed to the product S, when multiple stickers 52 are affixed to one product S, it is possible to process all of the stickers 52.

Although the embodiments of the present invention have been described above, these embodiments are presented as examples and are not intended to limit the scope of the invention. This new embodiment can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the gist of the invention. This embodiment falls within the scope and gist of the invention, and is included in the scope of the invention and its equivalents described in the claims.

For example, in the embodiment, the POS terminal 1 has been described as an example of an information processing device. Therefore, the image captured by the imaging unit 24 is transmitted to the POS terminal 1. However, this is not limited to the above, and for example, the imaging unit 24 may be an information processing device that processes the images it captures. In this case, the imaging unit 24 includes at least the counting means 103 and the processing means 106.

In the embodiment, the additional information 54 written on the sticker 52 is described as a discount on the product and information indicating that the product is an eat-in product. The additional information 54 may also be a point award rate, etc.

The programs executed by the POS terminal 1 of the embodiment are provided in the form of installable or executable files recorded on a computer-readable recording medium such as a CD-ROM, a flexible disk (FD), a CD-R, or a DVD (Digital Versatile Disk).

The program executed by the POS terminal 1 of the embodiment may be stored on a computer connected to a network such as the Internet and provided by downloading it via the network. The program executed by the POS terminal 1 of the embodiment may be provided or distributed via a network such as the Internet.

The program executed by the POS terminal 1 of the embodiment may also be configured to be provided by being pre-installed in a ROM or the like.

1 POS terminal 11 CPU
12 ROM
13 RAM
14 Memory section 21 Operation section 22 Operator display section 23 Customer display section 24 Imaging section 25 Printing section 26 Communication section 50 Product 51 Code symbol 52 Sticking material 52a Base section 52b Protruding section 52c Section 53 Image 53e Mark 54 Additional information 100 Control section 101 Image acquisition means 102 Mark judgment means 103 Counting means 104 Analysis means 105 Detection judgment means 106 Processing means 107 Price acquisition means 131 Product information section 132 Image storage section 133 Count storage section

JP 2012-74013 A

Claims (5)

a receiving means for receiving an image of a sticker attached to a product, the image being captured by an imaging unit, the sticker including additional information related to the product and a surrounding portion surrounding the additional information, and an image of a mark, which is attached to the product at a position different from the sticker, indicating that the sticker is attached to the product;
A counting means for counting the number of marks indicating the presence of a sticker attached to the product based on an image of the mark ;
an analysis means for analyzing the content of the paste based on the additional information on the basis of the image of the paste;
a processing means for performing a process related to the additional information on the product when the analyzing means analyzes the number of the labels corresponding to the number of the marks counted by the counting means;
An information processing device comprising: A price acquisition unit is further provided for acquiring a price of the product based on the image ,
The processing means performs processing related to the price based on the analyzed content .
The information processing device according to claim 1 . the processing means executes an error process when the analyzing means does not analyze the contents of the stickers corresponding to the number of the marks counted by the counting means.
3. The information processing device according to claim 1 or 2 . The image processing device further includes a mark determining unit that determines whether the image processing unit has received the image of the mark based on the image .
the counting means counts the number of the marks when it is determined that the image of the mark has been accepted ;
4. The information processing device according to claim 1 . A computer as an information processing device
a receiving means for receiving an image of a sticker attached to a product, the image being captured by an imaging unit, the sticker including additional information related to the product and a surrounding portion surrounding the additional information, and an image of a mark, which is attached to the product at a position different from the sticker, indicating that the sticker is attached to the product;
A counting means for counting the number of marks indicating the presence of a sticker attached to the product based on an image of the mark ;
an analysis means for analyzing the content of the paste based on the additional information on the basis of the image of the paste;
a processing means for performing a process related to the additional information on the product when the analyzing means analyzes the number of the labels corresponding to the number of the marks counted by the counting means;
A program to make it function as such.

Images