JP7219246B2 - Method, program and system for recording the opening history of individual products - Google Patents

Description

The present invention relates to a method, program and system for recording the history of opening of individual products.

A code (product uniqueness code) that includes information on the type of product such as food and beverages and the uniqueness of the product is displayed on the packaging material of the product, and consumers of the product can use the product uniqueness code to obtain points. It is known to apply for benefits such as campaigns and campaigns.

However, there is a possibility that the product uniqueness code of the displayed product may be illegally acquired without actually purchasing the product, and the user may apply for the privilege.

In order to prevent such fraud, products are known in which the product uniqueness code cannot be seen and thus cannot be obtained without opening the packaging material of the product (for example, See Patent Document 1). Based on the product uniqueness code information acquired in this manner, information indicating that individual products have been opened (individual product opening history) is recorded in the computer database of the system.

JP 2017-178382 A

SUMMARY OF THE INVENTION An object of the present invention is to provide a method, a program and a system for recording the opening history of individual products in a computer database in a manner different from the conventional method.

A second object of the present invention is to provide a method, a program, and a system for recognizing that an individual product has been opened and determining the content of a privilege in a manner different from the conventional method.

In order to achieve the above object, a method according to the present invention, which is executed by one or more computers and records the opening history of individual products in a database of said computer, provides a predetermined In the form, a product uniqueness code containing information on the type of product and the uniqueness of the product is exposed, and the method is a photo image of the product or part thereof after being opened together with the product uniqueness code. a step of receiving data from a terminal via the Internet; a step of reading product type and product uniqueness information from the product uniqueness code portion of the received image data; Evaluating the extent to which the shape of the product or part thereof is recognized as the predetermined shape using AI technology; determining whether or not it corresponds to a predetermined form; and when it is determined that the form recognized from the received image data corresponds to the predetermined form, the type of the read product and the uniqueness of the product. a step of confirming whether or not the sealing history of the individual product specified by the information is recorded in the database of the computer; and when the opening history of the individual product is not recorded in the database of the computer; and recording an opening history of the individual product in a database of the computer.

Further, in order to achieve the above object, a program according to the present invention, which is executed by one or more computers and records the opening history of individual products in a database of the computer, includes the following steps: In a predetermined form, a product uniqueness code containing information about the product type and product uniqueness is exposed, and the program captures the shape of the product or part thereof after opening and the product uniqueness code together. A process of receiving image data of the photo taken from the terminal via the Internet, a process of reading the product type and product uniqueness information from the product uniqueness code part of the received image data, and a process of reading the received image data A process of evaluating the extent to which the shape of the product or part thereof recognized from the product or part thereof is recognized as the predetermined shape using AI technology, and based on the evaluation, the product is recognized from the received image data a process of determining whether or not the form corresponds to the predetermined form; a process of confirming whether or not the sealing history of the individual product specified by the uniqueness information is recorded in the database of the computer, and whether the opening history of the individual product is recorded in the database of the computer and a process of recording the opening history of the individual product in the database of the computer when the product is not opened.

Further, in order to achieve the above object, in a system according to the present invention, which is provided with one or more computers and records the opening history of individual products in a database of the computer, the product or a part of the product after opening is stored in advance. In a predetermined form, a product uniqueness code containing information on the product type and product uniqueness is exposed, and the system takes a picture of the product or part of the product after opening and the product uniqueness code together. Processing to receive photo image data from a terminal via the Internet, processing to read product type and product uniqueness information from the product uniqueness code portion of the received image data, and processing from the received image data A process of evaluating the extent to which the form of the product to be recognized or a part thereof is recognized as the predetermined form using AI technology, and the form recognized from the received image data based on the evaluation a process of determining whether or not corresponds to the predetermined form; A process of confirming whether or not the sealing history of the individual product specified by the uniqueness information is recorded in the database of the computer; and whether the opening history of the individual product is recorded in the database of the computer. and a process of recording the opening history of the individual product in a database of the computer when there is no such item.

In the method, program and system configured as described above, one or more computers transmit the image data of the photograph of the unsealed product or part of the product together with the unique code from the terminal via the Internet. and read the product type and product uniqueness information from the uniqueness code portion of the received image data. It identifies individual products. Also, the one or more computers recognize that the product has been unsealed when it is determined that the shape recognized from the received image data corresponds to the predetermined shape. The predetermined form is a form that cannot be achieved without opening the product. Based on these results, the opening history of individual products is recorded in the database of the computer. The product uniqueness code may be read while the product is in an unopened state, and the opening history of individual products cannot be recorded in the database only with the product uniqueness code information.

In the method, program and system described above, the predetermined configuration may include a configuration in which the packaging bag or packaging box is folded, or a configuration in which the lid is removed from the cup-shaped product.

In order to achieve the second object in the above method, preferably, the step of determining the contents of the privilege based on the type of the read product and the form recognized from the received image data are determined in advance. and transmitting information indicating that it corresponds to the selected form and the contents of the privilege to the terminal.

In order to achieve the second object in the above program, preferably, the process of determining the contents of the privilege based on the type of the read product and the form recognized from the received image data are determined in advance. and a process of transmitting information indicating that it corresponds to the selected form and the content of the privilege to the terminal.

In order to achieve the second object in the above system, preferably, the process of determining the contents of the privilege based on the type of the read product and the form recognized from the received image data are determined in advance. and a process of transmitting information indicating that the form corresponds to the selected mode and the content of the privilege to the terminal.

1 is a schematic diagram of an example of a system used in the method according to the invention; FIG. 1 is a flowchart of an example of a method according to the invention; 1 is a flowchart of an example of a method according to the invention; 1 is a flowchart of an example of a method according to the invention; It is a figure which shows the procedure which folds an empty packaging bag. It is a figure which shows the procedure which folds an empty packaging bag. It is a figure which shows the procedure which folds an empty packaging bag. It is a figure which shows the procedure which folds an empty packaging bag. It is a figure which shows the procedure which folds an empty packaging bag. It is a figure which shows the procedure which folds an empty packaging bag. It is a figure which shows the procedure which folds an empty packaging bag. It is a figure which shows the procedure which folds an empty packaging bag. 1 shows the basic form of a folded empty packaging bag; FIG. FIG. 3 shows an example of a similar form of a folded empty packaging bag; It is a figure which shows the form of the lid|cover removed from the cup-shaped goods.

A method, program and system for recording the opening history of individual products, and a method, program and system associated therewith (transmitting privilege content) will be described with reference to the drawings. An individual product is, for example, a packaged food G such as potato chips sealed in a packaging bag B. Hereinafter, a method for recording the opening history of the packaged food G (specifically, the packaging bag B) will be described. . A product uniqueness code 50 including information on the packaged food G and information on the uniqueness of the packaged food G is printed on the packaging bag B (see FIG. 7). In the embodiment described below, the product uniqueness code 50 is a two-dimensional code 51 containing information on the type of the packaged food G and a character code 52 containing information on the uniqueness of the packaged food G.

FIG. 1 is a schematic diagram of an example of a system for programmatically executing the steps or processes included in the method of recording the opening history of individual packaged foods G according to the present invention. The system 1 includes a terminal 10 such as a consumer's mobile information terminal, an application server 20 that manages applications installed in the terminal 10, a point award determination system 30, and a point management system 40.

The application server 20, the point grant determination system 30, and the point management system are configured by one or more computers, either individually or in combination, and such computers may function as physical servers or virtual servers. may function as In this example, such a computer is a virtual server. Each virtual server has hardware resources for exerting CPU functions, memory functions, communication functions, input/output functions, etc., but detailed description thereof will be omitted. The virtual server (computer) operates in cooperation with each software (program).

The terminal 10 is configured by, for example, a smart phone and operated by a consumer. The terminal 10 has a camera function (not shown) and operates according to a smart phone application installed on the terminal 10 . The terminal 10 can communicate with the application server 20, the point award determination system 30, and the point management system via the Internet. The smartphone application can execute a process of taking a picture and transmitting the image data of the taken picture to the point awarding system 30 via the Internet.

The application server 20 is a server that manages smartphone applications, and is interposed between the terminal 10 and the point management system 40 .

The point award determination system 30 has first to sixth servers 31-36.

The first server 31 is a virtual server that operates according to a point award determination application. The first server 31 can communicate with the terminal 10, the application server 20, and the second to sixth servers 32-36.

The second server 32 is SaaS having a two-dimensional code reader function. When image data including the two-dimensional code 51 is input to the second server 32, the second server 32 can read the two-dimensional code and output the information. In this embodiment, the two-dimensional code 51 is DataMatrix, and the information of the two-dimensional code 51 is the product code. As the second server 32, for example, a generally available SaaS for two-dimensional code reader can be used.

The third server 33 is a SaaS with an OCR function. When image data including character codes is input to the third server 33 and its rough position and direction are indicated, the third server 33 can read the character codes and output the information. In this embodiment, the character code 52 is alphanumeric, and the information of the character code 52 is, for example, a factory unique number and a serial code. As the third server 33, for example, a commonly available SaaS for OCR can be used.

The fourth server 34 is SaaS having a form recognition function using AI technology. The fourth server 34 has training data obtained by modeling image data of a large number of photographs of various forms corresponding to predetermined forms by machine learning. When the image data is input, the fourth server 34 can evaluate the degree to which the morphology recognized from the image data is recognized as a predetermined morphology, and output the value of the evaluation. Such evaluation values are, for example, percentages. As the fourth server 34, for example, Custom Vision included in Cognitive Service of Microsoft (registered trademark) Azure (registered trademark) can be used.

A fifth server 35 is a virtual server having the function of a serial code database. When the serial code of the product is input to the fifth server 35, the fifth server 35 refers to a table in which the serial code and the opening history of the product (packaging container G) corresponding to the serial code are recorded. It is possible to output whether or not history is recorded.

A sixth server 36 is a virtual server having a product database function. When information on the type of product is input to the sixth server, the sixth server records the type of product (packaging container G) and the content of benefits corresponding thereto (for example, the number of points, point type, point period). It is possible to output the information on the contents of the privilege by referring to the table.

The point management system 40 has a seventh server 41 and an eighth server 42 .

A seventh server 41 is a virtual server that operates according to a points management application, and an eighth server 42 is a virtual server that functions as a customer/points database 42 . When the consumer's personal identification information and privilege content information are input from the terminal 10 to the seventh server 41 via the application server 20, the seventh server 41 accesses the eighth server 42 to It is possible to record the information of the consumer (customer) specified by the identification information and the content of the benefits belonging to it in the database of the eighth server 42 and read out from it.

Next, an example of a method for recording the opening history of individual products according to the present invention will be described. FIGS. 2-4 are an example of a flow chart in which the method according to the invention for recording the opening history of individual packaged foods G is used.

Stage S10 shown in FIG. 2 represents a preparatory stage for carrying out the method according to the invention.

In S11, the consumer legally obtains the packaged food G. For example, the consumer obtains the packaged food G by purchasing the packaged food G or by distributing the packaged food G to the consumer free of charge. A consumer opens the packaged food G (specifically, the packaging bag B), eats food such as potato chips, or puts the food on a plate.

The consumer can flatten and fold the empty packaging bag B. In S12, the consumer folds the packaging bag B in accordance with the folding method specified in the outer surface of the packaging bag B, a specific website, or an application installed in the terminal 10, and the packaged food G after opening (specifically Then, the packaging bag B) is formed into a predetermined shape. The predetermined form is a form that cannot be achieved unless the product (packaged food G) is unsealed.

An example of such a folding method will be described with reference to FIGS. 5 to 13. FIG. First, the flatly flattened packaging bag B is folded in two upwards (see FIGS. 5 and 6), and then folded in two downwards (see FIGS. 6 and 7). Packaging bag B is made so that product uniqueness code 50 (two-dimensional code 51 and character code 52) appears at the left end in the state shown in FIG.

Next, the folded packaging bag B is reversed left and right (see FIGS. 7 and 8), and the left end is folded back and upward along the mountain fold lines in FIG. 8 (see FIGS. 8 and 9). Next, along the valley fold line in FIG. 9, the right end is folded upward (see FIGS. 9 and 10) so as to line up with the upward folded back portion B1. Thereby, the product uniqueness code 50 (two-dimensional code 51 and character code 52) appears again.

Next, along the valley fold line in FIG. 10, the upward-facing front-side folded portion B2 is folded sideways and slid under the upward-facing back-side folded portion B1 (see FIGS. 10 to 12). Next, by turning over the whole, the product uniqueness code 50 (two-dimensional code 51 and character code 52) reappears and becomes a pentagon, which is the predetermined shape of the packaged food G after opening (FIGS. 12 and 12). 13). That is, in a predetermined form of the packaged food G after opening, the product uniqueness code 50 including information on the packaged food G and the uniqueness of the packaged food G is exposed.

Even if the packaging bag B is folded in accordance with the folding method described above, the pentagonal shape (reference shape) as shown in FIG. 13 may not be obtained. For example, at the stage shown in FIG. 9, if the length of the folded back portion B1 on the back side is long, the form (similar form) that is not pentagonal as shown in FIG. 14 may occur. However, both the reference form and the similar form are forms that cannot be achieved unless the packaging bag B is opened, and are within the range of predetermined forms.

The consumer then activates the application installed on the terminal 10 at S13. Next, according to the instructions of the application, the consumer takes a picture of the shape of the folded packaging bag B and the product uniqueness code 50 together with the camera (not shown) of the terminal 10, and the photograph is taken. The image data is transmitted to the point giving system 30 via the Internet. At this time, the personal identification information of the terminal 10 is also transmitted together.

Step S<b>20 shown in FIG. 3 is a step of recording the opening history of individual packaged foods G and determining the content of benefits and transmitting them to the terminal 10 by the point award determination system 30 .

In S21, the first server 31 transmits the image data of the photograph together with the shape of the unsealed packaged food G (specifically, the packaging bag B) together with the product uniqueness code 50 from the terminal 10 via the Internet. receive through.

Next, in S22, the first server 31 reads information on the type of the packaged food G and the uniqueness of the packaged food G from the product uniqueness code 50 portion of the received image data.

Specifically, the image data is transmitted by the first server 31 to the second server 32 (SaaS having a two-dimensional code reader function). In this embodiment (see FIG. 7), information on the type of packaged food G is represented by a two-dimensional code 51. FIG. The second server 32 reads the two-dimensional code 51 and transmits information on the type of packaged food G to the first server 31 .

In parallel with this, the image data is transmitted by the first server 31 to the third server 33 (SaaS with OCR function). In this embodiment (see FIG. 7), the uniqueness information of the packaged food G is represented by character code 52 . Information in the character code 52 is read by the third server 33 . In this embodiment, the character code 52 is alphanumeric, and the information of the character code 52 is, for example, a factory unique number and a serial code. The position and orientation of the character code 52 are recognized based on the position and orientation of the two-dimensional code 51, for example. The third server 32 reads the character code 52 and transmits the character code information to the first server 31 .

In parallel with S22, in S23, the first server 31 transmits the image data to the fourth server 34 (SaaS having a shape recognition function using AI technology). The fourth server 34 evaluates the extent to which the shape of the packaged food G recognized from the received image data is recognized as the predetermined shape using AI technology based on teacher data.

Next, in S24, based on the evaluation, the first server 31 determines whether (YES) or not (NO) the form recognized from the received image data corresponds to the predetermined form. For example, if the evaluation value is greater than or equal to a predetermined percentage, it is determined that the recognized morphology corresponds to the predetermined morphology.

In S22, the individual packaged food G is specified by the read information, and in S24, it is determined that the form recognized from the received image data corresponds to a predetermined form, thereby identifying the individual packaged food G. can be recognized that has been opened.

Next, when YES in S24 (when it is determined that the form recognized from the received image data corresponds to the predetermined form), preferably in S25, the first server 31 performs It is checked whether (YES) or not (NO) the sealing history of the individual product specified by the type and uniqueness information of the product is recorded in the fifth server 35 (serial code database). This makes it possible to confirm whether or not there is a double application. Specifically, the first server 31 accesses the fourth server 34 to determine whether the opening history corresponding to the serial code of the individual packaged food G specified in S22 is recorded in the serial code database (YES ) or not (NO).

If NO in S25 (when the opening history corresponding to the serial code of the individual packaged food G is not recorded in the computer database), in S26, the first server 31 reads the opening history of the individual packaged food G. is newly recorded in the serial code database of the fifth server 35 .

Also, preferably, in S27, the first server 31 determines the privilege content (for example, the number of points, point type, point period) corresponding to the type of individual packaged food G specified in S22.

Next, in S28, the information that the opening history of the individual packaged food G is recorded by the first server 31 (or that the form recognized from the received image data corresponds to a predetermined form). , and information on the content of the privilege is transmitted to the terminal 10 .

Also, when NO in S24 (when it is determined that the form recognized from the received image data does not correspond to the predetermined form (including when the image is unclear)), and YES in S25 When (when the opening history corresponding to the serial code of the individual packaged food G is recorded in the computer database), in S29, the first server 31 determines that the privilege cannot be given, Send that fact and the reason to the terminal 10 .

Step S30 shown in FIG. 4 is a management step after determining the content of the privilege.

In S31, when the terminal 10 receives the information on the content of the privilege, the application installed in the terminal 10 transmits the personal identification information and the information on the content of the privilege to the point management system 40 via the application server 20 in S32. 7 to the server 41. The purpose of passing through the application server 20 is to ensure security. The seventh server 41 accesses the eighth server 42 and updates the record of the privilege content information for the consumer (customer) identified by the personal identification information.

In this embodiment, image data of a photograph taken together with the product uniqueness code 50 and the pre-determined shape of the packaged food G after opening (specifically, the packaging bag B) is used. The code 50 can be displayed on the surface of the packaging bag, i.e. without concealment.

Although the embodiments of the present invention have been described above, the present invention is not limited to the above embodiments, and various modifications can be made within the scope of the invention described in the claims. is also included within the scope of the present invention.

In the above-described embodiment, the predetermined shape was a shape with a pentagonal shape as the basic shape (see FIG. 13), but the shape shown in FIG. Alternatively, the form shown in FIG. 5 may be a predetermined form. The predetermined form is arbitrary as long as it is a form that cannot be achieved unless the product (packaged food G) is unsealed.

In the above embodiment, the shape of the entire packaged food G (specifically, the packaging bag B) after opening is predetermined. It may be shaped, or part of the packaged food G after opening may be shaped in advance. For example, only the lid removed from the cup-shaped packaged food may have a predetermined shape (see FIG. 15). In the above embodiment, the products were packaged foods, but other products may be used.

The product uniqueness code 50 is not limited to the two-dimensional code 51 or character code 52, and may be a one-dimensional code such as a bar code. Also, in the above embodiment, both the two-dimensional code 51 and the character code 52 are used, but only a large two-dimensional code may be used. The two-dimensional code may be a QR code (registered trademark) or the like.

10 terminal 31 first server 32 second server (two-dimensional code reader function)
33 Third server (OCR function)
34 Fourth server (form recognition function)
35 Fifth Server (Serial Code Database)
36 6th server (product database)
50 Product uniqueness code B Packaging bag (product)
G Packaged food (product)

Claims (10)

1. A method executed by one or more computers for recording an opening history of an individual item in a database of said computer, comprising:
In a predetermined form of the product or part thereof after opening, a product uniqueness code containing information on product type and product uniqueness is exposed;
a step of receiving, from a terminal via the Internet, image data of a photograph of the unsealed product or a form of its part together with the product uniqueness code;
reading product type and product uniqueness information from the product uniqueness code portion of the received image data;
Evaluating, using AI technology, the extent to which the shape of the product or part thereof recognized from the received image data is recognized as the predetermined shape;
determining, based on the evaluation, whether the morphology recognized from the received image data corresponds to the predetermined morphology;
When it is determined that the form recognized from the received image data corresponds to the predetermined form, the sealing history of the individual product specified by the read product type and product uniqueness information is transferred to the computer. a step of checking whether it is recorded in the database of
and recording the opening history of the individual product in a database of the computer when the opening history of the individual product is not recorded in the database of the computer. 2. The method of claim 1, wherein the predetermined configuration includes a configuration in which a packaging bag or packaging box is folded. 2. The method of claim 1, wherein said predetermined configuration comprises a configuration of a lid removed from a cup-shaped product. Furthermore, a step of determining the content of the privilege based on the type of the read product;
2. The method according to claim 1, further comprising transmitting information indicating that the form recognized from the received image data corresponds to the predetermined form and the content of the privilege to the terminal. A program that is executed by one or more computers and records the opening history of individual products in a database of the computer,
In a predetermined form of the product or part thereof after opening, a product uniqueness code containing information on product type and product uniqueness is exposed;
A process of receiving image data of a photograph of the unsealed product or its partial form together with the product uniqueness code from the terminal via the Internet;
a process of reading product type and product uniqueness information from the product uniqueness code portion of the received image data;
a process of evaluating, using AI technology, the extent to which the shape of the product or part thereof recognized from the received image data is recognized as the predetermined shape;
a process of determining whether or not the form recognized from the received image data corresponds to the predetermined form based on the evaluation;
When it is determined that the form recognized from the received image data corresponds to the predetermined form, the sealing history of the individual product specified by the read product type and product uniqueness information is transferred to the computer. a process of checking whether or not it is recorded in the database of
and a process of recording the opening history of the individual product in the database of the computer when the history of opening the individual product is not recorded in the database of the computer. 6. The program according to claim 5, wherein said predetermined form includes a form in which a packaging bag or box is folded, or a form in which a lid is removed from a cup-shaped product. Furthermore, a process of determining the contents of the privilege based on the type of the read product;
6. The program according to claim 5, for executing a process of transmitting information indicating that the form recognized from the received image data corresponds to the predetermined form and the content of the privilege to the terminal. A system comprising one or more computers for recording the opening history of individual products in a database of said computer,
In a predetermined form of the product or part thereof after opening, a product uniqueness code containing information on product type and product uniqueness is exposed;
A process of receiving image data of a photograph of the unsealed product or its partial form together with the product uniqueness code from the terminal via the Internet;
a process of reading product type and product uniqueness information from the product uniqueness code portion of the received image data;
a process of evaluating, using AI technology, the extent to which the shape of the product or part thereof recognized from the received image data is recognized as the predetermined shape;
a process of determining whether or not the form recognized from the received image data corresponds to the predetermined form based on the evaluation;
When it is determined that the form recognized from the received image data corresponds to the predetermined form, the sealing history of the individual product specified by the read product type and product uniqueness information is transferred to the computer. a process of checking whether or not it is recorded in the database of
and a process of recording the opening history of the individual product in the database of the computer when the history of opening the individual product is not recorded in the database of the computer. 9. The system according to claim 8, wherein said predetermined configuration includes a configuration in which a packaging bag or packaging box is folded, or a configuration in which a lid is removed from a cup-shaped product. Furthermore, a process of determining the contents of the privilege based on the type of the read product;
9. The system according to claim 8, further comprising transmitting information indicating that the form recognized from the received image data corresponds to the predetermined form and the content of the privilege to the terminal.

Images