JP2021189506A - Method, program and system for recording opening history of individual product - Google Patents

Abstract

To provide a method etc. for recording an opening history of an individual product.SOLUTION: In the method according to the present invention, a product uniqueness code is exposed in a predetermined form of a product after opening. The method according to the present invention is executed by a computer, receives image data of a photograph taken together with the form of the product after opening and the product uniqueness code, reads information on the type of the product and the uniqueness of the product from a part of the product uniqueness code in the image data, evaluates the degree to which the form of the product recognized from the image data is recognized as a predetermined form, determines, based on the evaluation, whether or not the form of the product recognized from the image data corresponds to a predetermined form, confirms, if it is determined so, whether or not an opening history of the identified individual product is recorded in the database, and records, if it is not recorded so, the opening history of individual products in the database.SELECTED DRAWING: Figure 3

Description

The present invention relates to a method, a program and a system for recording the opening history of individual products.

A code containing information on the type of product such as food and beverages and the uniqueness of the product (product unique code) is displayed on the packaging material of the product, and the consumer of the product can use the product unique code to make points. It is known to apply for benefits such as campaigns and campaigns.

However, there is a risk of fraudulently acquiring the product uniqueness code of the displayed product and applying for the privilege without actually purchasing the product.

In order to prevent such fraud, there are known products in which the product uniqueness code cannot be seen unless the packaging material of the product is opened, and thus the product cannot be obtained (for example,). See Patent Document 1). Based on the information of the product uniqueness code acquired by such a method, the information that the individual product has been opened (opening history of the individual product) is recorded in the database of the computer of the system.

Japanese Unexamined Patent Publication No. 2017-178382

It is an object of the present invention to provide a method, a program and a system for recording the opening history of individual products in a computer database in a manner different from the conventional method.

A second object of the present invention is to provide a method, a program, and a system for recognizing that an individual product has been opened and determining a privilege content in a manner different from the conventional one.

In order to achieve the above object, in the method according to the present invention, which is executed by one or more computers and records the opening history of individual products in the database of the computer, the opened product or a part thereof is predetermined. In the form, a product unique code containing information on the type of product and the uniqueness of the product is exposed, and the method is an image of a photograph taken together with the form of the opened product or a part thereof and the product unique code. It is recognized from the stage of receiving data from the terminal via the Internet, the stage of reading the product type and product uniqueness information from the product uniqueness code part of the received image data, and the received image data. The stage of evaluating the degree to which the product or a part thereof is recognized as the predetermined form by using AI technology, and the form recognized from the received image data based on the evaluation are the predetermined forms. When it is determined that the form recognized from the received image data corresponds to the predetermined form at the stage of determining whether or not the form corresponds to the predetermined form, the type of the read product and the uniqueness of the product are determined. At the stage of confirming whether or not the sealing history of the individual product specified by the information is recorded in the computer database, and when the opening history of the individual product is not recorded in the computer database. It is characterized by including a step of recording the opening history of the individual product in a database of the computer.

Further, in order to achieve the above object, in the program according to the present invention, which is executed by one or more computers and records the opening history of individual products in the database of the computer, the product after opening or a part thereof. In a predetermined form, a product unique code containing information on the type of product and the uniqueness of the product is exposed, and the program captures the form of the opened product or a part thereof and the product unique code together. The process of receiving the image data of the photographed photo from the terminal via the Internet, the process of reading the information on the type of product and the uniqueness of the product from the part of the product uniqueness code of the received image data, and the received image data. The degree to which the product recognized from the computer or a part thereof is recognized as the predetermined form is recognized from the process of evaluating using the AI technology and the received image data based on the evaluation. When it is determined that the form corresponds to the predetermined form or not, and the form recognized from the received image data corresponds to the predetermined form, the type and product of the read product. The process of confirming whether or not the sealing history of an individual product specified by the uniqueness information of the individual product is recorded in the computer database, and the opening history of the individual product is recorded in the computer database. When not, the process of recording the opening history of the individual product in the database of the computer is executed.

Further, in order to achieve the above object, in the system according to the present invention provided with one or more computers and for recording the opening history of individual products in the database of the computer, the product after opening or a part thereof can be stored in advance. In a predetermined form, a product uniqueness code containing information on the type of product and the uniqueness of the product is exposed, and the system photographs the form of the opened product or a part thereof and the product uniqueness code together. Processing to receive image data of a photo from a terminal via the Internet, processing to read information on product type and product uniqueness from the product uniqueness code part of the received image data, and processing to read from the received image data. A process of evaluating the degree to which the recognized product or a part thereof is recognized as the predetermined form by using AI technology, and a form recognized from the received image data based on the evaluation. The process of determining whether or not corresponds to the predetermined form, and when it is determined that the form recognized from the received image data corresponds to the predetermined form, the type of the read product and the product The process of confirming whether or not the sealing history of an individual product specified by the uniqueness information is recorded in the computer database, and the opening history of the individual product are recorded in the computer database. When not present, the computer executes the process of recording the opening history of the individual product in the database of the computer.

In the method, program and system configured in this way, one or more computers may transfer the image data of a photograph taken together with the form of the opened product or a part thereof and the uniqueness code from the terminal via the Internet. The information on the type of the product and the uniqueness of the product is read from the uniqueness code portion of the received image data. Thereby, individual products are identified. Further, the one or more computers recognize that the product has been opened when it is determined that the form recognized from the received image data corresponds to a predetermined form. The predetermined form is a form that cannot be achieved without opening the product. Based on these results, the opening history of individual products is recorded in the database of the computer. The product uniqueness code may be read in an unopened state of the product, and the opening history of individual products is not recorded in the database only by the information of the product uniqueness code.

In the above method, program and system, the predetermined form may include a folded form of a packaging bag or a packaging box, or may include a form of a lid removed from a cup-shaped product.

In order to achieve the second object in the above method, preferably, a step of determining the privilege content based on the type of the read product and a form recognized from the received image data are determined in advance. It includes a step of transmitting the information that corresponds to the above-mentioned form and the privilege content to the terminal.

In order to achieve the second object in the program, preferably, a process of determining the privilege content based on the type of the read product and a form recognized from the received image data are determined in advance. The process of transmitting the information that corresponds to the above-mentioned form and the privilege content to the terminal is executed.

In order to achieve the second object in the system, preferably, a process of determining the privilege content based on the type of the read product and a form recognized from the received image data are predetermined. The computer executes the process of transmitting the information that corresponds to the above-mentioned form and the privilege content to the terminal.

It is a schematic diagram of an example of the system used in the method according to this invention. It is a flowchart of an example of the method by this invention. It is a flowchart of an example of the method by this invention. It is a flowchart of an example of the method by this invention. It is a figure which shows the procedure of folding an empty packaging bag. It is a figure which shows the procedure of folding an empty packaging bag. It is a figure which shows the procedure of folding an empty packaging bag. It is a figure which shows the procedure of folding an empty packaging bag. It is a figure which shows the procedure of folding an empty packaging bag. It is a figure which shows the procedure of folding an empty packaging bag. It is a figure which shows the procedure of folding an empty packaging bag. It is a figure which shows the procedure of folding an empty packaging bag. It is a figure which shows the basic form of a folded empty packaging bag. It is a figure which shows an example of the similar form of a folded empty packaging bag. It is a figure which shows the form of the lid removed from a cup-shaped product.

With reference to the drawings, a method of recording the opening history of individual products, a program and a system will be described, and a method of accompanying (sending privilege content), a program and a system will be described. The individual product is, for example, a packaged food G such as potato chips sealed in the package bag B, and the method of recording the opening history of the packaged food G (specifically, the package bag B) will be described below. .. A product unique code 50 including information on the packaged food G and information on the uniqueness of the packaged food G is printed on the packaging bag B (see FIG. 7). In the embodiment described below, the product uniqueness code 50 is a two-dimensional code 51 including information on the type of the packaged food G and a character code 52 including information on the uniqueness of the packaged food G.

FIG. 1 is a schematic diagram of an example of a system in which a step or process included in the method of recording the opening history of an individual packaged food product G according to the present invention is executed by a program. The system 1 includes a terminal 10 such as a consumer's personal digital assistant, an application server and 20 for managing applications installed on the terminal 10, a point grant determination system 30, and a point management system 40.

The application server 20, the point grant determination system 30, and the point management system are each composed of one or a plurality of computers, and such computers may function as a physical server or a virtual server. May function as. In this embodiment, the computer is a virtual server. Further, each virtual server has hardware resources that exhibit CPU functions, memory functions, communication functions, input / output functions, and the like, but detailed description thereof will be omitted. The virtual server (computer) operates in cooperation with each software (program).

The terminal 10 is configured by, for example, a smartphone and is operated by a consumer. The terminal 10 has a camera function (not shown) and operates according to a smartphone application installed in the terminal 10. The terminal 10 can communicate with the application server 20, the point grant determination system 30, and the point management system via the Internet. The smartphone application can take a picture and cause the point giving system 30 to execute a process of transmitting the image data of the taken picture to the point giving system 30 via the Internet.

The application server 20 is a server that manages smartphone applications, and is interposed between the terminal 10 and the point management system 40.

The point grant determination system 30 has first to sixth servers 31 to 36.

The first server 31 is a virtual server that operates according to the point grant determination application. The first server 31 can communicate with the terminal 10, the application server 20, and the second to sixth servers 32 to 36.

The second server 32 is SaaS having a function of a two-dimensional code reader. When image data including the two-dimensional code 51 is input to the second server 32, the second server 32 can read the two-dimensional code and output the information. In this embodiment, the two-dimensional code 51 is a DataMatrix, and the information of the two-dimensional code 51 is a product code. As the second server 32, for example, a generally available SaaS for a two-dimensional code reader can be used.

The third server 33 is SaaS having an OCR function. When image data including a character code is input to the third server 33 and a rough position and orientation thereof are instructed, the third server 33 can read the character code and output the information. In this embodiment, the character code 52 is an alphanumerical character, and the information of the character code 52 is, for example, a factory-specific number and a serial code. As the third server 33, for example, generally available SaaS for OCR can be used.

The fourth server 34 is SaaS having a form recognition function using AI technology. The fourth server 34 has teacher data in which image data of a large number of photographs taken of various forms corresponding to predetermined forms are modeled by machine learning, and the fourth server 34 should make a judgment. When the image data is input, the fourth server 34 can evaluate the degree to which the form recognized from the image data is recognized as a predetermined form, and output the evaluation value. The value of such an evaluation is, for example, a percentage display. As the fourth server 34, for example, Custom Vision included in the Cognitive Service of Microsoft (registered trademark) Azure (registered trademark) can be used.

The fifth server 35 is a virtual server having a function of a serial code database. When the serial code of the product is input to the fifth server 35, the fifth server 35 refers to the table in which the serial code and the opening history of the corresponding product (packaging container G) are recorded, and opens the product. It is possible to output whether or not the history is recorded.

The sixth server 36 is a virtual server having a function of a product database. When the product type information is input to the sixth server, the sixth server records the type of the product (packaging container G) and the corresponding privilege content (for example, the number of points, the point type, and the point period). It is possible to output information on the contents of such benefits by referring to the table.

The point management system 40 has a seventh server 41 and an eighth server 42.

The seventh server 41 is a virtual server that operates according to the point management application, and the eighth server 42 is a virtual server that functions as a customer / point database 42. When the personal identification information of the consumer and the information of the privilege content are input from the terminal 10 to the seventh server 41 via the application server 20, the seventh server 41 accesses the eighth server 42 and is an individual. It is possible to record and read the information of the consumer (customer) specified by the identification information and the privilege content belonging to the information in the database of the eighth server 42.

Next, an example of a method of recording the opening history of individual products according to the present invention will be described. 2 to 4 are an example of a flowchart in which the method according to the present invention for recording the opening history of individual packaged foods G is used.

Step S10 shown in FIG. 2 shows a preparatory step for carrying out the method according to the present invention.

In S11, the consumer legitimately obtains the packaged food G. For example, the consumer obtains the packaged food G by purchasing the packaged food G or distributing the packaged food G to the consumer free of charge. The consumer opens the packaged food G (specifically, the package bag B) to eat food such as potato chips or put the food on a plate.

The consumer can crush the empty packaging bag B flat and fold it. In S12, the consumer folds the packaging bag B according to the folding method specified in the outer surface of the packaging bag B or the application installed on a specific website or terminal 10, and the packaged food G (specifically) after opening. The packaging bag B) is made into a predetermined form. The predetermined form is a form that cannot be achieved without opening the product (packaged food G).

An example of such a folding method will be described with reference to FIGS. 5 to 13. First, the flatly crushed packaging bag B is folded in half upwards (see FIGS. 5 and 6) and then folded in half downwards (see FIGS. 6 and 7). The packaging bag B is made so that the product uniqueness code 50 (two-dimensional code 51 and character code 52) appears at the left end in the state shown in FIG. 7.

Then, the folded packaging bag B is turned upside down (see FIGS. 7 and 8), and the left end is folded back and upward along the mountain fold line of FIG. 8 (see FIGS. 8 and 9). Then, along the valley fold line of FIG. 9, the right end is folded back to the front side (front side) and upward so as to be aligned with the folded portion B1 on the back side facing upward (see FIGS. 9 and 10). As a result, the product uniqueness code 50 (two-dimensional code 51 and character code 52) reappears.

Next, along the valley fold line of FIG. 10, the upward folded portion B2 on the front side is folded sideways and slid under the folded portion B1 on the upward back side (see FIGS. 10 to 12). Then, by turning the whole over, the product unique code 50 (two-dimensional code 51 and character code 52) reappears and becomes a pentagon, which is a predetermined form of the packaged food G after opening (FIGS. 12 and 12). See 13). That is, in a predetermined form of the packaged food G after opening, the product uniqueness code 50 containing the uniqueness information of the packaged food G and the packaged food G is exposed.

Even if the packaging bag B is folded according to the above-mentioned folding method, it may not have a pentagonal shape (reference shape) as shown in FIG. For example, at the stage shown in FIG. 9, if the length of the folded portion B1 on the back side is long, it may have a non-pentagonal form (similar form) as shown in FIG. However, both the standard form and the similar form are forms that cannot be achieved without opening the packaging bag B, and are within the range of predetermined forms.

Then, in S13, the consumer activates the application installed on the terminal 10. Then, according to the instructions of the application, the consumer takes a picture with the camera of the terminal 10 (not shown) together with the form of the folded packaging bag B and the product uniqueness code 50, and the photograph is taken. The image data is transmitted to the point giving system 30 via the Internet. At this time, the personal identification information of the terminal 10 is also transmitted.

The step S20 shown in FIG. 3 is a step of recording the opening history of the individual packaged food G and a step of determining the privilege content and transmitting it to the terminal 10 by the point grant determination system 30.

In S21, the image data of a photograph taken together with the form of the packaged food G (specifically, the packaging bag B) after opening and the product uniqueness code 50 by the first server 31 is transmitted to the Internet from the terminal 10. Receive via.

Next, in S22, the first server 31 reads the information on the type of the packaged food G and the uniqueness of the packaged food G from the portion of the product uniqueness code 50 of the received image data.

Specifically, the image data is transmitted by the first server 31 to the second server 32 (SaaS having a function of a two-dimensional code reader). In this embodiment (see FIG. 7), the information on the type of the packaged food G is represented by the two-dimensional code 51. The second server 32 reads the two-dimensional code 51 and transmits information on the type of the packaged food G to the first server 31.

At the same time, the image data is transmitted by the first server 31 to the third server 33 (Software as a Service having an OCR function). In this embodiment (see FIG. 7), the uniqueness information of the packaged food G is represented by the character code 52. The information of the character code 52 is read by the third server 33. In this embodiment, the character code 52 is an alphanumerical character, and the information of the character code 52 is, for example, a factory-specific number and a serial code. The position and orientation of the character code 52 are recognized, for example, based on the position and orientation of the two-dimensional code 51. The third server 32 reads the character code 52 and transmits the character code information to the first server 31.

In parallel with S22, in S23, the image data is transmitted by the first server 31 to the fourth server 34 (SaaS having a form recognition function using AI technology). The fourth server 34 evaluates the degree to which the form of the packaged food G recognized from the received image data is recognized as the predetermined form by using the AI technique based on the teacher data.

Next, in S24, the first server 31 determines whether or not the form recognized from the received image data corresponds to the predetermined form (YES) or not (NO) based on the evaluation. For example, if the value of the evaluation is a predetermined percentage or more, it is determined that the recognized form corresponds to a predetermined form.

In S22, the individual packaged food G is specified by the read information, and in S24, the form recognized from the received image data is determined to correspond to a predetermined form, so that the individual packaged food G is specified. Can be recognized that has been opened.

Then, when YES in S24 (when it is determined that the form recognized from the received image data corresponds to the predetermined form), preferably, in S25, the product read by the first server 31 It is confirmed whether (YES) or not (NO) whether the sealage history of the individual product specified by the information of the type and the uniqueness of the product is recorded in the fifth server 35 (serial code database). This makes it possible to confirm whether or not the application is a double application. Specifically, the first server 31 accesses the fourth server 34, and is the opening history corresponding to the serial code of the individual packaged food G specified in S22 recorded in the serial code database (YES). ) Check if (NO).

If NO in S25 (when the opening history corresponding to the serial code of the individual packaged food G is not recorded in the database of the computer), in S26, the opening history of the individual packaged food G is determined by the first server 31. Is newly recorded in the serial code database of the fifth server 35.

Further, preferably, in S27, the first server 31 determines the privilege content (for example, the number of points, the point type, and the point period) corresponding to the type of the individual packaged food G specified in S22.

Next, in S28, the information that the opening history of the individual packaged food G was recorded by the first server 31 (or that the form recognized from the received image data corresponds to a predetermined form). , And the information of the privilege content is transmitted to the terminal 10.

Further, when NO in S24 (when it is determined that the form recognized from the received image data does not correspond to the predetermined form (including when the image is unclear)), and YES in S25. When (when the opening history corresponding to the serial code of the individual packaged food G is recorded in the database of the computer), in S29, the first server 31 determines that the privilege cannot be granted. That and the reason are transmitted to the terminal 10.

The stage S30 shown in FIG. 4 is a management stage after the privilege content is determined.

In S31, when the terminal 10 receives the privilege content information, in S32, the personal identification information and the privilege content information are transmitted by the application installed in the terminal 10 to the point management system 40 via the application server 20. It is transmitted to the server 41 of 7. The reason for going through the application server 20 is to ensure security. The seventh server 41 accesses the eighth server 42 and updates the record of the information on the privilege content of the consumer (customer) specified by the personal identification information.

In this embodiment, since the image data of the photograph taken together with the product uniqueness code 50 and the predetermined form of the packaged food G (specifically, the packaging bag B) after opening is used, the product uniqueness is used. The code 50 can be displayed on the surface of the packaging bag, i.e. without hiding.

Although the embodiments of the present invention have been described above, the present invention is not limited to the above embodiments, and various modifications can be made within the scope of the invention described in the claims. Needless to say, is included in the scope of the present invention.

In the above embodiment, the predetermined form is a form in which a pentagon is used as a basic form (see FIG. 13), but a folded form in which the form shown in FIG. 4 is turned over so that the product uniqueness code appears. Alternatively, the form shown in FIG. 5 may be a predetermined form. The predetermined form is arbitrary as long as it is a form that cannot be achieved without opening the product (packaged food G).

In the above embodiment, the entire packaged food G (specifically, the packaging bag B) after opening is in a predetermined form, but the form of the packaging material such as a packaging box other than the packaging bag B is predetermined. It may be in a form, or a part of the packaged food G after opening may be in a predetermined form. For example, only the lid removed from the cup-shaped packaged food may be in a predetermined form (see FIG. 15). In the above embodiment, the product is a packaged food, but other products may be used.

The product uniqueness code 50 is not limited to the two-dimensional code 51 and the character code 52, and may be a one-dimensional code such as a bar code. Further, in the above embodiment, both the two-dimensional code 51 and the character code 52 are used, but only a large-sized two-dimensional code may be used. The two-dimensional code may be a QR code (registered trademark) or the like.

10 Terminal 31 First server 32 Second server (two-dimensional code reader function)
33 Third server (OCR function)
34 Fourth server (form recognition function)
35 Fifth server (serial code database)
36 6th server (product database)
50 Product uniqueness code B Packaging bag (product)
G Packaged food (product)

Claims (10)

A method of recording the opening history of individual products in the database of the computer, which is executed by one or more computers.
In a predetermined form of the opened product or a part thereof, a product uniqueness code containing information on the type of product and the uniqueness of the product is exposed.
At the stage of receiving the image data of the photograph taken together with the form of the product or a part thereof after opening and the product uniqueness code from the terminal via the Internet,
At the stage of reading the product type and product uniqueness information from the product uniqueness code part of the received image data,
The stage of evaluating the degree to which the product recognized from the received image data or a part thereof is recognized as the predetermined form by using the AI technology, and
Based on the evaluation, a step of determining whether or not the form recognized from the received image data corresponds to the predetermined form, and
When it is determined that the form recognized from the received image data corresponds to the predetermined form, the personalized seal history of the individual product specified by the read product type and the uniqueness information of the product is recorded in the computer. At the stage of checking whether it is recorded in the database of
A method comprising recording the opening history of the individual product in the database of the computer when the opening history of the individual product is not recorded in the database of the computer. The method according to claim 1, wherein the predetermined form includes a folded form of a packaging bag or a packaging box. The method of claim 1, wherein the predetermined form comprises the form of a lid removed from a cup-shaped product. Furthermore, at the stage of deciding the privilege content based on the type of read product,
The method according to claim 1, wherein the form recognized from the received image data corresponds to the predetermined form, and the step of transmitting the privilege content to the terminal. A program executed by one or more computers to record the opening history of individual products in the database of the computer.
In a predetermined form of the opened product or a part thereof, a product uniqueness code containing information on the type of product and the uniqueness of the product is exposed.
The process of receiving the image data of the photograph taken together with the form of the product or a part of it after opening and the product uniqueness code from the terminal via the Internet.
Processing to read product type and product uniqueness information from the product uniqueness code part of the received image data,
A process of evaluating the degree to which a product recognized from received image data or a part thereof is recognized as the predetermined form by using AI technology, and
Based on the evaluation, a process of determining whether or not the form recognized from the received image data corresponds to the predetermined form, and
When it is determined that the form recognized from the received image data corresponds to the predetermined form, the personalized seal history of the individual product specified by the read product type and the uniqueness information of the product is recorded in the computer. The process of checking whether it is recorded in the database of
A program for executing a process of recording the opening history of the individual product in the database of the computer when the opening history of the individual product is not recorded in the database of the computer. The program according to claim 5, wherein the predetermined form includes a form in which a packaging bag or a packaging box is folded, or a form in which a lid is removed from a cup-shaped product. Furthermore, the process of determining the privilege content based on the type of read product,
The program according to claim 5, wherein the information that the form recognized from the received image data corresponds to the predetermined form and the process of transmitting the privilege content to the terminal are executed. A system equipped with one or more computers for recording the opening history of individual products in the database of the computer.
In a predetermined form of the opened product or a part thereof, a product uniqueness code containing information on the type of product and the uniqueness of the product is exposed.
The process of receiving the image data of the photograph taken together with the form of the product or a part of it after opening and the product uniqueness code from the terminal via the Internet.
Processing to read product type and product uniqueness information from the product uniqueness code part of the received image data,
A process of evaluating the degree to which a product recognized from received image data or a part thereof is recognized as the predetermined form by using AI technology, and
Based on the evaluation, a process of determining whether or not the form recognized from the received image data corresponds to the predetermined form, and
When it is determined that the form recognized from the received image data corresponds to the predetermined form, the personalized seal history of the individual product specified by the read product type and the uniqueness information of the product is recorded in the computer. The process of checking whether it is recorded in the database of
A system in which the computer executes a process of recording the opening history of the individual products in the database of the computer when the opening history of the individual products is not recorded in the database of the computer. The system according to claim 8, wherein the predetermined form includes a form in which a packaging bag or a packaging box is folded, or a form in which a lid is removed from a cup-shaped product. Furthermore, the process of determining the privilege content based on the type of read product,
The system according to claim 8, wherein the information that the form recognized from the received image data corresponds to the predetermined form and the process of transmitting the privilege content to the terminal are executed.

Images