JP7066257B2 - Computer system, visitor behavior offer offer method and program - Google Patents

Description

The present invention relates to a computer system for analyzing a visitor, a visitor behavior provision offer method and a program.

In recent years, a method of proposing an advertisement or a predetermined product to a consumer has been devised based on the consumer's psychology and willingness to purchase. As an example of such a method, a configuration is disclosed in which a consumer's willingness to purchase is determined based on the movement of the consumer in front of a product display shelf, and content is provided according to the consumer's willingness to purchase (Patent Document 1). reference).

Japanese Unexamined Patent Publication No. 2018-45454

However, in the configuration of Patent Document 1, since the analysis result of the consumer's pre-shelf psychology and pre-shelf behavior is held only by the store where the consumer visits, the manufacturer producing this product or this product is used. It was difficult for other stores to handle, manufacturers that produce related products of this product, or stores that sell this related product to share. Therefore, it has been difficult for manufacturers and other stores to utilize it for the development and sale of new products based on the psychology and behavior of consumers. In addition, simply providing the consumer's shelving psychology and shelving behavior analyzed by the retailer to the manufacturer and other stores may not be sufficient for the retailer to obtain sufficient profits.

The present invention encourages manufacturers and other retailers to develop new products by providing the analysis results of visitor attributes and purchase consideration behavior to manufacturers and other retailers, and also to the analyzed retailers. It also aims to provide computer systems, store visitor behavior offer offer methods and programs that are easy to provide profits.

The present invention provides the following solutions.

The present invention comprises an image analysis means for analyzing an acquired image of a visitor, and an image analysis means.
An analysis means for analyzing the attributes and purchase consideration behavior of the visitor based on the analysis result of the image, and analyzing the product considered for purchase by the visitor based on the attributes and purchase consideration behavior.
The related product of the product is identified based on the analyzed product that the visitor has considered purchasing, and the product that the visitor has considered purchasing or the store and / or the manufacturer associated with the related product is identified as the visitor. Specific means to identify the product considered for purchase or the store and / or manufacturer that handles the related product of the product.
An offer means for offering the analysis results to the specified retailer and / or manufacturer.
Receiving means to receive consideration from the retailer and / or manufacturer who received the offer,
A notification means for notifying the dealer and / or the manufacturer who did not receive the offer of a message prompting the provision of the required attribute or the content of the purchase consideration action.
Equipped with
The analysis means provides a computer system characterized by adding the content of the attribute or purchase consideration behavior included in the response to the notification result to the analysis content.

According to the present invention, the acquired image of the visitor is analyzed, the attribute of the visitor and the purchase consideration behavior are analyzed based on the analysis result of the image, and the visit is based on the attribute and the purchase consideration behavior. Analyzes the products that the person has considered purchasing, identifies the related products of the product based on the products that the analyzed visitor has considered purchasing, and the products that the visitor has considered purchasing or the stores associated with the related products and / Or identify the manufacturer as a store and / or manufacturer that handles the product that the visitor considered purchasing or a product related to the product, and offer the identified store and / or manufacturer to provide the analysis results. Received consideration from the retailer and / or manufacturer who received the offer, and notified the retailer and / or manufacturer who did not receive the offer of a message urging them to provide the required attributes or the content of the purchase consideration action. , The content of the attribute or purchase consideration behavior included in the response to the notification result is added to the analysis content.

Although the present invention is in the category of systems, the same actions and effects are exhibited in other categories such as methods and programs according to the categories.

According to the present invention, by providing the analysis result of the attribute of the visitor and the purchase consideration behavior to the maker and other stores, the maker and other stores are encouraged to develop new products, and the analyzed sales are performed. It will be possible to provide computer systems, store visitor behavior provision offer methods and programs that are easy to provide profits to stores.

FIG. 1 is a diagram showing an outline of a store visitor behavior providing offer system 1. FIG. 2 is an overall configuration diagram of the store visitor behavior provision offer system 1. FIG. 3 is a flowchart showing a visitor action provision offer process executed by the computer 10. FIG. 4 is a flowchart showing a consideration receiving process executed by the computer 10. FIG. 5 is an example of a diagram schematically showing an image acquired by the computer 10.

Hereinafter, the best mode for carrying out the present invention will be described with reference to the drawings. It should be noted that this is only an example, and the technical scope of the present invention is not limited to this.

[Outline of visitor behavior offer offer system 1]
An outline of a preferred embodiment of the present invention will be described with reference to FIG. FIG. 1 is a diagram for explaining an outline of a store visitor behavior providing offer system 1 which is a preferred embodiment of the present invention. The visitor behavior provision offer system 1 is a computer system composed of a computer 10 and analyzing a visitor.

The visitor behavior provision offer system 1 is installed near the product shelf or the product sales floor, and is a shooting device or product that captures images such as videos and still images of visitors who are near the product shelf or the product sales floor. It may include devices and terminals on the retailer side such as employee terminals owned by employees of the retailer who sells, or computers managed by the manufacturer or other retailer to which the offer is made. Employee terminals and the like owned by employees of manufacturers and other retailers may be included.

Further, the store visitor behavior providing offer system 1 may be realized by one computer such as a computer 10, or may be realized by a plurality of computers such as a cloud computer.

The computer 10 is connected to a photographing device or an employee terminal installed at a product store via a public network, a private network such as an intranet, short-range wireless communication, or wired communication, and is capable of data communication. Send and receive the required data. Further, the computer 10 is connected to an employee terminal of a manufacturer or another store, a computer, or the like via a public line network or the like so as to be capable of data communication, and executes necessary data transmission / reception.

The computer 10 acquires images such as moving images and still images of visitors taken by a photographing device installed near the product shelf or the product sales floor. The computer 10 analyzes this image and analyzes the attributes (age, gender, etc.) of the visitor or the purchase consideration behavior (purchase consideration product, purchase consideration time, etc.). The computer 10 offers the analysis results to other stores and manufacturers that handle the products that the visitor has considered to purchase and / or to the stores and manufacturers that handle related products of this product. Computer 10 receives compensation from the retailer and / or manufacturer that received this offer.

The outline of the process executed by the visitor behavior offer offer system 1 will be described.

The computer 10 acquires an image of a visitor taken by the photographing device (step S01). The computer 10 acquires an image of a visitor in the vicinity of the product shelf by the photographing device. As an example of this image, for example, the user's face, the whole picture, the product being picked up, and the product in the shopping cart are reflected.

The computer 10 analyzes this image and analyzes the attributes of the visitor or the purchase consideration behavior (step S02). As an image analysis, the computer 10 extracts feature points (shape, contour, color, etc.) and feature quantities (statistical numerical values such as average, variance, and histogram of pixel values) of the visitor reflected in this image. Analyze attributes or purchase consideration behavior. For example, the computer 10 recognizes the face of a visitor and analyzes the age and gender. In addition, the computer 10 performs object recognition, character recognition, and the like based on the shape and contour of the product in the line of sight of the visitor and the product held in the hand, and the product the visitor is considering purchasing. Analyze the name and type of. Further, the computer 10 analyzes, for example, the time when the same visitor is reflected in this image as the purchase consideration time.

The computer 10 may be configured to analyze at least one of the gender, age, purchase consideration product, or purchase consideration time of the visitor.

The computer 10 offers the analysis result to other retailers and / or manufacturers of the products that the visitor has considered purchasing, and other retailers and / or manufacturers that handle related products of this product (step S03). ). The computer 10 offers the dealer and / or the manufacturer whether or not to receive the analysis result. An offer is, for example, to present an analysis result and ask the other party for a reply. The analysis result is at least one of the above-mentioned analyzed visitor's gender, age, purchase consideration product, or purchase consideration time.

The computer 10 receives consideration (predetermined fee, service, goods, etc.) from the store and / or the manufacturer that received this offer (step S04). At this time, the computer 10 provides the analysis result to the dealer and / or the manufacturer who received the offer, and receives the consideration.

The above is the outline of the visitor behavior provision offer system 1.

Based on FIG. 2, the system configuration of the visitor behavior providing offer system 1, which is a preferred embodiment of the present invention, will be described. FIG. 2 is a diagram showing a system configuration of a visitor behavior providing offer system 1 which is a preferred embodiment of the present invention. In FIG. 2, the store visitor behavior providing offer system 1 is a computer system composed of a computer 10 and analyzing a store visitor.

The store visitor behavior provision offer system 1 may include other terminals and devices such as the above-mentioned photographing device, employee terminal, and other computer. Further, the visitor behavior providing offer system 1 may be realized by a plurality of computers such as one computer such as a computer 10 or a cloud computer.

The computer 10 has a public network, a private network, a short-range wireless communication, a wired communication, or the like with the above-mentioned photographing device or employee terminal (not shown), an employee terminal or computer at another store and / or a manufacturer. It is connected to enable data communication via, and sends and receives necessary data.

The computer 10 includes a CPU (Central Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), and the like, and as a communication unit, a device for enabling communication with other terminals, devices, and the like, for example, IEEE802. It is equipped with a Wi-Fi (Wi-Filess-Fidelity) compatible device or the like that conforms to 11． Further, the computer 10 includes a data storage unit such as a hard disk, a semiconductor memory, a recording medium, and a memory card as a recording unit. Further, the computer 10 includes various devices and the like that execute various processes as a processing unit.

In the computer 10, the control unit reads a predetermined program to realize the image acquisition module 20, the offer transmission module 21, the offer result acquisition module 22, the data transmission module 23, and the consideration receiving module 24 in cooperation with the communication unit. do. Further, in the computer 10, the control unit reads a predetermined program and cooperates with the recording unit to realize the recording module 30. Further, in the computer 10, the control unit reads a predetermined program, and in cooperation with the processing unit, the image analysis module 40, the analysis module 41, the specified number determination module 42, the specific module 43, the offer creation module 44, and the offer The determination module 45 is realized.

[Visitor behavior offer offer processing]
A visitor behavior offer offer process executed by the visitor behavior offer offer system 1 will be described with reference to FIG. FIG. 3 is a diagram showing a flowchart of a visitor action providing offer process executed by the computer 10. The process executed by each of the above-mentioned modules will be described together with this process.

The image acquisition module 20 acquires an image such as a moving image or a still image of a visitor taken by the photographing device (step S10). In step S10, this image is taken by a photographing device installed near the product shelf or the product sales floor to photograph the visitor. In addition to the face and whole body of the visitor, the product displayed on the product shelf, the product held by the visitor, etc. are reflected in this image. At this time, when the image captured by the photographing device is a still image, the image acquisition module 20 installs a detection sensor for a predetermined time (for example, on a product shelf or a product sales floor, and this detection sensor is used by a visitor. From the time when the detection is started to the time when the detection of the visitor is finished), the image taken by the photographing device is acquired. Further, the image acquisition module 20 may acquire an image constantly captured when the image captured by the imaging device is a moving image.

The timing and method for acquiring the image by the image acquisition module 20 can be appropriately changed, and the present invention is not limited to the above-mentioned example.

The image analysis module 40 analyzes the acquired image (step S11). In step S11, the image analysis module 40 extracts feature points and feature quantities in the acquired image. For example, the image analysis module 40 extracts the shape, contour, color, and the like in this image. Further, for example, the image analysis module 40 extracts statistical numerical values such as an average, a variance, and a histogram of pixel values in this image. At the same time, the image analysis module 40 executes various recognition processes such as face recognition, object recognition, and character recognition as image analysis. For example, the image analysis module 40 extracts the face of a person reflected in this image. The image analysis module 40 extracts the orbit, the nose, the contour of the jaw, the texture of the skin, and the like based on the extracted face. Further, the image analysis module 40 extracts an object based on the shape, contour, color, etc. of the object reflected in this image. Further, the image analysis module 40 extracts characters based on the characters, symbols, numbers, and the like reflected in the image.

The analysis module 41 analyzes the attribute behavior data indicating the attributes and behaviors of the visitor based on the result of the image analysis (step S12). In step S12, the analysis module 41 analyzes the attribute behavior data of the visitor based on the extracted feature amount and feature point. The analysis module 41 analyzes the age and gender of the visitor based on the result of face recognition. Further, the analysis module 41 analyzes the product that the visitor is picking up or the product that the visitor is browsing as a purchase consideration product based on the result of the object recognition or the character recognition. Further, the analysis module 41 considers the purchase of this product based on the time of the visitor shown in the moving image, the still image, etc., and the time of browsing and / or picking up the product specified by the visitor. Analyze time. At this time, the attributes of the visitor are age and gender, and the behavior of the visitor is the purchase consideration product and the purchase consideration time. That is, the attribute behavior data is the age, gender, purchase consideration product, and purchase consideration time of the visitor.

The attributes and actions are not limited to the above-mentioned examples, and may be other ones. Further, the analysis module 41 may be configured to analyze at least one of the above-mentioned age, gender, purchase consideration product, and purchase consideration time. Further, the analysis module 41 is not limited to the above-mentioned example, and may be configured to analyze at least one of the attributes and actions.

The attribute behavior data analyzed by the analysis module 41 will be described with reference to FIG. FIG. 5 is a diagram schematically showing an example of an image acquired by the image acquisition module 20. The image analysis module 40 analyzes the image 100 and extracts a person, a person's face, an object, characters, and the like as described above. As a result, the image analysis module 40 extracts the visitor 110, the product shelf 120, and the product 130 from the image 100.

The analysis module 41 analyzes the attribute behavior data of the visitor 110 reflected in the image 100 based on the result of the image analysis. The analysis module 41 analyzes the age and gender of the visitor 110 based on the face recognition result of the visitor 110. In this example, the analysis module 41 analyzes that the visitor 110 is in his twenties and has a female gender. Further, the analysis module 41 analyzes the product 130 at the tip of the arrow 140 indicating the line-of-sight direction of the visitor 110 and the product 130 touched by the hand 150 of the visitor 110. The analysis module 41 analyzes the name and type of the product 130 based on the object recognition result and the character recognition result of the product 130. At this time, the analysis module 41 refers to the product database in which the feature points and feature quantities of the product are stored in the recording module 30 in advance and the names and types of the products are associated with each other. Analyze names and types. The analysis module 41 analyzes the name, type, and the like of the product 130 by comparing the feature points and feature quantities extracted as a result of the image analysis with the product database. Further, the analysis module 41 analyzes the name and type of the product 130 by recognizing characters such as a label attached to the product 130 and a product name attached to the product shelf 120. This type can also analyze a plurality of types of classifications such as classification 1, classification 2, classification 3, .... In this case, it is possible to make the classification more detailed as the number of the classification becomes larger (conversely, make the classification more detailed as the number becomes smaller). The analysis module 41 analyzes this product 130 as a purchase consideration product. In this example, in the analysis module 41, the product 130, which is the product to be considered for purchase, has the name sparkling wine A, and the types are such that category 1 is beverage, category 2 is alcohol, category 3 is wine, and so on. Analyze based on the classification set or recorded in the product database. Based on the result of the image analysis, the analysis module 41 analyzes the time for browsing the product 130 and the time for picking up the product 130 as the purchase consideration time. The analysis module 41 analyzes the cumulative time when the visitor 110 reflected in the image is looking at the product 130 and the time when the visitor 110 is picking up the product 130 as the purchase examination time. In this example, the analysis module 41 analyzes that the purchase consideration time is 2 minutes.

As described above, the analysis module 41 may be configured to analyze at least one of the attribute behavior data. For example, it may be configured to analyze at least one of the age, gender, purchase consideration product, and purchase consideration time of the visitor 110. However, it is necessary to analyze the name of the product 130 even if the product to be considered for purchase is not subject to analysis. This is because, in the process described later, it is necessary to identify the manufacturer or the store that handles the product 130 and / or the product related to the product 130 based on the name of the product 130. That is, the analysis module 41 may be configured to analyze at least one of age, gender, purchase consideration product (type), and purchase consideration time.

The recording module 30 records the analyzed attribute behavior data (step S13). In step S13, the recording module 30 records the name of the product, the attribute behavior data, and the date and time when the attribute behavior data is analyzed in association with each other.

The recording module 30 may be configured to record only the attribute behavior data.

The specified number determination module 42 determines whether or not the number of samples of the analyzed attribute behavior data has reached a preset specified number (step S14). In step S14, the specified number means the number of samples effective for new product development and marketing. This specified number may be appropriately set according to the type of the product to be purchased and the attributes of the visitor. For example, the specified number determination module 42 determines whether or not the number of samples of attribute action data for the product 130 has reached the specified number.

It should be noted that the configuration may be such that the processing described later is executed regardless of whether or not the specified number has been reached. Further, it may be configured to determine whether or not the number of attribute action data recorded in the recording module 30 for a predetermined period has reached a predetermined number. In this case, it is also possible to effectively use the attribute behavior data in a specific period (for example, event time).

If the specified number determination module 42 determines in step S14 that the specified number has not been reached (step S14 NO), the computer 10 re-executes the process of step S10 described above.

On the other hand, when the specified number determination module 42 determines in step S14 that the specified number has been reached (YES in step S14), the specific module 43 includes the manufacturer producing this product, other retailers handling this product, and the like. / Or, the manufacturer that produces the related product of this product and other retailers that handle this related product are specified (step S15). In step S15, the specific module 43 is a product production / sale in which the name of the product recorded in the recording module 30 in advance, the name of the manufacturer that produces this product, and the name of another store that handles this product are associated with each other. Based on the database, identify the manufacturer that produces this product and other retailers that handle this product. The specific module 43 refers to a product production / sales database and identifies a manufacturer or another store based on the names of products that have reached a specified number. Further, the specific module 43 includes the name of this product recorded in the recording module 30 in advance, the name of the related product of this product, the name of the manufacturer that produces this related product, and other retailers handling this related product. Refer to the related product production and sales database associated with the name of, and identify the manufacturer and other retailers. The specific module 43 refers to a related product production / sales database based on the names of products that have reached a specified number, and identifies a manufacturer or another store.

The offer creation module 44 creates an offer to be presented to the specified manufacturer or other retailer (step S16). In step S16, the offer creation module 44 creates an offer that includes at least the product name, the content of the attribute behavior data, and the consideration. The offer creation module 44, for example, includes the age, gender, purchase consideration product, purchase consideration time, and another product considered by the visitor who considered purchasing this product, as the content of the attribute behavior data. Create a name for. At this time, the offer creation module 44 creates only the heading of the attribute behavior data as an offer.

The offer transmission module 21 transmits the created offer to the specified manufacturer and / or retailer (step S17). In step S17, the offer transmission module 21 will offer the provision of the analysis result to the store and / or the manufacturer that handles the product considered for purchase by the visitor or the product related to this product.

The above is the store visitor behavior provision offer processing.

[Compensation acquisition processing]
The consideration receiving process executed by the visitor behavior offer offer system 1 will be described with reference to FIG. FIG. 4 is a diagram showing a flowchart of the consideration receiving process executed by the computer 10. The process executed by each of the above-mentioned modules will be described together with this process.

The offer result acquisition module 22 acquires the offer result from the transmitting manufacturer and / or the store (step S20). In step S20, the offer result acquisition module 22 acquires the response result of the provided offer by the process of step S17 described above. The result of this offer includes a reply as to whether or not the retailer and / or manufacturer that provided the offer will receive the offer.

If the offer result acquisition module 22 cannot acquire the offer result, the present process ends.

The offer determination module 45 determines whether or not the offer destination receives this offer as a result of the acquired offer (step S21). In step S21, the offer determination module 45 executes this determination based on whether or not the result of the acquired offer includes a reply to receive the offer. When the offer determination module 45 determines that the result of the acquired offer does not include a reply to receive the offer (step S21 NO), the offer determination module 45 ends this process.

If the result of the offer does not include a reply to receive the offer, the computer 10 provides what kind of attribute behavior data is valid, what kind of attribute behavior data is required, and the like. It may be configured to notify the store and / or the manufacturer who acquired the result of the offer of the urging message. At this time, the computer 10 may be configured to newly add the attribute action data included in the response to this message to the image analysis and the analysis content in the processes of steps S11 and S12 described above, and execute the corresponding process. ..

On the other hand, in step S21, when the offer determination module 45 determines that the result of the acquired offer includes a reply to receive the offer (step S21 YES), the data transmission module 23 determines the attribute action presented in the offer. The data is transmitted to the offer destination (step S22). In step S22, the data transmission module 23 transmits the attribute behavior data presented in the offer, the name of this product, and the offer destination.

The consideration receiving module 24 receives the offer and / or the consideration from the dealer and / or the manufacturer as the consideration for providing the analysis result (step S23). In step S23, the consideration receiving module 24 receives a predetermined fee, service, goods, etc. as consideration. This consideration is direct or indirect. At this time, the consideration receiving module 24 may not only receive the data-like consideration but also receive the data necessary for receiving the substance.

The above is the consideration receipt processing.

The above-mentioned means and functions are realized by a computer (including a CPU, an information processing device, and various terminals) reading and executing a predetermined program. The program is provided, for example, in the form of being provided from a computer via a network (Software as a Service). Further, the program is provided in a form recorded on a computer-readable recording medium such as a flexible disk, a CD (CD-ROM or the like), or a DVD (DVD-ROM, DVD-RAM or the like). In this case, the computer reads the program from the recording medium, transfers it to an internal recording device or an external recording device, records the program, and executes the program. Further, the program may be recorded in advance on a recording device (recording medium) such as a magnetic disk, an optical disk, or a magneto-optical disk, and the program may be provided from the recording device to a computer via a communication line.

Although the embodiments of the present invention have been described above, the present invention is not limited to these embodiments described above. Further, the effects described in the embodiments of the present invention merely list the most suitable effects arising from the present invention, and the effects according to the present invention are limited to those described in the embodiments of the present invention. is not.

1 Visitor behavior offer system, 10 Computers

Claims (4)

Image analysis means to analyze the acquired image of the visitor,
An analysis means for analyzing the attributes and purchase consideration behavior of the visitor based on the analysis result of the image, and analyzing the product considered for purchase by the visitor based on the attributes and purchase consideration behavior.
The related product of the product is identified based on the analyzed product that the visitor has considered purchasing, and the product that the visitor has considered purchasing or the store and / or the manufacturer associated with the related product is referred to as the visitor. Specific means to identify the product considered for purchase or the store and / or manufacturer that handles the related product of the product.
An offer means for offering the analysis results to the specified retailer and / or manufacturer.
Receiving means to receive consideration from the retailer and / or manufacturer who received the offer,
A notification means for notifying the dealer and / or the manufacturer who did not receive the offer of a message prompting the provision of the required attribute or the content of the purchase consideration action.
Equipped with
The analysis means adds the content of the attribute or purchase consideration behavior included in the response to the notification result to the analysis content.
A computer system characterized by that. An acquisition method for acquiring an image of the visitor near the product shelf,
An analysis means for analyzing the image and
Further prepare
Based on the result of the analysis, the analysis means analyzes at least one of the gender, age group, purchase consideration time or purchase consideration product type of the visitor, and the name of the purchase consideration product .
The computer system according to claim 1. It is a visitor behavior offer offer method executed by a computer system.
Steps to analyze the acquired image of the visitor and
Based on the analysis result of the image, the attribute and the purchase consideration behavior of the visitor are analyzed, and the step of analyzing the product considered by the visitor based on the attribute and the purchase consideration behavior, and
The related product of the product is identified based on the analyzed product that the visitor has considered purchasing, and the product that the visitor has considered purchasing or the store and / or the manufacturer associated with the related product is referred to as the visitor. And the steps to identify as a retailer and / or manufacturer that handles the product that you have considered purchasing or the related product of the product.
Steps to offer the analysis results to the identified retailer and / or manufacturer, and
Steps to receive compensation from the retailer and / or manufacturer who received the offer,
A step of notifying the dealer and / or the manufacturer who did not receive the offer of a message urging the content of the required attribute or purchase consideration action.
A step to add the content of the attribute or purchase consideration behavior included in the response to the notification result to the analysis content, and
A visitor behavior offer offer method characterized by being equipped with. For computer systems
Steps to analyze the acquired image of the visitor,
A step of analyzing the attribute and purchase consideration behavior of the visitor based on the analysis result of the image, and analyzing the product considered by the visitor based on the attribute and purchase consideration behavior.
The related product of the product is identified based on the analyzed product that the visitor has considered purchasing, and the product that the visitor has considered purchasing or the store and / or the manufacturer associated with the related product is identified as the visitor. Steps to identify as a retailer and / or manufacturer that handles the product that you have considered purchasing or the related product of the product.
A step of offering analysis results to the identified retailer and / or manufacturer.
Steps to receive compensation from the retailer and / or manufacturer who received the offer,
A step of notifying the dealer and / or the manufacturer who did not receive the offer of a message urging the content of the required attribute or purchase consideration action.
Steps to add the content of the attribute or purchase consideration behavior included in the response to the notification result to the analysis content,
A computer-readable program for running.

Images