JP2017228921A - Projection system, projection method, and projection program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To change the appearance of a commodity in accordance with a scene.SOLUTION: A projection system according to one embodiment controls a projection image. The projection system comprises an extraction part which extracts an image corresponding to a commodity displayed for transaction, from an image database storing images, and a transmission part which transmits the image extracted by the extraction part to a projector and thereby causes the projector to project the image on the surface of the displayed commodity.SELECTED DRAWING: Figure 2

Description

  One aspect of the present invention relates to a projection system, a projection method, and a projection program.

  There are various methods for appealing products to customers. For example, Patent Document 1 describes a system for displaying advertisement content of a product on a vehicle. In this system, a projector installed in a vehicle displays an image on the side of the vehicle.

JP2015-511729A

  Depending on the person, even if they are interested in a product through advertisements, when they come into contact with the actual product, they may lose their interest by looking at the appearance of the product. For example, an eye-catching design package may not fit a person's interests and preferences. Or, the design to convey the characteristics of the product in an easy-to-understand manner may make certain people feel embarrassed. Therefore, it is desired to change the appearance of the product according to the scene.

  A projection system according to one aspect of the present invention is a projection system that controls a projection image, and an extraction unit that extracts an image corresponding to a commodity displayed for a transaction from an image database that stores the image; The projector includes a transmitting unit that transmits the image extracted by the extracting unit to the projector, thereby causing the projector to project the image on the surface of the displayed product.

  A projection method according to an aspect of the present invention is a projection method executed by a projection system including a processor that controls a projection image, and corresponds to a commodity displayed for a transaction from an image database storing the image. An extraction step of extracting an image to be transmitted, and a transmission step of causing the projector to project the image onto the surface of the displayed product by transmitting the image extracted in the extraction step to the projector.

  A projection program according to one aspect of the present invention is a projection program that causes a computer to function as a projection system that controls a projection image, and that corresponds to a product displayed for a transaction from an image database that stores the image. The computer executes the extraction step of extracting the image and the transmission step of causing the projector to project the image onto the surface of the displayed product by transmitting the image extracted in the extraction step to the projector.

  In this aspect, when a product is displayed, an image corresponding to the product is displayed on the surface of the product, but when a person picks up the product, the image is no longer displayed on the product. Disappear. With this mechanism, the appearance of the product can be changed between when the product is displayed and when the customer actually picks up the product. That is, the appearance of the product can be changed according to the scene.

  According to one aspect of the present invention, the appearance of a product can be changed according to the scene.

It is a figure which shows an example of application of the projection system which concerns on embodiment. It is a figure which shows the function structure of the projection system which concerns on embodiment. It is a figure which shows the example of apparatus information. It is a figure which shows the example of image information. It is a figure which shows the hardware constitutions of a server. It is a flowchart which shows operation | movement of the projection system which concerns on embodiment. It is a figure which shows the structure of the projection program which concerns on embodiment. It is a figure which shows the example which projects an image on goods.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the description of the drawings, the same or equivalent elements are denoted by the same reference numerals, and redundant description is omitted.

  The function and configuration of the projection system 1 according to the embodiment will be described with reference to FIGS. The projection system 1 is a computer system that projects an image on the surface of a displayed product. “Commodity” is any tangible thing that can be traded for a fee or free of charge, and its type is not limited at all. A “displayed product” is a product placed in a predetermined place for a transaction. For example, the “displayed product” is a product placed on a display shelf or display stand of a real store. The “surface of the product” is the outer surface of the displayed product, for example, the outer surface of a box or a container. An “image” is an image that is projected on the surface of a tangible object and that is visible to a person. The image may be a still image or a moving image. The image may be obtained by photographing or may be computer graphics.

  FIG. 1 shows an example of application of the projection system 1, and specifically shows an example in which an image 90 is projected onto a product (beverage can) 80 placed on a shelf. In the present embodiment, the projection system 1 includes a barcode reader 2, a camera 3, and a projector 4. The barcode reader 2 is a device that reads a barcode attached to the surface of a product. The type of the barcode reader 2 is not limited. For example, a reader that reads a one-dimensional barcode or a reader that reads a two-dimensional barcode may be used. The method of attaching a barcode to a product is not limited at all. For example, a barcode may be printed on the surface of the product, or a seal printed with the barcode may be affixed to the surface of the product. The camera 3 is a device for photographing a person in front of the shelf (a person who came in front of the displayed product). The projector 4 is a device that projects an image on the surface of a product placed in the front row of the shelf, and may be a small ultra-short focus projector, for example. FIG. 1 shows an example in which a barcode reader 2 is installed beside a shelf, a camera is installed at the front end of the shelf, and a projector 4 is installed on the lower surface of the shelf. The appearance of the display shelf can be improved by attaching the projector 4 to an inconspicuous place such as the lower surface of the shelf board. However, the installation location of each device is not limited at all. For example, the projector 4 may be attached to the front side surface of the shelf board. Or each apparatus may be attached to things other than a shelf.

  FIG. 1 shows an example in which the projector 4 projects a balloon image 90 containing characters “Limited time!” On the surface of a product 80 on which a star mark, diagonal lines, and the character string “ABC” are printed. When a person takes the product 80 out of the shelf and picks it up, of course, the image (speech balloon) 90 disappears from the can, and only the star mark, diagonal lines, and the character string “ABC” remain on the surface of the can. Become. In other words, the image provided from the projector 4 is visible only when the product is placed on the shelf, and disappears when the customer obtains the product.

  FIG. 2 shows a functional configuration of the projection system 1. The projection system 1 includes a database group 10 and a server 20 in addition to the barcode reader 2, the camera 3, and the projector 4. Each device in the projection system 1 can perform data communication with other devices via a communication network such as the Internet or a LAN. Although FIG. 2 shows only one display space device group (barcode reader 2, camera 3, and projector 4), the projection system 1 has a plurality of display spaces (for example, a plurality of stages constituting one shelf, A plurality of device groups provided on a plurality of shelves may be included.

  The database group 10 is a set of one or more databases that store data necessary for processing in the projection system 1. In the present embodiment, the database group 10 includes a device database 11 and an image database 12. A “database” is a functional element (storage unit) that stores a data set so that it can cope with any data operation (for example, extraction, addition, deletion, overwriting, etc.) from a processor or an external computer. The database mounting method is not limited. For example, a database management system or a text file may be used.

  The device database 11 is a device that stores device information indicating the correspondence between devices installed on a shelf. FIG. 3 shows an example of device information. In the present embodiment, each record of device information includes a reader ID that uniquely identifies a barcode reader, a camera ID that uniquely identifies a camera, and a projector ID that uniquely identifies a projector. In FIG. 3, for example, a bar code reader “R01”, a camera “C01”, and three projectors “P01”, “P02”, “P03” are installed in one display space (for example, one level of a shelf). Indicates that FIG. 3 also shows that the camera “C01” corresponds to two display spaces (for example, a plurality of stages on one shelf).

  The image database 12 is a device that stores image information indicating an image to be projected onto a product. In this specification, this image is also referred to as a “projection image”. FIG. 4 shows an example of a record of image information. In the present embodiment, each record of image information includes a product ID that uniquely identifies a product, an image (image data) projected on the product, and a projection condition. In FIG. 6, for example, the image X is always projected on the product “P001”, whereas the projected image switches on the product “P002” according to the time zone and the gender of the person who came in front of the shelf. Show. For example, when a woman comes before the product “P002”, the image Yc is projected onto the product “P002”.

  The configuration of each database and each record in the database group 10 is not limited to the above, and any normalization or redundancy may be performed on each database.

  The server 20 is a computer that provides an image to the projector. FIG. 5 shows a general hardware configuration of the server 20. The server 20 includes a processor 101 that executes an operating system, application programs, and the like, a main storage unit 102 that includes a ROM and a RAM, an auxiliary storage unit 103 that includes a hard disk, a flash memory, and the like, and a network card or wireless The communication control unit 104 includes a communication module, an input device 105 such as a keyboard and a mouse, and an output device 106 such as a monitor.

  As illustrated in FIG. 2, the server 20 includes a reception unit 21, an extraction unit 22, and a transmission unit 23 as functional components. These functional elements are realized by reading predetermined software on the processor 101 or the main storage unit 102 and executing the software. The processor 101 operates the communication control unit 104, the input device 105, or the output device 106 in accordance with the software, and reads and writes data in the main storage unit 102 or the auxiliary storage unit 103. Data or a database necessary for processing is stored in the main storage unit 102 or the auxiliary storage unit 103.

  The receiving unit 21 is a functional element that receives data from the barcode reader 2 and the camera 3. The receiving unit 21 receives the barcode data from the barcode reader 2 together with the reader ID, and extracts the product ID from the barcode data. The receiving unit 21 receives a captured image from the camera 3 together with the camera ID. The receiving unit 21 outputs these received data to the extracting unit 22. That is, in the present embodiment, the receiving unit 21 functions as a barcode receiving unit and an image receiving unit.

  The extraction unit 22 is a functional element that extracts an image corresponding to the displayed product from the image database 12. First, the extraction unit 22 sets a search condition including at least a product ID based on the input data. The search condition may further include the current time. The search condition may further include an attribute of the photographed person (subject). “Human attributes” are the nature or characteristics of a person. The kind of attribute is not limited at all, and examples include sex, age, adult and child distinction, and the like. The extraction unit 22 performs image recognition on the input photographed image, thereby determining the attribute of the photographed person (subject). As long as it is used as a search condition for extracting an image from the image database 12, the extraction unit 22 may determine an arbitrary attribute from the captured image. Subsequently, the extraction unit 22 reads an image that matches the set search condition from the image database 12.

  Assuming that the image information is the example shown in FIG. 4, for example, when the product ID “P001” is input, the extraction unit 22 reads the image X regardless of the attribute of the subject and the current time. When the product ID “P002” is input and it is determined that the attribute of the subject is “female”, the extraction unit 22 reads the image Yc. When the product ID “P002” is input and it is determined that the attribute of the subject is “male” and the current time is 18:00, the extraction unit 22 reads the image Yb.

  The extraction unit 22 outputs the read image to the transmission unit 23 together with the reader ID and the camera ID.

  The transmission unit 23 is a functional element that transmits the image extracted by the extraction unit 22 to the projector 4. Through this transmission process, the transmission unit 23 causes the projector 4 to project the image on the surface of the displayed product. The transmission unit 23 reads at least one projector ID corresponding to the input reader ID and camera ID from the device database 11 and transmits the input image to at least one projector 4 indicated by the projector ID. Each projector 4 receives the image and projects the image on the displayed product.

  Next, the operation of the projection system 1 will be described with reference to FIG. 6, and the projection method according to the present embodiment will be described.

  First, the receiving unit 21 receives barcode data from the barcode reader 2 to acquire a product ID (step S11), and receives a photographed image from the camera 3 (step S12). Subsequently, the extraction unit 22 sets a search condition based on at least the product ID (step S13), and extracts an image that matches the search condition from the image database 12 (step S14, extraction step). The extraction unit 22 may set a search condition further including at least one of the attribute of the subject determined from the captured image and the current time. Finally, the transmission unit 23 transmits the extracted image to the projector 4 (step S15, transmission step).

  Next, a projection program P1 for realizing the projection system 1 (server 20) will be described with reference to FIG.

  The projection program P1 includes a main module P10, a reception module P11, an extraction module P12, and a transmission module P13. The main module P10 is a part that comprehensively controls the functions of the projection system 1 (server 20). The functions realized by executing the reception module P11, the extraction module P12, and the transmission module P13 are the same as the functions of the reception unit 21, the extraction unit 22, and the transmission unit 23, respectively.

  The projection program P1 may be provided after being fixedly recorded on a tangible recording medium such as a CD-ROM, DVD-ROM, or semiconductor memory. Alternatively, the projection program P1 may be provided via a communication network as a data signal superimposed on a carrier wave.

  As described above, the projection system according to one aspect of the present invention is a projection system that controls a projection image, and an image corresponding to a product displayed for a transaction is stored in an image database that stores the image. An extraction unit for extraction, and a transmission unit that causes the projector to project the image on the surface of the displayed product by transmitting the image extracted by the extraction unit to the projector.

  A projection method according to an aspect of the present invention is a projection method executed by a projection system including a processor that controls a projection image, and corresponds to a commodity displayed for a transaction from an image database storing the image. An extraction step of extracting an image to be transmitted, and a transmission step of causing the projector to project the image onto the surface of the displayed product by transmitting the image extracted in the extraction step to the projector.

  A projection program according to one aspect of the present invention is a projection program that causes a computer to function as a projection system that controls a projection image, and that corresponds to a product displayed for a transaction from an image database that stores the image. The computer executes the extraction step of extracting the image and the transmission step of causing the projector to project the image onto the surface of the displayed product by transmitting the image extracted in the extraction step to the projector.

  In this aspect, when a product is displayed, an image corresponding to the product is displayed on the surface of the product, but when a person picks up the product, the image is no longer displayed on the product. Disappear. With this mechanism, the appearance of the product can be changed between when the product is displayed and when the customer actually picks up the product. That is, the appearance of the product can be changed according to the scene.

  FIG. 8 shows an example of such an effect. In this example, the exterior of the product (beverage can) 80 has a simple design (the left side in FIG. 8), and an image 90 of an additional design (for example, an advertising phrase, an advertisement, etc.) is projected only while being displayed. To make the product stand out by reflecting on the surface of the product (center of FIG. 8). Since the image (additional design) 90 does not appear on the surface of the product 80 after the customer picks up and purchases the product 80, the customer has the product 80 with a simple exterior ( FIG. 8 right side). By using this mechanism, for example, while making the exterior of the product itself a simple and sophisticated design, a flashy design can be superimposed on the surface of the product to attract attention. In addition, by displaying on the surface of the product, instead of printing, a design that is likely to be avoided by the customer when printed on the surface of the product (for example, promotional words, flashy design, etc.), the customer can pick up the product. The design can be erased after it is taken. With such a mechanism, purchase of a product can be promoted.

  Furthermore, as shown in the upper and lower stages of FIG. 8, the projection image 90 can be freely set for one product 80. For example, the upper projected image 90 represents an advertising phrase, and the lower projected image 90 represents the concept or impression of a product. For example, it is possible to project an appropriate image on the displayed product according to the type of customer and the time zone. This can also lead to the promotion of product purchases.

  The projection system according to another aspect further includes a bar code receiving unit that receives bar code data from a bar code reader that has read a bar code attached to a displayed product, and the extraction unit extracts the bar code data from the bar code data. An image corresponding to the merchandise ID may be extracted. By automatically acquiring a product ID for uniquely identifying the type of product from the barcode of the product, it is possible to accurately set an image to be projected on the product.

  The projection system according to another aspect further includes an image receiving unit that receives a captured image from a camera that captured a person who came in front of the displayed product, and the extraction unit performs image recognition on the captured image. The attributes of the person may be determined and the displayed products and images corresponding to the attributes may be extracted. With this mechanism, an image suitable for a person who is estimated to be viewing a product can be projected onto the product.

  In the projection system according to another aspect, the extraction unit may extract an image corresponding to the displayed product and the current time. With this mechanism, an image corresponding to a time zone can be projected onto a product.

  In the projection system according to another aspect, the product may be displayed on the shelf, and the projector may be attached to the shelf plate of the shelf.

  The present invention has been described in detail based on the embodiments. However, the present invention is not limited to the above embodiment. The present invention can be variously modified without departing from the gist thereof.

  In the above embodiment, the receiving unit 21 receives the barcode data and the captured image, but the receiving unit 21 may receive only one of these two types of data. Alternatively, the projection system may not include the receiving unit. For example, if a product and an image to be projected onto the product are determined in advance, the projection system may read the image from the image database and send it to the projector.

  As described above, the type of product is not limited. For example, the product may be a beverage in a can, a bottle or a plastic bottle, or a food product. Alternatively, the product may be a sanitary product such as a sanitary product or a contraceptive device, and in this case, it is not necessary to put the sanitary product in a paper bag, which is generally performed during a purchase procedure at a store. Become. Of course, the product may be any tangible object other than food and sanitary goods.

  The image projection method is not limited. For example, the positional relationship between the projector and the product may be adjusted so that an image from one projector is projected over a plurality of the same product. Alternatively, for the same product in two adjacent rows, an image projected on the same product by providing a barcode reader in each column and setting image information (image and projection conditions) so that the projection image in each column is different May be different for each column.

  The positional relationship between the original design printed on the product and the projected image is not limited. For example, the original design of the product and the projected image may overlap. Alternatively, at least one of the design of the product itself and the position where the image is projected may be adjusted so that such superposition does not occur. For example, the design of the product itself (this design may include an indication of ingredients or nutrients) is printed on the top or bottom of the product, nothing is printed on the center of the product, and an image is projected on this center. May be.

  The barcode reader, camera, projector, and database group may belong to a system other than the projection system.

  The projection system according to one aspect of the present invention may be used for A / B testing. For example, in the first period, the projection system projects the image Ax on a specific column of a product and the image Ay on another column of the product. In the second period thereafter, the projection system projects the image Bx onto a specific column of the product and projects the image By onto another column of the product. Then, the projection system compares the number of sales of the product in the first and second periods, and thereafter (the third period) displays the image with the larger number of sales. The projection system determines a projection image in the third period with reference to a database that stores the number of sales of each product. By using the projection system in this way, an A / B test at an actual store, which has not been performed conventionally, can be performed.

  The processing procedure in the projection system executed by at least one processor is not limited to the example in the above embodiment. For example, the projection system may omit some of the steps (processes) described above, or may execute the steps in a different order. Also, any two or more of the steps described above may be combined, or a part of the steps may be corrected or deleted. Alternatively, the projection system may perform other steps in addition to the above steps.

  DESCRIPTION OF SYMBOLS 1 ... Projection system, 2 ... Bar code reader, 3 ... Camera, 4 ... Projector, 10 ... Database group, 11 ... Equipment database, 12 ... Image database, 20 ... Server, 21 ... Receiving part (Bar code receiving part and image receiving) Part), 22 ... extraction part, 23 ... transmission part, P1 ... projection program, P10 ... main module, P11 ... reception module, P12 ... extraction module, P13 ... transmission module.

Claims (7)

A projection system for controlling a projection image,
An extraction unit for extracting the image corresponding to the commodity displayed for the transaction from the image database storing the image;
A projection system comprising: a transmission unit that causes the projector to project the image onto the surface of the displayed product by transmitting the image extracted by the extraction unit to the projector. A bar code receiving unit for receiving bar code data from a bar code reader that has read a bar code attached to the displayed product;
The extraction unit extracts the image corresponding to the product ID extracted from the barcode data;
The projection system according to claim 1. An image receiving unit that receives a photographed image from a camera that photographed a person who came in front of the displayed product;
The extraction unit determines the attribute of the person by executing image recognition on the captured image, and extracts the displayed product and the image corresponding to the attribute;
The projection system according to claim 1 or 2. The extraction unit extracts the image corresponding to the displayed product and the current time;
The projection system as described in any one of Claims 1-3. The goods are displayed on a shelf,
The projector is mounted on a shelf plate of the shelf;
The projection system as described in any one of Claims 1-4. A projection method performed by a projection system comprising a processor for controlling a projection image, comprising:
Extracting from the image database storing the image the image corresponding to the item being displayed for the transaction;
A projecting method comprising: transmitting the image extracted in the extracting step to a projector, thereby causing the projector to project the image onto a surface of the displayed commodity. A projection program for causing a computer to function as a projection system for controlling a projection image,
Extracting from the image database storing the image the image corresponding to the item being displayed for the transaction;
A projection program that causes the computer to execute a transmission step of causing the projector to project the image onto the surface of the displayed product by transmitting the image extracted in the extraction step to the projector.

Images