JP6716359B2 - Projection system, projection method, and projection program - Google Patents

Description

One aspect of the present invention relates to a projection system, a projection method, and a projection program.

There are various methods for appealing a product to customers. For example, Patent Document 1 describes a system for displaying advertisement content of a product on a vehicle. In this system, a projector installed in a vehicle displays an image on the side surface of the vehicle.

JP, 2005-511729, A

For some people, even if they are interested in a product through advertisement, they may lose their interest by seeing the appearance of the product when they come into contact with the actual product. For example, an eye-catching package may not fit a person's interests or preferences. Alternatively, a design that conveys the characteristics of a product in an easy-to-understand manner may make certain people feel embarrassed. Therefore, it is desired to change the appearance of the product depending on the situation.

A projection system according to one aspect of the present invention is a projection system that controls a projection image, and an extraction unit that extracts an image corresponding to a commodity displayed for trading from an image database that stores the image, A transmitting unit that transmits the image extracted by the extracting unit to the projector to cause the projector to project the image on the surface of the displayed commodity.

A projection method according to one aspect of the present invention is a projection method executed by a projection system including a processor that controls a projected image, and corresponds to a product displayed for trading from an image database that stores the image. And a transmitting step of transmitting the image extracted in the extracting step to the projector to cause the projector to project the image on the surface of the displayed commodity.

A projection program according to one aspect of the present invention is a projection program that causes a computer to function as a projection system that controls a projection image, and an image corresponding to a product displayed for trading from an image database that stores the image. The computer is caused to execute an extracting step of extracting the image and an image transmitting step in which the image extracted in the extracting step is transmitted to the projector to cause the projector to project the image on the surface of the displayed commodity.

In such an aspect, an image corresponding to the product is displayed on the surface of the product when the product is displayed, but when a person picks up the product, the image no longer appears on the product. Disappear. With this mechanism, it is possible to change the appearance of the product when the product is displayed and when the customer actually picks up the product. That is, the appearance of the product can be changed according to the scene.

According to one aspect of the present invention, the appearance of a product can be changed according to the scene.

It is a figure which shows an example of application of the projection system which concerns on embodiment. It is a figure which shows the function structure of the projection system which concerns on embodiment. It is a figure which shows the example of apparatus information. It is a figure which shows the example of image information. It is a figure which shows the hardware constitutions of a server. 6 is a flowchart showing an operation of the projection system according to the embodiment. It is a figure which shows the structure of the projection program which concerns on embodiment. It is a figure which shows the example which projects an image on goods.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the description of the drawings, the same or equivalent elements will be denoted by the same reference symbols, without redundant description.

The functions and configuration of the projection system 1 according to the embodiment will be described with reference to FIGS. 1 to 5. The projection system 1 is a computer system that projects an image on the surface of displayed products. The “commodity” is any tangible object that can be traded for a fee or free of charge, and the type thereof is not limited at all. The “displayed product” is a product placed in a predetermined place for a transaction. For example, the "displayed product" is a product placed on a display shelf or a display stand of a physical store. The “commodity surface” is the outer surface of the displayed commodity, for example, the outer surface of a box or a container. An “image” is an image that can be visually recognized by a person, which is displayed on the surface of a tangible object. The image may be a still image or a moving image. The image may be obtained by photographing or may be computer graphics.

FIG. 1 shows an example of application of the projection system 1, specifically, an example in which an image 90 is projected on a product (beverage can) 80 placed on a shelf. In this embodiment, the projection system 1 includes a barcode reader 2, a camera 3, and a projector 4. The barcode reader 2 is a device that reads a barcode attached to the surface of a product. The type of the barcode reader 2 is not limited, and may be, for example, a reader that reads a one-dimensional barcode or a reader that reads a two-dimensional barcode. The method of attaching a barcode to a product is not limited at all. For example, a barcode may be printed on the surface of the product, or a sticker on which the barcode is printed may be attached to the surface of the product. The camera 3 is a device for photographing a person in front of a shelf (a person who comes in front of a displayed product). The projector 4 is a device that projects an image on the surface of a product placed on the front row of the shelf, and may be, for example, a small ultra-short focus projector. FIG. 1 shows an example in which the barcode reader 2 is installed on the side of a shelf, the camera is installed on the front end of the shelf, and the projector 4 is installed on the lower surface of the shelf. By attaching the projector 4 to an inconspicuous place such as the lower surface of the shelf board, the appearance of the display shelf can be improved. However, the installation location of each device is not limited at all. For example, the projector 4 may be attached to the front side surface of the shelf board. Alternatively, each device may be attached to something other than a shelf.

FIG. 1 shows an example in which the projector 4 displays an image 90 of a balloon containing the characters “Limited time!” on the surface of a product 80 on which a star mark, diagonal lines, and the character string “ABC” are printed. When a person takes the product 80 out of the shelf and picks it up, naturally, the image (speech bubble) 90 disappears from the can, and only the star mark, the diagonal line, and the character string "ABC" remain on the surface of the can. Become. In other words, the image provided by the projector 4 is visible only when the product is placed on the shelf, and disappears when the customer obtains the product.

FIG. 2 shows a functional configuration of the projection system 1. The projection system 1 includes a database group 10 and a server 20 in addition to the barcode reader 2, the camera 3, and the projector 4. Each device in the projection system 1 can perform data communication with other devices via a communication network such as the Internet or a LAN. Although FIG. 2 shows only a group of devices (bar code reader 2, camera 3, and projector 4) in one display space, the projection system 1 has a plurality of display spaces (for example, a plurality of columns forming one shelf, It may include a plurality of device groups provided on a plurality of shelves or the like.

The database group 10 is a set of one or more databases that store data necessary for processing in the projection system 1. In this embodiment, the database group 10 includes a device database 11 and an image database 12. The “database” is a functional element (storage unit) that stores a data set so as to be able to handle arbitrary data operations (for example, extraction, addition, deletion, overwrite, etc.) from a processor or an external computer. The database mounting method is not limited, and may be a database management system or a text file, for example.

The device database 11 is a device that stores device information indicating a correspondence relationship between devices installed on shelves. FIG. 3 shows an example of device information. In the present embodiment, each record of device information includes a reader ID that uniquely identifies a barcode reader, a camera ID that uniquely identifies a camera, and a projector ID that uniquely identifies a projector. In FIG. 3, for example, a bar code reader “R01”, a camera “C01”, and three projectors “P01”, “P02”, and “P03” are installed in a certain display space (for example, one shelf shelf). Indicates that it has been done. FIG. 3 also shows that the camera “C01” corresponds to two display spaces (eg, multiple shelves on one shelf).

The image database 12 is a device that stores image information indicating an image projected on a product. In the present specification, this image is also referred to as “projection image”. FIG. 4 shows an example of a record of image information. In this embodiment, each record of image information includes a product ID that uniquely identifies a product, an image (image data) projected on the product, and a projection condition. In FIG. 6, for example, the image X is always projected on the product “P001”, whereas the projected image is switched on the product “P002” according to the time of day and the gender of the person who comes in front of the shelf. Show. For example, when a woman comes before the product “P002”, the image Yc is projected on the product “P002”.

The configuration of each database and each record in the database group 10 is not limited to the above, and each database may be subjected to arbitrary normalization or redundancy.

The server 20 is a computer that provides images to the projector. FIG. 5 shows a general hardware configuration of the server 20. The server 20 includes a processor 101 that executes an operating system and application programs, a main storage unit 102 that includes a ROM and a RAM, an auxiliary storage unit 103 that includes a hard disk and a flash memory, a network card or a wireless network. The communication controller 104 includes a communication module, an input device 105 such as a keyboard and a mouse, and an output device 106 such as a monitor.

As shown in FIG. 2, the server 20 includes a receiving unit 21, an extracting unit 22, and a transmitting unit 23 as functional components. These functional elements are realized by loading predetermined software on the processor 101 or the main storage unit 102 and executing the software. The processor 101 operates the communication control unit 104, the input device 105, or the output device 106 according to the software to read and write data in the main storage unit 102 or the auxiliary storage unit 103. The data or database required for processing is stored in the main storage unit 102 or the auxiliary storage unit 103.

The reception unit 21 is a functional element that receives data from the barcode reader 2 and the camera 3. The receiving unit 21 receives the barcode data from the barcode reader 2 together with the reader ID, and extracts the product ID from the barcode data. Further, the receiving unit 21 receives the captured image from the camera 3 together with the camera ID. The receiving unit 21 outputs these received data to the extracting unit 22. That is, in the present embodiment, the receiving unit 21 functions as a barcode receiving unit and an image receiving unit.

The extraction unit 22 is a functional element that extracts an image corresponding to the displayed product from the image database 12. First, the extraction unit 22 sets a search condition including at least a product ID based on the input data. The search condition may further include the current time. Further, the search condition may further include the attribute of the person (subject) who was photographed. “Personal attributes” are the nature or characteristics of a person. The type of attribute is not limited at all, and examples thereof include gender, age, and distinction between adults and children. The extraction unit 22 determines the attribute of the person (subject) who has been photographed by performing image recognition on the inputted photographed image. The extraction unit 22 may determine an arbitrary attribute from a captured image as long as it is used as a search condition for extracting an image from the image database 12. Then, the extraction unit 22 reads out an image that matches the set search conditions from the image database 12.

Assuming that the image information is the example illustrated in FIG. 4, for example, when the product ID “P001” is input, the extraction unit 22 reads the image X regardless of the attribute of the subject and the current time. When the product ID “P002” is input and it is determined that the attribute of the subject is “female”, the extraction unit 22 reads the image Yc. When the product ID “P002” is input, it is determined that the attribute of the subject is “male”, and the current time is 18:00, the extraction unit 22 reads the image Yb.

The extraction unit 22 outputs the read image to the transmission unit 23 together with the reader ID and the camera ID.

The transmission unit 23 is a functional element that transmits the image extracted by the extraction unit 22 to the projector 4. The transmission unit 23 causes the projector 4 to project the image on the surface of the displayed commodity by this transmission processing. The transmission unit 23 reads at least one projector ID corresponding to the input reader ID and camera ID from the device database 11, and transmits the input image to at least one projector 4 indicated by the projector ID. Each projector 4 receives the image and projects the image on the displayed products.

Next, the operation of the projection system 1 will be described and the projection method according to the present embodiment will be described with reference to FIG.

First, the receiving unit 21 receives the barcode data from the barcode reader 2 to acquire the product ID (step S11), and also receives the captured image from the camera 3 (step S12). Subsequently, the extraction unit 22 sets a search condition based on at least the product ID (step S13), and extracts an image matching the search condition from the image database 12 (step S14, extraction step). The extraction unit 22 may set a search condition that further includes at least one of the attribute of the subject determined from the captured image and the current time. Finally, the transmission unit 23 transmits the extracted image to the projector 4 (step S15, transmission step).

Next, a projection program P1 for realizing the projection system 1 (server 20) will be described with reference to FIG.

The projection program P1 includes a main module P10, a reception module P11, an extraction module P12, and a transmission module P13. The main module P10 is a part that integrally controls the functions of the projection system 1 (server 20). The functions realized by executing the reception module P11, the extraction module P12, and the transmission module P13 are the same as the functions of the reception unit 21, the extraction unit 22, and the transmission unit 23, respectively.

The projection program P1 may be provided after being fixedly recorded in a tangible recording medium such as a CD-ROM, a DVD-ROM, or a semiconductor memory. Alternatively, the projection program P1 may be provided as a data signal superimposed on a carrier wave via a communication network.

As described above, the projection system according to one aspect of the present invention is a projection system that controls a projected image, and displays an image corresponding to a product displayed for trade from an image database that stores the image. An extraction unit that extracts the image and a transmission unit that transmits the image extracted by the extraction unit to the projector to cause the projector to project the image on the surface of the displayed commodity.

A projection method according to one aspect of the present invention is a projection method executed by a projection system including a processor that controls a projected image, and corresponds to a product displayed for trading from an image database that stores the image. And a transmitting step of transmitting the image extracted in the extracting step to the projector to cause the projector to project the image on the surface of the displayed commodity.

A projection program according to one aspect of the present invention is a projection program that causes a computer to function as a projection system that controls a projection image, and an image corresponding to a product displayed for trading from an image database that stores the image. The computer is caused to execute an extraction step of extracting the image and a transmission step of causing the projector to project the image on the surface of the displayed product by transmitting the image extracted in the extraction step to the projector.

In such an aspect, an image corresponding to the product is displayed on the surface of the product when the product is displayed, but when a person picks up the product, the image no longer appears on the product. Disappear. With this mechanism, it is possible to change the appearance of the product when the product is displayed and when the customer actually picks up the product. That is, the appearance of the product can be changed according to the scene.

FIG. 8 shows an example of such an effect. In this example, the exterior of the product (beverage can) 80 itself has a simple design (on the left side of FIG. 8), and the image 90 of the additional design (for example, advertising phrase, advertisement, etc.) is projected only while it is displayed. Makes the product stand out by projecting it on the surface of the product (center of FIG. 8). After the customer picks up the product 80 and purchases it, the image (additional design) 90 naturally does not appear on the surface of the product 80, so the customer has the product 80 with a simple exterior ( Right side of FIG. 8). By using this mechanism, for example, while the exterior of the product itself has a simple and sophisticated design, the flashy design can be superimposed and displayed on the surface of the product to attract attention. In addition, by designing a design that is likely to be shunned by the customer if printed on the surface of the product (for example, a publicity phrase, a flashy design, etc.) by projecting it on the surface of the product instead of printing it You can erase the design after taking it. With such a mechanism, it is possible to encourage purchase of a product.

Furthermore, as shown in the upper and lower rows of FIG. 8, the projection image 90 can be freely set for one product 80. For example, the projected image 90 in the upper row represents a advertising phrase, and the projected image 90 in the lower row represents a concept or impression of a product. For example, it is possible to project an appropriate image according to the type of customer, time of day, etc. on the displayed product. This can also promote the purchase of products.

The projection system according to another aspect further includes a barcode receiving unit that receives barcode data from a barcode reader that reads a barcode attached to the displayed product, and the extraction unit extracts the barcode data from the barcode data. An image corresponding to the created product ID may be extracted. By automatically acquiring the product ID for uniquely identifying the product type from the product barcode, the image projected on the product can be set accurately.

The projection system according to another aspect further includes an image receiving unit that receives a captured image from a camera that captures a person who came in front of the displayed product, and the extraction unit performs image recognition on the captured image. The attribute of a person may be determined and the displayed product and the image corresponding to the attribute may be extracted. With this mechanism, it is possible to project an image suitable for a person who is presumed to be looking at the product on the product.

In the projection system according to another aspect, the extraction unit may extract the image corresponding to the displayed product and the current time. With this mechanism, an image according to the time zone can be projected on the product.

In the projection system according to another aspect, the product may be displayed on a shelf and the projector may be attached to a shelf plate of the shelf.

The present invention has been described in detail above based on the embodiments. However, the present invention is not limited to the above embodiment. The present invention can be variously modified without departing from the gist thereof.

Although the receiving unit 21 receives the barcode data and the captured image in the above embodiment, the receiving unit 21 may receive only one of these two types of data. Alternatively, the projection system may not include the receiver. For example, if the product and the image to be projected on the product are predetermined, the projection system may read the image from the image database and send it to the projector.

As described above, the type of product is not limited. For example, the product may be a beverage in a can, a bottle, a plastic bottle, or a food product. Alternatively, the product may be sanitary products such as sanitary products and contraceptives, in which case it is not necessary to put the sanitary product in a paper bag, which is generally done during the purchase procedure at the store. Become. Of course, the product may be any tangible object other than food and hygiene products.

The image projection method is not limited. For example, the positional relationship between the projector and the product may be adjusted so that the image from one projector is displayed over a plurality of the same product. Alternatively, for two adjacent columns of the same product, a bar code reader is provided in each column, and image information (image and projection conditions) is set so that the projected image of each column is different, so that the image projected on the same product May be different for each column.

The positional relationship between the original design printed on the product and the projected image is not limited at all. For example, the original design of the product and the projected image may overlap. Alternatively, at least one of the product design and the position where the image is projected may be adjusted so that such superimposition does not occur. For example, the design of the product itself (which design may include labeling of raw materials or nutritional ingredients) is printed on the top or bottom of the product and nothing is printed on the center of the product, and the image is projected on this center. May be.

The bar code reader, camera, projector, and database group may belong to a system other than the projection system.

The projection system according to one aspect of the present invention may be used for A/B testing. For example, the projection system causes the image Ax to be projected on a specific column of a product and the image Ay on another column of the product in the first period. In the second period thereafter, the projection system projects the image Bx on a particular column of the item and the image By on another column of the item. Then, the projection system compares the sales numbers of the products in the first and second periods, and thereafter (the third period) displays the image with the higher sales number. The projection system refers to the database that stores the number of sales of each product and determines the projection image in the third period. By using the projection system in this way, it is possible to carry out an A/B test in an actual store, which has not been performed in the past.

The processing procedure in the projection system executed by at least one processor is not limited to the example in the above embodiment. For example, the projection system may omit some of the steps (processes) described above, or may perform the steps in a different order. Further, any two or more of the steps described above may be combined, or some of the steps may be modified or deleted. Alternatively, the projection system may perform other steps in addition to the above steps.

DESCRIPTION OF SYMBOLS 1... Projection system, 2... Bar code reader, 3... Camera, 4... Projector, 10... Database group, 11... Equipment database, 12... Image database, 20... Server, 21... Receiving part (bar code receiving part and image reception) Section), 22... extraction section, 23... transmission section, P1... projection program, P10... main module, P11... reception module, P12... extraction module, P13... transmission module.

Claims (7)

A projection system for controlling a projection image,
From an image database that stores images, an extraction unit that extracts a plurality of the images corresponding to the same product displayed in two adjacent rows for trading,
By transmitting a plurality of images extracted by the extracting portion into a plurality of projectors and wherein said plurality of projectors, and a transmission unit for projecting the same said image on the surface of the goods displayed over two rows adjacent ones Prepare ,
The transmitting unit sets the plurality of images so that the projection images of the two adjacent columns are different from each other and transmits the plurality of images to the plurality of projectors, so that the same product is projected. Different image for each column,
Projection system. Further comprising a bar code reception unit for receiving the bar code data from the bar code reader reading a bar code attached to the product being the display,
The extraction unit extracts the image corresponding to the product ID extracted from the barcode data,
The projection system according to claim 1. Further comprising an image receiver for receiving captured images from the cameras taking who come before the products being the display,
The extraction unit determines the person attributes by executing image recognition with respect to the captured image, and extracts the image corresponding to the item and the attribute is the display,
The projection system according to claim 1 or 2. The extraction section extracts the image corresponding to the product and the current time is the display,
The projection system according to claim 1. The product is displayed on the shelf,
The plurality of projectors are attached to a lower surface of a shelf plate of the shelf,
The projection system according to claim 1. A projection method executed by a projection system comprising a processor for controlling a projection image, comprising:
An extracting step of extracting from the image database storing the images a plurality of the images corresponding to the same product displayed in two rows adjacent to each other for a transaction;
By transmitting a plurality of images extracted in the extraction step into a plurality of projectors and wherein said plurality of projectors, and a transmission step of projecting the same said image on the surface of the goods displayed over two rows adjacent ones seen including,
In the transmitting step, the plurality of images are set so that the projected images of the two adjacent columns are different from each other, and the plurality of images are transmitted to the plurality of projectors, so that the images are projected on the same product. Different image for each column,
Projection method. A projection program for causing a computer to function as a projection system for controlling a projection image,
An extracting step of extracting from the image database storing the images a plurality of the images corresponding to the same product displayed in two rows adjacent to each other for a transaction;
By transmitting a plurality of images extracted in the extraction step into a plurality of projectors and wherein said plurality of projectors, and a transmission step of projecting the same said image on the surface of the goods displayed over two rows adjacent ones Make the computer execute ,
In the transmitting step, the plurality of images are set so that the projected images of the two adjacent columns are different from each other, and the plurality of images are transmitted to the plurality of projectors, so that the images are projected on the same product. Different image for each column,
Projection program.

Images