KR20200034509A - Digital sign system, Digital signage and method for proposing informatiom of product - Google Patents

Abstract

The present invention relates to a digital signature system comprising: a product information database stored since it is possible to make a feature quantity of a product and product information to be related; a feature amount extracting means for extracting a feature quantity from a mounted image which is an image of a customer who has a product mounted thereof; a comparing means for comparing the extracted feature quantity with the feature quantity stored in the product information database and identifying a product that the customer is wearing; a product information searching means for searching for product information of the identified product from the product information database; and an output control means for outputting the searched product information and the mounted image.

Description

Digital sign system, digital signage and method for proposing informatiom of product}

The present invention relates to a digital sign system, a digital signage, and a method for presenting product information.

Digital signage, an advertising medium for displaying advertisements using a display such as a liquid crystal display or a projector, is installed in various places. By using digital signage, not only is it possible to provide various contents using video or voice, but also it is possible to efficiently transmit advertisements according to the place where digital signage is installed, so the market for digital signage is expected to expand in the future.

However, when purchasing a product, it is often purchased by trying on several products. Therefore, in order to compare the worn-out state, Patent Literature 1 discloses an invention in which it is possible to take a picture of one's own wear and to compare images of a plurality of photographed images.

In the invention of Patent Document 1, a detection signal is input from a sensor that detects a subject, and an image captured by the camera is displayed on the left and right screens of the display as a video. It is an invention of displaying an image as a still image on the left or right screen of a display by inputting an operation signal by pressing a left button or a right button of the control panel. Thereby, it is possible to easily photograph one's own appearance while wearing the product, and compare one's appearance at the time of trial wearing from the multiple images taken.

Japanese Patent Laid-Open Publication No. 2011-40953

On the other hand, customers want to know product information, such as color, size, and inventory information, of products that are being tested and worn (hereinafter abbreviated as trial wear).

However, the invention of Patent Document 1 can capture a trial image, but it is not possible to display the product information of the tried-on product only by displaying it on the display as it is. This is because there is no function to identify a tried-on product.

In addition, there are many cases that do not purchase on the spot but purchase later after examination. In such a case, it is easy to examine if the trial image of the person who tried the product is in front. Moreover, it is more convenient to have the product product information in addition to the trial image.

Moreover, digital signage is also desired to have functions other than functions as simple advertisement display means.

The present invention has been invented in view of the above problems, and an object thereof is to provide a digital signing system, a digital signage, and a method for presenting product information that can provide product information for customer's product purchase with good accessibility. .

The present invention provides a feature quantity extraction means for extracting a feature quantity from a feature image of an article, an article information database in which the article article information is associated, and an image of a customer who is wearing the article, and the extracted feature. Item information retrieval means for comparing the quantity, the characteristic quantity stored in the article information database, and the matching means for identifying the article mounted by the customer, and for retrieving the article information of the identified article from the article information database And a digital sign system having output control means for outputting the retrieved article information and the mounted image.

The present invention provides a feature amount extraction means for extracting a feature amount from a feature image of an article, an article information database stored in relation to the article article information, and an image of a customer who mounts the article, and the extracted feature An article information retrieval means for comparing an amount with a feature amount stored in the article information database, and identifying means with which the customer is equipped, and article information retrieval means for retrieving the identified article article information from the article information database , A digital signage having output control means for outputting the retrieved product information and the mounted image.

The present invention is a method for presenting goods information in a digital sign system having a feature quantity of goods and a goods information database in which the goods goods information is related, and the feature quantity is obtained from a mounted image that is an image of a customer who has the goods mounted. Extracting, comparing the extracted feature quantity with the feature quantity stored in the article information database, identify the article that the customer is equipped with, and retrieve the identified article article information from the article information database, It is a method of presenting article information for outputting the retrieved article information and the mounted image.

Since the present invention can recognize the product that the customer is wearing from the photographed customer's mounting image, it is possible to provide product information for purchasing the customer's product with good accessibility.

1 is a configuration diagram of a digital signage system in an embodiment of the present invention.
2 is an external view of a digital signage according to an embodiment of the present invention.
3 is a block diagram of a digital signage in one embodiment.
4 is a view showing an example of an article information database.
5 is a diagram showing an example of a customer information database.
6 is a view for explaining the operation of the embodiment.
7 is a view for explaining the operation of the embodiment.
8 is a view for explaining the operation of the embodiment.
9 is a view for explaining the operation of the embodiment.
10 is a view for explaining the operation of the embodiment.
11 is a view for explaining the operation of the embodiment.

In the embodiment of the present invention, the worn product is identified from the customer's wearing image on which an article such as clothing or accessories is worn. And, it relates to a digital signage that provides the identified item article information and the attached image to the customer.

1 is a configuration diagram of a digital sign system in the present embodiment.

As shown in Fig. 1, the digital sign system includes an article information database 10, a feature amount extraction section 11, a matching section 12, an article information search section 13, and an output control section 14 It is equipped with.

The article information database 10 is a database of information on articles handled in stores or digital chains in which digital signage is installed.

The feature amount extracting unit 11 extracts the feature amount of the product that the customer has attached from the customer's mounted image captured by the camera.

The matching unit 12 compares the feature amount extracted by the feature amount extraction unit 11 with the feature amount of the article stored in the article information database 10, and identifies the article in the mounted image.

The article information retrieval unit 13 searches the article information corresponding to the article identified by the control unit 12 from the article information database 10. Then, the retrieved product information is output to the output control unit 14.

The output control unit 14 outputs mounted images and product information to output means such as a display. On the other hand, the mounted image and article information may be transmitted to the customer's terminal (for example, a mobile phone or a smart phone).

As described above, since the present embodiment can recognize the product that the customer is wearing from the customer's mounting image, it is possible to provide product information for purchasing the customer's goods with good accessibility.

Next, examples of the present invention will be described. On the other hand, in the following description, for ease of understanding, the product currently handled by the supplier (store) will be described as an example of the article.

As shown in Fig. 2, the digital signage 1 is installed in a store or the like, and uses the display 2, and usually displays an advertisement video. In addition, in the digital signage 1, in addition to the display 2 for reproducing the advertisement image, a camera 3 for capturing a mounted image in a state where a customer wears (try-on) clothes or the like is provided.

As shown in Fig. 2, the digital signage 1 includes a display 2, a camera 3, an article information database 10, a feature amount extraction section 11, and a control section 12. , An article information retrieval unit 13, an output control unit 14, a mounted image registration unit 15, a communication unit 18, and a customer information file database 19.

The article information database 10 is a database of information on products handled by stores that have digital signage 1 installed, or by the entire chain. Specifically, the product information database 10 includes a product feature amount table 101 and a product information management table 102.

The product feature amount table 101 is a table in which product identification information for identifying a product and an image feature amount of the product are stored in association.

The product information management table 102 is a table in which the product identification information and product information related to the product are stored. Here, the product information may include not only the color type and size of the product, but also stock information, appeal points, and the like.

In the product feature amount table 101 shown in FIG. 4, the product identification information and the feature amount of the product are stored to be related, for example, the product identification information 'product A' and the feature amount 'feature amount A' are related. It is done. In the product information management table 102, the product identification information and the product product information are stored in association, for example, the product identification information 'product A' and the product information 'product information A' are related. It is done.

On the other hand, in the present embodiment, the article information database 10 is composed of two items, a product feature amount table 101 and a product information management table 102, but is not limited thereto. For example, the product feature amount and the product information may be related, and may be configured as one table.

The feature amount extraction unit 11 extracts a feature amount of a customer's attached product from a customer's mounted image captured by the camera 3. In order to facilitate the method of extracting a feature amount from an image, it is preferable that the object in the image is imaged at a predetermined location, but it is difficult in a digital signage installed in a store or the like. Therefore, in order to stably discriminate the product mounted by the customer in the image against changes in the shooting size or angle, a number of characteristic points (feature points) in the image are detected, and the feature amount of the local area around each feature point ( Local feature).

The control unit 12 compares the feature amount extracted by the feature amount extraction unit 11 with the feature amount of the product stored in the product feature amount table 101 of the article information database 10, and then the camera 3 A product in the mounted image captured with) is identified. On the other hand, in this embodiment, not only the type of the product in the mounted image is identified, but also the size of the product such as 'S', 'M', and 'L'. Then, the product identification information with matching feature amounts is output to the article information search unit 13.

The product information search unit 13 receives product identification information from the matching unit 12 and searches for product information corresponding to the product identification information from the product information management table 102. Then, the searched product information is output to the attached image registration unit 15.

The customer information file database 19 is a database in which customer information files such as customer identification information and their names, ages, and addresses are registered. Moreover, the customer information file database 19 is equipped with a field in which a mounted image is registered and a product information is registered so that the above-mentioned mounted image and product information can be registered in relation to the customer information file of the customer. have. In Fig. 5, customer identification information, name, age, address, attached image, and product information are registered in association.

The attached image registration unit 15 stores the customer's installed image (image the customer is wearing the product) and the product information retrieved by the product information search unit 13 captured by the camera 3 into the customer's customer information file. In order to be related, it is registered in the customer information file database 19. On the other hand, the customer identification information, upon installation (try-on) of the customer, the mounted image registration unit 15 displays a screen for entering a customer information file on the display of the digital signage 1, and inputs customer identification information to the customer Acquired by letting.

The output control unit 14 has a screen display control unit 16 and a communication control unit 17.

The screen display control unit 16 displays product information of a product that is mounted (try-on) retrieved by the product information search unit 13 while displaying the customer's mounted image captured by the camera 3 on the display 2. Control is performed. In addition, control is also performed to display a normal advertisement or event notification on the display 2.

The communication unit control unit 17 searches the customer information file database 14 for installed images and product information related to the input customer identification information, and outputs the installed images and product information to the communication unit 18.

The communication unit 18 transmits the mounted image to the customer's terminal (for example, a mobile phone or a smart phone) by communication.

On the other hand, the communication method may be a communication method such as non-contact Bluetooth, or if the customer's e-mail address is known, the e-mail may be provided with attached images and product information.

Next, a specific operation of the present embodiment in the above-described configuration will be described. On the other hand, in the following description, the article information database 10 is shown in Fig. 4, and the customer information file database 19 is shown in Fig. 5, respectively.

The digital signage 1 is installed in a dressing room or the like, and as shown in FIG. 6, normally, for example, when a customer does not stand in front of the digital signage 1, advertisement of a product, notification of an event, etc. It is displayed on the display 2.

When the customer is in front of the digital signage 1, face recognition or the like is recognized as a person, and as shown in FIG. 7, the image of the customer captured by the camera 3 is displayed on the display 2. Further, while wearing (try-on) the clothes desired by the customer, a touch panel for starting shooting is displayed on the display 2.

As shown in Fig. 8, when the mounting (try-on) is completed and the customer presses the touch panel to start shooting, the camera 3 starts shooting the customer's mounted image.

Subsequently, from the customer's mounted image captured by the camera 3, the feature amount extracting unit 11 extracts the feature amount of the product that is mounted (tried on). In the present embodiment, the feature quantity of the customer's fitted (try-on) product that could be extracted is referred to as the 'feature quantity A'.

The matching unit 12 searches for product identification information corresponding to the 'feature amount A' extracted by the feature amount extraction unit 11 from the product feature amount table 101. In this example, the product feature of FIG. From the quantity table 101, the product identification information corresponding to the characteristic quantity 'feature quantity A' is 'product A'.

Subsequently, the article information search unit 13 receives the product identification information from the matching unit 12 and searches the product information corresponding to the product identification information from the product information management table 102. In this example, since the product identification information from the control unit 12 is 'product A', 'product information A' is searched as product information related to 'product A'.

Then, the product information search unit 13 outputs the searched product information to the attached image registration unit 15 and the output control unit 16. In this example, since the searched product information is 'product information A', 'product information A' is output to the attached image registration unit 15 and the output control unit 16.

The output control unit 16 displays on the display 2 the mounted image photographed by the camera 3 and the product product information that is attached (try-on). Fig. 9 is a diagram showing a state in which the mounted image and the product product information A to be mounted (try-on) are displayed on the display 2.

When a predetermined time has elapsed, as shown in FIG. 10, in order to acquire customer identification information, a touch panel for inputting customer identification information is displayed. Then, when customer identification information is input by the customer, the customer identification information is transmitted to the attached image registration unit 15 and the communication control unit 17. Meanwhile, in this example, the customer identification information input by the customer is set to '1122'.

The attached image registration unit 15 is a customer information file database (corresponding to the attached image captured by the camera 3 and the product information received from the article information retrieval unit 13, corresponding to the customer identification information input by the customer ( 14) is registered in the field of the mounted image and the field of product information. In this example, the customer identification information is registered in the field of the mounted image of the record of '1122', and the mounted image A photographed by the camera 3 is registered, and 'product information A' is registered in the field of the product information.

The communication control unit 17 reads the mounted image corresponding to the customer identification information and the product information from the customer information file database 14 and outputs it to the communication unit 18. In this example, since the customer identification information is '1122', 'mounted image A' and 'product information A' are read from the customer information file database 14 and output to the communication unit 18.

The communication unit 18 transmits the mounted image and product information received from the communication control unit 17 to the customer's terminal. In this example, the communication unit 18 transmits 'mounted image A' and 'product information A' to the customer's terminal. Fig. 11 shows an example of product information of a mounted image and a mounted (try-on) product transmitted to a customer's terminal.

As described above, the digital signage 1 of the present embodiment identifies the product that the customer is wearing (try-on) from the photographed customer's mounting image, and automatically displays the product product information that is being mounted. Therefore, the customer can know the product information on the product that is mounted (try-on).

Moreover, since the installed image and product information can be transmitted to the customer's terminal, it becomes a reference when the customer purchases the product later. In particular, when visiting a store in the future to display product information, it is possible to notify whether there is a stock of a desired size by referring to the store inventory database by size. On the other hand, the size of the product may be identified by the feature amount as described above, or may be specified by the customer as product information. This information is registered in the customer information file database 19 as a customer information file. In addition, if the store issues a customer card or the like, it may be recorded on the customer card.

It can also be used for events such as giving privileges such as discounts to the customer when the customer presents the attached image when the product is purchased later.

On the other hand, in the present embodiment, the mounted image and the product product information of the attached (try-on) are transmitted to the customer's terminal, but only the mounted image may be used.

The technical spirit of the present invention is not limited to the above embodiments, and all examples equivalently and equivalently modified with the appended claims will fall within the scope of the present invention.

Digital signage ... 1
Display ... 2
Camera ... 3
Product Information Database ... 10
Feature amount extraction unit ... 11
Contrast ... 12
Product Information Search Department 13
Output Control ... 14
Mounted Image Register ... 15
Display control unit ... 16
Communication Control Unit ... 17
Communications ... 18
Customer Information Database ... 19

Claims (5)

A characteristic information of the article, an article information database stored in relation to the article article information,
A feature amount extracting means for extracting a feature amount from a mounted image, which is an image of a customer who is equipped with an article,
A matching means for comparing the extracted feature quantity with the feature quantity stored in the article information database, and identifying the article the customer is wearing;
Product information retrieval means for retrieving the article information of the identified article from the article information database;
A digital sign system having output control means for outputting the retrieved product information and the mounted image. According to claim 1,
The output control means transmits the mounted image to a customer's terminal. The method according to claim 1 or 2,
The collating means identifies the size of the product that the customer is wearing,
The article information retrieval means is a digital sign system for retrieving the size inventory of the article from the article information database. A characteristic information of the article, a database of the article information stored in relation to the article article information,
A feature amount extracting means for extracting a feature amount from a mounted image, which is an image of a customer who is equipped with an article,
A matching means for comparing the extracted feature quantity with the feature quantity stored in the article information database, and identifying the article the customer is wearing;
A product information retrieval means for retrieving the identified item product information from the item information database;
A digital signage having output control means for outputting the retrieved product information and the mounted image. It is a method of presenting article information in a digital sign system having a feature quantity of the article and a article information database stored in relation to the article article information.
The feature amount is extracted from the image of the customer who is wearing the product,
The extracted feature quantity is compared with the feature quantity stored in the article information database,
Identify the goods that the customer is wearing,
Search for the identified article article information from the article information database,
Product information presentation method for outputting the retrieved product information and the mounted image.

Images