WO2013147003A1 - Digital signage system, digital signage, article information presentation method, and program - Google Patents

Digital signage system, digital signage, article information presentation method, and program Download PDF

Info

Publication number
WO2013147003A1
WO2013147003A1 PCT/JP2013/059215 JP2013059215W WO2013147003A1 WO 2013147003 A1 WO2013147003 A1 WO 2013147003A1 JP 2013059215 W JP2013059215 W JP 2013059215W WO 2013147003 A1 WO2013147003 A1 WO 2013147003A1
Authority
WO
WIPO (PCT)
Prior art keywords
article
customer
information
digital signage
image
Prior art date
Application number
PCT/JP2013/059215
Other languages
French (fr)
Japanese (ja)
Inventor
智之 大坂
敏彦 広明
山田　昭雄
野村　俊之
Original Assignee
日本電気株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日本電気株式会社 filed Critical 日本電気株式会社
Publication of WO2013147003A1 publication Critical patent/WO2013147003A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising

Definitions

  • the present invention relates to a digital signage system, digital signage, article information presentation, and a program.
  • Digital signage an advertising medium that displays advertisements using displays such as liquid crystal displays and projectors, is beginning to be installed in various places.
  • digital signage not only will it be possible to provide rich content using video and audio, but it will also be possible to efficiently deliver advertisements according to the location of digital signage. Is expected to expand.
  • Patent Document 1 On the other hand, customer information is collected and used for marketing. As one of such inventions, there is an invention described in Patent Document 1.
  • the image processing unit from a plurality of screens of product purchase customers photographed continuously by each of a plurality of cameras, features such as individual customer sex, age group, occupation, stay location and time, and The attention product, the customer's gait course, etc. that are interested from the face direction are extracted and specified, and are registered in the visiting customer list. Then, the customer management unit extracts the feature data from the customer list during the store visit, extracts the voice guidance information or electronic bulletin information stored in advance corresponding to the feature data from the notification information, and makes an announcement or electronic posting from the output unit Is.
  • Patent Document 1 does not have a function of identifying a product worn by the customer such as a customer's clothes and belongings, information on the product worn by the customer that clearly shows the customer's taste Can not get. Therefore, it is not possible to automatically present an advertisement display of a product related to the product worn by the customer that matches the customer's taste.
  • digital signage has been expected to have functions other than a simple advertisement display function.
  • the present invention has been invented in view of the above problems, and its purpose is not only a mere advertisement display medium, but also a digital signage system capable of presenting information on articles that match customer preferences, digital To provide a signage, an article information presentation method, and a program.
  • the present invention relates to a related article database in which feature quantities of articles and related article information relating to related articles related to the articles are stored in association with each other, and feature quantity extracting means for extracting feature quantities from a customer image showing a customer.
  • a collation means for collating the extracted feature quantity with the feature quantity stored in the related article database to identify the article worn by the customer, and a related article related to the identified article.
  • the related article information search means for searching the related article information from the related article database, and the related article information output control means for outputting the searched related article information.
  • the present invention relates to a related article database in which feature quantities of articles and related article information relating to related articles related to the articles are stored in association with each other, and feature quantity extracting means for extracting feature quantities from a customer image showing a customer.
  • a collating means for collating the extracted feature quantity with the feature quantity stored in the article database to identify an article worn by the customer, and a related article related to the identified article
  • the digital signage includes related article information search means for searching for related article information from the related article database, and related article information output control means for outputting related article information searched by the related goods search means.
  • the present invention is a related article information presentation method for presenting related article information in a digital signage system having a related article database in which feature quantities of articles and related article information related to related articles related to the article are stored in association with each other. Then, a feature amount is extracted from a customer image in which the customer is photographed, the extracted feature amount is compared with a feature amount stored in the related article database, and an article worn by the customer is identified.
  • the related article information presenting method is to search related article information of a related article related to the identified article from the related article database and to output the searched related article information.
  • the present invention is a computer program for a system having a related article database in which a feature quantity of an article and related article information related to the related article related to the article are stored in association with each other.
  • a process of extracting a feature quantity, a process of collating the extracted feature quantity with the feature quantity stored in the related article database, and identifying an article worn by the customer; and the identified article Is a program that causes a computer to execute processing for searching related item information of related items related to the item from the related item database, and processing for outputting the searched related item information.
  • the article worn by the customer can be recognized from the photographed image of the customer, the information on the article according to the customer's taste can be presented.
  • FIG. 1 is a configuration diagram of a digital signage 1 according to an embodiment of the present invention.
  • FIG. 2 is an external view of the digital signage 1 in the embodiment.
  • FIG. 3 is a configuration diagram of the digital signage 1 of the embodiment.
  • FIG. 4 is a diagram illustrating an example of the related article information database 10 according to the embodiment.
  • FIG. 5 is a diagram for explaining the operation of the embodiment.
  • FIG. 6 is a diagram for explaining the operation of the embodiment.
  • FIG. 7 is a diagram for explaining the operation of the embodiment.
  • FIG. 8 is a diagram for explaining the operation of the embodiment.
  • FIG. 9 is a diagram for explaining the operation of the embodiment.
  • FIG. 10 is a block diagram of a digital signage according to another embodiment.
  • FIG. 11 is a configuration diagram of digital signage according to another embodiment.
  • This embodiment identifies goods such as clothes and belongings from a customer image obtained by photographing a customer standing in front of digital signage, and collates with goods sold or provided so far. Identify whether the item has been sold or provided to date. If the customer's goods are goods sold or provided so far, information on related articles related to the goods sold or provided is presented to the digital signage.
  • FIG. 1 is a configuration diagram of a digital signage system according to the present embodiment.
  • the digital signage system includes a related article information database 10, a feature quantity extraction unit 11, a collation unit 12, a related article information search unit 13, and a related article information output control unit 14.
  • a related article information database 10 includes a feature quantity extraction unit 11, a collation unit 12, a related article information search unit 13, and a related article information output control unit 14.
  • the related item information database 10 is a database in which the feature amount of an item and related item information related to the related item related to the item are stored in association with each other.
  • the articles include, for example, items worn on clothes, glasses, bags, and the like, but are not limited thereto.
  • the related article information is related article information related to the article. For example, when a certain article is a product worn by a customer, a series of the product or a new product of the product. Or other product information that matches the product, but is not limited thereto.
  • the information may be a still image or moving image of the product, introduction information, inventory, size, and the like.
  • the feature quantity extraction unit 11 extracts a feature quantity from a customer image showing a customer.
  • the collation unit 12 collates the extracted feature quantity with the feature quantity stored in the related article database, and identifies the article worn by the customer.
  • the related product information search unit 13 searches the related product information database 10 for related product information of related products related to the identified product.
  • the related article information output control unit 14 outputs the searched related article information, for example, a still image, a moving image (for example, a special video), music, voice, or the like to a digital signage display or a speaker.
  • the article worn by the customer can be identified from the photographed customer image of the customer, the article suited to the customer's taste can be presented to the customer.
  • FIG. 2 is an external view of the digital signage 1 in the present embodiment.
  • the digital signage 1 is installed in a store or the like, and usually displays an advertisement video using the display 2.
  • the digital signage 1 is provided with a camera 3 that captures an image for identifying a customer's clothes and belongings.
  • FIG. 3 is a block diagram of the digital signage 1.
  • the digital signage 1 includes a display 2, a camera 3, a related product information database 10, a feature amount extraction unit 11, a collation unit 12, a related product information search unit 13, and related product information output. And a control unit 14.
  • the related article information database 10 is a database of information related to products handled in the store where the digital signage 1 is installed and the entire chain store.
  • the related product information database 10 includes a product feature amount table 101, a related product table 102, and a product image table 103.
  • the product feature amount table 101 is a table in which product identification information for identifying a product handled so far and an image feature amount of the product are associated with each other and stored.
  • the related product table 102 is a table in which product identification information of products handled up to now and product identification information of related products related to the product are stored in association with each other.
  • the product image table 103 is a table in which product identification information and image data of the product (including images of the product itself and advertisement characters) are stored in association with each other.
  • the image data is not limited to a still image, and may be a moving image.
  • the related article information database 10 includes the product feature amount table 101, the related product table 102, and the product image table 103.
  • the present invention is not limited to this.
  • the product feature value, the product related to the product, and the image data related to the product may be associated with each other and configured with one table.
  • FIG. 4 is a diagram showing an example of the related article information database 10.
  • product identification information and the feature amount of the product are stored in association with each other.
  • product identification information “product A (”) ”and feature amount“ feature amount A ” are stored. ".
  • product identification information and product identification information of related products are stored in association with each other.
  • the product identification information “product A ( ⁇ )” and the product identification information of related products “ Product D ( ⁇ ) ” is associated with it.
  • product image table 103 product identification information and image data of the product are stored in association with each other.
  • product identification information “product A ( ⁇ )” and image data “image data A” are associated with each other. Is remembered.
  • the feature amount extraction unit 11 extracts the feature amount of the customer's clothes and belongings from the customer image captured by the camera 3.
  • the article in the image is picked up at a predetermined position, but it is difficult with digital signage installed in a store or the like. Therefore, in order to be able to identify the clothes and belongings of customers in the image robustly against changes in shooting size, angle, and occlusion, many characteristic points (feature points) in the image are detected and each feature is detected.
  • a feature amount (local feature amount) of a local region around a point is extracted. Representative methods include patent documents (US Pat. No. 6,711,293) and non-patent documents (David G.
  • a local feature quantity extraction device using a SIFT (Scale Invariant Feature Transform) feature quantity is disclosed.
  • SIFT Scale Invariant Feature Transform
  • a method for reducing the data size of the feature amount a feature point in an image is detected, a local region for each feature point is acquired, each local region is divided into a plurality of sub-regions, and each local region A multi-dimensional feature vector is generated for each sub-region, and based on the positional relationship of the sub-regions in each local region, the feature vector is determined for each sub-region so that the correlation between feature vectors of adjacent sub-regions is low. It is conceivable that a dimension is selected and an element of the selected dimension is used as a local region feature amount.
  • the customer to be recognized is specified according to a predetermined rule. For example, it may be considered that the person in the foreground in the customer image is the customer to be recognized. Further, not only the whole body of the customer but also a predetermined range such as the customer's face and hand can be set as a recognition target.
  • the collation unit 12 collates the feature quantity extracted by the feature quantity extraction unit 11 with the feature quantity of the product stored in the product feature quantity table 101 of the related article information database 10, and an image captured by the camera 3. Identify the clothes and belongings of customers inside. If the feature amounts match, product identification information corresponding to the feature amount is output to the related article information search unit 13.
  • the related product information search unit 13 receives the product identification information from the matching unit 12 and searches the related product table 102 for the product identification information of the related product corresponding to the product identification information. Then, the image data corresponding to the searched product identification information is searched from the product image table 103, and the image data of the searched product is output to the related article information output control unit 14.
  • the related product information output control unit 14 performs control to display on the display 2 a customer image captured by the camera 3 and a product of image data received from the related product information search unit 13. Further, control for displaying a normal advertisement, an event notification, etc. on the display 2 is performed.
  • the advertisement of the product, the notification of the event, etc. are displayed on the display 2.
  • the camera 3 takes a picture of the customer, and the customer image taken by the camera 3 is displayed on the display 2 of the digital signage 1 as shown in FIG.
  • the feature amount extraction unit 11 extracts the feature amount of the customer's clothes and belongings from the customer image captured by the camera 3.
  • the feature quantities of the belongings that can be extracted by the customer are “feature quantity A” and “feature quantity B”.
  • the collation unit 12 searches the product feature amount table 101 for product identification information corresponding to “feature amount A” and “feature amount B” extracted by the feature amount extraction unit 11.
  • the product identification information corresponding to the feature amount “feature amount A” is “product A (”) ”from the product feature amount table 101 of FIG. 4, and the product identification corresponding to the feature amount“ feature amount B ”is performed.
  • the information is “product B (glasses)”.
  • the related product information search unit 13 receives the product identification information from the matching unit 12 and searches the related product table 102 for the product identification information of the related product corresponding to the product identification information.
  • the product identification information from the matching unit 12 is “product A ( ⁇ )” and “product B (glasses)”, “product D ( I) ".
  • product Y (glasses)” is searched as product identification information related to “product B”.
  • the related product information search unit 13 searches the product image table 103 for product image data corresponding to the searched product identification information, and outputs the searched product image data to the related product information output control unit 14. To do.
  • image data D corresponding to “product D ( ⁇ )” is searched from the product image table 103 and output to the related article information output control unit 14.
  • image data Y corresponding to “product Y (glasses)” is searched from the product image table 103 and output to the related article information output control unit 14.
  • the digital signage 1 of the present embodiment recognizes a specific product worn by the customer, for example, a product that has been purchased in the store in the past from the photographed customer image. Therefore, it is possible to present a product advertisement tailored to the customer's taste.
  • FIG. 7 an example has been described in which images of “product D ( ⁇ )” and “product Y (glasses)” are displayed so as not to overlap the customer's video.
  • the related product may be displayed so as to be superimposed on the customer's clothes and belongings corresponding to the related product.
  • a necklace suitable for the product D ( ⁇ ) related to the “product D ( ⁇ )” is stored, and as shown in FIG. 9, an image of the necklace as a product related to the “product D ( ⁇ )” is stored. May be displayed at the position of the customer corresponding to the necklace.
  • the above embodiment is merely an example, and can be changed without departing from the present invention.
  • the related article information database 10, the feature amount extraction unit 11, the matching unit 12, and the related article information search unit 13 are configured in the digital signage 1, A part or all of them may be arranged on an external server or the like. An example is shown in FIG.
  • the collation server 20 which performs the extraction process of feature-value, collation, and the search process of related goods
  • the collation server 20 is the related goods information database 10
  • the feature-value extraction part 11 the collation part 12
  • a related article information search unit 13 and a communication unit 22 are provided.
  • the digital signage 1 is connected to the verification server 20 via the network 23, and the digital signage 1 includes a camera 3, a related article information output control unit 14, and a communication unit 21.
  • an image captured by the camera 3 is transmitted to the collation server 20 through the communication unit 21, and the collation server 20 extracts a feature amount from the received image and performs collation and related product search processing. It transmits to the digital signage 1 by the communication unit 22. Then, the digital signage 1 displays related products on the display 2 based on the result.
  • the advantage of the above configuration is that it is possible to reduce the processing load of the digital signage 1 by causing the server to perform heavy processing such as feature amount extraction and collation, and related product search processing. Further, by connecting a large number of digital signage 1 to the verification server 20 via the network 23, the verification server 20 can manage the processing and operation of the large number of digital signage 1.
  • FIG. 11 is a diagram showing a configuration of a modified example of the embodiment.
  • This embodiment is different from the above-described embodiment in that the digital signage 1 has a feature amount extraction unit 11 instead of the verification server 20. Then, the digital signage 1 extracts feature amounts from the customer image, and transmits the extracted feature amounts to the matching server 20.
  • the matching server 20 performs matching and related product search processing using the received feature amount.
  • the advantage of this embodiment is that what is transmitted from the digital signage 1 is not the customer image data but the feature amount, so that the amount of data to be transmitted is small, and the customer's personal information is not directly captured. It is preferable also from a viewpoint of protecting.
  • each unit may be configured by hardware or may be realized by a computer program.
  • functions and operations similar to those of the above-described embodiments and examples are realized by a processor that operates according to a program stored in the program memory.
  • a related article database in which feature quantities of articles and related article information related to related articles related to the article are stored in association with each other; Feature quantity extraction means for extracting feature quantities from a customer image in which the customer is shown; Collation means for collating the extracted feature quantity with the feature quantity stored in the related article database to identify the article worn by the customer; Related article information search means for searching related article information of a related article related to the identified article from the related article database; A digital signage system comprising: related article information output control means for outputting the searched related article information.
  • the said related article information output control means is a digital signage system of Additional remark 3 which superimposes and displays the said related article image on the image of the article
  • the collation server has at least the said related goods database, the said collation means, and the said related goods information search means, Digital signage has at least the feature quantity extraction means and the related article information output control means, The digital signage transmits the extracted feature amount of the article to the verification server, 8.
  • the digital signage system according to any one of appendix 1 to appendix 7, wherein the verification server transmits the related article information to the digital signage based on the feature amount of the article.
  • a related article database in which feature quantities of articles and related article information related to related articles related to the article are stored in association with each other, Feature quantity extraction means for extracting feature quantities from a customer image in which the customer is shown; Collation means for collating the extracted feature quantity with the feature quantity stored in the article database and identifying the article worn by the customer; Related article information search means for searching related article information of a related article related to the identified article from the related article database; Digital signage having related product information output control means for outputting related product information searched by the related product search means.
  • a related article information presentation method for presenting related article information in a digital signage system having a related article database in which feature quantities of articles and related article information related to related articles related to the article are stored in association with each other. There, Extract features from customer images of customers, Collating the extracted feature quantity with the feature quantity stored in the related article database to identify the article worn by the customer; Retrieving related item information of related items related to the identified item from the related item database; A related article information presentation method for outputting the retrieved related article information.
  • the related article information presentation method includes at least one of a related article image including a still image and a moving image of the article and introduction information of the article.
  • Additional remark 12 The related article information presentation method according to additional remark 11, wherein the related article image is displayed in a superimposed manner on the customer image at a position where the customer wears the related article.
  • Additional remark 13 The related goods information presentation method of Additional remark 12 which superimposes and displays the said related goods image on the image of the goods which the said customer wears among the said customer images.
  • the related article information includes at least one of a related article image including a still image and a moving image of the article and introduction information of the article.
  • Additional remark 18 The program of Additional remark 17 which makes a computer perform the process which superimposes and displays the said related goods image on the said customer image in the position which the customer wears the related goods.
  • Additional remark 19 The program of Additional remark 18 which makes a computer perform the process which superimposes and displays the said related article image on the image of the article
  • Additional remark 20 The program of Additional remark 17 which makes a computer perform the process which displays the said related article image of at least 1 or more so that the said related article image may not be superimposed on the customer of the said customer image.

Landscapes

  • Business, Economics & Management (AREA)
  • Strategic Management (AREA)
  • Engineering & Computer Science (AREA)
  • Accounting & Taxation (AREA)
  • Development Economics (AREA)
  • Finance (AREA)
  • Economics (AREA)
  • Game Theory and Decision Science (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Marketing (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Processing Or Creating Images (AREA)

Abstract

This invention is a digital signage system having: a related article database in which feature values for articles and related article information relating to related articles related to an article are associated and stored; a feature value extraction means that extracts feature values from a client image in which a client appears; a comparison means that compares the extracted feature values and feature values stored in the related article database, and identifies an article that a client is wearing; a related article information search means that searches related article information for related articles related to the identified article, from the related article database; and a related article information output control means that outputs the found related article information.

Description

デジタルサイネージシステム、デジタルサイネージ、物品情報提示方法及びプログラムDigital signage system, digital signage, article information presentation method and program
　本発明は、デジタルサイネージシステム、デジタルサイネージ、物品情報提示及びプログラムに関する。 The present invention relates to a digital signage system, digital signage, article information presentation, and a program.
　液晶ディスプレイやプロジェクタなどのディスプレイを用いて広告を表示する広告媒体であるデジタルサイネージ（Digital Signage）が、様々な場所に設置され始めている。デジタルサイネージを用いることで、動画や音声を用いた豊かなコンテンツの提供が可能になるばかりか、デジタルサイネージの設置場所に応じた効率的な広告配信が可能になるため、今後，デジタルサイネージのマーケットの拡大が期待されている。 Digital signage, an advertising medium that displays advertisements using displays such as liquid crystal displays and projectors, is beginning to be installed in various places. By using digital signage, not only will it be possible to provide rich content using video and audio, but it will also be possible to efficiently deliver advertisements according to the location of digital signage. Is expected to expand.
　一方、顧客情報を収集し、その顧客情報をマーケティングに活用することが行われている。このような発明の一つとして特許文献１に記載された発明がある。 On the other hand, customer information is collected and used for marketing. As one of such inventions, there is an invention described in Patent Document 1.
　特許文献１の技術は、画像処理部が、複数のカメラそれぞれが連続して撮影した商品購買顧客の複数画面から、顧客個人の性別、年齢層、職業などの特徴、滞在場所及びその時間、並びに顔向きから興味を有する注目商品、顧客の足取りコースなどを抽出して特定し、来店中顧客リストに登録する。そして、顧客管理部は、来店中顧客リストから特徴データを取り出し、特徴データに対応する予め保持された音声案内情報又は電子掲示情報を告示情報から取り出して出力部からアナウンス又は電子的な掲示を行うものである。 In the technology of Patent Document 1, the image processing unit, from a plurality of screens of product purchase customers photographed continuously by each of a plurality of cameras, features such as individual customer sex, age group, occupation, stay location and time, and The attention product, the customer's gait course, etc. that are interested from the face direction are extracted and specified, and are registered in the visiting customer list. Then, the customer management unit extracts the feature data from the customer list during the store visit, extracts the voice guidance information or electronic bulletin information stored in advance corresponding to the feature data from the notification information, and makes an announcement or electronic posting from the output unit Is.
特開２００４－３４８６１８号公報JP 2004-348618 A
　しかし、特許文献１の発明は、顧客の服装や持ち物といった顧客が身につけている商品等を識別する機能を有していないため、顧客の趣向が顕著に表れる顧客が身につけている商品に関する情報を取得することができない。従って、顧客の趣向に合致した顧客が身につけている商品に関連する商品の広告表示を自動的に提示することができなかった。 However, since the invention of Patent Document 1 does not have a function of identifying a product worn by the customer such as a customer's clothes and belongings, information on the product worn by the customer that clearly shows the customer's taste Can not get. Therefore, it is not possible to automatically present an advertisement display of a product related to the product worn by the customer that matches the customer's taste.
　更に、デジタルサイネージも単なる広告表示手段としての機能以外の他の機能が待ち望まれていた。 Furthermore, digital signage has been expected to have functions other than a simple advertisement display function.
　そこで、本発明は上記課題に鑑みて発明されたものであって、その目的は、単なる広告表示媒体だけではなく、顧客の趣向に合致した物品の情報を提示することができるジタルサイネージシステム、デジタルサイネージ、物品情報提示方法及びプログラムを提供することにある。 Accordingly, the present invention has been invented in view of the above problems, and its purpose is not only a mere advertisement display medium, but also a digital signage system capable of presenting information on articles that match customer preferences, digital To provide a signage, an article information presentation method, and a program.
　本発明は、物品の特徴量と、前記物品に関連する関連物品に関する関連物品情報とが関連付けられて記憶された関連物品データベースと、顧客が写った顧客画像から特徴量を抽出する特徴量抽出手段と、前記抽出された特徴量と、前記関連物品データベースに記憶されている特徴量とを照合し、前記顧客が身につけている物品を識別する照合手段と、前記識別した物品に関連する関連物品の関連物品情報を、前記関連物品データベースから検索する関連物品情報検索手段と、前記検索された関連物品情報を出力する関連物品情報出力制御手段とを有するデジタルサイネージシステムである。 The present invention relates to a related article database in which feature quantities of articles and related article information relating to related articles related to the articles are stored in association with each other, and feature quantity extracting means for extracting feature quantities from a customer image showing a customer. A collation means for collating the extracted feature quantity with the feature quantity stored in the related article database to identify the article worn by the customer, and a related article related to the identified article The related article information search means for searching the related article information from the related article database, and the related article information output control means for outputting the searched related article information.
　本発明は、物品の特徴量と、前記物品に関連する関連物品に関する関連物品情報とが関連付けられて記憶された関連物品データベースと、顧客が写った顧客画像から特徴量を抽出する特徴量抽出手段と、前記抽出された特徴量と、前記物品データベースに記憶されている特徴量とを照合し、前記顧客が身につけている物品を識別する照合手段と、前記識別した物品に関連する関連物品の関連物品情報を、前記関連物品データベースから検索する関連物品情報検索手段と、前記関連商品検索手段で検索された関連物品情報を出力する関連物品情報出力制御手段とを有するデジタルサイネージである。 The present invention relates to a related article database in which feature quantities of articles and related article information relating to related articles related to the articles are stored in association with each other, and feature quantity extracting means for extracting feature quantities from a customer image showing a customer. A collating means for collating the extracted feature quantity with the feature quantity stored in the article database to identify an article worn by the customer, and a related article related to the identified article The digital signage includes related article information search means for searching for related article information from the related article database, and related article information output control means for outputting related article information searched by the related goods search means.
　本発明は、物品の特徴量と、前記物品に関連する関連物品に関する関連物品情報とが関連付けられて記憶された関連物品データベースを有するデジタルサイネージシステムにおける関連物品情報を提示する関連物品情報提示方法であって、顧客が写った顧客画像から特徴量を抽出し、前記抽出された特徴量と、前記関連物品データベースに記憶されている特徴量とを照合し、前記顧客が身につけている物品を識別し、前記識別した物品に関連する関連物品の関連物品情報を、前記関連物品データベースから検索し、前記検索された関連物品情報を出力する関連物品情報提示方法である。 The present invention is a related article information presentation method for presenting related article information in a digital signage system having a related article database in which feature quantities of articles and related article information related to related articles related to the article are stored in association with each other. Then, a feature amount is extracted from a customer image in which the customer is photographed, the extracted feature amount is compared with a feature amount stored in the related article database, and an article worn by the customer is identified. The related article information presenting method is to search related article information of a related article related to the identified article from the related article database and to output the searched related article information.
　本発明は、物品の特徴量と、前記物品に関連する関連物品に関する関連物品情報とが関連付けられて記憶された関連物品データベースを有するシステムのコンピュータのプログラムであって、顧客が写った顧客画像から特徴量を抽出する処理と、前記抽出された特徴量と、前記関連物品データベースに記憶されている特徴量とを照合し、前記顧客が身につけている物品を識別する処理と、前記識別した物品に関連する関連物品の関連物品情報を、前記関連物品データベースから検索する処理と、前記検索された関連物品情報を出力する処理とをコンピュータに実行させるプログラムである。 The present invention is a computer program for a system having a related article database in which a feature quantity of an article and related article information related to the related article related to the article are stored in association with each other. A process of extracting a feature quantity, a process of collating the extracted feature quantity with the feature quantity stored in the related article database, and identifying an article worn by the customer; and the identified article Is a program that causes a computer to execute processing for searching related item information of related items related to the item from the related item database, and processing for outputting the searched related item information.
　本発明は、撮影された顧客の画像からその顧客が身につけている物品を認識することができるため、顧客の趣向に合わせた物品の情報を提示することができる。 In the present invention, since the article worn by the customer can be recognized from the photographed image of the customer, the information on the article according to the customer's taste can be presented.
図１は本発明の実施の形態におけるデジタルサイネージ１の構成図である。FIG. 1 is a configuration diagram of a digital signage 1 according to an embodiment of the present invention. 図２は実施例におけるデジタルサイネージ１の外観図である。FIG. 2 is an external view of the digital signage 1 in the embodiment. 図３は実施例のデジタルサイネージ１の構成図である。FIG. 3 is a configuration diagram of the digital signage 1 of the embodiment. 図４は実施例の関連物品情報データベース１０の一例を示した図である。FIG. 4 is a diagram illustrating an example of the related article information database 10 according to the embodiment. 図５は実施例の動作を説明する図である。FIG. 5 is a diagram for explaining the operation of the embodiment. 図６は実施例の動作を説明する図である。FIG. 6 is a diagram for explaining the operation of the embodiment. 図７は実施例の動作を説明する図である。FIG. 7 is a diagram for explaining the operation of the embodiment. 図８は実施例の動作を説明する図である。FIG. 8 is a diagram for explaining the operation of the embodiment. 図９は実施例の動作を説明する図である。FIG. 9 is a diagram for explaining the operation of the embodiment. 図１０は他の実施例のデジタルサイネージの構成図である。FIG. 10 is a block diagram of a digital signage according to another embodiment. 図１１は他の実施例のデジタルサイネージの構成図である。FIG. 11 is a configuration diagram of digital signage according to another embodiment.
　本発明の実施の形態を説明する。 Embodiments of the present invention will be described.
　本実施の形態は、デジタルサイネージの前に立った顧客を撮影した顧客画像から、服装や持ち物等の物品を識別し、現在に至るまでに販売又は提供した物品と照合して、顧客の物品が現在に至るまでに販売又は提供した物品であるかを識別する。そして、顧客の物品が現在に至るまでに販売又は提供した物品である場合、販売又は提供した物品に関連する関連物品の情報を、デジタルサイネージに提示するものである。 This embodiment identifies goods such as clothes and belongings from a customer image obtained by photographing a customer standing in front of digital signage, and collates with goods sold or provided so far. Identify whether the item has been sold or provided to date. If the customer's goods are goods sold or provided so far, information on related articles related to the goods sold or provided is presented to the digital signage.
　図１は、本実施の形態におけるデジタルサイネージシステムの構成図である。 FIG. 1 is a configuration diagram of a digital signage system according to the present embodiment.
　図１に示す如く、本実施の形態におけるデジタルサイネージシステムは、関連物品情報データベース１０と、特徴量抽出部１１と、照合部１２と、関連物品情報検索部１３と、関連物品情報出力制御部１４とを備える。 As shown in FIG. 1, the digital signage system according to the present embodiment includes a related article information database 10, a feature quantity extraction unit 11, a collation unit 12, a related article information search unit 13, and a related article information output control unit 14. With.
　関連物品情報データベース１０は、物品の特徴量と、物品に関連する関連物品に関する関連物品情報とが関連付けられて記憶されたデータベースである。ここで、物品とは、例えば、衣服やメガネ、バッグ等の身につけるものを含むが、これらに限定されない。また、関連物品情報とは、その物品に関連する関連物品の情報であり、例えば、ある物品が、顧客が身に着けている商品である場合、その商品のシリーズものや、その商品の新作商品、または、その商品に合う他の商品の情報などであるが、これに限られない。情報としては、その商品の静止画又は動画や、紹介情報、在庫、サイズなどが考えられる。 The related item information database 10 is a database in which the feature amount of an item and related item information related to the related item related to the item are stored in association with each other. Here, the articles include, for example, items worn on clothes, glasses, bags, and the like, but are not limited thereto. In addition, the related article information is related article information related to the article. For example, when a certain article is a product worn by a customer, a series of the product or a new product of the product. Or other product information that matches the product, but is not limited thereto. The information may be a still image or moving image of the product, introduction information, inventory, size, and the like.
　特徴量抽出部１１は、顧客が写った顧客画像から特徴量を抽出する。 The feature quantity extraction unit 11 extracts a feature quantity from a customer image showing a customer.
　照合部１２は、抽出された特徴量と、関連物品データベースに記憶されている特徴量とを照合し、顧客が身につけている物品を識別する。 The collation unit 12 collates the extracted feature quantity with the feature quantity stored in the related article database, and identifies the article worn by the customer.
　関連物品情報検索部１３は、識別した物品に関連する関連物品の関連物品情報を、関連物品情報データベース１０から検索する。 The related product information search unit 13 searches the related product information database 10 for related product information of related products related to the identified product.
　関連物品情報出力制御部１４は、検索された関連物品情報、例えば、静止画や動画（例えば、特別映像等）、音楽又は音声などを、デジタルサイネージのディスプレイや、スピーカに出力する。 The related article information output control unit 14 outputs the searched related article information, for example, a still image, a moving image (for example, a special video), music, voice, or the like to a digital signage display or a speaker.
　本実施の形態では、撮影された顧客の顧客画像からその顧客が身につけている物品を識別することができるため、顧客の趣向に合わせた物品を顧客に提示することができる。 In the present embodiment, since the article worn by the customer can be identified from the photographed customer image of the customer, the article suited to the customer's taste can be presented to the customer.
　次に、本発明の具体的な実施例を説明する。尚、以下の説明において、理解を容易にするために、物品の例として、業者が過去又は現在扱っている商品を例にして説明する。 Next, specific examples of the present invention will be described. In the following description, in order to facilitate understanding, as an example of an article, an explanation will be given taking an example of a product handled by a trader in the past or present.
　図２は、本実施例におけるデジタルサイネージ１の外観図である。 FIG. 2 is an external view of the digital signage 1 in the present embodiment.
　図２に示すように、デジタルサイネージ１は、店舗等などに設置され、ディスプレイ２を用いて、通常は広告映像を表示する。また、デジタルサイネージ１には、広告映像を再生するディスプレイ２の他に、顧客の服装や持ち物を識別するための画像を撮像するカメラ３が設けられている。 As shown in FIG. 2, the digital signage 1 is installed in a store or the like, and usually displays an advertisement video using the display 2. In addition to the display 2 that reproduces the advertisement video, the digital signage 1 is provided with a camera 3 that captures an image for identifying a customer's clothes and belongings.
　図３はデジタルサイネージ１の構成図である。 FIG. 3 is a block diagram of the digital signage 1.
　図３に示す如く、デジタルサイネージ１は、ディスプレイ２と、カメラ３と、関連物品情報データベース１０と、特徴量抽出部１１と、照合部１２と、関連物品情報検索部１３と、関連物品情報出力制御部１４とを備える。 As shown in FIG. 3, the digital signage 1 includes a display 2, a camera 3, a related product information database 10, a feature amount extraction unit 11, a collation unit 12, a related product information search unit 13, and related product information output. And a control unit 14.
　関連物品情報データベース１０は、デジタルサイネージ１が設置されている店舗や、チェーン店全体で扱っている商品に関する情報のデータベースである。具体的には、関連物品情報データベース１０は、商品特徴量テーブル１０１と、関連商品テーブル１０２と、商品画像テーブル１０３とを有する。 The related article information database 10 is a database of information related to products handled in the store where the digital signage 1 is installed and the entire chain store. Specifically, the related product information database 10 includes a product feature amount table 101, a related product table 102, and a product image table 103.
　商品特徴量テーブル１０１は、現在までに扱った商品の識別する商品識別情報と、その商品の画像特徴量とが関連付けられて記憶されたテーブルである。 The product feature amount table 101 is a table in which product identification information for identifying a product handled so far and an image feature amount of the product are associated with each other and stored.
　関連商品テーブル１０２は、現在までに扱った商品の商品識別情報と、その商品に関連する関連商品の商品識別情報とが関連付けられて記憶されたテーブルである。 The related product table 102 is a table in which product identification information of products handled up to now and product identification information of related products related to the product are stored in association with each other.
　商品画像テーブル１０３は、商品識別情報とその商品の画像データ（商品自体の画像や広告の文字を含む）とが関連付けられて記憶されたテーブルである。尚、画像データは静止画に限られず、動画でも良い。 The product image table 103 is a table in which product identification information and image data of the product (including images of the product itself and advertisement characters) are stored in association with each other. The image data is not limited to a still image, and may be a moving image.
　尚、本実施の形態では、関連物品情報データベース１０を、商品特徴量テーブル１０１と、関連商品テーブル１０２と、商品画像テーブル１０３との３つで構成したが、これに限定されるものではない。例えば、商品特徴量と、前記商品に関連する商品と、それらの商品に関する画像データとを関連付けて、ひとつのテーブルで構成するようにしても良い。 In the present embodiment, the related article information database 10 includes the product feature amount table 101, the related product table 102, and the product image table 103. However, the present invention is not limited to this. For example, the product feature value, the product related to the product, and the image data related to the product may be associated with each other and configured with one table.
　図４は関連物品情報データベース１０の一例を示した図である。 FIG. 4 is a diagram showing an example of the related article information database 10.
　図４に示される商品特徴量テーブル１０１では、商品識別情報とその商品の特徴量とが関連付けられて記憶されており、例えば、商品識別情報“商品Ａ（鞄）”と特徴量“特徴量Ａ”とが関連付けられている。また、関連商品テーブル１０２では、商品識別情報と、関連商品の商品識別情報とが関連付けられて記憶されており、例えば、商品識別情報“商品Ａ（鞄）”と、関連商品の商品識別情報“商品Ｄ（鞄）”とが関連付けられている。また、商品画像テーブル１０３では、商品識別情報とその商品の画像データとが関連付けられて記憶されており、例えば、商品識別情報“商品Ａ（鞄）”と画像データ“画像データＡ”とが関連付けられて記憶されている。 In the product feature amount table 101 shown in FIG. 4, product identification information and the feature amount of the product are stored in association with each other. For example, product identification information “product A (”) ”and feature amount“ feature amount A ”are stored. ". In the related product table 102, product identification information and product identification information of related products are stored in association with each other. For example, the product identification information “product A (鞄)” and the product identification information of related products “ Product D (鞄) ”is associated with it. In the product image table 103, product identification information and image data of the product are stored in association with each other. For example, product identification information “product A (商品)” and image data “image data A” are associated with each other. Is remembered.
　特徴量抽出部１１は、カメラ３で撮像された顧客の画像から顧客の服装や持ち物の特徴量を抽出するものである。画像からの特徴量の抽出方法を容易にするためには、画像中の物品が予め定められた位置で撮像されることが好ましいが、店舗などに設置されるデジタルサイネージでは難しい。そこで、画像内の顧客の服装や持ち物を、撮影サイズや角度の変化、オクルージョンに対して頑健に識別可能とするために、画像内の特徴的な点（特徴点）を多数検出し、各特徴点周辺の局所領域の特徴量（局所特徴量）を抽出する。その代表的な方式として、特許文献（米国特許第６７１１２９３号明細書）や、非特許文献（David G. Lowe著、「Distinctive image features from scale-invariant keypoints」、International Journal of Computer Vision、60(2)、2004年、p. 91-110）には、ＳＩＦＴ（Ｓｃａｌｅ　Ｉｎｖａｒｉａｎｔ　Ｆｅａｔｕｒｅ　Ｔｒａｎｓｆｏｒｍ）特徴量を用いる局所特徴量抽出装置が開示されている。また、特徴量のデータサイズを小さくする方法としては、画像内の特徴点を検出し、各特徴点に対する局所領域を取得し、各局所領域を複数のサブ領域に分割し、各局所領域内のサブ領域ごとに複数次元の特徴ベクトルを生成し、各局所領域内のサブ領域の位置関係に基づいて、近接するサブ領域の特徴ベクトル間の相関が低くなるようにサブ領域ごとに前記特徴ベクトルから次元を選定し、選定された次元の要素を局所領域の特徴量とすることが考えられる。 The feature amount extraction unit 11 extracts the feature amount of the customer's clothes and belongings from the customer image captured by the camera 3. In order to facilitate the method of extracting the feature amount from the image, it is preferable that the article in the image is picked up at a predetermined position, but it is difficult with digital signage installed in a store or the like. Therefore, in order to be able to identify the clothes and belongings of customers in the image robustly against changes in shooting size, angle, and occlusion, many characteristic points (feature points) in the image are detected and each feature is detected. A feature amount (local feature amount) of a local region around a point is extracted. Representative methods include patent documents (US Pat. No. 6,711,293) and non-patent documents (David G. Lowe, “Distinctive image features from scale-invariant keypoints”, International Journal of Computer Vision, 60 (2 ), 2004, p. 91-110), a local feature quantity extraction device using a SIFT (Scale Invariant Feature Transform) feature quantity is disclosed. As a method for reducing the data size of the feature amount, a feature point in an image is detected, a local region for each feature point is acquired, each local region is divided into a plurality of sub-regions, and each local region A multi-dimensional feature vector is generated for each sub-region, and based on the positional relationship of the sub-regions in each local region, the feature vector is determined for each sub-region so that the correlation between feature vectors of adjacent sub-regions is low. It is conceivable that a dimension is selected and an element of the selected dimension is used as a local region feature amount.
　尚、顧客画像中に複数人の人物が写っている場合には、予め定められた規則により、認識対象となる顧客を特定する。例えば、顧客画像のなかで一番手前に写っている人物を認識対象の顧客とすることが考えられる。また、顧客の全身だけではなく、顧客の顔や手などの所定範囲のみを認識対象とすることもできる。 When a plurality of persons are shown in the customer image, the customer to be recognized is specified according to a predetermined rule. For example, it may be considered that the person in the foreground in the customer image is the customer to be recognized. Further, not only the whole body of the customer but also a predetermined range such as the customer's face and hand can be set as a recognition target.
　照合部１２は、特徴量抽出部１１で抽出された特徴量と、関連物品情報データベース１０の商品特徴量テーブル１０１に記憶されている商品の特徴量とを照合し、カメラ３で撮像された画像中の顧客の服装や持ち物を識別する。そして、特徴量が一致する場合にはその特徴量に対応する商品識別情報を、関連物品情報検索部１３に出力する。 The collation unit 12 collates the feature quantity extracted by the feature quantity extraction unit 11 with the feature quantity of the product stored in the product feature quantity table 101 of the related article information database 10, and an image captured by the camera 3. Identify the clothes and belongings of customers inside. If the feature amounts match, product identification information corresponding to the feature amount is output to the related article information search unit 13.
　関連物品情報検索部１３は、照合部１２から商品識別情報を受信し、その商品識別情報に対応する関連商品の商品識別情報を、関連商品テーブル１０２から検索する。そして、検索された商品識別情報に対応する画像データを、商品画像テーブル１０３から検索し、その検索した商品の画像データを、関連物品情報出力制御部１４に出力する。 The related product information search unit 13 receives the product identification information from the matching unit 12 and searches the related product table 102 for the product identification information of the related product corresponding to the product identification information. Then, the image data corresponding to the searched product identification information is searched from the product image table 103, and the image data of the searched product is output to the related article information output control unit 14.
　関連物品情報出力制御部１４は、カメラ３で撮像した顧客の画像や、関連物品情報検索部１３から受信した画像データの商品をディスプレイ２に表示する制御を行う。また、通常時の広告やイベントの告知等をディスプレイ２に表示する制御を行うものである。 The related product information output control unit 14 performs control to display on the display 2 a customer image captured by the camera 3 and a product of image data received from the related product information search unit 13. Further, control for displaying a normal advertisement, an event notification, etc. on the display 2 is performed.
　次に、上述した構成における本実施の形態の具体的な動作を説明する。尚、以下の説明において、関連物品情報データベース１０は図４に示されている内容のものとする。 Next, a specific operation of the present embodiment in the configuration described above will be described. In the following description, it is assumed that the related article information database 10 has the contents shown in FIG.
　図５に示す如く、通常時、例えば、顧客がデジタルサイネージ１に前に立っていない場合には、商品の広告や、イベントの告知などがディスプレイ２に表示される。 As shown in FIG. 5, at the normal time, for example, when the customer is not standing in front of the digital signage 1, the advertisement of the product, the notification of the event, etc. are displayed on the display 2.
　顧客がデジタルサイネージ１に前の前に立つと、顔認識等により、人であることを認識し、動作を開始する。 When the customer stands in front of Digital Signage 1, it recognizes that it is a person by face recognition and starts operation.
　次に、カメラ３は顧客を撮影し、図６に示す如く、カメラ３で撮像された顧客の画像は、デジタルサイネージ１のディスプレイ２に表示される。そして、特徴量抽出部１１は、カメラ３で撮像された顧客の画像から顧客の服装や持ち物の特徴量を抽出する。本例では、抽出できた顧客の身につけている持ち物の特徴量が、“特徴量Ａ”と“特徴量Ｂ”とする。 Next, the camera 3 takes a picture of the customer, and the customer image taken by the camera 3 is displayed on the display 2 of the digital signage 1 as shown in FIG. Then, the feature amount extraction unit 11 extracts the feature amount of the customer's clothes and belongings from the customer image captured by the camera 3. In this example, it is assumed that the feature quantities of the belongings that can be extracted by the customer are “feature quantity A” and “feature quantity B”.
　照合部１２は、特徴量抽出部１１で抽出された“特徴量Ａ”と“特徴量Ｂ”に対応する商品識別情報を、商品特徴量テーブル１０１から検索する。本例では、図４の商品特徴量テーブル１０１から、特徴量“特徴量Ａ”に対応する商品識別情報が“商品Ａ（鞄）”であり、特徴量“特徴量Ｂ”に対応する商品識別情報が“商品Ｂ（メガネ）”である。 The collation unit 12 searches the product feature amount table 101 for product identification information corresponding to “feature amount A” and “feature amount B” extracted by the feature amount extraction unit 11. In this example, the product identification information corresponding to the feature amount “feature amount A” is “product A (”) ”from the product feature amount table 101 of FIG. 4, and the product identification corresponding to the feature amount“ feature amount B ”is performed. The information is “product B (glasses)”.
　続いて、関連物品情報検索部１３は、照合部１２から商品識別情報を受信し、その商品識別情報に対応する関連商品の商品識別情報を、関連商品テーブル１０２から検索する。本例では、照合部１２からの商品識別情報は“商品Ａ（鞄）”と“商品Ｂ（メガネ）”であるので、“商品Ａ（鞄）”に関連する商品識別情報として“商品Ｄ（鞄）”を検索する。また、“商品Ｂ”に関連する商品識別情報として“商品Ｙ（メガネ）”を検索する。そして、関連物品情報検索部１３は、検索した商品識別情報に対応する商品の画像データを、商品画像テーブル１０３から検索し、その検索した商品の画像データを、関連物品情報出力制御部１４に出力する。本例では、商品画像テーブル１０３から、“商品Ｄ（鞄）”に対応する“画像データＤ”を検索し、関連物品情報出力制御部１４に出力する。また、商品画像テーブル１０３から、“商品Ｙ（メガネ）”に対応する“画像データＹ”を検索し、関連物品情報出力制御部１４に出力する。 Subsequently, the related product information search unit 13 receives the product identification information from the matching unit 12 and searches the related product table 102 for the product identification information of the related product corresponding to the product identification information. In this example, since the product identification information from the matching unit 12 is “product A (鞄)” and “product B (glasses)”, “product D ( I) ". Further, “product Y (glasses)” is searched as product identification information related to “product B”. Then, the related product information search unit 13 searches the product image table 103 for product image data corresponding to the searched product identification information, and outputs the searched product image data to the related product information output control unit 14. To do. In this example, “image data D” corresponding to “product D (鞄)” is searched from the product image table 103 and output to the related article information output control unit 14. Further, “image data Y” corresponding to “product Y (glasses)” is searched from the product image table 103 and output to the related article information output control unit 14.
　関連物品情報出力制御部１４は、関連物品情報検索部１３から受信した“画像データＤ”及び“画像データＹ”に基づいて、図７に示すように、顧客の映像に重ならないように、“商品Ｄ（鞄）”及び“商品Ｙ（メガネ）”の画像を表示する。 Based on the “image data D” and “image data Y” received from the related product information search unit 13, the related product information output control unit 14, as shown in FIG. Images of “Product D (鞄)” and “Product Y (Glasses)” are displayed.
　以上の如く、本実施の形態のデジタルサイネージ１は、撮影された顧客の画像からその顧客が身につけている特定の商品、例えば、過去にその店舗で購入した実績のある商品を認識することができるため、顧客の趣向に合わせた商品広告を提示することができる。 As described above, the digital signage 1 of the present embodiment recognizes a specific product worn by the customer, for example, a product that has been purchased in the store in the past from the photographed customer image. Therefore, it is possible to present a product advertisement tailored to the customer's taste.
　尚、上述した実施の形態では、図７に示すように、顧客の映像に重ならないように、“商品Ｄ（鞄）”及び“商品Ｙ（メガネ）”の画像を表示する例を説明したが、図８に示すように、関連商品に対応する顧客の服装や持ち物に重畳するように、その関連する商品を表示するようにしても良い。 In the above-described embodiment, as shown in FIG. 7, an example has been described in which images of “product D (鞄)” and “product Y (glasses)” are displayed so as not to overlap the customer's video. As shown in FIG. 8, the related product may be displayed so as to be superimposed on the customer's clothes and belongings corresponding to the related product.
　また、関連物品情報データベース１０に、関連商品として同一種類の商品のみならず、関連する商品を記憶させておけば、幅広い商品の提示を行うことができる。例えば、“商品Ｄ（鞄）”に関連して商品Ｄ（鞄）に合うネックレス”を記憶させておき、図９に示す如く、“商品Ｄ（鞄）”に関連する商品としてそのネックレスの画像を、ネックレスが対応する顧客の位置に表示するようにしても良い。 Further, if not only related products but also related products are stored in the related product information database 10, a wide variety of products can be presented. For example, a necklace suitable for the product D (鞄) related to the “product D (鞄)” is stored, and as shown in FIG. 9, an image of the necklace as a product related to the “product D (鞄)” is stored. May be displayed at the position of the customer corresponding to the necklace.
　また、本実施の形態では、デジタルサイネージ１のディスプレイ２に顧客の姿全体が表示される構成を取ったが、これに限られず、撮影した顧客の姿は表示せずに、関連商品のみをディスプレイ２に表示するようにしても良い。 Moreover, in this Embodiment, although the structure which displays the customer's whole figure on the display 2 of the digital signage 1 was taken, it is not restricted to this, Only the related product is displayed without displaying the photographed customer's figure. 2 may be displayed.
　更に、上記実施例は一例であって、本発明を逸脱しない範囲で変更することができる。例えば、上述した実施例では、関連物品情報データベース１０と、特徴量抽出部１１と、照合部１２と、関連物品情報検索部１３とを、デジタルサイネージ１の内部にある構成としたが、それらの一部又は全部を外部のサーバ等に配置しても良い。図１０にその一例を示す。 Furthermore, the above embodiment is merely an example, and can be changed without departing from the present invention. For example, in the above-described embodiment, the related article information database 10, the feature amount extraction unit 11, the matching unit 12, and the related article information search unit 13 are configured in the digital signage 1, A part or all of them may be arranged on an external server or the like. An example is shown in FIG.
　図１０の例では、特徴量の抽出、照合及び関連商品の検索処理を行う照合サーバ２０を有し、照合サーバ２０は関連物品情報データベース１０と、特徴量抽出部１１と、照合部１２と、関連物品情報検索部１３と、通信部２２とを備えている。そして、デジタルサイネージ１はネットワーク２３を介して照合サーバ２０と接続されており、デジタルサイネージ１には、カメラ３と、関連物品情報出力制御部１４と、通信部２１とを備えている。 In the example of FIG. 10, it has the collation server 20 which performs the extraction process of feature-value, collation, and the search process of related goods, and the collation server 20 is the related goods information database 10, the feature-value extraction part 11, the collation part 12, A related article information search unit 13 and a communication unit 22 are provided. The digital signage 1 is connected to the verification server 20 via the network 23, and the digital signage 1 includes a camera 3, a related article information output control unit 14, and a communication unit 21.
　デジタルサイネージ１では、カメラ３で撮影した画像を通信部２１により、照合サーバ２０に送信し、照合サーバ２０は受信した画像から特徴量を抽出して照合、関連商品検索処理を行い、その結果を通信部２２によりデジタルサイネージ１に送信する。そして、デジタルサイネージ１は、その結果に基づき、関連商品をディスプレイ２に表示する。 In the digital signage 1, an image captured by the camera 3 is transmitted to the collation server 20 through the communication unit 21, and the collation server 20 extracts a feature amount from the received image and performs collation and related product search processing. It transmits to the digital signage 1 by the communication unit 22. Then, the digital signage 1 displays related products on the display 2 based on the result.
　上記の構成の利点は、特徴量の抽出や照合、関連商品検索処理といった負荷のかかる処理をサーバに行わせることにより、デジタルサイネージ１の処理の負荷の軽減を図れることにある。また、多数のデジタルサイネージ１を、ネットワーク２３を介して照合サーバ２０と接続することにより、照合サーバ２０により、多数のデジタルサイネージ１の処理や運用を管理することができる。 The advantage of the above configuration is that it is possible to reduce the processing load of the digital signage 1 by causing the server to perform heavy processing such as feature amount extraction and collation, and related product search processing. Further, by connecting a large number of digital signage 1 to the verification server 20 via the network 23, the verification server 20 can manage the processing and operation of the large number of digital signage 1.
　次に、上述した実施例の変形例を説明する。 Next, a modification of the above embodiment will be described.
　図１１は実施例の変形例の構成を示す図である。 FIG. 11 is a diagram showing a configuration of a modified example of the embodiment.
　本実施例が上述した実施例と異なる所は、照合サーバ２０の代わりに、特徴量抽出部１１をデジタルサイネージ１が有している点である。そして、デジタルサイネージ１が顧客画像から特徴量の抽出を行い、抽出した特徴量を照合サーバ２０に送信する。照合サーバ２０では、受信した特徴量を用いて、照合、関連商品検索処理を行う。 This embodiment is different from the above-described embodiment in that the digital signage 1 has a feature amount extraction unit 11 instead of the verification server 20. Then, the digital signage 1 extracts feature amounts from the customer image, and transmits the extracted feature amounts to the matching server 20. The matching server 20 performs matching and related product search processing using the received feature amount.
　本実施例の利点は、デジタルサイネージ１から送信するものが顧客の画像データではなく、特徴量なので、送信するデータ量が少なく、また、顧客が直接写っている画像ではないので、顧客の個人情報を保護する観点からも好ましい。 The advantage of this embodiment is that what is transmitted from the digital signage 1 is not the customer image data but the feature amount, so that the amount of data to be transmitted is small, and the customer's personal information is not directly captured. It is preferable also from a viewpoint of protecting.
　以上で本発明の実施の形態及び実施例の説明を終わるが、上述した説明からも明らかなように、各部をハードウェアで構成してもよいし、コンピュータプログラムにより実現してもよい。この場合、プログラムメモリに格納されているプログラムで動作するプロセッサによって、上述した各実施の形態及び実施例と同様の機能、動作を実現させる。また、上述した実施の形態の一部の機能のみをコンピュータプログラムにより実現してもよい。 This is the end of the description of the embodiments and examples of the present invention. As is apparent from the above description, each unit may be configured by hardware or may be realized by a computer program. In this case, functions and operations similar to those of the above-described embodiments and examples are realized by a processor that operates according to a program stored in the program memory. Moreover, you may implement | achieve only a part of function of embodiment mentioned above with a computer program.
　また、上記の実施形態の一部又は全部は、以下の付記のようにも記載されうるが、以下には限られない。 Further, a part or all of the above embodiment can be described as in the following supplementary notes, but is not limited thereto.
　（付記１）　物品の特徴量と、前記物品に関連する関連物品に関する関連物品情報とが関連付けられて記憶された関連物品データベースと、
　顧客が写った顧客画像から特徴量を抽出する特徴量抽出手段と、
　前記抽出された特徴量と、前記関連物品データベースに記憶されている特徴量とを照合し、前記顧客が身につけている物品を識別する照合手段と、
　前記識別した物品に関連する関連物品の関連物品情報を、前記関連物品データベースから検索する関連物品情報検索手段と、
　前記検索された関連物品情報を出力する関連物品情報出力制御手段と
を有するデジタルサイネージシステム。 (Supplementary Note 1) A related article database in which feature quantities of articles and related article information related to related articles related to the article are stored in association with each other;
Feature quantity extraction means for extracting feature quantities from a customer image in which the customer is shown;
Collation means for collating the extracted feature quantity with the feature quantity stored in the related article database to identify the article worn by the customer;
Related article information search means for searching related article information of a related article related to the identified article from the related article database;
A digital signage system comprising: related article information output control means for outputting the searched related article information.
　（付記２）　前記関連物品情報が、物品の静止画、動画を含む関連物品画像と、前記物品の紹介情報とのいずれかを少なくとも含む
付記１に記載のデジタルサイネージシステム。 (Supplementary note 2) The digital signage system according to supplementary note 1, wherein the related article information includes at least one of a related article image including a still image and a moving image of the article and introduction information of the article.
　（付記３）　前記関連物品情報出力制御手段は、前記関連物品画像を、その関連物品を顧客が身につける位置に、前記顧客画像に重畳して表示する
付記２に記載のデジタルサイネージシステム。 (Supplementary note 3) The digital signage system according to supplementary note 2, wherein the related article information output control means displays the related article image superimposed on the customer image at a position where the customer wears the related article.
　（付記４）　前記関連物品情報出力制御手段は、前記顧客画像のうち前記顧客が身につけている物品の画像に、前記関連物品画像を重畳して表示する
付記３に記載のデジタルサイネージシステム。 (Additional remark 4) The said related article information output control means is a digital signage system of Additional remark 3 which superimposes and displays the said related article image on the image of the article | item which the said customer wears among the said customer images.
　（付記５）　前記関連物品情報出力制御手段は、前記関連物品画像を、前記顧客画像の顧客に重畳しないように、少なくとも一以上の前記関連物品画像を表示する
付記２に記載のデジタルサイネージシステム。 (Supplementary note 5) The digital signage system according to supplementary note 2, wherein the related article information output control means displays at least one or more related article images so as not to superimpose the related article image on a customer of the customer image.
　（付記６）　前記顧客画像に複数の人物が写っている場合、所定の優先度に従って顧客を特定する顧客特定手段を有する
付記１から付記５のいずれかに記載のデジタルサイネージシステム。 (Supplementary note 6) The digital signage system according to any one of supplementary note 1 to supplementary note 5 having customer specifying means for specifying a customer according to a predetermined priority when a plurality of persons are reflected in the customer image.
　（付記７）　前記物品を所持又は配置する人物がデジタルサイネージを視認可能な領域を撮像することができる位置に配置され、前記物品を撮像する撮像手段を有する
付記１から付記６に記載のデジタルサイネージシステム。 (Supplementary note 7) The digital signage according to any one of supplementary notes 1 to 6, wherein the person who possesses or arranges the article is arranged at a position where an image of the area where the digital signage can be visually recognized is provided, and has imaging means for imaging the article. system.
　（付記８）　照合サーバが、前記関連物品データベースと、前記照合手段と、前記関連物品情報検索手段とを少なくとも有し、
　デジタルサイネージが、前記特徴量抽出手段と、前記関連物品情報出力制御手段とを少なくとも有し、
　前記デジタルサイネージが、前記抽出した物品の特徴量を、前記照合サーバに送信し、
　前記照合サーバが、前記物品の特徴量に基づいて、前記関連物品情報を前記デジタルサイネージに送信する
付記１から付記７のいずれかに記載のデジタルサイネージシステム。 (Additional remark 8) The collation server has at least the said related goods database, the said collation means, and the said related goods information search means,
Digital signage has at least the feature quantity extraction means and the related article information output control means,
The digital signage transmits the extracted feature amount of the article to the verification server,
8. The digital signage system according to any one of appendix 1 to appendix 7, wherein the verification server transmits the related article information to the digital signage based on the feature amount of the article.
　（付記９）　物品の特徴量と、前記物品に関連する関連物品に関する関連物品情報とが関連付けられて記憶された関連物品データベースと、
　顧客が写った顧客画像から特徴量を抽出する特徴量抽出手段と、
　前記抽出された特徴量と、前記物品データベースに記憶されている特徴量とを照合し、前記顧客が身につけている物品を識別する照合手段と、
　前記識別した物品に関連する関連物品の関連物品情報を、前記関連物品データベースから検索する関連物品情報検索手段と、
　前記関連商品検索手段で検索された関連物品情報を出力する関連物品情報出力制御手段と
を有するデジタルサイネージ。 (Supplementary Note 9) A related article database in which feature quantities of articles and related article information related to related articles related to the article are stored in association with each other,
Feature quantity extraction means for extracting feature quantities from a customer image in which the customer is shown;
Collation means for collating the extracted feature quantity with the feature quantity stored in the article database and identifying the article worn by the customer;
Related article information search means for searching related article information of a related article related to the identified article from the related article database;
Digital signage having related product information output control means for outputting related product information searched by the related product search means.
　（付記１０）　物品の特徴量と、前記物品に関連する関連物品に関する関連物品情報とが関連付けられて記憶された関連物品データベースを有するデジタルサイネージシステムにおける関連物品情報を提示する関連物品情報提示方法であって、
　顧客が写った顧客画像から特徴量を抽出し、
　前記抽出された特徴量と、前記関連物品データベースに記憶されている特徴量とを照合し、前記顧客が身につけている物品を識別し、
　前記識別した物品に関連する関連物品の関連物品情報を、前記関連物品データベースから検索し、
　前記検索された関連物品情報を出力する
関連物品情報提示方法。 (Supplementary Note 10) A related article information presentation method for presenting related article information in a digital signage system having a related article database in which feature quantities of articles and related article information related to related articles related to the article are stored in association with each other. There,
Extract features from customer images of customers,
Collating the extracted feature quantity with the feature quantity stored in the related article database to identify the article worn by the customer;
Retrieving related item information of related items related to the identified item from the related item database;
A related article information presentation method for outputting the retrieved related article information.
　（付記１１）　前記関連物品情報が、物品の静止画、動画を含む関連物品画像と、前記物品の紹介情報とのいずれかを少なくとも含む
付記１０に記載の関連物品情報提示方法。 (Supplementary note 11) The related article information presentation method according to supplementary note 10, wherein the related article information includes at least one of a related article image including a still image and a moving image of the article and introduction information of the article.
　（付記１２）　前記関連物品画像を、その関連物品を顧客が身につける位置に、前記顧客画像に重畳して表示する
付記１１に記載の関連物品情報提示方法。 (Additional remark 12) The related article information presentation method according to additional remark 11, wherein the related article image is displayed in a superimposed manner on the customer image at a position where the customer wears the related article.
　（付記１３）　前記顧客画像のうち前記顧客が身につけている物品の画像に、前記関連物品画像を重畳して表示する
付記１２に記載の関連物品情報提示方法。 (Additional remark 13) The related goods information presentation method of Additional remark 12 which superimposes and displays the said related goods image on the image of the goods which the said customer wears among the said customer images.
　（付記１４）　前記関連物品画像を、前記顧客画像の顧客に重畳しないように、少なくとも一以上の前記関連物品画像を表示する
付記１１に記載の関連物品情報提示方法。 (Supplementary note 14) The related article information presentation method according to supplementary note 11, wherein at least one related article image is displayed so that the related article image is not superimposed on a customer of the customer image.
　（付記１５）　前記顧客画像に複数の人物が写っている場合、所定の優先度に従って顧客を特定する
付記１０から付記１４のいずれかに記載の関連物品情報提示方法。 (Supplementary Note 15) The related article information presentation method according to any one of Supplementary Note 10 to Supplementary Note 14, wherein when a plurality of persons are reflected in the customer image, the customer is specified according to a predetermined priority.
　（付記１６）　物品の特徴量と、前記物品に関連する関連物品に関する関連物品情報とが関連付けられて記憶された関連物品データベースを有するシステムのコンピュータのプログラムであって、
　顧客が写った顧客画像から特徴量を抽出する処理と、
　前記抽出された特徴量と、前記関連物品データベースに記憶されている特徴量とを照合し、前記顧客が身につけている物品を識別する処理と、
　前記識別した物品に関連する関連物品の関連物品情報を、前記関連物品データベースから検索する処理と、
　前記検索された関連物品情報を出力する処理と
をコンピュータに実行させるプログラム。 (Supplementary Note 16) A computer program for a system having a related article database in which feature quantities of articles and related article information related to related articles related to the article are stored in association with each other.
A process of extracting features from a customer image in which the customer is shown;
A process of collating the extracted feature quantity with the feature quantity stored in the related article database and identifying the article worn by the customer;
A process of retrieving related article information of a related article related to the identified article from the related article database;
A program for causing a computer to execute a process of outputting the retrieved related article information.
　（付記１７）　前記関連物品情報が、物品の静止画、動画を含む関連物品画像と、前記物品の紹介情報とのいずれかを少なくとも含む
付記１６に記載のプログラム。 (Supplementary note 17) The program according to supplementary note 16, wherein the related article information includes at least one of a related article image including a still image and a moving image of the article and introduction information of the article.
　（付記１８）　前記関連物品画像を、その関連物品を顧客が身につける位置に、前記顧客画像に重畳して表示する処理をコンピュータに実行させる
付記１７に記載のプログラム。 (Additional remark 18) The program of Additional remark 17 which makes a computer perform the process which superimposes and displays the said related goods image on the said customer image in the position which the customer wears the related goods.
　（付記１９）　前記顧客画像のうち前記顧客が身につけている物品の画像に、前記関連物品画像を重畳して表示する処理をコンピュータに実行させる
付記１８に記載のプログラム。 (Additional remark 19) The program of Additional remark 18 which makes a computer perform the process which superimposes and displays the said related article image on the image of the article | item which the said customer wears among the said customer images.
　（付記２０）　前記関連物品画像を、前記顧客画像の顧客に重畳しないように、少なくとも一以上の前記関連物品画像を表示する処理をコンピュータに実行させる
付記１７に記載のプログラム。 (Additional remark 20) The program of Additional remark 17 which makes a computer perform the process which displays the said related article image of at least 1 or more so that the said related article image may not be superimposed on the customer of the said customer image.
　（付記２１）　前記顧客画像に複数の人物が写っている場合、所定の優先度に従って顧客を特定する処理をコンピュータに実行させる
付記１６から付記２０のいずれかに記載のプログラム。 (Supplementary note 21) The program according to any one of supplementary note 16 to supplementary note 20, which causes a computer to execute a process of specifying a customer in accordance with a predetermined priority when a plurality of persons are reflected in the customer image.
　以上、実施の形態及び実施例をあげて本発明を説明したが、本発明は必ずしも上記実施の形態及び実施例に限定されるものではなく、その技術的思想の範囲内において様々に変形し実施してもよい。また、各実施の形態を適宜組み合わせて実施してもよい。 Although the present invention has been described with reference to the embodiments and examples, the present invention is not necessarily limited to the above-described embodiments and examples, and various modifications can be made within the scope of the technical idea. May be. Moreover, you may implement combining each embodiment suitably.
　本出願は、２０１２年３月３０日に出願された日本出願特願２０１２－０７９０８１号を基礎とする優先権を主張し、その開示の全てをここに取り込む。 This application claims priority based on Japanese Patent Application No. 2012-079081 filed on Mar. 30, 2012, the entire disclosure of which is incorporated herein.
１　　　デジタルサイネージ
２　　　ディスプレイ
３　　　カメラ
１０　　関連物品情報データベース
１１　　特徴量抽出部
１２　　照合部
１３　　関連商品情報検索部
１４　　関連商品情報出力制御部
２０　　照合サーバ
２１　　通信部
２２　　通信部
２３　　ネットワーク DESCRIPTION OF SYMBOLS 1 Digital signage 2 Display 3 Camera 10 Related goods information database 11 Feature-value extraction part 12 Verification part 13 Related product information search part 14 Related product information output control part 20 Verification server 21 Communication part 22 Communication part 23 Network

Claims (11)

  1. 　物品の特徴量と、前記物品に関連する関連物品に関する関連物品情報とが関連付けられて記憶された関連物品データベースと、
    　顧客が写った顧客画像から特徴量を抽出する特徴量抽出手段と、
    　前記抽出された特徴量と、前記関連物品データベースに記憶されている特徴量とを照合し、前記顧客が身につけている物品を識別する照合手段と、
    　前記識別した物品に関連する関連物品の関連物品情報を、前記関連物品データベースから検索する関連物品情報検索手段と、
    　前記検索された関連物品情報を出力する関連物品情報出力制御手段と
    を有するデジタルサイネージシステム。     A related article database in which feature quantities of articles and related article information related to related articles related to the article are stored in association with each other;
    Feature quantity extraction means for extracting feature quantities from a customer image in which the customer is shown;
    Collation means for collating the extracted feature quantity with the feature quantity stored in the related article database to identify the article worn by the customer;
    Related article information search means for searching related article information of a related article related to the identified article from the related article database;
    A digital signage system comprising: related article information output control means for outputting the searched related article information.
  2. 　前記関連物品情報が、物品の静止画、動画を含む関連物品画像と、前記物品の紹介情報とのいずれかを少なくとも含む
    請求項１に記載のデジタルサイネージシステム。     The digital signage system according to claim 1, wherein the related product information includes at least one of a related product image including a still image and a moving image of the product and introduction information of the product.
  3. 　前記関連物品情報出力制御手段は、前記関連物品画像を、その関連物品を顧客が身につける位置に、前記顧客画像に重畳して表示する
    請求項２に記載のデジタルサイネージシステム。     3. The digital signage system according to claim 2, wherein the related article information output control means displays the related article image superimposed on the customer image at a position where the customer wears the related article.
  4. 　前記関連物品情報出力制御手段は、前記顧客画像のうち前記顧客が身につけている物品の画像に、前記関連物品画像を重畳して表示する
    請求項３に記載のデジタルサイネージシステム。     The digital signage system according to claim 3, wherein the related article information output control means displays the related article image superimposed on an image of an article worn by the customer among the customer images.
  5. 　前記関連物品情報出力制御手段は、前記関連物品画像を、前記顧客画像の顧客に重畳しないように、少なくとも一以上の前記関連物品画像を表示する
    請求項２に記載のデジタルサイネージシステム。     The digital signage system according to claim 2, wherein the related article information output control means displays at least one related article image so that the related article image is not superimposed on a customer of the customer image.
  6. 　前記顧客画像に複数の人物が写っている場合、所定の優先度に従って顧客を特定する顧客特定手段を有する
    請求項１から請求項５のいずれかに記載のデジタルサイネージシステム。     The digital signage system according to any one of claims 1 to 5, further comprising customer specifying means for specifying a customer in accordance with a predetermined priority when a plurality of persons are shown in the customer image.
  7. 　前記物品を所持又は配置する人物がデジタルサイネージを視認可能な領域を撮像することができる位置に配置され、前記物品を撮像する撮像手段を有する
    請求項１から請求項６に記載のデジタルサイネージシステム。     7. The digital signage system according to claim 1, further comprising an imaging unit that is arranged at a position where a person who possesses or arranges the article can take an image of an area in which the digital signage can be visually recognized, and picks up the article.
  8. 　照合サーバが、前記関連物品データベースと、前記照合手段と、前記関連物品情報検索手段とを少なくとも有し、
    　デジタルサイネージが、前記特徴量抽出手段と、前記関連物品情報出力制御手段とを少なくとも有し、
    　前記デジタルサイネージが、前記抽出した物品の特徴量を、前記照合サーバに送信し、
    　前記照合サーバが、前記物品の特徴量に基づいて、前記関連物品情報を前記デジタルサイネージに送信する
    請求項１から請求項７のいずれかに記載のデジタルサイネージシステム。     The verification server has at least the related product database, the verification unit, and the related product information search unit,
    Digital signage has at least the feature quantity extraction means and the related article information output control means,
    The digital signage transmits the extracted feature amount of the article to the verification server,
    The digital signage system according to any one of claims 1 to 7, wherein the matching server transmits the related article information to the digital signage based on a feature amount of the article.
  9. 　物品の特徴量と、前記物品に関連する関連物品に関する関連物品情報とが関連付けられて記憶された関連物品データベースと、
    　顧客が写った顧客画像から特徴量を抽出する特徴量抽出手段と、
    　前記抽出された特徴量と、前記物品データベースに記憶されている特徴量とを照合し、前記顧客が身につけている物品を識別する照合手段と、
    　前記識別した物品に関連する関連物品の関連物品情報を、前記関連物品データベースから検索する関連物品情報検索手段と、
    　前記関連商品検索手段で検索された関連物品情報を出力する関連物品情報出力制御手段と
    を有するデジタルサイネージ。     A related article database in which feature quantities of articles and related article information related to related articles related to the article are stored in association with each other;
    Feature quantity extraction means for extracting feature quantities from a customer image in which the customer is shown;
    Collation means for collating the extracted feature quantity with the feature quantity stored in the article database and identifying the article worn by the customer;
    Related article information search means for searching related article information of a related article related to the identified article from the related article database;
    Digital signage having related product information output control means for outputting related product information searched by the related product search means.
  10. 　物品の特徴量と、前記物品に関連する関連物品に関する関連物品情報とが関連付けられて記憶された関連物品データベースを有するデジタルサイネージシステムにおける関連物品情報を提示する関連物品情報提示方法であって、
    　顧客が写った顧客画像から特徴量を抽出し、
    　前記抽出された特徴量と、前記関連物品データベースに記憶されている特徴量とを照合し、前記顧客が身につけている物品を識別し、
    　前記識別した物品に関連する関連物品の関連物品情報を、前記関連物品データベースから検索し、
    　前記検索された関連物品情報を出力する
    関連物品情報提示方法。     A related article information presentation method for presenting related article information in a digital signage system having a related article database in which feature quantities of articles and related article information related to related articles related to the article are stored in association with each other.
    Extract features from customer images of customers,
    Collating the extracted feature quantity with the feature quantity stored in the related article database to identify the article worn by the customer;
    Retrieving related item information of related items related to the identified item from the related item database;
    A related article information presentation method for outputting the retrieved related article information.
  11. 　物品の特徴量と、前記物品に関連する関連物品に関する関連物品情報とが関連付けられて記憶された関連物品データベースを有するシステムのコンピュータのプログラムであって、
    　顧客が写った顧客画像から特徴量を抽出する処理と、
    　前記抽出された特徴量と、前記関連物品データベースに記憶されている特徴量とを照合し、前記顧客が身につけている物品を識別する処理と、
    　前記識別した物品に関連する関連物品の関連物品情報を、前記関連物品データベースから検索する処理と、
    　前記検索された関連物品情報を出力する処理と
    をコンピュータに実行させるプログラム。     A computer program for a system having a related article database in which feature quantities of articles and related article information related to related articles related to the article are stored in association with each other.
    A process of extracting features from a customer image in which the customer is shown;
    A process of collating the extracted feature quantity with the feature quantity stored in the related article database and identifying the article worn by the customer;
    A process of retrieving related article information of a related article related to the identified article from the related article database;
    A program for causing a computer to execute a process of outputting the retrieved related article information.
PCT/JP2013/059215 2012-03-30 2013-03-28 Digital signage system, digital signage, article information presentation method, and program WO2013147003A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2012079081 2012-03-30
JP2012-079081 2012-03-30

Publications (1)

Publication Number Publication Date
WO2013147003A1 true WO2013147003A1 (en) 2013-10-03

Family

ID=49260251

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2013/059215 WO2013147003A1 (en) 2012-03-30 2013-03-28 Digital signage system, digital signage, article information presentation method, and program

Country Status (2)

Country Link
JP (1) JPWO2013147003A1 (en)
WO (1) WO2013147003A1 (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015178070A1 (en) * 2014-05-19 2015-11-26 ソニー株式会社 Information processing system, storage medium, and information processing method
KR20170021707A (en) * 2015-08-18 2017-02-28 삼성전자주식회사 Large format display apparatus and control method thereof
JPWO2015173872A1 (en) * 2014-05-12 2017-04-20 富士通株式会社 Product information display system, control device, control program, and control method
JP2019197430A (en) * 2018-05-10 2019-11-14 大日本印刷株式会社 Information processing device, information processing method, program and information processing system
JPWO2019123714A1 (en) * 2017-12-21 2020-12-03 日本電気株式会社 Information processing equipment, product recommendation methods, and programs
US11061533B2 (en) 2015-08-18 2021-07-13 Samsung Electronics Co., Ltd. Large format display apparatus and control method thereof
KR102664008B1 (en) 2017-12-29 2024-05-09 삼성전자주식회사 Method and device to recommend customer item based on visual information

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005099956A (en) * 2003-09-22 2005-04-14 Fuji Xerox Co Ltd Video information processor, video information processing system, video information outputting method and its program
JP2008203916A (en) * 2007-02-16 2008-09-04 Hitachi Ltd Image processing apparatus, program, and image processing method
JP2010039095A (en) * 2008-08-04 2010-02-18 Seiko Epson Corp Audio output control device, audio output device, audio output control method, and program
JP2010049415A (en) * 2008-08-20 2010-03-04 Sony Corp Commodity marketing system
JP2010231355A (en) * 2009-03-26 2010-10-14 Sanyo Electric Co Ltd Information display device
JP2010536087A (en) * 2007-08-08 2010-11-25 オラワークス・インコーポレイテッド Method, terminal, and computer-readable recording medium for acquiring information about product worn by person in image data
JP2011100458A (en) * 2009-11-09 2011-05-19 Palo Alto Research Center Inc Method to be carried out by computer to collect purchase preference of consumer to commodity

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005099956A (en) * 2003-09-22 2005-04-14 Fuji Xerox Co Ltd Video information processor, video information processing system, video information outputting method and its program
JP2008203916A (en) * 2007-02-16 2008-09-04 Hitachi Ltd Image processing apparatus, program, and image processing method
JP2010536087A (en) * 2007-08-08 2010-11-25 オラワークス・インコーポレイテッド Method, terminal, and computer-readable recording medium for acquiring information about product worn by person in image data
JP2010039095A (en) * 2008-08-04 2010-02-18 Seiko Epson Corp Audio output control device, audio output device, audio output control method, and program
JP2010049415A (en) * 2008-08-20 2010-03-04 Sony Corp Commodity marketing system
JP2010231355A (en) * 2009-03-26 2010-10-14 Sanyo Electric Co Ltd Information display device
JP2011100458A (en) * 2009-11-09 2011-05-19 Palo Alto Research Center Inc Method to be carried out by computer to collect purchase preference of consumer to commodity

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
MAKI MIYAMOTO: "Kao Ninshiki de Anata ni Atta Kokoku o - NEC no Digital Signage", 11 November 2008 (2008-11-11), Retrieved from the Internet <URL:http://www.itmedia.co.jp/news/articles/0811/11/news078.html> [retrieved on 20130419] *

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPWO2015173872A1 (en) * 2014-05-12 2017-04-20 富士通株式会社 Product information display system, control device, control program, and control method
WO2015178070A1 (en) * 2014-05-19 2015-11-26 ソニー株式会社 Information processing system, storage medium, and information processing method
US10430572B2 (en) 2014-05-19 2019-10-01 Sony Corporation Information processing system that recognizes a user, storage medium, and information processing method
KR20170021707A (en) * 2015-08-18 2017-02-28 삼성전자주식회사 Large format display apparatus and control method thereof
KR102136223B1 (en) 2015-08-18 2020-07-21 삼성전자주식회사 Large format display apparatus and control method thereof
US11061533B2 (en) 2015-08-18 2021-07-13 Samsung Electronics Co., Ltd. Large format display apparatus and control method thereof
JPWO2019123714A1 (en) * 2017-12-21 2020-12-03 日本電気株式会社 Information processing equipment, product recommendation methods, and programs
JP7384516B2 (en) 2017-12-21 2023-11-21 日本電気株式会社 Information processing device, product recommendation method, program, and system
KR102664008B1 (en) 2017-12-29 2024-05-09 삼성전자주식회사 Method and device to recommend customer item based on visual information
JP2019197430A (en) * 2018-05-10 2019-11-14 大日本印刷株式会社 Information processing device, information processing method, program and information processing system
JP7102920B2 (en) 2018-05-10 2022-07-20 大日本印刷株式会社 Information processing equipment, information processing methods, programs and information processing systems

Also Published As

Publication number Publication date
JPWO2013147003A1 (en) 2015-12-14

Similar Documents

Publication Publication Date Title
WO2013147003A1 (en) Digital signage system, digital signage, article information presentation method, and program
US9324006B2 (en) System and method for displaying contextual supplemental content based on image content
CN110033298B (en) Information processing apparatus, control method thereof, system thereof, and storage medium
US9530144B2 (en) Content output device, content output method, content output program, and recording medium having content output program recorded thereon
JP6482172B2 (en) RECOMMENDATION DEVICE, RECOMMENDATION METHOD, AND PROGRAM
JP6148948B2 (en) Information processing system, information processing method, and information processing program
US20140247997A1 (en) Information processing system, information processing method, and computer program product
JP5816393B1 (en) Product evaluation apparatus, method and program
JP2017204013A (en) Advertisement display system, display control apparatus, and advertisement display method
CN109074498A (en) Visitor&#39;s tracking and system for the region POS
JP2016009416A (en) Sales promotion system, sales promotion management device, and sales promotion management program
JP7294663B2 (en) Customer service support device, customer service support method, and program
WO2013147004A1 (en) Digital signage system, digital signage, article information presentation method, and program
KR20190081367A (en) System and method for providing media content based on video recognition
WO2019192455A1 (en) Store system, article matching method and apparatus, and electronic device
JP2014146242A (en) Information distribution device, information display system and program
JP2014002651A (en) Information providing system and information providing method
KR102062248B1 (en) Method for advertising releated commercial image by analyzing online news article image
JP5907363B2 (en) Digital signage system, digital signage, advertisement display method and program
JP5660638B2 (en) Characteristic determination apparatus, characteristic determination method, and program
KR20200034475A (en) Digital sign system, Digital signage and method for proposing informatiom of product
KR20200084642A (en) A method of providing a fashion item recommendation service to a user using calendar data
WO2013147002A1 (en) Digital signage system, digital signage, event generation method, and program
WO2019025790A1 (en) Smart display system
US9268464B1 (en) Link determination and usage using image recognition

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13768864

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2014508017

Country of ref document: JP

Kind code of ref document: A

122 Ep: pct application non-entry in european phase

Ref document number: 13768864

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE