WO2013147002A1 - Digital signage system, digital signage, event generation method, and program - Google Patents

Digital signage system, digital signage, event generation method, and program Download PDF

Info

Publication number
WO2013147002A1
WO2013147002A1 PCT/JP2013/059213 JP2013059213W WO2013147002A1 WO 2013147002 A1 WO2013147002 A1 WO 2013147002A1 JP 2013059213 W JP2013059213 W JP 2013059213W WO 2013147002 A1 WO2013147002 A1 WO 2013147002A1
Authority
WO
WIPO (PCT)
Prior art keywords
article
event
digital signage
image
feature quantity
Prior art date
Application number
PCT/JP2013/059213
Other languages
French (fr)
Japanese (ja)
Inventor
智之 大坂
敏彦 広明
山田　昭雄
野村　俊之
Original Assignee
日本電気株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日本電気株式会社 filed Critical 日本電気株式会社
Publication of WO2013147002A1 publication Critical patent/WO2013147002A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising

Definitions

  • the present invention relates to a digital signage system, digital signage, an event generation method, and a program.
  • Digital signage an advertising medium that displays advertisements using displays such as liquid crystal displays and projectors, is beginning to be installed in various places.
  • digital signage not only will it be possible to provide rich content using video and audio, but it will also be possible to efficiently deliver advertisements according to the location of digital signage. Expansion is expected.
  • Patent Document 1 discloses an invention of an advertisement effect measuring apparatus and a computer program that can accurately measure the visibility of how many people are watching by measuring the number of people in front of the display.
  • Patent Document 1 analyzes frames included in a video transmitted from a video camera at predetermined intervals, detects a human body region from the frame, and further detects a face region from the human body region, thereby enabling digital signage As an index of advertising effectiveness, the visibility of digital signage is output.
  • Patent Document 1 calculates the number of people in front of digital signage as an advertising effect, but since there is no object recognition function, the type of article cannot be identified. Therefore, it cannot be used for a campaign that identifies the type of article and generates some event.
  • digital signage has been expected to have other functions than just a function for displaying advertisements.
  • the present invention has been invented in view of the above problems, and its object is to provide not only an advertisement display medium but also an event participation type digital signage system, a digital signage, an event generation method, and a program. It is in.
  • the present invention relates to an article feature quantity database in which feature quantities of articles are stored, a predetermined condition related to the article, and an event database in which events that occur when the predetermined condition is satisfied are stored in association with each other.
  • the feature amount extracting means for extracting the feature amount of the article from the article image of the article, the feature amount stored in the article feature amount database and the extracted feature amount are collated to identify the article of the article image
  • the present invention relates to an article feature quantity database in which feature quantities of articles are stored, a predetermined condition related to the article, and an event database in which events that occur when the predetermined condition is satisfied are stored in association with each other.
  • the feature amount extracting means for extracting the feature amount of the article from the article image of the article, the feature amount stored in the article feature amount database and the extracted feature amount are collated to identify the article of the article image
  • the digital signage includes a collating unit and an event output control unit that outputs an event corresponding to the predetermined condition when the identified article satisfies the predetermined condition.
  • the present invention extracts the feature amount of an article from the acquired article image of the article, collates the feature quantity stored in advance with the extracted feature quantity, identifies the article in the article image, and identifies the identified article Is an event generation method for outputting the event when the event generation condition is satisfied.
  • the present invention includes an article feature quantity database in which article feature quantities are stored, a predetermined condition related to the article, and an event database in which events that occur when the predetermined condition is satisfied are stored in association with each other.
  • a program for a computer system wherein a process for extracting a feature quantity of an article from an article image of an acquired article is compared with a feature quantity stored in the article feature quantity database and the extracted feature quantity, and the article
  • the present invention can provide not only advertisement display media but also event participation type digital signage.
  • FIG. 1 is a configuration diagram of a digital signage system according to the present embodiment.
  • FIG. 2 is an external view of the digital signage 1 according to the first embodiment.
  • FIG. 3 is a configuration diagram of the digital signage 1.
  • FIG. 4 is a diagram for explaining the operation of the first embodiment.
  • FIG. 5 is a diagram for explaining the operation of the first embodiment.
  • FIG. 6 is a diagram for explaining the operation of the first embodiment.
  • FIG. 7 is a diagram for explaining the operation of the first embodiment.
  • FIG. 8 is for explaining another embodiment of the first embodiment.
  • FIG. 9 is a configuration diagram of the second embodiment.
  • FIG. 10 is a diagram for explaining the second embodiment.
  • FIG. 11 is a configuration diagram of another embodiment of the present invention.
  • FIG. 12 is a configuration diagram of another embodiment of the present invention.
  • FIG. 13 is a configuration diagram of another embodiment of the present invention.
  • the present invention identifies those articles from an article image that is placed in front of digital signage or that shows articles worn by a person.
  • a predetermined event is output when the identified article satisfies a predetermined condition (hereinafter referred to as an event generation condition) regarding a predetermined article.
  • the article may be a specific novelty or a part of paper as well as a commodity sold generally such as food and clothes.
  • the event generation condition is a specific item, the number of specific items, or a combination thereof.
  • a specific article is “A coffee”, and the number is three.
  • the present invention is not limited to this, and a plurality of types of articles may be combined.
  • a specific article is “A coffee and red shirt”.
  • an event is, for example, a still image or a moving image (for example, a special image) displayed on a digital signage display, music or sound output from a speaker, a coupon with a discount privilege, time sale information, or the like.
  • a privilege etc. can be considered, but it is not limited to this.
  • FIG. 1 is a configuration diagram of a digital signage system according to the present embodiment.
  • the digital signage system in the present embodiment includes an article feature quantity database 10, an event database 11, a feature quantity extraction unit 12, a collation unit 13, and an event output control unit 14.
  • the article feature quantity database 10 stores article feature quantities.
  • the event database 11 stores event occurrence conditions and events in association with each other.
  • the event occurrence condition is a specific item, a specific number of items, or a combination thereof.
  • a specific article is “A coffee”, and the number is three.
  • the event is a still image or a moving image (for example, a special image or the like) displayed on the digital signage display, music or audio output from the speaker, or the like.
  • the feature amount extraction unit 12 extracts a feature amount from an article image of an article acquired by being captured by a camera or the like.
  • the collation unit 13 collates the feature quantity extracted by the feature quantity extraction unit 12 with the feature quantity of the article stored in the article feature quantity database 10, and identifies the article in the article image and the number thereof.
  • the event output control unit 13 receives the collation result of the collation unit 13, refers to the event database 11, and outputs an event if the collation result matches the event occurrence condition. For example, if the event occurrence condition is “A coffee, 3” and the event is a special video, if the A coffee can be identified in the article image, the special video can be displayed on a digital signage display, etc. Output to output means.
  • Example 1 of digital signage to which the above-described embodiment is applied will be described.
  • FIG. 2 is an external view of the digital signage 1 of the present embodiment.
  • the digital signage 1 is installed in a street, a store, or the like, and displays content such as advertisement video using the display 2. Further, the digital signage 1 is provided with a camera 3 for capturing an article image in addition to a display 2 for reproducing an advertisement video.
  • FIG. 3 is a block diagram of the digital signage 1.
  • the digital signage 1 includes a camera 3, an article feature database 10, an event database 11, a feature amount extraction unit 12, a matching unit 13, an event output control unit 14, and an advertisement display control unit 15. And a display 2.
  • the camera 3 is arranged at a position where a person who possesses or arranges an article can take an image of an area where the digital signage can be seen.
  • the article feature database 10 stores at least feature quantities of articles related to event occurrence conditions.
  • the event database 11 stores event occurrence conditions and events in association with each other.
  • the feature amount extraction unit 12 extracts a feature amount from an image captured by the camera 3.
  • the article in the image is picked up at a predetermined position, but it is difficult with digital signage or the like installed on the street. Therefore, in order to make it possible to identify the articles in the image robustly against changes in shooting size, angle, and occlusion, a large number of characteristic points (feature points) in the image are detected, and local areas around each feature point are detected. Extract region feature values (local feature values).
  • Representative methods include patent documents (US Pat. No. 6,711,293) and non-patent documents (David G.
  • a local feature quantity extraction device using a SIFT (Scale Invariant Feature Transform) feature quantity is disclosed.
  • SIFT Scale Invariant Feature Transform
  • a method for reducing the data size of the feature amount a feature point in an image is detected, a local region for each feature point is acquired, each local region is divided into a plurality of sub-regions, A multi-dimensional feature vector is generated for each sub-region, and based on the positional relationship of the sub-regions in each local region, the feature vector is determined for each sub-region so that the correlation between the feature vectors of adjacent sub-regions is low. It is conceivable that a dimension is selected and an element of the selected dimension is used as a local region feature amount.
  • the collation unit 13 collates the feature quantity extracted by the feature quantity extraction unit 12 with the feature quantity of the article stored in the article feature database 10, identifies the article from the article image captured by the camera 3, and Identify the number of items.
  • the event output control unit 14 receives the collation result of the collation unit 13, and in the article image captured by the camera 3, articles satisfying the event occurrence condition of the event database 11, the number of articles, combinations thereof, and the like If there is, a predetermined event is generated.
  • the advertisement display control unit 15 performs control to display a normal advertisement, an event notification, and the like on the display 2.
  • the display 2 of the digital signage 1 displays a message such as “Get 3 coffees and get a coupon” to announce the event. And it waits for the person who saw the notification of the event or the person who knows the event to bring “A coffee” and stand on the digital signage 1.
  • FIG. 7 shows an example of the occurrence of an event when three “A coffee” are successfully identified, and the discount coupon is displayed as a QR code (registered trademark) on the display 2 of the digital signage 1. Is. A person who has three “A coffee” can obtain a discount coupon by reading the QR code (registered trademark) displayed on the display 2 with a mobile phone or the like.
  • QR code registered trademark
  • an advertisement display medium not only an advertisement display medium but also an event participation type digital signage can be provided.
  • an example of canned coffee is shown as an article.
  • the present invention is not limited to this.
  • a person may wear specific clothes and identify the clothes.
  • “XYZ T-shirt” is an article to be identified, and the event occurrence condition is wearing “XYZ T-shirt” or “XYZ T-shirt”. If the photograph is taken with the camera 3 and the “XYZ T-shirt” can be identified in the article image, a predetermined event is generated.
  • a plurality of articles and a plurality of types of articles such as three “A coffee” and one “XYZ T-shirt” are used as event generation conditions. Also good.
  • FIG. 9 is a block diagram of the digital signage system of the second embodiment.
  • a plurality of displays 2 are connected to the digital signage 1 of the first embodiment, and an event is generated using the plurality of displays 2.
  • each display 2 For example, as shown in FIG. 10, different contents are displayed on each display 2 before the occurrence of an event. However, if an event occurrence condition is satisfied by identification of a predetermined article, a single group is formed using each display 2. Some content is displayed.
  • the camera 3, the article feature quantity database 10, the event database 11, the feature quantity extraction unit 12, the matching unit 13, the event output control unit 14, the advertisement display control unit 15, and the display 2 are configured inside the digital signage 1, but some or all of them may be arranged in an external server or the like. An example is shown in FIG.
  • a collation server 20 that performs collation is provided, and the collation server 20 includes an article feature amount database 10, a collation unit 13, and a communication unit 22.
  • the digital signage 1 is connected to the verification server 20 via the network 23.
  • the digital signage 1 includes a camera 3, a feature amount extraction unit 12, an event output control unit 14, an advertisement medium display control unit 15, and a communication unit 21. And.
  • the feature amount extraction unit 12 extracts the feature amount from the article image taken by the camera 3. Then, the extracted feature amount is transmitted to the verification server 20 by the communication unit 21.
  • the matching server 20 performs a matching process based on the received feature amount, and transmits the result to the digital signage 1 through the communication unit 22. Then, the digital signage 1 generates an event based on the collation result.
  • the advantage of the above configuration is that the processing load of the digital signage 1 can be reduced by causing the server to perform a processing that requires a load, such as a verification process. Further, by connecting a large number of digital signage 1 to the verification server 20 via the network 23, the verification processing and operation of the large number of digital signage 1 can be managed by the verification server.
  • FIG. 12 is a configuration diagram of another modification of the embodiment.
  • the collation server 20 includes an article feature quantity database 10, a feature quantity extraction unit 12, a collation unit 13, and a communication unit 22.
  • the digital signage 1 is connected to the verification server 20 via the network 23.
  • the digital signage 1 includes a camera 3, an event output control unit 14, an advertisement display control unit 15, and a communication unit 21. Yes.
  • the digital signage 1 transmits an image captured by the camera 3 to the verification server 20 via the communication unit 21.
  • the verification server 20 extracts a feature amount from the received image and performs a verification process.
  • the result is transmitted to the digital signage 1 by the communication unit 22.
  • the digital signage 1 is configured to generate an event based on the collation result.
  • the advantage of the above configuration is that the processing load of the digital signage 1 can be reduced by causing the server to perform processing that requires load such as feature amount extraction and collation processing. Further, by connecting a large number of digital signage 1 to the verification server 20 via the network 23, the verification processing and operation of the large number of digital signage 1 can be managed by the verification server.
  • an event occurring in the digital signage 1 can be reflected in the event of each store. For example, when the number of events occurring in each digital signage 1 exceeds a predetermined number, a time sale can be performed at the store to automatically reflect discounts on products.
  • each unit may be configured by hardware or may be realized by a computer program.
  • functions and operations similar to those of the above-described embodiments and examples are realized by a processor that operates according to a program stored in the program memory.
  • An article feature quantity database in which feature quantities of articles are stored;
  • An event database in which a predetermined condition related to the article and an event that occurs when the predetermined condition is satisfied are stored in association with each other;
  • Feature quantity extraction means for extracting the feature quantity of the article from the article image of the acquired article;
  • Collating means for collating the feature quantity stored in the article feature quantity database with the extracted feature quantity and identifying the article of the article image;
  • a digital signage system comprising event output control means for outputting an event corresponding to the predetermined condition when the identified article satisfies the predetermined condition.
  • Additional remark 3 The digital signage of Additional remark 1 or Additional remark 2 which has the imaging means which is arrange
  • a collation server has the said item feature-value database and the said collation means at least, Digital signage has at least the feature quantity extraction means and the event output control means, The digital signage transmits the extracted feature amount of the article to the verification server, 6.
  • the digital signage system according to any one of appendix 1 to appendix 5, wherein the collation server identifies an article of the article image based on a feature amount of the article and transmits the identification result to the digital signage.
  • a computer system program comprising: Processing for extracting the feature amount of the article from the article image of the acquired article; A process of collating the feature quantity stored in the article feature quantity database with the extracted feature quantity and identifying the article in the article image; A program for causing a computer to execute a process of outputting an event corresponding to the predetermined condition when the identified article satisfies the predetermined condition.
  • Additional remark 14 The program of Additional remark 12 or Additional remark 13 which has a process which notifies the event to the output means of digital signage.

Abstract

The present invention is a digital signage system, comprising: an object feature value database wherein an object feature value is stored; an event database in which a prescribed condition relating to an object and an event which occurs when the prescribed situation is satisfied are associated and stored; a feature value extraction means for extracting a feature value of an object from an acquired object image of the object; a comparison means for comparing the feature value which is stored in the object feature value database with the extracted feature value and identifying the object of the object image; and an event output control means for, when the identified object satisfies a prescribed condition, outputting the event which corresponds to the prescribed condition.

Description

デジタルサイネージシステム、デジタルサイネージ、イベント発生方法及びプログラムDigital signage system, digital signage, event generation method and program
　本発明は、デジタルサイネージシステム、デジタルサイネージ、イベント発生方法及びプログラムに関する。 The present invention relates to a digital signage system, digital signage, an event generation method, and a program.
　液晶ディスプレイやプロジェクタなどのディスプレイを用いて広告を表示する広告媒体であるデジタルサイネージ（Digital Signage）が、様々な場所に設置され始めている。デジタルサイネージを用いることで、動画や音声を用いた豊かなコンテンツの提供が可能になるばかりか、デジタルサイネージの設置場所に応じた効率的な広告配信が可能になるため、今後，デジタルサイネージのマーケット拡大が期待されている。 Digital signage, an advertising medium that displays advertisements using displays such as liquid crystal displays and projectors, is beginning to be installed in various places. By using digital signage, not only will it be possible to provide rich content using video and audio, but it will also be possible to efficiently deliver advertisements according to the location of digital signage. Expansion is expected.
　そこで、広告主がデジタルサイネージを導入するのにあたり、テレビの視聴率、新聞、雑誌の販売部数といったように、客観的な広告効果を広告主に提示するために、ディスプレイを閲覧した人数だけでなく、ディスプレイの前にいる人数も計測することにより、何人中何人見ていたかという視認率を精度よく測定することのできる広告効果測定装置及びコンピュータプログラムの発明が特許文献１に記載されている。 Therefore, when advertisers introduced digital signage, not only the number of viewers who viewed the display, but also the objective advertising effects, such as TV ratings, newspapers, magazine sales, etc. Patent Document 1 discloses an invention of an advertisement effect measuring apparatus and a computer program that can accurately measure the visibility of how many people are watching by measuring the number of people in front of the display.
　特許文献１の発明は、ビデオカメラから送信された映像に含まれるフレームを所定の間隔で解析し、フレームから人体領域を検出し、更に、人体領域から顔領域を検出することで、デジタルサイネージの広告効果の指標として、デジタルサイネージの視認率を出力するものである。 The invention of Patent Document 1 analyzes frames included in a video transmitted from a video camera at predetermined intervals, detects a human body region from the frame, and further detects a face region from the human body region, thereby enabling digital signage As an index of advertising effectiveness, the visibility of digital signage is output.
特開２０１１－２１０２３８号公報JP 2011-210238 A
　しかし、特許文献１の発明は、デジタルサイネージの前の人数を広告効果として算出するが、オブジェクト認識機能がないため、物品の種別などの識別はできない。従って、物品の種別を識別して何らかのイベントを発生させるようなキャンペーンには用いることができなかった。 However, the invention of Patent Document 1 calculates the number of people in front of digital signage as an advertising effect, but since there is no object recognition function, the type of article cannot be identified. Therefore, it cannot be used for a campaign that identifies the type of article and generates some event.
　また、デジタルサイネージも単なる広告表示手段としての機能以外の他の機能が待ち望まれていた。 In addition, digital signage has been expected to have other functions than just a function for displaying advertisements.
　そこで、本発明は上記課題に鑑みて発明されたものであって、その目的は、単なる広告表示媒体だけではなく、イベント参加型のデジタルサイネージシステム、デジタルサイネージ、イベント発生方法及びプログラムを提供することにある。 Therefore, the present invention has been invented in view of the above problems, and its object is to provide not only an advertisement display medium but also an event participation type digital signage system, a digital signage, an event generation method, and a program. It is in.
　本発明は、物品の特徴量が記憶された物品特徴量データベースと、前記物品に関する所定条件と、前記所定条件を満たした場合に発生するイベントとが対応付けられて記憶されたイベントデータベースと、取得した物品の物品画像から物品の特徴量を抽出する特徴量抽出手段と、前記物品特徴量データベースに記憶されている特徴量と前記抽出した特徴量とを照合し、前記物品画像の物品を識別する照合手段と、前記識別した物品が前記所定の条件を満たす場合、前記所定条件に対応するイベントを出力するイベント出力制御手段とを有するデジタルサイネージシステムである。 The present invention relates to an article feature quantity database in which feature quantities of articles are stored, a predetermined condition related to the article, and an event database in which events that occur when the predetermined condition is satisfied are stored in association with each other. The feature amount extracting means for extracting the feature amount of the article from the article image of the article, the feature amount stored in the article feature amount database and the extracted feature amount are collated to identify the article of the article image It is a digital signage system having collation means and event output control means for outputting an event corresponding to the predetermined condition when the identified article satisfies the predetermined condition.
　本発明は、物品の特徴量が記憶された物品特徴量データベースと、前記物品に関する所定条件と、前記所定条件を満たした場合に発生するイベントとが対応付けられて記憶されたイベントデータベースと、取得した物品の物品画像から物品の特徴量を抽出する特徴量抽出手段と、前記物品特徴量データベースに記憶されている特徴量と前記抽出した特徴量とを照合し、前記物品画像の物品を識別する照合手段と、前記識別した物品が前記所定の条件を満たす場合、前記所定条件に対応するイベントを出力するイベント出力制御手段とを有するデジタルサイネージである。 The present invention relates to an article feature quantity database in which feature quantities of articles are stored, a predetermined condition related to the article, and an event database in which events that occur when the predetermined condition is satisfied are stored in association with each other. The feature amount extracting means for extracting the feature amount of the article from the article image of the article, the feature amount stored in the article feature amount database and the extracted feature amount are collated to identify the article of the article image The digital signage includes a collating unit and an event output control unit that outputs an event corresponding to the predetermined condition when the identified article satisfies the predetermined condition.
　本発明は、取得した物品の物品画像から物品の特徴量を抽出し、予め記憶されている特徴量と前記抽出した特徴量とを照合し、前記物品画像の物品を識別し、前記識別した物品が、イベントの発生条件を満たす場合、前記イベントを出力するイベント発生方法である。 The present invention extracts the feature amount of an article from the acquired article image of the article, collates the feature quantity stored in advance with the extracted feature quantity, identifies the article in the article image, and identifies the identified article Is an event generation method for outputting the event when the event generation condition is satisfied.
　本発明は、物品の特徴量が記憶された物品特徴量データベースと、前記物品に関する所定条件と、前記所定条件を満たした場合に発生するイベントとが対応付けられて記憶されたイベントデータベースとを有するコンピュータシステムのプログラムであって、取得した物品の物品画像から物品の特徴量を抽出する処理と、前記物品特徴量データベースに記憶されている特徴量と前記抽出した特徴量とを照合し、前記物品画像の物品を識別する処理と、前記識別した物品が前記所定の条件を満たす場合、前記所定条件に対応するイベントを出力する処理とをコンピュータに実行させるプログラムである。 The present invention includes an article feature quantity database in which article feature quantities are stored, a predetermined condition related to the article, and an event database in which events that occur when the predetermined condition is satisfied are stored in association with each other. A program for a computer system, wherein a process for extracting a feature quantity of an article from an article image of an acquired article is compared with a feature quantity stored in the article feature quantity database and the extracted feature quantity, and the article A program for causing a computer to execute a process of identifying an article in an image and a process of outputting an event corresponding to the predetermined condition when the identified article satisfies the predetermined condition.
　本発明は、単なる広告表示媒体だけではなく、イベント参加型のデジタルサイネージを提供することができる。 The present invention can provide not only advertisement display media but also event participation type digital signage.
図１は本実施の形態のデジタルサイネージシステムの構成図である。FIG. 1 is a configuration diagram of a digital signage system according to the present embodiment. 図２は実施例１におけるデジタルサイネージ１の外観図である。FIG. 2 is an external view of the digital signage 1 according to the first embodiment. 図３はデジタルサイネージ１の構成図である。FIG. 3 is a configuration diagram of the digital signage 1. 図４は実施例１の動作を説明する図である。FIG. 4 is a diagram for explaining the operation of the first embodiment. 図５は実施例１の動作を説明する図である。FIG. 5 is a diagram for explaining the operation of the first embodiment. 図６は実施例１の動作を説明する図である。FIG. 6 is a diagram for explaining the operation of the first embodiment. 図７は実施例１の動作を説明する図である。FIG. 7 is a diagram for explaining the operation of the first embodiment. 図８は実施例１の他の形態を説明するためのである。FIG. 8 is for explaining another embodiment of the first embodiment. 図９は実施例２の構成図である。FIG. 9 is a configuration diagram of the second embodiment. 図１０は実施例２を説明するための図である。FIG. 10 is a diagram for explaining the second embodiment. 図１１は本発明の他の実施の形態の構成図である。FIG. 11 is a configuration diagram of another embodiment of the present invention. 図１２は本発明の他の実施の形態の構成図である。FIG. 12 is a configuration diagram of another embodiment of the present invention. 図１３は本発明の他の実施の形態の構成図である。FIG. 13 is a configuration diagram of another embodiment of the present invention.
　本発明の実施の形態を説明する。 Embodiments of the present invention will be described.
　本発明は、デジタルサイネージの前に配置されたり、人物が着用している物品が写った物品画像から、それらの物品を識別する。そして、識別した物品が予め定めた物品に関する所定条件（以下、イベント発生条件）を満たす場合に、所定のイベントを出力するものである。 The present invention identifies those articles from an article image that is placed in front of digital signage or that shows articles worn by a person. A predetermined event is output when the identified article satisfies a predetermined condition (hereinafter referred to as an event generation condition) regarding a predetermined article.
　ここで、物品とは、食料品や衣服といった一般に販売される商品のみならず、特定のノベルティや紙面の一部などでも良い。そして、イベント発生条件とは、ある特定の物品、特定の物品の数、又は、それらの組み合わせである。例えば、ある特定の物品が「Ａコーヒー」であり、その数が３本などである。また、これに限らず、複数種類の物品を組み合わせても良い。例えば、ある特定の物品が「Ａコーヒー及び赤色のシャツ」などである。また、イベントとは、例えば、デジタルサイネージのディスプレイに表示される静止画や動画（例えば、特別映像等）、スピーカから出力される音楽又は音声や、割引特典の付いたクーポンやタイムセール情報等の特典等が考えられるが、これに限られない。 Here, the article may be a specific novelty or a part of paper as well as a commodity sold generally such as food and clothes. The event generation condition is a specific item, the number of specific items, or a combination thereof. For example, a specific article is “A coffee”, and the number is three. Further, the present invention is not limited to this, and a plurality of types of articles may be combined. For example, a specific article is “A coffee and red shirt”. In addition, an event is, for example, a still image or a moving image (for example, a special image) displayed on a digital signage display, music or sound output from a speaker, a coupon with a discount privilege, time sale information, or the like. A privilege etc. can be considered, but it is not limited to this.
　図１は、本実施の形態におけるデジタルサイネージシステムの構成図である。 FIG. 1 is a configuration diagram of a digital signage system according to the present embodiment.
　図１に示す如く、本実施の形態におけるデジタルサイネージシステムは、物品特徴量データベース１０と、イベントデータベース１１と、特徴量抽出部１２と、照合部１３と、イベント出力制御部１４とを備える。 As shown in FIG. 1, the digital signage system in the present embodiment includes an article feature quantity database 10, an event database 11, a feature quantity extraction unit 12, a collation unit 13, and an event output control unit 14.
　物品特徴量データベース１０には、物品の特徴量が記憶されている。 The article feature quantity database 10 stores article feature quantities.
　イベントデータベース１１には、イベント発生条件と、イベントとが対応付けられて記憶されている。イベント発生条件は、上述したように、ある特定の物品、特定の物品の数、又は、それらの組み合わせである。例えば、ある特定の物品が「Ａコーヒー」であり、その数が３本などである。イベントは、上述したように、デジタルサイネージのディスプレイに表示する静止画や動画（例えば、特別映像等）、スピーカから出力する音楽又は音声等である。 The event database 11 stores event occurrence conditions and events in association with each other. As described above, the event occurrence condition is a specific item, a specific number of items, or a combination thereof. For example, a specific article is “A coffee”, and the number is three. As described above, the event is a still image or a moving image (for example, a special image or the like) displayed on the digital signage display, music or audio output from the speaker, or the like.
　特徴量抽出部１２は、カメラ等で撮像されて取得した物品の物品画像から特徴量を抽出するものである。 The feature amount extraction unit 12 extracts a feature amount from an article image of an article acquired by being captured by a camera or the like.
　照合部１３は、特徴量抽出部１２で抽出された特徴量と、物品特徴量データベース１０に記憶されている物品の特徴量とを照合し、物品画像の物品やその数を識別する。 The collation unit 13 collates the feature quantity extracted by the feature quantity extraction unit 12 with the feature quantity of the article stored in the article feature quantity database 10, and identifies the article in the article image and the number thereof.
　イベント出力制御部１３は、照合部１３の照合結果を受けて、イベントデータベース１１を参照し、照合結果がイベント発生条件に合致していれば、イベントを出力する。例えば、例えば、イベント発生条件が「Ａコーヒー、３本」であり、イベントが特別映像であるとすると、物品画像の中に、Ａコーヒーが３本識別できれば、特別映像をデジタルサイネージのディスプレイ等の出力手段に出力する。 The event output control unit 13 receives the collation result of the collation unit 13, refers to the event database 11, and outputs an event if the collation result matches the event occurrence condition. For example, if the event occurrence condition is “A coffee, 3” and the event is a special video, if the A coffee can be identified in the article image, the special video can be displayed on a digital signage display, etc. Output to output means.
　本実施の形態によれば、単なる広告表示媒体だけではなく、イベント参加型のデジタルサイネージシステムを提供することができる。 According to the present embodiment, it is possible to provide not only an advertisement display medium but also an event participation type digital signage system.
　次に、上述した実施の形態を適用したデジタルサイネージの実施例１を説明する。 Next, Example 1 of digital signage to which the above-described embodiment is applied will be described.
　図２は、本実施例のデジタルサイネージ１の外観図である。 FIG. 2 is an external view of the digital signage 1 of the present embodiment.
　図１に示すように、デジタルサイネージ１は、街頭や店舗などに設置され、ディスプレイ２を用いて広告映像等のコンテンツを表示する。また、デジタルサイネージ１には、広告映像を再生するディスプレイ２の他に、物品画像を撮像するカメラ３が設けられている。 As shown in FIG. 1, the digital signage 1 is installed in a street, a store, or the like, and displays content such as advertisement video using the display 2. Further, the digital signage 1 is provided with a camera 3 for capturing an article image in addition to a display 2 for reproducing an advertisement video.
　図３はデジタルサイネージ１の構成図である。 FIG. 3 is a block diagram of the digital signage 1.
　図２に示す如く、デジタルサイネージ１は、カメラ３と、物品特徴データベース１０と、イベントデータベース１１と、特徴量抽出部１２と、照合部１３と、イベント出力制御部１４と、広告表示制御部１５と、ディスプレイ２とを備える。 As shown in FIG. 2, the digital signage 1 includes a camera 3, an article feature database 10, an event database 11, a feature amount extraction unit 12, a matching unit 13, an event output control unit 14, and an advertisement display control unit 15. And a display 2.
　カメラ３は、物品を所持又は配置する人物がデジタルサイネージを視認可能な領域を撮像することができる位置に配置されている。 The camera 3 is arranged at a position where a person who possesses or arranges an article can take an image of an area where the digital signage can be seen.
　物品特徴データベース１０には、少なくともイベント発生条件に関係する物品の特徴量が記憶されている。 The article feature database 10 stores at least feature quantities of articles related to event occurrence conditions.
　イベントデータベース１１には、イベント発生条件と、イベントとが対応付けられて記憶されている。 The event database 11 stores event occurrence conditions and events in association with each other.
　特徴量抽出部１２は、カメラ３で撮像された画像から特徴量を抽出するものである。画像からの特徴量の抽出方法を容易にするためには、画像中の物品が予め定められた位置で撮像されることが好ましいが、街頭などに設置されるデジタルサイネージ等では難しい。そこで、画像内の物品を、撮影サイズや角度の変化、オクルージョンに対して頑健に識別可能とするために、画像内の特徴的な点（特徴点）を多数検出し、各特徴点周辺の局所領域の特徴量（局所特徴量）を抽出する。その代表的な方式として、特許文献（米国特許第６７１１２９３号明細書）や、非特許文献（David G. Lowe著、「Distinctive image features from scale-invariant keypoints」、International Journal of Computer Vision、60(2)、2004年、p. 91-110）には、ＳＩＦＴ（Ｓｃａｌｅ　Ｉｎｖａｒｉａｎｔ　Ｆｅａｔｕｒｅ　Ｔｒａｎｓｆｏｒｍ）特徴量を用いる局所特徴量抽出装置が開示されている。また、特徴量のデータサイズを小さくする方法としては、画像内の特徴点を検出し、各特徴点に対する局所領域を取得し、各局所領域を複数のサブ領域に分割し、各局所領域内のサブ領域ごとに複数次元の特徴ベクトルを生成し、各局所領域内のサブ領域の位置関係に基づいて、近接するサブ領域の特徴ベクトル間の相関が低くなるようにサブ領域ごとに前記特徴ベクトルから次元を選定し、選定された次元の要素を局所領域の特徴量とすることが考えられる。 The feature amount extraction unit 12 extracts a feature amount from an image captured by the camera 3. In order to facilitate the method of extracting the feature amount from the image, it is preferable that the article in the image is picked up at a predetermined position, but it is difficult with digital signage or the like installed on the street. Therefore, in order to make it possible to identify the articles in the image robustly against changes in shooting size, angle, and occlusion, a large number of characteristic points (feature points) in the image are detected, and local areas around each feature point are detected. Extract region feature values (local feature values). Representative methods include patent documents (US Pat. No. 6,711,293) and non-patent documents (David G. Lowe, “Distinctive image features from scale-invariant keypoints”, International Journal of Computer Vision, 60 (2 ), 2004, p. 91-110), a local feature quantity extraction device using a SIFT (Scale Invariant Feature Transform) feature quantity is disclosed. As a method for reducing the data size of the feature amount, a feature point in an image is detected, a local region for each feature point is acquired, each local region is divided into a plurality of sub-regions, A multi-dimensional feature vector is generated for each sub-region, and based on the positional relationship of the sub-regions in each local region, the feature vector is determined for each sub-region so that the correlation between the feature vectors of adjacent sub-regions is low. It is conceivable that a dimension is selected and an element of the selected dimension is used as a local region feature amount.
　照合部１３は、特徴量抽出部１２で抽出された特徴量と、物品特徴データベース１０に記憶されている物品の特徴量とを照合し、カメラ３で撮像された物品画像から物品を識別、及びその物品の個数を識別する。 The collation unit 13 collates the feature quantity extracted by the feature quantity extraction unit 12 with the feature quantity of the article stored in the article feature database 10, identifies the article from the article image captured by the camera 3, and Identify the number of items.
　イベント出力制御部１４は、照合部１３の照合結果を受けて、カメラ３で撮像された物品画像の中に、イベントデータベース１１のイベント発生条件を満たす物品、その物品の数や、それらの組み合わせ等があれば、所定のイベントを発生させる。 The event output control unit 14 receives the collation result of the collation unit 13, and in the article image captured by the camera 3, articles satisfying the event occurrence condition of the event database 11, the number of articles, combinations thereof, and the like If there is, a predetermined event is generated.
　広告表示制御部１５は、通常時の広告やイベントの告知等をディスプレイ２に表示する制御を行うものである。 The advertisement display control unit 15 performs control to display a normal advertisement, an event notification, and the like on the display 2.
　次に、上述した構成における本実施例の具体的な動作を説明する。尚、以下の説明では、特定物品を「Ａコーヒー」とし、「Ａコーヒー」を３本揃えてデジタルサイネージ１の前に配置することにより、割引クーポンの発行を行うイベントを発生させる例を説明する。 Next, a specific operation of the present embodiment in the configuration described above will be described. In the following description, an example in which an event for issuing a discount coupon is generated by setting “A coffee” as a specific article and arranging three “A coffee” in front of the digital signage 1 will be described. .
　まず、図４に示す如く、デジタルサイネージ１のディスプレイ２に「Ａコーヒーを、３本揃えて、クーポン　ゲット」のように表示し、イベントの告知を行う。そして、イベントの告知を見た人物又はそのイベントを知っている人物が「Ａコーヒー」を持参してデジタルサイネージ１に立つのを待機する。 First, as shown in FIG. 4, the display 2 of the digital signage 1 displays a message such as “Get 3 coffees and get a coupon” to announce the event. And it waits for the person who saw the notification of the event or the person who knows the event to bring “A coffee” and stand on the digital signage 1.
　次に、図５に示す如く、デジタルサイネージ１の前に人物が立つと、人物の顔認識等により、デジタルサイネージ１のディスプレイ２の表示が、「Ａコーヒーを、３本揃えて、ディスプレイの前に立って下さい。」に切り替わる。そして、人物が、Ａコーヒーを３本揃えてデジタルサイネージ１の前に立つと、識別動作が開始され、図６に示す如く、ディスプレイ２には、「識別開始！」が表示される。 Next, as shown in FIG. 5, when a person stands in front of the digital signage 1, the display 2 of the digital signage 1 displays “A coffee in three lines, Please stand up. " When a person stands in front of the digital signage 1 with three A coffees arranged, the identification operation is started, and “Identification start!” Is displayed on the display 2 as shown in FIG.
　ここで、「Ａコーヒー」の３本の識別に成功すると、イベントが発生する。図７では、「Ａコーヒー」の３本の識別に成功した場合のイベントの発生の一例を示したものであり、デジタルサイネージ１のディスプレイ２に、割引クーポンをＱＲコード（登録商標）として表示したものである。「Ａコーヒー」を３本揃えた人物は、ディスプレイ２に表示されたＱＲコード（登録商標）を携帯電話等で読み取ることにより、割引クーポンを取得できる。 Here, an event occurs when the three “A coffee” are successfully identified. FIG. 7 shows an example of the occurrence of an event when three “A coffee” are successfully identified, and the discount coupon is displayed as a QR code (registered trademark) on the display 2 of the digital signage 1. Is. A person who has three “A coffee” can obtain a discount coupon by reading the QR code (registered trademark) displayed on the display 2 with a mobile phone or the like.
　以上の如く、本実施の形態のデジタルサイネージによれば、単なる広告表示媒体だけではなく、イベント参加型のデジタルサイネージを提供することができる。 As described above, according to the digital signage of the present embodiment, not only an advertisement display medium but also an event participation type digital signage can be provided.
　尚、上述した実施例では、物品として缶コーヒーの例を示したが、これに限らず、例えば、人物が特定の衣服を着て、その衣服を識別するようにしても良い。例えば、図８の例では、「XYZのTシャツ」を識別対象の物品としたものであり、イベント発生条件として、「XYZのTシャツ」を着ているか、又は、「XYZのTシャツ」を持ってカメラ３で撮影し、その物品画像の中で「XYZのTシャツ」を識別できれば、所定のイベントを発生させるものである。 In the above-described embodiment, an example of canned coffee is shown as an article. However, the present invention is not limited to this. For example, a person may wear specific clothes and identify the clothes. For example, in the example of FIG. 8, “XYZ T-shirt” is an article to be identified, and the event occurrence condition is wearing “XYZ T-shirt” or “XYZ T-shirt”. If the photograph is taken with the camera 3 and the “XYZ T-shirt” can be identified in the article image, a predetermined event is generated.
　また、１種類の物品に限らず、例えば、３本の「Ａコーヒー」と一枚の「XYZのTシャツ」のように、複数個の物品、かつ、複数種類の物品を、イベント発生条件としても良い。 In addition to one type of article, for example, a plurality of articles and a plurality of types of articles such as three “A coffee” and one “XYZ T-shirt” are used as event generation conditions. Also good.
　次に、実施例２を説明する。 Next, Example 2 will be described.
　図９は実施例２のデジタルサイネージシステムの構成図である。 FIG. 9 is a block diagram of the digital signage system of the second embodiment.
　実施例２では、実施例１のデジタルサイネージ１に、複数のディスプレイ２を接続し、複数のディスプレイ２を用いてイベントを発生させる。 In the second embodiment, a plurality of displays 2 are connected to the digital signage 1 of the first embodiment, and an event is generated using the plurality of displays 2.
　例えば、図１０に示す如く、イベント発生前は、各ディスプレイ２には異なるコンテンツが表示されているが、所定の物品の識別により、イベント発生条件を満たすと、各ディスプレイ２を用いて一つの纏まりあるコンテンツが表示される。 For example, as shown in FIG. 10, different contents are displayed on each display 2 before the occurrence of an event. However, if an event occurrence condition is satisfied by identification of a predetermined article, a single group is formed using each display 2. Some content is displayed.
　尚、上記実施例は一例であって、本発明を逸脱しない範囲で変更することができる。例えば、上記実施例では、カメラ３と、物品特徴量データベース１０と、イベントデータベース１１と、特徴量抽出部１２と、照合部１３と、イベント出力制御部１４と、広告表示制御部１５と、ディスプレイ２とを、デジタルサイネージ１の内部にある構成としたが、それらの一部又は全部を外部のサーバ等に配置しても良い。図１１にその一例を示す。 The above embodiment is merely an example, and can be changed without departing from the present invention. For example, in the above-described embodiment, the camera 3, the article feature quantity database 10, the event database 11, the feature quantity extraction unit 12, the matching unit 13, the event output control unit 14, the advertisement display control unit 15, and the display 2 are configured inside the digital signage 1, but some or all of them may be arranged in an external server or the like. An example is shown in FIG.
　図１１の例では、照合を行う照合サーバ２０を有し、照合サーバ２０が物品特徴量データベース１０と照合部１３と通信部２２とを備えている。そして、デジタルサイネージ１はネットワーク２３を介して照合サーバ２０と接続されており、デジタルサイネージ１にはカメラ３と特徴量抽出部１２とイベント出力制御部１４と広告媒体表示制御部１５と通信部２１とを備えている。 In the example of FIG. 11, a collation server 20 that performs collation is provided, and the collation server 20 includes an article feature amount database 10, a collation unit 13, and a communication unit 22. The digital signage 1 is connected to the verification server 20 via the network 23. The digital signage 1 includes a camera 3, a feature amount extraction unit 12, an event output control unit 14, an advertisement medium display control unit 15, and a communication unit 21. And.
　デジタルサイネージ１では、カメラ３で撮影した物品画像から特徴量抽出部１２により特徴量を抽出する。そして、抽出した特徴量を通信部２１により、照合サーバ２０に送信する。照合サーバ２０は受信した特徴量に基づいて照合処理を行い、その結果を通信部２２によりデジタルサイネージ１に送信する。そして、デジタルサイネージ１は、照合結果に基づき、イベントを発生する。 In the digital signage 1, the feature amount extraction unit 12 extracts the feature amount from the article image taken by the camera 3. Then, the extracted feature amount is transmitted to the verification server 20 by the communication unit 21. The matching server 20 performs a matching process based on the received feature amount, and transmits the result to the digital signage 1 through the communication unit 22. Then, the digital signage 1 generates an event based on the collation result.
　上記の構成の利点は、照合処理といった負荷のかかる処理をサーバに行わせることにより、デジタルサイネージ１の処理の負荷の軽減を図れることにある。また、多数のデジタルサイネージ１を、ネットワーク２３を介して照合サーバ２０と接続することにより、照合サーバにより、多数のデジタルサイネージ１の照合処理や運用を管理することができる。 The advantage of the above configuration is that the processing load of the digital signage 1 can be reduced by causing the server to perform a processing that requires a load, such as a verification process. Further, by connecting a large number of digital signage 1 to the verification server 20 via the network 23, the verification processing and operation of the large number of digital signage 1 can be managed by the verification server.
　尚、上記実施の形態は、次のようにも変形することができる。 The above embodiment can be modified as follows.
　図１２は実施の形態の他の変形例の構成図である。 FIG. 12 is a configuration diagram of another modification of the embodiment.
　図１２の例では、照合サーバ２０は、物品特徴量データベース１０と、特徴量抽出部１２と、照合部１３と、通信部２２とを備えている。そして、デジタルサイネージ１はネットワーク２３を介して照合サーバ２０と接続されており、デジタルサイネージ１にはカメラ３と、イベント出力制御部１４と、広告表示制御部１５と、通信部２１とを備えている。 12, the collation server 20 includes an article feature quantity database 10, a feature quantity extraction unit 12, a collation unit 13, and a communication unit 22. The digital signage 1 is connected to the verification server 20 via the network 23. The digital signage 1 includes a camera 3, an event output control unit 14, an advertisement display control unit 15, and a communication unit 21. Yes.
　上述した実施の形態の特徴は、デジタルサイネージ１では、カメラ３で撮影した画像を通信部２１により、照合サーバ２０に送信し、照合サーバ２０は受信した画像から特徴量を抽出して照合処理を行い、その結果を通信部２２によりデジタルサイネージ１に送信する。そして、デジタルサイネージ１は、照合結果に基づき、イベントを発生させるようにしている点である。 In the digital signage 1, the digital signage 1 transmits an image captured by the camera 3 to the verification server 20 via the communication unit 21. The verification server 20 extracts a feature amount from the received image and performs a verification process. The result is transmitted to the digital signage 1 by the communication unit 22. The digital signage 1 is configured to generate an event based on the collation result.
　上記の構成の利点は、特徴量の抽出や照合処理といった負荷のかかる処理をサーバに行わせることにより、デジタルサイネージ１の処理の負荷の軽減を図れることにある。また、多数のデジタルサイネージ１を、ネットワーク２３を介して照合サーバ２０と接続することにより、照合サーバにより、多数のデジタルサイネージ１の照合処理や運用を管理することができる。 The advantage of the above configuration is that the processing load of the digital signage 1 can be reduced by causing the server to perform processing that requires load such as feature amount extraction and collation processing. Further, by connecting a large number of digital signage 1 to the verification server 20 via the network 23, the verification processing and operation of the large number of digital signage 1 can be managed by the verification server.
　更に、図１３に示す如く、ＰＯＳシステム３０と連携することにより、デジタルサイネージ１で発生したイベントを各店舗のイベントに反映させることができる。例えば、各デジタルサイネージ１で発生したイベントの数が所定数を超えた場合に、店舗でタイムセールを実施し、商品の値引き等を自動的に反映させたりすることができる。 Furthermore, as shown in FIG. 13, by cooperating with the POS system 30, an event occurring in the digital signage 1 can be reflected in the event of each store. For example, when the number of events occurring in each digital signage 1 exceeds a predetermined number, a time sale can be performed at the store to automatically reflect discounts on products.
　以上で本発明の実施の形態及び実施例の説明を終わるが、上述した説明からも明らかなように、各部をハードウェアで構成してもよいし、コンピュータプログラムにより実現してもよい。この場合、プログラムメモリに格納されているプログラムで動作するプロセッサによって、上述した各実施の形態及び実施例と同様の機能、動作を実現させる。また、上述した実施の形態の一部の機能のみをコンピュータプログラムにより実現してもよい。 This is the end of the description of the embodiments and examples of the present invention. As is apparent from the above description, each unit may be configured by hardware or may be realized by a computer program. In this case, functions and operations similar to those of the above-described embodiments and examples are realized by a processor that operates according to a program stored in the program memory. Moreover, you may implement | achieve only a part of function of embodiment mentioned above with a computer program.
　また、上記の実施形態の一部又は全部は、以下の付記のようにも記載されうるが、以下には限られない。 Further, a part or all of the above embodiment can be described as in the following supplementary notes, but is not limited thereto.
　（付記１）　物品の特徴量が記憶された物品特徴量データベースと、
　前記物品に関する所定条件と、前記所定条件を満たした場合に発生するイベントとが対応付けられて記憶されたイベントデータベースと、
　取得した物品の物品画像から物品の特徴量を抽出する特徴量抽出手段と、
　前記物品特徴量データベースに記憶されている特徴量と前記抽出した特徴量とを照合し、前記物品画像の物品を識別する照合手段と、
　前記識別した物品が前記所定の条件を満たす場合、前記所定条件に対応するイベントを出力するイベント出力制御手段と
を有するデジタルサイネージシステム。 (Supplementary Note 1) An article feature quantity database in which feature quantities of articles are stored;
An event database in which a predetermined condition related to the article and an event that occurs when the predetermined condition is satisfied are stored in association with each other;
Feature quantity extraction means for extracting the feature quantity of the article from the article image of the acquired article;
Collating means for collating the feature quantity stored in the article feature quantity database with the extracted feature quantity and identifying the article of the article image;
A digital signage system comprising event output control means for outputting an event corresponding to the predetermined condition when the identified article satisfies the predetermined condition.
　（付記２）　前記条件が、前記物品の種類、数、又はそれらの組み合わせのいずれかを少なくとも含む
付記１に記載のデジタルサイネージシステム。 (Supplementary note 2) The digital signage system according to supplementary note 1, wherein the condition includes at least one of a type, a number, and a combination of the articles.
　（付記３）　前記物品を所持又は配置する人物がデジタルサイネージを視認可能な領域を撮像することができる位置に配置され、前記物品を撮像する撮像手段を有する
付記１又は付記２に記載のデジタルサイネージシステム。 (Additional remark 3) The digital signage of Additional remark 1 or Additional remark 2 which has the imaging means which is arrange | positioned in the position where the person who possesses or arrange | positions the said article can image the area | region which can visually recognize digital signage, and images the said article system.
　（付記４）　デジタルサイネージの出力手段に、イベントの告知を行う
付記１から付記３のいずれかに記載のデジタルサイネージシステム。 (Supplementary note 4) The digital signage system according to any one of supplementary note 1 to supplementary note 3, wherein an event is notified to an output means of digital signage.
　（付記５）　複数の出力手段を有し、
　前記出力制御手段は、前記識別した物品が前記所定の条件を満たす場合、前記複数の出力手段にイベントを出力する
付記１から付記４のいずれかに記載のデジタルサイネージシステム。 (Appendix 5) Having a plurality of output means,
The digital signage system according to any one of appendix 1 to appendix 4, wherein the output control means outputs an event to the plurality of output means when the identified article satisfies the predetermined condition.
　（付記６）　照合サーバが、前記物品特徴量データベースと前記照合手段とを少なくとも有し、
　デジタルサイネージが、前記特徴量抽出手段と前記イベント出力制御手段とを少なくとも有し、
　前記デジタルサイネージが、前記抽出した物品の特徴量を、前記照合サーバに送信し、
　前記照合サーバが、前記物品の特徴量に基づいて前記物品画像の物品を識別し、その識別結果を前記デジタルサイネージに送信する
付記１から付記５のいずれかに記載のデジタルサイネージシステム。 (Additional remark 6) A collation server has the said item feature-value database and the said collation means at least,
Digital signage has at least the feature quantity extraction means and the event output control means,
The digital signage transmits the extracted feature amount of the article to the verification server,
6. The digital signage system according to any one of appendix 1 to appendix 5, wherein the collation server identifies an article of the article image based on a feature amount of the article and transmits the identification result to the digital signage.
　（付記７）　前記イベントが、静止画、動画、音声の少なくともいずれかを含むコンテンツである
付記１から付記６のいずれかに記載のデジタルサイネージシステム。 (Supplementary note 7) The digital signage system according to any one of supplementary note 1 to supplementary note 6, wherein the event is content including at least one of a still image, a moving image, and audio.
　（付記８）　取得した物品の物品画像から物品の特徴量を抽出し、
　予め記憶されている特徴量と前記抽出した特徴量とを照合し、前記物品画像の物品を識別し、
　前記識別した物品が、イベントの発生条件を満たす場合、前記イベントを出力する
イベント発生方法。 (Appendix 8) Extracting the feature amount of the article from the article image of the acquired article,
Collating the feature quantity stored in advance with the extracted feature quantity, identifying the article in the article image,
An event generation method for outputting the event when the identified article satisfies an event generation condition.
　（付記９）　前記イベントの発生条件が、前記物品の種類、数、又はそれらの組み合わせのいずれかを少なくとも含む
付記８に記載のイベント発生方法。 (Supplementary note 9) The event generation method according to supplementary note 8, wherein the event generation condition includes at least one of a type, a number, and a combination of the articles.
　（付記１０）　デジタルサイネージの出力手段に、イベントの告知を行う
付記８又は付記９に記載のイベント発生方法。 (Supplementary note 10) The event generation method according to supplementary note 8 or supplementary note 9, wherein the event is notified to the digital signage output means.
　（付記１１）　前記識別した物品が前記イベントの発生条件を満たす場合、複数の出力手段にイベントを出力する
付記８から付記１０のいずれかに記載のイベント発生方法。 (Supplementary note 11) The event generation method according to any one of supplementary note 8 to supplementary note 10, wherein the event is output to a plurality of output means when the identified article satisfies the event generation condition.
　（付記１２）　物品の特徴量が記憶された物品特徴量データベースと、前記物品に関する所定条件と、前記所定条件を満たした場合に発生するイベントとが対応付けられて記憶されたイベントデータベースとを有するコンピュータシステムのプログラムであって、
　取得した物品の物品画像から物品の特徴量を抽出する処理と、
　前記物品特徴量データベースに記憶されている特徴量と前記抽出した特徴量とを照合し、前記物品画像の物品を識別する処理と、
　前記識別した物品が前記所定の条件を満たす場合、前記所定条件に対応するイベントを出力する処理と
をコンピュータに実行させるプログラム。 (Additional remark 12) It has the article | item feature-value database in which the feature-value of the article | item was memorize | stored, the event database which matched and memorize | stored the predetermined condition regarding the said article | item, and the event which generate | occur | produces when the said predetermined condition is satisfy | filled. A computer system program comprising:
Processing for extracting the feature amount of the article from the article image of the acquired article;
A process of collating the feature quantity stored in the article feature quantity database with the extracted feature quantity and identifying the article in the article image;
A program for causing a computer to execute a process of outputting an event corresponding to the predetermined condition when the identified article satisfies the predetermined condition.
　（付記１３）　前記条件が、前記物品の種類、数、又はそれらの組み合わせのいずれかを少なくとも含む
付記１２に記載のプログラム。 (Supplementary note 13) The program according to supplementary note 12, wherein the condition includes at least one of a type, a number, and a combination of the articles.
　（付記１４）　デジタルサイネージの出力手段に、イベントの告知を行う処理を有する
付記１２又は付記１３に記載のプログラム。 (Additional remark 14) The program of Additional remark 12 or Additional remark 13 which has a process which notifies the event to the output means of digital signage.
　（付記１５）　前記識別した物品が前記所定の条件を満たす場合、前記複数の出力手段にイベントを出力する処理を有する
付記１２から付記１４のいずれかに記載のプログラム。 (Supplementary note 15) The program according to any one of supplementary note 12 to supplementary note 14, including a process of outputting an event to the plurality of output means when the identified article satisfies the predetermined condition.
　以上好ましい実施の形態及び実施例をあげて本発明を説明したが、本発明は必ずしも上記実施の形態及び実施例に限定されるものではなく、その技術的思想の範囲内において様々に変形し実施することが出来る。 Although the present invention has been described with reference to the preferred embodiments and examples, the present invention is not necessarily limited to the above-described embodiments and examples, and various modifications can be made within the scope of the technical idea. I can do it.
　本出願は、２０１２年３月３０日に出願された日本出願特願２０１２－０７９０８０号を基礎とする優先権を主張し、その開示の全てをここに取り込む。 This application claims priority based on Japanese Patent Application No. 2012-0799080 filed on Mar. 30, 2012, the entire disclosure of which is incorporated herein.
１　　　デジタルサイネージ
２　　　ディスプレイ
３　　　カメラ
１０　　画像特徴データベース
１１　　イベントデータベース
１２　　特徴量抽出部
１３　　照合部
１４　　イベント出力制御部
１５　　広告表示制御部
２０　　照合サーバ
２１　　通信部
２２　　通信部
２３　　ネットワーク
３０　　ＰＯＳシステム DESCRIPTION OF SYMBOLS 1 Digital signage 2 Display 3 Camera 10 Image feature database 11 Event database 12 Feature-value extraction part 13 Collation part 14 Event output control part 15 Advertisement display control part 20 Collation server 21 Communication part 22 Communication part 23 Network 30 POS system

Claims (9)

  1. 　物品の特徴量が記憶された物品特徴量データベースと、
    　前記物品に関する所定条件と、前記所定条件を満たした場合に発生するイベントとが対応付けられて記憶されたイベントデータベースと、
    　取得した物品の物品画像から物品の特徴量を抽出する特徴量抽出手段と、
    　前記物品特徴量データベースに記憶されている特徴量と前記抽出した特徴量とを照合し、前記物品画像の物品を識別する照合手段と、
    　前記識別した物品が前記所定の条件を満たす場合、前記所定条件に対応するイベントを出力するイベント出力制御手段と
    を有するデジタルサイネージシステム。     An article feature quantity database storing article feature quantities;
    An event database in which a predetermined condition related to the article and an event that occurs when the predetermined condition is satisfied are stored in association with each other;
    Feature quantity extraction means for extracting the feature quantity of the article from the article image of the acquired article;
    Collating means for collating the feature quantity stored in the article feature quantity database with the extracted feature quantity and identifying the article of the article image;
    A digital signage system comprising event output control means for outputting an event corresponding to the predetermined condition when the identified article satisfies the predetermined condition.
  2. 　前記条件が、前記物品の種類、数、又はそれらの組み合わせのいずれかを少なくとも含む
    請求項１に記載のデジタルサイネージシステム。     The digital signage system according to claim 1, wherein the condition includes at least one of a type, a number, and a combination of the articles.
  3. 　前記物品を所持又は配置する人物がデジタルサイネージを視認可能な領域を撮像することができる位置に配置され、前記物品を撮像する撮像手段を有する
    請求項１又は請求項２に記載のデジタルサイネージシステム。     3. The digital signage system according to claim 1, further comprising an imaging unit that is arranged at a position where a person who possesses or arranges the article can take an image of an area in which the digital signage can be visually recognized, and takes an image of the article.
  4. 　デジタルサイネージの出力手段に、イベントの告知を行う
    請求項１から請求項３のいずれかに記載のデジタルサイネージシステム。     The digital signage system according to any one of claims 1 to 3, wherein an event is notified to the digital signage output means.
  5. 　複数の出力手段を有し、
    　前記出力制御手段は、前記識別した物品が前記所定の条件を満たす場合、前記複数の出力手段にイベントを出力する
    請求項１から請求項４のいずれかに記載のデジタルサイネージシステム。     Having a plurality of output means;
    5. The digital signage system according to claim 1, wherein the output control unit outputs an event to the plurality of output units when the identified article satisfies the predetermined condition.
  6. 　照合サーバが、前記物品特徴量データベースと前記照合手段とを少なくとも有し、
    　デジタルサイネージが、前記特徴量抽出手段と前記イベント出力制御手段とを少なくとも有し、
    　前記デジタルサイネージが、前記抽出した物品の特徴量を、前記照合サーバに送信し、
    　前記照合サーバが、前記物品の特徴量に基づいて前記物品画像の物品を識別し、その識別結果を前記デジタルサイネージに送信する
    請求項１から請求項５のいずれかに記載のデジタルサイネージシステム。     The verification server has at least the article feature amount database and the verification unit,
    Digital signage has at least the feature quantity extraction means and the event output control means,
    The digital signage transmits the extracted feature amount of the article to the verification server,
    The digital signage system according to any one of claims 1 to 5, wherein the verification server identifies an article of the article image based on a feature amount of the article and transmits the identification result to the digital signage.
  7. 　前記イベントが、静止画、動画、音声の少なくともいずれかを含むコンテンツである
    請求項１から請求項６のいずれかに記載のデジタルサイネージシステム。     The digital signage system according to any one of claims 1 to 6, wherein the event is content including at least one of a still image, a moving image, and audio.
  8. 　取得した物品の物品画像から物品の特徴量を抽出し、
    　予め記憶されている特徴量と前記抽出した特徴量とを照合し、前記物品画像の物品を識別し、
    　前記識別した物品が、イベントの発生条件を満たす場合、前記イベントを出力する
    イベント発生方法。     Extract the feature amount of the article from the article image of the acquired article,
    Collating the feature quantity stored in advance with the extracted feature quantity, identifying the article in the article image,
    An event generation method for outputting the event when the identified article satisfies an event generation condition.
  9. 　物品の特徴量が記憶された物品特徴量データベースと、前記物品に関する所定条件と、前記所定条件を満たした場合に発生するイベントとが対応付けられて記憶されたイベントデータベースとを有するコンピュータシステムのプログラムであって、
    　取得した物品の物品画像から物品の特徴量を抽出する処理と、
    　前記物品特徴量データベースに記憶されている特徴量と前記抽出した特徴量とを照合し、前記物品画像の物品を識別する処理と、
    　前記識別した物品が前記所定の条件を満たす場合、前記所定条件に対応するイベントを出力する処理と
    をコンピュータに実行させるプログラム。     A computer system program comprising an article feature quantity database in which feature quantities of articles are stored, a predetermined condition related to the article, and an event database in which events generated when the predetermined condition is satisfied are stored in association with each other Because
    Processing for extracting the feature amount of the article from the article image of the acquired article;
    A process of collating the feature quantity stored in the article feature quantity database with the extracted feature quantity and identifying the article in the article image;
    A program for causing a computer to execute a process of outputting an event corresponding to the predetermined condition when the identified article satisfies the predetermined condition.
PCT/JP2013/059213 2012-03-30 2013-03-28 Digital signage system, digital signage, event generation method, and program WO2013147002A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2012079080 2012-03-30
JP2012-079080 2012-03-30

Publications (1)

Publication Number Publication Date
WO2013147002A1 true WO2013147002A1 (en) 2013-10-03

Family

ID=49260250

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2013/059213 WO2013147002A1 (en) 2012-03-30 2013-03-28 Digital signage system, digital signage, event generation method, and program

Country Status (2)

Country Link
JP (1) JPWO2013147002A1 (en)
WO (1) WO2013147002A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001076227A (en) * 1999-08-19 2001-03-23 Mitsubishi Electric Inf Technol Center America Inc Automatic vending machine with visual sensation function and method for mutually acting with consumer by using automatic vending machine
JP2010039095A (en) * 2008-08-04 2010-02-18 Seiko Epson Corp Audio output control device, audio output device, audio output control method, and program
JP2010049415A (en) * 2008-08-20 2010-03-04 Sony Corp Commodity marketing system
JP2010231355A (en) * 2009-03-26 2010-10-14 Sanyo Electric Co Ltd Information display device
JP2010536087A (en) * 2007-08-08 2010-11-25 オラワークス・インコーポレイテッド Method, terminal, and computer-readable recording medium for acquiring information about product worn by person in image data

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5764869B2 (en) * 2010-03-31 2015-08-19 富士通株式会社 Advertisement device, advertisement method, and advertisement output program

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001076227A (en) * 1999-08-19 2001-03-23 Mitsubishi Electric Inf Technol Center America Inc Automatic vending machine with visual sensation function and method for mutually acting with consumer by using automatic vending machine
JP2010536087A (en) * 2007-08-08 2010-11-25 オラワークス・インコーポレイテッド Method, terminal, and computer-readable recording medium for acquiring information about product worn by person in image data
JP2010039095A (en) * 2008-08-04 2010-02-18 Seiko Epson Corp Audio output control device, audio output device, audio output control method, and program
JP2010049415A (en) * 2008-08-20 2010-03-04 Sony Corp Commodity marketing system
JP2010231355A (en) * 2009-03-26 2010-10-14 Sanyo Electric Co Ltd Information display device

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
HIROSHI WATANABE ET AL.: "'Reflect Ad' Display to Reflect the Status of Surroundings", SYMPOSIUM ON MULTIMEDIA, DISTRIBUTED, COOPERATIVE AND MOBILE SYSTEMS (DICOM02011) RONBUNSHU IPSJ SYMPOSIUM SERIES, vol. 2011, no. 1, 6 July 2011 (2011-07-06), pages 1049 - 1056 *
MAKI MIYAMOTO: "Kao Ninshiki de Anata ni Atta Kokoku o - NEC no Digital Signage", 11 November 2008 (2008-11-11), Retrieved from the Internet <URL:http://www.itmedia.co.jp/news/articles/0811/11/news078.html> [retrieved on 20130419] *

Also Published As

Publication number Publication date
JPWO2013147002A1 (en) 2015-12-14

Similar Documents

Publication Publication Date Title
JP6148948B2 (en) Information processing system, information processing method, and information processing program
JP5224360B2 (en) Electronic advertising device, electronic advertising method and program
US9530144B2 (en) Content output device, content output method, content output program, and recording medium having content output program recorded thereon
US20190108551A1 (en) Method and apparatus for customer identification and tracking system
WO2010053191A1 (en) Electronic advertisement system, electronic advertisement distribution apparatus, electronic advertisement distribution method, and recording medium
CN104090973A (en) Information presentation method and device
WO2013147003A1 (en) Digital signage system, digital signage, article information presentation method, and program
JP5816393B1 (en) Product evaluation apparatus, method and program
JP2014170314A (en) Information processing system, information processing method, and program
JP2013257697A (en) Signage system and program
JP2010140287A (en) Purchase action analysis device, method and computer program
JP2013084182A (en) Information processor and program
WO2021048763A1 (en) Augmented, virtual and mixed-reality content selection &amp; display
JP2006268440A (en) System, server, program, and method for distributing product advertisement image, and recording medium
JP2014203312A (en) Computer program for sales promotion campaign application, and computer program for sales promotion campaign lottery
JP2006215842A (en) Human movement line tracing system and advertisement display control system
WO2013147004A1 (en) Digital signage system, digital signage, article information presentation method, and program
US9324292B2 (en) Selecting an interaction scenario based on an object
JP6716359B2 (en) Projection system, projection method, and projection program
JP5426441B2 (en) Advertisement image display device and advertisement image display method
WO2013147002A1 (en) Digital signage system, digital signage, event generation method, and program
JP2014146242A (en) Information distribution device, information display system and program
JP2014002651A (en) Information providing system and information providing method
JP5907363B2 (en) Digital signage system, digital signage, advertisement display method and program
WO2016038902A1 (en) Behavior analysis device, behavior analysis method, behavior analysis program, and recording medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13768345

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2014508016

Country of ref document: JP

Kind code of ref document: A

122 Ep: pct application non-entry in european phase

Ref document number: 13768345

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE