WO2016135816A1 - Information system - Google Patents

Information system Download PDF

Info

Publication number
WO2016135816A1
WO2016135816A1 PCT/JP2015/054986 JP2015054986W WO2016135816A1 WO 2016135816 A1 WO2016135816 A1 WO 2016135816A1 JP 2015054986 W JP2015054986 W JP 2015054986W WO 2016135816 A1 WO2016135816 A1 WO 2016135816A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
unit
content
image
display device
Prior art date
Application number
PCT/JP2015/054986
Other languages
French (fr)
Japanese (ja)
Inventor
貴行 筒井
Original Assignee
株式会社日立国際電気
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社日立国際電気 filed Critical 株式会社日立国際電気
Priority to JP2017501568A priority Critical patent/JPWO2016135816A1/en
Priority to PCT/JP2015/054986 priority patent/WO2016135816A1/en
Publication of WO2016135816A1 publication Critical patent/WO2016135816A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising

Definitions

  • the present disclosure relates to an information system, and can be applied to an information display system having a face recognition function, for example.
  • information display devices such as digital signage (digital signage) have been installed on store floors such as financial institutions, and by displaying advertisements of financial products such as various deposits and various loan products to customers, Contributing to store PR activities.
  • digital signage digital signage
  • it acquires the image from the camera installed in the information display device, performs face recognition processing, and measures what content and what gender and age group see from the recognition result of estimating gender and age (For example, JP2012-252613A).
  • An object of the present disclosure is to provide an information system that can efficiently specify products / services recommended next to products / services currently used for customers.
  • the information system compares the face recognition result (viewing result) for each content of each service from the camera unit of the information display device with the face recognition result from the camera unit of the service window, but the content is viewed but corresponds.
  • the services that are not used by the service counter are extracted by summing up the services without face recognition. As a result, it is possible to efficiently identify products / services recommended next to products / services currently being used by customers.
  • FIG. 1A is a block diagram illustrating the configuration of the information system according to the embodiment.
  • an information display device 10 that displays various product / service guidance is installed in a store, and an information device 11 is installed in each service window. Although two service windows are shown in FIG. 1A, the number of service windows may be one or three or more.
  • the information display device 10 includes an information display processing device 100, a camera 101, and a display unit 102. At least the camera 101 and the display unit 102 are installed at a waiting place in a store.
  • the information device 11 includes an information acquisition processing device 110 and a camera 111.
  • a customer information comparison device (server device) 200 that collects and compares face detection data from the information display device 10 and the information device 11 is installed in the store.
  • FIG. 2 is a block diagram illustrating the configuration of the information display apparatus according to the embodiment.
  • the circulation display control unit 104 displays various contents on the display unit 102 according to the content file display list stored in the storage unit 103. Further, the circulation display control unit 104 sends a content switching notification to the face detection unit 105 at the timing of content switching.
  • the face detection unit 105 acquires image data (video signal) from the camera 101 and performs face detection processing.
  • the image data obtained by cutting out the detected portion is stored in the storage unit 106.
  • the content ID being displayed is embedded so that the content being viewed can be specified.
  • the face detection data transmission unit 107 reads the face detection data from the storage unit 106 and transmits it to the customer information comparison device 200.
  • FIG. 3 is a block diagram illustrating the configuration of the information device according to the embodiment.
  • each job is performed at the window service terminal 112 of the information device 11.
  • the face detection unit 115 is notified of the window processing notification to the information acquisition processing device 110 when each job is processed.
  • the face detection unit 115 receives the window processing notification, acquires image data from the camera 111, and performs face detection processing.
  • the image data obtained by cutting out the detected portion is stored in the storage unit 116.
  • the accumulated face detection data is embedded with the customer ID sent from the window business terminal 112 and the processed business ID so that the customer and the service / product used can be identified.
  • the face detection data transmission unit 117 reads the face detection data from the storage unit 116 and transmits it to the customer information comparison device 200.
  • FIG. 4 is a block diagram illustrating the configuration of the customer information comparison apparatus according to the embodiment.
  • FIG. 5 is a diagram for explaining an example of a viewing list according to the embodiment.
  • face detection data image data
  • the face recognition processing unit 203 converts the feature such as the position of the face part from the image data into numerical data (face recognition data) and accumulates it in the storage units 204A and 204B.
  • the face recognition data comparison unit 205 compares the face recognition data of the information device 11 at the window and the face recognition data of the information display device 10. If there is a match as a result of the comparison processing, a service usage list 301 for each customer ID as shown in FIG. 5A is created and stored from the customer ID and business ID included in the face recognition data of the information device at the window. It accumulates in the unit 206. Further, a content viewing list 302 for each customer ID as shown in FIG. 5B is created from the customer ID included in the face recognition data of the information device at the window and the viewing content ID included in the face recognition data of the information display device. Accumulate in the storage unit 206.
  • a customer undefined ID is assigned and added to the list.
  • G01, G02,... Gnn indicate business IDs, and those marked with ⁇ are business (products / services, contents) used by the customer at the service window. This is referred to as a usage service ID.
  • C01, C02,... Cnn indicate content IDs, and those marked with ⁇ are content viewed by the customer, which are referred to as viewing content IDs.
  • FIG. 6 is a diagram for explaining an extraction example from the content viewing list according to the embodiment.
  • the content list 303 is searched using the content IDs (marked with a circle) viewed in the content viewing list 302, and the corresponding business ID is acquired.
  • a business ID associated with the viewed content ID is compared with a usage ID of the service usage list 301 to extract a business ID that is not used. That is, by extracting a business ID that is not included in the used business ID, content (product / service) that the customer is interested in is newly extracted. For example, when the customer ID is “00000002”, the business ID “G01” is viewed but not used.
  • the business ID “G01” is determined as a newly recommended product / service.
  • FIG. 1B is a block diagram illustrating a configuration of an information system according to a modification.
  • an information display device 10 that displays various product / service guidance is installed in the stores of the branch offices BR1, BR2, and BR3, and an information device 11 is installed in each service window.
  • FIG. 1B shows three branches, the number of branches may be one or four or more. Further, although two service windows are shown in FIG. 1B, the number of service windows may be one or three or more.
  • the information display device 10 includes an information display processing device 100, a camera 101, and a display unit 102.
  • the information acquisition device 11 includes an information acquisition processing device 110 and a camera 111.
  • a head office (head office) HQ is provided with a customer information comparison device (server device) 200 that collects and compares face detection data from the information display devices 10 and information devices 11 of each branch via the network NTW. Yes.
  • the customer information comparison device (server device) 200 does not need to be installed at the headquarters (head office), and may be installed at a location other than the headquarters as long as it can be processed centrally at one location.
  • the information system as in the embodiment is configured for each branch, that is, when a customer information comparison device (server device) is provided for each information display device or a face recognition function is built in, an additional device or a high-performance processing device
  • server device since the customer information comparison device (server device) is centralized in the headquarters in this modification, the cost can be reduced.
  • 1A, 1B ... Information system 10 ... Information display device 11 ... Information device 100 ... Information display processing device 101 ... Camera 102 ... Display unit 103 ... Storage unit 104 ... Circulation display control unit 105 ... face detection unit 106 ... storage unit 107 ... face detection data transmission unit 110 ... information acquisition processing device 111 ... camera 112 ... counter service terminal 115 ... Face detection unit 116 ... storage unit 117 ... face detection data transmission unit 200 ... customer information comparison device (server device)

Landscapes

  • Business, Economics & Management (AREA)
  • Engineering & Computer Science (AREA)
  • Strategic Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Marketing (AREA)
  • Finance (AREA)
  • Development Economics (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Accounting & Taxation (AREA)
  • Economics (AREA)
  • General Business, Economics & Management (AREA)
  • Theoretical Computer Science (AREA)
  • Human Resources & Organizations (AREA)
  • Tourism & Hospitality (AREA)
  • Quality & Reliability (AREA)
  • Operations Research (AREA)
  • Game Theory and Decision Science (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Financial Or Insurance-Related Operations Such As Payment And Settlement (AREA)

Abstract

An information system is provided with an information display device, an information device, and a server device. The information display device is provided with a display unit for displaying a predetermined content on a screen which is installed in a waiting space, a storage unit for storing a plurality of contents and content attributes, a control unit for causing the contents to be displayed in order, a camera unit attached to the display unit, a storage unit for storing an image from the camera unit in synchronization with content switch timing, and a transmission unit for transmitting the stored image. The information device is provided with a camera unit attached to a service window, a storage unit for storing an image from the camera unit, and a transmission unit for transmitting the stored image. The server device receives the images transmitted from the transmission unit of the information display device and the transmission unit of the information device and performs a face recognition process therefor.

Description

情報システムInformation system
　本開示は情報システムに関し、例えば顔認識機能を備えた情報表示システムに適用可能である。 The present disclosure relates to an information system, and can be applied to an information display system having a face recognition function, for example.
　従来、電子看板（デジタルサイネージ）等の情報表示装置は金融機関などの店舗フロアに設置され、来店客に対して各種預金や各種融資商品といった金融商品の広告を来店客に表示することで、各店舗の広報活動に貢献している。
  また、情報表示装置に設置されたカメラから画像を取得して顔認識処理を実施して性別や年齢を推測しての認識結果からどのコンテンツがどの性別や年齢層が見ているか測定している（例えば、特開２０１２－２５２６１３号公報）。 Conventionally, information display devices such as digital signage (digital signage) have been installed on store floors such as financial institutions, and by displaying advertisements of financial products such as various deposits and various loan products to customers, Contributing to store PR activities.
In addition, it acquires the image from the camera installed in the information display device, performs face recognition processing, and measures what content and what gender and age group see from the recognition result of estimating gender and age (For example, JP2012-252613A).
特開２０１２－２５２６１３号公報JP 2012-252613 A
　情報表示装置に表示されているコンテンツについて、来店客がどの商品・サービスに興味があるかを情報表示装置に設置されたカメラからの画像からの顔認識結果とその時に表示されていたコンテンツから推測することができる。しかし、そのコンテンツを見ていた顧客が既にその商品・サービスを利用していることもあり、効率的に商品・サービスを勧めることが困難である。
  本開示の課題は、来店客に対して現在、利用している商品・サービスの次にお勧めする商品・サービスを効率的に特定することができる情報システムを提供することにある。 As for the content displayed on the information display device, guess which product / service the customer is interested in from the face recognition result from the image from the camera installed in the information display device and the content displayed at that time can do. However, it is difficult to recommend products and services efficiently because the customers who have been viewing the content have already used the products and services.
An object of the present disclosure is to provide an information system that can efficiently specify products / services recommended next to products / services currently used for customers.
　本開示のうち、代表的なものの概要を簡単に説明すれば、下記のとおりである。
  すなわち、情報システムは情報表示装置と情報装置とサーバ装置とを備える。前記情報表示装置は、待合場所に設置され画面上に所定のコンテンツを表示する表示部と、複数のコンテンツおよびコンテンツ属性を記憶する記憶部と、前記コンテンツを順番に表示させる制御部と、前記表示部に取り付けられたカメラ部と、コンテンツ切替えタイミングと連動して前記カメラ部からの画像を記憶する記憶部と、記憶した画像を送信する送信部と、を備える。前記情報装置は、サービス窓口に取り付けられるカメラ部と、前記カメラ部からの画像を記憶する記憶部と、記憶した画像を送信する送信部と、を備える。前記サーバ装置は、前記情報表示装置の前記送信部および前記情報装置の前記送信部から送信される画像を受信・顔認識処理を実施する。 The outline of a representative one of the present disclosure will be briefly described as follows.
That is, the information system includes an information display device, an information device, and a server device. The information display device is installed at a waiting place, displays a predetermined content on a screen, a storage unit that stores a plurality of content and content attributes, a control unit that displays the content in order, and the display A camera unit attached to the unit, a storage unit that stores an image from the camera unit in conjunction with content switching timing, and a transmission unit that transmits the stored image. The information device includes a camera unit attached to a service window, a storage unit that stores an image from the camera unit, and a transmission unit that transmits the stored image. The server device performs a face recognition process on images transmitted from the transmission unit of the information display device and the transmission unit of the information device.
　上記情報表示システムによれば、来店客に対して現在、利用している商品・サービスの次にお勧めする商品・サービスを効率的に特定することができる。 According to the information display system described above, it is possible to efficiently identify products / services recommended next to products / services currently used for customers.
実施例に係る情報システムの構成を説明するためのブロック図である。It is a block diagram for demonstrating the structure of the information system which concerns on an Example. 変形例に係る情報システムの構成を説明するためのブロック図である。It is a block diagram for demonstrating the structure of the information system which concerns on a modification. 実施例に係る情報表示装置を説明するためのブロック図である。It is a block diagram for demonstrating the information display apparatus which concerns on an Example. 実施例に係る情報装置を説明するためのブロック図である。It is a block diagram for demonstrating the information apparatus which concerns on an Example. 実施例に係る顧客情報比較装置を説明するためのブロック図である。It is a block diagram for demonstrating the customer information comparison apparatus which concerns on an Example. 実施例に係るコンテンツ視聴リスト例を説明するための図である。It is a figure for demonstrating the example of a content viewing list which concerns on an Example. 実施例に係るサービス利用リスト例を説明するための図である。It is a figure for demonstrating the example of a service usage list which concerns on an Example. 実施例に係る視聴リストからの抽出例を説明するための図である。It is a figure for demonstrating the example extracted from the viewing list which concerns on an Example.
　実施形態に係る情報システムは情報表示装置のカメラ部からの各サービスのコンテンツ毎の顔認識結果（視聴結果）とサービス窓口のカメラ部からの顔認識結果を比較して、コンテンツは視聴したが該当するサービス窓口の顔認識が無いものを集計することによりサービスが未利用で興味があるものを抽出する。これにより、来店客に対して現在、利用している商品・サービスの次にお勧めする商品・サービスを効率的に特定することができる。 The information system according to the embodiment compares the face recognition result (viewing result) for each content of each service from the camera unit of the information display device with the face recognition result from the camera unit of the service window, but the content is viewed but corresponds. The services that are not used by the service counter are extracted by summing up the services without face recognition. As a result, it is possible to efficiently identify products / services recommended next to products / services currently being used by customers.
　以下、実施例および変形例について、図面を用いて説明する。ただし、以下の説明において、同一構成要素には同一符号を付し繰り返しの説明を省略することがある。 Hereinafter, examples and modifications will be described with reference to the drawings. However, in the following description, the same components may be denoted by the same reference numerals and repeated description may be omitted.
　まず、実施例に係る情報システムについて図１Ａを用いて説明する。図１Ａは実施例に係る情報システムの構成を示すブロック図である。
  実施例に係る情報システム１Ａにおいて、店舗には各種商品・サービス案内を表示する情報表示装置１０が設置され、各サービス窓口には情報装置１１が設置される。図１Ａではサービス窓口は２箇所示しているが、窓口は１箇所でも３箇所以上でもよい。情報表示装置１０は情報表示処理装置１００とカメラ１０１と表示部１０２とを備える。少なくともカメラ１０１および表示部１０２は店舗の待合場所等に設置される。情報装置１１は情報取得処理装置１１０とカメラ１１１とを備える。また、情報システム１Ａにおいて、店舗には情報表示装置１０および情報装置１１から顔検出データを収集・比較する顧客情報比較装置（サーバ装置）２００が設置されている。 First, an information system according to an embodiment will be described with reference to FIG. 1A. FIG. 1A is a block diagram illustrating the configuration of the information system according to the embodiment.
In the information system 1A according to the embodiment, an information display device 10 that displays various product / service guidance is installed in a store, and an information device 11 is installed in each service window. Although two service windows are shown in FIG. 1A, the number of service windows may be one or three or more. The information display device 10 includes an information display processing device 100, a camera 101, and a display unit 102. At least the camera 101 and the display unit 102 are installed at a waiting place in a store. The information device 11 includes an information acquisition processing device 110 and a camera 111. In the information system 1A, a customer information comparison device (server device) 200 that collects and compares face detection data from the information display device 10 and the information device 11 is installed in the store.
　次に、実施例に係る情報表示装置について図２を用いて説明する。図２は実施例に係る情報表示装置の構成を示すブロック図である。
  情報表示処理装置１００において、循環表示制御部１０４では記憶部１０３に格納されているコンテンツファイル表示リストに従って各種コンテンツを表示部１０２で表示するようにしている。また、循環表示制御部１０４ではコンテンツ切替えのタイミングで顔検出部１０５にコンテンツ切替通知を送る。顔検出部１０５ではコンテンツ切替通知を受けてカメラ１０１より画像データ（映像信号）を取得して顔検出処理を実施する。顔検出ができたら検出部分を切り出した画像データを記憶部１０６に蓄積する。蓄積された顔検出データには表示中のコンテンツＩＤを埋め込んで視聴しているコンテンツを特定できるようにしている。顔検出データ送信部１０７は記憶部１０６から顔検出データを読み込んで顧客情報比較装置２００に送信する。 Next, the information display apparatus according to the embodiment will be described with reference to FIG. FIG. 2 is a block diagram illustrating the configuration of the information display apparatus according to the embodiment.
In the information display processing apparatus 100, the circulation display control unit 104 displays various contents on the display unit 102 according to the content file display list stored in the storage unit 103. Further, the circulation display control unit 104 sends a content switching notification to the face detection unit 105 at the timing of content switching. In response to the content switching notification, the face detection unit 105 acquires image data (video signal) from the camera 101 and performs face detection processing. When the face is detected, the image data obtained by cutting out the detected portion is stored in the storage unit 106. In the accumulated face detection data, the content ID being displayed is embedded so that the content being viewed can be specified. The face detection data transmission unit 107 reads the face detection data from the storage unit 106 and transmits it to the customer information comparison device 200.
　次に、実施例に係る情報装置について図３を用いて説明する。図３は実施例に係る情報装置の構成を示すブロック図である。
  各窓口では情報装置１１の窓口業務端末１１２にて各業務を実施している。各業務の処理時に情報取得処理装置１１０に対して窓口処理通知を顔検出部１１５に通知する。顔検出部１１５では窓口処理通知を受けてカメラ１１１より画像データを取得して顔検出処理を実施する。顔検出ができたら検出部分を切り出した画像データを記憶部１１６に蓄積する。蓄積された顔検出データには窓口業務端末１１２から送られてきた顧客ＩＤおよび処理した業務ＩＤを埋め込んで顧客および利用サービス・商品を特定できるようにしている。顔検出データ送信部１１７は記憶部１１６から顔検出データを読み込んで顧客情報比較装置２００に送信する。 Next, the information apparatus according to the embodiment will be described with reference to FIG. FIG. 3 is a block diagram illustrating the configuration of the information device according to the embodiment.
At each window, each job is performed at the window service terminal 112 of the information device 11. The face detection unit 115 is notified of the window processing notification to the information acquisition processing device 110 when each job is processed. The face detection unit 115 receives the window processing notification, acquires image data from the camera 111, and performs face detection processing. When the face is detected, the image data obtained by cutting out the detected portion is stored in the storage unit 116. The accumulated face detection data is embedded with the customer ID sent from the window business terminal 112 and the processed business ID so that the customer and the service / product used can be identified. The face detection data transmission unit 117 reads the face detection data from the storage unit 116 and transmits it to the customer information comparison device 200.
　次に、実施例に係る顧客情報比較装置について図４および図５を用いて説明する。図４は実施例に係る顧客情報比較装置の構成を示すブロック図である。図５は実施例に係る視聴リスト例を説明するための図である。
  顧客情報比較装置２００では夜間などの決められた時間帯に情報表示装置１０および情報装置１１から顔検出データ（画像データ）を顔検出データ取得部２０１で取得し、記憶部２０２Ａ，２０２Ｂに蓄積する。蓄積された顔検出データは比較できるように顔認識処理部２０３で画像データから顔のパーツの位置等の特徴を数値データ（顔認識データ）化し、記憶部２０４Ａ，２０４Ｂに蓄積する。窓口の情報装置１１の顔認識データと情報表示装置１０の顔認識データとを顔認識データ比較部２０５で比較処理を実施する。
  比較処理の結果、一致したものがあれば、窓口の情報装置の顔認識データに含まれる顧客ＩＤと業務ＩＤとから、図５Ａに示すような顧客ＩＤ毎のサービス利用リスト３０１を作成し、記憶部２０６に蓄積する。また、窓口の情報装置の顔認識データに含まれる顧客ＩＤと情報表示装置の顔認識データに含まれる視聴コンテンツＩＤとから、図５Ｂに示すような顧客ＩＤ毎のコンテンツ視聴リスト３０２を作成し、記憶部２０６に蓄積する。
  情報表示装置の顔認識データが窓口の情報装置の顔認識データに一致しない場合は顧客未定義ＩＤを割り当ててリストに追加する。サービス利用リスト３０１において、Ｇ０１、Ｇ０２、・・・Ｇｎｎは業務ＩＤを示しており、○印が付されたものは顧客がサービス窓口で利用した業務（商品・サービス、コンテンツ）であり、これを利用業務ＩＤという。コンテンツ視聴リスト３０２において、Ｃ０１、Ｃ０２、・・・ＣｎｎはコンテンツＩＤを示しており、○印が付されたものは顧客が視聴したコンテンツであり、これを視聴コンテンツＩＤという。 Next, a customer information comparison apparatus according to an embodiment will be described with reference to FIGS. FIG. 4 is a block diagram illustrating the configuration of the customer information comparison apparatus according to the embodiment. FIG. 5 is a diagram for explaining an example of a viewing list according to the embodiment.
In the customer information comparison device 200, face detection data (image data) is acquired from the information display device 10 and the information device 11 by the face detection data acquisition unit 201 and stored in the storage units 202A and 202B at a predetermined time zone such as at night. . In order to compare the accumulated face detection data, the face recognition processing unit 203 converts the feature such as the position of the face part from the image data into numerical data (face recognition data) and accumulates it in the storage units 204A and 204B. The face recognition data comparison unit 205 compares the face recognition data of the information device 11 at the window and the face recognition data of the information display device 10.
If there is a match as a result of the comparison processing, a service usage list 301 for each customer ID as shown in FIG. 5A is created and stored from the customer ID and business ID included in the face recognition data of the information device at the window. It accumulates in the unit 206. Further, a content viewing list 302 for each customer ID as shown in FIG. 5B is created from the customer ID included in the face recognition data of the information device at the window and the viewing content ID included in the face recognition data of the information display device. Accumulate in the storage unit 206.
If the face recognition data of the information display device does not match the face recognition data of the information device at the window, a customer undefined ID is assigned and added to the list. In the service usage list 301, G01, G02,... Gnn indicate business IDs, and those marked with ○ are business (products / services, contents) used by the customer at the service window. This is referred to as a usage service ID. In the content viewing list 302, C01, C02,... Cnn indicate content IDs, and those marked with ○ are content viewed by the customer, which are referred to as viewing content IDs.
　次に、図６を用いて説明する。図６は実施例に係るコンテンツ視聴リストからの抽出例を説明するための図である。
  コンテンツ視聴リスト３０２の視聴したコンテンツＩＤ（○印が付されたもの）でコンテンツリスト３０３を検索して対応する業務ＩＤを取得する。視聴したコンテンツＩＤに対応付けられた業務ＩＤとサービス利用リスト３０１の利用業務ＩＤを比較して利用していない業務ＩＤを抽出する。すなわち、利用した業務ＩＤに含まれない業務ＩＤを抽出することにより、新たにその顧客が興味あるコンテンツ（商品・サービス）を抽出する。例えば、顧客ＩＤが「０００００００２」の場合は業務ＩＤが「Ｇ０１」について視聴しているが利用していない。業務ＩＤが「Ｇ０１」について新たに勧める商品・サービスと判断する。 Next, a description will be given with reference to FIG. FIG. 6 is a diagram for explaining an extraction example from the content viewing list according to the embodiment.
The content list 303 is searched using the content IDs (marked with a circle) viewed in the content viewing list 302, and the corresponding business ID is acquired. A business ID associated with the viewed content ID is compared with a usage ID of the service usage list 301 to extract a business ID that is not used. That is, by extracting a business ID that is not included in the used business ID, content (product / service) that the customer is interested in is newly extracted. For example, when the customer ID is “00000002”, the business ID “G01” is viewed but not used. The business ID “G01” is determined as a newly recommended product / service.
　＜変形例＞
　次に、変形例に係る情報システムについて図１Ｂを用いて説明する。図１Ｂは変形例に係る情報システムの構成を示すブロック図である。
  変形例に係る情報システム１Ｂにおいて、各支店ＢＲ１，ＢＲ２，ＢＲ３の店舗には各種商品・サービス案内を表示する情報表示装置１０が設置され、各サービス窓口には情報装置１１が設置される。図１Ｂでは支店は３箇所示しているが、支店は１箇所でも４箇所以上でもよい。また、図１Ｂではサービス窓口は２箇所示しているが、窓口は１箇所でも３箇所以上でもよい。情報表示装置１０は情報表示処理装置１００とカメラ１０１と表示部１０２とを備える。少なくともカメラ１０１および表示部１０２は店舗の待合場所等に設置される。情報取得装置１１は情報取得処理装置１１０とカメラ１１１とを備える。
  情報システム１Ｂにおいて、本部（本店）ＨＱには各支店の情報表示装置１０および情報装置１１からネットワークＮＴＷを介して顔検出データを収集・比較する顧客情報比較装置（サーバ装置）２００が設置されている。なお、顧客情報比較装置（サーバ装置）２００は本部（本店）に設置する必要はなく、１箇所で集中的に処理することができればよいので、本部以外の場所に設置してもよい。
  実施例のような情報システムを支店毎に構成すると、すなわち、情報表示装置毎に顧客情報比較装置（サーバ装置）を併設または顔認識機能を内蔵する場合は装置の増設や高性能の処理装置とするなどシステム構築のためのコストが高くなってしまうが、本変形例では顧客情報比較装置（サーバ装置）を本部に集約しているので、低コスト化することができる。 <Modification>
Next, an information system according to a modification will be described with reference to FIG. 1B. FIG. 1B is a block diagram illustrating a configuration of an information system according to a modification.
In the information system 1B according to the modification, an information display device 10 that displays various product / service guidance is installed in the stores of the branch offices BR1, BR2, and BR3, and an information device 11 is installed in each service window. Although FIG. 1B shows three branches, the number of branches may be one or four or more. Further, although two service windows are shown in FIG. 1B, the number of service windows may be one or three or more. The information display device 10 includes an information display processing device 100, a camera 101, and a display unit 102. At least the camera 101 and the display unit 102 are installed at a waiting place in a store. The information acquisition device 11 includes an information acquisition processing device 110 and a camera 111.
In the information system 1B, a head office (head office) HQ is provided with a customer information comparison device (server device) 200 that collects and compares face detection data from the information display devices 10 and information devices 11 of each branch via the network NTW. Yes. The customer information comparison device (server device) 200 does not need to be installed at the headquarters (head office), and may be installed at a location other than the headquarters as long as it can be processed centrally at one location.
When the information system as in the embodiment is configured for each branch, that is, when a customer information comparison device (server device) is provided for each information display device or a face recognition function is built in, an additional device or a high-performance processing device However, since the customer information comparison device (server device) is centralized in the headquarters in this modification, the cost can be reduced.
　＜効果＞
（１）窓口の利用状況とコンテンツ視聴状況を比較することにより利用窓口（サービス・商品）以外にどのサービス・商品に興味があるか抽出することができる。
（２）更に顧客ＩＤと関連付けることにより利用顧客個人毎に対してどのサービスを勧めるべきかの判定も可能となる。
（３）処理性能が必要な顔認識・比較処理を本店側等で集中的に処理することにより支店側の顔認識に関する処理が不要となりシステム全体のコストを下げることができる。
（４）また顧客が複数支店を利用した場合も対応が可能となる。 <Effect>
(1) By comparing the usage status of the window with the content viewing status, it is possible to extract which service / product other than the usage window (service / product) is interested.
(2) Further, by associating with the customer ID, it is possible to determine which service should be recommended for each individual customer.
(3) When face recognition / comparison processing requiring processing performance is centrally processed at the head office or the like, processing related to face recognition at the branch side becomes unnecessary, and the cost of the entire system can be reduced.
(4) It is also possible to handle cases where a customer uses multiple branches.
　以上、本発明者によってなされた発明を実施形態に基づき具体的に説明したが、本発明は、上記実施形態に限定されるものではなく、種々変更可能であることはいうまでもない。 As mentioned above, although the invention made by the present inventor has been specifically described based on the embodiments, it is needless to say that the present invention is not limited to the above-described embodiments and can be variously changed.
１Ａ、１Ｂ・・・情報システム
１０・・・情報表示装置
１１・・・情報装置
１００・・・情報表示処理装置
１０１・・・カメラ
１０２・・・表示部
１０３・・・記憶部
１０４・・・循環表示制御部
１０５・・・顔検出部
１０６・・・記憶部
１０７・・・顔検出データ送信部
１１０・・・情報取得処理装置
１１１・・・カメラ
１１２・・・窓口業務端末
１１５・・・顔検出部
１１６・・・記憶部
１１７・・・顔検出データ送信部
２００・・・顧客情報比較装置（サーバ装置） 1A, 1B ... Information system 10 ... Information display device 11 ... Information device 100 ... Information display processing device 101 ... Camera 102 ... Display unit 103 ... Storage unit 104 ... Circulation display control unit 105 ... face detection unit 106 ... storage unit 107 ... face detection data transmission unit 110 ... information acquisition processing device 111 ... camera 112 ... counter service terminal 115 ... Face detection unit 116 ... storage unit 117 ... face detection data transmission unit 200 ... customer information comparison device (server device)

Claims (4)

  1. 　待合場所に設置され画面上に所定のコンテンツを表示する表示部と、複数のコンテンツおよびコンテンツ属性を記憶する記憶部と、前記コンテンツを順番に表示させる制御部と、前記表示部に取り付けられたカメラ部と、コンテンツ切替えタイミングと連動して前記カメラ部からの画像を記憶する記憶部と、記憶した画像を送信する送信部と、を備える情報表示装置と、
    　サービス窓口に取り付けられるカメラ部と、前記カメラ部からの画像を記憶する記憶部と、記憶した画像を送信する送信部と、を備える情報装置と、
    　前記情報表示装置の前記送信部および前記情報装置の前記送信部から送信される画像を受信・顔認識処理を実施するサーバ装置と、
    を備える情報システム。     A display unit that is installed at a waiting place and displays predetermined content on a screen, a storage unit that stores a plurality of content and content attributes, a control unit that displays the content in order, and a camera attached to the display unit An information display device comprising: a storage unit that stores an image from the camera unit in conjunction with a content switching timing; and a transmission unit that transmits the stored image;
    An information device comprising: a camera unit attached to a service window; a storage unit that stores an image from the camera unit; and a transmission unit that transmits the stored image;
    A server device that receives and recognizes an image transmitted from the transmission unit of the information display device and the transmission unit of the information device;
    An information system comprising:
  2. 　請求項１において、
    　前記サーバ装置は、前記情報表示装置にて各コンテンツ毎に記憶される画像および前記情報装置にて記録される画像に対して顔認識処理を実施し、双方の顔認識データを比較して窓口利用顧客がその窓口の扱い商品・サービス以外の視聴コンテンツデータから新たに顧客の興味のありそうなコンテンツを抽出する情報システム。     In claim 1,
    The server device performs face recognition processing on the image stored for each content in the information display device and the image recorded by the information device, compares both face recognition data, and uses the window An information system that enables customers to extract content that is likely to be of interest to customers from viewing content data other than the products and services handled at the window.
  3. 　請求項２において、
    　前記サーバ装置は、窓口の顔認識データと顧客情報を関連付けることにより顧客に新たに案内する商品・サービスを選定する情報システム。     In claim 2,
    The server device is an information system for selecting a product / service to be newly guided to a customer by associating the face recognition data of the window with the customer information.
  4. 　請求項３において、
    　前記サーバ装置は本部に配置され、
    　前記情報表示装置および前記情報装置は支店に配置され、
    　前記サーバ装置はネットワークによって前記情報表示装置および情報装置と接続される情報システム。     In claim 3,
    The server device is located in the headquarters,
    The information display device and the information device are arranged in a branch,
    The server device is an information system connected to the information display device and the information device via a network.
PCT/JP2015/054986 2015-02-23 2015-02-23 Information system WO2016135816A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2017501568A JPWO2016135816A1 (en) 2015-02-23 2015-02-23 Information system
PCT/JP2015/054986 WO2016135816A1 (en) 2015-02-23 2015-02-23 Information system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2015/054986 WO2016135816A1 (en) 2015-02-23 2015-02-23 Information system

Publications (1)

Publication Number Publication Date
WO2016135816A1 true WO2016135816A1 (en) 2016-09-01

Family

ID=56787974

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2015/054986 WO2016135816A1 (en) 2015-02-23 2015-02-23 Information system

Country Status (2)

Country Link
JP (1) JPWO2016135816A1 (en)
WO (1) WO2016135816A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108681940A (en) * 2018-05-09 2018-10-19 连云港伍江数码科技有限公司 Man-machine interaction method, device, article-storage device and storage medium in article-storage device
CN110135906A (en) * 2019-05-14 2019-08-16 赵东 It is a kind of being capable of shopping guide and the intelligent sales counter that precisely pushes

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010053194A1 (en) * 2008-11-10 2010-05-14 日本電気株式会社 Customer behavior recording device, customer behavior recording method, and recording medium
WO2012161349A1 (en) * 2011-05-24 2012-11-29 九州日本電気ソフトウェア株式会社 Information processing device and control method therefor, control program, information processing system, and information processing method

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010053194A1 (en) * 2008-11-10 2010-05-14 日本電気株式会社 Customer behavior recording device, customer behavior recording method, and recording medium
WO2012161349A1 (en) * 2011-05-24 2012-11-29 九州日本電気ソフトウェア株式会社 Information processing device and control method therefor, control program, information processing system, and information processing method

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108681940A (en) * 2018-05-09 2018-10-19 连云港伍江数码科技有限公司 Man-machine interaction method, device, article-storage device and storage medium in article-storage device
CN110135906A (en) * 2019-05-14 2019-08-16 赵东 It is a kind of being capable of shopping guide and the intelligent sales counter that precisely pushes

Also Published As

Publication number Publication date
JPWO2016135816A1 (en) 2017-11-16

Similar Documents

Publication Publication Date Title
JP5866559B2 (en) Computer system and method for managing in-store aisles
JP5958723B2 (en) System and method for queue management
US10235574B2 (en) Image-capturing device, recording device, and video output control device
EP3076351A1 (en) Product monitoring device, product monitoring system, and product monitoring method
US10147230B2 (en) Dynamic video visualization
JP5246752B2 (en) Advertisement management system, advertisement management apparatus, advertisement management method, and program
WO2016174804A1 (en) Product monitoring device, product monitoring system, and product monitoring method
US20180268440A1 (en) Dynamically generating and delivering sequences of personalized multimedia content
JP2008112401A (en) Advertisement effect measurement apparatus
US10798425B1 (en) Personalized key object identification in a live video stream
US20160350332A1 (en) Individualized on-demand image information acquisition
JP2016071414A (en) Information presentation program and information processing apparatus
WO2016135816A1 (en) Information system
JP6586706B2 (en) Image analysis apparatus, image analysis method, and program
US10979472B2 (en) Dynamically altering presentations to maintain or increase viewer attention
JP6112156B2 (en) Behavior analysis apparatus and behavior analysis program
US20190303678A1 (en) Information processing apparatus, image display method, and non-transitory computer-readable storage medium
US20160098785A1 (en) User equipment, control method thereof and non-transitory computer readable storage medium having computer program recorded thereon
CN105915968A (en) Method, device and system for inserting advertisement
US20180181940A1 (en) Pos terminal device, information processing device, information processing system, image recognition method, and image recognition program
US20180300802A1 (en) Facility imaging device, facility image collecting device, facility image storage device, facility image output control device, facility operation support device, user terminal device, and facility operation support method
US20140375827A1 (en) Systems and Methods for Video System Management
KR100794957B1 (en) Digital video recoder capable of searching a text
US20210182542A1 (en) Determining sentiments of customers and employees
JP2016024601A (en) Information processing apparatus, information processing system, information processing method, commodity recommendation method, and program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15883114

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2017501568

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15883114

Country of ref document: EP

Kind code of ref document: A1