201120768 六、發明說明： 【發明所屬之技術領威】 [0001]本發明涉及一種資訊控制裝置、方法及具有該資訊控制 裝置的資訊顯示系統。 【先前技術】 [0002]在商業宣傳高度發達的今天，多媒體廣告播放系統得到 了廣泛的應用。很多人流量大的公共場所均設有多媒體 廣告播放系統，例如大樓電梯入口、公共汽車站及地鐵 月臺等。該等多媒體廣告播放系統雖可為商家帶來一定 〇 的宣傳效果，然，其均不夠“智慧”’即不能即時根據 觀看者的喜好更改所播放的廣告的内容。 * 【發明内容】 f ^ ^ ..................201120768 VI. Description of the Invention: [Technical Leadership of Invention] [0001] The present invention relates to an information control apparatus, method, and information display system having the information control apparatus. [Prior Art] [0002] In today's highly developed commercial propaganda, multimedia advertising playback systems have been widely used. Many public places with high traffic volume have multimedia advertisement broadcasting systems, such as building elevator entrances, bus stops and subway platforms. These multimedia advertisement playback systems can bring a certain amount of publicity to the merchants. However, they are not "smart". That is, the content of the advertisements to be played cannot be changed immediately according to the viewer's preferences. * [Summary of the content] f ^ ^ ..................
[〇〇〇3] 鑒於以上内容’有必要提供一種資訊控制裝置及方法， 该資汛控制裝置及方法能根據觀看者的喜好自動調整資 訊資料的類別，以為觀看者提供更有針對性的資訊。還 有必要提供一種包括前述資訊控制裝置的資訊顯示系統 〇 ... - ❹ 剛-種資訊控制裝置，用於選擇—監視器所顯示的圖像， 該資訊控制裝置包括：[〇〇〇3] In view of the above, it is necessary to provide an information control device and method, which can automatically adjust the category of information materials according to the viewer's preference, so as to provide viewers with more targeted information. . It is also necessary to provide an information display system including the aforementioned information control device, which is for selecting an image displayed by the monitor, the information control device comprising:
Luuuoj 監視器的觀看者㈣像，並ΓαΓΓ關捉的觀看該 到圖像中的臉部區域；，像進行臉㈣測’以得 [0006] 一立體模型建立模塊，用於對圖 體模型，以得•部立體圖像； 像中的臉部區域建立立 098141830 表單編號Α0101 第3頁/共2〇頁 0982071805-0 201120768 [0007] —區域判定模塊，用於根據臉部立體圖像判斷觀看者所 注視的監視裔的區域，以及 [0008] —控制模塊，用於根據得到的觀看者正在注視的監視器 的區域從複數圖像中選擇對應的圖像，並將其傳送至監 視器，該監視器用於顯示被選擇的圖像。 [0009] 一種資訊控制方法，用於選擇一監視器所顯示的圖像， 該資訊控制方法包括： [00101 接收由一攝像機所捕捉的觀看該監視器的觀看者的圖像 ，並對其進行臉部偵測，以得到圖像中的臉部區域； [0011] 對圖像中的臉部區域建立立體模型，以得到臉部立體圖 像； [0012] 根據臉部立體圖像判斷觀看者所注視的監視器的區域； 以及 [0013] 根據得到的監視器的區域從複數圖像中選擇對應的圖像 ，並將其傳送至監視器。 [0014] —種資訊顯示系統，包括一監視器、一攝像機及一資訊 控制裝置，該攝像機用於捕捉觀看該監視器的觀看者的 圖像，該資訊控制裝置用於接收由該攝像機所拍攝得到 的圖像，並對其進行處理以得到觀看者所注視的監視器 的區域，以根據得到的區域從存儲於存儲單元的複數圖 像中選擇對應的圖像，並將其傳送至監視器，該監視器 用於顯示被選擇的圖像。 [0015] 前述資訊控制裝置、方法及資訊顯示系統利用攝像機對 0982071805-0 098141830 表單編號A0101 第4頁/共20頁 201120768 [0016] Ο [0017] [0018] Ο [0019] 觀看者進行拍攝以得到觀看者的臉部的立體圖像，並對 該立體圖像進行分析以得知觀看者正在觀看的監視器的 區域，從而可對應調整所播放的内容，以為觀看者提供 更有用的資訊。 【實施方式】 請參閱圖1 ’本發明資訊顯示系統的第一較佳實施方式包 括一監視器、一攝像機12、一資訊控制裝置15 該資訊 顯示系統可自動調整所播放的廣告的内容，以為觀看者 提供更具針對性的資訊。本實施方式中，該監視器為— 電子看板10。 該攝像機12裝設於該電子看板丨〇的上方，用於捕捉觀看 該電子看板10的觀看者的圖像。本實施方式中，該攝像 機12為一TOF (Time of Flight)攝像機，其可得到觀 看者身上各點與攝像機12之間的距離。 請一併參閱圖2，該資訊控制裝置15包括一臉部偵測模塊 W、—立體模,立模塊152 .、一區域判定模塊155、 一時間判定模塊156、-控制模塊157、—圖像存储模塊 158及一對應關係存儲模塊159。 該臉部_模塊15G用於接收由該攝像機12所拍攝得到的 圖像’並對其進行臉部_，以得到圖像中的臉部區域 〇 二體抵型建立模塊152用於對圖像中的臉部區域建立立 『型。由於該攝像機可得到觀看者身上各點與攝像 機12之間的輯，故所__像巾包含觀看者臉部各 098141830 表單編號A〇l〇i 第5頁/共20頁 0982071805-0 [0020] 201120768 點與攝像機12之間的距離資訊，從而可建立觀看者的臉 部立體模型。該立體模型建立模塊152還用於根據觀看者 臉部各點與攝像機12之間的距離資訊將圖像中除臉部以 外的圖像全部抹除，即得到無背景的觀看者臉部立體圖 像。 [0021] 該區域判定模塊1 5 5用於根據得到的臉部立體圖像判斷觀 看者此時的視線方向以及觀看者此時所處的位置，以得 知此時觀看者所觀看的電子看板10的區域。其中，透過 對觀看者的臉部立體圖像進行分析以得到觀看者此時的 視線方向屬於習知技術，在此不再贅述。 [0022] 另，由於TOF攝像機可得到觀看者身上各點與攝像機12之 間的距離，故可得知此時觀看者所處的位置，即觀看者 與電子看板10的垂直距離及與電子看板10的中心點之間 的水準距離。假設以電子看板10的中心點為座標原點， 那麼根據觀看者此時的視線方向以及觀看者與電子看板 10的距離即可得知觀看者此時正在觀看電子看板10上的 區域的座標範圍。 [0023] 該時間判定模塊1 56用於統計觀看者注視電子看板1 0上每 一區域的持續時間。本實施方式中，該時間判定模塊156 可在區域判定模塊155判斷觀看者注視電子看板10上某一 座標範圍時即開始計時、而當區域判定模塊155判斷觀看 者注視電子看板10上另一座標範圍時即停止計時，如此 即可得到觀看者注視電子看板10上該座標範圍所持續的 時間，即注視電子看板10上該區域所持續的時間。 098141830 表單編號A0101 第6頁/共20頁 201120768 [0024]該圖像存儲模塊158用於存儲複數圖像，該等圖像均為廣 告影片或圖片且對應不同的產品。 剛_應關·儲模塊159料存儲複數對應關係，該等對 應關係為觀看者觀看電子看板㈣區域與複數圖像之間 的對應關係。比如當觀看者觀看電子看板1〇的第一區域 時對應-第-產品的廣告影片或圖像；當觀看者觀看電 子看板10的第二區域時對應—第二產品的廣告影片或圖 像。 Ο [_冑控制模塊157用於根據由時間判定模塊156所得到的持 _時間判定觀，者是否對正在觀看的區域產生興趣，比 ' 如可設定當持續時間超過某—預設時間時即表示觀看者 對正在觀看的’產生㈣。當狀觀看者對正在觀看 的區域產生興趣之後，該控制模塊157還用於根據由區域 判定模塊155所得到的觀看區域以及存儲於該對應關係存 _塊159的對應_選擇對應的圓像，並將其傳送至電 子看板10。該電子看板10則用於播放被選擇的圖像。 〇 [㈤27]下面將以一實例對前述工作原理進行說明。 [0028] 請參閱圖3，假設此時電子看板1G顯示的圖像包括兩種飲 料產品，其中位於第—區域（即電子看板10的左侧區域 )的飲料產品記為產品1{)〇、第二區域（即電子看板1〇的 右侧區域）的飲料產品記為產品11〇。該圖像存儲模塊 ⑽中存儲有產品100的廣告圖像以及產品11〇的廣主圖 像。該對應關係存儲模塊159中存儲的對應關係為° “第 一區域”對應“產品110的廣告圖像，，、“第二區域”對 098141830 表單編號Α0101 第7頁/共20頁 0982071805-0 201120768 應“產品100的廣告圖像”。 [0029] 該攝像機12拍攝位於該電子看板10前的觀看者20的圖像 ，並將其傳送給該臉部偵測單元150。該圖像經過臉部偵 測模塊150、立體模型建立模塊152、區域判定模塊155 以及時間判定模塊156處理之後得知觀看者正在觀看第二 區域且該觀看該第二區域的持續時間已超過預設時間。 [0030] 該控制模塊157則根據該被觀看的區域以及存儲於該對應 關係存儲模塊159的對應關係選擇產品110的廣告圖像， 並將其傳送至電子看板10進行播放。 [0031] 請一併參閱圖4，在其他實施方式中，該資訊顯示系統還 包括一網路單元18。該攝像機12所拍攝的圖像透過網路 單元18傳送至資訊控制系統15進行處理。當控制模塊157 選擇對應的廣告圖像之後再透過網路單元18傳送至電子 看板10進行播放。 [0032] 請參閱圖5，本發明資訊控制方法的較佳實施方式包括以 下步驟： [0033] 步驟S1 :該攝像機12捕捉觀看該電子看板10的觀看者的 圖像。 [0034] 步驟S2 :該臉部偵測模塊150接收由該攝像機12所拍攝得 到的圖像，並對其進行臉部偵測，以得到圖像中的臉部 區域。 [0035] 步驟S3 :該立體模型建立模塊152對圖像中的臉部區域建 立立體模型，並將圖像中除臉部以外的圖像全部抹除， 098141830 表單編號A0101 第8頁/共20頁Luuuoj monitor viewer (four) image, and ΓαΓΓ catch the viewing of the face area in the image; like the face (four) test '[0006] a three-dimensional model building module for the stereo model, The image of the face is established in the image; the face area in the image is established 098141830. Form number Α 0101 Page 3 / Total 2 page 0982071805-0 201120768 [0007] - Area determination module for judging viewing according to the facial stereo image The area of the surveillance target that the person is watching, and [0008] a control module for selecting a corresponding image from the plurality of images based on the obtained area of the monitor that the viewer is looking at, and transmitting the same to the monitor, This monitor is used to display the selected image. [0009] An information control method for selecting an image displayed by a monitor, the information control method comprising: [00101 receiving an image captured by a camera and viewing a viewer of the monitor, and performing the same Face detection to obtain a face region in an image; [0011] establishing a stereoscopic model for a face region in an image to obtain a facial stereoscopic image; [0012] determining a viewer based on the facial stereoscopic image The area of the monitor that is watching; and [0013] selecting a corresponding image from the plurality of images based on the obtained area of the monitor and transmitting it to the monitor. [0014] An information display system comprising a monitor, a camera and an information control device for capturing an image of a viewer viewing the monitor, the information control device for receiving a photo taken by the camera Obtaining an image and processing it to obtain an area of the monitor that the viewer is looking at, to select a corresponding image from the plurality of images stored in the storage unit according to the obtained area, and transmit the same to the monitor This monitor is used to display the selected image. [0015] The foregoing information control device, method and information display system utilize camera pair 0982071805-0 098141830 Form No. A0101 Page 4 / Total 20 Page 201120768 [0017] [0018] [0019] The viewer takes a picture to shoot A stereoscopic image of the viewer's face is obtained, and the stereoscopic image is analyzed to know the area of the monitor that the viewer is viewing, so that the played content can be adjusted correspondingly to provide the viewer with more useful information. [Embodiment] Please refer to FIG. 1. The first preferred embodiment of the information display system of the present invention includes a monitor, a camera 12, and an information control device. The information display system can automatically adjust the content of the displayed advertisement. Viewers provide more targeted information. In the present embodiment, the monitor is an electronic signage 10. The camera 12 is mounted above the electronic billboard , for capturing an image of a viewer viewing the electronic kanban 10. In the present embodiment, the camera 12 is a TOF (Time of Flight) camera that obtains the distance between each point on the viewer and the camera 12. Referring to FIG. 2 together, the information control device 15 includes a face detection module W, a stereo module, a vertical module 152, an area determination module 155, a time determination module 156, a control module 157, and an image. The storage module 158 and a corresponding relationship storage module 159. The face_module 15G is configured to receive an image captured by the camera 12 and perform a face _ on it to obtain a face region in the image. The face area in the middle is established. Since the camera can obtain the series between the points on the viewer and the camera 12, the __ towel contains the viewer's face 098141830. The form number A〇l〇i page 5 / total 20 pages 0982071805-0 [0020 ] 201120768 The distance information between the point and the camera 12, so that the viewer's face stereo model can be established. The stereo model establishing module 152 is further configured to erase all images except the face in the image according to the distance information between the points of the viewer's face and the camera 12, thereby obtaining a stereoscopic view of the viewer's face without the background. image. [0021] The area determining module 155 is configured to determine, according to the obtained facial stereoscopic image, the direction of the line of sight of the viewer at this time and the position of the viewer at this time, to know the electronic board viewed by the viewer at this time. 10 areas. It is a prior art to analyze the stereoscopic image of the viewer's face to obtain the viewer's line of sight at this time, and details are not described herein. [0022] In addition, since the TOF camera can obtain the distance between each point on the viewer and the camera 12, the position of the viewer at this time, that is, the vertical distance between the viewer and the electronic board 10 and the electronic board can be known. The level of distance between the center points of 10. Assuming that the center point of the electronic kanban 10 is the coordinate origin, the coordinate range of the area where the viewer is viewing the electronic kanban 10 at this time can be known according to the direction of the line of sight of the viewer at this time and the distance between the viewer and the electronic kanban 10. . [0023] The time determination module 156 is configured to count the duration that the viewer is looking at each of the areas on the electronic billboard 10. In this embodiment, the time determination module 156 may start timing when the area determination module 155 determines that the viewer looks at a certain coordinate range on the electronic board 10, and when the area determination module 155 determines that the viewer looks at another coordinate on the electronic board 10 The time is stopped when the range is reached, so that the time that the viewer looks at the range of the coordinates on the electronic board 10, that is, the time during which the area on the electronic board 10 is gazing, is obtained. 098141830 Form No. A0101 Page 6 of 20 201120768 [0024] The image storage module 158 is used to store a plurality of images, which are all advertisement films or pictures and correspond to different products. The just-closed storage module 159 stores a complex correspondence, which is a correspondence between the viewer's viewing of the electronic signboard (4) area and the complex image. For example, when the viewer views the first area of the electronic signboard 1 corresponding to the advertisement film or image of the -product, when the viewer views the second area of the electronic billboard 10, the corresponding advertisement film or image of the second product. Ο [_胄 control module 157 is configured to determine whether the user is interested in the area being viewed according to the hold time judgment obtained by the time determination module 156, such as when the duration may exceed a certain time - the preset time Indicates that the viewer is generating (four) for the watch being viewed. After the viewer is interested in the area being viewed, the control module 157 is further configured to select a corresponding round image according to the viewing area obtained by the area determining module 155 and the corresponding__ stored in the corresponding relation_block 159. And transfer it to the electronic signboard 10. The electronic signage 10 is then used to play the selected image. 〇 [(5) 27] The foregoing working principle will be described with an example. [0028] Referring to FIG. 3, assume that the image displayed by the electronic signboard 1G at this time includes two kinds of beverage products, wherein the beverage product located in the first region (ie, the left region of the electronic billboard 10) is recorded as the product 1{)〇, The beverage product of the second region (ie, the right region of the electronic billboard 1〇) is referred to as the product 11〇. The image storage module (10) stores an advertisement image of the product 100 and a wide-master image of the product 11〇. The correspondence stored in the correspondence storage module 159 is ° "first region" corresponds to "advertisement image of product 110,", "second region" pair 098141830, form number Α 0101, page 7 / total 20 pages 09820781805-0 201120768 It should be "an advertisement image of the product 100." [0029] The camera 12 captures an image of the viewer 20 located in front of the electronic billboard 10 and transmits it to the face detection unit 150. The image passes through the face After the detection module 150, the stereo model creation module 152, the region determination module 155, and the time determination module 156 process, it is known that the viewer is viewing the second region and the duration of viewing the second region has exceeded a preset time. [0030] The control module 157 selects an advertisement image of the product 110 according to the viewed area and the corresponding relationship stored in the correspondence storage module 159, and transmits the advertisement image to the electronic board 10 for playback. [0031] Please refer to the figure together. 4. In other embodiments, the information display system further includes a network unit 18. The image captured by the camera 12 is transmitted to the information control system 15 via the network unit 18. After the control module 157 selects the corresponding advertisement image, it transmits it to the electronic board 10 through the network unit 18 for playing. [0032] Referring to FIG. 5, a preferred embodiment of the information control method of the present invention includes the following steps: [0033] Step S1: The camera 12 captures an image of a viewer viewing the electronic signboard 10. [0034] Step S2: The face detection module 150 receives an image captured by the camera 12 and Performing face detection to obtain a face region in the image. [0035] Step S3: The stereo model creation module 152 establishes a stereo model for the face region in the image, and removes the image from the face other than the face. Image erased completely, 098141830 Form No. A0101 Page 8 of 20
0982C 201120768 [0036] [0037] [0038] Ο [0039] ❹ [0040] 098141830 以得到無背景的臉部立體圖像。 步驟S4 :該區域判定模塊155根據得到的臉部立體圖像判 斷觀看者此時的視線方向以及與電子看板10之間的距離 ’從而得到此時觀看者所觀看的電子看板10的區域。 步驟S5 :該時間判定模塊156統計觀看者注視電子看板10 每一區域的持續時間。 步驟S6 :該控制模塊157根據由時間判定模塊156所得到 的持續時間判定觀看者是否對正在觀看的區域產生興趣 。若觀看者觀看電子看板10上某一區域所持續的時間超 過預設時間’則判定觀看者對正在觀看的區域產生興趣 ’並執行步驟S7。若觀看者觀看電子看板1〇上某一區域 所持續的時間未超過預設時間，則表示觀看者對正在觀 看的區域不感興趣，並返回至步驟S1 〇 步驟S7 :該控制模塊157根據由區域判定模塊155所得到 Ο’’ ’ * . 的區域以及存儲於該對應關係存儲模塊丨59的對應關係選 擇對應的圖像’教將其傳送至電子看板1〇。該電子看板 10則用於播放被選擇的圖像。 前述資訊控制系統及方法利用TOF攝像機對觀看者進行拍 攝以付到觀看者的臉部的立體圖像，並對該立體圖像進 行分析以得知觀看者正在觀看電子看板1〇的哪個區域， 從而可對應調整電子看板10所播放的廣告内容，以為觀 看者提供更有用的廣告資訊。 綜上所述，本發明符合發明專利要件，爰依法提出專利 申請。惟，以上所述者僅為本發明之較佳實施例，舉凡 表單編號Α0101 第9頁/共20頁 0982071805-0 [0041] 201120768 熟悉本案技藝之人士，在爰依本發明精神所作之等效修 飾或變化，皆應涵蓋於以下之申請專利範圍内。 【圖式簡單說明】 [0042] 圖1為本發明資訊顯示系統的較佳實施方式的示意圖。 [0043] 圖2為圖1中資訊控制裝置的示意圖。 [0044] 圖3為圖1中觀看者觀看監視器的示意圖。 [0045] 圖4為本發明資訊顯示系統的另一較佳實施方式的示意圖 〇 [0046] 圖5為本發明資訊控制方法的較佳實施方式的流程圖。 【主要元件符號說明】 [0047] 電子看板：10 [0048] 攝像機：12 [0049] 資訊控制裝置：15 [0050] 臉部偵測模塊：150 [0051] 立體模型建立模塊： 152 [0052] 區域判定模塊：155 [0053] 時間判定模塊：156 [0054] 控制模塊：157 [0055] 圖像存儲模塊：158 [0056] 對應關係存儲模塊： 159 [0057] 產品：100、110 098141830 表單編號 A0101 第 10 頁/共 20 頁 0982071805-0 201120768 [0058] 觀看者：20 [0059] 網路單元：18 ❹ 098141830 表單編號A0101 第11頁/共20頁 0982071805-00982C 201120768 [0037] [0038] 098 [0040] 00 141 830 to obtain a faceless stereoscopic image without background. Step S4: The area determining module 155 judges the line of sight direction of the viewer at this time and the distance ′ with the electronic board 10 based on the obtained face stereo image to obtain the area of the electronic board 10 viewed by the viewer at this time. Step S5: The time determination module 156 counts the duration that the viewer looks at each area of the electronic signboard 10. Step S6: The control module 157 determines whether the viewer is interested in the area being viewed based on the duration obtained by the time determination module 156. If the viewer watches an area on the electronic board 10 for a time exceeding the preset time ', it is determined that the viewer is interested in the area being viewed' and step S7 is performed. If the viewer continues to watch an area on the electronic board for a period of time that does not exceed the preset time, it means that the viewer is not interested in the area being viewed, and returns to step S1, step S7: the control module 157 is based on the area The image obtained by the determination module 155 and the image corresponding to the correspondence relationship stored in the correspondence storage module 丨59 are transmitted to the electronic board. The electronic billboard 10 is used to play the selected image. The foregoing information control system and method utilizes a TOF camera to photograph a viewer to pay a stereoscopic image of a viewer's face, and analyze the stereoscopic image to know which region of the electronic billboard the viewer is viewing. Therefore, the advertisement content played by the electronic billboard 10 can be adjusted correspondingly to provide more useful advertisement information for the viewer. In summary, the present invention complies with the requirements of the invention patent and submits a patent application according to law. However, the above description is only a preferred embodiment of the present invention, and the form number Α0101, page 9 / total 20 pages 0982071805-0 [0041] 201120768 is familiar with the skill of the present invention, and is equivalent in the spirit of the present invention. Modifications or variations are intended to be included within the scope of the claims below. BRIEF DESCRIPTION OF THE DRAWINGS [0042] FIG. 1 is a schematic diagram of a preferred embodiment of an information display system of the present invention. 2 is a schematic diagram of the information control device of FIG. 1. 3 is a schematic diagram of the viewer viewing the monitor of FIG. 1. 4 is a schematic diagram of another preferred embodiment of the information display system of the present invention. [0046] FIG. 5 is a flow chart of a preferred embodiment of the information control method of the present invention. [Main component symbol description] [0047] Electronic Kanban: 10 [0048] Camera: 12 [0049] Information Control Device: 15 [0050] Face Detection Module: 150 [0051] Stereo Model Creation Module: 152 [0052] Region Decision Module: 155 [0053] Time Decision Module: 156 [0054] Control Module: 157 [0055] Image Storage Module: 158 [0056] Correspondence Storage Module: 159 [0057] Product: 100, 110 098141830 Form No. A0101 10 pages/total 20 pages 0982071805-0 201120768 [0058] Viewer: 20 [0059] Network unit: 18 ❹ 098141830 Form number A0101 Page 11 of 20 0982071805-0