TW201706963A - Content provision system, content provision device, and content provision method - Google Patents

Content provision system, content provision device, and content provision method Download PDF

Info

Publication number
TW201706963A
TW201706963A TW105113907A TW105113907A TW201706963A TW 201706963 A TW201706963 A TW 201706963A TW 105113907 A TW105113907 A TW 105113907A TW 105113907 A TW105113907 A TW 105113907A TW 201706963 A TW201706963 A TW 201706963A
Authority
TW
Taiwan
Prior art keywords
content
information
unit
dimensional image
dimensional
Prior art date
Application number
TW105113907A
Other languages
Chinese (zh)
Inventor
Masayuki Nakazato
Hei Cho
Yuji Sato
Original Assignee
Toppan Printing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Toppan Printing Co Ltd filed Critical Toppan Printing Co Ltd
Publication of TW201706963A publication Critical patent/TW201706963A/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Processing Or Creating Images (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

This content provision system comprises a content provision device. The content provision device includes: a storage unit that stores, in association with one another, pieces of object identification information and pieces of object content each being three-dimensional image content of an object specified by the object identification information; an object information reception unit that receives a piece of object identification information and arrangement position information from a terminal device; a compositing unit that creates three-dimensional image content for distribution that is composited such that a piece of object content corresponding to the received object identification information is arranged on background content, which is three-dimensional image content of a background, at a three-dimensional position obtained from the received arrangement position information; and a content transmission unit that transmits, to the terminal device, the three-dimensional image content for distribution created by the compositing unit.

Description

內容提供系統、內容提供裝置及內容提供方法 Content providing system, content providing device, and content providing method

本發明係有關一種內容提供系統、內容提供裝置及內容提供方法。 The present invention relates to a content providing system, a content providing apparatus, and a content providing method.

利用右眼用畫像和左眼用畫像的視差讓人看見3D(三維)內容之技術係廣為人知的公知技術。又有將附在(遊戲)卡或雜誌上的二維條碼以智慧手機等之終端讀入,下載有附帶條件的二維條碼之內容進行視聽的技術(例如,參照專利文獻1)。 A technique known in the art for using 3D (three-dimensional) content is used for the parallax of the image for the right eye and the image for the left eye. In addition, a two-dimensional bar code attached to a (game) card or magazine is read by a terminal such as a smart phone, and the content of the conditional two-dimensional bar code is downloaded for viewing (for example, refer to Patent Document 1).

[先前技術文獻] [Previous Technical Literature] [專利文獻] [Patent Literature]

[專利文獻1]日本特開2011-22798號公報 [Patent Document 1] Japanese Patent Laid-Open Publication No. 2011-22798

在消費者研討是否購入傢俱時,自家的房間佈置與傢俱的諧調成為決定購入的重要因子。且有不少消費者會研討是否將餐桌與椅子、沙發與咖啡桌等之複數種類的傢俱整套購入的情形。於是,認為若消費者若能將自家的房間佈置和正研討要購入的傢俱作組合並以 3D畫像觀看,則十分有助於決定是否購入傢俱。傢俱的販售業者若能提供消費者那樣的3D畫像,則預定進行購入的消費者可輕鬆選擇傢俱,且確認傢俱設置後的明確影像而研討進行購入,可促進購買。 When consumers discuss whether to purchase furniture, the harmony of their own room layout and furniture becomes an important factor in determining purchase. And many consumers will discuss whether to buy a full range of furniture such as dining tables and chairs, sofas and coffee tables. Therefore, if consumers can combine their own room layout and the furniture they are going to purchase, 3D portrait viewing is very helpful in deciding whether to buy furniture. If a furniture retailer can provide a 3D image like a consumer, the consumer who is scheduled to purchase can easily select the furniture, and confirm the purchase of the clear image after the furniture is set up, and the purchase can be promoted.

又,若能讓使用者所選擇的人物登上供複數個人物登場的3D畫像的卡片遊戲,則可依使用者所選提供具吸引力的內容。 In addition, if the character selected by the user can be placed on a card game for a 3D portrait of a plurality of personal appearances, the user can select an attractive content according to the user's choice.

本發明係考慮上述情事而完成者,提供一種可提供將使用者所選擇的物件的畫像合成後的三維畫像的內容之內容提供系統、內容提供裝置及內容提供方法。 The present invention has been made in consideration of the above circumstances, and provides a content providing system, a content providing apparatus, and a content providing method that can provide contents of a three-dimensional image obtained by combining portraits of objects selected by a user.

本發明第1態樣為一種內容提供系統,係具有終端裝置及將三維畫像內容提供給前述終端裝置的內容提供裝置之內容提供系統,其中前述終端裝置具備:傳送部,將特定物件的物件識別資訊和可取得配置前述物件的畫像之三維上的位置的配置位置資訊傳送到前述內容提供裝置;及顯示控制部,使和已傳送的前述物件識別資訊及前述配置位置資訊對應地從前述內容提供裝置接收到的三維畫像內容顯示,前述內容提供裝置具備:記憶部,將前述物件識別資訊和依前述物件識別資訊所特定之是前述物件的三維畫像內容的物件內容(object contents)賦予對應地記憶;物件資訊接收部,從前述終端裝置接收前述物件識別資訊及前述配置位置資訊;合成部,係生成配信用的三維畫像內容,該配信用的三維畫像內容係以在是背景的三維畫像內容的背景內容上將 和已接收的前述物件識別資訊對應之前述物件內容配置在從已接收的前述配置位置資訊獲得之三維上的位置之方式作合成;及內容傳送部,將藉由前述合成部生成之配信用的前述三維畫像內容傳送到前述終端裝置。 According to a first aspect of the present invention, a content providing system includes a terminal device and a content providing system that provides a three-dimensional image content to a content providing device of the terminal device, wherein the terminal device includes a transfer unit that recognizes an object of a specific object. Information and arrangement position information for obtaining a position in a three-dimensional position of the portrait of the object to be transferred to the content providing device; and a display control unit for providing the content from the content corresponding to the transmitted object identification information and the configuration position information The content providing device receives the three-dimensional image content received by the device, and the content providing device includes a storage unit that stores the object identification information and the object contents specified by the object identification information as the three-dimensional image content of the object. The object information receiving unit receives the object identification information and the arrangement position information from the terminal device, and the synthesis unit generates a three-dimensional image content of the credit, and the three-dimensional image content of the credit is based on the three-dimensional image content of the background. Background content Synthesizing the content of the object corresponding to the received object identification information in a three-dimensional position obtained from the received configuration position information; and the content transmission unit, the credit generated by the synthesizing unit The aforementioned three-dimensional portrait content is transmitted to the aforementioned terminal device.

本發明第2態樣一種內容提供裝置,具備:記憶部,將物件識別資訊和依前述物件識別資訊所特定之是物件的三維畫像內容的物件內容賦予對應地記憶;物件資訊接收部,從終端裝置接收前述物件識別資訊和可取得配置前述物件的畫像的三維上的位置之配置位置資訊;合成部,係生成配信用的三維畫像內容,該生成配信用的三維畫像內容係以在是背景的三維畫像內容的背景內容上將和已接收的前述物件識別資訊對應之前述物件內容配置在從已接收的前述配置位置資訊獲得之三維上的位置之方式作合成;及內容傳送部,將藉由前述合成部生成之配信用的前述三維畫像內容傳送到前述終端裝置。 According to a second aspect of the present invention, a content providing device includes: a memory unit that stores an object identification information and an object content specified by the object identification information as a three-dimensional image content of the object; the object information receiving unit, the slave terminal The device receives the object identification information and the arrangement position information of the position in the three-dimensional position of the image in which the object is arranged; the synthesizing unit generates the three-dimensional image content of the credit, and the three-dimensional image content of the generated credit is in the background. The background content of the three-dimensional portrait content is synthesized by arranging the content of the object corresponding to the received object identification information in a three-dimensional position obtained from the received configuration position information; and the content transmission unit is to be The three-dimensional image content of the credit generated by the synthesizing unit is transmitted to the terminal device.

本發明第3態樣係亦可如上述第2態樣的內容提供裝置,其中更具備修正指示接收部,該修正指示接收部從前述終端裝置接收指示前述物件的配置位置或方向的修正之修正指示,前述合成部,將配信用的前述三維畫像內容中配置前述物件內容之位置或方向,因應所接收之前述修正指示作修正。 According to a third aspect of the present invention, there is provided a content providing apparatus according to the second aspect, further comprising: a correction instruction receiving unit that receives a correction indicating a correction of an arrangement position or a direction of the object from the terminal device The combination unit instructs the position or direction in which the content of the object is placed in the three-dimensional image content of the credit, and corrects the received correction instruction.

本發明第4態樣係亦可如上述第2或第3態樣的內容提供裝置,其中前述記憶部係和前述物件識別資訊賦予對應,進一步記憶表示前述物件的屬性之屬性資 訊,前述合成部係將從前述配置位置資訊獲得之三維上的位置,因應於和已接收的前述物件識別資訊對應之前述屬性資訊作修正,在前述背景內容上生成將前述物件內容配置於已修正的位置之方式所合成的配信用的前述三維畫像內容。 According to a fourth aspect of the present invention, in the second aspect or the third aspect, the memory unit is associated with the object identification information, and the attribute of the attribute of the object is further memorized. The synthesizing unit generates a position in the three-dimensional position obtained from the configuration position information, and corrects the attribute information corresponding to the received object identification information, and generates the content of the object on the background content. The aforementioned three-dimensional image content of the credits synthesized by the corrected position.

本發明第5態樣係亦可如上述第4態樣的內容提供裝置,其中前述合成部,因應於和已接收的前述物件識別資訊對應之前述屬性資訊,修正配置在配信用的前述三維畫像內容之前述物件內容的方向。 The fifth aspect of the present invention is the content providing apparatus according to the fourth aspect, wherein the synthesizing unit corrects the three-dimensional portrait arranged in the credit according to the attribute information corresponding to the received object identification information. The direction of the content of the aforementioned object.

本發明第6態樣係亦可如上述第4或第5態樣的內容提供裝置,其中前述合成部,將和配信用的前述三維畫像內容的顯示相關之屬性,因應於和已接收的前述物件識別資訊對應之前述屬性資訊作修正。 According to a sixth aspect of the present invention, there is provided a content providing apparatus according to the fourth or fifth aspect, wherein the synthesizing unit determines an attribute relating to display of the three-dimensional portrait content of the credit, in response to the received The attribute information corresponding to the object identification information is corrected.

本發明第7態樣係亦可如上述第2至第6態樣中任一態樣的內容提供裝置,其中更具備視聽方向資訊接收部,該視聽方向資訊接收部從前述終端裝置,接收表示使用者的方向或使用者的方向及位置之視聽方向資訊,前述內容傳送部,係從配信用的前述三維畫像內容,抽出和前述視聽方向資訊所示之前述使用者的方向,或前述使用者的方向及位置對應之區域的三維畫像內容並傳送到前述終端裝置。 According to a seventh aspect of the present invention, there is provided a content providing apparatus according to any one of the second aspect to the sixth aspect, wherein the viewing direction information receiving unit further receives the indication from the terminal device. In the direction of the user, the direction of the user, and the viewing direction information of the user, the content transmitting unit extracts the direction of the user indicated by the viewing direction information from the three-dimensional image content of the credit, or the user The three-dimensional image content of the region corresponding to the direction and position is transmitted to the terminal device.

本發明第8態樣係亦可如上述第2至第7態樣中任一態樣的內容提供裝置,其中前述合成部係在已接收既定的物件識別資訊之組合的情況,對配信用的前述三維畫像內容進行因應於前述組合的加工。 The eighth aspect of the present invention is the content providing apparatus according to any one of the second aspect to the seventh aspect, wherein the synthesizing section is in the case of having received a combination of the predetermined object identification information. The aforementioned three-dimensional image content is processed in accordance with the aforementioned combination.

本發明第9態樣為一種內容提供方法,係內容提供裝置所執行的內容提供方法,具有:物件資訊接收步驟,物件資訊接收部從終端裝置接收特定物件的物件識別資訊和可取得配置前述物件的畫像的三維上的位置之配置位置資訊;合成步驟,合成部在是背景的三維畫像內容的背景內容上生成配信用的三維畫像內容,該配信用的三維畫像內容係以將依已接收的前述物件識別資訊所特定之是前述物件的三維畫像內容的物件內容配置在從已接收的前述配置位置資訊所獲得之三維上的位置之方式而合成;及內容傳送步驟,內容傳送部將藉由前述合成步驟生成之配信用的前述三維畫像內容傳送到前述終端裝置。 A ninth aspect of the present invention is a content providing method, which is a content providing method performed by a content providing apparatus, comprising: an object information receiving step, the object information receiving unit receives object identification information of a specific object from the terminal device, and can obtain the configured object The arrangement position information of the position on the three-dimensional image; the synthesis step, the synthesis unit generates the three-dimensional image content of the credit on the background content of the three-dimensional image content of the background, and the three-dimensional image content of the credit is received The object identification information is specified by the manner in which the object content of the three-dimensional portrait content of the object is disposed in a three-dimensional position obtained from the received configuration position information; and the content transfer step, the content transfer unit The aforementioned three-dimensional portrait content of the credit generated by the aforementioned synthesizing step is transmitted to the terminal device.

依據上述本發明的態樣,可提供將使用者所選擇的物件的畫像合成後的三維畫像的內容。 According to the aspect of the invention described above, it is possible to provide the content of the three-dimensional image obtained by combining the portraits of the objects selected by the user.

1‧‧‧內容提供裝置 1‧‧‧Content providing device

2‧‧‧HMD(頭戴式顯示器) 2‧‧‧HMD (Head Mounted Display)

3‧‧‧終端裝置 3‧‧‧ Terminal devices

5‧‧‧媒體 5‧‧‧Media

9‧‧‧網路 9‧‧‧Network

11‧‧‧記憶部 11‧‧‧Memory Department

12‧‧‧通訊部 12‧‧‧Communication Department

13‧‧‧處理部 13‧‧‧Processing Department

131‧‧‧視聽方向資訊接收部 131‧‧‧Visual Direction Information Reception Department

132‧‧‧物件資訊接收部 132‧‧‧Article Information Receiving Department

133‧‧‧合成部 133‧‧‧Combination Department

134‧‧‧內容傳送部 134‧‧‧Content Transfer Department

135‧‧‧修正指示接收部 135‧‧‧Revision Instructions Receiving Department

136‧‧‧刪除指示接收部 136‧‧‧Delete Instruction Receiver

31‧‧‧輸入部 31‧‧‧ Input Department

32‧‧‧處理部 32‧‧‧Processing Department

33‧‧‧檢測部 33‧‧‧Detection Department

34‧‧‧攝像部 34‧‧‧Photography Department

35‧‧‧通訊部 35‧‧‧Communication Department

36‧‧‧顯示部 36‧‧‧Display Department

321‧‧‧視聽方向資訊取得部 321‧‧‧Sightseeing Direction Information Acquisition Department

322‧‧‧物件識別取得部 322‧‧‧Article Identification Acquisition Department

323‧‧‧配置位置資訊取得部 323‧‧‧Configure Location Information Acquisition Department

324‧‧‧傳送部 324‧‧‧Transportation Department

325‧‧‧內容接收部 325‧‧‧Content Receiving Department

326‧‧‧顯示控制部 326‧‧‧Display Control Department

圖1係本發明一實施形態的內容提供系統的構成圖。 Fig. 1 is a configuration diagram of a content providing system according to an embodiment of the present invention.

圖2係本發明一實施形態的內容提供裝置的機能方塊圖。 Fig. 2 is a functional block diagram of a content providing apparatus according to an embodiment of the present invention.

圖3係本發明一實施形態的HMD(頭戴式顯示器)的外觀圖。 Fig. 3 is an external view of an HMD (Head Mounted Display) according to an embodiment of the present invention.

圖4係本發明一實施形態的終端裝置的機能方塊圖。 Fig. 4 is a block diagram showing the function of a terminal device according to an embodiment of the present invention.

圖5係顯示本發明一實施形態的物件內容管理資訊之圖。 Fig. 5 is a view showing information management information of an object according to an embodiment of the present invention.

圖6係本發明一實施形態的終端裝置中之內容要求處理的流程圖。 Fig. 6 is a flow chart showing the content request processing in the terminal device according to the embodiment of the present invention.

圖7係本發明一實施形態的內容提供裝置中之內容提供處理的流程圖。 Fig. 7 is a flow chart showing the content providing process in the content providing apparatus according to the embodiment of the present invention.

圖8係顯示使用者使用本發明一實施形態的HMD的狀況之圖。 Fig. 8 is a view showing a state in which a user uses an HMD according to an embodiment of the present invention.

圖9係顯示本發明一實施形態的物件內容管理資訊的設定例之圖。 Fig. 9 is a view showing an example of setting of object content management information according to an embodiment of the present invention.

圖10係顯示本發明一實施形態的配信用三維畫像內容的生成例之圖。 Fig. 10 is a view showing an example of generation of a three-dimensional portrait content of a credit according to an embodiment of the present invention.

圖11係顯示本發明一實施形態的配信用三維畫像內容的例子之圖。 Fig. 11 is a view showing an example of the contents of the three-dimensional image of the credit according to the embodiment of the present invention.

圖12係顯示本發明一實施形態的物件內容管理資訊的設定例之圖。 Fig. 12 is a view showing an example of setting of object content management information according to an embodiment of the present invention.

圖13係顯示本發明一實施形態的終端裝置所顯示的三維畫像內容的例子之圖。 Fig. 13 is a view showing an example of the contents of the three-dimensional image displayed by the terminal device according to the embodiment of the present invention.

以下,一邊參照圖面一邊詳細說明本發明的實施形態。 Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

圖1係本發明一實施形態的內容提供系統的構成圖。如同圖所示,內容提供系統具備:內容提供裝置1;頭戴式顯示器(以下,記載為「HMD」。)2;及媒體5。同圖中,HMD2、及媒體5分別只顯示1個,但事實上存在複數個。又,內容提供裝置1亦可具備複數台。 Fig. 1 is a configuration diagram of a content providing system according to an embodiment of the present invention. As shown in the figure, the content providing system includes a content providing device 1, a head mounted display (hereinafter referred to as "HMD") 2, and a medium 5. In the same figure, only one HMD2 and one media 5 are displayed, but in fact there are a plurality of them. Further, the content providing device 1 may be provided with a plurality of devices.

內容提供裝置1係配信三維畫像內容。三維畫 像內容係為讓人以三維方式觀看動畫或靜止畫等之畫像的內容資料。本實施形態的三維畫像內容使右眼用畫像顯示於顯示畫面的右半部,使左眼用畫像顯示於左半部。 The content providing device 1 distributes the three-dimensional image content. Three-dimensional painting The content is a content material that allows people to view images such as animations or still pictures in three dimensions. In the three-dimensional image content of the present embodiment, the right-eye image is displayed on the right half of the display screen, and the left-eye image is displayed on the left half.

HMD2為視聽三維畫像內容所用的立體觀賞用器具的一例。頭戴式顯示器2係利用終端裝置3作為顯示裝置。此外,立體觀賞用器具除了HMD2以外,亦可為視聽被顯示於終端裝置3的三維畫像內容所用的眼鏡。 HMD2 is an example of a stereoscopic viewing device used for viewing a three-dimensional image content. The head mounted display 2 uses the terminal device 3 as a display device. Further, the stereoscopic viewing device may be a pair of glasses for viewing the three-dimensional image content of the terminal device 3 in addition to the HMD 2.

終端裝置3係例如為智慧手機、平板終端等之具有通訊機能的電腦終端,將從內容提供裝置1所配信之三維畫像內容顯示於顯示器。內容提供裝置1和終端裝置3透過網際網路等之網路9連接。 The terminal device 3 is, for example, a computer terminal having a communication function such as a smart phone or a tablet terminal, and displays the three-dimensional image content distributed from the content providing device 1 on the display. The content providing device 1 and the terminal device 3 are connected via a network 9 such as the Internet.

從媒體5可取得用以特定將畫像重疊(合成)於背景內容的物件之資訊即物件ID(物件識別資訊)。所謂背景內容係指成為背景之動畫或靜態畫的三維畫像內容。例如,背景為房間,物件為在房間設置的椅子、桌子、照明、窗簾、繪畫等。又,背景係遊戲或故事上演的場所,物件為在遊戲或故事登場的人物。物件係不僅是實際上作為物而顯示畫像之對象,亦可以是成為使與畫像的顯示相關的屬性變化之要因者。例如,太陽的物件係使畫像的亮度變明亮。 The object ID (object identification information) which is information for specifying an object in which the portrait is superimposed (synthesized) on the background content is obtained from the medium 5. The background content refers to the three-dimensional portrait content of the animation or static painting that becomes the background. For example, the background is a room, and the objects are chairs, tables, lighting, curtains, paintings, and the like provided in the room. Also, the background is a place where a game or a story is played, and the object is a character who appears in a game or a story. The object is not only an object that actually displays an image as an object, but also a factor that causes a change in the attribute related to the display of the image. For example, the object of the sun makes the brightness of the portrait brighter.

媒體5係為例如印刷有表示物件ID的文字列或畫像(例如,二維條碼等)的卡、標籤、貼紙、標識等。在媒體5方面,於使用卡等之情況,以使用者容易從媒體5認識哪個物件的物件ID之方式,使用印刷或書寫有物件的照片或畫、物件名稱、物件的說明等者為宜。又, 亦可將屬於媒體5的卡或標籤、貼紙、標識貼附於從媒體5可獲得之藉物件ID所特定之物件(例如,傢俱等)的實物上。又,媒體5亦可為記憶著物件ID的RFID(Radio Frequency Identification;無線射頻識別)。記憶著物件ID的RFID係例如被貼附於卡或實物的物件上。 The medium 5 is, for example, a card, a label, a sticker, a logo, or the like on which a character string or an image (for example, a two-dimensional barcode or the like) indicating an object ID is printed. In the case of the media 5, in the case of using a card or the like, it is preferable to use a photo or a picture of the object to be printed or written, an object name, and an object description so that the user can easily recognize the object ID of the object from the medium 5. also, It is also possible to attach a card or a label, a sticker, and a logo belonging to the medium 5 to the object of the object (for example, furniture, etc.) specified by the borrowing object ID available from the medium 5. Further, the medium 5 may be an RFID (Radio Frequency Identification) in which the object ID is stored. The RFID that memorizes the object ID is attached to, for example, a card or a physical object.

圖2係顯示內容提供裝置1的構成之機能方塊圖,僅抽出和本實施形態有關的機能方塊來表示。內容提供裝置1係透過1台或複數台的電腦伺服器來實現,具備有記憶部11、通訊部12及處理部13。 Fig. 2 is a functional block diagram showing the configuration of the content providing apparatus 1, and only the functional blocks related to the present embodiment are extracted. The content providing device 1 is realized by one or a plurality of computer servers, and includes a memory unit 11, a communication unit 12, and a processing unit 13.

記憶部11係記憶背景內容、或物件內容管理資訊等之各種資訊。物件內容管理資訊係使物件ID、物件內容、物件的屬性資訊賦予對應的資料。物件內容係物件的動畫或靜態畫的三維畫像內容。屬性資訊係表示會對和物件的配置位置相關的屬性、和畫像的顯示相關的屬性帶來什麼樣的影響(進行加工)之屬性。 The memory unit 11 stores various kinds of information such as background content or object content management information. The object content management information is such that the object ID, the object content, and the attribute information of the object are assigned to the corresponding materials. The object content is an animated or statically drawn three-dimensional portrait of the object. The attribute information indicates an attribute that affects the attributes related to the arrangement position of the object and the attributes related to the display of the image (processing).

通訊部12係透過網路9和其他裝置進行資料收發。 The communication unit 12 transmits and receives data via the network 9 and other devices.

處理部13具備:視聽方向資訊接收部131;物件資訊接收部132;合成部133;內容傳送部134;修正指示接收部135;及刪除指示接收部136。 The processing unit 13 includes a viewing direction information receiving unit 131, an object information receiving unit 132, a synthesizing unit 133, a content transmitting unit 134, a correction instructing receiving unit 135, and a deletion instructing receiving unit 136.

視聽方向資訊接收部131係從終端裝置3接收使用者的視聽方向,亦即表示使用者所面對的方向之視聽方向資訊。視聽方向資訊係可包含使用者的現在位置的資訊。現在位置可以是地理的絕對位置,亦可為以背景內容的畫像中之既定位置為基準的相對位置。 The viewing direction information receiving unit 131 receives the viewing direction of the user from the terminal device 3, that is, the viewing direction information indicating the direction the user is facing. The viewing direction information can include information about the user's current location. The current position may be the absolute position of the geographic location, or may be the relative position based on the predetermined position in the portrait of the background content.

物件資訊接收部132係從終端裝置3接收物件ID和表 示可取得配置物件的畫像的三維上的位置的資訊之配置位置資訊。可於配置位置資訊設定地理的絕對位置,亦可設定以背景內容的畫像中之既定位置為基準的相對位置或方向。 The article information receiving unit 132 receives the object ID and the table from the terminal device 3. The position information of the information of the position in the three-dimensional position of the portrait of the arranging object is displayed. The absolute position of the geographic location can be set by configuring the location information, and the relative position or direction based on the predetermined position in the portrait of the background content can also be set.

合成部133係以在背景內容將和已接收的物件ID對應之物件內容配置在已接收之配置位置資訊所取得之三維上的位置的方式作合成,生成係配信用的三維畫像內容的配信用三維畫像內容。此外,合成部133在配置位置資訊是表示地理的絕對位置之情況,將絕對位置變換成在背景內容的畫像中之位置。 The synthesizing unit 133 synthesizes the content of the object corresponding to the received object ID in the three-dimensional position obtained by the received placement position information, and generates the credit of the three-dimensional image content of the matching credit. 3D portrait content. Further, the synthesizing unit 133 converts the absolute position into a position in the image of the background content when the placement position information indicates the absolute position of the geographical position.

內容傳送部134從藉由合成部133所生成之配信用三維畫像內容,將基於視聽方向資訊所抽出的三維畫像內容傳送到終端裝置3。 The content transfer unit 134 transmits the three-dimensional image content extracted based on the viewing direction information to the terminal device 3 from the three-dimensional image content of the credit generated by the synthesizing unit 133.

修正指示接收部135係接收指示被重疊於配信用三維畫像內容的物件內容之配置位置或方向的修正之修正指示。合成部133係將配信用三維畫像內容中配置物件內容的位置或方向,按位置資訊修正指示作修正。 The correction instruction receiving unit 135 receives an instruction to correct the correction of the arrangement position or direction of the object content superimposed on the content of the three-dimensional image of the credit. The synthesizing unit 133 corrects the position or direction of the content of the object in the three-dimensional portrait content of the credit, and corrects the position information correction instruction.

刪除指示接收部136係接收指示被重疊於配信用三維畫像內容的物件內容的刪除之刪除指示。合成部133係將依刪除指示所指示刪除之三維畫像內容從配信用三維畫像內容刪除。 The deletion instruction receiving unit 136 receives a deletion instruction indicating deletion of the contents of the object superimposed on the three-dimensional portrait content of the credit. The synthesizing unit 133 deletes the three-dimensional portrait content deleted as indicated by the deletion instruction from the three-dimensional portrait content of the credit.

圖3係HMD2的外觀圖。同圖係表示利用智慧手機作為終端裝置3的情況之HMD2的例子。 Figure 3 is an external view of the HMD2. The same figure shows an example of the HMD 2 in the case where a smart phone is used as the terminal device 3.

HMD2所具備的右眼用透鏡21係用以觀看終端裝置3所顯示在顯示器右側之右眼用畫像的透鏡。HMD2所具備 的左眼用透鏡22係用以觀看終端裝置3所顯示在顯示器左側之左眼用畫像的透鏡。於HMD2安裝隔板23俾無法透過右眼用透鏡21看見左眼用畫像且無法透過左眼用透鏡22看見右眼用畫像。使用者係在終端裝置3的畫面所顯示的右眼用畫像與左眼用畫像的分隔附近以隔板23的與透鏡對向側的緣部重疊之方式設定終端裝置3。使用者透過右眼用透鏡21及左眼用透鏡22視聽終端裝置3所顯示的三維畫像內容。 The right-eye lens 21 included in the HMD 2 is a lens for viewing the right-eye image displayed on the right side of the display by the terminal device 3. HMD2 has The left-eye lens 22 is a lens for viewing an image for the left eye displayed on the left side of the display by the terminal device 3. When the partition plate 23 is mounted on the HMD 2, the image for the left eye cannot be seen through the right-eye lens 21, and the image for the right eye cannot be seen through the lens 22 for the left eye. The user sets the terminal device 3 so as to overlap the edge of the partition 23 on the opposite side of the lens in the vicinity of the partition between the right-eye image and the left-eye image displayed on the screen of the terminal device 3. The user views the three-dimensional portrait content displayed by the terminal device 3 through the right-eye lens 21 and the left-eye lens 22.

圖4係顯示終端裝置3的構成之機能方塊圖,僅抽出和本實施形態有關的機能方塊來表示。終端裝置3係例如為智慧手機,但亦可為平板終端、行動電話終端、可搬送的個人電腦等。終端裝置3具備:輸入部31;處理部32;檢測部33;攝像部34;通訊部35;及顯示部36。此外,在媒體5是RFID的情況,終端裝置3具備標籤閱讀機。 Fig. 4 is a functional block diagram showing the configuration of the terminal device 3, and only the functional blocks relating to the present embodiment are extracted. The terminal device 3 is, for example, a smart phone, but may be a tablet terminal, a mobile phone terminal, a portable personal computer, or the like. The terminal device 3 includes an input unit 31, a processing unit 32, a detecting unit 33, an imaging unit 34, a communication unit 35, and a display unit 36. Further, in the case where the medium 5 is an RFID, the terminal device 3 is provided with a tag reader.

輸入部31係接受依使用者操作的資訊輸入。處理部32具備:視聽方向資訊取得部321;物件識別取得部322;配置位置資訊取得部323;傳送部324;內容接收部325;及顯示控制部326。視聽方向資訊取得部321係取得視聽方向資訊。物件識別取得部322係取得被記錄在媒體5的物件ID。配置位置資訊取得部323係取得用以表示配置物件的畫像之三維上的位置的配置位置資訊。傳送部324將視聽方向資訊、物件ID、配置位置資訊等之各種資訊傳送到內容提供裝置1。又,傳送部324係依據藉由輸入部31所輸入之使用者操作,將修正指示或刪除指示 傳送到內容提供裝置1。內容接收部325從內容提供裝置1接收三維畫像內容。顯示控制部326係使三維畫像內容等之各種資料顯示於顯示部36。檢測部33係檢測方向的感測器。又,檢測部33亦可建構成含有可獲得現在位置的資訊之GPS(Global Positioning System)。攝像部34為相機。通訊部35係透過網路9進行資訊收發。顯示部36為顯示器,顯示資料。在終端裝置3是智慧手機的情況,顯示部36為觸控面板,輸入部31為配置在觸控面板的感測器。 The input unit 31 accepts information input by the user. The processing unit 32 includes a viewing direction information acquiring unit 321, an object recognition acquiring unit 322, a placement position information acquiring unit 323, a transmitting unit 324, a content receiving unit 325, and a display control unit 326. The viewing direction information obtaining unit 321 acquires the viewing direction information. The object recognition acquisition unit 322 acquires the object ID recorded on the medium 5. The arrangement position information acquisition unit 323 acquires arrangement position information indicating a position on the three-dimensional image of the arrangement object. The transmission unit 324 transmits various pieces of information such as the viewing direction information, the object ID, and the arrangement position information to the content providing device 1. Further, the transmitting unit 324 sets the correction instruction or the deletion instruction in accordance with the user operation input by the input unit 31. Transfer to the content providing device 1. The content receiving unit 325 receives the three-dimensional image content from the content providing device 1. The display control unit 326 displays various materials such as three-dimensional image content on the display unit 36. The detecting unit 33 is a sensor that detects the direction. Further, the detecting unit 33 may be configured to include a GPS (Global Positioning System) that can obtain information on the current position. The imaging unit 34 is a camera. The communication unit 35 transmits and receives information via the network 9. The display unit 36 is a display and displays materials. When the terminal device 3 is a smart phone, the display unit 36 is a touch panel, and the input unit 31 is a sensor disposed on the touch panel.

圖5係顯示物件內容管理資訊的資料構成例之圖。同圖所示的物件內容管理資訊係使物件ID、物件名稱、物件內容、及屬性資訊賦予對應之資訊。亦可和1個物件ID對應僅設定物件內容與屬性資訊任一者。屬性資訊係含有配置位置屬性與畫像加工屬性之資訊。配置位置屬性係表示和配置物件的位置相關之屬性。畫像加工屬性係表示會對和畫像的顯示相關的屬性帶來什麼樣的影響(進行加工)之屬性。在屬性資訊亦可僅設定配置位置屬性與畫像加工屬性其中一方。 Fig. 5 is a view showing an example of the data structure of the object content management information. The object content management information shown in the figure gives the corresponding information to the object ID, the object name, the object content, and the attribute information. It is also possible to set only one of the object content and the attribute information corresponding to one object ID. The attribute information contains information about the configuration location attribute and the image processing attribute. The configuration location attribute represents an attribute related to the location of the configuration object. The image processing attribute indicates the attribute that affects the attribute related to the display of the image (processing). In the attribute information, only one of the configuration position attribute and the image processing attribute can be set.

接著,針對內容提供系統的動作進行說明。 Next, the operation of the content providing system will be described.

圖6係終端裝置3中之內容要求處理的流程圖。 Fig. 6 is a flow chart showing the content request processing in the terminal device 3.

當使用者藉由終端裝置3的輸入部31輸入內容要求時,視聽方向資訊取得部321係取得視聽方向資訊(步驟S105)。例如,視聽方向資訊取得部321係從檢測部3取得方向或現在位置的資訊,並設為視聽方向資訊。此外,視聽方向資訊取得部321係亦可從設置於現在使用者所處建築物的牆壁或地板、使用者所在的場所的看板或像 等具備的通訊裝置藉由近距離通訊接收位置的資訊作為現在位置的資訊,俾取代從構成檢測部33的GPS取得現在位置的資訊。近距離通訊能使用WiFi(註冊商標)、Bluetooth(註冊商標)、可見光通訊、紅外線通訊、NFC(Near field communication;近場通訊)等。或,亦可藉由攝像部34拍攝用以表示描繪於被貼在設於現在使用者所處建築物的牆壁或地板、使用者所在的場所的看板或像等之海報或標識的位置的資訊之文字或畫像(二維條碼等)。視聽方向資訊取得部321係從已拍攝之畫像的資料取得位置的資訊,設為現在位置的資訊。傳送部324將視聽方向資訊取得部321所取得之視聽方向資訊傳送到內容提供裝置1(步驟S110)。 When the user inputs a content request by the input unit 31 of the terminal device 3, the viewing direction information obtaining unit 321 acquires the viewing direction information (step S105). For example, the viewing direction information obtaining unit 321 acquires information of the direction or the current position from the detecting unit 3, and sets the viewing direction information. Further, the viewing direction information obtaining unit 321 may also be a kanban or image provided on a wall or floor of a building where the user is currently located, or a place where the user is located. The communication device provided by the communication device receives the information of the current position as the information of the current position, and replaces the information of the current position from the GPS constituting the detecting unit 33. For short-range communication, WiFi (registered trademark), Bluetooth (registered trademark), visible light communication, infrared communication, NFC (Near field communication), etc. can be used. Alternatively, the imaging unit 34 may capture information indicating the position of the poster or logo drawn on the wall or floor of the building where the user is located, the kanban or image of the user's location. Text or portrait (2D barcode, etc.). The viewing direction information acquiring unit 321 acquires the information of the position from the data of the captured image, and sets the information of the current position. The transmission unit 324 transmits the viewing direction information acquired by the viewing direction information acquiring unit 321 to the content providing device 1 (step S110).

內容接收部325從內容提供裝置1接收三維畫像內容(步驟S115)。顯示控制部326係使所接收之三維畫像內容顯示於顯示部36(步驟S120)。 The content receiving unit 325 receives the three-dimensional image content from the content providing device 1 (step S115). The display control unit 326 causes the received three-dimensional image content to be displayed on the display unit 36 (step S120).

處理部32係在判斷未輸入物件ID的取得指示之情況(步驟S125:NO),進行後述步驟S145的處理。 The processing unit 32 determines that the acquisition instruction of the object ID is not input (step S125: NO), and performs the processing of step S145 described later.

一方面,處理部32係在判斷既經輸入部31輸入物件ID的取得指示之情況(步驟S125:YES),物件識別取得部322係取得被記錄在媒體5的物件ID(步驟S130)。例如,藉由攝像部34拍攝印刷在媒體5上之表示物件ID的文字或畫像。物件識別取得部322從所拍攝之畫像的資料取得物件ID。或,在媒體5是RFID的情況,物件識別取得部322係取得標籤閱讀機從媒體5讀出的物件ID。或,在媒體5是通訊設備的情況,物件識別取得部322藉由近距離 通訊接收從媒體5傳送之物件ID。 On the other hand, when the processing unit 32 determines that the instruction to acquire the object ID is input via the input unit 31 (step S125: YES), the object recognition acquisition unit 322 acquires the object ID recorded on the medium 5 (step S130). For example, the image capturing unit 34 captures a character or an image indicating the object ID printed on the medium 5. The object recognition acquisition unit 322 acquires the object ID from the data of the captured image. Alternatively, when the medium 5 is an RFID, the object recognition acquisition unit 322 acquires the object ID read by the tag reader from the medium 5. Or, in the case where the medium 5 is a communication device, the object recognition acquisition unit 322 is at a close distance The communication receives the object ID transmitted from the media 5.

接著,配置位置資訊取得部323係取得配置位置資訊(步驟S135)。例如,配置位置資訊取得部323係從構成檢測部33的GPS取得現在位置的資訊,設為配置位置資訊。或,亦可配置位置資訊取得部323將從檢測部33取得之使用者的方向之資訊設為配置位置資訊。在配置位置資訊是表示使用者的方向之情況,從背景內容(或配信用三維畫像內容)的在畫像中之三維上的既定位置向使用者的方向前進既定距離後的位置是成為配置位置。或,亦可配置位置資訊取得部323係從設置於現在使用者所處建築物的牆壁或地板、使用者所在的場所的看板或像等具備的通訊裝置藉由近距離通訊接收位置的資訊而設為配置位置資訊。或,藉由攝像部34拍攝用以表示描繪於被貼在設於現在使用者所處建築物的牆壁或地板、使用者所在的場所的看板或像等之海報或標識的位置的資訊之文字或畫像亦可。視聽方向資訊取得部321係從已拍攝之畫像的資料取得位置的資訊並設為配置位置資訊。傳送部324將物件識別取得部322所取得之物件ID及配置位置資訊取得部323所取得之配置位置資訊傳送到內容提供裝置1(步驟S140)。終端裝置3的處理部32係重複自步驟S115開始的處理。 Next, the placement location information acquisition unit 323 acquires the placement location information (step S135). For example, the arrangement position information acquisition unit 323 acquires information on the current position from the GPS constituting the detection unit 33, and sets the position information. Alternatively, the position information acquisition unit 323 may be configured to set the information of the direction of the user acquired from the detection unit 33 as the arrangement position information. When the placement position information indicates the direction of the user, the position from the background position (or the three-dimensional image content of the credit) to the predetermined position in the direction of the user in the three-dimensional position in the image is the arrangement position. Alternatively, the position information acquisition unit 323 may be configured to receive position information by short-distance communication from a communication device provided on a wall or floor of a building where the user is located, a kanban or an image of a place where the user is located. Set to configure location information. Alternatively, the image capturing unit 34 captures text indicating the position of the poster or logo that is attached to the wall or floor of the building where the user is located, the kanban or image of the user's location, or the like. Or portraits are also available. The viewing direction information acquiring unit 321 acquires the information of the position from the data of the captured image and sets the position information. The transfer unit 324 transmits the object ID acquired by the article identification acquisition unit 322 and the arrangement position information acquired by the arrangement position information acquisition unit 323 to the content providing device 1 (step S140). The processing unit 32 of the terminal device 3 repeats the processing from step S115.

處理部32於步驟S125判斷NO之後,傳送部324判斷是否已被輸入物件的位置或方向的修正指示(步驟S145)。傳送部324係在判斷未輸入物件的修正指示之情況(步驟S145:NO),進行後述步驟S155的處理。 After the processing unit 32 determines NO in step S125, the transmission unit 324 determines whether or not an instruction to correct the position or direction of the input object has been received (step S145). The transmission unit 324 determines that the correction instruction of the object has not been input (step S145: NO), and performs the processing of step S155 described later.

一方面,傳送部324係於判斷被輸入修正指示之情況(步驟S145:YES),將被輸入的修正指示傳送到內容提供裝置1(步驟S150)。 On the other hand, the transmission unit 324 determines that the correction instruction is input (step S145: YES), and transmits the input correction instruction to the content providing apparatus 1 (step S150).

例如,在欲移動物件的畫像的位置之情況,使用者係以手指接觸被顯示於觸控面板之物件的畫像,使之往欲移動的方向移動(拖曳操作)。傳送部324係將在被接觸的畫面上的位置顯示有畫像之物件的物件ID及已設定移動方向和移動量的修正指示傳送到內容提供裝置1。移動量係和將手指保持接觸著觸控面板移動的距離對應的資訊。或者使用者係保持帶著HMD2將頭往欲移動的方向搖動。檢測部33所具備的感測器係檢測搖頭的方向,傳送部324係將以該檢測到的方向作為移動方向所設定之修正指示傳送到內容提供裝置1。此時,傳送部324亦可將和搖頭的速度或搖頭的距離對應之移動量設定在修正指示。或者,在終端裝置3預先備有檢測視線的感測器以檢測使用者移動視線的方向。傳送部324係將在使用者的視線觸及的位置上顯示有畫像之物件的物件ID和以所檢測之方向作為移動方向所設定之修正指示傳送到內容提供裝置1。此時,傳送部324亦可將和視線移動的距離對應之移動量設定在修正指示。 For example, in the case where the image of the object is to be moved, the user touches the image of the object displayed on the touch panel with a finger to move it in the direction to be moved (drag operation). The transfer unit 324 transmits the object ID of the object on which the image is displayed at the position on the screen being touched, and the correction instruction for setting the moving direction and the amount of movement to the content providing device 1. The amount of movement and the information corresponding to the distance that the finger is kept in contact with the movement of the touch panel. Or the user keeps shaking the head with the HMD2 in the direction of moving. The sensor included in the detecting unit 33 detects the direction of the moving head, and the transmitting unit 324 transmits the correction instruction set in the moving direction as the moving direction to the content providing device 1. At this time, the transport unit 324 may also set the amount of movement corresponding to the speed of the moving head or the distance of the shaking head to the correction instruction. Alternatively, the terminal device 3 is provided with a sensor for detecting a line of sight to detect the direction in which the user moves the line of sight. The transport unit 324 transmits the object ID of the object in which the image is displayed at the position touched by the user's line of sight and the correction instruction set as the moving direction with the detected direction to the content providing apparatus 1. At this time, the transmission unit 324 may also set the amount of movement corresponding to the distance moved by the line of sight to the correction instruction.

又,在欲使物件的畫像的方向旋轉之情況,使用者係進行點擊被顯示於觸控面板之物件的畫像等之操作。傳送部324係將在被點擊的畫面上的位置上顯示有畫像之物件的物件ID及已設定旋轉的修正指示傳送到內容提供裝置1。 Further, when the user wants to rotate the image of the object, the user performs an operation of clicking on an image of the object displayed on the touch panel. The transfer unit 324 transmits the object ID of the object on which the image is displayed on the clicked screen and the correction instruction for setting the rotation to the content providing device 1.

終端裝置3的處理部32係重複自步驟S115開始的處理。 The processing unit 32 of the terminal device 3 repeats the processing from step S115.

傳送部324係於步驟S145判斷為NO之後,判斷是否已被輸入物件的刪除指示(步驟S155)。 The transmission unit 324 determines whether or not the deletion of the input object has been instructed after the determination in step S145 is NO (step S155).

傳送部324係在判斷已被輸入物件的刪除指示之情況(步驟S155:YES),將既輸入的刪除指示傳送到內容提供裝置1(步驟S160)。例如,使用者以手指接觸被顯示於觸控面板之刪除對象的物件的畫像向畫面外的方向輕撥操作或雙擊刪除對象的物件的畫像。傳送部324係將設定有已進行此種刪除操作之物件的物件ID的刪除指示傳送到內容提供裝置1。 The transfer unit 324 determines that the deletion instruction has been input (step S155: YES), and transmits the deleted instruction input to the content providing device 1 (step S160). For example, the user touches the image of the object to be deleted displayed on the touch panel with a finger in a direction outside the screen or double-clicks the image of the object to be deleted. The transfer unit 324 transmits an instruction to delete the object ID in which the object having been subjected to the deletion operation is set to the content providing device 1.

終端裝置3的處理部32係重複自步驟S115開始的處理。 The processing unit 32 of the terminal device 3 repeats the processing from step S115.

一方面,在判斷傳送部324未被輸入物件的刪除指示之情況(步驟S155:NO),處理部32判斷是否已藉由輸入部31輸入處理結束(步驟S165)。處理部32係在判斷未輸入處理結束之情況(步驟S165:NO),重複自步驟S105開始的處理。 On the other hand, when it is judged that the transmission unit 324 has not input the deletion instruction of the input object (step S155: NO), the processing unit 32 determines whether or not the input processing has been completed by the input unit 31 (step S165). The processing unit 32 determines that the uninput processing has ended (step S165: NO), and repeats the processing from step S105.

接著,處理部32係在判斷步驟S165已被輸入處理結束之情況(步驟S165:YES),結束處理。 Next, the processing unit 32 determines that the input processing has been completed in step S165 (step S165: YES), and ends the processing.

圖7係內容提供裝置1中之內容提供處理的流程圖。 FIG. 7 is a flowchart of the content providing process in the content providing device 1.

內容提供裝置1的合成部133係判斷是否視聽方向資訊接收部131已從終端裝置3接收到視聽方向資訊(步驟S205)。合成部133係在判斷視聽方向資訊接收部131還未 接收視聽方向資訊之情況(步驟S205:NO),進行後述步驟S220的處理。 The synthesizing unit 133 of the content providing device 1 determines whether or not the viewing direction information receiving unit 131 has received the viewing direction information from the terminal device 3 (step S205). The synthesizing unit 133 determines that the viewing direction information receiving unit 131 has not yet When the viewing direction information is received (step S205: NO), the processing of step S220 described later is performed.

合成部133係在判斷視聽方向資訊接收部131已接收視聽方向資訊之情況(步驟S205:YES),判斷是否已生成配信用三維畫像內容(步驟S210)。合成部133係在判斷已生成配信用三維畫像內容之情況(步驟S210:YES),進行後述步驟S220的處理。 The synthesizing unit 133 determines that the viewing direction information receiving unit 131 has received the viewing direction information (step S205: YES), and determines whether or not the distribution digital three-dimensional image content has been generated (step S210). The synthesizing unit 133 determines that the content of the three-dimensional image of the credit has been generated (step S210: YES), and performs the processing of step S220 to be described later.

合成部133係在判斷尚未生成配信用三維畫像內容之情況(步驟S210:NO),從記憶部11讀出背景內容,設為配信用三維畫像內容(步驟S215)。此外,亦可從終端裝置3進一步接收特定背景內容的資訊。合成部133將依接收的資訊所特定之背景內容從記憶部11讀出,設為配信用三維畫像內容。 When it is determined that the content of the three-dimensional image of the credit has not been generated (step S210: NO), the composition unit 133 reads the background content from the storage unit 11 and sets the content of the three-dimensional image of the credit (step S215). Further, information of the specific background content may be further received from the terminal device 3. The synthesizing unit 133 reads out the background content specified by the received information from the storage unit 11, and sets it as a three-dimensional portrait content.

合成部133係於步驟S205判斷NO之後、於步驟S210判斷YES之後、或步驟S215的處理之後,判斷是否物件資訊接收部132已接收物件ID及配置位置資訊(步驟S220)。合成部133係在判斷物件資訊接收部132還未接收物件ID及配置位置資訊之情況(步驟S220:NO),進行後述步驟S245的處理。 The synthesizing unit 133 determines whether the object information receiving unit 132 has received the object ID and the arrangement position information after determining NO in step S205, determining YES in step S210, or after the process in step S215 (step S220). The composition unit 133 determines that the object information receiving unit 132 has not received the object ID and the arrangement position information (step S220: NO), and performs the processing of step S245 described later.

一方面,合成部133係在判斷物件資訊接收部132已接收物件ID及配置位置資訊之情況(步驟S220:YES),進行步驟S225的處理。亦即,合成部133將和已接收的物件ID對應之物件內容及屬性資訊從記憶於記憶部11的物件內容管理資訊讀出(步驟S225)。合成部133從所接收的配置位置資訊獲得配信用三維畫像內容中之三 維上的配置位置。合成部133在配置位置資訊是表示地理的絕對位置之情況,變換成在背景畫像中之位置。合成部133係於現在的配信用三維畫像內容上將讀出的物件內容以配置在配信用三維畫像內容中之配置位置的方式重疊(合成),生成更新後的配信用三維畫像內容(步驟S230)。在重疊於配信用三維畫像內容的物件內容附加有物件內容的物件ID。 On the other hand, the synthesizing unit 133 determines that the object information receiving unit 132 has received the object ID and the arrangement position information (step S220: YES), and performs the processing of step S225. In other words, the synthesizing unit 133 reads the object content and the attribute information corresponding to the received object ID from the object content management information stored in the storage unit 11 (step S225). The synthesizing unit 133 obtains three of the three-dimensional portrait contents of the credit from the received placement position information. The configuration location on the dimension. The combining unit 133 converts the position information into a position in the background image when the arrangement position information indicates the absolute position of the geographical position. The synthesizing unit 133 superimposes (synthesizes) the read object contents on the current distribution digital three-dimensional image content so as to be arranged in the distribution three-dimensional image content, and generates the updated credit digital three-dimensional image content (step S230). ). The object ID of the object content is attached to the object content superimposed on the three-dimensional portrait content of the credit.

再者,合成部133係按所讀出之屬性資訊所示之配置位置屬性,修正在步驟S230中配置之物件內容的三維上的配置位置(步驟S235)。此外,合成部133亦可在合成前將所接收之配置位置資訊所示之配置位置按照配置位置屬性作修正。此時,合成部133係於現在的配信用三維畫像內容上將物件內容以配置在配信用三維畫像內容中之修正後的配置位置之方式重疊(合成),生成更新後的配信用三維畫像內容。又,合成部133亦可再按配置位置屬性,修正物件內容的方向。合成部133係對和已生成之配信用三維畫像內容的顯示相關的屬性,進行和已讀出之屬性資訊所示之畫像加工屬性對應之加工(步驟S240)。 Furthermore, the synthesizing unit 133 corrects the three-dimensional arrangement position of the object contents arranged in step S230 in accordance with the arrangement position attribute indicated by the read attribute information (step S235). Further, the synthesizing unit 133 may correct the arrangement position indicated by the received arrangement position information in accordance with the arrangement position attribute before synthesis. In this case, the synthesizing unit 133 superimposes (synthesizes) the contents of the object on the current three-dimensional image content of the credit, and creates the updated three-dimensional image content of the credit distribution so as to be arranged in the corrected arrangement position of the three-dimensional image content of the credit. . Further, the synthesizing unit 133 may correct the direction of the object content by the placement position attribute. The synthesizing unit 133 performs processing corresponding to the image processing attribute indicated by the read attribute information on the attribute related to the display of the generated three-dimensional image content (step S240).

此外,於步驟S225中,物件內容未被讀出之情況為,合成部133不進行步驟S230及步驟S235的處理。又,合成部133係在屬性資訊未被設定配置位置屬性之情況,不進行步驟S235的處理,在屬性資訊未被設定畫像加工屬性之情況,不進行步驟S240的處理。 Further, in the case where the object contents are not read in step S225, the synthesizing unit 133 does not perform the processing of steps S230 and S235. Further, the synthesizing unit 133 does not perform the processing of step S235 when the attribute information is not set to the position attribute, and does not perform the processing of step S240 when the attribute information is not set with the image processing attribute.

合成部133在步驟S220中判斷為NO之後,或 ,步驟S240的處理之後,判斷是否修正指示接收部135已從終端裝置3接收修正指示(步驟S245)。合成部133係在判斷修正指示接收部135還未接收修正指示之情況(步驟S245:NO),進行後述步驟S255的處理。 The synthesizing unit 133 determines that NO after the step S220, or After the process of step S240, it is determined whether or not the correction instruction receiving unit 135 has received the correction instruction from the terminal device 3 (step S245). The synthesizing unit 133 determines that the correction instruction receiving unit 135 has not received the correction instruction (step S245: NO), and performs the processing of step S255 to be described later.

合成部133係在判斷修正指示接收部135已接收修正指示之情況(步驟S245:YES),按修正指示,修正配信用三維畫像內容中之物件內容的配置位置或方向(步驟S250)。 The synthesizing unit 133 determines that the correction instruction receiving unit 135 has received the correction instruction (step S245: YES), and corrects the arrangement position or direction of the object content in the three-dimensional portrait content of the credit according to the correction instruction (step S250).

具體言之,合成部133係將配信用三維畫像內容中之物件內容的現在的配置位置,因應於修正指示所示之移動方向及移動量作修正。在修正指示設定有物件ID之情況,合成部133係僅移動依該物件ID所特定之物件內容的配置位置。又,在修正指示未設定移動量之情況,合成部133使配置位置僅移動固定的移動量。 Specifically, the synthesizing unit 133 corrects the current arrangement position of the object contents in the three-dimensional portrait content of the credit, in accordance with the movement direction and the movement amount indicated by the correction instruction. When the correction instruction indicates that the object ID is set, the synthesizing unit 133 moves only the arrangement position of the object content specified by the object ID. Further, when the correction instruction indicates that the amount of movement is not set, the synthesizing unit 133 shifts the arrangement position by only a fixed amount of movement.

又,在修正指示設定有物件ID及旋轉之情況,合成部133係將重疊於配信用三維畫像內容的物件內容中之依設定於修正指示的物件ID所特定之物件內容的方向往既定方向僅旋轉既定角度。 Further, when the object ID and the rotation are set in the correction instruction, the synthesizing unit 133 sets the direction of the object content specified by the object ID set in the correction instruction in the object content superimposed on the content of the three-dimensional image of the credit in the predetermined direction. Rotate the given angle.

合成部133係於步驟S245判斷為NO之後,或在步驟S250的處理之後,判斷是否刪除指示接收部136已從終端裝置3接收刪除指示(步驟S255)。合成部133係在判斷刪除指示接收部136還未接收刪除指示之情況(步驟S255:NO),進行後述步驟S265的處理。一方面,合成部133係在判斷刪除指示接收部136已接收刪除指示之情況(步驟S255:YES),進行步驟S260的處理。亦即,合 成部133係從重疊於配信用三維畫像內容的物件內容,刪除依設定於刪除指示之物件ID所特定的物件內容(步驟S260)。 The synthesizing unit 133 determines whether or not the deletion instruction receiving unit 136 has received the deletion instruction from the terminal device 3 after the determination in step S245 is NO or after the process of step S250 (step S255). The synthesizing unit 133 determines that the deletion instruction receiving unit 136 has not received the deletion instruction (step S255: NO), and performs the processing of step S265 described later. On the other hand, the synthesizing unit 133 determines that the deletion instruction receiving unit 136 has received the deletion instruction (step S255: YES), and performs the processing of step S260. That is, The part 133 deletes the object content specified by the object ID set in the deletion instruction from the object content superimposed on the three-dimensional portrait content of the credit (step S260).

合成部133係在判斷步驟S255中為NO之情況,或在進行步驟S260的處理後,內容傳送部134進行步驟S265的處理。亦即,內容傳送部134係從配信用三維畫像內容,抽出和從終端裝置3接收到的視聽方向資訊所示之使用者的方向或位置對應之區域(部分)的三維畫像內容(步驟S265)。在視聽方向資訊未設定使用者的位置之情況,使用背景內容的中心的位置等之預先決定的位置。內容傳送部134係將從配信用三維畫像內容抽出之三維畫像內容傳送到終端裝置3(步驟S270)。 The synthesizing unit 133 is NO in the determination step S255, or after the processing in step S260 is performed, the content transmitting unit 134 performs the processing in step S265. In other words, the content transfer unit 134 extracts the three-dimensional image content of the region (portion) corresponding to the direction or position of the user indicated by the viewing direction information received from the terminal device 3 from the digital three-dimensional image content (step S265). . In the case where the user's position is not set in the viewing direction information, a predetermined position such as the position of the center of the background content is used. The content transfer unit 134 transmits the three-dimensional image content extracted from the digital three-dimensional image content to the terminal device 3 (step S270).

此外,終端裝置3的攝像部34繼續拍攝動畫像資料,物件識別取得部322亦可在即便使用者沒利用輸入部31輸入物件ID之取得指示,還是從攝像部34所繼續拍攝的動畫像資料檢測表示物件ID的文字或畫像,再從所檢測之資訊取得物件ID。而在已取得物件ID之情況,即便使用者沒利用輸入部31輸入指示,配置位置資訊取得部323將取得配置位置資訊,而傳送部324將物件識別取得部322所取得之物件ID及配置位置資訊取得部323所取得之配置位置資訊傳送到內容提供裝置1。 Further, the imaging unit 34 of the terminal device 3 continues to capture the moving image data, and the object recognition acquiring unit 322 can also capture the moving image data that is continuously captured by the imaging unit 34 even if the user does not input the instruction to input the object ID by the input unit 31. The text or image indicating the object ID is detected, and the object ID is obtained from the detected information. On the other hand, even if the user does not input the instruction by the input unit 31, the placement position information acquisition unit 323 acquires the arrangement position information, and the transmission unit 324 sets the object ID and the arrangement position acquired by the object recognition acquisition unit 322. The placement location information acquired by the information acquisition unit 323 is transmitted to the content providing device 1.

如上述,終端裝置3在攝像部34正繼續進行拍攝的期間,即便使用者未輸入指示,亦重複從動畫像資料檢測物件ID,將已檢測的物件ID和檢測物件ID時的配置位置資訊傳送到內容提供裝置1的處理。藉此,即便使用者未 隨時進行操作,光是將媒體5遮住終端裝置3的攝像部34或使攝像部34面向媒體5,就可視聽不斷被追加物件之三維畫像內容。 As described above, the terminal device 3 repeats the follow-up image data detection object ID even when the user does not input an instruction while the imaging unit 34 is continuing the imaging, and transmits the detected object ID and the arrangement position information when the object ID is detected. The processing to the content providing device 1. Thereby, even if the user does not When the medium 5 is blocked from the imaging unit 34 of the terminal device 3 or the imaging unit 34 faces the medium 5, the three-dimensional image content of the object to be added is visually recognized.

接著,說明內容提供系統之具體的使用例。 Next, a specific use example of the content providing system will be described.

在第1使用例方面,說明使用者藉由三維畫像來視聽將傢俱配置於房間的影像之情況。 In the first use example, the case where the user views the image of the furniture in the room by the three-dimensional image will be described.

圖8係顯示使用者使用HMD2的狀況之圖。使用者位在與配置傢俱的房間相同房間佈置的房間R。在房間R的地板或牆壁,印刷有位置資訊的標識M貼在地板或牆壁。 Fig. 8 is a view showing a state in which the user uses the HMD 2. The user is located in a room R arranged in the same room as the room in which the furniture is arranged. In the floor or wall of the room R, the logo M printed with the location information is attached to the floor or the wall.

圖9係顯示物件內容管理資訊的設定例之圖。如同圖所示,在物件內容管理資訊設定有針對椅子、窗簾、時鐘等之傢俱或內部裝飾,或針對會影響房間的狀況之太陽等之物件的資訊。針對設置於地板上之物件的物件內容,將配置位置屬性設為「地板」,針對設置於窗戶之物件的物件內容,將配置位置屬性設為「窗戶」,針對設置於牆壁之物件的物件內容,將配置位置屬性設為「牆壁」,針對可懸掛於天花板之物件的物件內容,將配置位置屬性設為「天花板」。又,於會影響畫像的亮度的照明或太陽等之物件的畫像加工屬性上設定要如何加工畫像。 Fig. 9 is a view showing a setting example of the object content management information. As shown in the figure, information on the object content management information is set for furniture such as a chair, a curtain, a clock, or the like, or an object such as the sun that affects the condition of the room. For the object content of the object set on the floor, set the configuration position attribute to "floor", and set the configuration position attribute to "window" for the object content of the object set on the window, and the object content for the object set on the wall. Set the position attribute to "wall" and set the position attribute to "ceiling" for the contents of the object that can be hung from the ceiling. In addition, how to process the image is set in the image processing property of the object that affects the brightness of the image or the image of the sun.

此外,亦可作成藉由配置位置屬性而獲得物件的方向的屬性。例如,在配置位置屬性為「地板」之情況,以和房間和方向會相同的方式配置物件內容,配置位置屬性為「窗戶」之情況,以和窗戶平行的方式配置物件 內容,配置位置屬性為「牆壁」之情況,以和牆壁平行的方式配置物件內容。此外,亦可在配置位置屬性上明示地設定物件的方向。 In addition, it is also possible to obtain an attribute of the direction of the object by configuring the position attribute. For example, when the location attribute is "floor", the contents of the object are configured in the same way as the room and direction, and the position attribute is "window", and the object is arranged in parallel with the window. Content, when the location attribute is set to "wall", the contents of the object are configured in parallel with the wall. In addition, the orientation of the object can be explicitly set on the configuration location attribute.

圖10係顯示配信用三維畫像內容的生成例之圖。 Fig. 10 is a view showing an example of generation of a three-dimensional portrait content of a credit.

首先,作為HMD2的顯示裝置使用之終端裝置3的視聽方向資訊取得部321,係將檢測部33所取得之使用者的方向與現在位置的資訊作為視聽方向資訊傳送到內容提供裝置1(步驟S105,步驟S110)。當內容提供裝置1的視聽方向資訊接收部131從終端裝置3接收視聽方向資訊時(步驟S205:YES),合成部133從記憶部11讀出和視聽方向資訊所示之現在位置對應之房間R的背景內容B1。合成部133將背景內容B1如圖10(a)所示設為配信用三維畫像內容G11(步驟S210:NO,步驟S215)。背景內容B1係將房間R事前攝影所生成之三維畫像內容。藉由指定位置和方向,從背景內容B1可取得從指定的位置在所指定的方向觀看時的三維畫像內容。內容傳送部134係從配信用三維畫像內容G11,抽出和已接收的視聽方向資訊所示之使用者的位置或方向對應之區域的三維畫像內容(步驟S265),傳送到終端裝置3(步驟S270)。終端裝置3的顯示控制部326將內容接收部325自內容提供裝置1接收到之三維畫像內容顯示於顯示部36(步驟S115~步驟S120)。藉此,使用者可視聽從現在的位置觀看房間R時的三維畫像內容。 First, the viewing direction information obtaining unit 321 of the terminal device 3 used as the display device of the HMD 2 transmits the information of the user's direction and the current position acquired by the detecting unit 33 as the viewing direction information to the content providing device 1 (step S105). , step S110). When the viewing direction information receiving unit 131 of the content providing device 1 receives the viewing direction information from the terminal device 3 (step S205: YES), the synthesizing unit 133 reads out the room R corresponding to the current position indicated by the viewing direction information from the storage unit 11. Background content B1. The composition unit 133 sets the background content B1 as the credit three-dimensional image content G11 as shown in FIG. 10(a) (step S210: NO, step S215). The background content B1 is a three-dimensional image content generated by the front view of the room R. By specifying the position and direction, the three-dimensional portrait content when viewed from the specified position in the specified direction can be obtained from the background content B1. The content transfer unit 134 extracts the three-dimensional image content of the region corresponding to the position or direction of the user indicated by the received viewing direction information from the digital three-dimensional image content G11 (step S265), and transmits the content to the terminal device 3 (step S270). ). The display control unit 326 of the terminal device 3 displays the three-dimensional image content received by the content receiving unit 325 from the content providing device 1 on the display unit 36 (steps S115 to S120). Thereby, the user can visually listen to the three-dimensional portrait content when viewing the room R from the current position.

當使用者在房間R中移動時,終端裝置3的視 聽方向資訊取得部321係將檢測部33新取得之使用者的方向與現在位置的資訊作為視聽方向資訊傳送到內容提供裝置1(步驟S105,步驟S110)。內容提供裝置1的視聽方向資訊接收部131從終端裝置3接收新的視聽方向資訊(步驟S205)。內容傳送部134係從既生成的配信用三維畫像內容G11,抽出和新接收的視聽方向資訊所示之使用者的位置或方向對應之區域的三維畫像內容(步驟S265),傳送到終端裝置3(步驟S270)。終端裝置3的顯示控制部326將內容接收部325自內容提供裝置1接收到之三維畫像內容顯示於顯示部36(步驟S115~步驟S120)。藉此,使用者可視聽從既移動的位置觀看房間R時的三維畫像內容。 When the user moves in the room R, the view of the terminal device 3 The listening direction information obtaining unit 321 transmits the information of the user's direction and the current position newly acquired by the detecting unit 33 as the viewing direction information to the content providing device 1 (step S105, step S110). The viewing direction information receiving unit 131 of the content providing device 1 receives new viewing direction information from the terminal device 3 (step S205). The content transfer unit 134 extracts the three-dimensional image content of the region corresponding to the position or direction of the user indicated by the newly received viewing direction information from the generated three-dimensional image content G11 (step S265), and transmits the content to the terminal device 3. (Step S270). The display control unit 326 of the terminal device 3 displays the three-dimensional image content received by the content receiving unit 325 from the content providing device 1 on the display unit 36 (steps S115 to S120). Thereby, the user can visually listen to the three-dimensional portrait content when viewing the room R from the moved position.

當使用者往房間R中欲設置傢俱的場所移動時,選擇已印刷有欲設置的傢俱的照片和物件ID的卡(媒體5),將拍攝指示藉由終端裝置3的輸入部31輸入(步驟S125:YES)。物件識別取得部322係從攝像部34所拍攝之畫像的資料取得物件ID(步驟S130)。然後,使用者藉由終端裝置3的攝像部34拍攝欲設置傢俱的場所之標識M。配置位置資訊取得部323係從攝像部34所拍攝之畫像的資料取得位置資訊,設為配置位置資訊(步驟S135)。傳送部324係將取得之物件ID及配置位置資訊傳送到內容提供裝置1(步驟S140)。 When the user moves to the place where the furniture is to be set in the room R, the card (media 5) in which the photo of the furniture to be set and the article ID are printed is selected, and the shooting instruction is input through the input unit 31 of the terminal device 3 (step S125: YES). The object recognition acquisition unit 322 acquires the object ID from the data of the image captured by the imaging unit 34 (step S130). Then, the user captures the mark M of the place where the furniture is to be set by the imaging unit 34 of the terminal device 3. The arrangement position information acquisition unit 323 acquires the position information from the data of the image captured by the imaging unit 34, and sets the position information (step S135). The transfer unit 324 transmits the acquired object ID and arrangement position information to the content providing device 1 (step S140).

當內容提供裝置1的物件資訊接收部132接收物件ID及配置位置資訊時(步驟S220:YES),合成部133係讀出和物件ID對應之物件內容及屬性資訊(步驟S225) 。此處,設為所接收的物件ID為「00001」,從圖9所示的物件內容管理資訊讀出物件名稱「椅子」的物件內容C11和表示配置位置屬性「地板」之屬性資訊。合成部133係於現在的配信用三維畫像內容G11上重疊(合成)物件內容C11,生成圖10(b)所示的配信用三維畫像內容G12(步驟S230)。物件內容C11係以於配信用三維畫像內容G11的畫像上配置在配置位置資訊所示之三維上的配置位置之方式重疊。 When the article information receiving unit 132 of the content providing device 1 receives the object ID and the arrangement position information (step S220: YES), the synthesizing unit 133 reads the object content and the attribute information corresponding to the object ID (step S225). . Here, the received object ID is "00001", and the object content C11 of the object name "chair" and the attribute information indicating the arrangement position attribute "floor" are read from the object content management information shown in FIG. The composition unit 133 superimposes (synthesizes) the object content C11 on the current credit digital three-dimensional image content G11, and generates the credit digital three-dimensional image content G12 shown in FIG. 10(b) (step S230). The object content C11 is superimposed so that the arrangement position of the three-dimensional portrait content G11 of the credit is placed on the three-dimensional arrangement position indicated by the position information.

合成部133係將所生成之配信用三維畫像內容G12中之物件內容C11的配置位置修正成和設定於屬性資訊的配置位置屬性「地板」一致。例如,會有配置物件內容C11的方向雖一致,但下端被配置成比配信用三維畫像內容G12的地板高度還上面的情況。於是,合成部133係將配信用三維畫像內容G12中之物件內容C11的配置位置,以物件內容C11的下端和地板的高度一致的方式作修正(步驟S235)。再者,合成部133係如圖10(c)所示,亦能以使重疊於配信用三維畫像內容G12的背景內容B1(或配信用三維畫像內容G12)中之房間的方向和物件內容C11的方向對準之方式旋轉物件內容C11。合成部133在步驟S230,例如,在重疊有地毯等配置位置屬性是「地板」的物件內容之情況,亦同樣地修正包含方向在內的配置位置。又,例如,合成部133在重疊有時鐘等配置位置屬性為「牆壁」的物件內容之情況,將物件內容的配置位置修正成配信用三維畫像內容中之牆壁的位置,且以和牆壁平行的方式旋轉方向。此外,合成部133可生成 物件內容C11的配置位置修正後之配信用三維畫像內容,亦可生成將物件內容C11從最初的配置位置往修正後的配置位置移動之動畫的配信用三維畫像內容。 The synthesizing unit 133 corrects the arrangement position of the object content C11 in the generated three-dimensional portrait content G12 to match the placement position attribute "floor" set in the attribute information. For example, although the direction in which the object contents C11 are arranged is the same, the lower end is arranged to be higher than the floor height of the three-dimensional portrait content G12 of the credit. Then, the synthesizing unit 133 corrects the arrangement position of the object content C11 in the three-dimensional portrait content G12 of the credit, so that the lower end of the object content C11 and the height of the floor match each other (step S235). Further, as shown in FIG. 10(c), the synthesizing unit 133 can also superimpose the direction of the room and the object content C11 in the background content B1 (or the credit digital three-dimensional image content G12) of the three-dimensional portrait content G12. Rotate the object content C11 in the direction of the alignment. In step S230, for example, in the case where the object content in which the position attribute is "floor" is overlapped, such as a carpet, the arrangement position is also corrected in the same manner. Further, for example, when the composition unit 133 superimposes the contents of the object whose position attribute is "wall", such as a clock, the synthesizing unit 133 corrects the position of the object content to the position of the wall in the content of the three-dimensional image of the credit, and is parallel to the wall. The direction of rotation. Further, the synthesizing section 133 can generate The content of the three-dimensional image of the credit after the arrangement position of the object content C11 is corrected, and the three-dimensional image content of the animation that moves the object content C11 from the initial arrangement position to the corrected arrangement position may be generated.

內容傳送部134係從已修正物件內容C11的配置位置之配信用三維畫像內容G12,抽出和最新的視聽方向資訊所示之使用者的位置或方向對應之區域的三維畫像內容(步驟S265),傳送到終端裝置3(步驟S270)。 The content transfer unit 134 extracts the three-dimensional image content of the region corresponding to the position or direction of the user indicated by the latest viewing direction information from the digital three-dimensional image content G12 at the position of the corrected object content C11 (step S265). It is transmitted to the terminal device 3 (step S270).

使用者係在欲移動椅子的位置之情況,將顯示於終端裝置3的椅子之畫像以手指保持接觸地往欲移動的方向移動(步驟S145:YES)。終端裝置3的傳送部324係將已設定椅子的物件ID和移動方向及移動量之修正指示傳送到內容提供裝置1(步驟S150)。 When the user wants to move the position of the chair, the portrait of the chair displayed on the terminal device 3 is moved in the direction in which the finger is held in contact with the finger (step S145: YES). The transfer unit 324 of the terminal device 3 transmits an instruction to correct the object ID and the moving direction and the amount of movement of the set chair to the content providing device 1 (step S150).

內容提供裝置1的合成部133係從修正指示接收部135所接收之修正指示取得物件ID、移動方向及移動量。合成部133係將配信用三維畫像內容G12中之椅子的物件內容C11的配置位置,按修正指示作修正(步驟S245:YES,步驟S250)。內容傳送部134係從已修正物件內容C11的配置位置之配信用三維畫像內容G12,抽出和最新的視聽方向資訊所示之使用者的位置或方向對應之區域的三維畫像內容(步驟S265),傳送到終端裝置3(步驟S270)。藉此,使用者可視聽在移動設置於房間R的椅子之位置時的三維畫像內容。因為可如此修正位置,故無需在房間R以狹窄間隔設置標識M。 The synthesizing unit 133 of the content providing device 1 acquires the object ID, the moving direction, and the moving amount from the correction instruction received by the correction instruction receiving unit 135. The synthesizing unit 133 corrects the arrangement position of the object content C11 of the chair in the three-dimensional portrait content G12 of the credit, in accordance with the correction instruction (step S245: YES, step S250). The content transfer unit 134 extracts the three-dimensional image content of the region corresponding to the position or direction of the user indicated by the latest viewing direction information from the digital three-dimensional image content G12 at the position of the corrected object content C11 (step S265). It is transmitted to the terminal device 3 (step S270). Thereby, the user can visually recognize the three-dimensional portrait content when moving the position of the chair set in the room R. Since the position can be corrected in this way, it is not necessary to set the mark M at a narrow interval in the room R.

使用者往房間R中欲設置不同傢俱之場所移動。在移動的期間,亦係終端裝置3將依移動而新取得之 使用者的方向與現在位置的資訊傳送到內容提供裝置1。內容提供裝置1係從配信用三維畫像內容G12,抽出和新接收的視聽方向資訊所示之使用者的位置或方向對應之區域的三維畫像內容,傳送到終端裝置3。終端裝置3的顯示控制部326將內容接收部325從內容提供裝置1所接收到之三維畫像內容顯示於顯示部36。藉此,使用者可視聽從既移動的位置觀看在設置有椅子的房間R時的三維畫像內容。 The user moves to a place in the room R where different furniture is to be set. During the movement, the terminal device 3 will also be newly acquired according to the movement. The information of the user's direction and the current location is transmitted to the content providing device 1. The content providing device 1 extracts the three-dimensional image content of the region corresponding to the position or direction of the user indicated by the newly received viewing direction information from the digital three-dimensional portrait content G12, and transmits the content to the terminal device 3. The display control unit 326 of the terminal device 3 displays the three-dimensional image content received by the content receiving unit 325 from the content providing device 1 on the display unit 36. Thereby, the user can view the three-dimensional portrait content when the room R in which the chair is installed can be viewed from the moved position.

使用者藉由終端裝置3拍攝欲設置的新傢俱的卡,取得物件ID(步驟S125:YES,步驟S130)。然後,使用者藉由終端裝置3拍攝欲設置的新傢俱的場所之標識M,獲得配置位置資訊(步驟S135)。傳送部324係將取得之物件ID及配置位置資訊傳送到內容提供裝置1(步驟S140)。 The user captures the card of the new furniture to be set by the terminal device 3, and acquires the article ID (step S125: YES, step S130). Then, the user captures the mark M of the place of the new furniture to be set by the terminal device 3, and obtains the arrangement position information (step S135). The transfer unit 324 transmits the acquired object ID and arrangement position information to the content providing device 1 (step S140).

內容提供裝置1係將和自終端裝置3接收的物件ID對應之物件內容及屬性資訊讀出(步驟S220:YES,步驟S225)。此處,設為所接收之物件ID是「00004」,從圖9所示的物件內容管理資訊讀出表示物件名稱「照明1」的物件內容C14和配置位置屬性「天花板」及畫像加工屬性「1段階照明」之屬性資訊。合成部133係於配信用三維畫像內容G12重疊(合成)物件內容C14而生成配信用三維畫像內容(步驟S230)。物件內容C14係於配信用三維畫像內容G12的畫像,以配置在配置位置資訊所示之三維上的配置位置之方式重疊。此處生成的配信用三維畫像內容係背景內容B1和物件內容C11及物件內容C14重 疊而成之三維畫像內容。 The content providing device 1 reads the object contents and attribute information corresponding to the object ID received from the terminal device 3 (step S220: YES, step S225). Here, it is assumed that the received object ID is "00004", and the object content C14 indicating the object name "lighting 1" and the arrangement position attribute "ceiling" and image processing attribute are read out from the object content management information shown in FIG. Attribute information of 1 stage lighting. The synthesizing unit 133 generates the matching three-dimensional image content by superimposing (synthesizing) the object content C14 on the credit digital three-dimensional image content G12 (step S230). The object content C14 is attached to the image of the three-dimensional portrait content G12 of the credit, and is superimposed so as to be arranged in the three-dimensional arrangement position indicated by the position information. The three-dimensional portrait content generated here is the background content B1 and the object content C11 and the object content C14 Stacked three-dimensional portrait content.

合成部133係將所生成之配信用三維畫像內容中之物件內容C14的配置位置,修正成和設定於屬性資訊的配置位置屬性「天花板」一致。例如,會有物件內容C14的上端被配置在比配信用三維畫像內容中之天花板還下面或上面的高度之情況。於是,合成部133係將物件內容C14的配置位置,以物件內容C14的上端和天花板的高度一致的方式作修正(步驟S235)。再者,合成部133係亦能以使重疊於配信用三維畫像內容的背景內容B1(或配信用三維畫像內容)中之房間的方向和物件內容C14的方向對準之方式旋轉物件內容C14。合成部133係對已修正物件內容C14的位置之配信用三維畫像內容,如畫像加工屬性所示般進行「1段階照明」之加工(步驟S240)。內容傳送部134係從被加工的配信用三維畫像內容,抽出和最新的視聽方向資訊所示之使用者的位置或方向對應之區域的三維畫像內容(步驟S265),傳送到終端裝置3(步驟S270)。 The synthesizing unit 133 corrects the arrangement position of the object content C14 in the generated three-dimensional portrait content to match the placement position attribute "ceiling" set in the attribute information. For example, there may be a case where the upper end of the object content C14 is disposed at a height below or above the ceiling in the three-dimensional portrait content of the credit. Then, the synthesizing unit 133 corrects the arrangement position of the object content C14 such that the upper end of the object content C14 and the height of the ceiling match each other (step S235). Further, the synthesizing unit 133 can also rotate the object content C14 such that the direction of the room in the background content B1 (or the three-dimensional image content of the credit) superimposed on the content of the three-dimensional image of the credit is aligned with the direction of the object content C14. The synthesizing unit 133 performs processing of "one-stage illumination" as shown in the image processing attribute on the content of the three-dimensional image of the corrected object content C14 (step S240). The content transfer unit 134 extracts the three-dimensional image content of the region corresponding to the position or direction of the user indicated by the latest viewing direction information from the processed three-dimensional image content (step S265), and transmits the content to the terminal device 3 (step S270).

藉由重複上述,使用者藉由三維畫像可視聽在房間R設置傢俱時的影像。 By repeating the above, the user can visually listen to the image when the furniture is set in the room R by the three-dimensional image.

此外,終端裝置3例如亦可從被貼附在展示於展示場等之實物的傢俱之媒體5預先讀取、記憶物件ID。此時,宜在物件ID事先附加表示傢俱的名稱等之物件名稱。使用者係藉由輸入部31從終端裝置3在顯示部36上顯示的物件名稱當中,選擇設置於房間R的傢俱的物件名稱。終端裝置3的傳送部324係將與被選擇的物件名稱對應之物 件ID在步驟S140中進行傳送。 Further, the terminal device 3 may read and store the article ID in advance from the media 5 attached to the furniture displayed on the display site or the like, for example. At this time, it is preferable to add an object name indicating the name of the furniture or the like to the object ID in advance. The user selects the object name of the furniture set in the room R from among the object names displayed on the display unit 36 by the terminal device 3 by the input unit 31. The transmitting unit 324 of the terminal device 3 will correspond to the selected object name. The piece ID is transmitted in step S140.

圖11係顯示設置複數個傢俱的物件時的配信用三維畫像內容的例子之圖。同圖中,在是房間R的三維畫像內容的背景內容B1上生成重疊有物件內容C21~C28的配信用三維畫像內容。同圖所示的使用者係表示在配信用三維畫像內容中之使用者的假想位置。使用者係透過利用HMD2視聽從配信用三維畫像內容所抽出之三維畫像內容,可體驗處在實際設有物件內容C21~C28的傢俱的房間R那樣的臨場感。 Fig. 11 is a view showing an example of the contents of the three-dimensional portrait of the credit when an object of a plurality of pieces of furniture is set. In the same figure, the three-dimensional image content of the credits in which the object contents C21 to C28 are superimposed is generated on the background content B1 which is the three-dimensional portrait content of the room R. The user shown in the figure shows the imaginary position of the user in the three-dimensional portrait content of the credit. By using the HMD2 to view the three-dimensional image content extracted from the three-dimensional image of the credit, the user can experience the sense of presence in the room R of the furniture in which the object contents C21 to C28 are actually provided.

其次,在第2使用例方面,說明使用者讓使用者所選擇的人物登上三維畫像的遊戲畫面之情況。 Next, in the second use example, a case will be described in which the user has placed a character selected by the user on the game screen of the three-dimensional portrait.

圖12係顯示物件內容管理資訊的設定例之圖。如同圖所示,於物件內容管理資訊,設定針對於可在遊戲畫面登場的人物或影響畫面的顯示之物件的資訊。針對在地面移動、放置在地面的物件,將配置位置屬性設為「地面」,針對在空中移動、浮在空中的物件,將配置位置屬性設為「天空」。此外,在配置位置屬性為天空的情況,亦可設定距離地面的高度。又,於影響畫像的亮度之太陽或積雨雲等之物件的畫像加工屬性上設定如何加工與畫像的顯示有關之屬性。 Fig. 12 is a view showing an example of setting of object content management information. As shown in the figure, in the object content management information, information for an object that can appear on the game screen or an object that affects the display of the screen is set. Set the position attribute to "Ground" for objects moving on the ground and placed on the ground, and set the position attribute to "Sky" for objects moving in the air and floating in the air. In addition, in the case where the position attribute is set to the sky, the height from the ground can also be set. In addition, the attribute related to the display of the image is set in the image processing attribute of the object such as the sun or the cumulonimbus cloud which affects the brightness of the image.

圖13係顯示終端裝置3所顯示的三維畫像內容的例子之圖。 FIG. 13 is a view showing an example of the contents of the three-dimensional image displayed by the terminal device 3.

最初,作為HMD2的顯示裝置使用之終端裝置3的視聽方向資訊取得部321,係將檢測部33所取得之使用者的方向的資訊作為視聽方向資訊傳送到內容提供裝置1(步 驟S105,步驟S110)。當內容提供裝置1的視聽方向資訊接收部131從終端裝置3接收視聽方向資訊時(步驟S205:YES),合成部133將背景內容B2從記憶部11讀出。合成部133將背景內容B2設為配信用三維畫像內容G31(步驟S210:NO,步驟S215)。內容傳送部134係從配信用三維畫像內容G31,抽出和已接收的視聽方向資訊所示之使用者的方向對應之區域的三維畫像內容(步驟S265),傳送到終端裝置3(步驟S270)。此外,使用者的位置係設為在背景內容(或配信用三維畫像內容)中之空間的中心位置等之固定位置。終端裝置3的顯示控制部326係如圖13(a)所示,將內容接收部325自內容提供裝置1所接收到之三維畫像內容顯示於顯示部36(步驟S115~步驟S120)。 First, the viewing direction information obtaining unit 321 of the terminal device 3 used as the display device of the HMD 2 transmits the information of the direction of the user acquired by the detecting unit 33 as the viewing direction information to the content providing device 1 (step). Step S105, step S110). When the viewing direction information receiving unit 131 of the content providing device 1 receives the viewing direction information from the terminal device 3 (step S205: YES), the synthesizing unit 133 reads the background content B2 from the storage unit 11. The composition unit 133 sets the background content B2 as the credit three-dimensional portrait content G31 (step S210: NO, step S215). The content transfer unit 134 extracts the three-dimensional image content of the region corresponding to the direction of the user indicated by the received viewing direction information from the digital three-dimensional image content G31 (step S265), and transmits the content to the terminal device 3 (step S270). Further, the position of the user is set to a fixed position such as the center position of the space in the background content (or the three-dimensional image content of the credit). As shown in FIG. 13A, the display control unit 326 of the terminal device 3 displays the three-dimensional image content received by the content receiving unit 325 from the content providing device 1 on the display unit 36 (steps S115 to S120).

使用者係藉由終端裝置3的攝像部34拍攝青蛙(兒子)的卡(媒體5),從所拍攝之畫像的資料取得物件ID「10001」(步驟S125:YES,步驟S130)。終端裝置3的配置位置資訊取得部323係將檢測部33所取得之使用者的方向的資訊設為配置位置資訊(步驟S135)。傳送部324將所取得之物件ID及配置位置資訊傳送到內容提供裝置1(步驟S140)。 The user captures the card (media 5) of the frog (son) by the imaging unit 34 of the terminal device 3, and acquires the object ID "10001" from the image of the captured image (step S125: YES, step S130). The arrangement position information acquisition unit 323 of the terminal device 3 sets the information of the direction of the user acquired by the detection unit 33 as the arrangement position information (step S135). The transfer unit 324 transmits the acquired object ID and arrangement position information to the content providing device 1 (step S140).

內容提供裝置1的合成部133係將和已接收的物件ID「10001」對應之物件內容C31和屬性資訊讀出(步驟S220:YES,步驟S225)。合成部133係從已接收之配置位置資訊取得使用者的方向的資訊,將從背景內容(或配信用三維畫像內容)的中心位置等之三維上的既定位置向已取得的資訊所示之方向前進既定距離後的位置 取得作為配置位置。合成部133係於現在的配信用三維畫像內容G31上重疊(合成)物件內容C31,生成更新後的配信用三維畫像內容(步驟S230)。物件內容C31係以於配信用三維畫像內容G31的畫像上配置在所取得之三維上的配置位置之方式重疊。 The synthesizing unit 133 of the content providing device 1 reads the object content C31 and the attribute information corresponding to the received object ID "10001" (step S220: YES, step S225). The synthesizing unit 133 acquires information on the direction of the user from the received placement position information, and sets the direction from the predetermined position in the three-dimensional position such as the center position of the background content (or the content of the three-dimensional image of the credit) to the direction of the acquired information. Position after the predetermined distance Obtained as the configuration location. The synthesizing unit 133 superimposes (synthesizes) the object content C31 on the current credit digital three-dimensional image content G31, and generates the updated digital three-dimensional image content (step S230). The object content C31 is superimposed so that the image of the three-dimensional image content G31 of the credit is placed on the acquired three-dimensional arrangement position.

合成部133係更新後的配信用三維畫像內容中之物件內容C31的配置位置修正成和設定於屬性資訊的配置位置「地面」一致。亦即,合成部133係將配信用三維畫像內容中之物件內容C31的配置位置,以物件內容C31的下端和地面的高度一致的方式作修正(步驟S235)。內容傳送部134從新生成的配信用三維畫像內容,抽出和最新的視聽方向資訊所示之使用者的方向對應之區域的三維畫像內容(步驟S265),傳送到終端裝置3(步驟S270)。 The arranging position of the object content C31 in the three-dimensional image content of the updated credit 133 is corrected so as to match the arrangement position "ground" set in the attribute information. In other words, the synthesizing unit 133 corrects the arrangement position of the object content C31 in the three-dimensional portrait content of the credit, so that the lower end of the object content C31 matches the height of the ground (step S235). The content transfer unit 134 extracts the three-dimensional image content of the region corresponding to the user's direction indicated by the latest viewing direction information from the newly generated digital three-dimensional image content (step S265), and transmits the content to the terminal device 3 (step S270).

然後使用者係藉由終端裝置3的攝像部34拍攝雲A的卡(媒體5),從所拍攝之畫像的資料取得物件ID「10008」(步驟S125:YES,步驟S130)。終端裝置3的傳送部324將所取得之物件ID與表示使用者的方向之配置位置資訊傳送到內容提供裝置1(步驟S135~步驟S140)。 Then, the user captures the card of the cloud A (media 5) by the imaging unit 34 of the terminal device 3, and acquires the object ID "10008" from the image of the captured image (step S125: YES, step S130). The transfer unit 324 of the terminal device 3 transmits the acquired object ID and the arrangement position information indicating the direction of the user to the content providing device 1 (steps S135 to S140).

內容提供裝置1的合成部133係將和已接收的物件ID「10008」對應之物件內容C38和屬性資訊讀出(步驟S220:YES,步驟S225)。合成部133係將從配信用三維畫像內容的中心位置等三維上的既定位置往已接收的配置位置資訊所示之方向前進既定距離後的位置取得作為配置位置。合成部133係於現在的配信用三維畫像內 容重疊(合成)物件內容C38,生成配信用三維畫像內容G32(步驟S230)。物件內容C38係於現在的配信用三維畫像內容的畫像,以配置在所取得之三維上的配置位置之方式重疊。 The synthesizing unit 133 of the content providing device 1 reads the object content C38 and the attribute information corresponding to the received object ID "10008" (step S220: YES, step S225). The synthesizing unit 133 acquires the position from the predetermined position in the three-dimensional position such as the center position of the three-dimensional image content of the credit to the position indicated by the received arrangement position information as the arrangement position. The synthesizing unit 133 is attached to the current three-dimensional portrait of the credit The object content C38 is superimposed (synthesized), and the three-dimensional portrait content G32 of the credit is generated (step S230). The object content C38 is an image of the current three-dimensional image content of the credit, and is superimposed so as to be placed on the acquired three-dimensional arrangement position.

合成部133係將配信用三維畫像內容G32中之物件內容C38的配置位置,修正成和設定於屬性資訊的配置位置「天空(距離地面的高度W)」一致(步驟S235)。內容傳送部134係從配信用三維畫像內容G32,抽出和最新的視聽方向資訊所示之使用者的方向對應之區域的三維畫像內容(步驟S265),傳送到終端裝置3(步驟S270)。終端裝置3的顯示控制部326係如圖13(b)所示,將內容接收部325自內容提供裝置1所接收到之三維畫像內容顯示於顯示部36(步驟S115~步驟S120)。 The synthesizing unit 133 corrects the arrangement position of the object content C38 in the distribution digital three-dimensional image content G32 to match the arrangement position "sky (height W from the ground)" set in the attribute information (step S235). The content transfer unit 134 extracts the three-dimensional image content of the region corresponding to the direction of the user indicated by the latest viewing direction information from the digital three-dimensional image content G32 (step S265), and transmits the content to the terminal device 3 (step S270). The display control unit 326 of the terminal device 3 displays the three-dimensional image content received by the content receiving unit 325 from the content providing device 1 on the display unit 36 as shown in FIG. 13(b) (steps S115 to S120).

同樣地,透過終端裝置3讀入青蛙(媽媽)、鴿子、雲B的卡,內容提供裝置1係生成將背景內容B2、物件內容C31、C32、C34、C38、C39重疊後的配信用三維畫像內容G33。內容提供裝置1係將從配信用三維畫像內容G33抽出與使用者的方向對應的範圍之三維畫像內容傳送到終端裝置3。終端裝置3的顯示控制部326係將圖13(c)所示的三維畫像內容顯示於顯示部36(步驟S115~步驟S120)。 In the same manner, the content of the frog (mother), the pigeon, and the cloud B is read by the terminal device 3, and the content providing device 1 generates a three-dimensional image of the credit with the background content B2, the object contents C31, C32, C34, C38, and C39 superimposed. Content G33. The content providing device 1 transmits the three-dimensional image content of the range corresponding to the direction of the user from the distribution digital three-dimensional image content G33 to the terminal device 3. The display control unit 326 of the terminal device 3 displays the three-dimensional image content shown in FIG. 13(c) on the display unit 36 (steps S115 to S120).

當使用者一邊藉由HMD2視聽配信用三維畫像內容一邊轉頭時,終端裝置3係將新取得之使用者的方向之資訊傳送到內容提供裝置1。內容提供裝置1係從配信用三維畫像內容G33,抽出和新接收到的使用者的方向 對應之區域的三維畫像內容,傳送到終端裝置3。終端裝置3的顯示控制部326將內容接收部325自內容提供裝置1所接收到之三維畫像內容顯示於顯示部36。藉此,使用者可視聽在觀看不同的方向時的三維畫像內容。 When the user turns around while viewing the three-dimensional image content of the credit by the HMD 2, the terminal device 3 transmits the information of the direction of the newly acquired user to the content providing device 1. The content providing device 1 extracts and newly received directions from the user's three-dimensional portrait content G33. The three-dimensional image content of the corresponding area is transmitted to the terminal device 3. The display control unit 326 of the terminal device 3 displays the three-dimensional image content received by the content receiving unit 325 from the content providing device 1 on the display unit 36. Thereby, the user can visually listen to the three-dimensional portrait content when viewing different directions.

此外,內容提供裝置1的合成部133在檢測到既定的事件(event)之情況,亦可因應於該事件而對配信用三維畫像內容進行因應該事件之加工。 Further, when the composition unit 133 of the content providing apparatus 1 detects a predetermined event, the content of the three-dimensional image of the credit can be processed in response to the event.

事件係例如有已接收既定的物件ID的組合之情況或既定的物件內容以既定的配置作配置之情況等。事件亦可進一步加入物件ID的接收順序或背景內容的種類。 The event is, for example, a case where a combination of predetermined object IDs has been received or a case where a predetermined object content is configured in a predetermined configuration. The event may further include the order in which the object ID is received or the type of background content.

又,在因應於事件的加工上,有在配信用三維畫像內容上重疊新的物件內容、將重疊於配信用三維畫像內容的物件內容置換成其他物件內容、背景內容變更成其他背景內容、及變更和配信用三維畫像內容的顯示相關之屬性(亮度或色調等)等。 In addition, in the processing of the event, the contents of the new object are superimposed on the three-dimensional image of the credit, the contents of the object superimposed on the three-dimensional image of the credit are replaced with other contents, and the background content is changed to other background content, and Change the attributes (brightness, hue, etc.) related to the display of the three-dimensional portrait content of the credit.

例如,內容提供裝置1的合成部133係以「青蛙(媽媽)」的物件內容和「青蛙(爸爸)」的物件內容配置在既定的距離內為事件進行檢測。合成部133係在配信用三維畫像內容上,以將「心型記號」的物件內容配置在「青蛙(媽媽)」的物件內容和「青蛙(爸爸)」的物件內容之間的方式追加而重疊。 For example, the synthesizing unit 133 of the content providing device 1 detects an event by arranging the contents of the object of "Frog (Mother)" and the contents of the object of "Frog (Daddy)" within a predetermined distance. The composition unit 133 is added to the content of the three-dimensional image of the credit, and the content of the object of the "heart type symbol" is added to and overlaps with the content of the object of "frog (mother)" and the content of the object of "frog (daddy)" .

又,例如,內容提供裝置1的合成部133係先從終端裝置3接收「子葉」的物件ID,之後以接收「雨」的物件ID為事件進行檢測。合成部133係將重疊於配信用三維畫像內容的子葉之物件內容,置換成從子葉成長並開花的 動畫之物件內容。 Further, for example, the synthesizing unit 133 of the content providing device 1 first receives the object ID of the "co-leaf" from the terminal device 3, and then detects the event ID of the "rain". The synthesizing unit 133 replaces the object content of the cotyledon superimposed on the content of the three-dimensional portrait of the credit, and grows and grows from the cotyledon. The object content of the animation.

又,例如,內容提供裝置1的合成部133係以接收「桃太郎」、「狗」、「雉」、「猿猴」的物件ID為事件進行檢測。合成部133係將重疊於配信用三維畫像內容的背景內容,變更成前往鬼島的故事之背景內容。 Further, for example, the synthesizing unit 133 of the content providing device 1 detects an event ID of "Taotaro", "Dog", "雉", and "Apes" as events. The composition unit 133 changes the background content superimposed on the content of the three-dimensional portrait of the credit to the background content of the story to the ghost island.

又,例如,內容提供裝置1的合成部133係以房間的背景內容之使用和窗簾的物件ID及月亮的物件ID之接收為事件進行檢測。合成部133係以使配信用三維畫像內容的亮度變暗的方式進行加工。 Further, for example, the synthesizing unit 133 of the content providing apparatus 1 detects the use of the background content of the room, the reception of the object ID of the curtain, and the object ID of the moon. The synthesizing unit 133 performs processing so that the brightness of the three-dimensional image content of the credit is darkened.

依據上述的實施形態,使用者藉由臨場感高的HMD可視聽合成有自己所選擇的物件的畫像之三維畫像的內容。 According to the above-described embodiment, the user can visually synthesize the content of the three-dimensional portrait of the portrait of the object selected by the HMD with high sense of presence.

此外,上述的內容提供裝置1及終端裝置3係內部具有電腦系統。而且,內容提供裝置1及終端裝置3的動作的過程係以程式的形式記憶於電腦可讀取的記錄媒體,透過電腦系統讀出並執行此程式以進行上述處理。此處所說的電腦系統是指包含CPU及各種記憶體、OS、週邊設備等之硬體。 Further, the content providing device 1 and the terminal device 3 described above have a computer system therein. Further, the processes of the operations of the content providing apparatus 1 and the terminal apparatus 3 are memorized in the form of a program on a computer-readable recording medium, and the program is read and executed by the computer system to perform the above processing. The computer system referred to herein refers to a hardware including a CPU and various memories, an OS, and peripheral devices.

又,「電腦系統」若是利用WWW系統的情況,則亦包含網頁提供環境(或顯示環境)。 In addition, if the "computer system" uses the WWW system, it also includes a web page providing environment (or display environment).

又,「電腦可讀取的記錄媒體」係指軟碟、磁光碟、ROM、CD-ROM等之可搬送的媒體、內建於電腦系統的硬碟等之記憶裝置。再者「電腦可讀取的記錄媒體」係包含如同經由網際網路等之網路或電話線路等之通訊線路傳送程式的情況之通訊線在短時間的期間動態地保 持程式者、如同在該情況成為伺服器或委託人的電腦系統內部的揮發性記憶體於一定時間保持程式者。且上述程式可為用以實現前述機能的一部分者,亦可為透過將前述機能和既記錄於電腦系統的程式之組合而得以實現者。 Further, the "computer-readable recording medium" refers to a memory device such as a floppy disk, a magneto-optical disk, a ROM, a CD-ROM, or the like, and a hard disk built in a computer system. Further, the "computer-readable recording medium" is a communication line that transmits a program such as a communication line such as a network or a telephone line via the Internet, and is dynamically protected for a short period of time. The programmer, like the volatile memory inside the computer system that becomes the server or the principal in this case, keeps the programmer for a certain period of time. The above program may be implemented to implement a part of the aforementioned functions, or may be realized by a combination of the above functions and a program recorded in a computer system.

以上,針對此發明的實施形態參照圖面作了詳述,但具體的構成不受此實施形態所限,亦包含未逸脫此發明要旨之範圍的設計等。 The embodiments of the present invention have been described in detail with reference to the drawings, but the specific configuration is not limited to the embodiments, and includes designs and the like that do not deviate from the scope of the invention.

Claims (10)

一種內容提供系統,係具有終端裝置及將三維畫像內容提供給前述終端裝置的內容提供裝置之內容提供系統,其中前述終端裝置具備:傳送部,將特定物件的物件識別資訊和可取得配置前述物件的畫像之三維上的位置的配置位置資訊傳送到前述內容提供裝置;及顯示控制部,使和已傳送的前述物件識別資訊及前述配置位置資訊對應地從前述內容提供裝置接收到的三維畫像內容顯示,前述內容提供裝置具備:記憶部,將前述物件識別資訊和依前述物件識別資訊所特定之是前述物件的三維畫像內容的物件內容賦予對應地記憶;物件資訊接收部,從前述終端裝置接收前述物件識別資訊及前述配置位置資訊;合成部,係生成配信用的三維畫像內容,該配信用的三維畫像內容係以在是背景的三維畫像內容的背景內容上將和已接收的前述物件識別資訊對應之前述物件內容配置在從已接收的前述配置位置資訊獲得之三維上的位置之方式作合成;及內容傳送部,將藉由前述合成部生成之配信用的前述三維畫像內容傳送到前述終端裝置。 A content providing system is a content providing system including a terminal device and a content providing device that supplies the three-dimensional image content to the terminal device, wherein the terminal device includes a transfer unit that recognizes the object identification information of the specific object and the configurable object The arrangement position information of the position on the three-dimensional image is transmitted to the content providing device; and the display control unit causes the three-dimensional image content received from the content providing device in correspondence with the transmitted object identification information and the arrangement position information. The content providing device includes: a storage unit that stores the object identification information and an object content specified by the object identification information as the three-dimensional image content of the object; and the object information receiving unit receives the terminal device The object identification information and the arrangement position information; the synthesizing unit generates a three-dimensional image content of the credit, and the three-dimensional image content of the credit is identified on the background content of the three-dimensional image content that is the background and the received object Before the information corresponds SUMMARY dimensional object disposed on the obtained location information from said received configuration manner for the synthesis of a position; and content transfer unit, the transfer by generating a three-dimensional illustration of the contents of the credit to the synthesis section with the terminal device. 一種內容提供裝置,具備: 記憶部,將物件識別資訊和依前述物件識別資訊所特定之是物件的三維畫像內容的物件內容賦予對應地記憶;物件資訊接收部,從終端裝置接收前述物件識別資訊和可取得配置前述物件的畫像的三維上的位置之配置位置資訊;合成部,係生成配信用的三維畫像內容,該生成配信用的三維畫像內容係以在是背景的三維畫像內容的背景內容上將和已接收的前述物件識別資訊對應之前述物件內容配置在從已接收的前述配置位置資訊獲得之三維上的位置之方式作合成;及內容傳送部,將藉由前述合成部生成之配信用的前述三維畫像內容傳送到前述終端裝置。 A content providing device having: The memory unit associates the object identification information with the object content of the three-dimensional image content of the object specified by the object identification information, and the object information receiving unit receives the object identification information from the terminal device and can obtain the configuration of the object. The positional information of the position in the three-dimensional position of the image; the synthesis unit generates the three-dimensional image content of the credit, and the three-dimensional image content of the generated credit is based on the background content of the three-dimensional image content of the background and the received The object identification content corresponding to the object content is arranged in a three-dimensional position obtained from the received configuration position information; and the content transmission unit transmits the three-dimensional image content of the credit generated by the synthesizing unit Go to the aforementioned terminal device. 如請求項2之內容提供裝置,其中更具備修正指示接收部,該修正指示接收部從前述終端裝置接收指示前述物件的配置位置或方向的修正之修正指示,前述合成部,將配信用的前述三維畫像內容中配置前述物件內容之位置或方向,因應所接收之前述修正指示作修正。 The content providing device of claim 2, further comprising: a correction instruction receiving unit that receives a correction instruction for instructing correction of an arrangement position or direction of the object from the terminal device, wherein the combining unit The position or direction of the content of the object is arranged in the three-dimensional portrait content, and is corrected in response to the received correction instruction. 如請求項2或3之內容提供裝置,其中前述記憶部係和前述物件識別資訊賦予對應,進一步記憶表示前述物件的屬性之屬性資訊,前述合成部係將從前述配置位置資訊獲得之三維上的位置,因應於和已接收的前述物件識別資訊對應 之前述屬性資訊作修正,在前述背景內容上生成將前述物件內容配置於已修正的位置之方式所合成的配信用的前述三維畫像內容。 The content providing device of claim 2 or 3, wherein the memory unit is associated with the object identification information, and further stores attribute information indicating an attribute of the object, wherein the combining unit is obtained from the configuration position information in three dimensions. Position, corresponding to the received object identification information received The attribute information is corrected, and the three-dimensional image content of the credits synthesized by arranging the contents of the object at the corrected position is generated on the background content. 如請求項4之內容提供裝置,其中前述合成部,因應於和已接收的前述物件識別資訊對應之前述屬性資訊,修正配置在配信用的前述三維畫像內容之前述物件內容的方向。 The content providing device of claim 4, wherein the synthesizing unit corrects a direction of the object content of the three-dimensional portrait content arranged in the credit according to the attribute information corresponding to the received object identification information. 如請求項4之內容提供裝置,其中前述合成部,將和配信用的前述三維畫像內容的顯示相關之屬性,因應於和已接收的前述物件識別資訊對應之前述屬性資訊作修正。 The content providing apparatus according to claim 4, wherein the synthesizing unit corrects the attribute related to the display of the three-dimensional portrait content of the credit according to the attribute information corresponding to the received object identification information. 如請求項5之內容提供裝置,其中前述合成部,將和配信用的前述三維畫像內容的顯示相關之屬性,因應於和已接收的前述物件識別資訊對應之前述屬性資訊作修正。 The content providing device of claim 5, wherein the synthesizing unit corrects an attribute relating to display of the three-dimensional portrait content of the credit according to the attribute information corresponding to the received object identification information. 如請求項2之內容提供裝置,其中更具備視聽方向資訊接收部,該視聽方向資訊接收部從前述終端裝置,接收表示使用者的方向或使用者的方向及位置之視聽方向資訊,前述內容傳送部,係從配信用的前述三維畫像內容,抽出和前述視聽方向資訊所示之前述使用者的方向,或前述使用者的方向及位置對應之區域的三維畫像內容並傳送到前述終端裝置。 The content providing device of claim 2, further comprising: a viewing direction information receiving unit that receives viewing direction information indicating a direction of the user or a direction and a position of the user from the terminal device, the content transmission The part extracts the three-dimensional image content of the area corresponding to the direction of the user indicated by the viewing direction information or the direction and position of the user from the three-dimensional image content of the credit, and transmits the content to the terminal device. 如請求項2之內容提供裝置,其中前述合成部係在接收到既定的物件識別資訊的組 合之情況,對配信用的前述三維畫像內容進行和前述組合對應之加工。 The content providing device of claim 2, wherein the aforementioned synthesizing unit is in a group that receives the predetermined object identification information In the case of the above, the three-dimensional image content of the credit is processed in accordance with the aforementioned combination. 一種內容提供方法,係為內容提供裝置所執行的內容提供方法,具有:物件資訊接收步驟,物件資訊接收部從終端裝置接收特定物件的物件識別資訊和可取得配置前述物件的畫像的三維上的位置之配置位置資訊;合成步驟,合成部在是背景的三維畫像內容的背景內容上生成配信用的三維畫像內容,該配信用的三維畫像內容係以將依已接收的前述物件識別資訊所特定之是前述物件的三維畫像內容的物件內容配置在從已接收的前述配置位置資訊所獲得之三維上的位置之方式而合成;及內容傳送步驟,內容傳送部將藉由前述合成步驟生成之配信用的前述三維畫像內容傳送到前述終端裝置。 A content providing method is a content providing method executed by a content providing device, comprising: an object information receiving step, the object information receiving unit receives object identification information of a specific object from the terminal device, and obtains a three-dimensional image of the image in which the object is configured Positioning position information; a synthesizing step, the synthesizing unit generates a three-dimensional portrait content of the credit on the background content of the three-dimensional portrait content of the background, and the three-dimensional portrait content of the credit is determined by the above-mentioned object identification information received The content of the three-dimensional portrait content of the object is arranged in a three-dimensional position obtained from the received configuration position information; and the content transfer step, the content transfer unit generates the delivery by the aforementioned synthesizing step. The aforementioned three-dimensional portrait content is transmitted to the aforementioned terminal device.
TW105113907A 2015-05-08 2016-05-05 Content provision system, content provision device, and content provision method TW201706963A (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2015095614A JP6582526B2 (en) 2015-05-08 2015-05-08 Content providing system, content providing apparatus, and content providing method

Publications (1)

Publication Number Publication Date
TW201706963A true TW201706963A (en) 2017-02-16

Family

ID=57249032

Family Applications (1)

Application Number Title Priority Date Filing Date
TW105113907A TW201706963A (en) 2015-05-08 2016-05-05 Content provision system, content provision device, and content provision method

Country Status (3)

Country Link
JP (1) JP6582526B2 (en)
TW (1) TW201706963A (en)
WO (1) WO2016181780A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7093996B2 (en) * 2018-04-30 2022-07-01 日本絨氈株式会社 Interior proposal system using virtual reality system

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3947132B2 (en) * 2003-05-13 2007-07-18 日本電信電話株式会社 Image composition display method, image composition display program, and recording medium recording this image composition display program
JP2010218107A (en) * 2009-03-16 2010-09-30 Toppan Printing Co Ltd Panorama vr file providing apparatus, program, method, and system
JP5857946B2 (en) * 2012-11-30 2016-02-10 カシオ計算機株式会社 Image processing apparatus, image processing method, and program

Also Published As

Publication number Publication date
JP6582526B2 (en) 2019-10-02
WO2016181780A1 (en) 2016-11-17
JP2016212621A (en) 2016-12-15

Similar Documents

Publication Publication Date Title
US10579134B2 (en) Improving advertisement relevance
CN107430767B (en) The system and method that Photo Filter is presented
CN104641399B (en) System and method for creating environment and for location-based experience in shared environment
US10868977B2 (en) Information processing apparatus, information processing method, and program capable of adaptively displaying a video corresponding to sensed three-dimensional information
US9195677B2 (en) System and method for decorating a hotel room
JP6720385B1 (en) Program, information processing method, and information processing terminal
JP2019200627A (en) Data processing program, data processing method, and data processor
JP6665402B2 (en) Content display terminal, content providing system, content providing method, and content display program
KR20190033705A (en) System for providing AR photo zone
WO2014027433A1 (en) Information provision device, information provision method, and program
Rigby et al. Augmented reality challenges for cultural heritage
WO2016181783A1 (en) Content distribution system, content distribution device, and content distribution method
KR20180029690A (en) Server and method for providing and producing virtual reality image about inside of offering
JP2015099545A (en) Image generation system and image generation program
JP6699709B2 (en) Information processing device and program
JP6617547B2 (en) Image management system, image management method, and program
TW201706963A (en) Content provision system, content provision device, and content provision method
Fan et al. HiFi: hi de and fi nd digital content associated with physical objects via coded light
US10796459B2 (en) Information processing apparatus and non-transitory computer readable medium for executing information processing
JP2017168132A (en) Virtual object display system, display system program, and display method
US20190113871A1 (en) Information processing apparatus and non-transitory computer readable medium
US20220114753A1 (en) Blended physical and virtual realities
TW202201224A (en) Interaction method based on optical communictation device, electric apparatus, and computer readable storage medium
KR20150090351A (en) Video producing service device based on contents received from a plurality of user equipments, video producing method based on contents received from a plurality of user equipments and computer readable medium having computer program recorded therefor