TWM403706U - Simulation system for 3D face image - Google Patents

Simulation system for 3D face image Download PDF

Info

Publication number
TWM403706U
TWM403706U TW99218889U TW99218889U TWM403706U TW M403706 U TWM403706 U TW M403706U TW 99218889 U TW99218889 U TW 99218889U TW 99218889 U TW99218889 U TW 99218889U TW M403706 U TWM403706 U TW M403706U
Authority
TW
Taiwan
Prior art keywords
image
face
dimensional
facial
module
Prior art date
Application number
TW99218889U
Other languages
Chinese (zh)
Inventor
Yeong-Sung Lin
Original Assignee
Tlj Intertech Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tlj Intertech Inc filed Critical Tlj Intertech Inc
Priority to TW99218889U priority Critical patent/TWM403706U/en
Publication of TWM403706U publication Critical patent/TWM403706U/en

Links

Landscapes

  • Processing Or Creating Images (AREA)

Abstract

Provided is a simulation system for 3D face image, which comprises a 3D object module, an image capturing module, an image analysis module, an image simulation module and a display module, wherein the 3D object module is utilized for generating a 3D object having a face, the image capturing module is utilized for capturing the face image of an user, the image analysis module is utilized for analyzing the posture, facial expression, brightness, contrast, chromaticity and saturation of the face image to generate a face image data, the image simulation module is utilized for analyzing the face image data and the face contour of the 3D object to modify the face image data and post the modified face image data on the face of the 3D object such that a 3D simulation object of the face image data of the user is generated, and the display module is utilized for displaying 3D simulation object of the face.

Description

M403706 五、新型說明: 【新型所屬之技術領域】 本創作係關於一種三維臉部影像模擬系統,更詳而言 之,係為一種於三維物件的臉部產生使用者之三維臉部模 擬影像之影像模擬系統。 【先前技術】 由於消費者對娛樂品質的要求越來越高,眾家廠商也 莫不積極地投入大量的研發成本,以期能提供消費者更好 的視覺娛樂產品。 像是時下非常流行的數位式互動遊戲機,由於其具有 可供使用者配戴之操縱器,以及專門用以感應該操縱器位 置之感應器,故可令遊戲晝面中的三維人型物件(例如數 位人偶)即時地隨著使用者的肢體擺動產生動作,進而令 使用者感受到猶如至身處遊戲中的逼真效果。美中不足的 是,由於遊戲畫面中之三維人型物件僅具有粗糙的外觀輪 廓,故無法讓使用者對其產生足夠的認同感。 較為可行的解決方法是,將三維人型物件的臉部模擬 成使用者之臉部特徵。以現有的影像技術而言,此種方法 需先建置使用者的照片資料集後,接著方可藉由相關的影 像剪輯軟體將照片資料集中之照片合成於三維人型物件 上,爾後,再將合成後之三維人型物件儲存於遊戲軟體中。 然而,由於此種作法需要大量的事前作業,因此會大大地 增加遊戲的製作時間與製作成本,故實用性不高。再者, 由此種作法合成出的三維人型物件的表情會受到照片資料 M403706 集的限制,因此,不但無法提供使用者較豐富的表情變 也無法即時地反應出使用者的各種臉部表情,仍然無、’ 使用者產生高度的認同感。 、讓 有幾於此,如何提供一種三維臉部影像模擬系统 但也増加遊戲軟體與使用者的互動性’亦可提古j吏 不 遊戲軟體的認同度,亟為各界所急待解決之課題。用者對 【新型内容】 鑒於上述習知技術之缺點,本創作提供一 影像模擬系統,係包括:三維物件模組,係:::臉部 臉部之三維物件;影像擷取模組,係用以 生具有 部影像;影像分析模組,係^ 表情、亮度、對比、彩度或飽和度 臉:的安態、 維物件―進行分析===、 訊,並將修正後之該使用者之臉部;= 該三維物件的臉部,俾產生具有 =覆於 物件。 係心顯不該三維模擬 於本創作之一實施態樣中 棟取該使用者不同表情的臉部影像即時地 分析以產生該臉部影像資訊,而=二像分析模組 二 ==:=:維物件的臉部輪 部影像資訊貼覆於修正後之該三維物件:^表情的臉 5 讀使用去創作之另一實施態樣中,該影像分析模組係分析 部影像A之臉部影像以產生該使用者不同表情之複數個臉 的臉部5訊而§該影像擷取模組取出該使用者不同表情 生像時’該影像模擬模組係由該影像分析模組所產 對稱正Ιί情之複數個臉部影像資訊中取出表情相對應之 的臉部:像並對所取出之臉部影像資訊與該 三維物件 表情的崎邪進订分析及修正,俾將修正後之該使用者不同 此:部影像資訊貼覆於修正後之該三維物件的臉部。 建模級,/本創作之二維臉部影像模擬系統復包括影像重 該使用去係用以對該使用者之臉部影像進行 重建,以產生 正臉影#之對稱正臉影像,而該影像分析模組係對該對稱 紐是進行分析以產生該臉部影像資訊。該影像重建模 時啟爾該影像榻取模組所操取之臉部影像為非正臉狀態 、β用於對該使用者不同表情的臉部影像進行重建, 以提供該,讀分析模組分析並產生該臉部影像資訊。 據此,本創作之二維臉部影像模擬系統,可利用三維 物件模、组、影像操取模、组、影像分析模组、影像模擬模:、 及顯不模組的交互搭配,能即時地顯示具有該使用者之對 稱正臉影狀三_擬物件m更透㈣像重建模 組重建非正臉之臉部影像’以供該影像模擬模組進行後續 修正調整及貼覆於二維物件上,如此,不但實用性佳,更 提高使用者與遊戲軟體的互動性,並可讓使用者對遊戲軟 體產生高度的認同感。 【實施方式】 M403706 以下係藉由特定的具體實施例說明本創作之技術内 容,熟悉此技藝之人士可由本說明書所揭示之内容輕易地 暸解本創作之其他優點與功效。本創作亦可藉由其他不同 的具體實例加以施行或應用,本說明書中的各項細節亦可 基於不同觀點與應用,在不悖離本創作之精神下進行各種 修飾與變更。 請同時參閱第1圖、第2圖、第3A圖、第3B圖,及 第4圖。其中,第1圖係為本創作之三維臉部影像模擬系 • 統之基本系統架構圖,第2圖係為本創作之三維臉部影像 模擬系統產生之三維物件之示意圖,第3A圖係為本創作之 三維臉部影像模擬系統擷取之使用者之臉部影像之示意 圖,第3B圖係為本創作之三維臉部影像模擬系統建置之使 用者之正臉影像之示意圖,而第4圖係為本創作之三維臉 部影像模擬系統產生之三維模擬物件之示意圖。 如第1圖所示,三維臉部影像模擬系統1係包括三維 • 物件模組10、影像擷取模組11、影像分析模組12、影像 模擬模組13、及顯示模組14。 所述之三維物件模組10,係用以產生至少一具有臉部 的三維物件,於本實施例中,該三維物件係可為如第2圖 所示之三維人型物件a。隨著使用者的需求,三維人型物 件a中可塗布有花紋及/或色澤,當然,於本實施例之其他 實施態樣中,三維物件模組10亦可產生具有臉部的三维獸 型物件或三維人獸型物件。 所述之影像擷取模組11,係用以擷取使用者之臉部影 7 M403706 像’於本實施^,影像練模組u係可例如為數位攝爹 機’並設置於筆記型電腦上,而所擷取出 ㈣ 影像,可為如第3A圖所示之臉部影像bl。1體^臉^ :取模組U所擷取出的使用者之臉部影像:可為 臉。P影像或具有任何偏轉角度的臉部影像惟,具偏 度的臉部影像需透過預先處理才能進行影像模擬了 於後詳述。 、 W乃式 影像分析模組12,係用以分析該臉部影像的姿態、表 度對比、讀或飽和度,以產生臉部影像資訊, 二中,該影像分龍組12可針對全部或局部臉部影像進行 立2由於該衫像_取模組U係於不同環境下操取到該臉 ㈣像’因此’由該影像分析模組12對各種型態作分析而 產生該臉部f彡像tlfl,麟臉部縣f tfi更容胃進行後續 如貼覆、融合等影像處理。 影像模擬模組13,係藉由預定的分析法對該使用者之 臉。卩影像資訊及該三維物件的臉部輪廓進行分析,以修正 5周整該使用者之臉部影像資訊,並將修正後之該使用者之 臉。卩影像資訊貼覆於該三維物件的臉部,進而產生臉部為 該使用者之臉部影像資訊之三維模擬物件。 舉例而言,若該影像擷取模組11所擷取之臉部影像為 使用者的正面臉部影像時,該影像模擬模組13可對如第 3B圖所示之之正臉影像b2以及如第2圖所示之三維人型 物件a的臉部輪磨進行綜合性的尺寸差異分析,並於分析 出正臉影像b2及三維人型物件a的臉部輪廓間的尺寸差異 示 臉影像b2之尺寸調整成符合三維人型物件a的臉 廓1尺寸’祕尺寸_修錢之正臉料Μ貼覆於 :’”人里物件a的臉部’如類似拉皮動作 為該使用者之正臉影像於之三維模擬物件c,如第 此時,衫像模擬模組13即可將正 :=至整成符合三維人型物件a的臉部輪靡之 面積經過修正後之正臉影像b2貼覆於三維 人型物件a的臉部。 芦 八折岐’本創作之影像模擬模組13係依據三维 =^====: 其次,影像模_組13還可依據特定之融合比例 型物;=件C進行融合處理。舉例來說,若三維人 之正臉旦…有斑點化紋,則當影像模擬模組13將修正後 紋相似之槿掇〜 、一维人型物件a之斑點花 的需求有所該模擬花紋的融合度係可隨使用者 之正臉影像^" #此’進—步使二賴擬物件C _貼覆 使用者背景之三維人型物件a中,以提供 此外,影像模_組13復可對其產生之三維模擬物件 -M403706 進仃邊緣柔化處理,以第4㈣示之三賴擬物件。為例 說月田衫像模擬模組13修正後之該使用者之正臉景 =貼覆於三維人型物件a的臉料,可同步地柔化正臉影 b2及三維人型物件a的交界線條及紋理進一步消除邊 緣:一致的突兀感,藉此提高使用者的認同感。當然,亦 =遺使用麵設定對三維類物件e的整财條及紋理進 行相應的柔化。 阳所述之顯示模組14 - 丨小川从网不刖返之臉部為該使 臉影叙三__件,財實施财,顯示模 4暮Γ以顯示如第4圖所示之三維模擬物件c的液 =臉=本創作可即時地提供使用者臉部為該使用 〜象的_維模擬物件,令使用者與其產生互動。 需在此提出說明的是’於本實施例之—實施 影像操取模組11係可即時地擷取❹者列表㈣臉部 分析模組分析以產生臉部影像資訊。而 〜像模浦組13復可進—步對該使用者不同 =像資訊及三維物件的臉部輪廓進行分析,以修正該使用 ===影像資訊及該三維物件的臉,並 之紅维物件的=同表情的臉部影像資訊貼覆於修正後 地斜=:::本實施態樣中,影像擷取模組11可持續 使用者歡喜、憤=不^表情的影像銳,以即時地摘取出 旦Μ象八析;组;、衣傷、或快樂的臉部影像;接著,由 々像刀賴組12依據影像摘取模組η所_之使用者歡 M403706 偏轉60度,此時,該影像重建模組即可利用臉部影像bl 重建出臉部中心線偏轉0度之正臉影像b2,如第3B圖所 示。 於一實施例中,該影像重建模組對該使用者不同表情 的臉部影像進行重建,俾產生該使用者不同表情的正臉影 像5並由該影像分析模組12分析以產生該臉部影像貢訊’ 而該影像模擬模組13復用以對該使用者不同表情的臉部 影像資訊及該三維物件的臉部輪廓進行分析並修正,以將 • 修正後之該使用者不同表情的臉部影像資訊貼覆於修正後 之該三維物件的臉部。簡單來說,於該影像擷取模組11所 擷取之臉部影像非正臉時,透過影像重建模組進行重建, 後續臉部影像資訊與前述相似,故不再贅述。 於另一實施例中,該影像重建模組係用以對該使用者 之臉部影像進行重建,俾產生該使用者不同表情之複數個 正臉影像,並由該影像分析模組12分析以產生複數個臉部 I 影像資訊,而當該影像擷取模組11擷取出該使用者不同表 "情的臉部影像時,該影像模擬模組13係由該影像分析模組 12所產生之不同表情之複數個臉部影像資訊中取出表情相 對應之臉部影像資訊,並對所取出之該臉部影像資訊與該 三維物件的臉部輪廓進行分析與修正,再將修正後之該使 用者不同表情的臉部影像資訊貼覆於修正後之該三維物件 的臉部。簡單來說,於該影像擷取模組11所擷取之臉部影 像非正臉時,透過影像重建模組進行重建為正臉影像,而 後續產生複數個臉部影像資訊則與前述相似,故不再贅述。 13 M403706 需補充的是’本創作之三維臉部影像模擬系統i復可選擇 有影像調整模組(未圖示),以藉由該影像調整模 产較2 組11所擷取之臉部影像進行亮度及/或彩 。換言之,影像調整模组可自動調整影像 =組11所擷取之臉部影像之亮度及/或彩度,進一步 組11賴取之臉部影像更為清晰,更利於後 頊的重建及分析之進行。 本創作之三維臉部影像模㈣統1復可設置聲音 騎模組(未圖式)’係用喃取該使用者之聲音資訊並透 〜聲音資訊與該臉·像資訊之對應關係資訊,以由該 聲音資訊取得所對應之臉部影像資訊。具體來說,透過= =擷取模^使用者聲音的擷取,以及利用預存對應關〆 '、貝訊的》析’错此取得該使用者可能口形,如此 部影像資訊中的口部影像形成更貼近於真實影像。 另外,前述提及依據特定之融合比例進行影像融合, f方法有兩種。第-種方式係該影賴_組13復依據 定之融合比例對已貼覆該使用者之臉部影像資訊之該三維 模擬物件進仃融合處理,亦即將該影像錄模組11所取 P影像貼覆於三維物件並形成該三維模擬物件再進行融 口。此外,第二種方式係該影像模擬模組13 2比例將該使用者之臉部綱訊與該影像分 2之複數個臉部影像資訊之-者進行融合,以貼覆“ *.,物件之臉部’ D魏,依據所齡 已館存的複數個臉部影像資訊(如前述記憶體 14 M403706 最後再 並與該影像操取模組11所娜臉部影像進行融合, 貼覆於該三維物件之臉部。 邱2外’該影像模擬模組13復係將該臉部影像資訊之局 取(亦可同時施予變形),並貼覆於該三維物 整體之,該影像模擬模組13不僅可將臉部影像 、覆㈣二維物件之臉部’村將M403706 V. New description: [New technical field] This creation is about a three-dimensional facial imaging simulation system. More specifically, it is a three-dimensional facial simulation image of a user's face on a three-dimensional object. Image simulation system. [Prior Art] As consumers' demands for entertainment quality are getting higher and higher, many manufacturers are not actively investing in a large amount of research and development costs, in order to provide consumers with better visual entertainment products. Like the popular digital interactive game console, it has three-dimensional humanoids in the game because of its user-operated manipulator and the sensor that is used to sense the position of the manipulator. Objects (such as digital figures) instantly move with the user's limbs, which in turn makes the user feel as if they were in the game. The fly in the ointment is that because the three-dimensional humanoid objects in the game screen only have a rough appearance, it is not enough for the user to have a sense of identity. A more feasible solution is to simulate the face of a three-dimensional human object as a facial feature of the user. In the existing image technology, this method needs to first set up the user's photo data set, and then the related image editing software can combine the photos in the photo data into the three-dimensional human object, and then The synthesized three-dimensional human object is stored in the game software. However, since this method requires a large amount of prior work, it greatly increases the production time and production cost of the game, so the practicality is not high. Furthermore, the expression of the three-dimensional human object synthesized by this method is limited by the photo material M403706 set, so that not only the user's rich expression but also the user's various facial expressions cannot be immediately reflected. , still no, 'users have a high degree of identity. Here, how to provide a three-dimensional facial image simulation system, but also the interaction between the game software and the user's can also mention the recognition of the ancient j吏 not game software, and it is an urgent issue for all walks of life. . User Pair [New Content] In view of the above-mentioned shortcomings of the prior art, the present invention provides an image simulation system including: a three-dimensional object module, which is:: a three-dimensional object of a facial face; an image capturing module, Used to produce part of the image; image analysis module, ^ expression, brightness, contrast, chroma or saturation face: the state, dimension object - analysis ===, message, and the revised user The face; = the face of the three-dimensional object, the 俾 produces with = over the object. The system is not in the three-dimensional simulation. In one implementation of the present invention, the facial image of the user's different expressions is immediately analyzed to generate the facial image information, and the second image analysis module 2 ==:= The image information of the facial wheel of the object is attached to the corrected three-dimensional object: ^ The face of the expression 5 is read and used to create another embodiment, the image analysis module is the face of the image A of the analysis section The image is generated by the face 5 of the plurality of faces of the user with different expressions. § The image capturing module extracts the different expressions of the user. The image simulation module is symmetrically produced by the image analysis module. The face corresponding to the expression is extracted from the plurality of facial image information of the Ι情: the image and the extracted facial image information and the analysis and correction of the three-dimensional object expression, which will be corrected The user is different: the image information is attached to the face of the corrected three-dimensional object. The modeling level, the two-dimensional facial image simulation system of the present invention includes an image re-use to reconstruct the facial image of the user to generate a symmetric positive face image of the positive face shadow, and the The image analysis module analyzes the symmetric button to generate the facial image information. When the image is re-modeled, the facial image acquired by the image capturing module is a non-positive face state, and β is used to reconstruct the facial image of the user with different expressions to provide the reading analysis mode. The group analyzes and generates the facial image information. Accordingly, the two-dimensional facial image simulation system of the present invention can utilize three-dimensional object model, group, image manipulation mode, group, image analysis module, image simulation mode: and interactive module matching, which can be instantly The display shows that the user has a symmetric positive face shape, and the image reconstruction module rebuilds the face image of the non-positive face for subsequent correction and adjustment of the image simulation module and is applied to the two-dimensional image. On the object, this is not only practical, but also enhances the interaction between the user and the game software, and allows the user to have a high sense of identity with the game software. [Embodiment] The following is a description of the technical content of the present invention by a specific embodiment, and those skilled in the art can easily understand other advantages and effects of the present invention by the contents disclosed in the present specification. The present invention can also be implemented or applied by other specific examples. The details of the present specification can also be modified and changed without departing from the spirit of the present invention. Please also refer to Figure 1, Figure 2, Figure 3A, Figure 3B, and Figure 4. Among them, the first picture is the basic system architecture diagram of the three-dimensional facial imaging simulation system of the creation, and the second figure is the schematic diagram of the three-dimensional object generated by the three-dimensional facial image simulation system of the creation, and the third figure is The schematic diagram of the user's facial image captured by the 3D facial image simulation system of the present invention, and the 3B image is a schematic diagram of the user's positive face image built by the created 3D facial image simulation system, and the 4th figure The diagram is a schematic diagram of a three-dimensional simulated object generated by the created three-dimensional facial image simulation system. As shown in FIG. 1, the three-dimensional facial imaging simulation system 1 includes a three-dimensional object module 10, an image capturing module 11, an image analyzing module 12, an image sensing module 13, and a display module 14. The three-dimensional object module 10 is configured to generate at least one three-dimensional object having a face. In the embodiment, the three-dimensional object can be a three-dimensional human object a as shown in FIG. The three-dimensional object member a can be coated with a pattern and/or a color according to the needs of the user. Of course, in other embodiments of the embodiment, the three-dimensional object module 10 can also generate a three-dimensional animal shape having a face. Object or three-dimensional human animal type object. The image capturing module 11 is used to capture the facial shadow of the user. 7 M403706 is like 'in this implementation ^, the imaging training module u can be, for example, a digital camera' and is set in the notebook computer. The image is taken as the face image bl as shown in Fig. 3A. 1 body ^ face ^: Take the image of the user's face taken out by the module U: it can be the face. P-images or face images with any deflection angle. Only face images with skewness must be pre-processed for image simulation. The W-type image analysis module 12 is configured to analyze the posture, the contrast, the reading or the saturation of the facial image to generate facial image information. In the second, the image splitting group 12 can be directed to all or The partial facial image is performed as the face 2 is obtained by the image capturing module U in different environments. The image is generated by the image analyzing module 12 to analyze the various types. Like tlfl, Lin Faxian County f tfi is more suitable for stomach processing such as overlaying, fusion and other image processing. The image simulation module 13 is a face of the user by a predetermined analysis method. The image information and the facial contour of the three-dimensional object are analyzed to correct the facial image information of the user for 5 weeks, and the corrected user's face is corrected. The image information is attached to the face of the three-dimensional object, thereby generating a three-dimensional simulated object whose face is the facial image information of the user. For example, if the facial image captured by the image capturing module 11 is the front facial image of the user, the image simulation module 13 can display the positive facial image b2 as shown in FIG. 3B and The face wheel grinding of the three-dimensional human object a shown in Fig. 2 performs a comprehensive dimensional difference analysis, and analyzes the difference in size between the facial contour b2 and the facial contour of the three-dimensional human object a. The size of b2 is adjusted to conform to the face 1 size of the three-dimensional human object a. The secret size _ the face of the money is affixed to: ''the face of the object a' is like a pull-up action for the user The positive face image is in the three-dimensional simulation object c. For example, at the same time, the shirt image analog module 13 can be positive: = to the face of the face rim corresponding to the three-dimensional human object a. The image b2 is attached to the face of the three-dimensional human object a. The image simulation module 13 of the creation is based on three-dimensional =^====: Second, the image mode group 13 can also be based on a specific fusion. Proportional type; = part C for fusion processing. For example, if a three-dimensional person's face is... there is a speckle pattern, then The image simulation module 13 will correct the post-patterned 槿掇~, the requirement of the speckle flower of the one-dimensional human object a. The fusion degree of the simulated pattern can be followed by the user's positive face image ^"#此' - stepping the object C _ to the user object in the three-dimensional human object a to provide, in addition, the image mode group 13 can be used to generate the three-dimensional simulation object - M403706 edge edge softening treatment, The fourth (four) shows the third object. For example, the positive face of the user after the correction of the model of the moonlight shirt 13 is applied to the face of the three-dimensional human object a, and the face can be softened simultaneously. The boundary line and texture of the shadow b2 and the three-dimensional human object a further eliminate the edge: a uniform sense of abruptness, thereby enhancing the user's sense of identity. Of course, also using the face to set the whole financial strip and texture of the three-dimensional object e Corresponding to the softening. The display module 14 described by Yang: 脸小川 from the net does not return to the face for the face to make the face __ pieces, financial implementation, display 暮Γ 4暮Γ to display as the fourth The liquid of the three-dimensional simulation object c shown in the figure = face = this creation can provide the user's face instantly The use of the image-like analog object allows the user to interact with it. It is to be noted that in the present embodiment, the image manipulation module 11 is implemented to instantly capture the list of subjects (4) the face. Analyze the module analysis to generate facial image information. And the image module 13 can be used to analyze the face contour of the user=image and three-dimensional object to correct the use===image information And the face of the three-dimensional object, and the red-dimensional object=the facial image information of the same expression is attached to the corrected ground oblique =::: In this embodiment, the image capturing module 11 can be enjoyed by the user continuously, Indignation = not ^ the image of the expression is sharp, in order to extract the image of the elephant; the group; the clothing injury, or the happy face image; then, the image extraction module η according to the image The user's joy M403706 is deflected by 60 degrees. At this time, the image reconstruction module can reconstruct the face image b2 of the face center line deflection by 0 degrees using the face image bl, as shown in FIG. 3B. In an embodiment, the image reconstruction module reconstructs the facial image of the user with different expressions, generates a positive face image 5 of the user's different expressions, and analyzes the image analysis module 12 to generate the face. The image simulation module 13 is multiplexed to analyze and correct the facial image information of the user's different expressions and the facial contour of the three-dimensional object, so as to correct the different expressions of the user. The facial image information is attached to the face of the corrected three-dimensional object. In brief, when the facial image captured by the image capturing module 11 is not normal, the image reconstruction module performs reconstruction, and the subsequent facial image information is similar to the foregoing, and thus will not be described again. In another embodiment, the image reconstruction module is configured to reconstruct a facial image of the user, and generate a plurality of positive facial images of different expressions of the user, and analyze the image analysis module 12 by the image analysis module 12 A plurality of facial I image information is generated, and when the image capturing module 11 extracts the facial image of the user's different table, the image simulation module 13 is generated by the image analyzing module 12 Extracting facial image information corresponding to the expression in a plurality of facial image information of different expressions, and analyzing and correcting the extracted facial image information and the facial contour of the three-dimensional object, and then correcting the corrected The facial image information of the user's different expressions is attached to the corrected face of the three-dimensional object. Briefly, when the facial image captured by the image capturing module 11 is not a normal face, the reconstructed image is reconstructed into a positive face image by the image reconstruction module, and subsequent generation of a plurality of facial image information is similar to the foregoing. Therefore, it will not be repeated. 13 M403706 It should be added that 'the 3D facial image simulation system of this creation can be selected with an image adjustment module (not shown) to adjust the facial image captured by the model 11 by the image. Perform brightness and/or color. In other words, the image adjustment module can automatically adjust the brightness and/or chroma of the image captured by the image=group 11, and further improve the facial image of the group 11 to facilitate the reconstruction and analysis of the posterior image. get on. The three-dimensional facial image mode (4) of the creation can be set up to set the sound riding module (not shown) to take the user's voice information and to transmit the information of the correspondence between the sound information and the face information. The facial image information corresponding to the sound information is obtained. Specifically, through the == capture module ^ user's voice capture, and use the pre-stored corresponding relationship ', Beixun's analysis' error to obtain the user's possible mouth shape, the mouth image in such image information Formed closer to the real image. In addition, the aforementioned reference performs image fusion according to a specific fusion ratio, and there are two methods of f. The first method is the processing of the three-dimensional simulated object that has been attached to the user's facial image information according to the predetermined fusion ratio, that is, the P image captured by the video recording module 11 The three-dimensional object is attached to the three-dimensional object and the fuse is formed. In addition, the second method is that the image simulation module 132 combines the facial contour of the user with the plurality of facial image information of the image to cover the "*., object. The face 'D Wei, according to the age of the library has stored a number of facial image information (such as the memory 14 M403706 finally combined with the image of the image manipulation module 11 facial image, attached to the The face of the three-dimensional object. The image simulation module 13 is used to capture the facial image information (may also be deformed at the same time) and is attached to the whole of the three-dimensional object. Group 13 can not only face the image, but also cover the face of the (four) two-dimensional object

後貼覆,所謂局部區域係指如目叫、鼻取 可提供❹者適物㈣三__件线m’如此 Γ ’本創作之之三維臉部影像模擬系統,利用 二、隹物件扠組、影像擷取模組、 用 模組、及顯示模組的交互搭配,;:;= 且、影像模擬 ._ ^ j即時地於該三維物件楛 :所產生之三維物件的臉部生成使用者之三維臉部模擬旦; 時,更可透㈣像重_組對所提供的臉部景^ t重建以產生該❹者之正臉影像,以供後續貼覆於ί _物件上’相較於先前技術,本創作不但實用性甚佳: 更提两❹者與遊躲體的互Μ,並可讓使用者對 軟體產生高度的認同感。 5 以上所述之實施例’僅係以說明本創作之特點及功 效,而非用以限定本創作之實質技術内容的範圍,本創作 之實質技術内容係廣義地定義於下述之_請專利範圍中, 任何他人所完成之技術實體或方法,若與下述之所卜主專 利範圍定義者為完全相同、或是—種等效之變更,均^被 視為涵蓋於此專利範圍中。 【圖式簡單說明】 15 M403706 第1圖係為本創作之三維臉部影像模擬系統之基本系 統架構圖; 第2圖係為本創作之三維臉部影像模擬系統產生之三 維物件之示意圖; 第3A圖係為本創作之三維臉部影像模擬系統擷取之 使用者之臉部影像之示意圖; 第3B圖係為本創作之三維臉部影像模擬系統建置之 使用者之正臉影像之示意圖;以及 第4圖係為本創作之三維臉部影像模擬系統提供之三 維模擬物件之示意圖。 【主要元件符號說明】 1 三維臉部影像模擬系統 10 三維物件模組 11 影像擷取模組 12 影像分析模組 13 影像模擬模組 14 顯示模組 a 三維人型物件 bl 臉部影像 b2 正臉影像 c 三維模擬物件 16Post-laying, the so-called local area means that the eye can be provided as a target, the nose can provide the appropriate object (four) three __ piece line m' so Γ 'This creation of the three-dimensional facial imaging simulation system, using the second, 隹 object fork group , image capture module, module, and display module interaction;;;; = and image simulation. _ ^ j immediately in the three-dimensional object 楛: the generated face of the three-dimensional object generation user The three-dimensional face is simulated; when it is more transparent, the image of the face is reconstructed to generate the face image of the latter for subsequent attachment to the ί _ object. In the prior art, this creation is not only very practical: it also mentions the mutual ambiguity between the two and the sneak peek, and allows the user to have a high degree of identity with the software. The above described embodiments are merely for the purpose of illustrating the features and functions of the present invention, and are not intended to limit the scope of the technical content of the present invention. The technical content of the present invention is broadly defined as follows. To the extent that any technical entity or method performed by another person is identical or equivalent to the definition of the main patent scope described below, it is considered to be covered by this patent. [Simple description of the picture] 15 M403706 The first picture is the basic system architecture diagram of the three-dimensional facial imaging simulation system of the creation; the second picture is the schematic diagram of the three-dimensional object generated by the three-dimensional facial imaging simulation system of the creation; 3A is a schematic diagram of the facial image of the user captured by the created three-dimensional facial imaging simulation system; FIG. 3B is a schematic diagram of the positive facial image of the user created by the created three-dimensional facial imaging simulation system And Figure 4 is a schematic diagram of the 3D simulation object provided by the 3D facial image simulation system of the creation. [Main component symbol description] 1 3D face image simulation system 10 3D object module 11 Image capture module 12 Image analysis module 13 Image simulation module 14 Display module a 3D human object bl Face image b2 Face Image c 3D simulation object 16

Claims (1)

M403706 六、申請專利範圍: 1. 一種三維臉部影像模擬系統,係包括: 三維物件模組,係用以產生具有臉部的三維物件; 影像擷取模組,係用以擷取使用者之臉部影像; 影像分析模組,係用以分析該臉部影像的姿態、表 清、冗度、對比、彩度或飽和度,以產生臉部影像資訊 影像模擬模組,係對該使用者之臉部影像資訊及該 三維物件的臉部輪廓進行分析,以修正調整該使用者之 臉部影像資訊’並將修正後之該使用者之臉部影像資訊 貼覆於該三維物件的臉部’俾產生具有該使用者之臉部 影像資訊的三維模擬物件;以及 。 顯不模組,係用以顯示該三維模擬物件。 2. ,申4專利範圍第丨項所述之三維臉部影像模擬系 統’其中’該影像操取模組即時地擷取該使用者不 情的臉部影像,並由鄉像分析频分析以產生該臉二 二像資訊’㈣影像模擬馳復用以對該制者 =的臉部影像f訊及心維物㈣臉部财卩進行、 y修正,以將修正後之該使用者不同表情 ㈣覆於修正後之該三維物件的臉部。 &像貝 •如申請專利1項所狀三維臉部影像模輕备 係分析該使用者之臉部影像 該影像_=表二==資:, 時,該影像 17 M403706 表情之複㈣臉部影像資财取出 影像資訊’並對所取出之該臉部影像資訊與c 的臉部輪廟進行分析與修正,再將修正後之件 同表情的臉部影像資訊貼覆於修正後之1用者不 臉部。 I正後之該三維物件的 4.如申請專利範圍第! 統’復包括影像重建模組,係用以::像模擬系 像進行重建,以產生該使用者之正臉影像,=臉部影 :模_如臉影像進行分析以產生該::: 5·如申請專利範圍第4項所述之 # 統,其中,該影像重建模組對該使用者°:像模擬系 影像進行重建,俾產生概时 =表情的臉部 資訊及該三維物件的驗部輪廊\者行=析^臉部影像 後之該三維物件的臉部。 像#訊貼覆於修正 6·:申:專:範圍第4項所述之三維 ,、充其中’鄉像线触_叫 ^系 ΐ進二重二’俾產生該使用者不同表情之複數個正:: =:=分析模組分析以產生複數個臉部影:ί 部影像田時二ί 組擁取出該使用者不同表情的臉 像模擬模組係由該影像分析模組所產生 之臉部=數:對::影像資訊中取*表情相對應 維物件的臉部^出之該臉部影像資訊與該三 用者不同表情與修正,再將修正後之該使 物件的臉部像貝訊貼覆於修正後之該三維 7.如申請專利範圍第1、2、q A r 部影像模irn + n或6項料之三維臉 析運箕告料— 7象模擬模組係依據三維分 進行包含特二影像資訊及該三維物件的臉部輪廓 統,復包括影像調整模纟用維臉〜像杈擬系 掘取之臉抑模組所 整。 心度或飽和度之較佳化調 9.如申清專利範圍第1頂所、^ 統,其心擬^^=模擬系 進行邊緣柔化處理。H產生之二維模擬物件 1〇.如申請專利範園第9項所述之三維臉部影像模擬季 統,其中,該影像模擬模組所進行的邊緣柔化處理’俘 於該使用者之臉部影像資訊貼 系 時’同步地柔化該使用者之臉部影像; 之交界線條及紋理。 —摘件 1L如^•專利_第丨項所述之三维臉部 統,其中,該影像模擬模組復依據特定之融合比例^ 貼覆該使用者之臉部影像資訊之該三轉=已 19 M403706 融合處理。 12. 如申請專利範圍第3或6項所述之三維臉部影像模擬系 統,其中,該影像模擬模組復依據特定之融合比例將該 使用者之臉部影像資訊與該影像分析模組所產生之複 數個臉部影像資訊之一者進行融合,以貼覆於該三維物 件之臉部。 13. 如申請專利範圍第1項所述之三維臉部影像模擬系 統,其中,該影像模擬模組復將該臉部影像資訊之局部 區域進行擷取或同時施予變形,並貼覆於該三維物件之 臉部。 14. 如申請專利範圍第1項所述之三維臉部影像模擬系 統,其中,該三維物件係為三維人型物件、三維獸型物 件、或三維人獸型物件。 15. 如申請專利範圍第1項所述之三維臉部影像模擬系 統,其中,該影像擷取模組係為數位攝影機,而該顯示 模組係為液晶榮幕。 16. 如申請專利範圍第1項所述之三維臉部影像模擬系 統,其中,復包括聲音擷取模組,係用以擷取該使用者 之聲音資訊並透過該聲音資訊與該臉部影像資訊之對 應關係資訊,以由該聲音資訊取得所對應之臉部影像資 訊0 20M403706 VI. Patent Application Range: 1. A three-dimensional facial imaging simulation system, comprising: a three-dimensional object module for generating a three-dimensional object having a face; an image capturing module for capturing a user Face image; image analysis module is used to analyze the posture, appearance, redundancy, contrast, chroma or saturation of the face image to generate a facial image information image simulation module for the user The facial image information and the facial contour of the three-dimensional object are analyzed to correct and adjust the facial image information of the user', and the corrected facial image information of the user is attached to the face of the three-dimensional object. '俾 generating a three-dimensional simulated object having facial image information of the user; and. The display module is used to display the three-dimensional simulation object. 2. The three-dimensional facial imaging simulation system described in the fourth paragraph of the patent application scope of the invention, wherein the image manipulation module captures the facial image of the user in an instant, and analyzes the image by the rural image analysis. The face image information of the face is generated. (4) The image is simulated and multiplexed to perform the face image f signal and the heart material object (4) face money, and the y correction is performed to correct the different expressions of the user after the correction. (4) Covering the face of the corrected three-dimensional object. & like the sample of the 3D facial image model of the patent application, the image of the face of the user is analyzed. _=Table 2 == capital:, when the image is 17 M403706 complex face (four) face The image information is taken out of the image information', and the facial image information taken out and the face wheel temple of c are analyzed and corrected, and the corrected facial image information of the expression is attached to the corrected 1 The user does not have a face. I am the third dimension of the object 4. As claimed in the patent scope! The system includes an image reconstruction module for: reconstructing like a simulated image to generate a positive face image of the user, = face shadow: mode _ such as face image analysis to generate the ::: 5 According to the fourth embodiment of the patent application scope, wherein the image reconstruction module reconstructs the user: image of the simulation system, and generates facial information of the expression = expression and the inspection of the three-dimensional object Part of the wheel gallery \ person line = analysis ^ face image of the face of the three-dimensional object. Like #讯贴覆在修正6·:申:Special: The three-dimensional range described in item 4, fills in the 'township line touch _ 叫 ^ ΐ 二 二 二 二 二 俾 俾 俾 俾 俾 俾 俾Positive:: =:= Analyze the module analysis to generate a plurality of facial shadows: ί The image of the image is acquired by the image analysis module. Face = Number: Pair:: The image information is taken from the face of the object that corresponds to the face of the object. The face image information is different from the three users and the face is corrected, and then the face of the object is corrected. Like the Beixun posted on the modified 3D 7. For example, the patent scope of the first, second, q A r image mode iln + n or 6 items of the three-dimensional face analysis report - 7 image simulation module According to the three-dimensional sub-division, the facial contour system including the special two-image information and the three-dimensional object is included, and the image adjustment module is used to complete the face-reducing module. Better adjustment of heart rate or saturation 9. If Shen Qing's patent scope is the first top, and the system is simulated, the simulation system performs edge softening. The two-dimensional simulation object generated by H. The three-dimensional facial image simulation system described in claim 9 of the patent application, wherein the edge softening process performed by the image simulation module is captured by the user. When the facial image information is attached, the surface image of the user is softened synchronously; the boundary lines and textures. - The 1D of the 3D facial system as described in the above-mentioned patent, wherein the image simulation module is affixed to the user's facial image information according to a specific fusion ratio ^ 19 M403706 Fusion processing. 12. The three-dimensional facial imaging simulation system according to claim 3, wherein the image simulation module reproduces the facial image information of the user and the image analysis module according to a specific fusion ratio. One of the plurality of facial image information generated is blended to be applied to the face of the three-dimensional object. 13. The three-dimensional facial imaging simulation system according to claim 1, wherein the image simulation module repeatedly captures or partially deforms a partial region of the facial image information, and applies the same to the The face of a three-dimensional object. 14. The three-dimensional facial imaging simulation system of claim 1, wherein the three-dimensional object is a three-dimensional human object, a three-dimensional animal object, or a three-dimensional human animal object. 15. The three-dimensional facial imaging simulation system of claim 1, wherein the image capturing module is a digital camera, and the display module is a liquid crystal glory. 16. The three-dimensional facial imaging simulation system of claim 1, wherein the sound capturing module is configured to capture the user's voice information and transmit the voice information to the facial image. Correspondence information of the information, to obtain the corresponding facial image information from the sound information 0 20
TW99218889U 2010-09-30 2010-09-30 Simulation system for 3D face image TWM403706U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW99218889U TWM403706U (en) 2010-09-30 2010-09-30 Simulation system for 3D face image

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW99218889U TWM403706U (en) 2010-09-30 2010-09-30 Simulation system for 3D face image

Publications (1)

Publication Number Publication Date
TWM403706U true TWM403706U (en) 2011-05-11

Family

ID=45077576

Family Applications (1)

Application Number Title Priority Date Filing Date
TW99218889U TWM403706U (en) 2010-09-30 2010-09-30 Simulation system for 3D face image

Country Status (1)

Country Link
TW (1) TWM403706U (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI785258B (en) * 2018-07-25 2022-12-01 大陸商騰訊科技(深圳)有限公司 Method, device, and storage medium for processing human face image

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI785258B (en) * 2018-07-25 2022-12-01 大陸商騰訊科技(深圳)有限公司 Method, device, and storage medium for processing human face image

Similar Documents

Publication Publication Date Title
JP6644833B2 (en) System and method for rendering augmented reality content with albedo model
Achenbach et al. Fast generation of realistic virtual humans
US9348950B2 (en) Perceptually guided capture and stylization of 3D human figures
Yuan et al. A mixed reality virtual clothes try-on system
Zhang Microsoft kinect sensor and its effect
US9652895B2 (en) Augmented reality image transformation
Hu et al. 3DBodyNet: fast reconstruction of 3D animatable human body shape from a single commodity depth camera
US20170186235A1 (en) Augmented reality system
US20180197345A1 (en) Augmented reality technology-based handheld viewing device and method thereof
WO2008145952A1 (en) Apparatus and method of body characterisation
Saint et al. 3dbodytex: Textured 3d body dataset
WO2014081394A1 (en) Method, apparatus and system for virtual clothes modelling
CN107067460A (en) A kind of virtual fit method, apparatus and system
Berdic et al. Creation and usage of 3D full body avatars
Aloba et al. Kinder-Gator: The UF Kinect Database of Child and Adult Motion.
TW201222476A (en) Image processing system and method thereof, computer readable storage media and computer program product
TWM412400U (en) Augmented virtual reality system of bio-physical characteristics identification
Ami-Williams et al. Digitizing traditional dances under extreme clothing: The case study of eyo
Saggio et al. Augmented reality for restoration/reconstruction of artefacts with artistic or historical value
Milosevic et al. A SmartPen for 3D interaction and sketch-based surface modeling
JP2021192230A (en) Augmented reality display device and program
Lin et al. eHeritage of shadow puppetry: creation and manipulation
TWI332639B (en) Method for displaying expressional image
JP2012120080A (en) Stereoscopic photography apparatus
Ge et al. 3D Human Reconstruction in the Wild with Synthetic Data Using Generative Models

Legal Events

Date Code Title Description
MK4K Expiration of patent term of a granted utility model