TWI630579B - Electronic apparatus, computer readable recording medium storing program and facial image displaying method - Google Patents

Electronic apparatus, computer readable recording medium storing program and facial image displaying method Download PDF

Info

Publication number
TWI630579B
TWI630579B TW105137538A TW105137538A TWI630579B TW I630579 B TWI630579 B TW I630579B TW 105137538 A TW105137538 A TW 105137538A TW 105137538 A TW105137538 A TW 105137538A TW I630579 B TWI630579 B TW I630579B
Authority
TW
Taiwan
Prior art keywords
image
makeup
instant
feature
facial image
Prior art date
Application number
TW105137538A
Other languages
Chinese (zh)
Other versions
TW201724013A (en
Inventor
鄭義錡
林偉博
郭修瑞
Original Assignee
華碩電腦股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 華碩電腦股份有限公司 filed Critical 華碩電腦股份有限公司
Priority to US15/376,901 priority Critical patent/US10162997B2/en
Publication of TW201724013A publication Critical patent/TW201724013A/en
Application granted granted Critical
Publication of TWI630579B publication Critical patent/TWI630579B/en

Links

Landscapes

  • Image Processing (AREA)

Abstract

本案揭示一種臉部影像顯示方法,其適用於一電子裝置。臉部影像顯示方法包含取得即時臉部影像、在即時臉部影像上定義出至少一第一特徵區、擷取包含至少一第一特徵區的第一特徵區塊影像、放大第一特徵區塊影像為第一輸出影像,以及於顯示單元的第一顯示區顯示第一輸出影像。The present disclosure discloses a method for displaying a facial image, which is applicable to an electronic device. The facial image display method includes obtaining an instant facial image, defining at least one first feature region on the instant facial image, capturing a first feature patch image including at least one first feature region, and enlarging the first feature block The image is a first output image, and the first output image is displayed on the first display area of the display unit.

Description

電子裝置、電腦可讀取記錄媒體及臉部影像顯示方法Electronic device, computer readable recording medium and facial image display method

本案是關於顯示技術,特別是一種虛擬影像顯示技術。 This case is about display technology, especially a virtual image display technology.

隨著科技之發展,許多廠商推出虛擬彩妝系統,使得使用者可透過簡易的平台將各式彩妝套用至使用者的照片上後,便可以供使用者參考其完妝後的妝感。 With the development of technology, many manufacturers have introduced a virtual make-up system, which allows users to apply various makeups to the user's photos through a simple platform, so that users can refer to the makeup after finishing their makeup.

然而,由於現有的虛擬彩妝系統僅提供套用虛擬彩妝後的圖像給使用者看,使用者並無法清楚比較其上妝前後的差異變化。此外,傳統的虛擬彩妝系統亦無法提供使用者觀看其細微部分之妝感。 However, since the existing virtual makeup system only provides images for applying the virtual makeup to the user, the user cannot clearly compare the changes before and after the makeup. In addition, the traditional virtual make-up system does not provide the user with the subtlety of the makeup.

本案提供一種臉部影像顯示方法,其適用於一電子裝置。此臉部影像顯示方法包括:取得一即時臉部影像;在即時臉部影像上定義出至少一第一特徵區;擷取包含至少一第一特徵區的一第一特徵區塊影像;放大第一特徵區塊影像為一第一輸出影像;及於一顯示單元之一第一顯示區顯示第一輸出影像。 The present invention provides a facial image display method suitable for an electronic device. The method for displaying a facial image includes: acquiring an instant facial image; defining at least one first characteristic region on the instant facial image; capturing a first characteristic patch image including the at least one first characteristic region; The feature block image is a first output image; and the first output image is displayed in a first display area of one of the display units.

本案另提供一種電腦可讀取記錄媒體,其儲存複數程式碼。當電子裝置載入並執行複數程式碼時,複數程式碼可致使電子裝置執行本 案之臉部影像顯示方法。 The present invention further provides a computer readable recording medium that stores a plurality of code codes. When the electronic device loads and executes the complex code, the complex code can cause the electronic device to execute the present The method of displaying the face image of the case.

本案更提供一種電子裝置,其包含:一影像處理單元,在即時臉部影像上定義出至少一第一特徵區,且自即時臉部影像中擷取包含至少一第一特徵區的第一特徵區塊影像,並放大第一特徵區塊影像為一第一輸出影像;及一顯示單元,包含一第一顯示區,顯示單元於第一顯示區顯示第一輸出影像。 The present invention further provides an electronic device, comprising: an image processing unit, defining at least one first feature area on the instant face image, and extracting a first feature including at least one first feature area from the instant face image And displaying, by the display unit, a first display area, wherein the display unit displays the first output image in the first display area.

以下在實施方式中詳細敘述本案之詳細特徵及優點,其內容足以使任何熟習相關技藝者瞭解本案之技術內容並據以實施,且根據本說明書所揭露之內容、申請專利範圍及圖式,任何熟習相關技藝者可輕易地理解本案相關之目的及優點。 The detailed features and advantages of the present invention are described in detail in the following description, which is sufficient to enable anyone skilled in the art to understand the technical content of the present invention and to implement it, and according to the disclosure, the scope of the patent and the drawings, Those skilled in the art can easily understand the related purposes and advantages of the present case.

100‧‧‧電子裝置 100‧‧‧Electronic devices

110‧‧‧影像處理單元 110‧‧‧Image Processing Unit

120‧‧‧顯示單元 120‧‧‧Display unit

121‧‧‧第一顯示區 121‧‧‧First display area

122‧‧‧第二顯示區 122‧‧‧Second display area

130‧‧‧影像擷取單元 130‧‧‧Image capture unit

140‧‧‧虛擬彩妝單元 140‧‧‧Virtual Makeup Unit

141‧‧‧彩妝模組 141‧‧‧ Makeup Module

142‧‧‧轉換模組 142‧‧‧Transition module

150‧‧‧訊息產生單元 150‧‧‧Information generating unit

160‧‧‧儲存單元 160‧‧‧storage unit

300‧‧‧虛擬彩妝 300‧‧‧Virtual Makeup

C1‧‧‧第一特徵區 C1‧‧‧ first characteristic area

I0‧‧‧即時影像 I0‧‧‧ Instant Video

I1‧‧‧即時臉部影像 I1‧‧‧ Instant Face Image

I2‧‧‧第一特徵區塊影像 I2‧‧‧ first feature block image

I2a‧‧‧第二特徵區塊影像 I2a‧‧‧Second feature block image

I3‧‧‧第一輸出影像 I3‧‧‧ first output image

I3a‧‧‧第二輸出影像 I3a‧‧‧second output image

I4‧‧‧彩妝後的即時臉部影像 Instant face image after I4‧‧‧ makeup

I5‧‧‧彩妝前的即時臉部影像 Instant facial imagery before I5‧‧ ‧ makeup

M1‧‧‧上妝導引訊息 M1‧‧‧ makeup guide message

C2‧‧‧第二特徵區 C2‧‧‧Second feature area

V1‧‧‧擷取框 V1‧‧‧ capture frame

P1、P11、P12、P21、P22、P1c‧‧‧特徵點 P1, P11, P12, P21, P22, P1c‧‧‧ feature points

S10~S140‧‧‧步驟 S10~S140‧‧‧Steps

圖1為一實施例之電子裝置的立體概要示意圖。 1 is a schematic perspective view of an electronic device according to an embodiment.

圖2為一實施例之電子裝置的方塊概要示意圖。 2 is a schematic block diagram of an electronic device according to an embodiment.

圖3為第一實施例之臉部影像顯示方法的流程概要示意圖。 Fig. 3 is a schematic flow chart showing a method of displaying a face image of the first embodiment.

圖4為即時臉部影像之一實施例的概要示意圖。 4 is a schematic diagram of an embodiment of an instant facial image.

圖5為擷取第一特徵區塊影像之一實施例的概要示意圖。 FIG. 5 is a schematic diagram of an embodiment of capturing an image of a first feature block.

圖6為於第一顯示區顯示第一輸出影像的概要示意圖。 FIG. 6 is a schematic diagram showing the first output image displayed in the first display area.

圖7為圖3中步驟S10之一實施例的流程概要示意圖。 FIG. 7 is a schematic diagram showing the flow of an embodiment of step S10 in FIG.

圖8為圖3中步驟S30之一實施例的流程概要示意圖。 FIG. 8 is a schematic diagram showing the flow of an embodiment of step S30 in FIG.

圖9為第二實施例之臉部影像顯示方法的流程概要示意圖。 Fig. 9 is a schematic flow chart showing a method of displaying a face image of the second embodiment.

圖10為顯示即時臉部影像與第一輸出影像的概要示意圖。 FIG. 10 is a schematic diagram showing an instant face image and a first output image.

圖11為第三實施例之臉部影像顯示方法的流程概要示意圖。 Fig. 11 is a schematic flow chart showing a method of displaying a face image of the third embodiment.

圖12為顯示彩妝前的即時臉部影像與第一輸出影像的概要示意圖。 FIG. 12 is a schematic diagram showing an instant facial image and a first output image before makeup.

圖13為顯示彩妝後的即時臉部影像與第一輸出影像的概要示意圖。 FIG. 13 is a schematic diagram showing an instant facial image and a first output image after makeup.

圖14為第四實施例之臉部影像顯示方法的流程概要示意圖。 Fig. 14 is a schematic flow chart showing a method of displaying a face image of the fourth embodiment.

圖15為顯示第一輸出影像與帶有上妝導引訊息之彩妝前的即時臉部影像的概要示意圖。 Figure 15 is a schematic diagram showing the first output image and the instant face image before the makeup with the makeup guide message.

圖16為顯示第一輸出影像與帶有上妝導引訊息之彩妝後的即時臉部影像的概要示意圖。 FIG. 16 is a schematic diagram showing an instant facial image after the first output image and the makeup with the makeup guide message.

圖17為第五實施例之臉部影像顯示方法的流程概要示意圖。 Fig. 17 is a schematic flow chart showing a method of displaying a face image of the fifth embodiment.

圖18為擷取第二特徵區塊影像之一實施例的概要示意圖。 18 is a schematic diagram of an embodiment of capturing a second feature block image.

圖19為顯示第一輸出影像與第二輸出影像的概要示意圖。 19 is a schematic diagram showing the first output image and the second output image.

圖20為第六實施例之臉部影像顯示方法的流程概要示意圖。 Fig. 20 is a schematic flow chart showing a method of displaying a face image of the sixth embodiment.

圖21為顯示第一輸出影像與帶有上妝導引訊息之第二輸出影像的概要示意圖。 21 is a schematic diagram showing a first output image and a second output image with a makeup guide message.

圖1為一實施例之電子裝置的立體概要示意圖,圖2為一實施例之電子裝置的方塊概要示意圖,圖3為第一實施例之臉部影像顯示方法的流程概要示意圖,圖4為即時臉部影像之一實施例的概要示意圖,圖5為擷取第一特徵區塊影像之一實施例的概要示意圖,且圖6為於第一顯示區顯示第一輸出影像的概要示意圖。請參閱圖1至圖6,本案任一實施例之臉部影像顯示方法適用於一電子裝置100,致使電子裝置100能放大顯示使用者的一或多個臉部特徵,進而使得使用者可輕易檢視其一或多個臉部 特徵。 1 is a schematic perspective view of an electronic device according to an embodiment, FIG. 2 is a schematic block diagram of an electronic device according to an embodiment, and FIG. 3 is a schematic flow chart of a facial image display method according to the first embodiment, and FIG. A schematic diagram of an embodiment of a facial image, FIG. 5 is a schematic diagram of an embodiment of capturing a first feature block image, and FIG. 6 is a schematic diagram showing a first output image displayed in a first display area. Referring to FIG. 1 to FIG. 6 , the facial image display method of any embodiment of the present invention is applicable to an electronic device 100 , so that the electronic device 100 can display one or more facial features of the user, thereby making the user easy. View one or more faces feature.

電子裝置100包含影像處理單元110、顯示單元120以及儲存單元160。影像處理單元110可耦接於顯示單元120以及儲存單元160。 The electronic device 100 includes an image processing unit 110, a display unit 120, and a storage unit 160. The image processing unit 110 can be coupled to the display unit 120 and the storage unit 160.

影像處理單元110可於取得即時臉部影像I1(步驟S10)後,在即時臉部影像I1上定義出至少一第一特徵區C1(如圖4所示)(步驟S20)。之後,影像處理單元110可擷取包含至少一第一特徵區C1的第一特徵區塊影像I2(如圖5所示)(步驟S30),以放大第一特徵區塊影像I2為第一輸出影像I3(步驟S40)。接續,影像處理單元110可傳輸第一輸出影像I3至顯示單元120,以於顯示單元120的第一顯示區121顯示第一輸出影像I3(如圖6所示)(步驟S50)。 After acquiring the instant face image I1 (step S10), the image processing unit 110 defines at least one first feature area C1 (shown in FIG. 4) on the instant face image I1 (step S20). Afterwards, the image processing unit 110 can capture the first feature block image I2 (shown in FIG. 5) including at least one first feature area C1 (step S30) to enlarge the first feature block image I2 as the first output. Image I3 (step S40). In the continuation, the image processing unit 110 can transmit the first output image I3 to the display unit 120 to display the first output image I3 (shown in FIG. 6) in the first display area 121 of the display unit 120 (step S50).

圖7為圖3中步驟S10之一實施例的流程概要示意圖。請參閱圖1至圖7,在步驟S10之一實施例中,影像處理單元110可於接收即時影像I0(步驟S11)後,對即時影像I0進行臉部偵測以取得即時臉部影像I1(步驟S12)。 FIG. 7 is a schematic diagram showing the flow of an embodiment of step S10 in FIG. Referring to FIG. 1 to FIG. 7 , in an embodiment of step S10, the image processing unit 110 may perform face detection on the instant image I0 to obtain an instant facial image I1 after receiving the instant image I0 (step S11). Step S12).

因此,電子裝置100更可包含影像擷取單元130,且影像擷取單元130耦接於影像處理單元110。影像擷取單元130可用以對使用者擷取即時影像I0。其中,即時影像I0可為平面影像或立體影像。在一些實施例中,影像擷取單元130可為網路攝影機(webcam)、相機、數位攝影機或其他合適用以擷取即時影像I0的的攝像鏡頭,但本案並非以此為限。於此,影像擷取單元130所擷取之即時影像I0可儲存和/或暫存於儲存單元160中,以便進行後續影像處理。 Therefore, the electronic device 100 further includes an image capturing unit 130 , and the image capturing unit 130 is coupled to the image processing unit 110 . The image capturing unit 130 can be used to capture the instant image I0 from the user. The instant image I0 can be a flat image or a stereo image. In some embodiments, the image capturing unit 130 can be a webcam, a camera, a digital camera, or other suitable camera lens for capturing the instant image I0, but the present invention is not limited thereto. The instant image I0 captured by the image capturing unit 130 can be stored and/or temporarily stored in the storage unit 160 for subsequent image processing.

在一些實施例中,影像擷取單元130所擷取到之即時影像I0 會傳送給影像處理單元110進行影像處理。於此,影像處理單元110可透過相關的臉部識別演算法(例如特徵向量法等)對即時影像I0進行臉部辨識及特徵點分析。例如自即時影像I0中取得呈現使用者臉部的即時臉部影像I1,並且在即時臉部影像I1上具有多個特徵點P1,如圖4所示。舉例而言,影像處理單元110係根據即時影像I0中的各個圖像點與周圍的灰度差值來找出多個圖像點作為特徵點P1,進而可自即時影像I0中取得涵蓋此些特徵點P1的即時臉部影像I1。 In some embodiments, the instant image I0 captured by the image capturing unit 130 It is transmitted to the image processing unit 110 for image processing. Here, the image processing unit 110 can perform face recognition and feature point analysis on the live image I0 through a related face recognition algorithm (for example, a feature vector method or the like). For example, the instant face image I1 that presents the face of the user is obtained from the instant image I0, and has a plurality of feature points P1 on the instant face image I1, as shown in FIG. For example, the image processing unit 110 finds a plurality of image points as the feature points P1 according to the gamma difference values of the image points and the surrounding gamma in the instant image I0, and can obtain the coverage from the instant image I0. The instant face image I1 of the feature point P1.

在一些實施例中,此些特徵點P1可位在即時臉部影像I1的轉折點、終點、尖端以及邊緣等位置上。例如,特徵點P1可位在眼睛輪廓線、嘴唇輪廓線、眉毛輪廓線、鼻子輪廓線與鼻尖等位置。但本案並非以此為限。 In some embodiments, such feature points P1 can be located at the turning point, the end point, the tip end, and the edge of the instant facial image I1. For example, the feature point P1 can be located at an eye contour, a lip contour, an eyebrow contour, a nose contour, and a nose tip. However, this case is not limited to this.

在一些實施例中,影像處理單元110可將所得之多個特徵點P1儲存於儲存單元160中。於此,影像處理單元110可將對應於同一臉部特徵的多個特徵點P1關聯在一起後,再一同儲存於儲存單元160中。 In some embodiments, the image processing unit 110 may store the obtained plurality of feature points P1 in the storage unit 160. Here, the image processing unit 110 may associate a plurality of feature points P1 corresponding to the same facial feature and store them in the storage unit 160 together.

在一些實施例中,影像處理單元110可於取得即時臉部影像I1後,先將即時臉部影像I1傳送至顯示單元120顯示,以使使用者可透過顯示單元120之顯示畫面(即時臉部影像I1)確認影像。需注意的是,顯示單元120於顯示即時臉部影像I1時,特徵點P1可顯示於即時臉部影像I1上,抑或不顯示於即時臉部影像I1上。 In some embodiments, the image processing unit 110 can transmit the instant facial image I1 to the display unit 120 after the instant facial image I1 is acquired, so that the user can display the display through the display unit 120 (immediate face). Image I1) Confirm the image. It should be noted that when the display unit 120 displays the instant facial image I1, the feature point P1 can be displayed on the instant facial image I1 or not on the instant facial image I1.

在步驟S20之一實施例中,影像處理單元110接收一特徵選擇訊號,此特徵選擇訊號是用來指定在即時影像I1中的臉部特徵。特徵選擇訊號可以是由使用者自行輸入或是電子裝置的系統預設的,但不限於 此。 In an embodiment of step S20, the image processing unit 110 receives a feature selection signal for specifying a facial feature in the live image I1. The feature selection signal may be preset by a user to input the system or the electronic device, but is not limited thereto. this.

在步驟S20之一實施例中,當特徵選擇訊號所指定的臉部特徵為眼睛時,影像處理單元110在即時臉部影像I1上定義出對應於眼睛部位之多個特徵點P1所圍繞出之範圍(即,第一特徵區C1)。而當特徵選擇訊號指定的臉部特徵有兩個以上時,影像處理單元110則在即時臉部影像I1上對應定義出兩個以上的第一特徵區C1,即找到此些臉部特徵在即時臉部影像I1上的位置。例如特徵選擇訊號指示之臉部特徵為鼻子部位與嘴巴部位時,影像處理單元110可將對應於鼻子部位之多個特徵點P1所圍繞出之範圍以及對應於嘴巴部位之多個特徵點P1所圍繞出之範圍分別定義為第一特徵區C1。 In an embodiment of step S20, when the facial feature specified by the feature selection signal is an eye, the image processing unit 110 defines a plurality of feature points P1 corresponding to the eye portion on the instant facial image I1. Range (ie, first feature area C1). When there are more than two facial features specified by the feature selection signal, the image processing unit 110 correspondingly defines two or more first feature regions C1 on the instant facial image I1, that is, the facial features are found in the instant. The position on the face image I1. For example, when the feature feature indicates that the facial features are the nose portion and the mouth portion, the image processing unit 110 may surround the range of the plurality of feature points P1 corresponding to the nose portion and the plurality of feature points P1 corresponding to the mouth portion. The range around is defined as the first feature area C1.

圖8為圖3中步驟S30之一實施例的流程概要示意圖。請參閱圖1至圖8,在步驟S30之一實施例中,影像處理單元110於接收特徵放大訊號(步驟S31)後,根據特徵放大訊號產生擷取框V1(步驟S32)。其中,擷取框V1之範圍可涵蓋於步驟S20中所定義出的至少一個第一特徵區C1,如圖5所示。之後,影像處理單元110便可根據擷取框V1自即時臉部影像I1中擷取第一特徵區塊影像I2(步驟S33)。換言之,第一特徵區塊影像I2即為包含即時臉部影像I1中之第一特徵區C1所對應的臉部特徵的局部影像。 FIG. 8 is a schematic diagram showing the flow of an embodiment of step S30 in FIG. Referring to FIG. 1 to FIG. 8 , in an embodiment of step S30 , after receiving the feature amplification signal (step S31 ), the image processing unit 110 generates a capture frame V1 according to the feature amplification signal (step S32 ). The range of the capture frame V1 may cover at least one first feature area C1 defined in step S20, as shown in FIG. 5. After that, the image processing unit 110 can extract the first feature block image I2 from the instant face image I1 according to the capture frame V1 (step S33). In other words, the first feature block image I2 is a partial image including the face feature corresponding to the first feature area C1 in the instant face image I1.

於此,特徵放大訊號是使影像處理單元110開始將即時臉部影像I1中對應於使用者之至少一臉部特徵的局部影像進行放大顯示之處理動作。在一些實施例中,特徵放大訊號是影像處理單元110於第一特徵區C1之定義完成後所產生的一個內部訊號。 Here, the feature amplification signal is a processing operation for causing the image processing unit 110 to start to enlarge and display a partial image corresponding to at least one facial feature of the user in the instant face image I1. In some embodiments, the feature amplification signal is an internal signal generated by the image processing unit 110 after the definition of the first feature area C1 is completed.

請參考圖5,在步驟S32的一實施例中,影像處理單元110可自儲存單元160將代表各個第一特徵區C1的特徵點P1全部取出。之後,影像處理單元110根據各個第一特徵區C1的各個特徵點P1找出一中心點,之後以此中心點為基準產生一個可涵蓋此第一特徵區C1之所有特徵點P1(即,可涵蓋第一特徵區C1)的擷取框V1。其中,各個第一特徵區C1的中心點可為代表此第一特徵區C1的所有特徵點P1其中的一個特徵點P1、或代表此第一特徵區C1的所有特徵點P1其中的多個特徵點P1的中間點,但本案不以此為限。舉例而言,如圖5所示,當特徵放大訊號所指定之臉部特徵為眼睛特徵時,影像處理單元110可以眼珠位置之所有特徵點P1中位於中心的特徵點P1c作為中心點,並且根據眼珠位置之所有特徵點P1中於X軸方向上距離最遠的兩個特徵點P11、P12以及於Y軸方向上距離最遠的兩個特徵點P21、P22去產生擷取框V1。例如,以各個特徵點P11、P12、P21、P22向外擴展一預設距離後之範圍作為擷取框V1。然而本案並非以此為限,影像處理單元110更可根據顯示單元120之影像顯示的長寬比,如4:3或16:9等,以產生符合顯示單元120之影像顯示的長寬比的擷取框V1。換言之,此時影像處理單元110可分別以各個特徵點P11、P12、P21、P22向外擴展不同長度之預設距離以產生符合長寬比的擷取框V1。其中,中心點的選擇方式及預設距離等參數可對應實施的程式碼而預先儲存在儲存單元160中。 Referring to FIG. 5, in an embodiment of step S32, the image processing unit 110 may take out all the feature points P1 representing the respective first feature regions C1 from the storage unit 160. Then, the image processing unit 110 finds a center point according to each feature point P1 of each first feature area C1, and then generates a feature point P1 covering the first feature area C1 based on the center point (ie, The capture frame V1 of the first feature area C1) is covered. The center point of each of the first feature regions C1 may be one of the feature points P1 representing all the feature points P1 of the first feature region C1 or a plurality of features of all the feature points P1 representing the first feature region C1. Point the middle point of P1, but this case is not limited to this. For example, as shown in FIG. 5, when the facial feature specified by the feature magnifying signal is an eye feature, the image processing unit 110 may use the feature point P1c located at the center among all the feature points P1 of the eyeball position as a center point, and according to The two feature points P11 and P12 which are the farthest in the X-axis direction and the two feature points P21 and P22 which are the farthest in the Y-axis direction of all the feature points P1 of the eyeball position generate the capture frame V1. For example, a range in which the respective feature points P11, P12, P21, and P22 are extended outward by a predetermined distance is taken as the capture frame V1. However, the present invention is not limited thereto. The image processing unit 110 may further display an aspect ratio of the image displayed by the display unit 120, such as 4:3 or 16:9, to generate an aspect ratio according to the image display of the display unit 120. Capture frame V1. In other words, at this time, the image processing unit 110 can expand the preset distances of different lengths by using the respective feature points P11, P12, P21, and P22 to generate the capture frame V1 that conforms to the aspect ratio. The parameters such as the selection method of the center point and the preset distance may be pre-stored in the storage unit 160 according to the implemented code.

在步驟S40之一實施例中,當第一特徵區塊影像I2與顯示單元120之影像顯示的長寬比不同時,影像處理單元110可先適當地調整第一特徵區塊影像I2的長寬比後,再放大經調整後的第一特徵區塊影像I2為第 一輸出影像I3。舉例而言,影像處理單元110可以第一特徵區塊影像I2的寬度為基準,並根據其與顯示單元120之影像顯示的寬度間之比例來重新計算出第一特徵區塊影像I2之新的寬度應為多少。同樣地,影像處理單元110可以第一特徵區塊影像I2的長度為基準,並根據其與顯示單元120之影像顯示的長度間之比例來重新計算出第一特徵區塊影像I2之新的長度應為多少。在一些實施例中,影像處理單元110可利用均勻縮放(Scaling)或影像切縫(Seam Carving)等影像處理方法來適度調整第一特徵區塊影像I2的長寬比。然而,本案並非以此為限,影像處理單元110亦可直接放大第一特徵區塊影像I2為第一輸出影像I3,且顯示單元120於顯示第一輸出影像I3時,其畫面周圍若有空缺之部分則可以黑色去填滿畫面。 In an embodiment of step S40, when the aspect ratio of the first feature block image I2 and the display unit 120 is different, the image processing unit 110 may appropriately adjust the length and width of the first feature block image I2. After the ratio, the enlarged first feature block image I2 is enlarged An output image I3. For example, the image processing unit 110 can recalculate the new feature of the first feature block image I2 based on the width of the first feature block image I2 and the ratio of the width of the image display to the display unit 120. What should be the width? Similarly, the image processing unit 110 can recalculate the new length of the first feature block image I2 based on the length of the first feature block image I2 and the ratio between the length of the image display and the image display unit 120. How much should be. In some embodiments, the image processing unit 110 may moderately adjust the aspect ratio of the first feature block image I2 by using image processing methods such as Scaling or Seam Carving. However, the present disclosure is not limited thereto. The image processing unit 110 can also directly enlarge the first feature block image I2 as the first output image I3, and the display unit 120 displays the first output image I3 if there is a vacancy around the screen. Some of them can be filled with black.

此外,在一些實施例中,為了消除訊號雜訊,影像處理單元110更可對多個即時臉部影像I1進行擷取,以取得一定數量之第一特徵區塊影像I2後,再將此些第一特徵區塊影像I2進行中位數運算,來產生一個較為穩定之第一特徵區塊影像I2,之後再放大此較為穩定之第一特徵區塊影像I2為第一輸出影像I3。 In addition, in some embodiments, in order to eliminate signal noise, the image processing unit 110 may further capture a plurality of instant facial images I1 to obtain a certain number of first feature block images I2. The first feature block image I2 performs a median operation to generate a relatively stable first feature block image I2, and then amplifies the relatively stable first feature block image I2 as the first output image I3.

在一些實施例中,顯示單元120於初始狀態時,可先顯示即時臉部影像I1於第一顯示區121,並待接收到影像處理單元110所輸出之第一輸出影像I3後,再將第一輸出影像I3顯示於第一顯示區121,如圖6所示。 In some embodiments, when the display unit 120 is in the initial state, the instant face image I1 may be displayed first in the first display area 121, and after receiving the first output image I3 output by the image processing unit 110, An output image I3 is displayed on the first display area 121 as shown in FIG.

圖9為第二實施例之臉部影像顯示方法的流程概要示意圖,圖10為顯示即時臉部影像與第一輸出影像的概要示意圖。請參閱圖1、圖2與圖4至圖10,在一些實施例中,顯示單元120更可包含第二顯示區122,且顯示單元120可於第二顯示區122顯示即時臉部影像I1(步驟S60),以 使使用者可於第一顯示區121觀看其臉部上至少一個臉部特徵的放大影像(即第一輸出影像I3),且於第二顯示區122觀看涵蓋其完整臉部的即時臉部影像I1。 9 is a schematic flow chart showing a facial image display method according to a second embodiment, and FIG. 10 is a schematic diagram showing an instant face image and a first output image. Referring to FIG. 1 , FIG. 2 and FIG. 4 to FIG. 10 , in some embodiments, the display unit 120 further includes a second display area 122 , and the display unit 120 can display the instant facial image I1 in the second display area 122 ( Step S60), The user can view the enlarged image of the at least one facial feature on the face (ie, the first output image I3) in the first display area 121, and view the instant facial image covering the entire face in the second display area 122. I1.

在一些實施例中,步驟S50可與步驟S60同步執行,但本案並非僅限於此,步驟S60亦可於影像處理單元110取得即時臉部影像I1後即開始執行。 In some embodiments, step S50 can be performed in synchronization with step S60, but the present invention is not limited thereto. Step S60 can also be executed after the image processing unit 110 obtains the instant facial image I1.

請參閱圖2與圖3,電子裝置100更可包含虛擬彩妝單元140,且虛擬彩妝單元140耦接至影像處理單元110。虛擬彩妝單元140可用以產生對應於即時臉部影像I1之虛擬彩妝,以使影像處理單元110可將虛擬彩妝單元140所產生之虛擬彩妝與即時臉部影像I1結合為一彩妝後的即時臉部影像I4後,再提供給顯示單元120進行顯示。 Referring to FIG. 2 and FIG. 3 , the electronic device 100 further includes a virtual makeup unit 140 , and the virtual makeup unit 140 is coupled to the image processing unit 110 . The virtual makeup unit 140 can be used to generate a virtual makeup corresponding to the instant facial image I1, so that the image processing unit 110 can combine the virtual makeup generated by the virtual makeup unit 140 with the instant facial image I1 into a makeup instant face. After the image I4, it is provided to the display unit 120 for display.

圖11為第三實施例之臉部影像顯示方法的流程概要示意圖,圖12為彩妝前的即時臉部影像與第一輸出影像的概要示意圖,且圖13為顯示彩妝後的即時臉部影像與第一輸出影像的概要示意圖。請參閱圖2、圖11至圖13,在本實施例中,影像處理單元110是自彩妝後的即時臉部影像I4擷取包含至少一第一特徵區C1的第一特徵區塊影像I3(步驟S30a)。 11 is a schematic flow chart showing a facial image display method according to a third embodiment, FIG. 12 is a schematic diagram showing an instant facial image and a first output image before makeup, and FIG. 13 is a view showing an instant facial image after makeup. A schematic diagram of the first output image. Referring to FIG. 2 and FIG. 11 to FIG. 13 , in the embodiment, the image processing unit 110 captures the first feature block image I3 including at least one first feature area C1 from the instant face image I4 after makeup ( Step S30a).

在一實施例中,彩妝後的即時臉部影像I4是由影像處理單元110將虛擬彩妝單元140所產生的虛擬彩妝300與彩妝前的即時臉部影像I5結合而成的。舉例而言,影像處理單元110可對即時影像I0進行臉部偵測以從即時影像I0中取得未結合虛擬彩妝的即時臉部影像(即,彩妝前的即時臉部影像I5)。接續,虛擬彩妝單元140可根據至少一彩妝選擇訊號 與彩妝前的即時臉部影像I5產生至少一虛擬彩妝300,並將至少一虛擬彩妝300結合至彩妝前的臉部影像I5上以形成彩妝後的臉部影像。其中,彩妝選擇訊號可涵蓋使用者所選擇之臉部特徵以及彩妝樣式的相關資訊。 In one embodiment, the instant facial image I4 after makeup is formed by the image processing unit 110 combining the virtual makeup 300 generated by the virtual makeup unit 140 with the instant facial image I5 before makeup. For example, the image processing unit 110 may perform face detection on the live image I0 to obtain an instant facial image (ie, the instant facial image I5 before makeup) that is not combined with the virtual makeup from the instant image I0. In addition, the virtual makeup unit 140 can select a signal according to at least one make-up. The instant facial image I5 before the make-up produces at least one virtual make-up 300, and at least one virtual make-up 300 is combined with the facial image I5 before the makeup to form a facial image after the makeup. Among them, the make-up selection signal can cover the facial features selected by the user and the related information of the make-up style.

於此,由於本實施例之步驟S10以及步驟S20大致上和第一實施例以及第二實施例之步驟S10以及步驟S20相同,故於下不再贅述。 The steps S10 and S20 of the present embodiment are substantially the same as the steps S10 and S20 of the first embodiment and the second embodiment, and therefore will not be described again.

在一實施例中,虛擬彩妝單元140可包含彩妝模組141以及轉換模組142。影像處理單元110耦接至彩妝模組141以及轉換模組142,且轉換模組142耦接至彩妝模組141。 In an embodiment, the virtual makeup unit 140 can include a makeup module 141 and a conversion module 142. The image processing unit 110 is coupled to the makeup module 141 and the conversion module 142 , and the conversion module 142 is coupled to the makeup module 141 .

在步驟S30a之一實施例中,虛擬彩妝單元140之彩妝模組141根據至少一彩妝選擇訊號自虛擬彩妝資料庫(內建於儲存單元160)中取出對應之虛擬彩妝樣板,且轉換模組142可根據彩妝前的即時臉部影像I5上的特徵點P1將虛擬彩妝樣板調整成可符合彩妝前的即時臉部影像I5中對應之臉部特徵之影像大小的虛擬彩妝300。換言之,當彩妝前的即時臉部影像I5中對應之臉部特徵的影像隨著使用者之轉動或移動時而改變其面積、形狀或大小時,轉換模組142所產生的虛擬彩妝300亦可隨之變動,以符合真實情況。 In an embodiment of step S30a, the makeup module 141 of the virtual makeup unit 140 takes out the corresponding virtual makeup template from the virtual makeup database (built in the storage unit 160) according to at least one makeup selection signal, and the conversion module 142 The virtual make-up template can be adjusted to the virtual make-up 300 that can conform to the image size of the corresponding facial features in the instant facial image I5 before the makeup, according to the feature point P1 on the instant facial image I5 before the makeup. In other words, when the image of the corresponding facial feature in the instant facial image I5 before the makeup changes its area, shape or size as the user rotates or moves, the virtual makeup 300 generated by the conversion module 142 can also Change accordingly to match the real situation.

接著,在本步驟S40中,影像處理單元110則是將具有虛擬彩妝300的第一特徵區塊影像I2放大為第一輸出影像I3。換言之,此時第一特徵區塊影像I2以及第一輸出影像I3上皆具有虛擬彩妝300,進而於步驟S50之執行後,使用者可自顯示單元120之第一顯示區121所顯示的第一輸出影像I3中清楚觀看到此臉部特徵上妝後之妝感。 Next, in this step S40, the image processing unit 110 enlarges the first feature block image I2 having the virtual makeup 300 into the first output image I3. In other words, at this time, the first feature block image I2 and the first output image I3 all have the virtual make-up 300, and after the execution of step S50, the user can display the first display area 121 from the first display area 121 of the display unit 120. In the output image I3, the makeup feeling on the facial features is clearly seen.

在一些實施例中,於步驟S50後,顯示單元120更可於顯示 單元120之第二顯示區122顯示即時臉部影像(步驟S60),以使使用者可依據第一顯示區121與第二顯示區122所顯示的影像進行比對。其中,第二顯示區122所顯示的即時臉部影像可為彩妝前的即時臉部影像I5抑或為彩妝後的即時臉部影像I4。 In some embodiments, after step S50, the display unit 120 is more displayable. The second display area 122 of the unit 120 displays an instant facial image (step S60), so that the user can compare the images displayed by the first display area 121 and the second display area 122. The instant facial image displayed by the second display area 122 may be the instant facial image I5 before makeup or the instant facial image I4 after makeup.

在一實施例中,如圖12所示,顯示單元120可於第二顯示區122上顯示彩妝前的即時臉部影像I5,以使使用者可於第二顯示區122觀看到未帶有彩妝時之整體臉部,且於第一顯示區121所顯示的第一輸出影像I3中觀看到其臉部上至少一個臉部特徵的細微彩妝。 In an embodiment, as shown in FIG. 12, the display unit 120 can display the instant facial image I5 before the makeup on the second display area 122, so that the user can view the non-makeup in the second display area 122. The overall face of the time, and the fine makeup of at least one facial feature on the face is viewed in the first output image I3 displayed by the first display area 121.

在另一實施例中,如圖13所示,顯示單元120則是於第二顯示區122上顯示彩妝後的即時臉部影像I4,以使使用者可於第二顯示區122觀看到整體臉部帶有彩妝時的妝感,且於第一顯示區121所顯示的第一輸出影像I3中觀看到其臉部上至少一個臉部特徵的細微彩妝。 In another embodiment, as shown in FIG. 13, the display unit 120 displays the instant facial image I4 after the makeup on the second display area 122, so that the user can view the overall face in the second display area 122. The makeup is felt with makeup, and a subtle makeup of at least one facial feature on the face is viewed in the first output image I3 displayed in the first display area 121.

圖14為第四實施例之臉部影像顯示方法的流程概要示意圖,圖15為顯示第一輸出影像與帶有上妝導引訊息之彩妝前的即時臉部影像的概要示意圖,且圖16為顯示第一輸出影像與帶有上妝導引訊息之彩妝後的即時臉部影像的概要示意圖。請參閱圖14至圖16,在一實施例中,電子裝置100更可包含訊息產生單元150,且訊息產生單元150耦接至影像處理單元110。 14 is a schematic flow chart showing a facial image display method according to a fourth embodiment, and FIG. 15 is a schematic diagram showing a first output image and an instant facial image before makeup with a makeup guide message, and FIG. 16 is a schematic diagram A schematic diagram showing the first output image and the instant facial image after the makeup with the makeup guide message. Referring to FIG. 14 to FIG. 16 , in an embodiment, the electronic device 100 further includes a message generating unit 150 , and the message generating unit 150 is coupled to the image processing unit 110 .

訊息產生單元150可根據至少一彩妝選擇訊號產生對應至少一虛擬彩妝300的上妝導引訊息M1(步驟S70),之後顯示單元120顯示上妝導引訊息M1於第二顯示區122的即時臉部影像(即,彩妝前的即時臉部影像I5或彩妝後的即時臉部影像I4)上(步驟S80)。在一實施例中, 如圖15所示,顯示單元120同時顯示彩妝前的即時臉部影像I5和上妝導引訊息M1於第二顯示區122上,以供使用者在比對其上妝前後之差異之同時還可透過上妝導引訊息M1得知如何自行畫出如同第一顯示區121所顯示之妝感。在另一實施例中,如圖16所示,顯示單元120同時顯示彩妝後的即時臉部影像I4和上妝導引訊息M1,以供使用者能同時觀看整體妝感與細部妝感並透過上妝導引訊息M1得知如何自行畫出同樣的妝感。 The message generating unit 150 may generate the makeup guide message M1 corresponding to the at least one virtual makeup 300 according to the at least one makeup selection signal (step S70), and then the display unit 120 displays the instant face of the makeup guide message M1 in the second display area 122. The partial image (that is, the instant facial image I5 before makeup or the instant facial image I4 after makeup) is on (step S80). In an embodiment, As shown in FIG. 15 , the display unit 120 simultaneously displays the instant facial image I5 and the makeup guide message M1 before the makeup on the second display area 122 for the user to compare the difference between before and after the makeup. The makeup guide message M1 can be used to know how to draw the makeup feeling as displayed by the first display area 121. In another embodiment, as shown in FIG. 16, the display unit 120 simultaneously displays the instant facial image I4 and the makeup guide message M1 after the makeup, so that the user can simultaneously view the overall makeup and the detailed makeup and pass through. The makeup guide message M1 knows how to draw the same makeup feeling by itself.

圖17為第五實施例之臉部影像顯示方法的流程概要示意圖,圖18為擷取第二特徵區塊影像之一實施例的概要示意圖,且圖19為顯示第一輸出影像與第二輸出影像的概要示意圖。 17 is a schematic flow chart showing a method of displaying a facial image in a fifth embodiment, FIG. 18 is a schematic diagram showing an embodiment of capturing a second feature block image, and FIG. 19 is a view showing a first output image and a second output. A schematic diagram of the image.

在一些實施例中,請參閱圖16至圖19,影像處理單元110更可在即時臉部影像(即,彩妝前的即時臉部影像I5或彩妝後的即時臉部影像I4)上定義出至少一第二特徵區C2(步驟S90),並自此即時臉部影像中擷取包含該至少一第二特徵區C2的第二特徵區塊影像I2a(步驟S100)。在步驟S100後,影像處理單元110放大第二特徵區塊影像I2a為第二輸出影像I3a(步驟S110),之後由顯示單元120於第二顯示區122顯示第二輸出影像I3a(步驟S120)。 In some embodiments, referring to FIG. 16 to FIG. 19, the image processing unit 110 can define at least the instant facial image (ie, the instant facial image I5 before makeup or the instant facial image I4 after makeup). a second feature area C2 (step S90), and the second feature block image I2a including the at least one second feature area C2 is extracted from the instant face image (step S100). After the step S100, the image processing unit 110 enlarges the second feature block image I2a into the second output image I3a (step S110), and then displays the second output image I3a in the second display area 122 by the display unit 120 (step S120).

在步驟S90之一實施例中,影像處理單元110可藉由和步驟S20大致上相同之方式找到第二特徵區C2。換言之,第二特徵區C2可為使用者欲放大觀看之臉部特徵所對應的多個特徵點P1所圍繞出的範圍。 In an embodiment of step S90, the image processing unit 110 can find the second feature area C2 in substantially the same manner as step S20. In other words, the second feature area C2 may be a range surrounded by a plurality of feature points P1 corresponding to the facial features of the user to be enlarged.

在一實施例中,第二特徵區C2所對應之臉部特徵可實質上不同於第一特徵區C1所對應之臉部特徵。於此,第一輸出影像I3中的臉部特徵是帶有虛擬彩妝300,而第二輸出影像I3a的臉部特徵則亦可帶有虛擬 彩妝300,以供使用者同時確認不同臉部特徵的妝感。 In an embodiment, the facial features corresponding to the second feature region C2 may be substantially different from the facial features corresponding to the first feature region C1. Here, the facial features in the first output image I3 are provided with the virtual make-up 300, and the facial features of the second output image I3a may also be virtualized. Make-up 300, for the user to confirm the makeup of different facial features at the same time.

在另一實施例中,第二特徵區C2所對應之臉部特徵大致上和第一特徵區C1所對應之臉部特徵相同。於此,第一輸出影像I3中的臉部特徵是帶有虛擬彩妝300,而第二輸出影像I3a的臉部特徵則未帶有虛擬彩妝300。如圖19所示,此時顯示單元120於第二顯示區122所顯示的是未帶有虛擬彩妝300且放大後的第二輸出影像I3a,且顯示單元120於第一顯示區121所顯示的是帶有虛擬彩妝300且放大後的第一輸出影像I3,以使得使用者可根據此二顯示區121、122比對出其上妝前與上妝後的差異。 In another embodiment, the facial features corresponding to the second feature region C2 are substantially the same as the facial features corresponding to the first feature region C1. Here, the facial features in the first output image I3 are provided with the virtual makeup 300, and the facial features of the second output image I3a are not provided with the virtual makeup 300. As shown in FIG. 19, at this time, the display unit 120 displays the second output image I3a without the virtual makeup 300 and the enlarged display image 120 is displayed on the first display area 121. It is the first output image I3 with the virtual make-up 300 and enlarged, so that the user can compare the difference between the makeup before and after the makeup according to the two display areas 121 and 122.

圖20為第六實施例之臉部影像顯示方法的流程概要示意圖,且圖21為顯示第一輸出影像與帶有上妝導引訊息之第二輸出影像的概要示意圖。 20 is a schematic flow chart showing a facial image display method according to a sixth embodiment, and FIG. 21 is a schematic diagram showing a first output image and a second output image with a makeup guide message.

在一些實施例中,請參閱圖20與圖21,訊息產生單元150可根據至少一彩妝選擇訊號產生對應虛擬彩妝300的上妝導引訊息M1(步驟S130),之後顯示單元120顯示上妝導引訊息M1於第二顯示區122的第二輸出影像I3a上(步驟S140),如圖21所示,以教導使用者如何繪出如同第一顯示區121所示之彩妝樣式。 In some embodiments, referring to FIG. 20 and FIG. 21, the message generating unit 150 may generate a makeup guide message M1 corresponding to the virtual makeup 300 according to at least one makeup selection signal (step S130), and then the display unit 120 displays the makeup guide. The message M1 is on the second output image I3a of the second display area 122 (step S140), as shown in FIG. 21, to teach the user how to draw a makeup style as shown by the first display area 121.

在一些實施例中,上妝導引訊息M1可包含使用者所選擇之彩妝樣式的上妝動作、步驟、流程解說與注意事項等。 In some embodiments, the makeup guide message M1 may include a makeup action, a step, a flow explanation, a precaution, and the like of the makeup style selected by the user.

在一些實施例中,上妝導引訊息M1可以文字之顯示態樣進行顯示,如圖15所示。然而本案並非以此為限,上妝導引訊息M1亦可以動畫之顯示態樣進行顯示,如圖21所示,在第二顯示區122所顯示之第二輸出影像I3a上可顯示一或多個選項供使用者進行點選,且對應之上妝導 引訊息M1可依據使用者所點選之選項於第二顯示區122中以動態之方式呈現。 In some embodiments, the makeup guide message M1 can be displayed in a displayed manner of the text, as shown in FIG. However, the present invention is not limited thereto. The makeup guide message M1 can also be displayed in an animated display manner. As shown in FIG. 21, one or more of the second output images I3a displayed on the second display area 122 can be displayed. Options for the user to click, and corresponding to the makeup The message M1 can be presented in a dynamic manner in the second display area 122 according to the option selected by the user.

在一些實施例中,於顯示單元120顯示前,影像處理單元110可對欲顯示的影像(第一輸出影像I3、第二輸出影像I3a、彩妝後的即時臉部影像I4或彩妝前的即時臉部影像I5)進行位置校正,以使各影像顯示於顯示單元120的顯示區(第一顯示區121或第二顯示區122)時,各影像中的臉部圖像可位於顯示區的中央並且佔據顯示區的特定比例。藉此,即便使用者相對於影像擷取單元130有所偏離,例如,使用者並非正對影像擷取單元130而是位於影像擷取單元130之擷取範圍中的右方時,只要使用者仍位於影像擷取單元130之擷取範圍中,最後於顯示單元120之顯示區進行顯示時,各影像中的臉部圖像便可維持於中央而不偏移。 In some embodiments, before the display unit 120 displays, the image processing unit 110 can display the image to be displayed (the first output image I3, the second output image I3a, the instant facial image I4 after makeup, or the instant face before makeup). Part image I5) When the position correction is performed such that each image is displayed on the display area (the first display area 121 or the second display area 122) of the display unit 120, the face image in each image may be located at the center of the display area and Occupies a specific proportion of the display area. Therefore, even if the user is deviated from the image capturing unit 130, for example, when the user is not facing the image capturing unit 130 but is located to the right of the capturing range of the image capturing unit 130, the user Still in the capturing range of the image capturing unit 130, and finally displayed in the display area of the display unit 120, the facial image in each image can be maintained at the center without being offset.

在一些實施例中,電子裝置100可為筆記型電腦、平板電腦、智慧型手機或其他合適的電子裝置。 In some embodiments, the electronic device 100 can be a notebook computer, a tablet computer, a smart phone, or other suitable electronic device.

在一些實施例中,影像處理單元110、虛擬彩妝單元140以及訊息產生單元150可由一個或多個處理元件實現。各處理元件可為中央處理器(CPU)、控制器或微處理器等。此外,顯示單元120可為任何合適的顯示幕,例如LCD螢幕、LED螢幕等。但本案並非僅限於此。 In some embodiments, image processing unit 110, virtual makeup unit 140, and message generation unit 150 may be implemented by one or more processing elements. Each processing element can be a central processing unit (CPU), a controller, a microprocessor, or the like. Moreover, display unit 120 can be any suitable display such as an LCD screen, LED screen, or the like. However, this case is not limited to this.

在一些實施例中,儲存單元160可由一個或多個儲存元件實現。各儲存元件可為非揮發性記憶體,例如唯讀記憶體(ROM)或快閃記憶體(Flash memory)等或揮發性記憶體,例如隨機存取記憶體(RAM)。 In some embodiments, storage unit 160 can be implemented by one or more storage elements. Each storage element can be a non-volatile memory such as a read only memory (ROM) or a flash memory or a volatile memory such as a random access memory (RAM).

在一些實施例中,本案任一實施例之臉部影像顯示方法可由 一電腦可讀取記錄媒體實現。此電腦可讀取記錄媒體儲存有複數程式碼,以當電子裝置100載入並執行複數程式碼後,此些程式碼能使電子裝置100執行前述任一實施例之臉部影像顯示方法。在一實施例中,此電腦可讀取記錄媒體可為電子裝置100內部的儲存元件。在另一實施例中,此電腦可讀取記錄媒體可為遠端儲存元件,並且經由有線或無線的方式傳輸至電子裝置100中。在又一實施例中,此電腦可讀取記錄媒體可為電子裝置100外部的儲存元件,並經由電子裝置100的讀取器或連接器連接並存取此儲存元件的程式碼。 In some embodiments, the facial image display method of any of the embodiments may be A computer readable recording medium implementation. The computer-readable recording medium stores a plurality of code codes for enabling the electronic device 100 to execute the facial image display method of any of the embodiments described above after the electronic device 100 loads and executes the plurality of codes. In an embodiment, the computer readable recording medium can be a storage component inside the electronic device 100. In another embodiment, the computer readable recording medium can be a remote storage element and transmitted to the electronic device 100 via a wired or wireless means. In still another embodiment, the computer readable recording medium can be a storage component external to the electronic device 100, and the code of the storage component can be connected and accessed via a reader or connector of the electronic device 100.

綜上所述,本案實施例之電子裝置及其顯示方法,透過對即時影像進行臉部偵測所得之多個特徵點從即時臉部影像中擷取出對應於至少一臉部特徵的特徵區塊影像,並且於顯示單元放大顯示此特徵區塊影像,而使得使用者無需貼近即可清楚檢視其臉部特徵之細微部分。此外,本案實施例之電子裝置及其顯示方法更可結合虛擬彩妝於即時臉部影像上,以使使用者可藉由前述之方式而可輕易觀看於其至少一臉部特徵於上妝後之妝感。再者,本案實施例之電子裝置及其顯示方法更可將從結合有虛擬彩妝之即時臉部影像中所擷取出的特徵區塊影像和原始的即時臉部影像(即,未結合虛擬彩妝的即時臉部影像)或和自原始的即時臉部影像中所擷取出的另一個特徵區塊影像一同顯示,以使使用者可自此二影像中觀看到其上妝前後的差異。 In summary, the electronic device and the display method thereof according to the embodiment of the present invention extracts feature blocks corresponding to at least one facial feature from the instant facial image through a plurality of feature points obtained by performing face detection on the real-time image. The image is displayed on the display unit in an enlarged manner, so that the user can clearly view the subtle portions of the facial features without being close to the user. In addition, the electronic device and the display method of the embodiment of the present invention can be combined with the virtual makeup on the instant facial image so that the user can easily view at least one facial feature on the makeup by the foregoing manner. Makeup. Furthermore, the electronic device and the display method of the embodiment of the present invention can further extract the feature block image and the original instant face image extracted from the instant face image combined with the virtual makeup (ie, the virtual makeup without the virtual makeup). The instant face image is displayed together with another feature block image extracted from the original instant face image, so that the user can view the difference before and after the makeup from the two images.

雖然本案的技術內容已經以較佳實施例揭露如上,然其並非用以限定本案,任何熟習此技藝者,在不脫離本案之精神所作些許之更動與潤飾,皆應涵蓋於本案的範疇內,因此本案之保護範圍當視後附之申請 專利範圍所界定者為準。 Although the technical content of the present invention has been disclosed in the above preferred embodiments, it is not intended to limit the scope of the present invention. Any person skilled in the art, without departing from the spirit of the present invention, should be included in the scope of the present case. Therefore, the scope of protection of this case is subject to the attached application. The scope defined by the patent scope shall prevail.

Claims (19)

一種臉部影像顯示方法,適用於一具有一顯示單元之電子裝置,該方法包含:取得一即時臉部影像;取得一虛擬彩妝;將該虛擬彩妝結合於該即時臉部影像產生一彩妝後的即時臉部影像;在該彩妝後的即時臉部影像上定義出至少一第一特徵區;自該彩妝後的即時臉部影像擷取包含該至少一第一特徵區的一第一特徵區塊影像;放大該第一特徵區塊影像為一第一輸出影像;於該顯示單元之一第一顯示區顯示該第一輸出影像;及於該顯示單元顯示對應該虛擬彩妝的一上妝導引訊息,該上妝導引訊息包括該虛擬彩妝的上妝動作、步驟、流程解說或注意事項。 A method for displaying a facial image is applicable to an electronic device having a display unit, the method comprising: obtaining an instant facial image; obtaining a virtual makeup; and combining the virtual makeup with the instant facial image to generate a makeup Instant face image; defining at least one first feature area on the instant face image after the make-up; extracting a first feature block including the at least one first feature area from the instant face image after the make-up And displaying the image of the first feature block as a first output image; displaying the first output image in a first display area of the display unit; and displaying a makeup guide corresponding to the virtual makeup on the display unit The message, the makeup guide message includes the makeup action, steps, process explanations or precautions of the virtual makeup. 如請求項1所述的臉部影像顯示方法,其中取得該即時臉部影像之步驟包含:接收一即時影像;及對該即時影像進行臉部偵測以取得該即時臉部影像。 The method for displaying a facial image according to claim 1, wherein the step of acquiring the instant facial image comprises: receiving an instant image; and performing face detection on the real image to obtain the instant facial image. 如請求項1所述的臉部影像顯示方法,其中擷取包含該至少一第一特徵區的該第一特徵區塊影像之步驟中包含:接收一特徵放大訊號;根據該特徵放大訊號產生涵蓋該至少一第一特徵區的一擷取框;及根據該擷取框自該即時臉部影像中擷取該第一特徵區塊影像。 The method for displaying a facial image according to claim 1, wherein the step of capturing the image of the first feature block that includes the at least one first feature region comprises: receiving a feature amplification signal; and amplifying the signal generation according to the feature a capture frame of the at least one first feature area; and extracting the first feature block image from the instant face image according to the capture frame. 如請求項1所述的臉部影像顯示方法,其中在取得該即時臉部影像之步驟後,更包含:顯示該即時臉部影像於該顯示單元之一第二顯示區。 The method of displaying a facial image according to claim 1, wherein after the step of acquiring the instant facial image, the method further comprises: displaying the instant facial image in a second display area of the display unit. 如請求項1所述的臉部影像顯示方法,其中該彩妝後的該即時臉部影像係於彩妝前的該即時臉部影像上結合根據一彩妝選擇訊號產生之該虛擬彩妝而形成。 The facial image display method according to claim 1, wherein the instant facial image after the makeup is formed on the instant facial image before the makeup is combined with the virtual makeup generated according to a makeup selection signal. 如請求項5所述的臉部影像顯示方法,更包含:顯示該即時臉部影像於該顯示單元之一第二顯示區。 The method for displaying a facial image according to claim 5, further comprising: displaying the instant facial image in a second display area of the display unit. 如請求項6所述的臉部影像顯示方法,其更包含:根據該彩妝選擇訊號產生對應該虛擬彩妝之該上妝導引訊息;及顯示該上妝導引訊息於該第二顯示區的該即時臉部影像上。 The method of displaying a facial image according to claim 6, further comprising: generating the makeup guide message corresponding to the virtual makeup according to the makeup selection signal; and displaying the makeup guide message in the second display area The instant face image. 如請求項5所述的臉部影像顯示方法,更包含:在該即時臉部影像上定義出至少一第二特徵區;自該即時臉部影像中擷取包含該至少一第二特徵區的一第二特徵區塊影像;放大該第二特徵區塊影像為一第二輸出影像;及於該顯示單元之一第二顯示區顯示該第二輸出影像。 The method for displaying a facial image according to claim 5, further comprising: defining at least one second feature region on the instant face image; extracting, from the instant face image, the at least one second feature region a second feature block image; the second feature block image is enlarged to be a second output image; and the second output image is displayed in a second display area of the display unit. 如請求項8所述的臉部影像顯示方法,更包含:根據該彩妝選擇訊號產生對應該虛擬彩妝之該上妝導引訊息;及顯示該上妝導引訊息於該第二顯示區的該第二輸出影像上。 The method for displaying a facial image according to claim 8, further comprising: generating the makeup guide message corresponding to the virtual makeup according to the makeup selection signal; and displaying the makeup guide message in the second display area On the second output image. 一種電腦可讀取記錄媒體,儲存複數程式碼,當一電子裝置載入並執行該複數程式碼時,該複數程式碼致使該電子裝置執行以下步驟:取得一即時臉部影像;取得一虛擬彩妝;將該虛擬彩妝結合於該即時臉部影像產生一彩妝後的即時臉部影像;在該彩妝後的即時臉部影像上定義出至少一第一特徵區;自該彩妝後的即時臉部影像擷取包含該至少一第一特徵區的一第一特徵區塊影像;放大該第一特徵區塊影像為一第一輸出影像;於一顯示單元之一第一顯示區顯示該第一輸出影像;及於該顯示單元顯示對應該虛擬彩妝的一上妝導引訊息,該上妝導引訊息包括該虛擬彩妝的上妝動作、步驟、流程解說或注意事項。 A computer readable recording medium storing a plurality of code codes, when an electronic device loads and executes the plurality of code codes, the plurality of code codes cause the electronic device to perform the following steps: obtaining an instant facial image; obtaining a virtual makeup Combining the virtual makeup with the instant facial image to generate a makeup instant facial image; defining at least one first characteristic region on the instant facial image after the makeup; instant facial image from the makeup Extracting a first feature block image including the at least one first feature area; zooming the first feature block image into a first output image; displaying the first output image in a first display area of a display unit And displaying, on the display unit, a makeup guide message corresponding to the virtual makeup, the makeup guide message including a makeup action, a step, a process explanation or a precaution of the virtual makeup. 一種電子裝置,包含:一影像處理單元,結合一虛擬彩妝與一即時臉部影像以形成一彩妝後的即時臉部影像,在該彩妝後的即時臉部影像上定義出至少一第一特徵區,並自該彩妝後的即時臉部影像中擷取包含該至少一第一特徵區的一第一特徵區塊影像,且放大該第一特徵區塊影像為一第一輸出影像;及一顯示單元,包含一第一顯示區,該顯示單元於該第一顯示區顯示該第一輸出影像,該顯示單元顯示對應該虛擬彩妝的一上妝導引訊息,該上妝導引訊息包括該虛擬彩妝的上妝動作、步驟、流程解說或注意事項。 An electronic device comprising: an image processing unit, combining a virtual make-up and an instant facial image to form a makeup instant facial image, and defining at least one first characteristic region on the instant facial image after the makeup And capturing a first feature block image including the at least one first feature area from the instant face image after the make-up, and zooming in the first feature block image as a first output image; and displaying The unit includes a first display area, the display unit displays the first output image in the first display area, and the display unit displays a makeup guide message corresponding to the virtual makeup, the makeup guide message including the virtual Make-up actions, steps, process explanations or precautions for make-up. 如請求項11所述的電子裝置,更包含: 一影像擷取單元,擷取一即時影像,其中該影像處理單元更對該即時影像進行臉部偵測以取得該即時臉部影像。 The electronic device of claim 11, further comprising: An image capturing unit captures an instant image, wherein the image processing unit further performs face detection on the instant image to obtain the instant facial image. 如請求項11所述的電子裝置,其中該影像處理單元更接收一特徵放大訊號,並根據該特徵放大訊號產生包含該至少一第一特徵區的一擷取框,其中該影像處理單元係根據該擷取框自該即時臉部影像中擷取該第一特徵區塊影像。 The electronic device of claim 11, wherein the image processing unit further receives a feature amplification signal, and generates a capture frame including the at least one first feature region according to the feature amplification signal, wherein the image processing unit is The capture frame captures the first feature block image from the instant face image. 如請求項11所述的電子裝置,其中該顯示單元更包含一第二顯示區,且該顯示單元於該第二顯示區顯示該即時臉部影像。 The electronic device of claim 11, wherein the display unit further comprises a second display area, and the display unit displays the instant face image in the second display area. 如請求項11所述的電子裝置,其中該電子裝置更包含:一虛擬彩妝單元,根據至少一彩妝選擇訊號與該即時臉部影像產生該至少一虛擬彩妝;其中,該影像處理單元更結合該至少一虛擬彩妝與彩妝前的該即時臉部影像以形成該彩妝後的該即時臉部影像。 The electronic device of claim 11, wherein the electronic device further comprises: a virtual makeup unit, the at least one virtual makeup is generated according to the at least one make-up selection signal and the instant facial image; wherein the image processing unit further The instant facial image before the virtual makeup and makeup to form the instant facial image after the makeup. 如請求項15所述的電子裝置,其中該顯示單元更包含一第二顯示區,且該顯示單元於該第二顯示區顯示該即時臉部影像。 The electronic device of claim 15, wherein the display unit further comprises a second display area, and the display unit displays the instant face image in the second display area. 如請求項16所述的電子裝置,更包含:一訊息產生單元,根據該至少一彩妝選擇訊號產生對應該至少一虛擬彩妝之該上妝導引訊息,其中該顯示單元更顯示該上妝導引訊息於該第二顯示區的該即時臉部影像上。 The electronic device of claim 16, further comprising: a message generating unit, configured to generate the makeup guide message corresponding to the at least one virtual makeup according to the at least one makeup selection signal, wherein the display unit further displays the makeup guide The message is directed to the instant face image of the second display area. 如請求項15所述的電子裝置,其中該顯示單元更包含一第二顯示區,該影像處理單元更自該即時臉部影像中定義出至少一第二特徵區,並擷取包含該至少一第二特徵區的一第二特徵區塊影像,且該影像處 理單元放大該第二特徵區塊影像為一第二輸出影像,以及該顯示單元更於該第二顯示區顯示該第二輸出影像。 The electronic device of claim 15, wherein the display unit further comprises a second display area, wherein the image processing unit further defines at least one second feature area from the instant face image, and extracts the at least one a second feature block image of the second feature area, and the image portion The processing unit enlarges the second feature block image as a second output image, and the display unit displays the second output image in the second display area. 如請求項18所述的電子裝置,更包含:一訊息產生單元,根據該至少一彩妝選擇訊號產生對應該至少一虛擬彩妝之該上妝導引訊息;其中,該顯示單元更顯示該上妝導引訊息於該第二顯示區的該第二輸出影像上。 The electronic device of claim 18, further comprising: a message generating unit, configured to generate the makeup guide message corresponding to the at least one virtual makeup according to the at least one makeup selection signal; wherein the display unit further displays the makeup The guiding message is on the second output image of the second display area.
TW105137538A 2015-12-27 2016-11-16 Electronic apparatus, computer readable recording medium storing program and facial image displaying method TWI630579B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/376,901 US10162997B2 (en) 2015-12-27 2016-12-13 Electronic device, computer readable storage medium and face image display method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201562271306P 2015-12-27 2015-12-27
US62/271,306 2015-12-27

Publications (2)

Publication Number Publication Date
TW201724013A TW201724013A (en) 2017-07-01
TWI630579B true TWI630579B (en) 2018-07-21

Family

ID=60048005

Family Applications (1)

Application Number Title Priority Date Filing Date
TW105137538A TWI630579B (en) 2015-12-27 2016-11-16 Electronic apparatus, computer readable recording medium storing program and facial image displaying method

Country Status (1)

Country Link
TW (1) TWI630579B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7135472B2 (en) * 2018-06-11 2022-09-13 カシオ計算機株式会社 Display control device, display control method and display control program

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW200521851A (en) * 2003-12-19 2005-07-01 Inst Information Industry Simulation method for make-up trial and the device thereof
US20120223956A1 (en) * 2011-03-01 2012-09-06 Mari Saito Information processing apparatus, information processing method, and computer-readable storage medium
TW201411506A (en) * 2012-09-14 2014-03-16 Utechzone Co Ltd Information system for automatic makeup and makeup method thereof
US20150262403A1 (en) * 2014-03-13 2015-09-17 Panasonic Intellectual Property Management Co., Ltd. Makeup support apparatus and method for supporting makeup

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW200521851A (en) * 2003-12-19 2005-07-01 Inst Information Industry Simulation method for make-up trial and the device thereof
US20120223956A1 (en) * 2011-03-01 2012-09-06 Mari Saito Information processing apparatus, information processing method, and computer-readable storage medium
TW201411506A (en) * 2012-09-14 2014-03-16 Utechzone Co Ltd Information system for automatic makeup and makeup method thereof
US20150262403A1 (en) * 2014-03-13 2015-09-17 Panasonic Intellectual Property Management Co., Ltd. Makeup support apparatus and method for supporting makeup

Also Published As

Publication number Publication date
TW201724013A (en) 2017-07-01

Similar Documents

Publication Publication Date Title
KR102045695B1 (en) Facial image processing method and apparatus, and storage medium
CN107818305B (en) Image processing method, image processing device, electronic equipment and computer readable storage medium
EP3323249B1 (en) Three dimensional content generating apparatus and three dimensional content generating method thereof
US9635311B2 (en) Image display apparatus and image processing device
US10599914B2 (en) Method and apparatus for human face image processing
JP6691529B2 (en) Eyebrow shape guide device and method thereof
EP3992919B1 (en) Three-dimensional facial model generation method and apparatus, device, and medium
US20150206354A1 (en) Image processing apparatus and image display apparatus
CN107452049B (en) Three-dimensional head modeling method and device
JP5949331B2 (en) Image generating apparatus, image generating method, and program
US20170147866A1 (en) Image processing device and image display device
US10162997B2 (en) Electronic device, computer readable storage medium and face image display method
JP5460793B2 (en) Display device, display method, television receiver, and display control device
TWI630579B (en) Electronic apparatus, computer readable recording medium storing program and facial image displaying method
US9323981B2 (en) Face component extraction apparatus, face component extraction method and recording medium in which program for face component extraction method is stored
US8971636B2 (en) Image creating device, image creating method and recording medium
CN112507766A (en) Face image extraction method, storage medium and terminal equipment
KR102372711B1 (en) Image photographing apparatus and control method thereof
JP2015184701A (en) Image processing apparatus, image processing method, and program
TWI743413B (en) Single-photo generating device and method and non-volatile computer-readable media thereof
RU2703327C1 (en) Method of processing a two-dimensional image and a user computing device thereof
JP2014174855A (en) Image processor, image processing method and program
JP2016136325A (en) Image processing device and program
CN113837016A (en) Cosmetic progress detection method, device, equipment and storage medium
CN115294273A (en) Shooting method and device