TWI837469B - Method and device for removeing the background - Google Patents

Method and device for removeing the background Download PDF

Info

Publication number
TWI837469B
TWI837469B TW110113187A TW110113187A TWI837469B TW I837469 B TWI837469 B TW I837469B TW 110113187 A TW110113187 A TW 110113187A TW 110113187 A TW110113187 A TW 110113187A TW I837469 B TWI837469 B TW I837469B
Authority
TW
Taiwan
Prior art keywords
initial image
image
color
background
background removal
Prior art date
Application number
TW110113187A
Other languages
Chinese (zh)
Other versions
TW202240548A (en
Inventor
許豪岱
柯兆齊
陳佳豪
Original Assignee
宏正自動科技股份有限公司
Filing date
Publication date
Application filed by 宏正自動科技股份有限公司 filed Critical 宏正自動科技股份有限公司
Priority to TW110113187A priority Critical patent/TWI837469B/en
Priority to CN202210356625.6A priority patent/CN115272360A/en
Publication of TW202240548A publication Critical patent/TW202240548A/en
Application granted granted Critical
Publication of TWI837469B publication Critical patent/TWI837469B/en

Links

Images

Abstract

The present invention provides a method and system for removing background of an image, wherein a image acquiring device is utilized to acquire an initial image, an operation interface in the image acquiring device is utilized to display the initial image, a plurality of removal targets are selected from the initial image through the operation interface and a plurality of positioning information respectively corresponding to each removal target are generated, a processing module is utilized to determine a plurality of color features respectively corresponding to the plurality of positioning information in the initial image, and finally, the background corresponding to the color features in the initial image are removed by the processing module.

Description

去背方法與去背裝置Background removal method and background removal device

本發明為一種影像處理技術,特別是指一種去除影像背景的去背方法與去背裝置。The present invention relates to an image processing technology, and more particularly to a background removal method and a background removal device for removing image background.

由於網路的發達,以及影音設備的進步,帶動了很多產業的發展。其中,在影音多媒體的產業中,影音播放平台提供了素人以特有的影音內容來取得觀賞者的喜愛與追蹤,因此造就了以網紅或Youtuber為主的新世代的影音產業模式。在這種新型態的網路影音產業中,為了吸引訂閱者,網紅或Youtuber除了在內容企劃上需要投入設計之外,影音剪輯處理,例如:從靜態的圖片到動態影像的編輯、或影像特殊效果的增加等,也是輔助增加訂閱率重要的一環。The development of the Internet and the advancement of audio-visual equipment have driven the development of many industries. In the audio-visual multimedia industry, audio-visual playback platforms provide amateurs with unique audio-visual content to gain the love and attention of viewers, thus creating a new generation of audio-visual industry model dominated by Internet celebrities or YouTubers. In this new type of online audio-visual industry, in order to attract subscribers, Internet celebrities or YouTubers need to invest in content planning and design. Audio-visual editing and processing, such as editing from static images to dynamic images, or adding special effects to images, are also important links to help increase subscription rates.

在影音剪輯處理中,去除背景(以下簡稱去背)是不可或缺的技巧。所謂去除背景,係指將影像或圖片中部分影像主體的部分保留,其餘部分則去除。去背的手法可以讓影像主體任意改變背景的環境,增加影像或圖片的多樣性。Background removal is an indispensable technique in video editing. Background removal means that part of the image subject is retained and the rest is removed. Background removal allows the image subject to change the background environment at will, increasing the diversity of the image or picture.

習用技術中,當使用者有置換背景環境的需求時,一般使用者必須準備一單色幕(例如綠布或藍布)作為背景布幕,再來進行拍攝得到影像。接著,將此影像輸入影像處理軟體中,選取欲保留之前景部分,然後將未選取的背景部分刪除並填上透明背景後存檔,最後,將去背的檔案與欲置換之背景進行疊加即可得到新影像,達到去背與置換背景的影像效果。In practice, when users need to replace the background environment, they generally need to prepare a monochrome screen (such as green or blue cloth) as the background screen, and then shoot to obtain an image. Then, input the image into the image processing software, select the foreground part to be retained, and then delete the unselected background part and fill it with a transparent background before saving. Finally, the background-removed file is superimposed with the background to be replaced to obtain a new image, achieving the image effect of removing the background and replacing the background.

由於在習用技術中,使用者必須自備藍色或綠色布幕,且拍攝完畢之後,還必須以另外的程序上傳到可以進行影像處理的設備,才能進行後製處理,如此對使用者相當的不方便。此外,因為布幕會有隨著燈光的影響,使得在影像或圖像中呈現出來的顏色並不均一,因此使用者很難精準選擇所要去除的顏色,而需要反覆調整,影響去除背景的工作效率。In the application of this technology, users must prepare their own blue or green curtains, and after shooting, they must upload the images to image processing equipment using another program before post-processing, which is quite inconvenient for users. In addition, because the curtains are affected by the light, the colors presented in the images or pictures are not uniform, so it is difficult for users to accurately select the color to be removed, and they need to adjust repeatedly, affecting the efficiency of background removal.

爰是之故,有鑑於習知技術之不足,提出一種去背方法與去背裝置,用以改善上述習用手段之缺失。Therefore, in view of the shortcomings of the prior art, a background removal method and a background removal device are proposed to improve the shortcomings of the above-mentioned conventional means.

本發明提供一種去背方法與裝置,使用者利用手持裝置擷取影像之後,透過操作介面讓使用者選取的任意多組區域,然後自動偵測選取區域的顏色特徵,再根據顏色的特徵即時(real time)進行去背,達到對應現場光源之有效去背的操作效果。The present invention provides a background removal method and device. After a user captures an image with a handheld device, the user is allowed to select any multiple groups of areas through an operation interface. The color characteristics of the selected areas are then automatically detected, and the background removal is performed in real time according to the color characteristics, thereby achieving an effective background removal operation effect corresponding to the on-site light source.

本發明的去背方法與裝置,可以在擷取影像或圖像之後,立即根據使用者選擇區域的顏色特徵找到相應的區域進行去背,透過選取區域顏色特徵的演算,可以解決因為擷取影像的角度產生反光所產生的顏色差異而影響去背效果的問題。此外,使用者直接選取區域的方式更可以提升去背影像處理效率,可以應用在直播、會議或演講等應用。The background removal method and device of the present invention can find the corresponding area for background removal according to the color characteristics of the area selected by the user immediately after capturing an image or picture. By calculating the color characteristics of the selected area, the problem of color difference caused by reflection caused by the angle of the captured image affecting the background removal effect can be solved. In addition, the method of directly selecting the area by the user can further improve the background removal image processing efficiency, which can be applied to live broadcasts, meetings or speeches.

本發明提供一種去背方法,其係藉由影像擷取裝置擷取初始影像,然後於影像擷取裝置中提供操作介面顯示出初始影像,之後,藉由操作介面於初始影像選取複數個欲去背目標,並產生該些欲去背目標的複數個位置資訊,接著,透過處理單元從初始影像當中決定出對應於該些位置資訊的複數個顏色特徵,最後,處理單元根據所得的顏色特徵,對初始影像進行去背。The present invention provides a background removal method, which uses an image capture device to capture an initial image, and then provides an operation interface in the image capture device to display the initial image. Thereafter, multiple targets to be background removed are selected in the initial image through the operation interface, and multiple position information of the targets to be background removed is generated. Then, a processing unit determines multiple color features corresponding to the position information from the initial image. Finally, the processing unit removes the background of the initial image based on the obtained color features.

在一實施例中,本發明提供一種去背裝置,包括操作介面、影像接收埠以及處理單元,其中,影像接收埠接收初始影像,藉由操作介面以於初始影像選取複數個欲去背目標,並產生些欲去背目標的複數個位置資訊。另外,處理單元與影像接收埠電性連接,處理單元從初始影像當中決定出對應於該些位置資訊的複數個顏色特徵,並根據該些顏色特徵對初始影像進行去背。In one embodiment, the present invention provides a background removal device, including an operation interface, an image receiving port, and a processing unit, wherein the image receiving port receives an initial image, and a plurality of background removal targets are selected from the initial image through the operation interface, and a plurality of position information of the background removal targets is generated. In addition, the processing unit is electrically connected to the image receiving port, and the processing unit determines a plurality of color features corresponding to the position information from the initial image, and removes the background of the initial image according to the color features.

在下文將參考隨附圖式,可更充分地描述各種例示性實施例,在隨附圖式中展示一些例示性實施例。然而,本發明概念可能以許多不同形式來體現,且不應解釋為限於本文中所闡述之例示性實施例。確切而言,提供此等例示性實施例使得本發明將為詳盡且完整,且將向熟習此項技術者充分傳達本發明概念的範疇。類似數字始終指示類似元件。以下將以多種實施例配合圖式來說明所述去背方法與去背裝置,然而,下述實施例並非用以限制本發明。Various exemplary embodiments will be more fully described below with reference to the accompanying drawings, some of which are shown in the accompanying drawings. However, the concepts of the present invention may be embodied in many different forms and should not be construed as limited to the exemplary embodiments described herein. Rather, these exemplary embodiments are provided so that the present invention will be detailed and complete, and will fully convey the scope of the concepts of the present invention to those skilled in the art. Similar numbers always indicate similar elements. The background removal method and background removal device will be described below with a variety of embodiments in conjunction with drawings, however, the following embodiments are not intended to limit the present invention.

請參閱圖1A所示,其為本發明之去背裝置之一實施例示意圖。去背裝置3包括操作介面300以及處理單元32。在本實施例中,操作介面300係提供於影像擷取裝置30。在本實施例中,影像擷取裝置30為可攜式裝置,例如:智慧型手機、相機、或平板電腦等,但不以此為限制。影像擷取裝置30同時也具有運算處理能力,可以藉由執行應用程式或APP產生使用者操作介面300。要說明的是,操作介面300可以提供使用者對於影像或圖像進行特定功能的操作,例如:選取圖像或影像上特定位置或區域讓應用程式或APP藉由演算取得關於被選取的特定位置或區域所具有的影像特徵,例如:亮度、對比度或顏色等資訊。本實施例中,影像擷取裝置30藉由內建的鏡頭30a擷取被攝主體4以及其所在背景環境40的影像,以產生初始影像P0。Please refer to FIG. 1A, which is a schematic diagram of an embodiment of the background removal device of the present invention. The background removal device 3 includes an operation interface 300 and a processing unit 32. In the present embodiment, the operation interface 300 is provided on the image capture device 30. In the present embodiment, the image capture device 30 is a portable device, such as a smart phone, a camera, or a tablet computer, but is not limited thereto. The image capture device 30 also has a computing and processing capability, and can generate a user operation interface 300 by executing an application or an APP. It should be noted that the operation interface 300 can provide the user with the ability to perform specific functions on an image or picture, for example, selecting a specific position or area on the image or picture so that the application or APP can obtain information about the image characteristics of the selected specific position or area through calculation, such as brightness, contrast or color. In this embodiment, the image capturing device 30 captures the image of the subject 4 and its background environment 40 via a built-in lens 30a to generate an initial image P0.

處理單元32在本實施例中,設置於去背裝置3內。去背裝置3在本實施例中,為具有網路通訊功能的直播設備,其係具有第一連接介面330與影像擷取裝置30電性連接。本實施例中的第一連接介面330為影像接收埠,可以為無線通訊介面,例如:Wi-Fi 無線通訊或者是藍牙無線通訊等介面,或者是可以為有線介面,例如:USB各種形式的連接介面、HDMI、DVI等,但不以此為限置。影像擷取裝置30可以將擷取到的初始影像P0藉由該第一連接介面330傳給去背裝置3。此外,第一連接介面330亦可以將操作介面300操作之後所得到的關於去背的資訊(例如:欲去背目標的位置資訊)傳輸給去背裝置3,再傳給處理單元32對初始影像P0進行去背。In the present embodiment, the processing unit 32 is disposed in the background removal device 3. In the present embodiment, the background removal device 3 is a live broadcast device with a network communication function, which has a first connection interface 330 electrically connected to the image capture device 30. The first connection interface 330 in the present embodiment is an image receiving port, which can be a wireless communication interface, such as: Wi-Fi wireless communication or Bluetooth wireless communication interface, or can be a wired interface, such as: various forms of USB connection interfaces, HDMI, DVI, etc., but not limited to this. The image capture device 30 can transmit the captured initial image P0 to the background removal device 3 through the first connection interface 330. In addition, the first connection interface 330 can also transmit the background removal information (eg, location information of the background removal target) obtained after operating the operation interface 300 to the background removal device 3, and then transmit it to the processing unit 32 to remove the background of the initial image P0.

在本實施例中,處理單元32更進一步包括有像素轉換模組320、影像分析模組321、背景處理模組322。其中,像素轉換模組320根據使用者在操作介面300上對初始影像P0選取欲去背目標的位置於初始影像P0上決定相應的複數個顏色特徵。欲去背的目標可以是單一點或者是特定大小的範圍。影像分析模組321將些顏色特徵聯集成顏色範圍。背景處理模組322,根據顏色範圍將初始影像中具有該些顏色特徵的顏色去除。In this embodiment, the processing unit 32 further includes a pixel conversion module 320, an image analysis module 321, and a background processing module 322. The pixel conversion module 320 determines a plurality of corresponding color features on the initial image P0 according to the position of the target to be removed from the initial image P0 selected by the user on the operation interface 300. The target to be removed can be a single point or a range of a specific size. The image analysis module 321 combines these color features into a color range. The background processing module 322 removes the colors with these color features from the initial image according to the color range.

以下用圖1A與圖3A與圖3B所示的實施例來說明從初始影像選擇位置的方式,影像擷取裝置30的操作介面300上顯示有初始影像P0,使用者在初始影像P0上選取了欲去背目標90a~90e。要說明的是,選取的方式為觸控方式在影像擷取裝置30的顯示屏幕上選擇。每一個欲去背目標90a~90e可以為單一像素或多個像素的集合。影像擷取裝置30將所選取的目標90a~90e的位置資訊以及初始影像P0傳給了去背裝置3。The following uses the embodiments shown in FIG. 1A and FIG. 3A and FIG. 3B to illustrate the method of selecting a position from an initial image. An initial image P0 is displayed on the operation interface 300 of the image capture device 30, and the user selects the target 90a~90e to be background-removed on the initial image P0. It should be noted that the selection method is to select on the display screen of the image capture device 30 by touch. Each target 90a~90e to be background-removed can be a single pixel or a collection of multiple pixels. The image capture device 30 transmits the position information of the selected target 90a~90e and the initial image P0 to the background-removing device 3.

去背裝置3接收到了位置資訊,傳給像素轉換模組320。像素轉換模組320根據所收到的位置資訊,在初始影像P0上取得相應於選取的目標90a~90e的顏色特徵。本實施例中,顏色特徵為YUV資訊,但不以此為限,例如:RGB資訊或者是CMYK資訊亦可。以下以YUV資訊來說明,在位置90a的YUV為(149,53,19),90b的YUV為(122,41,21),90c的YUV為(110,43,30),90d的YUV為(166,69,42) ,90e的YUV為(160,60,30)等。然後影像分析模組321再將對應選取的目標90a~90e的這些顏色特徵聯集成顏色範圍R1(Max:YUV(166, 69, 42), MinYUV(110, 41, 21),也就是Y介於166~110,U介於69~41,V介於42~21之間。之後,顏色範圍R1傳給了背景處理模組322,背景處理模組322再根據顏色範圍R1對初始影像P0中符合前述顏色範圍R1的顏色進行去除。The background removal device 3 receives the position information and transmits it to the pixel conversion module 320. The pixel conversion module 320 obtains the color characteristics corresponding to the selected targets 90a~90e on the initial image P0 based on the received position information. In this embodiment, the color characteristics are YUV information, but are not limited to this. For example, RGB information or CMYK information is also acceptable. The following is explained using YUV information. The YUV at position 90a is (149,53,19), the YUV at 90b is (122,41,21), the YUV at 90c is (110,43,30), the YUV at 90d is (166,69,42), the YUV at 90e is (160,60,30), and so on. Then, the image analysis module 321 combines the color features corresponding to the selected targets 90a-90e into a color range R1 (Max: YUV (166, 69, 42), MinYUV (110, 41, 21), that is, Y is between 166-110, U is between 69-41, and V is between 42-21. Afterwards, the color range R1 is transmitted to the background processing module 322, and the background processing module 322 removes the colors in the initial image P0 that meet the color range R1 according to the color range R1.

除了前述之方式外,另一實施例中,影像分析模組321將每一顏色特徵定義出複數個顏色範圍。背景處理模組322,根據顏色範圍將初始影像P0中具有該些顏色特徵的顏色去除。在本實施例中,如圖1A、圖3C與圖3D所示,影像擷取裝置30的操作介面300上顯示有初始影像P0,使用者在初始影像上選取了欲去背的目標90f~90h。本實施例中,每一個目標90f~90h是由使用者利用觸控方式在初始影像P0上畫出的範圍。影像擷取裝置30將所選取的目標90f~90h的位置資訊(例如:範圍邊界)傳給了去背裝置3,然後經由像素轉換模組320根據所收到的位置資訊,在初始影像P0上取得相應於選取的目標90f~90h範圍邊界的顏色特徵,然後影像分析模組321再將對應選取的目標90f~90h範圍邊界的顏色特徵決定出對應的顏色範圍R2~R4,例如:R2的YUVmax(149,53,19),YUVmin(138,51,17);R3的YUVmax(122,41,21),YUVmin(115,25,18),R4的YUVmax(110,43,30),YUVmin(108,32,25)。要說明的是產生顏色範圍R2~R4的方式係如前圖3A與3B所述,在此不作贅述。之後,顏色範圍R2~R4傳給了背景處理模組322,背景處理模組322再根據顏色範圍R2~R4對初始影像P0中符合前述顏色範圍R2~R4的顏色進行去除。In addition to the aforementioned method, in another embodiment, the image analysis module 321 defines a plurality of color ranges for each color feature. The background processing module 322 removes the colors having the color features in the initial image P0 according to the color ranges. In this embodiment, as shown in FIG. 1A , FIG. 3C and FIG. 3D , the operation interface 300 of the image capture device 30 displays the initial image P0, and the user selects the target 90f~90h to be removed from the initial image. In this embodiment, each target 90f~90h is a range drawn by the user on the initial image P0 using a touch screen. The image capture device 30 transmits the position information (e.g., range boundary) of the selected target 90f~90h to the background removal device 3, and then the pixel conversion module 320 obtains the color features corresponding to the range boundary of the selected target 90f~90h on the initial image P0 according to the received position information. Then the image analysis module 321 determines the corresponding color range R2~R4 according to the color features corresponding to the range boundary of the selected target 90f~90h, for example: YUVmax(149,53,19), YUVmin(138,51,17) of R2; YUVmax(122,41,21), YUVmin(115,25,18) of R3, and YUVmax(110,43,30), YUVmin(108,32,25) of R4. It should be noted that the method of generating the color range R2-R4 is as described in the previous Figures 3A and 3B, which will not be repeated here. Afterwards, the color range R2-R4 is transmitted to the background processing module 322, and the background processing module 322 removes the colors in the initial image P0 that match the color range R2-R4 according to the color range R2-R4.

除了前述之方式外,另一實施例中,影像分析模組321將每一顏色特徵定義出複數個顏色值。背景處理模組322,根據顏色範圍將第二初始影像中具有該些顏色特徵的像素去除。在一實施例中,如圖3E與圖3F所示,影像擷取裝置30的操作介面300上顯示有初始影像P0,使用者在初始影像P0上選取了欲去背的目標90i~90l。本實施例中,每一個目標90i~90l是由使用者利用觸控方式在初始影像P0點選的位置。影像擷取裝置30將所選取的目標90i~90l的位置資訊傳給了去背裝置3,然後經由像素轉換模組320根據所收到的位置資訊,在初始影像P0上取得相應於選取的目標(像素)90i~90l的顏色特徵,然後影像分析模組321再將對應選取的目標90i~90l的顏色特徵決定出對應的顏色值Ca~Cd,例如:位置90i的YUV值Ca為(149,53,19),90j的YUV值Cb為(122,41,21),90k的YUV值Cc為(110,43,30),90l的YUV值Cd為(166,69,42)。之後,顏色值Ca~Cd傳給了背景處理模組322,背景處理模組322再根據顏色值Ca~Cd對初始影像P0中符合前述顏色值Ca~Cd的顏色進行去除。In addition to the aforementioned method, in another embodiment, the image analysis module 321 defines a plurality of color values for each color feature. The background processing module 322 removes the pixels having the color features in the second initial image according to the color range. In one embodiment, as shown in FIG. 3E and FIG. 3F , the operation interface 300 of the image capture device 30 displays the initial image P0, and the user selects the target 90i~90l to be removed from the initial image P0. In this embodiment, each target 90i~90l is a position selected by the user in the initial image P0 by touch. The image capture device 30 transmits the position information of the selected target 90i~90l to the background removal device 3, and then the pixel conversion module 320 obtains the color features corresponding to the selected targets (pixels) 90i~90l on the initial image P0 according to the received position information. Then the image analysis module 321 determines the corresponding color values Ca~Cd according to the color features of the selected targets 90i~90l, for example: the YUV value Ca of position 90i is (149,53,19), the YUV value Cb of 90j is (122,41,21), the YUV value Cc of 90k is (110,43,30), and the YUV value Cd of 90l is (166,69,42). Afterwards, the color values Ca~Cd are transmitted to the background processing module 322, and the background processing module 322 removes the colors in the initial image P0 that match the color values Ca~Cd according to the color values Ca~Cd.

再回到圖1A所示,處理單元32更具有影像疊加模組323,其係將背景處理模組322去背之後的去背影像與至少一背景影像相互疊加,以形成疊加影像。其中,背景影像可以為圖像或者是動態的影像。背景影像可以事先儲存在去背裝置3內,或者是透過網路連接雲端儲存設備7取得。此外,去背裝置3更具有第三連接介面332、影像輸出模組34以及第四連接介面333,其中第三連接介面332作為影音訊號輸出的介面,與電子裝置5電性連接,將處理後所得到的多媒體資訊,例如:影音資訊、影像資訊或圖像資訊,傳給電子裝置5。電子裝置5可以為智慧型手機、筆記型電腦或者是桌上型電腦等。第三連接介面332可以為USB各種形式的介面、HDMI或DVI等影音介面或者是無線或有線網路介面,但不以此為限置。在一實施例中,電子裝置5內具有應用程式可以將影音處理裝置5所輸出的多媒體資訊上傳到遠端的網路的影音串流平台或者是雲端儲存裝置。Returning to FIG. 1A , the processing unit 32 further has an image superimposition module 323, which superimposes the background-removed image after the background processing module 322 removes the background and at least one background image to form a superimposed image. The background image can be a picture or a dynamic image. The background image can be stored in the background removal device 3 in advance, or obtained by connecting to the cloud storage device 7 via the network. In addition, the background removal device 3 further has a third connection interface 332, an image output module 34, and a fourth connection interface 333, wherein the third connection interface 332 is electrically connected to the electronic device 5 as an interface for outputting audio and video signals, and transmits the multimedia information obtained after processing, such as audio and video information, image information, or image information, to the electronic device 5. The electronic device 5 can be a smart phone, a laptop, or a desktop computer, etc. The third connection interface 332 can be a USB interface of various forms, an audio and video interface such as HDMI or DVI, or a wireless or wired network interface, but is not limited thereto. In one embodiment, the electronic device 5 has an application that can upload the multimedia information output by the audio and video processing device 5 to a remote network audio and video streaming platform or a cloud storage device.

影像輸出模組34與影像疊加模組323以及第四連接介面333電性連接,第四連接介面333與顯示裝置6電性連接,第四連接介面333可以為USB各種形式的介面、HDMI或DVI等影音介面。透過影像輸出模組34以及第四連接介面333,使用者可以直接透過顯示器6看到後處理之後的影像效果。在另一實施例中,去背裝置3更可以包括有音訊連接介面334用以和音訊輸入裝置電性連接。音訊輸入裝置可以為麥克風或者是其他播音設備。要說明的是,雖然本實施例中去背裝置3與影像擷取裝置30為分離的兩個裝置,在另一實施例中去背裝置3與影像擷取裝置30可以相互整合在一起。例如,影像擷取裝置30可以是智慧型手機,其中去背裝置3整合在影像擷取裝置30內。The image output module 34 is electrically connected to the image superposition module 323 and the fourth connection interface 333. The fourth connection interface 333 is electrically connected to the display device 6. The fourth connection interface 333 can be various forms of USB interfaces, HDMI or DVI and other audio and video interfaces. Through the image output module 34 and the fourth connection interface 333, the user can directly see the image effect after post-processing through the display 6. In another embodiment, the background removal device 3 can further include an audio connection interface 334 for electrically connecting to an audio input device. The audio input device can be a microphone or other broadcasting equipment. It should be noted that although the background removal device 3 and the image capture device 30 are two separate devices in this embodiment, the background removal device 3 and the image capture device 30 can be integrated with each other in another embodiment. For example, the image capturing device 30 may be a smart phone, wherein the background removal device 3 is integrated into the image capturing device 30 .

請參閱圖1B所示,其為本發明之去背裝置之另一實施例示意圖。去背裝置3包括有第一影像擷取裝置30’、第二影像擷取裝置31以及處理單元32。第一影像擷取裝置30’在本實施例中為可攜式的影像擷取裝置,例如:智慧型手機、相機、或平板電腦等,但不以此為限制。第一影像擷取裝置30’同時也具有運算處理能力,可以藉由執行應用程式或APP產生使用者操作介面300。要說明的是,操作介面300可以提供使用者對於影像或圖像進行特定功能的操作,例如:選取圖像或影像上特定位置或區域讓應用程式或APP藉由演算取得關於被選取的特定位置或區域所具有的影像特徵,例如:亮度、對比度或顏色等資訊。本實施例中,第一影像擷取裝置30’藉由內建的鏡頭30a擷取被攝主體4以及其所在背景環境40的影像,以產生第一初始影像P1。Please refer to FIG. 1B , which is a schematic diagram of another embodiment of the background removal device of the present invention. The background removal device 3 includes a first image capture device 30 ′, a second image capture device 31 and a processing unit 32. In the present embodiment, the first image capture device 30 ′ is a portable image capture device, such as a smart phone, a camera, or a tablet computer, but is not limited thereto. The first image capture device 30 ′ also has a computing and processing capability, and can generate a user operation interface 300 by executing an application or APP. It should be noted that the operation interface 300 can provide the user with the ability to perform specific functions on an image or picture, such as selecting a specific position or area on the image or picture so that the application or APP can obtain information about the image characteristics of the selected specific position or area through calculation, such as brightness, contrast or color. In this embodiment, the first image capturing device 30' captures the image of the subject 4 and its background environment 40 via the built-in lens 30a to generate a first initial image P1.

第二影像擷取裝置31在本實施例中,為外接的攝影裝置,例如:相機或錄影機等,但不以此為限,例如,也可以為智慧型手機、相機、或平板電腦等。在另一實施例中,如圖1C所示,第二影像擷取裝置31可以整合在去背裝置3內。再回到圖1B所示,第二影像擷取裝置31藉由鏡頭31a擷取被攝主體4以及其所在背景環境40的影像,以產生第二初始影像。In this embodiment, the second image capture device 31 is an external photographic device, such as a camera or a video recorder, but is not limited thereto, and may also be a smart phone, a camera, or a tablet computer. In another embodiment, as shown in FIG1C , the second image capture device 31 may be integrated into the background removal device 3. Returning to FIG1B , the second image capture device 31 captures the image of the subject 4 and its background environment 40 through the lens 31a to generate a second initial image.

處理單元32在本實施例中,設置於去背裝置3內。去背裝置3在本實施例中,為具有網路通訊功能的直播設備,其係具有第一連接介面330以及第二連接介面331分別與第一影像擷取裝置30’以及第二影像擷取裝置31電性連接。第一連接介面330與第二連接介面331可以為無線通訊介面,例如:Wi-Fi 無線通訊或者是藍牙無線通訊等介面,或者是可以為有線介面,例如:USB各種形式的連接介面、HDMI、DVI等,但不以此為限置。In this embodiment, the processing unit 32 is disposed in the background removal device 3. In this embodiment, the background removal device 3 is a live broadcast device with a network communication function, which has a first connection interface 330 and a second connection interface 331, which are electrically connected to the first image capture device 30' and the second image capture device 31 respectively. The first connection interface 330 and the second connection interface 331 can be wireless communication interfaces, such as Wi-Fi wireless communication or Bluetooth wireless communication interfaces, or can be wired interfaces, such as various types of USB connection interfaces, HDMI, DVI, etc., but are not limited thereto.

第一影像擷取裝置30’可以將操作介面300操作之後所得到的關於去背的資訊(例如:欲去背目標的位置資訊)藉由第一連接介面330傳輸給去背裝置3,再傳給處理單元32進行影像處理。同樣地,第二影像擷取裝置31將所擷取到的第二初始影像經由第二連接介面331傳輸給去背裝置3再傳給處理單元32。處理單元32則根據使用者決定的去背資訊,對第二初始影像進行去背。The first image capture device 30' can transmit the background removal information (e.g., the location information of the background removal target) obtained after the operation of the operation interface 300 to the background removal device 3 through the first connection interface 330, and then transmit it to the processing unit 32 for image processing. Similarly, the second image capture device 31 transmits the captured second initial image to the background removal device 3 through the second connection interface 331 and then to the processing unit 32. The processing unit 32 removes the background of the second initial image according to the background removal information determined by the user.

在本實施例中,處理單元32更進一步包括有像素轉換模組320、影像分析模組321、背景處理模組322。其中,像素轉換模組320根據使用者在操作介面300上對第一初始影像選取欲去背目標的位置於第二初始影像上決定相應的複數個顏色特徵。欲去背的目標可以是單一點或者是特定大小的範圍。影像分析模組321將些顏色特徵聯集成顏色範圍。背景處理模組322,根據顏色範圍將第二初始影像中具有該些顏色特徵的像素去除。In this embodiment, the processing unit 32 further includes a pixel conversion module 320, an image analysis module 321, and a background processing module 322. The pixel conversion module 320 determines a plurality of corresponding color features on the second initial image according to the position of the target to be removed from the first initial image selected by the user on the operation interface 300. The target to be removed from the background can be a single point or a range of a specific size. The image analysis module 321 combines these color features into a color range. The background processing module 322 removes the pixels with these color features in the second initial image according to the color range.

以下用圖1B與圖3G與圖3H所示的實施例來說明,第一影像擷取裝置30’的操作介面300上顯示有第一初始影像P1,使用者在第一初始影像P1上選取了欲去背目標90a~90e。要說明的是,選取的方式為觸控方式在第一影像擷取裝置30’的顯示屏幕上選擇。每一個欲去背目標90a~90e可以為單一像素或多個像素的集合。第一影像擷取裝置30’將所選取的目標90a~90e的位置資訊傳給了去背裝置3。The following is an example shown in FIG. 1B , FIG. 3G and FIG. 3H . A first initial image P1 is displayed on the operation interface 300 of the first image capture device 30 ′, and the user selects the target 90a~90e to be background-removed on the first initial image P1. It should be noted that the selection is made by touch on the display screen of the first image capture device 30 ′. Each target 90a~90e to be background-removed can be a single pixel or a collection of multiple pixels. The first image capture device 30 ′ transmits the position information of the selected target 90a~90e to the background-removing device 3.

去背裝置3接收到了位置資訊,傳給像素轉換模組320。像素轉換模組320根據所收到的位置資訊,在第二初始影像P2上取得相應於選取的目標90a~90e的顏色特徵。本實施例中,顏色特徵為YUV資訊,但不以此為限,例如:RGB資訊或者是CMYK資訊亦可。以下以YUV資訊來說明,在位置90a的YUV為(149,53,19),90b的YUV為(122,41,21),90c的YUV為(110,43,30),90d的YUV為(166,69,42) ,90e的YUV為(160,60,30)等。然後影像分析模組321再將對應選取的目標90a~90e的這些顏色特徵聯集成顏色範圍R1(Max:YUV(166, 69, 42), MinYUV(110, 41, 21),也就是Y介於166~110,U介於69~41,V介於42~21之間。之後,顏色範圍R1傳給了背景處理模組322,背景處理模組322再根據顏色範圍R1對第二初始影像P2中符合前述顏色範圍R1的顏色進行去除。The background removal device 3 receives the position information and transmits it to the pixel conversion module 320. The pixel conversion module 320 obtains the color characteristics corresponding to the selected targets 90a~90e on the second initial image P2 based on the received position information. In this embodiment, the color characteristics are YUV information, but are not limited to this. For example, RGB information or CMYK information is also acceptable. The following is explained using YUV information. The YUV at position 90a is (149,53,19), the YUV at 90b is (122,41,21), the YUV at 90c is (110,43,30), the YUV at 90d is (166,69,42), the YUV at 90e is (160,60,30), etc. Then, the image analysis module 321 combines the color features corresponding to the selected targets 90a-90e into a color range R1 (Max: YUV (166, 69, 42), MinYUV (110, 41, 21), that is, Y is between 166-110, U is between 69-41, and V is between 42-21. Afterwards, the color range R1 is transmitted to the background processing module 322, and the background processing module 322 removes the colors in the second initial image P2 that meet the color range R1 according to the color range R1.

除了前述之方式外,另一實施例中,影像分析模組321將每一顏色特徵定義出複數個顏色範圍。背景處理模組322,根據顏色範圍將第二初始影像P1中具有該些顏色特徵的像素去除。在本實施例中,如圖1B、圖3I與圖3J所示,第一影像擷取裝置30’的操作介面300上顯示有第一初始影像P1,使用者在初始影像上選取了欲去背的目標90f~90h。本實施例中,每一個目標90f~90h是由使用者利用觸控方式在第一初始影像P1上畫出的範圍。第一影像擷取裝置30’將所選取的目標90f~90h的位置資訊(範圍邊界)傳給了去背裝置3,然後經由像素轉換模組320根據所收到的位置資訊,在第二初始影像P2上取得相應於選取的目標90f~90h範圍邊界的顏色特徵,然後影像分析模組321再將對應選取的目標90f~90h範圍邊界的顏色特徵決定出對應的顏色範圍R2~R4,例如:R2的YUVmax(149,53,19),YUVmin(138,51,17);R3的YUVmax(122,41,21),YUVmin(115,25,18),R4的YUVmax(110,43,30),YUVmin(108,32,25)。要說明的是產生顏色範圍R2~R4的方式係如前圖3G與3H所述,在此不作贅述。之後,顏色範圍R2~R4傳給了背景處理模組322,背景處理模組322再根據顏色範圍R2~R4對第二初始影像P2中符合前述顏色範圍R2~R4的顏色進行去除。In addition to the aforementioned method, in another embodiment, the image analysis module 321 defines a plurality of color ranges for each color feature. The background processing module 322 removes the pixels having the color features in the second initial image P1 according to the color range. In this embodiment, as shown in FIG. 1B , FIG. 3I and FIG. 3J , the operation interface 300 of the first image capture device 30 ′ displays the first initial image P1, and the user selects the target 90f~90h to be removed from the background on the initial image. In this embodiment, each target 90f~90h is a range drawn by the user on the first initial image P1 using a touch screen. The first image capture device 30' transmits the position information (range boundary) of the selected target 90f~90h to the background removal device 3, and then the pixel conversion module 320 obtains the color features corresponding to the range boundary of the selected target 90f~90h on the second initial image P2 according to the received position information, and then the image analysis module 321 determines the corresponding color range R2~R4 according to the color features corresponding to the range boundary of the selected target 90f~90h, for example: R2's YUVmax(149,53,19), YUVmin(138,51,17); R3's YUVmax(122,41,21), YUVmin(115,25,18), R4's YUVmax(110,43,30), YUVmin(108,32,25). It should be noted that the method of generating the color range R2-R4 is as described in the previous Figures 3G and 3H, which will not be repeated here. Afterwards, the color range R2-R4 is transmitted to the background processing module 322, and the background processing module 322 removes the colors in the second initial image P2 that match the color range R2-R4 according to the color range R2-R4.

除了前述之方式外,另一實施例中,影像分析模組321將每一顏色特徵定義出複數個顏色值。背景處理模組322,根據顏色範圍將第二初始影像中具有該些顏色特徵的像素去除。在一實施例中,如圖3K與圖3L所示,第一影像擷取裝置30’的操作介面300上顯示有第一初始影像P1,使用者在初始影像上選取了欲去背的目標90i~90l。本實施例中,每一個目標90i~90l是由使用者利用觸控方式在第一初始影像P1點選的位置。第一影像擷取裝置30’將所選取的目標90i~90l的位置資訊傳給了去背裝置3,然後經由像素轉換模組320根據所收到的位置資訊,在第二初始影像P2上取得相應於選取的目標(像素)90i~90l的顏色特徵,然後影像分析模組321再將對應選取的目標90i~90l的顏色特徵決定出對應的顏色值Ca~Cd,例如:位置90i的YUV值Ca為(149,53,19),90j的YUV值Cb為(122,41,21),90k的YUV值Cc為(110,43,30),90l的YUV值Cd為(166,69,42)。之後,顏色值Ca~Cd傳給了背景處理模組322,背景處理模組322再根據顏色值Ca~Cd對第二初始影像P2中符合前述顏色值Ca~Cd的顏色進行去除。In addition to the aforementioned method, in another embodiment, the image analysis module 321 defines a plurality of color values for each color feature. The background processing module 322 removes the pixels having the color features in the second initial image according to the color range. In one embodiment, as shown in FIG. 3K and FIG. 3L , the operation interface 300 of the first image capture device 30 ′ displays the first initial image P1, and the user selects the target 90i~90l to be removed from the initial image. In this embodiment, each target 90i~90l is a position selected by the user using a touch screen in the first initial image P1. The first image capture device 30' transmits the position information of the selected target 90i~90l to the background removal device 3, and then the pixel conversion module 320 obtains the color features corresponding to the selected targets (pixels) 90i~90l on the second initial image P2 according to the received position information, and then the image analysis module 321 determines the corresponding color values Ca~Cd according to the color features of the selected targets 90i~90l, for example: the YUV value Ca of position 90i is (149,53,19), the YUV value Cb of 90j is (122,41,21), the YUV value Cc of 90k is (110,43,30), and the YUV value Cd of 90l is (166,69,42). Afterwards, the color values Ca~Cd are transmitted to the background processing module 322, and the background processing module 322 removes the colors in the second initial image P2 that match the color values Ca~Cd according to the color values Ca~Cd.

再回到圖1B所示,處理單元32更具有影像疊加模組323,其係將背景處理模組322去背之後的去背影像與至少一背景影像相互疊加,以形成疊加影像。其中,背景影像可以為圖像或者是動態的影像。背景影像可以事先儲存在去背裝置3內,或者是透過網路連接雲端儲存設備7取得。此外,去背裝置3更具有第三連接介面332、影像輸出模組34以及第四連接介面333,其中第三連接介面332作為影音訊號輸出的介面,與電子裝置5電性連接,將處理後所得到的多媒體資訊,例如:影音資訊、影像資訊或圖像資訊,傳給電子裝置5。電子裝置5可以為智慧型手機、筆記型電腦或者是桌上型電腦等。第三連接介面332可以為USB各種形式的介面、HDMI或DVI等影音介面或者是無線或有線網路介面,但不以此為限置。在一實施例中,電子裝置5內具有應用程式可以將影音處理裝置5所輸出的多媒體資訊上傳到遠端的網路的影音串流平台或者是雲端儲存裝置。Returning to FIG. 1B , the processing unit 32 further has an image superimposition module 323, which superimposes the background-removed image after the background processing module 322 removes the background and at least one background image to form a superimposed image. The background image can be a picture or a dynamic image. The background image can be stored in the background removal device 3 in advance, or obtained by connecting to the cloud storage device 7 via the network. In addition, the background removal device 3 further has a third connection interface 332, an image output module 34, and a fourth connection interface 333, wherein the third connection interface 332 is electrically connected to the electronic device 5 as an interface for outputting audio and video signals, and transmits the multimedia information obtained after processing, such as audio and video information, image information, or image information, to the electronic device 5. The electronic device 5 can be a smart phone, a laptop, or a desktop computer, etc. The third connection interface 332 can be a USB interface of various forms, an audio and video interface such as HDMI or DVI, or a wireless or wired network interface, but is not limited thereto. In one embodiment, the electronic device 5 has an application that can upload the multimedia information output by the audio and video processing device 5 to a remote network audio and video streaming platform or a cloud storage device.

影像輸出模組34與影像疊加模組323以及第四連接介面333電性連接,第四連接介面333與顯示裝置6電性連接,第四連接介面333可以為USB各種形式的介面、HDMI或DVI等影音介面。透過影像輸出模組34以及第四連接介面333,使用者可以直接透過顯示器6看到後處理之後的影像效果。在另一實施例中,去背裝置3更可以包括有音訊連接介面334用以和音訊輸入裝置電性連接。音訊輸入裝置可以為麥克風或者是其他播音設備。The image output module 34 is electrically connected to the image superimposition module 323 and the fourth connection interface 333. The fourth connection interface 333 is electrically connected to the display device 6. The fourth connection interface 333 can be an interface in various forms of USB, an audio and video interface such as HDMI or DVI. Through the image output module 34 and the fourth connection interface 333, the user can directly see the image effect after post-processing through the display 6. In another embodiment, the background removal device 3 can further include an audio connection interface 334 for electrically connecting to an audio input device. The audio input device can be a microphone or other broadcasting equipment.

在一實施例中,透過圖1A的去背裝置3,進行圖2A的去背方法2,首先利用步驟20藉由影像擷取裝置30擷取初始影像P0。接著進行步驟21,於影像擷取裝置30中提供操作介面顯示出初始影像P0。然後以步驟22藉由操作介面300於初始影像P0選取一個或複數個欲去背目標,並產生相應於選取的欲去背目標的複數個位置資訊。在步驟22中,可以利用前述如圖3A、圖3C或圖3E所示的三種方式任一種來達成選取目標位置的效果。之後,進行步驟23利用處理單元32從初始影像P0當中決定出對應於該些位置資訊的複數個顏色特徵。在步驟23中,可以利用前述如圖3B、圖3D或圖3F所示的三種方式任何一種來達成取得顏色特徵的效果。最後進行步驟24,處理單元32根據該些顏色特徵,對初始影像P0進行去背。在去背過程中,處理單元32將初始影像P0中符合顏色特徵的各個像素所具有的顏色去除,將去除顏色的區域透明化,形成去背影像。步驟24所得到的去背影像,可以進一步透過影像疊加模組323與另一目標影像或圖像相互疊加,形成疊加影像。In one embodiment, the background removal method 2 of FIG. 2A is performed by the background removal device 3 of FIG. 1A. First, the initial image P0 is captured by the image capture device 30 in step 20. Then, step 21 is performed to provide an operation interface in the image capture device 30 to display the initial image P0. Then, in step 22, one or more background removal targets are selected from the initial image P0 through the operation interface 300, and a plurality of position information corresponding to the selected background removal targets is generated. In step 22, any of the three methods shown in FIG. 3A, FIG. 3C or FIG. 3E can be used to achieve the effect of selecting the target position. Afterwards, step 23 is performed to determine a plurality of color features corresponding to the position information from the initial image P0 using the processing unit 32. In step 23, any of the three methods shown in FIG. 3B, FIG. 3D or FIG. 3F can be used to achieve the effect of obtaining color features. Finally, step 24 is performed, and the processing unit 32 removes the background of the initial image P0 according to the color features. In the background removal process, the processing unit 32 removes the color of each pixel in the initial image P0 that meets the color feature, and makes the area where the color is removed transparent to form a background-removed image. The background-removed image obtained in step 24 can be further superimposed with another target image or picture through the image superposition module 323 to form a superimposed image.

在另一實施例中,透過圖1B或圖1C的去背裝置3,進行圖2B的去背方法2a,首先利用步驟20a藉由第一影像擷取裝置30’擷取第一初始影像以及第二影像擷取裝置31擷取第二初始影像。接著進行步驟21a,於第一影像擷取裝置30’中提供操作介面顯示出第一初始影像P1。然後以步驟22a藉由操作介面300於第一初始影像P1選取一個或複數個欲去背目標,並產生相應於選取的欲去背目標的複數個位置資訊。在步驟22a中,可以利用前述如圖3G、圖3I或圖3K所示的三種方式任一種來達成選取目標位置的效果。之後,進行步驟23a利用處理單元32從第二初始影像當中決定出對應於該些位置資訊的複數個顏色特徵。在步驟23a中,可以利用前述如圖3H、圖3J或圖3L所示的三種方式任何一種來達成取得顏色特徵的效果。最後進行步驟24a,處理單元32根據該些顏色特徵,對第二初始影像進行去背。在去背過程中,處理單元32將第二初始影像中符合顏色特徵的各個像素所具有的顏色去除,將去除顏色的區域透明化,形成去背影像。步驟24a所得到的去背影像,可以進一步透過影像疊加模組323與另一目標影像或圖像相互疊加,形成疊加影像。In another embodiment, the background removal method 2a of FIG. 2B is performed by the background removal device 3 of FIG. 1B or FIG. 1C. First, the first initial image is captured by the first image capture device 30' and the second initial image is captured by the second image capture device 31 in step 20a. Then, step 21a is performed to provide an operation interface in the first image capture device 30' to display the first initial image P1. Then, in step 22a, one or more background removal targets are selected in the first initial image P1 through the operation interface 300, and a plurality of position information corresponding to the selected background removal targets is generated. In step 22a, any of the three methods shown in FIG. 3G, FIG. 3I or FIG. 3K can be used to achieve the effect of selecting the target position. Afterwards, step 23a is performed to use the processing unit 32 to determine a plurality of color features corresponding to the position information from the second initial image. In step 23a, any of the three methods as shown in Figure 3H, Figure 3J or Figure 3L can be used to achieve the effect of obtaining color features. Finally, step 24a is performed, and the processing unit 32 removes the background of the second initial image based on the color features. In the background removal process, the processing unit 32 removes the color of each pixel in the second initial image that meets the color feature, and makes the area where the color is removed transparent to form a background-removed image. The background-removed image obtained in step 24a can be further superimposed with another target image or picture through the image superposition module 323 to form a superimposed image.

綜合上述,本發明的去背方法與去背裝置,可以在擷取影像或圖像之後,立即的根據使用者選擇多個區域的找到相應的多個顏色特徵進行去背,透過選取多個區域顏色特徵的演算,可以解決因為擷取影像的角度產生反光所產生的顏色差異而影響去背效果的問題。此外,使用者直接選取區域的方式更可以提升去背影像處理效率。In summary, the background removal method and background removal device of the present invention can find multiple corresponding color features according to multiple regions selected by the user immediately after capturing an image or picture to remove the background. By selecting the calculation of the color features of multiple regions, the problem of color difference caused by reflection caused by the angle of capturing the image and affecting the background removal effect can be solved. In addition, the method of directly selecting the region by the user can further improve the background removal image processing efficiency.

以上所述,乃僅記載本發明為呈現解決問題所採用的技術手段之較佳實施方式或實施例而已,並非用來限定本發明專利實施之範圍。即凡與本發明專利申請範圍文義相符,或依本發明專利範圍所做的均等變化與修飾,皆為本發明專利範圍所涵蓋。The above only records the preferred implementation methods or examples of the technical means adopted by the present invention to solve the problem, and is not used to limit the scope of implementation of the present invention. That is, all equivalent changes and modifications that are consistent with the scope of the patent application of the present invention or made according to the scope of the patent of the present invention are covered by the scope of the patent of the present invention.

2:去背方法 20~24:步驟 3:去背裝置 30:影像擷取裝置 30’:第一影像擷取裝置 30a:鏡頭 300:操作介面 31:第二影像擷取裝置 31a:鏡頭 32:處理單元 320:像素轉換模組 321:影像分析模組 322:背景處理模組 323:影像疊加模組 330:第一連接介面 331:第二連接介面 332:第三連接介面 333:第四連接介面 334:音訊連接介面 34:影像輸出模組 4:被攝主體 40:背景環境 5:電子裝置 6:顯示裝置 7:雲端儲存設備 P0:初始影像 P1:第一初始影像 P2:第二初始影像 90a~90l:目標 R1~R4:範圍 Ca~Cd:顏色值 2: Background removal method 20~24: Steps 3: Background removal device 30: Image capture device 30’: First image capture device 30a: Lens 300: Operation interface 31: Second image capture device 31a: Lens 32: Processing unit 320: Pixel conversion module 321: Image analysis module 322: Background processing module 323: Image superposition module 330: First connection interface 331: Second connection interface 332: Third connection interface 333: Fourth connection interface 334: Audio connection interface 34: Image output module 4: Subject 40: Background environment 5: Electronic device 6: Display device 7: Cloud storage device P0: Initial image P1: First initial image P2: Second initial image 90a~90l: Target R1~R4: Range Ca~Cd: Color value

圖1A為本發明之去背裝置之一實施例示意圖。 圖1B與圖1C為本發明之去背裝置之其他實施例示意圖。 圖2A為本發明之去背方法之一實施例流程示意圖。 圖2B為本發明之去背方法之一實施例流程示意圖。 圖3A至3L為本發明之選取顏色特徵之不同實施例示意圖。 FIG. 1A is a schematic diagram of an embodiment of the background removal device of the present invention. FIG. 1B and FIG. 1C are schematic diagrams of other embodiments of the background removal device of the present invention. FIG. 2A is a schematic diagram of a flow chart of an embodiment of the background removal method of the present invention. FIG. 2B is a schematic diagram of a flow chart of an embodiment of the background removal method of the present invention. FIG. 3A to FIG. 3L are schematic diagrams of different embodiments of selecting color features of the present invention.

2:去背方法 2: Background removal method

20~24:步驟 20~24: Steps

Claims (10)

一種去背方法,適用於背景布幕顏色呈現不均勻的去背情境,該去背方法包括:藉由一影像擷取裝置擷取一初始影像;於該影像擷取裝置中提供一操作介面顯示出該初始影像;藉由該操作介面於該初始影像選取複數個欲去背目標,並產生該些欲去背目標的複數個位置資訊;提供一處理單元以從該初始影像當中決定出對應於該些位置資訊的複數個顏色特徵;以及該處理單元根據該些顏色特徵,對該初始影像進行去背。 A background removal method is applicable to the background removal situation where the color of the background curtain is uneven. The background removal method includes: capturing an initial image by an image capture device; providing an operation interface in the image capture device to display the initial image; selecting a plurality of background removal targets in the initial image by the operation interface, and generating a plurality of position information of the background removal targets; providing a processing unit to determine a plurality of color features corresponding to the position information from the initial image; and the processing unit removes the background of the initial image according to the color features. 如請求項1所述之去背方法,其中該影像擷取裝置包含一第一影像擷取裝置以及一第二影像擷取裝置,該初始影像包含一第一初始影像以及一第二初始影像,其中該第一初始影像以及該第二初始影像分別透過該第一影像擷取裝置以及該第二影像擷取裝置擷取而得,該操作介面係提供於該第一影像擷取裝置並顯示出該第一初始影像,其中該些欲去背目標係藉由該操作介面於該第一初始影像選取而得,其中該些顏色特徵係藉由該處理單元從該第二初始影像當中所決定出,並根據該些顏色特徵對該第二初始影像進行去背。 The background removal method as described in claim 1, wherein the image capture device includes a first image capture device and a second image capture device, the initial image includes a first initial image and a second initial image, wherein the first initial image and the second initial image are captured by the first image capture device and the second image capture device respectively, the operation interface is provided on the first image capture device and displays the first initial image, wherein the background removal targets are selected from the first initial image through the operation interface, wherein the color features are determined from the second initial image by the processing unit, and the background removal is performed on the second initial image according to the color features. 如請求項2所述之去背方法,其中根據該些顏色特徵對該第二初始影像進行去背更包括有將該些顏色特徵聯集成一顏色範圍,並根據該顏色範圍將該第二初始影像中具有該些顏色特徵的像素去除。 The background removal method as described in claim 2, wherein the background removal of the second initial image according to the color features further includes combining the color features into a color range, and removing the pixels having the color features in the second initial image according to the color range. 如請求項2所述之去背方法,其中根據該些顏色特徵對該第二初 始影像進行去背更包括有將該些顏色特徵定義出複數個顏色範圍,並根據該顏些色範圍將該第二初始影像中具有該些顏色特徵的像素去除。 The background removal method as described in claim 2, wherein the background removal of the second initial image according to the color features further includes defining a plurality of color ranges from the color features, and removing pixels having the color features in the second initial image according to the color ranges. 如請求項2所述之去背方法,其中根據該些顏色特徵對該第二初始影像進行去背更包括有將該些顏色特徵定義出複數個顏色值,並根據該些顏色值將該第二初始影像中具有該些顏色特徵的像素去除。 The background removal method as described in claim 2, wherein the background removal of the second initial image according to the color features further includes defining a plurality of color values from the color features, and removing the pixels having the color features in the second initial image according to the color values. 一種去背裝置,適用於背景布幕顏色呈現不均勻的去背情境,該去背裝置包括:一操作介面;一影像接收埠,接收一初始影像,藉由該操作介面以於該初始影像選取複數個欲去背目標,並產生該些欲去背目標的複數個位置資訊;以及一處理單元,與該影像接收埠電性連接,該處理單元從該初始影像當中決定出對應於該些位置資訊的複數個顏色特徵,並根據該些顏色特徵對該初始影像進行去背。 A background removal device is suitable for removing background when the background curtain has uneven color. The background removal device includes: an operation interface; an image receiving port, which receives an initial image, selects a plurality of background removal targets in the initial image through the operation interface, and generates a plurality of position information of the background removal targets; and a processing unit, which is electrically connected to the image receiving port, determines a plurality of color features corresponding to the position information from the initial image, and removes the background of the initial image according to the color features. 如請求項6所述之去背裝置,其中該影像接收埠包含一第一影像接收埠以及一第二影像接收埠,該初始影像包含一第一初始影像以及一第二初始影像,該些欲去背目標係藉由該操作介面於該第一初始影像中選取而得,該處理單元從該第二初始影像當中決定出該些顏色特徵,並根據該些顏色特徵對該第二初始影像進行去背。 The background removal device as described in claim 6, wherein the image receiving port includes a first image receiving port and a second image receiving port, the initial image includes a first initial image and a second initial image, the background removal targets are selected from the first initial image through the operation interface, the processing unit determines the color features from the second initial image, and removes the background of the second initial image according to the color features. 如請求項7所述之去背裝置,其中該處理單元更包括有:一像素轉換模組,根據所選取的該些欲去背目標於該第二初始影像上決定相應的複數個顏色特徵; 一影像分析模組,將該些顏色特徵聯集成一顏色範圍;以及一背景處理模組,根據該顏色範圍將該第二初始影像中具有該些顏色特徵的像素去除。 The background removal device as described in claim 7, wherein the processing unit further includes: a pixel conversion module, which determines a plurality of corresponding color features on the second initial image according to the selected background removal targets; an image analysis module, which combines the color features into a color range; and a background processing module, which removes pixels having the color features in the second initial image according to the color range. 如請求項7所述之去背裝置,其中該處理單元更包括有:一像素轉換模組,根據所選取的該些欲去背目標於該第二初始影像上決定相應的複數個顏色特徵;一影像分析模組,將該些顏色特徵定義出複數個顏色範圍;以及一背景處理模組,根據該些顏色範圍將該第二初始影像中具有該些顏色特徵的像素去除。 The background removal device as described in claim 7, wherein the processing unit further includes: a pixel conversion module, which determines a plurality of corresponding color features on the second initial image according to the selected background removal targets; an image analysis module, which defines a plurality of color ranges from the color features; and a background processing module, which removes pixels having the color features in the second initial image according to the color ranges. 如請求項7所述之去背裝置,其中該處理單元更包括有:一像素轉換模組,根據所選取的該些欲去背目標於該第二初始影像上決定相應的顏色特徵;一影像分析模組,將該些顏色特徵定義出複數個顏色值;以及一背景處理模組,根據該些顏色值將該第二初始影像中具有該些顏色特徵的像素去除。 The background removal device as described in claim 7, wherein the processing unit further includes: a pixel conversion module, which determines the corresponding color features on the second initial image according to the selected background removal targets; an image analysis module, which defines a plurality of color values from the color features; and a background processing module, which removes the pixels having the color features in the second initial image according to the color values.
TW110113187A 2021-04-13 2021-04-13 Method and device for removeing the background TWI837469B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
TW110113187A TWI837469B (en) 2021-04-13 Method and device for removeing the background
CN202210356625.6A CN115272360A (en) 2021-04-13 2022-04-06 Back removing method and back removing device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW110113187A TWI837469B (en) 2021-04-13 Method and device for removeing the background

Publications (2)

Publication Number Publication Date
TW202240548A TW202240548A (en) 2022-10-16
TWI837469B true TWI837469B (en) 2024-04-01

Family

ID=

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110991454A (en) 2019-12-23 2020-04-10 云南大学 Blade image recognition method and device, electronic equipment and storage medium

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110991454A (en) 2019-12-23 2020-04-10 云南大学 Blade image recognition method and device, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
WO2019105467A1 (en) Method and device for sharing information, storage medium, and electronic device
US10242710B2 (en) Automatic cinemagraph
CN107948733B (en) Video image processing method and device and electronic equipment
WO2023016039A1 (en) Video processing method and apparatus, electronic device, and storage medium
CN103916597A (en) Shooting method based on simulated scenario
US20140313366A1 (en) Method of processing image and electronic device and system supporting the same
WO2023193521A1 (en) Video inpainting method, related apparatus, device and storage medium
JP2017511627A (en) Raw scene recognition that allows scene-dependent image modification before image recording or display
KR102641738B1 (en) Image processing method and electronic device supporting the same
US10205940B1 (en) Determining calibration settings for displaying content on a monitor
TWI837469B (en) Method and device for removeing the background
CN115002358B (en) Control method and system in digital background shooting
US20210400192A1 (en) Image processing apparatus, image processing method, and storage medium
TW202240548A (en) Method and device for removeing the background
WO2021169810A1 (en) Video processing method, and server
US9036070B2 (en) Displaying of images with lighting on the basis of captured auxiliary images
US11562712B2 (en) Video reproduction system, video reproduction device, and calibration method for video reproduction system
US10440266B2 (en) Display apparatus and method for generating capture image
Le et al. Visual quality assessment for projected content
JP5742305B2 (en) Drawing image processing device
EP1542471A4 (en) Image processing device, method, information processing device, method, recording medium, and program
WO2024082863A1 (en) Image processing method and electronic device
WO2023100664A1 (en) Image processing device, image processing method, and program
CN111083312B (en) Studio system and program video production method and device
JP2019009764A (en) Image processor, image processing method, image processing system, and program