TWI400943B - A method and a system for adjusting the control of the border / subtitle color of the media screen - Google Patents

A method and a system for adjusting the control of the border / subtitle color of the media screen Download PDF

Info

Publication number
TWI400943B
TWI400943B TW99105805A TW99105805A TWI400943B TW I400943 B TWI400943 B TW I400943B TW 99105805 A TW99105805 A TW 99105805A TW 99105805 A TW99105805 A TW 99105805A TW I400943 B TWI400943 B TW I400943B
Authority
TW
Taiwan
Prior art keywords
color
value
border
subtitle
brightness
Prior art date
Application number
TW99105805A
Other languages
Chinese (zh)
Other versions
TW201132118A (en
Original Assignee
Matsushita Electric Tw Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Matsushita Electric Tw Co Ltd filed Critical Matsushita Electric Tw Co Ltd
Priority to TW99105805A priority Critical patent/TWI400943B/en
Publication of TW201132118A publication Critical patent/TW201132118A/en
Application granted granted Critical
Publication of TWI400943B publication Critical patent/TWI400943B/en

Links

Landscapes

  • Controls And Circuits For Display Device (AREA)
  • Studio Circuits (AREA)

Description

播放媒體畫面之邊框/字幕色彩之調整控制方法和系統Method and system for adjusting border/subtitle color of media screen

本發明是有關於一種調整色彩之控制方法和系統,特別是指一種播放媒體畫面之邊框/字幕色彩之調整控制方法和系統。The present invention relates to a method and system for controlling color adjustment, and more particularly to a method and system for adjusting the border/subtitle color of a playback media screen.

現行數位看板的媒體在播放時,其播放影像畫面之訊息邊框/字幕色彩有下述缺失:When the media of the current digital signage is playing, the message border/subtitle color of the video image is missing as follows:

1.在邊框方面,以在播放之影像畫面重疊的一訊息為例,訊息外緣主要是套用一預定顏色之邊框,若該預定顏色與播放之影像畫面顏色接近時,無法突顯。1. In the case of a frame, taking a message superimposed on the played image screen as an example, the outer edge of the message is mainly a frame of a predetermined color, and if the predetermined color is close to the color of the played image, it cannot be highlighted.

2.在字幕方面,現行一般例如影片的播放媒體字幕使用白色或黃色,且一色到底,無法依據播放媒體不同的色彩變換不同的字幕顏色,有時會影響閱讀。2. In terms of subtitles, currently, for example, the video playback media subtitles use white or yellow, and one color is in the end, and it is impossible to change different subtitle colors according to different colors of the playback media, which sometimes affects reading.

3.在選單方面,例如觸發遙控器後,於在播放之影像畫面所產生的一選單訊息,其色彩固定,無法依背景播放之影像畫面之色彩作變化,當色彩接近時不易觀看和操作。3. In the menu aspect, for example, after triggering the remote controller, the color of a menu message generated on the played image screen is fixed, and cannot change according to the color of the image screen played by the background, and is difficult to watch and operate when the color is close.

本發明之目的,即在提供一種播放媒體畫面之邊框/字幕色彩之調整控制方法和系統。It is an object of the present invention to provide a method and system for adjusting the border/subtitle color of a playback media screen.

本發明播放媒體畫面之邊框/字幕色彩之調整控制方法包含下述步驟:(a)依據該播放媒體畫面之第一區域取得一代表背景色之第一色彩;(b)依據該播放媒體畫面之第二區域取得一代表前景色之第二色彩;及(c)由該第一色彩及該第二色彩之亮度/色彩差異決定一第三色彩,且以該第三色彩作為該播放媒體畫面之邊框/字幕之色彩。The method for controlling the border/subtitle color of the playback media screen comprises the following steps: (a) obtaining a first color representing a background color according to the first region of the playback media screen; (b) according to the playback media screen The second area obtains a second color representing the foreground color; and (c) determining a third color by the brightness/color difference of the first color and the second color, and using the third color as the playing media picture The color of the border/subtitle.

本發明播放媒體畫面之邊框色彩之調整控制方法包括下述步驟:(a)設定一間隔取值時間及邊框位置和大小;(b)於播放媒體時,判斷是否到達一間隔取值時間,若到達該間隔取值時間即執行一色彩調整控制程序,該色彩調整控制程序是依據該播放媒體畫面之第一區域取得一代表背景色之第一色彩,依據該播放媒體畫面之第二區域取得一代表前景色之第二色彩,並由該第一色彩及該第二色彩之亮度/色彩差異決定一第三色彩,及記錄該第三色彩以作為邊框色彩;及(c)依據設定之邊框位置和大小顯示更新色彩後之邊框。The method for controlling the border color of the playback media screen comprises the following steps: (a) setting an interval value time and a position and a size of the frame; (b) determining whether to reach an interval value when playing the media, if When the interval value is reached, a color adjustment control program is executed. The color adjustment control program obtains a first color representing a background color according to the first region of the playback media screen, and obtains a second region according to the playback media screen. Representing a second color of the foreground color, and determining a third color by the brightness/color difference of the first color and the second color, and recording the third color as a border color; and (c) according to the set border position And size display the border after updating the color.

本發明播放媒體畫面之字幕色彩之調整控制方法包括下述步驟:(a)設定一亮度門檻值;(b)依據該播放媒體畫面之第一區域取得一代表背景色之第一色彩及於該播放媒體畫面之第二區域取得一代表前景色之第二色彩,由該第一色彩及該第二色彩之亮度/色彩差異決定一第三色彩,並以該第三色彩求出一色彩亮度值;及(c)比對該色彩亮度值及該亮度門檻值以判斷選用何種字幕色彩。The method for adjusting subtitle color of a playback media screen includes the following steps: (a) setting a brightness threshold; (b) obtaining a first color representing a background color according to the first region of the playback media screen; And playing a second color of the foreground image, determining a third color by the brightness/color difference of the first color and the second color, and determining a color brightness value by using the second color And (c) compare the color brightness value and the brightness threshold to determine which subtitle color to use.

本發明播放媒體畫面之邊框色彩之調整控制系統包含一背景色抽取模組、一前景色抽取模組及一邊框色生成模組。The frame color adjustment control system of the playback media screen comprises a background color extraction module, a foreground color extraction module and a border color generation module.

該背景色抽取模組依據該播放媒體畫面之第一區域取得一代表背景色之第一色彩;該前景色抽取模組依據該播放媒體畫面之第二區域取得一代表前景色之第二色彩;該邊框色生成模組由該第一色彩及該第二色彩之亮度/色彩差異決定一第三色彩,並以該第三色彩作為該播放媒體畫面之邊框之色彩。The background color extraction module obtains a first color representing a background color according to the first area of the playback media screen; the foreground color extraction module obtains a second color representing the foreground color according to the second area of the playback media screen; The frame color generating module determines a third color by the brightness/color difference of the first color and the second color, and uses the third color as the color of the border of the playing media picture.

本發明播放媒體畫面之邊框色彩之調整控制系統包含一編輯模組、一指定媒體模組及一計算模組。The frame color adjustment control system for playing a media screen of the present invention comprises an editing module, a designated media module and a computing module.

該編輯模組供輸入資料以進行相關的設定操作;該指定媒體模組供指定一需更新畫面中的邊框色彩之媒體資料;該計算模組接收該輸入資料以進行設定,並依據查表方式產生前述的邊框色彩,其查表包括一時序設定表及一搭配設定表,該時序設定表是依據不同時間變化之邊框效果,該搭配設定表是前景/背景對應靜態圖片/動態影片之設定程序加以設定以產生最適的搭配效果。The editing module is configured to input data for performing related setting operations; the designated media module is configured to specify a media material of a border color in the screen to be updated; the computing module receives the input data for setting, and according to a table lookup manner The foregoing border color is generated, and the lookup table includes a timing setting table and a matching setting table, wherein the timing setting table is a frame effect according to different time changes, and the matching setting table is a foreground/background corresponding static picture/dynamic movie setting program. Set it to produce the best match.

本發明播放媒體畫面之字幕色彩之調整控制系統包含一背景色抽取模組、一前景色抽取模組及一字幕色生成模組:該背景色抽取模組依據該播放媒體畫面之第一區域取得一代表背景色之第一色彩;該前景色抽取模組依據該播放媒體畫面之第二區域取得一代表前景色之第二色彩;該字幕色生成模組由該第一色彩及該第二色彩之亮度/色彩差異決定一第三色彩,並以該第三色彩求出一色彩亮度值,及比對該色彩亮度值及該亮度門檻值以判斷選用何種字幕色彩。The adjustment control system for subtitle color of the playback media screen comprises a background color extraction module, a foreground color extraction module and a subtitle color generation module: the background color extraction module is obtained according to the first region of the playback media image a first color representing a background color; the foreground color extraction module obtains a second color representing a foreground color according to the second area of the playback media image; the subtitle color generation module is configured by the first color and the second color The brightness/color difference determines a third color, and a color brightness value is obtained from the third color, and the color brightness value and the brightness threshold value are compared to determine which subtitle color is selected.

本發明播放媒體畫面之邊框/字幕色彩之調整控制方法和系統之功效在於,利用由代表背景之第一色彩及代表前景之第二色彩之亮度/色彩差異決定播放媒體畫面之邊框/字幕之色彩,使得整體畫面能達到較佳的閱讀效果。The effect of the method and system for adjusting the border/subtitle color of the playback media screen is to determine the color of the border/subtitle of the played media screen by using the first color representing the background and the brightness/color difference of the second color representing the foreground. So that the overall picture can achieve better reading results.

有關本發明之前述及其他技術內容、特點與功效,在以下配合參考圖式之數個較佳實施例的詳細說明中,將可清楚的呈現。在本發明被詳細描述之前,要注意的是,在以下的說明內容中,類似的元件是以相同的編號來表示。另外,本發明所提到的三原色分別為紅(R)、綠(G)、藍色(B),三原色之顏色值(R,G,B)組成一色彩,各顏色值範圍為0至255,邊框顏色之產生可以類推適用於選單或訊息的方塊顏色,不以邊框框線顏色為限制。The above and other technical features, features, and advantages of the present invention will be apparent from the following detailed description of the preferred embodiments. Before the present invention is described in detail, it is noted that in the following description, similar elements are denoted by the same reference numerals. In addition, the three primary colors mentioned in the present invention are red (R), green (G), and blue (B), respectively, and the color values (R, G, B) of the three primary colors constitute a color, and each color value ranges from 0 to 255. The color of the border can be analogized to the color of the box used for the menu or message, not limited by the color of the border.

參閱圖1,本發明之較佳實施例中,播放媒體畫面之邊框/字幕色彩之調整控制系統100包含一控制單元10、一顯示單元11、一記憶單元12、一接收單元13及一輸入單元14;其中記憶單元12具有一媒體資料庫40、一播放程式41、一編輯程式42、一邊框程式43及一字幕程式44。Referring to FIG. 1 , in a preferred embodiment of the present invention, a frame/subtitle color adjustment control system 100 for playing a media screen includes a control unit 10, a display unit 11, a memory unit 12, a receiving unit 13, and an input unit. The memory unit 12 has a media library 40, a player 41, an editing program 42, a border program 43 and a caption program 44.

控制單元10協調各元件之運作,執行播放程式41以播放媒體資料庫40之媒體資料,例如:影片、視訊、節目或影像檔案(以下簡稱播放媒體);顯示單元11是一顯示螢幕,用以顯示播放媒體之畫面,播放媒體之畫面呈現至少一邊框/字幕,且播放媒體是邊框/字幕的背景;接收單元13接收遙控器2之指令以於顯示單元11顯示重疊於播放媒體上之選單;輸入單元14是鍵盤滑鼠等輸入資料裝置。The control unit 10 coordinates the operation of each component, and executes the play program 41 to play the media data of the media library 40, such as a video, video, program or video file (hereinafter referred to as playing media); the display unit 11 is a display screen for Displaying a picture of the playing medium, the screen of the playing medium presents at least one border/subtitle, and the playing medium is the background of the border/subtitle; the receiving unit 13 receives the instruction of the remote controller 2 to display the menu superimposed on the playing medium by the display unit 11; The input unit 14 is an input data device such as a keyboard mouse.

以下配合圖1,分別介紹系統原理以及邊框/字幕色彩之調整控制方法和系統之詳細運作方式。在原理方面,參考圖2至圖4之說明,在邊框處理方面,可區分為如圖5事先編輯處理再播放處理模式及如圖6及圖7之即時處理模式,在字幕處理方面可參閱圖8及圖9之說明,而轉場處理參閱圖10及圖11之說明。The following is a description of the system principle and the adjustment control method of the border/subtitle color and the detailed operation mode of the system. In terms of the principle, with reference to FIG. 2 to FIG. 4, in the aspect of the frame processing, it can be divided into the pre-edit processing and replay processing mode as shown in FIG. 5 and the instant processing mode as shown in FIG. 6 and FIG. 7, and the subtitle processing can be referred to the figure. 8 and FIG. 9, and the transition processing is described with reference to FIGS. 10 and 11.

編輯程式42、邊框程式43及字幕程式44之色彩配置原理均類似,為方便說明起見,以邊框程式43為代表說明之。The color configuration principles of the editing program 42, the border program 43, and the subtitle program 44 are similar. For convenience of explanation, the border program 43 is representative.

參閱圖2,邊框程式43包括一背景色抽取模組431、一前景色抽取模組432、一邊框色生成模組433及一邊框產生模組434。Referring to FIG. 2, the border program 43 includes a background color extraction module 431, a foreground color extraction module 432, a border color generation module 433, and a frame generation module 434.

本發明播放媒體畫面之邊框色彩之調整控制方法包含下述步驟:配合圖3及圖4,背景色抽取模組431依據播放媒體畫面401之第一區域101取得一代表背景色之第一色彩(步驟301),例如:(Br,Bg,Bb),分別代表背景色之紅、藍、綠;然後,前景色抽取模組432依據該播放媒體畫面401之第二區域102取得一代表前景色之第二色彩(步驟302),例如:(Fr,Fg,Fb),分別代表前景色之紅、藍、綠。The method for adjusting the border color of the playback media screen of the present invention comprises the following steps: in conjunction with FIG. 3 and FIG. 4, the background color extraction module 431 obtains a first color representing the background color according to the first region 101 of the playback media screen 401 ( Step 301), for example: (Br, Bg, Bb), respectively representing the background color of red, blue, and green; then, the foreground color extraction module 432 obtains a representative foreground image according to the second area 102 of the playback media screen 401. The second color (step 302), for example: (Fr, Fg, Fb), represents the red, blue, and green of the foreground color, respectively.

須注意的是,背景色抽取模組431抽取的範圍是例如邊框的外圍區及/或內圍區,前景色抽取模組432抽取的範圍是例如媒體中心區域103,且前述選取區可以是一/多點、或多點、或一/多條線,或一/多矩形區域,或一/多任意區域,只要足以取得色彩值,皆可當成前景色或背景色之要素。It should be noted that the range extracted by the background color extraction module 431 is, for example, the peripheral area and/or the inner circumference area of the frame. The range extracted by the foreground color extraction module 432 is, for example, the media center area 103, and the foregoing selection area may be one. / Multi-point, or multi-point, or one/multiple lines, or one/multiple rectangular areas, or one/multiple arbitrary areas, as long as it is sufficient to obtain a color value, can be regarded as an element of the foreground color or the background color.

邊框色生成模組433由第一色彩及第二色彩之亮度/色彩差異決定一第三色彩,且以該第三色彩作為該播放媒體畫面401之邊框/字幕之色彩(步驟303),例如:以三原色之顏色值組成(C1,C2,C3);最後,邊框產生模組434於播放媒體畫面產生一邊框,且以第三色彩之顏色值組成,即(C1,C2,C3),作為在顯示單元11播放媒體畫面401之邊框色彩。The border color generating module 433 determines a third color by the brightness/color difference of the first color and the second color, and uses the third color as the border/subtitle color of the playing media screen 401 (step 303), for example: The color value of the three primary colors is composed (C1, C2, C3); finally, the frame generation module 434 generates a border on the playing media screen, and is composed of the color value of the third color, that is, (C1, C2, C3), as The display unit 11 plays the border color of the media screen 401.

其中,步驟303是採用W3C(World Wide Web Consortium)所提出的一般視覺正常者的“色彩可見性”公式,其亮度公式為L=((r*299)+(g*587)+(b*114))/1000(公式1),其中的r,g,b分別為紅、藍、綠值,因此背景之亮度值BL=((Br*299)+(Bg*587)+(Bb*114))/1000,前景之亮度值FL=((Fr*299)+(Fg*587)+(Fb*114))/1000。Step 303 is a "color visibility" formula of a general visual normal proposed by the W3C (World Wide Web Consortium), and the brightness formula is L=((r*299)+(g*587)+(b*) 114)) / 1000 (Formula 1), where r, g, b are red, blue, and green values, respectively, so the background brightness value BL = ((Br * 299) + (Bg * 587) + (Bb * 114 )) / 1000, the brightness value of the foreground FL = ((Fr * 299) + (Fg * 587) + (Fb * 114)) / 1000.

另外,前景和背景色彩差異值的計算公式為D=abs(Fr-Br)+abs(Fg-Bg)+abs(Fb-Bb)(公式2),其中的abs(n)是取絕對值;建議較佳的範圍是背景色亮度FL與前景色亮度BL的亮度差異應大於125(即FL-BL>125),及背景色與前景色的色彩差異值D應大於500(即D>500)。In addition, the foreground and background color difference values are calculated as D=abs(Fr-Br)+abs(Fg-Bg)+abs(Fb-Bb) (formula 2), where abs(n) is an absolute value; The recommended range is that the brightness difference between the background color brightness FL and the foreground color brightness BL should be greater than 125 (ie, FL-BL>125), and the color difference value D of the background color and the foreground color should be greater than 500 (ie, D>500). .

詳細說明如下:The details are as follows:

1.依據播放媒體畫面之第一區域取得一代表背景色之第一色彩:將邊框之外圍區和內圍區的各點紅、藍、綠值以平均值公式值平均計算以求出第一色彩之三原色組成(Br,Bg,Bb)。1. According to the first area of the playing media screen, obtain a first color representing the background color: the red, blue and green values of the peripheral area and the inner surrounding area of the border are averaged by the average formula value to obtain the first color. The primary color of the color consists of (Br, Bg, Bb).

2.依據該播放媒體畫面之第二區域取得一代表前景色之第二色彩:根據該播放媒體畫面中心區域103取數個點以平均值公式將數個點之紅、藍、綠值分別平均計算以求出該第二色彩之三原色組成(Fr,Fg,Fb)。2. Obtaining a second color representing the foreground color according to the second area of the playback media screen: averaging the red, blue, and green values of the plurality of points according to the average formula according to the number of points in the center area 103 of the playback media screen The calculation is performed to find the three primary color compositions (Fr, Fg, Fb) of the second color.

3.由第一色彩及第二色彩之亮度/色彩差異決定一第三色彩:取得前述平均值中代表前景色(Fr,Fg,Fb)挑選二個較大數值C1及C2,亦即將代表前景色之色彩三原色數值(Fr,Fg,Fb)中取二者較大者當做前景色的第一顏色值C1及第二顏色值C2。3. A third color is determined by the brightness/color difference of the first color and the second color: obtaining the foreground color (Fr, Fg, Fb) in the foregoing average value to select two larger values C1 and C2, which will also represent the former The color of the three colors of the scenery (Fr, Fg, Fb) is taken as the first color value C1 and the second color value C2 of the foreground color.

4.將所述第一顏色值C1及第二顏色值C2值代入公式求出第三顏色值C3以組成該第三色彩:以(255-C1)及(255-C2)代表第一及第二顏色值套入L>125(公式1)和D>500(公式2),求第三顏色值C3的範圍值,亦即,第一及第二顏色值C1,C2為已知數,未知數C3代入須符合((255-C1)*299)+((255-C2)*587)+(C3*114))/1000>125,且abs((255-C1)-Br)+abs((255-C2)-Bg)+abs(C3-Bb)>500,因此可求得第三顏色值C3,如果第三顏色值C3>255或<0,則C1和C2遞增或遞減,使0≦(C1或C2或C3)≦255,最後以(C1,C2,C3)作為邊框之色彩,即可提高播放邊框的可視性。4. Substituting the first color value C1 and the second color value C2 into a formula to obtain a third color value C3 to form the third color: (255-C1) and (255-C2) represent the first and the third The two color values are nested into L>125 (formula 1) and D>500 (formula 2), and the range value of the third color value C3 is obtained, that is, the first and second color values C1, C2 are known numbers, unknowns C3 substitution shall be in accordance with ((255-C1)*299)+((255-C2)*587)+(C3*114))/1000>125, and abs((255-C1)-Br)+abs(( 255-C2)-Bg)+abs(C3-Bb)>500, so the third color value C3 can be obtained. If the third color value C3>255 or <0, C1 and C2 are incremented or decremented, so that 0≦ (C1 or C2 or C3) ≦ 255, and finally (C1, C2, C3) as the color of the border, you can improve the visibility of the playback frame.

介紹完系統之運算原理後,以下分別說明各實施例之應用。After introducing the operation principle of the system, the following describes the application of each embodiment.

應用1:已知媒體播放順序,則儲存後播放Application 1: Know the media playback order, then play after saving

參閱圖5,第一實施例主要是以編輯程式42運用媒體資料庫40既有的媒體資料及節目表來事先編輯各媒體資料於不同時間點的不同邊框色彩,再更新媒體資料庫40儲存之媒體資料後,供播放程式41播放以顯示更新色彩後的邊框。Referring to FIG. 5, the first embodiment mainly uses the editing program 42 to use the media data and the program table of the media database 40 to edit the different border colors of the media materials at different time points in advance, and then update the media database 40 to store the same. After the media material is played, the player 41 plays to display the border after updating the color.

編輯程式42包括一編輯模組421、一指定媒體模組422及一計算模組423;編輯模組421是供輸入單元14輸入資料以進行相關的設定操作;指定媒體模組422是取出媒體資料供計算模組423更新畫面中的邊框色彩;計算模組423是依據查表方式產生前述的邊框色彩,其查表包括一時序設定表420及一搭配設定表425,時序設定表420是依據不同時間變化之邊框效果,搭配設定表425是前景/背景對應靜態圖片/動態影片之設定程序加以設定以產生最適的搭配效果,請參考搭配設定表425內之文字說明。The editing program 42 includes an editing module 421, a designated media module 422, and a computing module 423. The editing module 421 is configured to input data to the input unit 14 for related setting operations; and the designated media module 422 is to retrieve the media data. The calculation module 423 updates the border color in the screen; the calculation module 423 generates the border color according to the table lookup manner, and the lookup table includes a timing setting table 420 and a matching setting table 425, and the timing setting table 420 is different according to different The time-varying border effect is set in the foreground/background corresponding static image/dynamic movie setting program to generate an optimal matching effect. Please refer to the text description in the matching setting table 425.

應用2:未知媒體播放順序而即時運算與顯示邊框色彩Application 2: Unknown media playback order and instant operation and display border color

當無法得知媒體播放順序時,例如互動式多媒體看板、Windows視窗重疊、IPTV視窗重疊等應用,也可即時顯示邊框色彩,其方式是於播放媒體時,預估下個時間點各指定區域的色彩值且先計算邊框色彩以顯示邊框,邊框色彩設定方法說明如下。When the media playback order cannot be known, such as interactive multimedia billboards, Windows window overlays, IPTV window overlays, etc., the border color can also be displayed instantly, in the case of playing media, estimating the designated areas at the next time point. The color value is calculated first to display the border color, and the border color setting method is explained as follows.

參閱圖6,先設定相關參數(步驟601),包括間隔取值時間=m秒,及推估下個色彩值的取值個數n個(例如n=1,2,3…),並預設邊框位置和大小x,y,w,h。Referring to FIG. 6, the relevant parameters are first set (step 601), including the interval value time = m seconds, and the number of values of the next color value is estimated to be n (for example, n=1, 2, 3...), and Set the position and size of the border x, y, w, h.

接著,於播放媒體時,開始計時(步驟602),並判斷是否到達間隔取值時間(步驟603)?若到達,即執行色彩調整控制程序(步驟604),色彩調整控制程序即如圖3的步驟301至步驟303,然後記錄調整之邊框色彩(步驟605),最後顯示更新後之邊框(步驟606)。Next, when the media is played, timing is started (step 602), and it is determined whether or not the interval value time is reached (step 603). If yes, the color adjustment control program is executed (step 604), and the color adjustment control program is step 301 to step 303 of FIG. 3, then the adjusted border color is recorded (step 605), and finally the updated border is displayed (step 606). .

參閱圖7,間隔取值時間=m秒是一個時間區間,可以是整數或小數,可以到一般影片變換影格的時間,例如1/25秒,或1/29.97秒,或1/30秒等;預設邊框資料是每間隔m秒選取指定區域(外圍)的背景色彩值,且記錄在例如佇列或陣列結構;如果是Windows視窗重疊、IPTV視窗重疊之影像重疊事件觸發時,則是每間隔m秒選取指定區域(內圍)的背景色彩值和中心區域的前景色彩二色並記錄之。Referring to Figure 7, the interval value = m seconds is a time interval, which can be an integer or a decimal, and can be converted to a normal movie time, such as 1/25 second, or 1/29.97 seconds, or 1/30 second; The preset frame data is a background color value of a specified area (peripheral) selected every m seconds, and recorded in, for example, a queue or an array structure; if it is an overlap of an Windows window overlap and an IPTV window overlap, the interval is triggered. m seconds selects the background color value of the specified area (inner circumference) and the foreground color of the center area and records it.

另外,邊框色彩設定方法中,初始是以預設邊框色彩顯示邊框,然後由三個色彩記錄結構,各自以最後的n個記錄色彩值,以迴歸分析公式預估下個m秒的色彩值,計算邊框色彩後顯示邊框。In addition, in the border color setting method, the border is initially displayed in a preset border color, and then the color values of the next m seconds are estimated by the regression analysis formula by the three color recording structures, respectively. The border is displayed after the border color is calculated.

應用3:預存或即時運算與顯示字幕色彩Application 3: Pre-stored or instant computing and display subtitle color

字幕重疊在影片上的方法,可使用前述預存或即時運算來顯示字幕色彩,例如:影片中的字幕色彩變換、遙控器的選單字幕之應用。The method of superimposing subtitles on a movie can use the aforementioned pre-stored or instant operation to display subtitle color, for example, subtitle color conversion in a movie, and application of a menu subtitle of a remote controller.

參閱圖8,字幕程式44(如圖1)包括一背景色抽取模組441、一前景色抽取模組442、一字幕色生成模組443及一字幕產生模組444。Referring to FIG. 8, the subtitle program 44 (FIG. 1) includes a background color extraction module 441, a foreground color extraction module 442, a subtitle color generation module 443, and a subtitle generation module 444.

字幕色彩之調整控制方法中,背景色抽取模組441、前景色抽取模組442及字幕色生成模組443是執行如圖3之步驟301至303,利用相同計算色彩公式決定前景色彩三元素值(0到255任意值)再計算其亮彩亮度值,不同的是,字幕色生成模組443還接續如圖9的步驟來判斷使用白色/黃色/藍色/紅色。In the subtitle color adjustment control method, the background color extraction module 441, the foreground color extraction module 442, and the subtitle color generation module 443 perform steps 301 to 303 of FIG. 3, and determine the foreground color three-element value by using the same calculated color formula. (0 to 255 arbitrary value) and then calculate its bright color brightness value, the difference is that the subtitle color generating module 443 continues to use the steps of FIG. 9 to determine the use of white / yellow / blue / red.

參閱圖9,首先須設定亮度門檻值(步驟500),本較佳實施例中,該亮度門檻值具有依數值大小為一第一值、一第二值及一第三值,第一值為226,一第二值為70及一第三值為30。Referring to FIG. 9, the brightness threshold is first set (step 500). In the preferred embodiment, the brightness threshold has a first value, a second value, and a third value. The first value is 226, a second value of 70 and a third value of 30.

然後,利用色彩調整控制程序計算出第三色彩(步驟501),色彩調整控制程序也就是如圖3之步驟301至303,計算出第三色彩即(C1,C2,C3),並藉由第三色彩計算亮度值(步驟502),接著,比對第三色彩之亮度值及亮度門檻值判斷選用何種字幕色彩(步驟503)?若第三色彩之亮度值為不小於226,即取用白色作為字幕色彩(步驟504);若第三色彩之亮度值為大於77及小於226之間,即取用黃色作為字幕色彩(步驟505);若第三色彩之亮度值為不小於30及不大於77之間,即取用紅色作為字幕色彩(步驟506);若第三色彩之亮度值為小於30,即取用藍色作為字幕色彩(步驟507)。Then, the third color is calculated by the color adjustment control program (step 501), and the color adjustment control program, that is, steps 301 to 303 of FIG. 3, calculates the third color (C1, C2, C3), and The three colors calculate the brightness value (step 502). Then, the brightness value and the brightness threshold value of the third color are compared to determine which subtitle color is selected (step 503). If the brightness value of the third color is not less than 226, white is used as the subtitle color (step 504); if the brightness value of the third color is greater than 77 and less than 226, yellow is taken as the subtitle color (step 505) If the brightness value of the third color is not less than 30 and not more than 77, the red color is taken as the subtitle color (step 506); if the brightness value of the third color is less than 30, the blue color is used as the subtitle Color (step 507).

應用4:邊框(或字幕)色彩變換時的前後顏色轉場效果Application 4: Front and back color transition effects when border (or subtitle) color is changed

上述應用1,2,3中得到的邊框(或字幕)假設在不同時間產生之C1,C2,C3為二組不同的色彩值(r1,g1,b1)和(r2,g2,b2),則控制在一預定期間T內(區隔為n次),使r1漸變成r2,g1漸變成g2,b1漸變成b2,每個時間間隔皆顯示色彩。The frame (or subtitle) obtained in the above applications 1, 2, 3 assumes that C1, C2, and C3 generated at different times are two sets of different color values (r1, g1, b1) and (r2, g2, b2). Control is in a predetermined period T (division is n times), so that r1 is gradually changed to r2, g1 is changed to g2, b1 is changed to b2, and color is displayed every time interval.

參閱圖10,令r’=(r2-r1)/n;g’=(g2-g1)/n;b’=(b2-b1)/n(步驟701);在預定期間T內執行迴圈i=1至n(步驟702);然後,令r2=r1+r’*i;g2=g1+g’*i;b2=b1+b’*i(步驟703);以r2,g2,b2顯示邊框(或字幕)顏色且設定顏色(步驟704),直到迴圈執行完畢。如此一來,前景或背景媒體切換時,邊框(或字幕)色彩也跟著改變,亦符合”色彩可見性”規範。Referring to FIG. 10, let r'=(r2-r1)/n;g'=(g2-g1)/n; b'=(b2-b1)/n (step 701); perform a loop within a predetermined period T i=1 to n (step 702); then, let r2=r1+r'*i; g2=g1+g'*i; b2=b1+b'*i (step 703); with r2, g2, b2 The border (or subtitle) color is displayed and the color is set (step 704) until the loop is completed. As a result, when the foreground or background media is switched, the color of the border (or subtitle) also changes, which also conforms to the "color visibility" specification.

參閱圖11,以邊框顏色為黃色至藍色之變換轉場效果為例,初始為黃色(255,255,0),歷經16次,可逐漸轉變成為目標色藍色之值(0,0,255)。Referring to FIG. 11, the transition color effect of the border color is yellow to blue, and the initial yellow color (255, 255, 0), after 16 times, can be gradually changed to the value of the target color blue (0, 0, 255).

綜上所述,本發明播放媒體畫面之邊框/字幕色彩之調整控制方法和系統之功效在於,利用由代表背景之第一色彩及代表前景之第二色彩之亮度/色彩差異決定播放媒體畫面之邊框/字幕之色彩,使得整體畫面能達到較佳的閱讀效果,故確實能達成本發明之目的。In summary, the method and system for adjusting the border/subtitle color of the playback media screen of the present invention have the effect of determining the playing media screen by using the first color representing the background and the brightness/color difference of the second color representing the foreground. The color of the border/subtitle enables the overall picture to achieve a better reading effect, so the object of the present invention can be achieved.

惟以上所述者,僅為本發明之較佳實施例而已,當不能以此限定本發明實施之範圍,即大凡依本發明申請專利範圍及發明說明內容所作之簡單的等效變化與修飾,皆仍屬本發明專利涵蓋之範圍內。The above is only the preferred embodiment of the present invention, and the scope of the invention is not limited thereto, that is, the simple equivalent changes and modifications made by the scope of the invention and the description of the invention are All remain within the scope of the invention patent.

10...控制單元10. . . control unit

100...調整控制系統100. . . Adjustment control system

101...第一區域101. . . First area

102...第二區域102. . . Second area

103...中心區域103. . . Central region

11...顯示單元11. . . Display unit

12...記憶單元12. . . Memory unit

13...接收單元13. . . Receiving unit

14...輸入單元14. . . Input unit

301~303...步驟301~303. . . step

40...媒體資料庫40. . . Media database

401...媒體畫面401. . . Media screen

41...播放程式41. . . Player

42...編輯程式42. . . Editing program

420...時序設定表420. . . Timing setting table

421...編輯模組421. . . Editing module

422...指定媒體模組422. . . Specified media module

423...計算模組423. . . Computing module

425...搭配設定表425. . . Match setting table

43...邊框程式43. . . Border program

431...背景色抽取模組431. . . Background color extraction module

432...前景色抽取模組432. . . Foreground extraction module

433...邊框色生成模組433. . . Border color generation module

434...邊框產生模組434. . . Border generation module

44...字幕程式44. . . Subtitle program

441...背景色抽取模組441. . . Background color extraction module

442...前景色抽取模組442. . . Foreground extraction module

443...字幕色生成模組443. . . Subtitle color generation module

444...字幕產生模組444. . . Subtitle generation module

500~507...步驟500~507. . . step

601~606...步驟601~606. . . step

701~704...步驟701~704. . . step

圖1是一系統方塊圖,說明本發明播放媒體畫面之邊框/字幕色彩之調整控制系統之較佳實施例;1 is a system block diagram showing a preferred embodiment of a frame/subtitle color adjustment control system for playing a media picture of the present invention;

圖2是一示意圖,說明邊框程式之運作原理;Figure 2 is a schematic diagram showing the operation of the border program;

圖3是一流程圖,說明本發明播放媒體畫面之邊框色彩之調整控制方法;3 is a flow chart illustrating a method for adjusting the color of a border of a playback media screen of the present invention;

圖4是一示意圖,說明播放媒體畫面之第一區域、第二區域及邊框;4 is a schematic diagram illustrating a first area, a second area, and a frame of a playback media screen;

圖5是一示意圖,說明以編輯程式運用媒體資料庫事先編輯各媒體資料於不同時間點的不同邊框色彩;FIG. 5 is a schematic diagram illustrating the use of an editing program to edit media frames in advance to edit different media colors at different time points;

圖6是一流程圖,說明未知媒體播放順序而即時運算與顯示邊框色彩;6 is a flow chart illustrating the unknown media playback order and real-time operation and display border color;

圖7是一示意圖,說明圖6之運作原理;Figure 7 is a schematic view showing the operation principle of Figure 6;

圖8是一示意圖,說明字幕程式之運作原理;Figure 8 is a schematic diagram showing the operation principle of the subtitle program;

圖9是一流程圖,說明本發明播放媒體畫面之字幕色彩之調整控制方法;FIG. 9 is a flowchart illustrating a method for adjusting and controlling subtitle color of a playback media screen of the present invention; FIG.

圖10是一示意圖,說明邊框(或字幕)色彩變換時的前後顏色轉場效果;及Figure 10 is a schematic view showing the effect of color transition before and after the color change of the border (or subtitle); and

圖11是一示意圖,說明圖10之運作處理過程。Figure 11 is a schematic view showing the operation process of Figure 10.

301~303...步驟301~303. . . step

Claims (10)

一種播放媒體畫面之邊框/字幕色彩之調整控制方法,包含下述步驟:(a)依據該播放媒體畫面之第一區域取得一代表背景色之第一色彩;(b)依據該播放媒體畫面之第二區域取得一代表前景色之第二色彩;及(c)由該第一色彩及該第二色彩之亮度/色彩差異決定一第三色彩,且以該第三色彩作為該播放媒體畫面之邊框/字幕之色彩。A method for controlling a border/subtitle color of a playback media screen, comprising the steps of: (a) obtaining a first color representing a background color according to the first region of the playback media screen; (b) according to the playback media screen The second area obtains a second color representing the foreground color; and (c) determining a third color by the brightness/color difference of the first color and the second color, and using the third color as the playing media picture The color of the border/subtitle. 依據申請專利範圍第1項所述之播放媒體畫面之邊框/字幕色彩之調整控制方法,其中,步驟(c)係將代表前景色之色彩三原色數值中取二者較大者當做前景色的第一顏色值及第二顏色值,再將所述第一及第二顏色值代入一亮度公式及一色彩差異公式求出第三顏色值,並以第一、第二及第三顏色值組成該第三色彩。According to the method for adjusting the border/subtitle color of the playback media picture according to the first aspect of the patent application scope, the step (c) is to compare the three primary color values representing the foreground color as the foreground color. a color value and a second color value, substituting the first and second color values into a brightness formula and a color difference formula to determine a third color value, and composing the first, second, and third color values The third color. 依據申請專利範圍第1或2項所述之播放媒體畫面之邊框/字幕色彩之調整控制方法,其中,步驟(a)係根據該邊框/字幕之外圍區和內圍區的各點紅、藍、綠值當背景色值,以平均值公式將外圍區和內圍區的各點紅、藍、綠值分別平均計算以求出該第一色彩之三原色組成;步驟(b)係根據該播放媒體畫面中心區取數個點以平均值公式將數個點之紅、藍、綠值分別平均計算以求出該第二色彩之三原色組成。According to the method for adjusting the border/subtitle color of the playback media screen according to the first or second aspect of the patent application, the step (a) is based on the red and blue points of the peripheral area and the inner circumference area of the border/subtitle. The green value is the background color value, and the red, blue and green values of the peripheral area and the inner surrounding area are respectively averaged by the average value formula to obtain the three primary color components of the first color; the step (b) is based on the playing. The central portion of the media picture takes a number of points and averages the red, blue, and green values of the points to calculate the three primary colors of the second color. 依據申請專利範圍第1或2項所述之播放媒體畫面之邊框/字幕色彩之調整控制方法,其係控制在一預定期間內,令邊框或字幕色彩變換時的前後顏色具有轉場效果。The method for controlling the border/subtitle color of the playback media screen according to the first or second aspect of the patent application is controlled to have a transition effect before and after the color change of the border or the subtitle color in a predetermined period. 一種播放媒體畫面之邊框色彩之調整控制方法,包括下述步驟:(a)設定一間隔取值時間及邊框位置和大小;(b)於播放媒體時,判斷是否到達一間隔取值時間,若到達該間隔取值時間即執行一色彩調整控制程序,該色彩調整控制程序是依據該播放媒體畫面之第一區域取得一代表背景色之第一色彩,依據該播放媒體畫面之第二區域取得一代表前景色之第二色彩,並由該第一色彩及該第二色彩之亮度/色彩差異決定一第三色彩,及記錄該第三色彩以作為邊框色彩;及(c)依據設定之邊框位置和大小顯示更新色彩後之邊框。The method for adjusting the color of the border color of the playing media screen comprises the following steps: (a) setting an interval value time and a position and a size of the frame; (b) determining whether to reach an interval value when playing the media, if When the interval value is reached, a color adjustment control program is executed. The color adjustment control program obtains a first color representing a background color according to the first region of the playback media screen, and obtains a second region according to the playback media screen. Representing a second color of the foreground color, and determining a third color by the brightness/color difference of the first color and the second color, and recording the third color as a border color; and (c) according to the set border position And size display the border after updating the color. 一種播放媒體畫面之字幕色彩之調整控制方法,包括下述步驟:(a)設定一亮度門檻值;(b)依據該播放媒體畫面之第一區域取得一代表背景色之第一色彩及於該播放媒體畫面之第二區域取得一代表前景色之第二色彩,由該第一色彩及該第二色彩之亮度/色彩差異決定一第三色彩,並以該第三色彩求出一色彩亮度值;及(c)比對該色彩亮度值及該亮度門檻值以判斷選用何種字幕色彩。A method for controlling subtitle color playback of a media screen, comprising the steps of: (a) setting a brightness threshold; (b) obtaining a first color representing a background color according to the first region of the playback media screen; And playing a second color of the foreground image, determining a third color by the brightness/color difference of the first color and the second color, and determining a color brightness value by using the second color And (c) compare the color brightness value and the brightness threshold to determine which subtitle color to use. 依據申請專利範圍第6項所述之播放媒體畫面之字幕色彩之調整控制方法,其中,該亮度門檻值具有依數值大小為一第一值、一第二值及一第三值,若該第三色彩之色彩亮度值為不小於該第一值,即選用白色作為字幕色彩;若該第三色彩之色彩亮度值為大於該第二值及小於該第一值之間,即取用黃色作為字幕色彩;若該第三色彩之色彩亮度值為不小於該第三值及不大於該第二值之間,即選用紅色作為字幕色彩;若該第三色彩之色彩亮度值為小於該第三值,即選用藍色作為字幕色彩。According to the method for adjusting the color of the subtitle color of the playback media screen according to the sixth aspect of the patent application, wherein the brightness threshold has a first value, a second value and a third value according to the value. The color value of the three colors is not less than the first value, that is, white is selected as the subtitle color; if the color brightness value of the third color is greater than the second value and less than the first value, the yellow color is taken as Subtitle color; if the color brightness value of the third color is not less than the third value and not greater than the second value, the red color is selected as the subtitle color; if the color brightness value of the third color is less than the third color Value, that is, blue is used as the subtitle color. 一種播放媒體畫面之邊框色彩之調整控制系統,包含:一背景色抽取模組,依據該播放媒體畫面之第一區域取得一代表背景色之第一色彩;一前景色抽取模組,依據該播放媒體畫面之第二區域取得一代表前景色之第二色彩;一邊框色生成模組,由該第一色彩及該第二色彩之亮度/色彩差異決定一第三色彩;及一邊框產生模組,於該播放媒體畫面產生一邊框時,以該第三色彩作為該播放媒體畫面之邊框之色彩。An adjustment control system for playing a border color of a media picture, comprising: a background color extraction module, obtaining a first color representing a background color according to the first area of the playback media picture; and a foreground color extraction module, according to the playing The second area of the media picture obtains a second color representing the foreground color; a border color generation module determines a third color by the brightness/color difference of the first color and the second color; and a frame generation module When the playback media screen generates a border, the third color is used as the color of the border of the playback media screen. 一種播放媒體畫面之邊框色彩之調整控制系統,包含:一編輯模組,供輸入資料以進行相關的設定操作;一指定媒體模組,供指定一需更新畫面中的邊框色彩之媒體資料;及一計算模組,接收該輸入資料以進行設定,並依據查表方式產生前述的邊框色彩,其查表包括一時序設定表及一搭配設定表,該時序設定表是依據不同時間變化之邊框效果,該搭配設定表是前景/背景對應靜態圖片/動態影片之設定程序加以設定以產生最適的搭配效果。An adjustment control system for playing a border color of a media screen, comprising: an editing module for inputting data for performing related setting operations; and a designated media module for designating a media material for updating a border color in the screen; and a computing module receives the input data for setting, and generates the foregoing border color according to the table lookup manner, wherein the lookup table includes a timing setting table and a matching setting table, and the timing setting table is a frame effect according to different time changes. The collocation setting table is set by the foreground/background corresponding static picture/dynamic movie setting program to generate an optimal matching effect. 一種播放媒體畫面之字幕色彩之調整控制系統,包含:一背景色抽取模組,依據該播放媒體畫面之第一區域取得一代表背景色之第一色彩;一前景色抽取模組,依據該播放媒體畫面之第二區域取得一代表前景色之第二色彩;及一字幕色生成模組,由該第一色彩及該第二色彩之亮度/色彩差異決定一第三色彩,並以該第三色彩求出一色彩亮度值,及比對該色彩亮度值及該亮度門檻值以判斷選用何種字幕色彩。An adjustment control system for playing subtitle color of a media picture, comprising: a background color extraction module, obtaining a first color representing a background color according to the first area of the playback media picture; and a foreground color extraction module, according to the playing The second area of the media picture obtains a second color representing the foreground color; and a subtitle color generating module, the third color is determined by the brightness/color difference of the first color and the second color, and the third color is used The color finds a color brightness value, and compares the color brightness value and the brightness threshold to determine which subtitle color to use.
TW99105805A 2010-03-01 2010-03-01 A method and a system for adjusting the control of the border / subtitle color of the media screen TWI400943B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW99105805A TWI400943B (en) 2010-03-01 2010-03-01 A method and a system for adjusting the control of the border / subtitle color of the media screen

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW99105805A TWI400943B (en) 2010-03-01 2010-03-01 A method and a system for adjusting the control of the border / subtitle color of the media screen

Publications (2)

Publication Number Publication Date
TW201132118A TW201132118A (en) 2011-09-16
TWI400943B true TWI400943B (en) 2013-07-01

Family

ID=49225955

Family Applications (1)

Application Number Title Priority Date Filing Date
TW99105805A TWI400943B (en) 2010-03-01 2010-03-01 A method and a system for adjusting the control of the border / subtitle color of the media screen

Country Status (1)

Country Link
TW (1) TWI400943B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106911937B (en) * 2017-03-31 2019-06-21 武汉斗鱼网络科技有限公司 The configuration method and system of present banner background colour in a kind of live streaming
CN113360155A (en) * 2021-06-23 2021-09-07 平安普惠企业管理有限公司 Front-end interface background color matching method, device, equipment and storage medium
CN113377077B (en) * 2021-07-08 2022-09-09 四川恒业硅业有限公司 Intelligent manufacturing digital factory system
CN113992968B (en) * 2021-10-27 2023-03-31 深圳市宝泽科技有限公司 Method and device for gradually changing colors of frames of screen projection pictures based on wireless screen projection field

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW576110B (en) * 2002-08-16 2004-02-11 Matsushita Electric Tw Co Ltd Caption selection method for digital TV and the system thereof
TW200524431A (en) * 2004-01-12 2005-07-16 Matsushita Electric Ind Co Ltd Subtitle text processing device
US20060013563A1 (en) * 2002-11-15 2006-01-19 Dirk Adolph Method and apparatus for composition of subtitles
TW200929158A (en) * 2007-12-25 2009-07-01 Mstar Semiconductor Inc Method for setting caption window attributes and associated TV system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW576110B (en) * 2002-08-16 2004-02-11 Matsushita Electric Tw Co Ltd Caption selection method for digital TV and the system thereof
US20060013563A1 (en) * 2002-11-15 2006-01-19 Dirk Adolph Method and apparatus for composition of subtitles
TW200524431A (en) * 2004-01-12 2005-07-16 Matsushita Electric Ind Co Ltd Subtitle text processing device
TW200929158A (en) * 2007-12-25 2009-07-01 Mstar Semiconductor Inc Method for setting caption window attributes and associated TV system

Also Published As

Publication number Publication date
TW201132118A (en) 2011-09-16

Similar Documents

Publication Publication Date Title
US10496878B2 (en) Information processing apparatus, method and computer program product
US8421819B2 (en) Pillarboxing correction
JP6733785B2 (en) Image processing apparatus, image processing system, image processing method, and program
JP2006279969A (en) Method for generating user preference data and recording medium
JP2006033656A (en) User interface provider
TWI400943B (en) A method and a system for adjusting the control of the border / subtitle color of the media screen
US9773523B2 (en) Apparatus, method and computer program
US20160381290A1 (en) Apparatus, method and computer program
JP2011030111A (en) Image combining apparatus, image coding apparatus, computer program, and recording medium
KR20080095194A (en) Image processing apparatus, image processing method, and program
CN101661739A (en) Information processing apparatus, information processing method and program
JP2009110536A (en) Image frame processing method and device, rendering processor and moving image display method
JP2015049463A (en) Information processor, information processing method, program and image display device
US20150062152A1 (en) 3-dimensional look-up table-based color masking technique
JP2006516862A (en) Method and apparatus for combining video signals to produce a comprehensive video signal
JP6493855B2 (en) Image processing apparatus and image processing method
JP2007288587A (en) Video adjusting device, video adjusting method and video processing program
JP2009129362A (en) Color processing equipment and color processing method
WO2016117383A1 (en) Reproducing device, information processing method, and program
JP2006041614A (en) Image processing apparatus, image processing method, program, and recording medium
KR20030076897A (en) Method and apparatus for highlighting for highlighting region in a display sevice
JP2008271096A (en) Method and device for correcting gray balance of image data, and storage medium
US10706891B2 (en) Video image processing apparatus and processing method
TWI522885B (en) Method for displaying on-screen display image
JP2009005097A (en) Device and method for adjusting color gamut

Legal Events

Date Code Title Description
MM4A Annulment or lapse of patent due to non-payment of fees