TW202242822A - Display device and method to blur borderline in cud device - Google Patents

Display device and method to blur borderline in cud device Download PDF

Info

Publication number
TW202242822A
TW202242822A TW110113920A TW110113920A TW202242822A TW 202242822 A TW202242822 A TW 202242822A TW 110113920 A TW110113920 A TW 110113920A TW 110113920 A TW110113920 A TW 110113920A TW 202242822 A TW202242822 A TW 202242822A
Authority
TW
Taiwan
Prior art keywords
pixel
sensor
display
blurred
area
Prior art date
Application number
TW110113920A
Other languages
Chinese (zh)
Other versions
TWI756109B (en
Inventor
莊啓峰
Original Assignee
奇景光電股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 奇景光電股份有限公司 filed Critical 奇景光電股份有限公司
Priority to TW110113920A priority Critical patent/TWI756109B/en
Application granted granted Critical
Publication of TWI756109B publication Critical patent/TWI756109B/en
Publication of TW202242822A publication Critical patent/TW202242822A/en

Links

Images

Abstract

A display device includes a sensor pixel set having a maximal sensor pixel brightness value SV, a display pixel set having a display pixel brightness value DV, and a blurring pixel set disposed between the sensor pixel set and the display pixel set and having a blurring pixel brightness value BV. A minimal distance between the blurring pixel set and the sensor pixel set is Z and a minimal distance between the blurring pixel set and the display pixel set is (1-Z) to satisfy: BV=(1-Z)×SV+Z×DV.

Description

顯示裝置與模糊顯示下鏡頭裝置中的邊界線的方法Display device and method for blurring display of boundary line in lower lens device

本發明大致上關於一種顯示裝置,以及一種模糊化顯示下鏡頭(camera under display, CUD)裝置中的邊界線的方法。特別地,本發明是針對一種用在顯示下鏡頭裝置中,以調整像素單元的伽馬級的方式,使得顯示裝置中的感測器區域和顯示區域之間明顯的邊界線模糊化的方法。The present invention generally relates to a display device and a method for blurring a boundary line in a camera under display (CUD) device. In particular, the present invention is directed to a method for blurring the obvious boundary line between the sensor area and the display area in the display device by adjusting the gamma level of the pixel unit used in the display lens device.

為了獲得更好的顯示品質,可以有利地將行動電話的攝影鏡頭設計成隱藏在顯示面板的下方。然而,一些入射到攝影鏡頭的光可能會被像素阻擋,又有機發光二極體(OLED)的透明材料仍然太過昂貴而無法應用於普通產品中。In order to obtain better display quality, it may be advantageous to design the camera lens of the mobile phone to be hidden under the display panel. However, some of the light incident on the camera lens may be blocked by the pixels, and the transparent materials for organic light-emitting diodes (OLEDs) are still too expensive to be used in ordinary products.

為了解決這樣的問題,可以提出一種不完整的子像素佈局好將攝影鏡頭隱藏在面板下方。此外,在面板中,顯示下鏡頭的區域中的某些像素會被切掉以利於攝影鏡頭的正常功能。To solve such problems, an incomplete sub-pixel layout can be proposed to hide the camera lens under the panel. Also, in the panel, some pixels in the area showing the lower lens are cut off to facilitate the normal function of the photographic lens.

如圖1所示,這種不完整的子像素佈局可能會導致在顯示下鏡頭區域10和正常區域20的邊界線11上出現輪廓的問題(contour issue)。圖1繪示出在顯示下鏡頭區域10與正常區域20之間會感覺有明顯的視覺差異,也就是邊界線11的視覺存在,於是在顯示下鏡頭區域10存在的情況下會危及面板1的視覺呈現品質。As shown in FIG. 1 , this incomplete sub-pixel layout may cause a contour issue on the boundary line 11 showing the lower lens area 10 and the normal area 20 . FIG. 1 shows that there is a significant visual difference between the displayed lower lens area 10 and the normal area 20, that is, the visual presence of the boundary line 11, so that the presence of the displayed lower lens area 10 will jeopardize the integrity of the panel 1. Visual presentation quality.

有鑑於以上,本發明的第一方面提出了一種新穎的顯示裝置,可以在顯示下鏡頭區域存在的情況下,改善顯示下鏡頭裝置的視覺呈現品質,例如會最小化顯示下鏡頭區域的視覺存在感。在顯示下鏡頭區域視覺上無感存在的情況下,邊界線會被模糊化來隱藏顯示下鏡頭區域。本發明的第二方面提出了一種新穎的方法,來模糊掉顯示下鏡頭裝置中的邊界線,以在顯示下鏡頭區域存在的情況下,改善顯示下鏡頭裝置的視覺呈現品質。In view of the above, the first aspect of the present invention proposes a novel display device, which can improve the visual presentation quality of the display lower lens device under the condition that the lower lens area is displayed, for example, the visual presence of the lower lens area can be minimized. feel. In the case where the lower camera area is visually insensitive, the boundary line will be blurred to hide the lower camera area. The second aspect of the present invention proposes a novel method to blur the boundary line in the display lower lens device, so as to improve the visual presentation quality of the display lower lens device when the display lower lens region exists.

本發明在第一方面,提出了一種新穎的顯示裝置。本發明的顯示裝置包括顯示面板、影像感測器、感測器像素組、顯示像素組和模糊化像素組。顯示面板包括顯示區域、被顯示區域所包圍的模糊化區域、以及被模糊化區域所包圍的感測器區域。影像感測器設置在感測器區域中。感測器像素組設置在感測器區域中、鄰近模糊化區域、並具有最大感測器像素亮度值SV。顯示像素組設置在顯示區域中、鄰近模糊化區域、並具有顯示像素亮度值DV。模糊化像素組設置在模糊化區域中、位於感測器像素組和顯示像素組之間、並且具有模糊化像素亮度值BV。顯示像素組和感測器像素組之間的最小距離為1、模糊化像素組和感測器像素組之間的最小距離為Z、模糊化像素組和顯示像素組之間的最小距離為(1-Z),使得BV =(1-Z)× SV + Z × DV。In a first aspect, the present invention proposes a novel display device. The display device of the present invention includes a display panel, an image sensor, a sensor pixel group, a display pixel group and a blurring pixel group. The display panel includes a display area, a blurring area surrounded by the display area, and a sensor area surrounded by the blurring area. The image sensor is disposed in the sensor area. A sensor pixel group is disposed in the sensor area, adjacent to the blurring area, and has a maximum sensor pixel brightness value SV. A display pixel group is disposed in the display area, adjacent to the blurring area, and has a display pixel luminance value DV. The blurred pixel set is disposed in the blurred region between the sensor pixel set and the display pixel set, and has a blurred pixel brightness value BV. The minimum distance between the display pixel group and the sensor pixel group is 1, the minimum distance between the blur pixel group and the sensor pixel group is Z, the minimum distance between the blur pixel group and the display pixel group is ( 1-Z), so that BV = (1-Z) × SV + Z × DV.

在本發明的一個實施方式中,感測器像素組包括n個有效感測器像素和m個無效感測器像素。In one embodiment of the invention, the sensor pixel group includes n active sensor pixels and m ineffective sensor pixels.

在本發明的另一個實施方式中,顯示像素組包括n+m個有效顯示像素,並且沒有無效顯示像素。In another embodiment of the present invention, the display pixel group includes n+m effective display pixels and no invalid display pixels.

在本發明的另一實施方式中,每個有效顯示像素具有顯示像素亮度值DV,使得DV = [n /(n+m)] × 100。In another embodiment of the present invention, each effective display pixel has a display pixel brightness value DV such that DV = [n/(n+m)]×100.

在本發明的另一個實施方式中,模糊化區域為空心圓的形式,並且包括內部同心圓和外部同心圓。內部同心圓具有內部同心圓的圓心。In another embodiment of the invention, the blurred area is in the form of a hollow circle and includes an inner concentric circle and an outer concentric circle. The inner concentric circle has the center of the inner concentric circle.

在本發明的另一個實施方式中,一條直線穿過內部同心圓的圓心、感測器像素組、模糊化像素組、和顯示像素組。In another embodiment of the invention, a straight line passes through the center of the inner concentric circle, the sensor pixel set, the blur pixel set, and the display pixel set.

在本發明的另一實施方式中,顯示裝置還包括設置在感測器區域中的至少一個針孔。In another embodiment of the present invention, the display device further includes at least one pinhole disposed in the sensor area.

在本發明的另一實施方式中,至少一個針孔代表m個無效感測器像素。In another embodiment of the invention, at least one pinhole represents m invalid sensor pixels.

在本發明的另一實施方式中,模糊化像素亮度值BV表示模糊化像素組中的模糊化像素的伽馬級。In another embodiment of the present invention, the blurred pixel brightness value BV represents the gamma level of the blurred pixel in the blurred pixel group.

本發明在第二方面,提出了一種使顯示下鏡頭裝置中的邊界線模糊化的新穎方法。首先,提供顯示下鏡頭裝置。顯示下鏡頭裝置包括顯示區域、被顯示區域所包圍的模糊化區域、以及被模糊化區域所包圍的感測器區域。感測器像素組設置在感測器區域中、鄰近模糊化區域並具有最大感測器像素亮度值SV。感測器像素組包括n個有效感測器像素和m個無效感測器像素。顯示像素組設置在顯示區域中、鄰近模糊化區域、並具有顯示像素亮度值DV。顯示像素組包括n+m個有效顯示像素,並且沒有無效顯示像素。模糊化像素組設置在位於感測器像素組和顯示像素組之間的模糊化區域中,並且具有模糊化像素亮度值BV。其次,根據DV = [n /(n+m)]×100來決定顯示像素亮度值DV。然後,在決定了顯示像素亮度值DV之後,根據BV =(1-Z)× SV + Z × DV來決定模糊化像素亮度值BV。其中,顯示像素組和感測器像素組之間的最小距離為1、模糊化像素組和感測器像素組之間的最小距離為Z、模糊化像素組和顯示像素組之間的最小距離為(1-Z)。The present invention, in a second aspect, proposes a novel method of blurring borderlines in a display lens arrangement. First, provide the display under the lens device. The display lower lens device includes a display area, a blurring area surrounded by the display area, and a sensor area surrounded by the blurring area. A sensor pixel group is disposed in the sensor area adjacent to the blurring area and has a maximum sensor pixel luminance value SV. The sensor pixel group includes n active sensor pixels and m ineffective sensor pixels. A display pixel group is disposed in the display area, adjacent to the blurring area, and has a display pixel luminance value DV. The display pixel group includes n+m effective display pixels and has no invalid display pixels. The blurred pixel set is disposed in a blurred region between the sensor pixel set and the display pixel set, and has a blurred pixel brightness value BV. Secondly, according to DV = [n / (n+m)] × 100 to determine the display pixel brightness value DV. Then, after the display pixel brightness value DV is determined, the blurred pixel brightness value BV is determined according to BV = (1-Z) × SV + Z × DV. Among them, the minimum distance between the display pixel group and the sensor pixel group is 1, the minimum distance between the blur pixel group and the sensor pixel group is Z, and the minimum distance between the blur pixel group and the display pixel group for (1-Z).

在本發明的一個實施方式中,模糊化區域為空心圓的形式,並且包括內部同心圓和外部同心圓。內部同心圓具有內部同心圓的圓心。In one embodiment of the invention, the blurred area is in the form of a hollow circle and includes an inner concentric circle and an outer concentric circle. The inner concentric circle has the center of the inner concentric circle.

在本發明的另一個實施方式中,決定模糊化像素亮度值BV是要模糊化內部同心圓的邊界線。In another embodiment of the present invention, the determination of the blurred pixel brightness value BV is to blur the boundary line of the inner concentric circle.

在本發明的另一個實施方式中,一條直線穿過內部同心圓的圓心、感測器像素組、模糊化像素組、和顯示像素組。In another embodiment of the invention, a straight line passes through the center of the inner concentric circle, the sensor pixel set, the blur pixel set, and the display pixel set.

在本發明的另一實施方式中,模糊化像素亮度值BV表示模糊化像素組中的模糊化像素的伽馬級。In another embodiment of the present invention, the blurred pixel brightness value BV represents the gamma level of the blurred pixel in the blurred pixel group.

在本發明的另一個實施方式中,感測器像素組包括具有最大感測器像素亮度值SV的第一感測器像素、和具有最小感測器像素亮度值0的第二感測器像素。In another embodiment of the invention, the sensor pixel group includes a first sensor pixel having a maximum sensor pixel intensity value SV, and a second sensor pixel having a minimum sensor pixel intensity value of 0 .

在本發明的另一個實施方式中,模糊化像素組包括具有第一模糊化像素亮度值BV1的第一模糊化像素、和具有第二模糊化像素亮度值BV2的第二模糊化像素。In another embodiment of the present invention, the blurred pixel group includes a first blurred pixel with a first blurred pixel brightness value BV1 and a second blurred pixel with a second blurred pixel brightness value BV2.

在本發明的另一實施方式中,第一模糊化像素亮度值BV1不同於第二模糊化像素亮度值BV2。In another embodiment of the present invention, the first blurred pixel brightness value BV1 is different from the second blurred pixel brightness value BV2.

在本發明的另一實施方式中,第一模糊化像素亮度值BV1和第二模糊化像素亮度值BV2分別表示伽馬級。In another embodiment of the present invention, the first blurred pixel brightness value BV1 and the second blurred pixel brightness value BV2 represent gamma levels respectively.

在本發明的另一個實施方式中,第一感測器像素對應於第一模糊化像素,第二感測器像素對應於第二模糊化像素。In another embodiment of the invention, the first sensor pixels correspond to first blurred pixels and the second sensor pixels correspond to second blurred pixels.

在本發明的另一實施方式中,顯示像素組的總亮度等於模糊化像素組的總亮度。In another embodiment of the present invention, the total brightness of the display pixel group is equal to the total brightness of the blurred pixel group.

在本發明的另一個實施方式中,感測器像素組的總亮度等於模糊化像素組的總亮度。In another embodiment of the invention, the total brightness of the sensor pixel group is equal to the total brightness of the blurred pixel group.

為了提高顯示品質,本發明提供一種調整方法,以在顯示下鏡頭區域存在的情況下,模糊掉顯示下鏡頭裝置中的邊界線,例如弱化或進一步消除不期望的顯示下鏡頭區域的視覺存在感。圖2是本發明的模糊化顯示下鏡頭裝置中的邊界線的方法的流程圖的例示。圖3至圖4例示本發明的用於模糊顯示下鏡頭裝置中的邊界線的操作過程的範例。In order to improve the display quality, the present invention provides an adjustment method to blur the boundary line in the display lower lens device under the condition that the display lower lens area exists, such as weakening or further eliminating the undesired visual presence of the display lower lens area . FIG. 2 is an illustration of the flow chart of the method for blurring and displaying the boundary line in the lower lens device of the present invention. 3 to 4 illustrate an example of the operation process for blurring the boundary line in the lower lens device of the present invention.

請參考圖2,先執行步驟101。步驟101是表示輸入複數個原始像素單元的步驟。原始像素單元可以是顯示裝置的像素(pixels)或子像素(sub-pixels)。顯示裝置可以對應於圖3中所示的顯示下鏡頭裝置100。例如,在顯示下鏡頭裝置100中有複數個像素單元。一個像素單元可以是具有預定的顏色和預定的亮度的一個像素或一個子像素。一個像素可以包括複數個子像素,並且每個子像素可以發射某種顏色的光,例如可以是紅色(稱為R)、綠色(稱為G)、藍色(稱為G)或是另一種合適的顏色,但是本發明不限於此。換句話說,步驟101也可以被稱為輸入R/G/B資訊。Please refer to FIG. 2 , step 101 is executed first. Step 101 is a step of inputting a plurality of original pixel units. The original pixel units may be pixels or sub-pixels of a display device. The display device may correspond to the display lower lens device 100 shown in FIG. 3 . For example, there are a plurality of pixel units in the display lens device 100 . One pixel unit may be one pixel or one sub-pixel having a predetermined color and predetermined brightness. A pixel can include a plurality of sub-pixels, and each sub-pixel can emit light of a certain color, such as red (referred to as R), green (referred to as G), blue (referred to as G), or another suitable color. color, but the present invention is not limited thereto. In other words, step 101 can also be referred to as inputting R/G/B information.

請參考圖3。圖3繪示根據本發明的一實例的顯示下鏡頭裝置的上視圖。先提供顯示下鏡頭裝置100。顯示下鏡頭裝置100可以包括顯示面板101,用於顯示圖片或影像,像是圖1所顯示的影像103。顯示下鏡頭裝置100可以進一步包括其他合適的元件,例如輸入單元(未示出)、輸出單元(未示出)、或是控制單元(未示出),但是本發明不限於此。顯示面板101可以包括複數個功能區域,例如感測器區域110、模糊化區域120和顯示區域130,但是本發明不限於此。在本發明的一些實施方式中,感測器區域110可以被模糊化區域120所包圍、並且模糊化區域120可以被顯示區域130所包圍。在本發明的一些實施方式中,模糊化區域120可以是空心圓120H的形式。空心圓120H可以包括內部同心圓121和外部同心圓122。內部同心圓121可以具有內部同心圓121的圓心111,使得圓心111也可以是外部同心圓122的圓心。Please refer to Figure 3. FIG. 3 is a top view showing a lower lens device according to an example of the present invention. Firstly, the display lens device 100 is provided. The lower display lens device 100 may include a display panel 101 for displaying pictures or images, such as the image 103 shown in FIG. 1 . The lower display lens device 100 may further include other suitable elements, such as an input unit (not shown), an output unit (not shown), or a control unit (not shown), but the present invention is not limited thereto. The display panel 101 may include a plurality of functional areas, such as a sensor area 110, a blurring area 120, and a display area 130, but the present invention is not limited thereto. In some embodiments of the invention, the sensor area 110 may be surrounded by a blurred area 120 and the blurred area 120 may be surrounded by a display area 130 . In some embodiments of the invention, the blurred region 120 may be in the form of a hollow circle 120H. The hollow circle 120H may include an inner concentric circle 121 and an outer concentric circle 122 . The inner concentric circle 121 may have a center 111 of the inner concentric circle 121 such that the center 111 may also be the center of the outer concentric circle 122 .

顯示面板101可以包括設置在感測器區域110中的影像感測器112。影像感測器112可以至少部分地設置在感測器區域110中,或是完全設置在感測器區域110中。影像感測器112可以作為顯示下鏡頭裝置100中的攝影鏡頭之用。The display panel 101 may include an image sensor 112 disposed in the sensor area 110 . The image sensor 112 can be at least partially disposed in the sensor area 110 , or completely disposed in the sensor area 110 . The image sensor 112 can be used to display the camera lens in the lower lens device 100 .

如前所述,在顯示裝置100中有複數個像素或子像素。在顯示裝置100的不同區域中的不同像素或是不同的子像素可以形成不同的像素組(set)。在本發明的一些實施方式中,至少一個感測器像素組113可以設置在鄰近於模糊化區域120位置的感測器區域110中。換句話說,感測器像素組113可以設置在內部同心圓121,即感測器區域110和模糊化區域120的邊界線,處。感測器像素組113可以包括一個或多個感測器像素單元。圖4繪示感測器像素組113可以包括複數個感測器子像素,但是本發明不限於此。As mentioned above, there are a plurality of pixels or sub-pixels in the display device 100 . Different pixels or different sub-pixels in different regions of the display device 100 may form different pixel groups (sets). In some embodiments of the invention, at least one sensor pixel group 113 may be disposed in the sensor region 110 adjacent to the location of the blurring region 120 . In other words, the sensor pixel group 113 may be disposed at the inner concentric circle 121 , ie, the boundary line of the sensor area 110 and the blurring area 120 . The sensor pixel group 113 may include one or more sensor pixel units. FIG. 4 shows that the sensor pixel group 113 may include a plurality of sensor sub-pixels, but the invention is not limited thereto.

在本發明的一些實施方式中,至少一個模糊化像素組123可以設置在模糊化區域120中。換句話說,可以將模糊化像素組123設置在內部同心圓121和外部同心圓122之間,亦即,可以設置在感測器區域110和顯示區域130之間。模糊化像素組123可以包括一個或多個模糊化像素單元。圖4繪示模糊化像素組123可以包括複數個感測器子像素,但是本發明不限於此。In some embodiments of the present invention, at least one blurring pixel group 123 may be disposed in the blurring area 120 . In other words, the blurring pixel group 123 may be disposed between the inner concentric circle 121 and the outer concentric circle 122 , that is, may be disposed between the sensor area 110 and the display area 130 . The blurred pixel group 123 may include one or more blurred pixel units. FIG. 4 shows that the blurred pixel group 123 may include a plurality of sensor sub-pixels, but the invention is not limited thereto.

在本發明的一些實施方式中,至少一個顯示像素組133可以設置在鄰近於模糊化區域120位置的顯示區域130中。例如,顯示像素組133可以設置在外部同心圓122,即顯示區域130和模糊化區域120之間的邊界線,處。顯示像素組133可以包括一個或多個顯示像素單元。圖4繪示顯示像素組133可以包括複數個顯示子像素,但是本發明不限於此。In some embodiments of the present invention, at least one display pixel group 133 may be disposed in the display area 130 adjacent to the position of the blurring area 120 . For example, the display pixel group 133 may be disposed at the outer concentric circle 122 , that is, the boundary line between the display area 130 and the blurring area 120 . The display pixel group 133 may include one or more display pixel units. FIG. 4 shows that the display pixel group 133 may include a plurality of display sub-pixels, but the invention is not limited thereto.

在本發明的一些實施方式中,還可以有一條直線102穿過感測器像素組113、模糊化像素組123、和顯示像素組133。在本發明的一些實施方式中,直線102可以進一步通過內部同心圓121的圓心111、感測器像素組113、模糊化像素組123和顯示像素組133,使得模糊化像素組123可以設置在感測器像素組113和顯示像素組133之間。模糊化像素組123可以包括一個或多個模糊化像素單元。在本發明的一些實施方式中,圖4繪示顯示像素組133與感測器像素組113之間的最小距離為1、模糊化像素組123與感測器像素組113之間的最小距離為Z、以及模糊化像素組123與顯示像素組133之間的最小距離是(1-Z)。In some embodiments of the present invention, there may also be a straight line 102 passing through the sensor pixel group 113 , the blur pixel group 123 , and the display pixel group 133 . In some embodiments of the present invention, the straight line 102 can further pass through the center 111 of the inner concentric circle 121, the sensor pixel group 113, the blurred pixel group 123 and the display pixel group 133, so that the blurred pixel group 123 can be set in the sense Between the detector pixel group 113 and the display pixel group 133. The blurred pixel group 123 may include one or more blurred pixel units. In some embodiments of the present invention, FIG. 4 shows that the minimum distance between the display pixel group 133 and the sensor pixel group 113 is 1, and the minimum distance between the blur pixel group 123 and the sensor pixel group 113 is Z, and the minimum distance between the blurring pixel set 123 and the display pixel set 133 is (1-Z).

圖4繪示根據本發明的圖3的顯示下鏡頭裝置100沿直線102的局部放大圖。感測器像素組113可以包括一個或多個感測器像素單元,以形成一個單元單位(unit cell)。在本發明的一個實施例中,感測器區域110中的有效感測器像素(active sensor pixels)和無效感測器像素(inactive sensor pixels)可以共同形成圖案,或者可以規則地排列。包括有效感測器像素和無效感測器像素以表示圖案或者排列的最小重複單元(minimal repeating unit)的單元單位,由其中的一個感測器像素組113所代表。例如,感測器像素組113可以包括n個有效感測器像素和m個無效感測器像素,其中n是不小於1的整數,m是不小於1的整數。在本發明的另一個實施例中,圖4繪示感測器像素組113可以包括四個感測器子像素,即,n+m=4,但是本發明不限於此。例如,感測器像素組113可以包括感測器子像素114、感測器子像素115、感測器子像素116、和感測器子像素117,但無論四個感測器子像素的顏色為何。FIG. 4 is a partially enlarged view showing the lower lens device 100 along the line 102 of FIG. 3 according to the present invention. The sensor pixel group 113 may include one or more sensor pixel units to form a unit cell. In one embodiment of the present invention, active sensor pixels and inactive sensor pixels in the sensor region 110 may jointly form a pattern, or may be regularly arranged. A unit unit including valid sensor pixels and invalid sensor pixels to represent a minimal repeating unit of a pattern or arrangement is represented by one sensor pixel group 113 . For example, the sensor pixel group 113 may include n valid sensor pixels and m invalid sensor pixels, where n is an integer not less than 1 and m is an integer not less than 1. In another embodiment of the present invention, FIG. 4 shows that the sensor pixel group 113 may include four sensor sub-pixels, ie, n+m=4, but the present invention is not limited thereto. For example, sensor pixel group 113 may include sensor subpixel 114, sensor subpixel 115, sensor subpixel 116, and sensor subpixel 117, but regardless of the color of the four sensor subpixels why.

類似地,模糊化像素組123可以包括一個或多個模糊化像素單元,以形成一個單元單位。一個單元單位中的模糊化像素單元的數量,與一個單元單位中的感測器像素單元的數量相同。例如,圖4繪示模糊化像素組123可以包括四個模糊化子像素,以與感測器像素組113中的四個感測器子像素相對應,但無論四個模糊化子像素的顏色為何。例如,模糊化像素組123可以包括模糊化子像素124、模糊化子像素125、模糊化子像素126、和模糊化子像素127,但是本發明不限於此。Similarly, the blurred pixel group 123 may include one or more blurred pixel units to form a unit unit. The number of blurred pixel units in a unit unit is the same as the number of sensor pixel units in a unit unit. For example, FIG. 4 shows that the blurred pixel group 123 may include four blurred sub-pixels to correspond to the four sensor sub-pixels in the sensor pixel group 113, but regardless of the color of the four blurred sub-pixels why. For example, the blurring pixel group 123 may include a blurring sub-pixel 124, a blurring sub-pixel 125, a blurring sub-pixel 126, and a blurring sub-pixel 127, but the present invention is not limited thereto.

類似地,顯示像素組133可以包括一個或多個顯示像素單元,以形成一個單元單位。一個單元單位中的模糊化像素單元的數量,與一個單元單位中的顯示像素單元的數量相同。例如,圖4繪示顯示像素組133可以包括四個顯示子像素,以與感測器像素組113中的四個感測器子像素相對應,但無論四個顯示子像素的顏色為何。例如,一個顯示像素組133可以包括顯示子像素134、顯示子像素135、顯示子像素136、和顯示子像素137,但是本發明不限於此。Similarly, the display pixel group 133 may include one or more display pixel units to form a unit unit. The number of blurring pixel units in one cell unit is the same as the number of display pixel units in one cell unit. For example, FIG. 4 shows that the display pixel set 133 may include four display sub-pixels to correspond to the four sensor sub-pixels in the sensor pixel set 113 , regardless of the colors of the four display sub-pixels. For example, one display pixel group 133 may include a display sub-pixel 134, a display sub-pixel 135, a display sub-pixel 136, and a display sub-pixel 137, but the present invention is not limited thereto.

如上所述,在感測器區域110中設置有影像感測器112,並且由影像感測器112的一部分所佔據的一個像素單元,則可以成為一個針孔(由點表示),以允許入射光到達影像感測器112來形成影像的一部分。由於一個或多個針孔(即,圖1中的顯示下鏡頭區域10所表示的一個或多個點)的存在,因為這些對應於點的無效感測器像素單元不再能夠發光,感測器區域110中的一個或多個感測器像素單元,會變成無效的感測器像素單元。圖1繪示對應於感測器區域110而在視覺形式上為點狀的區域,會對應於無效感測器像素單元的針孔。As described above, the image sensor 112 is disposed in the sensor area 110, and a pixel unit occupied by a part of the image sensor 112 may become a pinhole (represented by a dot) to allow incident The light reaches the image sensor 112 to form a portion of the image. Due to the presence of one or more pinholes (i.e., one or more points represented by the lower display lens area 10 in FIG. One or more sensor pixel units in the sensor region 110 become invalid sensor pixel units. FIG. 1 depicts regions corresponding to sensor regions 110 that are visually dotted, which would correspond to pinholes of inactive sensor pixel units.

因此,包括影像感測器112的感測器區域110在視覺上可能會表現出一些有效感測器像素和一些無效感測器像素。一個有效感測器像素可以表示為能夠發射任何合適顏色的光的一個感測器像素單元。無效的感測器像素可以表示為根本不能發光的一個感測器像素單元。例如,一個無效的感測器像素可以表示為在感測器區域110中由影像感測器112所表示的、而被一個針孔所佔據的一個像素單元,並使得此感測器像素單元的功能無效。感測器區域110中的無效感測器像素的集合,可能會不利地改變一個給定圖案的預定視覺呈現感,如圖1所示。Therefore, the sensor area 110 including the image sensor 112 may visually exhibit some valid sensor pixels and some invalid sensor pixels. An effective sensor pixel may be denoted as a sensor pixel unit capable of emitting light of any suitable color. An invalid sensor pixel may be represented as a sensor pixel unit that cannot emit light at all. For example, an invalid sensor pixel can be represented as a pixel cell represented by image sensor 112 in sensor area 110 that is occupied by a pinhole such that the sensor pixel cell's Function is invalid. A collection of inactive sensor pixels in sensor area 110 may adversely alter the intended visual appearance of a given pattern, as shown in FIG. 1 .

因為一個無效的感測器像素沒有亮度(沒有可用的照明),所以基於感測器像素組113中無效的感測器像素的存在,可能會不可避免地降低感測器像素組113(即一個單元單位)的總亮度。而存在著越多的無效的感測器像素,則感測器像素組113的總亮度就會越小。Because an inactive sensor pixel has no brightness (no illumination available), there may be an unavoidable reduction in sensor pixel set 113 (i.e., a unit unit) of the total brightness. And the more ineffective sensor pixels exist, the smaller the total brightness of the sensor pixel group 113 will be.

為了平衡由於無效的感測器像素的存在而導致照明的減少,感測器像素組113中所有的有效感測器像素可以具有最大的感測器像素亮度值SV,而感測器像素組113中所有的無效感測器像素會具有最小的感測器像素亮度值0。最大像素亮度值可以代表等於強度100%的最大灰階(grayscale)255。最小像素亮度值可以指的是等於強度0%的最小灰階0。由於灰階或是強度的概念,在本技術領域中是眾所周知的,因此不會詳述其細節。換句話說,一個感測器像素單元的亮度值可以是SV或是0,所以SV可以等於亮度值100。To balance the reduction in illumination due to the presence of ineffective sensor pixels, all active sensor pixels in sensor pixel group 113 may have a maximum sensor pixel brightness value SV, while sensor pixel group 113 All invalid sensor pixels in will have a minimum sensor pixel intensity value of 0. The maximum pixel brightness value may represent a maximum grayscale of 255 equal to an intensity of 100%. The minimum pixel brightness value may refer to a minimum gray scale of 0 equal to an intensity of 0%. Since the concept of grayscale or intensity is well known in the art, its details will not be described in detail. In other words, the brightness value of a sensor pixel unit can be SV or 0, so SV can be equal to the brightness value of 100.

因此,本發明提供以下的程序,以減輕或進一步消除在感測器區域110中的無效感測器像素的不利的視覺干擾。首先,如圖2所示,執行步驟201。先決定顯示像素亮度值DV。顯示像素亮度值DV較佳會與感測器像素亮度值SV有關。Accordingly, the present invention provides the following procedure to mitigate or further eliminate the unwanted visual interference of ineffective sensor pixels in the sensor area 110 . First, as shown in FIG. 2 , step 201 is executed. First determine the display pixel brightness value DV. The display pixel luminance value DV is preferably related to the sensor pixel luminance value SV.

由於一個或多個針孔的存在,因此並非感測器區域110中的每個感測器像素單元都是一個有效感測器像素。相反地,顯示像素組133是設置在作為一般顯示區域用的顯示區域130中,因此顯示區域130中的每個顯示像素單元都是在無效顯示像素不存在的情況下,是能夠發出任何合適顏色的光的一個有效顯示像素。在本發明的一些實施方式中,如果感測器像素組113包括n個有效感測器像素和m個無效感測器像素時,則顯示像素組133可以類似地並且相應地包括n+m個有效顯示像素並且沒有無效顯示像素。Due to the presence of one or more pinholes, not every sensor pixel unit in sensor area 110 is a valid sensor pixel. On the contrary, the display pixel group 133 is arranged in the display area 130 used as a general display area, so each display pixel unit in the display area 130 can emit any suitable color when the invalid display pixel does not exist. An effective display pixel of light. In some embodiments of the invention, if sensor pixel group 113 includes n valid sensor pixels and m ineffective sensor pixels, then display pixel group 133 may similarly and correspondingly include n+m Active display pixels and no invalid display pixels.

為了表現出視覺上的均勻一致性,顯示像素組133的視覺亮度較佳會接近或等於感測器像素組113的視覺亮度,於是可以來決定顯示像素亮度值DV。例如,顯示像素亮度值DV可以相對於感測器像素亮度值SV而成比例地降低。感測器像素亮度值SV則可以表示因應顯示下鏡頭的結果。In order to show visual uniformity, the visual brightness of the display pixel group 133 is preferably close to or equal to the visual brightness of the sensor pixel group 113 , so the display pixel brightness value DV can be determined. For example, the display pixel luminance value DV may be proportionally reduced relative to the sensor pixel luminance value SV. The sensor pixel luminance value SV can represent the result of displaying the lower lens.

如果感測器像素組113包括n個有效感測器像素和m個無效感測器像素時,則可以根據DV = [n/(n+m)]×(最大像素亮度值SV)的原則來決定顯示像素單元的顯示像素亮度值DV。例如,如果將SV設定為100,則DV = [n/(n+m)] × 100。滿足了前述關係的顯示像素亮度值DV,可以確保相對於感測器區域110、在顯示區域130中的亮度有著視覺上的亮度一致性。在前述步驟之後,可以使得例如顯示區域130中的顯示像素單元的亮度能夠被一致化與常規化(normalize),所以它們可以共享相同的顯示像素亮度值DV,而在顯示區域130中具有均勻的亮度。因此,顯示像素亮度值DV可以表示常態的結果,或是常規化後的結果。If the sensor pixel group 113 includes n effective sensor pixels and m ineffective sensor pixels, it can be determined according to the principle of DV = [n/(n+m)]×(maximum pixel brightness value SV) Determine the display pixel brightness value DV of the display pixel unit. For example, if SV is set to 100, then DV = [n/(n+m)] × 100. The display pixel luminance value DV that satisfies the aforementioned relationship can ensure visual consistency of luminance in the display area 130 relative to the sensor area 110 . After the aforementioned steps, for example, the luminance of the display pixel units in the display area 130 can be uniformed and normalized (normalize), so they can share the same display pixel luminance value DV, and have a uniform luminance in the display area 130 brightness. Therefore, the display pixel luminance value DV may represent a normal result or a normalized result.

其次,如圖2所示,在執行步驟201之後,再執行步驟301。在決定顯示像素單元的顯示像素亮度值DV之後,再決定模糊化像素單元的模糊化像素亮度值BV。模糊化像素的亮度值BV的決定方式,可以是模糊化像素亮度值BV從最大感測器像素亮度值SV到顯示像素亮度值DV的亮度對準。這是一種模糊化區域120,相對於感測器區域110和相對於顯示區域130的用於亮度對準的調整操作。Next, as shown in FIG. 2 , after step 201 is performed, step 301 is performed. After the display pixel luminance value DV of the display pixel unit is determined, the blurred pixel luminance value BV of the blurred pixel unit is determined. The method of determining the brightness value BV of the blurred pixel may be the brightness alignment of the blurred pixel brightness value BV from the maximum sensor pixel brightness value SV to the display pixel brightness value DV. This is an adjustment operation for brightness alignment of the blurring area 120 with respect to the sensor area 110 and with respect to the display area 130 .

不同地,為了平衡感測器區域110和顯示區域130之間的像素單元的亮度差別,照明,例如模糊化區域120中的每個模糊化像素單元的亮度,可以根據顯示像素亮度值DV和感測器像素亮度值SV,而有一個特定的模糊化像素亮度值BV。例如,模糊化像素亮度值BV會不大於最大感測器像素亮度值SV,又不小於對應的顯示像素亮度值DV,以形成從SV遞變至DV的平滑亮度梯度。因此,可以沿著直線102形成像素單元的亮度梯度,使得由感測器區域110中因無效感測器像素所引起給定影像的不良視覺呈現感可以逐漸變弱,並且經由模糊化區域120逐漸收斂到顯示區域130。換句話說,像素單元的亮度梯度可以用於使得顯示下鏡頭區域,例如圖1所示的明顯邊界線11變得模糊不清,於是原始的邊界線在視覺上就可能變得較不那麼明顯,或者進一步變得實質上的不可見。Differently, in order to balance the brightness difference of the pixel units between the sensor area 110 and the display area 130, the illumination, for example, the brightness of each blurred pixel unit in the blurred area 120, can be based on the display pixel brightness value DV and the sensing area DV. The sensor pixel brightness value SV has a specific blurred pixel brightness value BV. For example, the blurred pixel brightness value BV is not greater than the maximum sensor pixel brightness value SV and not smaller than the corresponding display pixel brightness value DV, so as to form a smooth brightness gradient from SV to DV. Therefore, the brightness gradient of the pixel units can be formed along the straight line 102, so that the poor visual presentation of a given image caused by the ineffective sensor pixels in the sensor area 110 can be gradually weakened, and gradually become blurred through the blurring area 120. Converge to display area 130 . In other words, the brightness gradient of the pixel unit can be used to make the display area of the lower lens, such as the obvious boundary line 11 shown in FIG. 1, become blurred, so the original boundary line may become less obvious visually , or further become substantially invisible.

形成單元單位的模糊化像素組123設置在模糊化區域120中,並且位於感測器像素組113和顯示像素組133之間,例如正好位於感測器像素組113和顯示像素組133之間。模糊化像素組123中的每個像素單元具有獨立的模糊化像素亮度值BV。計算各個獨立的模糊化像素亮度值BV而與SV和DV對齊。決定各個模糊化像素亮度值BV,使得內部同心圓121的邊界線變得模糊不清。一個單元單位可以包括n+m個子像素,而無論子像素的顏色為何,並且可以安排n+m個子像素形成圖案或按照順序,例如按其位點(locus),排列。The blurred pixel group 123 forming a unit unit is disposed in the blurred region 120 and located between the sensor pixel group 113 and the display pixel group 133 , for example, just between the sensor pixel group 113 and the display pixel group 133 . Each pixel unit in the blurred pixel group 123 has an independent blurred pixel brightness value BV. Each independent blurred pixel brightness value BV is calculated to align with SV and DV. The brightness value BV of each blurred pixel is determined so that the boundary line of the inner concentric circle 121 becomes blurred. One unit unit may include n+m sub-pixels regardless of the color of the sub-pixels, and the n+m sub-pixels may be arranged to form a pattern or be arranged in order, for example, by their locus.

例如,感測器像素組113中的一個單元單位可以包括n個有效感測器像素和m個無效感測器像素,其中n是不小於1的整數,又m是不小於1的整數,所以一個單元單位可以相應地包括位於一個模糊化像素組123中的n+ m個模糊化像素,或是可以相應地包括位於顯示區域130中的n+m個顯示像素。一個單元單位中的某個模糊化像素可以排他地對應於特定的感測器像素和對應於特定的顯示像素。例如,一個單元單位中的第一位點的模糊化像素,可以沿著直線102對應於另一單元單位中的第一位點的感測器像素,並且對應於另一個單元單位中的第一位點的顯示像素。而一個單元單位中的第二位點的模糊化像素,可以沿著直線102對應於另一個單元單位中的第二位點的感測器像素,並且對應於另一單元單位中的第二位點的顯示像素,並可以依此類推。For example, a unit unit in the sensor pixel group 113 may include n valid sensor pixels and m invalid sensor pixels, where n is an integer not less than 1, and m is an integer not less than 1, so A unit unit may correspondingly include n+m blurred pixels located in one blurred pixel group 123 , or may correspondingly include n+m display pixels located in the display area 130 . A certain blurred pixel in a cell unit may correspond exclusively to a particular sensor pixel and to a particular display pixel. For example, a blurred pixel at a first location in one cell unit may correspond to a sensor pixel at a first location in another cell unit along line 102 and correspond to a first location in another cell unit. Display pixels for the locus. And the blurred pixel of the second position in one unit unit can correspond to the sensor pixel of the second position in the other unit unit along the straight line 102, and corresponds to the second position in the other unit unit. Points are displayed in pixels, and so on.

然後,如圖2所示,在執行步驟301之後再執行步驟401。步驟401可以是一種調整計算,例如執行一種或多種的加權計算。這種加權計算可涉及一個或多個權值。一個或多個權值可以涉及像是距離之類的尺寸測量,使得可以根據到參考點的距離來調整模糊化區域120中的子像素的亮度,但是本發明不限於此。Then, as shown in FIG. 2 , step 401 is executed after step 301 is executed. Step 401 may be an adjustment calculation, such as performing one or more weighting calculations. Such weighting calculations may involve one or more weights. One or more weights may relate to a dimensional measure such as distance such that the brightness of sub-pixels in the blurred region 120 may be adjusted according to the distance to a reference point, but the invention is not limited thereto.

例如,可以根據權值Z、根據對應的感測器像素亮度值SV、和根據對應的顯示像素亮度值DV,來決定一個特定的模糊化像素亮度值BV,而滿足一種線性加權計算:BV =(1-Z)× SV + Z × DV,但是本發明不限於此。模糊化像素亮度值BV可以代表模糊化像素組123中的模糊化像素的伽馬級(gamma level),但是本發明不限於此。沿著直線102,一個顯示像素組133和一個感測器像素組113之間的最小距離是1、一個模糊化像素組123和一個感測器像素組113之間的最小距離是Z而用作為本實例中的權值、並且一個模糊化像素組123和一個顯示像素組133之間的最小距離是為(1-Z),但是本發明不限於此。當實施本發明的方法時,顯示像素組133和感測器像素組113之間實際的最小距離是視實施當時情況所得到的,並且可由本領域的一般技藝人士所決定,只要此最小距離足以用於實作本發明即可。換句話說,本發明引入了與顯示下鏡頭有關的權值,以決定模糊化像素亮度值BV,但是本發明不限於此。For example, a specific blurred pixel luminance value BV can be determined according to the weight Z, according to the corresponding sensor pixel luminance value SV, and according to the corresponding display pixel luminance value DV, so as to satisfy a linear weighted calculation: BV = (1-Z)×SV+Z×DV, but the present invention is not limited thereto. The blurred pixel brightness value BV may represent the gamma level of the blurred pixel in the blurred pixel group 123 , but the invention is not limited thereto. Along line 102, the minimum distance between a display pixel group 133 and a sensor pixel group 113 is 1, and the minimum distance between a blur pixel group 123 and a sensor pixel group 113 is Z to be used as In this example, the weight value and the minimum distance between one blurring pixel group 123 and one display pixel group 133 are (1-Z), but the present invention is not limited thereto. When implementing the method of the present invention, the actual minimum distance between the display pixel group 133 and the sensor pixel group 113 is obtained depending on the situation at the time of implementation, and can be determined by those of ordinary skill in the art, as long as the minimum distance is sufficient It can be used for implementing the present invention. In other words, the present invention introduces weights related to the lower shot to determine the blurred pixel brightness value BV, but the present invention is not limited thereto.

如圖4所示,以下根據本發明的一些實施提出一些用於決定不同的模糊化像素亮度值BV的計算範例。以下的計算範例雖然涉及n+m = 4的實施方式,但是本發明不僅限於n+m = 4的實施方式。任何涉及n+m≥2的實施方式,都要視為落入本發明的範圍之中和優化的原理之內。As shown in FIG. 4 , some calculation examples for determining different blurred pixel brightness values BV are proposed below according to some implementations of the present invention. Although the following calculation example relates to the embodiment of n+m=4, the present invention is not limited to the embodiment of n+m=4. Any implementation involving n+m≧2 should be regarded as falling within the scope of the present invention and within the principle of optimization.

第一實例first instance

圖4繪示包括第一感測器子像素114、第二感測器子像素115、第三感測器子像素116、和第四感測器子像素117的感測器像素組113,以形成一個單元單位113,而與四個感測器子像素的顏色無關。四個感測器子像素相對於它們各自的特定位點,而排列在一個單元單位中。一個位點是指將一個特定的感測器子像素,沿著一條給定的直線排列,而在一個給定的單元單位中的一個地點,或者是在執行決定一個像素亮度值,例如DV或BV,時所關注的一個地點。例如,包括第一感測器子像素114、第二感測器子像素115、第三感測器子像素116、和第四感測器子像素117的感測器像素組113,可以包括四個對應的位點,例如第一感測器子像素114的位點、第二感測器子像素115的位點、第三感測器子像素116的位點、和第四感測器子像素117的位點,但是本發明不限於此。在第一實例中,第一感測器子像素114、第二感測器子像素115、第三感測器子像素116是有效感測器像素,而第四感測器子像素117是無效感測器像素,因此n = 3和m = 1。FIG. 4 illustrates a sensor pixel group 113 comprising a first sensor sub-pixel 114, a second sensor sub-pixel 115, a third sensor sub-pixel 116, and a fourth sensor sub-pixel 117, in order to One cell unit 113 is formed regardless of the colors of the four sensor sub-pixels. Four sensor sub-pixels are arranged in a cell unit with respect to their respective specific sites. A location refers to a specific sensor sub-pixel arranged along a given line, and a location in a given unit unit, or to determine a pixel brightness value, such as DV or BV, a place of concern at the time. For example, sensor pixel group 113 including first sensor sub-pixel 114, second sensor sub-pixel 115, third sensor sub-pixel 116, and fourth sensor sub-pixel 117 may include four corresponding sites, such as the site of the first sensor sub-pixel 114, the site of the second sensor sub-pixel 115, the site of the third sensor sub-pixel 116, and the site of the fourth sensor sub-pixel The position of the pixel 117, but the present invention is not limited thereto. In a first example, the first sensor sub-pixel 114, the second sensor sub-pixel 115, the third sensor sub-pixel 116 are active sensor pixels, and the fourth sensor sub-pixel 117 is an inactive sensor pixel. sensor pixels, so n = 3 and m = 1.

首先,根據前述原理,第一感測器子像素114、第二感測器子像素115和第三感測器子像素116分別具有最大感測器像素亮度值SV(亮度100)而第四感測器子像素117則具有最小的感測器像素亮度值0。可以簡化前述的初始條件而表示為[子像素 (對應的亮度值)]:First, according to the aforementioned principles, the first sensor sub-pixel 114, the second sensor sub-pixel 115, and the third sensor sub-pixel 116 respectively have the maximum sensor pixel brightness value SV (brightness 100), while the fourth sensor sub-pixel The sensor sub-pixel 117 has a minimum sensor pixel brightness value of 0. The aforementioned initial conditions can be simplified and expressed as [subpixel (corresponding brightness value)]:

[114(100),115(100),116(100),117(0)][114(100), 115(100), 116(100), 117(0)]

其次,圖4繪示包括第一顯示子像素134、第二顯示子像素135、第三顯示子像素136、和第四顯示子像素137的顯示像素組133,以形成一個單元單位133,而與四個顯示子像素的顏色無關。四個顯示子像素相對於它們的特定位點,而分別排列在一個單元單位中。再根據DV = [n /(n+m)] × 100來決定四個顯示子像素的顯示像素亮度值DV。Next, FIG. 4 shows a display pixel group 133 including a first display sub-pixel 134, a second display sub-pixel 135, a third display sub-pixel 136, and a fourth display sub-pixel 137 to form a unit unit 133, and The four display sub-pixels are color independent. The four display sub-pixels are respectively arranged in a unit unit with respect to their specific positions. Then, according to DV=[n/(n+m)]×100, the display pixel luminance value DV of the four display sub-pixels is determined.

DV134 = [3 /(3 + 1)] × 100 = 75,因為第一顯示子像素134在區域上對應於第一感測器子像素114;DV134 = [3/(3+1)] x 100 = 75, since the first display sub-pixel 134 corresponds in area to the first sensor sub-pixel 114;

DV135 = [3 /(3 + 1)] × 100 = 75,因為第二顯示子像素135在區域上對應於第二感測器子像素115;DV135 = [3/(3+1)] x 100 = 75, since the second display sub-pixel 135 corresponds in area to the second sensor sub-pixel 115;

DV136 = [3 /(3 + 1)] × 100 = 75,因為第三顯示子像素136在區域上對應於第三感測器子像素116;DV136 = [3/(3+1)] x 100 = 75, since the third display sub-pixel 136 corresponds in area to the third sensor sub-pixel 116;

DV137 = [3 /(3 + 1)] × 100 = 75,因為第四顯示子像素137在區域上對應於第四感測器子像素117。DV137 = [3/(3+1)]×100=75, since the fourth display sub-pixel 137 corresponds in area to the fourth sensor sub-pixel 117 .

以上結果可以簡化為:The above result can be simplified to:

[134(75),135(75),136(75),137(75)][134(75), 135(75), 136(75), 137(75)]

第三,圖4繪示包括第一模糊化子像素124、第二模糊化子像素125、第三模糊化子像素126、和第四模糊化子像素127的模糊化像素組123,以形成一個單元單位123,而與四個模糊化子像素的顏色無關。四個顯示子像素相對於它們的特定位點,而分別排列在一個單元單位中。假設Z = 0.25,這意味著模糊化像素組123比較靠近感測器像素組113,來決定每個模糊化子像素的模糊化像素亮度值BV1或BV2,並滿足關係:BV =(1- Z)× SV + Z × DV。第一模糊化像素亮度值BV1和第二模糊化像素亮度值BV2可以分別表示一種伽馬級。Third, FIG. 4 shows a blurred pixel group 123 including a first blurred sub-pixel 124, a second blurred sub-pixel 125, a third blurred sub-pixel 126, and a fourth blurred sub-pixel 127 to form a The cell unit is 123, regardless of the color of the four blurred sub-pixels. The four display sub-pixels are respectively arranged in a unit unit with respect to their specific positions. Suppose Z=0.25, which means that the blurred pixel group 123 is relatively close to the sensor pixel group 113 to determine the blurred pixel brightness value BV1 or BV2 of each blurred sub-pixel, and satisfy the relationship: BV=(1-Z ) × SV + Z × DV. The first blurred pixel brightness value BV1 and the second blurred pixel brightness value BV2 may respectively represent a gamma level.

BV124 =(1-0.25)× 100 + 0.25 × 75 = 93.75,因為第一模糊化子像素124在區域上對應於第一感測器子像素114(SV = 100);BV124 = (1-0.25) x 100 + 0.25 x 75 = 93.75, since the first blurred sub-pixel 124 corresponds in area to the first sensor sub-pixel 114 (SV = 100);

BV125 =(1-0.25)× 100 + 0.25 × 75 = 93.75,因為第二模糊化子像素125在區域上對應於第二感測器子像素115(SV = 100);BV125 = (1-0.25) x 100 + 0.25 x 75 = 93.75, since the second blurring sub-pixel 125 corresponds in area to the second sensor sub-pixel 115 (SV = 100);

BV126 =(1-0.25)× 100 + 0.25 × 75 = 93.75,因為第三模糊化子像素126在區域上對應於第三感測器子像素116(SV = 100);BV126 = (1-0.25) x 100 + 0.25 x 75 = 93.75, since the third blurred sub-pixel 126 corresponds in area to the third sensor sub-pixel 116 (SV = 100);

BV127 =(1-0.25)× 0 + 0.25 × 75 = 18.75,因為第四模糊化子像素127在區域上對應於第四感測器子像素117(SV = 0)。BV127 = (1-0.25) x 0 + 0.25 x 75 = 18.75, since the fourth blurring sub-pixel 127 corresponds in area to the fourth sensor sub-pixel 117 (SV = 0).

以上的調整結果可以簡化為:The above adjustment results can be simplified as:

[124(93.75),125(93.75),126(93.75),127(18.75)][124 (93.75), 125 (93.75), 126 (93.75), 127 (18.75)]

計算結果列示於圖5中。The calculation results are listed in Figure 5.

請注意,因為每個單元單位113/123/133中的總亮度是相同的(300),所以會在不同的像素組中產生均勻一致的視覺亮度品質。Note that because the total brightness in each cell unit 113/123/133 is the same (300), this results in a uniform visual brightness quality across the different pixel groups.

第二實例second instance

圖4繪示包括第一感測器子像素114、第二感測器子像素115、第三感測器子像素116、和第四感測器子像素117的感測器像素組113,以形成一個單元單位113,而與四個感測器子像素的顏色無關。四個感測器子像素相對於它們的特定位點,而分別排列在一個單元單位中。而在第二實例中,第一感測器子像素114和第四感測器子像素117是有效感測器像素,而第二感測器子像素115和第三感測器子像素116是無效感測器像素,因此n = 2同時m = 2。FIG. 4 illustrates a sensor pixel group 113 comprising a first sensor sub-pixel 114, a second sensor sub-pixel 115, a third sensor sub-pixel 116, and a fourth sensor sub-pixel 117, in order to One cell unit 113 is formed regardless of the colors of the four sensor sub-pixels. The four sensor sub-pixels are respectively arranged in a cell unit with respect to their specific positions. While in the second example, the first sensor sub-pixel 114 and the fourth sensor sub-pixel 117 are effective sensor pixels, while the second sensor sub-pixel 115 and the third sensor sub-pixel 116 are Invalid sensor pixels, so n = 2 and m = 2.

首先,根據前述原理,第一感測器子像素114和第四感測器子像素117分別具有最大感測器像素亮度值SV(亮度100),而第二感測器子像素115和第三感測器子像素116分別具有最小的感測器像素亮度值0。前述的初始條件可以簡化為[子像素 (對應的亮度值)]:First, according to the aforementioned principle, the first sensor sub-pixel 114 and the fourth sensor sub-pixel 117 respectively have the maximum sensor pixel brightness value SV (brightness 100), while the second sensor sub-pixel 115 and the third sensor sub-pixel The sensor subpixels 116 each have a minimum sensor pixel luminance value of zero. The aforementioned initial conditions can be simplified to [subpixel (corresponding brightness value)]:

[114(100),115(0),116(0),117(100)][114(100), 115(0), 116(0), 117(100)]

其次,圖4繪示包括第一顯示子像素134、第二顯示子像素135、第三顯示子像素136、和第四顯示子像素137的顯示像素組133,以形成一個單元單位133,而與四個顯示子像素的顏色無關。四個顯示子像素相對於它們的特定位點,而分別排列在一個單元單位中。再根據DV = [n /(n+m)] × 100的原則來決定四個顯示子像素的顯示像素亮度值DV。Next, FIG. 4 shows a display pixel group 133 including a first display sub-pixel 134, a second display sub-pixel 135, a third display sub-pixel 136, and a fourth display sub-pixel 137 to form a unit unit 133, and The four display sub-pixels are color independent. The four display sub-pixels are respectively arranged in a unit unit with respect to their specific positions. Then, according to the principle of DV = [n / (n+m)] × 100, the display pixel luminance value DV of the four display sub-pixels is determined.

DV134 = [2 /(2 + 2)] × 100 = 50,因為第一顯示子像素134在區域上對應於第一感測器子像素114;DV134 = [2/(2+2)] x 100 = 50, since the first display sub-pixel 134 corresponds in area to the first sensor sub-pixel 114;

DV135 = [2 /(2 + 2)] × 100 = 50,因為第二顯示子像素135在區域上對應於第二感測器子像素115;DV135 = [2/(2+2)] x 100 = 50, since the second display sub-pixel 135 corresponds in area to the second sensor sub-pixel 115;

DV136 = [2 /(2 + 2)] × 100 = 50,因為第三顯示子像素136在區域上對應於第三感測器子像素116;DV136 = [2/(2+2)] x 100 = 50, since the third display sub-pixel 136 corresponds in area to the third sensor sub-pixel 116;

DV137 = [2 /(2 + 2)] × 100 = 50,因為第四顯示子像素137在區域上對應於第四感測器子像素117。DV137 = [2/(2+2)]×100=50, since the fourth display sub-pixel 137 corresponds in area to the fourth sensor sub-pixel 117 .

以上結果可以簡化為:The above result can be simplified to:

[134(50),135(50),136(50),137(50)][134(50), 135(50), 136(50), 137(50)]

第三,圖4繪示包括第一模糊化子像素124、第二模糊化子像素125、第三模糊化子像素126、和第四模糊化子像素127的模糊化像素組123,以形成一個單元單位123,而與四個模糊化子像素的顏色無關。四個模糊化子像素相對於它們的特定位點,而分別排列在一個單元單位中。假設Z = 0.50,這意味著模糊化像素組123位於與感測器像素組113和顯示像素組133之間等距的位置上。再根據BV = (1-Z)× SV + Z × DV來決定每個模糊化子像素的模糊化像素亮度值BV。Third, FIG. 4 shows a blurred pixel group 123 including a first blurred sub-pixel 124, a second blurred sub-pixel 125, a third blurred sub-pixel 126, and a fourth blurred sub-pixel 127 to form a The cell unit is 123, regardless of the color of the four blurred sub-pixels. The four blurred sub-pixels are respectively arranged in a unit unit with respect to their specific positions. Assuming Z = 0.50, this means that blurring pixel set 123 is located equidistant between sensor pixel set 113 and display pixel set 133 . Then, according to BV = (1-Z) × SV + Z × DV, the blurred pixel brightness value BV of each blurred sub-pixel is determined.

BV124 =(1-0.50)× 100 + 0.50 × 50 = 75,因為第一模糊化子像素124在區域上對應於第一感測器子像素114(SV = 100);BV124 = (1-0.50) x 100 + 0.50 x 50 = 75, since the first blurring sub-pixel 124 corresponds in area to the first sensor sub-pixel 114 (SV = 100);

BV125 =(1-0.50)× 0 + 0.50 × 50 = 25,因為第二模糊化子像素125在區域上對應於第二感測器子像素115(SV = 0);BV125 = (1-0.50) x 0 + 0.50 x 50 = 25, since the second blurring sub-pixel 125 corresponds in area to the second sensor sub-pixel 115 (SV = 0);

BV126 =(1-0.50)× 0 + 0.50 × 50 = 25,因為第三模糊化子像素126在區域上對應於第三感測器子像素116(SV = 0);BV126 = (1-0.50) x 0 + 0.50 x 50 = 25, since the third blurred sub-pixel 126 corresponds in area to the third sensor sub-pixel 116 (SV = 0);

BV127 =(1-0.50)× 100 + 0.50 × 50 = 75,因為第四模糊化子像素127在區域上對應於第四感測器子像素117(SV = 100)。BV127 = (1-0.50) x 100 + 0.50 x 50 = 75, since the fourth blurring sub-pixel 127 corresponds in area to the fourth sensor sub-pixel 117 (SV = 100).

以上的調整結果可以簡化為:The above adjustment results can be simplified as:

[124(75),125(25),126(25),127(75)][124(75), 125(25), 126(25), 127(75)]

計算結果列示於圖6中。The calculation results are listed in Figure 6.

請注意,因為每個單元單位113/123/133中的總亮度是相同的(200),所以在不同的像素組中產生均勻一致的視覺亮度品質。Note that because the total brightness in each cell unit 113/123/133 is the same (200), this results in a uniform visual brightness quality across different groups of pixels.

第三實例third example

圖4繪示包括第一感測器子像素114、第二感測器子像素115、第三感測器子像素116、和第四感測器子像素117的感測器像素組113,以形成一個單元單位113,而與四個感測器子像素的顏色無關。四個感測器子像素相對於它們的特定位點,而分別排列在一個單元單位中。而在第三實例中,第一感測器子像素114、第二感測器子像素115、和第三感測器子像素116是無效的感測器像素,而第四感測器子像素117是有效感測器像素,因此n = 1和m = 3。FIG. 4 illustrates a sensor pixel group 113 comprising a first sensor sub-pixel 114, a second sensor sub-pixel 115, a third sensor sub-pixel 116, and a fourth sensor sub-pixel 117, in order to One cell unit 113 is formed regardless of the colors of the four sensor sub-pixels. The four sensor sub-pixels are respectively arranged in a cell unit with respect to their specific positions. While in the third example, the first sensor sub-pixel 114, the second sensor sub-pixel 115, and the third sensor sub-pixel 116 are inactive sensor pixels, while the fourth sensor sub-pixel 117 is an effective sensor pixel, so n=1 and m=3.

首先,根據前述原理,第一感測器子像素114、第二感測器子像素115、和第三感測器子像素116分別具有最小的感測器像素亮度值0,而第四感測器子像素117具有最大感測器像素亮度值SV(亮度100)。前述的初始條件可以簡化為[子像素 (對應的亮度值)]:First, according to the aforementioned principle, the first sensor sub-pixel 114, the second sensor sub-pixel 115, and the third sensor sub-pixel 116 respectively have the minimum sensor pixel brightness value of 0, while the fourth sensor sub-pixel Sensor subpixel 117 has a maximum sensor pixel brightness value SV (brightness 100). The aforementioned initial conditions can be simplified to [subpixel (corresponding brightness value)]:

[114(0),115(0),116(0),117(100)][114(0), 115(0), 116(0), 117(100)]

其次,圖4繪示包括第一顯示子像素134、第二顯示子像素135、第三顯示子像素136、和第四顯示子像素137的顯示像素組133,以形成一個單元單位133,而與四個顯示子像素的顏色無關。四個顯示子像素相對於它們的特定位點,而分別排列在一個單元單位中。再根據DV = [1 /(1 + 3)] × 100來決定四個顯示子像素的顯示像素亮度值DV。Next, FIG. 4 shows a display pixel group 133 including a first display sub-pixel 134, a second display sub-pixel 135, a third display sub-pixel 136, and a fourth display sub-pixel 137 to form a unit unit 133, and The four display sub-pixels are color independent. The four display sub-pixels are respectively arranged in a unit unit with respect to their specific positions. Then according to DV = [1 / (1 + 3)] × 100 to determine the display pixel brightness value DV of the four display sub-pixels.

DV134 = [1 /(3 + 1)] × 100 = 25,因為第一顯示子像素134在區域上對應於第一感測器子像素114;DV134 = [1/(3+1)] x 100 = 25, since the first display sub-pixel 134 corresponds in area to the first sensor sub-pixel 114;

DV135 = [1 /(3 + 1)] × 100 = 25,因為第二顯示子像素135在區域上對應於第二感測器子像素115;DV135 = [1/(3+1)] x 100 = 25, since the second display sub-pixel 135 corresponds in area to the second sensor sub-pixel 115;

DV136 = [1 /(3 + 1)] × 100 = 25,因為第三顯示子像素136在區域上對應於第三感測器子像素116;DV136 = [1/(3+1)] x 100 = 25, since the third display sub-pixel 136 corresponds in area to the third sensor sub-pixel 116;

DV137 = [1 /(3 + 1)] × 100 = 25,因為第四顯示子像素137在區域上對應於第四感測器子像素117。DV137 = [1/(3+1)]×100=25, since the fourth display sub-pixel 137 corresponds in area to the fourth sensor sub-pixel 117 .

以上的結果可以簡化為:The above result can be simplified as:

[134(25),135(25),136(25),137(25)][134(25), 135(25), 136(25), 137(25)]

第三,圖4繪示包括第一模糊化子像素124、第二模糊化子像素125、第三模糊化子像素126、和第四模糊化子像素127的模糊化像素組123,以形成一個單元單位123,而與四個模糊化子像素的顏色無關。四個模糊化子像素相對於它們的特定位點,而分別排列在一個單元單位中。假設Z = 0.75,這意味著模糊化像素組123位於更靠近顯示像素組133的位置,再根據BV =(1-Z)× SV + Z × DV的原則來決定每個模糊化子像素的模糊化像素亮度值BV。Third, FIG. 4 shows a blurred pixel group 123 including a first blurred sub-pixel 124, a second blurred sub-pixel 125, a third blurred sub-pixel 126, and a fourth blurred sub-pixel 127 to form a The cell unit is 123, regardless of the color of the four blurred sub-pixels. The four blurred sub-pixels are respectively arranged in a unit unit with respect to their specific positions. Suppose Z = 0.75, which means that the blurred pixel group 123 is located closer to the display pixel group 133, and then the blurring of each blurred sub-pixel is determined according to the principle of BV = (1-Z) × SV + Z × DV Optimize the pixel brightness value BV.

BV124 =(1-0.75)× 0 + 0.75 × 25 = 18.75,因為第一模糊化子像素124在區域上對應於第一感測器子像素114(SV = 0);BV124 = (1-0.75) x 0 + 0.75 x 25 = 18.75, since the first blurred sub-pixel 124 corresponds in area to the first sensor sub-pixel 114 (SV = 0);

BV125 =(1-0.75)× 0 + 0.75 × 25 = 18.75,因為第二模糊化子像素125在區域上對應於第二感測器子像素115(SV = 0);BV125 = (1-0.75) x 0 + 0.75 x 25 = 18.75, since the second blurring sub-pixel 125 corresponds in area to the second sensor sub-pixel 115 (SV = 0);

BV126 =(1-0.75)× 0 + 0.75 × 25 = 18.75,因為第三模糊化子像素126在區域上對應於第三感測器子像素116(SV = 0);BV126 = (1-0.75) x 0 + 0.75 x 25 = 18.75, since the third blurred sub-pixel 126 corresponds in area to the third sensor sub-pixel 116 (SV = 0);

BV127 =(1-0.75)×100 + 0.75×25 = 43.75,因為第四模糊化子像素127在區域上對應於感測器子像素117(SV = 100)。BV127 = (1-0.75) x 100 + 0.75 x 25 = 43.75, since the fourth blurring sub-pixel 127 corresponds in area to the sensor sub-pixel 117 (SV = 100).

以上的調整結果可以簡化為:The above adjustment results can be simplified as:

[124(18.75),125(18.75),126(18.75),127(43.75)][124 (18.75), 125 (18.75), 126 (18.75), 127 (43.75)]

計算結果列示於圖7中。The calculation results are shown in Figure 7.

請注意,因為每個單元單位113/123/133中的總亮度是相同的(100),所以在不同的像素組中產生均勻一致的視覺亮度品質。Note that because the total brightness in each cell unit 113/123/133 is the same (100), this results in a uniform visual brightness quality across different groups of pixels.

接下來,如圖2所示,在執行步驟401之後再執行步驟501。例如,決定模糊化區域120中的每個與各個像素單元的亮度,而獲得模糊化區域120中的每個像素單元加權過的結果。模糊化區域120中的像素單元新得到的加權過的結果可以表示用來弱化輪廓的梯度,來模糊化如圖1所示的顯示下鏡頭區域的明顯邊界線。例如,在第一實例中,決定模糊化區域120中的一些例示的像素單元的亮度,以獲得模糊化區域120中的像素單元的加權結果[124(93.75),125(93.75),126(93.75),127(18.75)]。在第二實例中,決定模糊化區域120中的一些例示的像素單元的亮度,以獲得模糊化區域120中的像素單元的加權結果[124(75),125(25),126(25),127(75)]。而在第三實例中,決定模糊化區域120中的一些例示的像素單元的亮度,以獲得模糊化區域120中的像素單元的加權結果[124(18.75),125(18.75),126(18.75),127(43.75)]。Next, as shown in FIG. 2 , step 501 is executed after step 401 is executed. For example, the brightness of each pixel unit in the blurred area 120 is determined to obtain a weighted result of each pixel unit in the blurred area 120 . The newly obtained weighted result of the pixel units in the blurring area 120 can represent the gradient used to soften the outline, so as to blur the obvious boundary line of the lower shot area shown in FIG. 1 . For example, in a first example, the brightness of some instantiated pixel units in the blurred area 120 is determined to obtain a weighted result of the pixel units in the blurred area 120 [124(93.75), 125(93.75), 126(93.75 ), 127(18.75)]. In a second instance, the brightness of some instantiated pixel units in the blurred area 120 is determined to obtain a weighted result of the pixel units in the blurred area 120 [124(75), 125(25), 126(25), 127(75)]. And in the third example, the brightness of some instantiated pixel units in the blurred area 120 is determined to obtain a weighted result of the pixel units in the blurred area 120 [124(18.75), 125(18.75), 126(18.75) , 127 (43.75)].

像素單元群的加權結果,是與模糊化區域120中的每個像素單元所對應的每個加權結果的集合。例如,第一實例中的集合是[124(93.75),125(93.75),126(93.75),127(18.75)],第二實例中的集合為[124(75),125(25),126(25),127(75)],第三實例中的集合為[124(18.75),125(18.75),126(18.75),127(43.75)]。位於模糊化區域120中具有亮度上的加權結果的每個像素單元,則變為與不同區域中的相關像素單元所對應的調整過的像素單元。例如,在第一實例中[114(100)-124(93.75)-134(75)]與第一感測器子像素(顯示下鏡頭)114以及與正常的第一顯示子像素134一起,形成調整過的第一模糊化子像素124。在第二實例中,[115(0)-125(25)-135(50)]與第一感測器子像素(顯示下鏡頭)115以及與正常的第一顯示子像素135一起,形成調整過的第一模糊化子像素125。在第三實例中,[117(100)-127(43.75)-137(25)]與第一感測器子像素(顯示下鏡頭)117以及與正常的第一顯示子像素137一起,形成調整過的第一模糊化子像素127。經改善了亮度梯度的結果,分別表示在第一實例、第二實例、或第三實例中。The weighted result of the pixel unit group is a set of each weighted result corresponding to each pixel unit in the blurred area 120 . For example, the set in the first instance is [124(93.75), 125(93.75), 126(93.75), 127(18.75)] and the set in the second instance is [124(75), 125(25), 126 (25), 127(75)], the set in the third instance is [124(18.75), 125(18.75), 126(18.75), 127(43.75)]. Each pixel unit located in the blurred area 120 with a weighted result on brightness becomes an adjusted pixel unit corresponding to the related pixel unit in a different area. For example, in the first instance [114(100)-124(93.75)-134(75)] together with the first sensor sub-pixel (display lower lens) 114 and with the normal first display sub-pixel 134, form Adjusted first blurred sub-pixel 124 . In the second example, [115(0)-125(25)-135(50)] together with the first sensor subpixel (display lower lens) 115 and with the normal first display subpixel 135, form the adjusted The passed first blurred sub-pixel 125. In the third example, [117(100)-127(43.75)-137(25)] together with the first sensor subpixel (display lower lens) 117 and with the normal first display subpixel 137, form the adjusted The passed first blurred sub-pixel 127. The results of the improved brightness gradient are shown in the first example, the second example, or the third example, respectively.

在經過前述步驟之後,如圖2所示,再執行步驟601以輸出複數個調整過的像素單元。輸出在顯示面板101上、經過前述的步驟之後獲得的每個與各個RGB的子像素(稱為R / G / B資訊)。R / G / B的資訊,就亮度方面而言,可以包括不同的資訊類型,但與其各別的顏色資訊無關。例如,在感測器區域110中的R / G / B資訊可能涉及原始的顯示下鏡頭的結果,例如最大像素亮度值SV或是最小像素亮度值0。在顯示區域130中的R / G / B資訊,可以涉及一種一般性的結果,例如根據DV = [n /(n+m)] ×(最大像素亮度值SV)所得到的平均顯示像素亮度值DV。而在模糊化區域120中的R / G / B資訊,可以涉及多個梯度結果的集合,例如根據BV =(1-Z)× SV + Z × DV所得到的模糊化像素亮度值BV的集合。Z是對應於所給定的某個模糊化像素單元的位置的變數。After the aforementioned steps, as shown in FIG. 2 , step 601 is executed to output a plurality of adjusted pixel units. Each and each RGB sub-pixel (referred to as R/G/B information) obtained after the aforementioned steps on the display panel 101 is output. The R/G/B information can include different information types in terms of brightness, but not its respective color information. For example, the R/G/B information in the sensor area 110 may relate to the raw display results of the lower shot, such as the maximum pixel intensity value SV or the minimum pixel intensity value 0. The R/G/B information in the display area 130 can refer to a general result, such as the average display pixel brightness value obtained according to DV = [n/(n+m)] × (maximum pixel brightness value SV) DV. The R/G/B information in the blurred area 120 may involve a set of multiple gradient results, for example, a set of blurred pixel brightness values BV obtained according to BV = (1-Z) × SV + Z × DV . Z is a variable corresponding to the location of a given blurred pixel unit.

特別地,模糊化像素亮度值BV是一種根據Z的加權結果,並且收集了對應於模糊化區域120中的每個像素單元的每個加權結果,因此,所有加權後的結果成為在模糊化區域120中、與所有像素單元有關的亮度資訊的集合,而用於輸出用於顯示目的的複數個調整後的像素單元。In particular, the blurred pixel brightness value BV is a weighted result according to Z, and each weighted result corresponding to each pixel unit in the blurred area 120 is collected, so all weighted results become in the blurred area 120 In 120, the set of luminance information associated with all pixel units is used to output a plurality of adjusted pixel units for display purposes.

在經過前述調整方法之後,又提供了一種新穎的顯示裝置100,以在顯示下鏡頭區域存在的情況下,優化顯示下鏡頭裝置的視覺呈現品質,例如能最小化顯示下鏡頭區域的視覺存在感。圖3繪示根據本發明的實例的顯示下鏡頭裝置的上視圖。圖4繪示根據圖3的顯示下鏡頭裝置沿著一條直線的局部放大圖。本發明的顯示裝置100包括顯示面板101、影像感測器112、感測器像素組113、顯示像素組123、和模糊化像素組133。After the above-mentioned adjustment method, a novel display device 100 is provided to optimize the visual presentation quality of the lower lens device under the condition that the lower lens area is displayed, for example, it can minimize the visual presence of the lower lens area. . FIG. 3 is a top view showing a lower lens device according to an example of the present invention. FIG. 4 is a partially enlarged view showing the lower lens device along a straight line according to FIG. 3 . The display device 100 of the present invention includes a display panel 101 , an image sensor 112 , a sensor pixel group 113 , a display pixel group 123 , and a blurring pixel group 133 .

顯示裝置100可以是一種攝影鏡頭設置於顯示面板下方的裝置。顯示下鏡頭裝置可以包括用於顯示圖片或影像(例如影像103)的顯示面板101。顯示下鏡頭裝置可以進一步包括其他合適的元件,例如輸入單元(未示出)、輸出單元(未示出)、或是控制單元(未示出),但是本發明不限於此。The display device 100 may be a device in which a photographic lens is disposed under a display panel. The display lower lens device may include a display panel 101 for displaying pictures or images (eg image 103 ). The lower display lens device may further include other suitable elements, such as an input unit (not shown), an output unit (not shown), or a control unit (not shown), but the present invention is not limited thereto.

顯示面板101可以包括複數個功能區域,例如感測器區域110、模糊化區域120、和顯示區域130,但是本發明不限於此。在本發明的一些實施方式中,感測器區域110可以被模糊化區域120所包圍、並且模糊化區域120可以被顯示區域130所包圍。在本發明的一些實施方式中,模糊化區域120可以是空心圓120H的形式。空心圓120H可以包括內部同心圓121和外部同心圓122。內部同心圓121可以具有內部同心圓121的圓心111,因此圓心111也可以是外部同心圓122的圓心。The display panel 101 may include a plurality of functional areas, such as a sensor area 110, a blurring area 120, and a display area 130, but the present invention is not limited thereto. In some embodiments of the invention, the sensor area 110 may be surrounded by a blurred area 120 and the blurred area 120 may be surrounded by a display area 130 . In some embodiments of the invention, the blurred region 120 may be in the form of a hollow circle 120H. The hollow circle 120H may include an inner concentric circle 121 and an outer concentric circle 122 . The inner concentric circle 121 may have the center 111 of the inner concentric circle 121 , so the center 111 may also be the center of the outer concentric circle 122 .

顯示面板101可以包括設置在感測器區域110中的影像感測器112,並且被影像感測器112的一部分所佔據的一個像素單元可以成為針孔(點),以允許入射光穿過後到達影像感測器112而形成影像。影像感測器112可以至少部分地設置在感測器區域110中,或完全地設置在感測器區域110中。影像感測器112可以形成複數個點,並且可以用作為顯示下鏡頭裝置100的感測器區域110中的攝影鏡頭之用。由於一個或多個針孔的存在,因此感測器區域110中的一個或多個感測器像素單元,會變成一個或多個無效的感測器像素單元,例如是一個或多個針孔,因為這些無效感測器像素單元不能夠發光。圖1繪示對應於感測器區域110的、以視覺點狀區域的形式所呈現、而對應於無效感測器像素單元的針孔。The display panel 101 may include an image sensor 112 disposed in the sensor area 110, and one pixel unit occupied by a part of the image sensor 112 may become a pinhole (dot) to allow incident light to pass through and reach The image sensor 112 forms an image. The image sensor 112 may be at least partially disposed in the sensor area 110 , or completely disposed in the sensor area 110 . The image sensor 112 can form a plurality of dots, and can be used to display a photographic lens in the sensor area 110 of the lower lens device 100 . Due to the existence of one or more pinholes, one or more sensor pixel units in the sensor region 110 will become one or more invalid sensor pixel units, such as one or more pinholes , because these invalid sensor pixel cells cannot emit light. FIG. 1 illustrates pinholes corresponding to sensor area 110 in the form of visual point-like regions corresponding to inactive sensor pixel units.

顯示裝置100中有複數個像素或子像素。顯示裝置100的不同區域中的不同像素或不同子像素形成不同的像素組。在本發明的一些實施方式中,感測器像素組113可以設置在感測器區域110中並且鄰近模糊化區域120。換句話說,感測器像素組113可以設置在內部同心圓121處,即,鄰近感測器區域110和模糊化區域120之間的邊界線。感測器像素組113可以包括一個或多個感測器像素單元。There are a plurality of pixels or sub-pixels in the display device 100 . Different pixels or different sub-pixels in different regions of the display device 100 form different pixel groups. In some embodiments of the invention, sensor pixel group 113 may be disposed in sensor area 110 and adjacent blurring area 120 . In other words, the sensor pixel group 113 may be disposed at the inner concentric circle 121 , ie, adjacent to the boundary line between the sensor area 110 and the blurring area 120 . The sensor pixel group 113 may include one or more sensor pixel units.

因此,包括影像感測器112的感測器區域110可能在視覺上展現出一些有效感測器像素和一些無效感測器像素。有效感測器像素可以是指,能夠發射任何合適顏色的光的感測器像素單元。無效的感測器像素可以是指,根本不會發光的感測器像素單元。例如,無效的感測器像素可以是指,被針孔所佔據的像素單元,並且由感測器區域110中的影像感測器112所表示的針孔,會使得感測器像素單元原本的功能無效。感測器區域110中的無效感測器像素的集合,可能會不利地改變了一個給定影像在視覺上預定的呈現感,如圖1所示。Therefore, the sensor area 110 including the image sensor 112 may visually exhibit some valid sensor pixels and some invalid sensor pixels. An active sensor pixel may refer to a sensor pixel unit capable of emitting light of any suitable color. A dead sensor pixel may refer to a sensor pixel cell that does not emit light at all. For example, an invalid sensor pixel may refer to a pixel cell that is occupied by a pinhole, and the pinhole, represented by image sensor 112 in sensor area 110, would render the sensor pixel cell otherwise Function is invalid. The collection of ineffective sensor pixels in the sensor area 110 may adversely alter the visually intended appearance of a given image, as shown in FIG. 1 .

一個感測器像素組113可以包括一個或多個感測器像素單元,以形成一個單元單位。在本發明的一個實施例中,一個感測器區域110中的有效感測器像素和無效感測器像素,可以共同形成圖案,或者可以規則地排列。包括有效感測器像素和無效感測器像素、以表示圖案或排列上的最小重複單元的一個單元單位,由一個感測器像素組113所代表。例如,感測器像素組113可以包括n個有效感測器像素和m個無效感測器像素,其中n為不小於1的整數,m為不小於1的整數。在本發明的另一個實施例中,圖4繪示感測器像素組113可以包括四個感測器子像素,所以n+m = 4,但是本發明不限於此。例如,無論這四個感測器子像素的顏色為何,感測器像素組113可以包括感測器子像素114、感測器子像素115、感測器子像素116、和感測器子像素117。One sensor pixel group 113 may include one or more sensor pixel units to form a unit unit. In one embodiment of the present invention, the valid sensor pixels and the invalid sensor pixels in one sensor area 110 may jointly form a pattern, or may be regularly arranged. One unit unit including valid sensor pixels and invalid sensor pixels to represent the minimum repeating unit on a pattern or arrangement is represented by one sensor pixel group 113 . For example, the sensor pixel group 113 may include n valid sensor pixels and m invalid sensor pixels, where n is an integer not less than 1 and m is an integer not less than 1. In another embodiment of the present invention, FIG. 4 shows that the sensor pixel group 113 may include four sensor sub-pixels, so n+m=4, but the present invention is not limited thereto. For example, regardless of the color of the four sensor subpixels, sensor pixel group 113 may include sensor subpixel 114, sensor subpixel 115, sensor subpixel 116, and sensor subpixel 117.

感測器像素組113中的有效感測器像素,可以具有最大感測器像素亮度值SV。感測器像素組113中的無效的感測器像素,可以具有最小的感測器像素亮度值0。最大像素亮度值可表示等於強度100%的最大灰階255。最小像素亮度值可以指的是等於強度0%的最小灰階0。灰階或強度的概念,在本領域中是眾所周知的,因此不再詳述其細節。換句話說,一個感測器像素單元的亮度值可以是SV或是0,所以SV可以等於亮度值100。An active sensor pixel in sensor pixel group 113 may have a maximum sensor pixel luminance value SV. Inactive sensor pixels in sensor pixel group 113 may have a minimum sensor pixel brightness value of zero. A maximum pixel brightness value may represent a maximum gray scale of 255 equal to an intensity of 100%. The minimum pixel brightness value may refer to a minimum gray scale of 0 equal to an intensity of 0%. The concept of gray scale or intensity is well known in the art, so its details will not be described in detail. In other words, the brightness value of a sensor pixel unit can be SV or 0, so SV can be equal to the brightness value of 100.

在本發明的一些實施方式中,顯示像素組133可以設置在顯示區域130中,並且鄰近模糊化區域120。換句話說,顯示像素組133可以設置在外部同心圓122處,即,鄰近顯示區域130和模糊化區域120之間的邊界線。顯示像素組133可以包括一個或多個顯示像素單元。圖3繪示每個顯示像素組133可以包括複數個顯示子像素,但是本發明不限於此。In some embodiments of the present invention, the display pixel group 133 may be disposed in the display area 130 and adjacent to the blurring area 120 . In other words, the display pixel group 133 may be disposed at the outer concentric circle 122 , ie, adjacent to the boundary line between the display area 130 and the blurring area 120 . The display pixel group 133 may include one or more display pixel units. FIG. 3 shows that each display pixel group 133 may include a plurality of display sub-pixels, but the invention is not limited thereto.

類似地,一個顯示像素組133可以包括一個或多個顯示像素單元,以形成一個單元單位。一個單元單位中的顯示像素單元的數量,與另一個單元單位中的感測器像素組單元的數量相同。例如,圖4繪示顯示像素組133可以包括四個顯示子像素,以與感測器像素組113中的四個感測器子像素相對應,而與感測器子像素的顏色無關。例如,顯示像素組133可以包括顯示子像素134、顯示子像素135、顯示子像素136、和顯示子像素137,但是本發明不限於此。Similarly, one display pixel group 133 may include one or more display pixel units to form a unit unit. The number of display pixel units in one unit unit is the same as the number of sensor pixel group units in another unit unit. For example, FIG. 4 shows that the display pixel set 133 may include four display sub-pixels to correspond to the four sensor sub-pixels in the sensor pixel set 113 , regardless of the color of the sensor sub-pixels. For example, the display pixel group 133 may include the display sub-pixel 134, the display sub-pixel 135, the display sub-pixel 136, and the display sub-pixel 137, but the present invention is not limited thereto.

如果感測器像素組113包括n個有效感測器像素和m個無效感測器像素時,則可以決定顯示像素單元的顯示像素亮度值DV,而滿足以下的關係:DV = [n /(n+m)] ×(最大像素亮度值SV)。在顯示區域130中滿足前述關係的顯示像素亮度值DV,可以確保相對於感測器區域110,在視覺上的亮度一致性。因此,顯示像素亮度值DV可以代表一種常態的結果,或是一種常規化結果。If the sensor pixel group 113 includes n effective sensor pixels and m ineffective sensor pixels, the display pixel brightness value DV of the display pixel unit can be determined, and the following relationship is satisfied: DV=[n/( n+m)] × (maximum pixel brightness value SV). The display pixel luminance value DV satisfying the aforementioned relationship in the display area 130 can ensure visual consistency of luminance with respect to the sensor area 110 . Therefore, the display pixel luminance value DV may represent a normal result, or a normalized result.

在本發明的一些實施方式中,模糊化像素組123可以設置在模糊化區域120中。換句話說,模糊化像素組123可以設置在內部同心圓121和外部同心圓122之間,即,在感測器區域110和顯示區域130之間。一個模糊化像素組123可以包括一個或多個模糊化像素單元。圖3繪示每個模糊化像素組123可以包括複數個模糊化子像素,但是本發明不限於此。In some embodiments of the present invention, the blurring pixel group 123 may be disposed in the blurring area 120 . In other words, the blurring pixel group 123 may be disposed between the inner concentric circle 121 and the outer concentric circle 122 , ie, between the sensor area 110 and the display area 130 . A blurred pixel group 123 may include one or more blurred pixel units. FIG. 3 shows that each blurred pixel group 123 may include a plurality of blurred sub-pixels, but the invention is not limited thereto.

類似地,一個模糊化像素組123可以包括一個或多個模糊化像素單元,以形成一個單元單位。一個單元單位中的模糊化像素單元的數量,與另一個單元單位中的感測器像素單元的數量相同。例如,圖4繪示模糊化像素組123可以包括四個模糊化子像素,以與感測器像素組113中的四個感測器子像素相對應,但又與感測器子像素的顏色無關。例如,一個模糊化像素組123可以包括模糊化子像素124、模糊化子像素125、模糊化子像素126、和模糊化子像素127,但是本發明不限於此。Similarly, one blurred pixel group 123 may include one or more blurred pixel units to form a unit unit. The number of blurred pixel units in one unit unit is the same as the number of sensor pixel units in the other unit unit. For example, FIG. 4 shows that the blurred pixel group 123 may include four blurred sub-pixels to correspond to the four sensor sub-pixels in the sensor pixel group 113, but with the color of the sensor sub-pixels irrelevant. For example, one blurring pixel group 123 may include blurring sub-pixels 124, 125, 126, and 127, but the present invention is not limited thereto.

在本發明的一些實施方式中,可以有一條直線102穿過感測器像素組113、模糊化像素組123、和顯示像素組133。在本發明的一些實施方式中,直線102可以進一步通過內部同心圓121的圓心111、感測器像素組113、模糊化像素組123、和顯示像素組133。圖3繪示沿著直線102,一個像素組133和一個感測器像素組113之間的最小距離是1、一個模糊化像素組123和一個感測器像素組113之間的最小距離是Z而用作為權值、並且一個模糊化像素組123和一個顯示像素組133之間的最小距離是為(1-Z),但是本發明不限於此。當實施本發明的方法時,顯示像素組133和感測器像素組113之間實際的最小距離是視實施當時情況所得到的,並且可由本領域的一般技藝人士所決定,只要此最小距離足以用於實作本發明即可。In some embodiments of the invention, there may be a line 102 passing through the sensor pixel set 113 , the blur pixel set 123 , and the display pixel set 133 . In some embodiments of the present invention, the straight line 102 may further pass through the center 111 of the inner concentric circle 121 , the sensor pixel group 113 , the blurring pixel group 123 , and the display pixel group 133 . 3 shows that along the line 102, the minimum distance between a pixel group 133 and a sensor pixel group 113 is 1, and the minimum distance between a blur pixel group 123 and a sensor pixel group 113 is Z And the minimum distance used as the weight and between one blurring pixel group 123 and one display pixel group 133 is (1-Z), but the present invention is not limited thereto. When implementing the method of the present invention, the actual minimum distance between the display pixel group 133 and the sensor pixel group 113 is obtained depending on the situation at the time of implementation, and can be determined by those of ordinary skill in the art, as long as the minimum distance is sufficient It can be used for implementing the present invention.

根據顯示像素亮度值DV和感測器像素亮度值SV,例如關於模糊化區域120中的每個模糊化像素單元的亮度的照明,可以具有特定的模糊化像素亮度值BV。模糊化像素亮度值BV可以表示模糊化像素組123中的模糊化像素的伽馬級,但是本發明不限於此。例如,模糊化像素亮度值BV不大於最大感測器像素亮度值SV,又不小於對應的顯示像素亮度值DV,以滿足依據Z、SV、和DV的線性加權關係:BV =(1-Z)× SV + Z ×DV,但是本發明不限於此。Depending on the display pixel luminance value DV and the sensor pixel luminance value SV, for example the illumination with respect to the luminance of each blurred pixel unit in the blurred region 120 may have a specific blurred pixel luminance value BV. The blurred pixel brightness value BV may represent the gamma level of the blurred pixel in the blurred pixel group 123, but the present invention is not limited thereto. For example, the blurred pixel brightness value BV is not greater than the maximum sensor pixel brightness value SV, and is not smaller than the corresponding display pixel brightness value DV, so as to satisfy the linear weighting relationship according to Z, SV, and DV: BV = (1-Z ) × SV + Z × DV, but the present invention is not limited thereto.

於是,可以沿著從感測器像素組113到顯示像素組133的直線102,形成像素單位的亮度梯度,使得由於感測器區域110中的無效顯示像素所造成給定影像的不良視覺呈現感,可以逐漸地經由模糊化區域120而減弱,並收斂至顯示區域130。換句話說,像素單元的亮度梯度可以用於使得如圖1所示的顯示下鏡頭區域10的明顯邊界線11看起來變得模糊,以致於原始的邊界線11可能在視覺上變得較不明顯,或是更加變成實質上不可見。Thus, along the straight line 102 from the sensor pixel group 113 to the display pixel group 133, a pixel-by-pixel brightness gradient can be formed such that a given image has poor visual presentation due to ineffective display pixels in the sensor area 110. , can gradually weaken through the blurring region 120 and converge to the display region 130 . In other words, the brightness gradient of the pixel unit can be used to make the obvious boundary line 11 showing the lower lens area 10 as shown in FIG. 1 look blurred, so that the original boundary line 11 may become less visible become apparent, or become more substantially invisible.

形成一個單元單位的一個模糊化像素組123是設置在模糊化區域120中,並且位於感測器像素組113和顯示像素組133之間。一個模糊化像素組123中的每個像素單元具有單獨的模糊化像素亮度值BV。計算各個模糊化像素亮度值BV以跟所對應的感測器像素亮度值SV對準。一個單元單位可以包括n+m個子像素,而不論此子像素的顏色為何,並且可以安排n+m個子像素形成圖案,或者按照,例如位點,來有序地排列。One blurred pixel group 123 forming a unit unit is disposed in the blurred area 120 and is located between the sensor pixel group 113 and the display pixel group 133 . Each pixel unit in a blurred pixel group 123 has an individual blurred pixel brightness value BV. Each blurred pixel luminance value BV is calculated to align with the corresponding sensor pixel luminance value SV. One unit unit may include n+m sub-pixels regardless of the color of the sub-pixels, and the n+m sub-pixels may be arranged to form a pattern, or be arranged in order, for example, according to positions.

例如,感測器像素組113中的一個單元單位,可以包括n個有效感測器像素和m個無效感測器像素,其中n是不小於1的整數,並且m是不小於1的整數,因此,一個單元單位也可以相應地包括位於模糊化像素組123中的n+m個模糊化像素,並且可以相應地在顯示區域130中包括n+m個顯示像素。一個單元單位中的一些模糊化像素,可以排他地對應於特定的感測器像素和特定的顯示像素。例如,一個單元單位中的第一位點的模糊化像素可以沿著直線102對應於另一單元單位中的第一位點的感測器像素並且對應於另一單元單位中的第一位點的顯示像素,以及一個單元單位中的第二位點的模糊化像素可以沿著直線102對應於另一單元單位中的第二位點的感測器像素,並且對應於另一單元單位中的第二位點的顯示像素,並可以此類推。For example, one unit unit in the sensor pixel group 113 may include n valid sensor pixels and m invalid sensor pixels, where n is an integer not less than 1, and m is an integer not less than 1, Therefore, a unit unit may also correspondingly include n+m blurred pixels located in the blurred pixel group 123 , and may correspondingly include n+m display pixels in the display area 130 . Some blurred pixels in a cell unit may correspond exclusively to specific sensor pixels and specific display pixels. For example, a blurred pixel of a first location in one cell unit may correspond to a sensor pixel of a first location in another cell unit along line 102 and correspond to a first location in another cell unit , and the blurred pixel at the second location in one unit unit may correspond to the sensor pixel at the second location in the other unit unit along the line 102, and correspond to the sensor pixel at the second location in the other unit unit The display pixel of the second position, and so on.

在步驟601之後,於是可以獲得經改善的,或進一步優化過視覺呈現品質的調整過的影像103。圖8繪示根據圖1在經過本發明的方法之後,降低了輪廓問題的具有經更新過R / G / B資訊的影像103的實例。如圖8所示,與圖1相比,顯示出較佳的視覺呈現品質的影像103可以最小化黑點的視覺效果。例如,在顯示下鏡頭區域存在的情況下,於顯示面板101上執行本發明的方法之後,可以減輕了圖8中的影像103發生在位於例如顯示下鏡頭區域的感測器區域(基本上不可見)與例如一般區域的顯示區域130之間的邊界線(基本上不可見)上的輪廓問題。 以上所述僅為本發明之較佳實施例,凡依本發明申請專利範圍所做之均等變化與修飾,皆應屬本發明之涵蓋範圍。 After step 601 , the adjusted image 103 with improved or further optimized visual presentation quality can then be obtained. FIG. 8 shows an example of an image 103 with updated R/G/B information according to FIG. 1 after undergoing the method of the present invention with reduced contouring problems. As shown in FIG. 8 , compared to FIG. 1 , the image 103 exhibits a better visual presentation quality that minimizes the visual effect of black dots. For example, in the case where the display lower lens area exists, after the method of the present invention is executed on the display panel 101, the image 103 in FIG. See) the outline problem on the boundary line (substantially invisible) between the display area 130 such as the general area. The above descriptions are only preferred embodiments of the present invention, and all equivalent changes and modifications made according to the scope of the patent application of the present invention shall fall within the scope of the present invention.

1:面板 10:顯示下鏡頭區域 11:邊界線 20:正常區域 100:顯示下鏡頭裝置/顯示裝置 101:顯示面板 102:直線 103:影像 110:感測器區域 111:圓心 112:影像感測器 113:感測器像素組/單元單位 114:感測器子像素 115:感測器子像素 116:感測器子像素 117:感測器子像素 120:模糊化區域 120H:空心圓 121:內部同心圓 122:外部同心圓 123:模糊化像素組/單元單位 124:模糊化子像素 125:模糊化子像素 126:模糊化子像素 127:模糊化子像素 130:顯示區域 133:顯示像素組/單元單位 134:顯示子像素 135:顯示子像素 136:顯示子像素 137:顯示子像素 101:步驟 201:步驟 301:步驟 401:步驟 501:步驟 601:步驟 BV:模糊化像素的亮度值 DV:顯示像素亮度值 SV:感測器像素亮度值 Z:權值 1: panel 10: Display the lower lens area 11: Borderline 20: normal area 100: display lower lens device/display device 101: Display panel 102: straight line 103: Image 110: sensor area 111: center of circle 112: Image sensor 113: Sensor pixel group/unit 114:Sensor sub-pixel 115:Sensor sub-pixel 116:Sensor sub-pixel 117:Sensor sub-pixel 120:Blurred area 120H: hollow circle 121: inner concentric circle 122: Outer concentric circle 123: Fuzzy pixel group/unit 124:Blurred sub-pixels 125:Blurred sub-pixels 126:Blurred sub-pixels 127:Blurred sub-pixels 130: display area 133: display pixel group/unit 134: Display sub-pixel 135: Display sub-pixel 136: Display sub-pixel 137: Display sub-pixel 101: Steps 201: Step 301: Step 401: step 501: step 601: Step BV: the brightness value of the blurred pixel DV: display pixel brightness value SV: sensor pixel brightness value Z: weight

圖1繪示出在顯示下鏡頭區域和正常區域的邊界線上發生的輪廓問題的示例,來表示在顯示下鏡頭區域和正常區域之間會表現出強烈的視覺差異,從而在顯示下鏡頭區域存在的情況下危及了面板的視覺顯示品質。 圖2是本發明的模糊化顯示下鏡頭裝置中的邊界線的方法的流程圖的示例。 圖3繪示根據本發明的一實例的顯示下鏡頭裝置的上視圖。 圖4繪示根據本發明圖3的顯示下鏡頭裝置沿一直線的局部放大圖。 圖5繪示根據本發明的第一實例的計算結果。 圖6繪示根據本發明的第二實例的計算結果。 圖7繪示根據本發明的第三實例的計算結果。 圖8繪示對應於圖1的影像在經過本發明的操作之後的影像,具有減輕了發生在位於感測器區域(顯示下鏡頭區域)與顯示區域(一般區域)之間的邊界線上的輪廓問題的實例,從而在顯示下鏡頭區域存在的情況下來改善顯示面板的視覺呈現品質。 Figure 1 depicts an example of the contour problem that occurs on the boundary line between the under-display area and the normal area, to show that there will be a strong visual difference between the under-display area and the normal area, so that there are In some cases, the visual display quality of the panel is compromised. FIG. 2 is an example of the flow chart of the method for blurring and displaying the boundary line in the lower lens device of the present invention. FIG. 3 is a top view showing a lower lens device according to an example of the present invention. FIG. 4 is a partially enlarged view showing the lower lens device along a straight line in FIG. 3 according to the present invention. FIG. 5 shows calculation results according to the first example of the present invention. FIG. 6 shows calculation results according to the second example of the present invention. FIG. 7 shows calculation results according to the third example of the present invention. FIG. 8 shows the image corresponding to the image of FIG. 1 after the operation of the present invention, with the contours that occur on the boundary line between the sensor area (display lower lens area) and the display area (general area) reduced. An example of the problem to improve the visual presentation quality of a display panel in the presence of a display lower lens area.

101:步驟 101: Steps

201:步驟 201: Step

301:步驟 301: Step

401:步驟 401: step

501:步驟 501: step

601:步驟 601: Step

BV:模糊化像素的亮度值 BV: the brightness value of the blurred pixel

DV:顯示像素亮度值 DV: display pixel brightness value

Claims (20)

一種顯示裝置,包括: 一顯示面板,包括一顯示區域、被該顯示區域所包圍的一模糊化區域、和被該模糊化區域所包圍的一感測器區域; 一影像感測器,設置在該感測器區域中; 一感測器像素組,設置在該感測器區域中、鄰近該模糊化區域、並具有一最大感測器像素亮度值SV; 一顯示像素組,設置在該顯示區域中、鄰近該模糊化區域、並具有一顯示像素亮度值DV;以及 一模糊化像素組、設置在該模糊化區域中、位於該感測器像素組與該顯示像素組之間、並具有一模糊化像素亮度值BV; 其中,該顯示像素組與該感測器像素組之間的一最小距離為1、該模糊化像素組與該感測器像素組之間的一最小距離為Z、該模糊化像素組與該顯示像素組之間的一最小距離為(1-Z),使得BV =(1-Z)× SV + Z × DV。 A display device comprising: A display panel, including a display area, a blurring area surrounded by the display area, and a sensor area surrounded by the blurring area; an image sensor, arranged in the sensor area; a sensor pixel group disposed in the sensor area adjacent to the blurred area and having a maximum sensor pixel brightness value SV; a display pixel group, disposed in the display area, adjacent to the blurred area, and has a display pixel brightness value DV; and a blurred pixel group, disposed in the blurred area, between the sensor pixel group and the display pixel group, and has a blurred pixel brightness value BV; Wherein, a minimum distance between the display pixel group and the sensor pixel group is 1, a minimum distance between the blurred pixel group and the sensor pixel group is Z, and the blurred pixel group and the A minimum distance between groups of display pixels is (1-Z), such that BV = (1-Z) × SV + Z × DV. 依據請求項1的顯示裝置,其中,該感測器像素組包括n個有效感測器像素和m個無效感測器像素,而該顯示像素組包括n+m個有效顯示像素並且沒有無效顯示像素。The display device according to claim 1, wherein the sensor pixel group includes n valid sensor pixels and m invalid sensor pixels, and the display pixel group includes n+m valid display pixels and no invalid display pixels pixels. 依據請求項2的顯示裝置,其中,每個該有效顯示像素具有該顯示像素亮度值DV,使得DV = [n /(n+m)] ×(最大感測器像素亮度值SV)。The display device according to claim 2, wherein each of the effective display pixels has the display pixel brightness value DV such that DV = [n/(n+m)]×(maximum sensor pixel brightness value SV). 依據請求項1的顯示裝置,其中,該模糊化區域為一空心圓的形式,並且包括一內部同心圓和一外部同心圓,並且該內部同心圓具有該內部同心圓的一圓心。The display device according to claim 1, wherein the blurred area is in the form of a hollow circle and includes an inner concentric circle and an outer concentric circle, and the inner concentric circle has a center of the inner concentric circle. 依據請求項4的顯示裝置,其中,一條直線穿過該內部同心圓、該感測器像素組、該模糊化像素組、和該顯示像素組的該圓心。The display device according to claim 4, wherein a straight line passes through the center of the inner concentric circle, the sensor pixel group, the blurring pixel group, and the display pixel group. 依據請求項2該的顯示裝置,更包括: 至少一個針孔,設置在該感測器區域中。 The display device according to claim 2 further includes: At least one pinhole is disposed in the sensor area. 依據請求項6的顯示裝置,其中,該至少一個針孔代表該m個無效感測器像素。The display device according to claim 6, wherein the at least one pinhole represents the m invalid sensor pixels. 依據請求項1的顯示裝置,其中,該模糊化像素亮度值BV表示該模糊化像素組中的一模糊化像素的一伽馬級。The display device according to claim 1, wherein the blurred pixel brightness value BV represents a gamma level of a blurred pixel in the blurred pixel group. 一種模糊顯示下鏡頭裝置中的邊界線的方法,包括: 提供一種顯示下鏡頭裝置,包括: 一顯示區域、被該顯示區域所包圍的一模糊化區域、和被該模糊化區域所包圍的一感測器區域; 一感測器像素組,設置在該感測器區域中、鄰近該模糊化區域、並具有一最大感測器像素亮度值SV,其中,該感測器像素組包括n個有效感測器像素和m個無效感測器像素; 一顯示像素組,設置在該顯示區域中、鄰近該模糊化區域、並具有一顯示像素亮度值DV,其中,該顯示像素組包括n+m個有效顯示像素並且沒有無效顯示像素;以及 一模糊化像素組、設置在該模糊化區域中、位於該感測器像素組與該顯示像素組之間、並具有一模糊化像素亮度值BV; 根據DV = [n /(n+m)] ×(該最大像素亮度值SV)來決定該顯示像素亮度值DV;以及 在決定該顯示像素亮度值DV後,根據BV =(1-Z)× SV + Z × DV,來決定該模糊化像素亮度值BV,其中,該顯示像素組與該感測器像素組之間的一最小距離為1、該模糊化像素組與該感測器像素組之間的一最小距離為Z、以及該模糊化像素組與該顯示像素組之間的一最小距離為(1-Z)。 A method of blurring a boundary line in a lower camera setup, comprising: A display lens device is provided, comprising: a display area, a blurring area surrounded by the display area, and a sensor area surrounded by the blurring area; a sensor pixel group disposed in the sensor area adjacent to the blurred area and having a maximum sensor pixel brightness value SV, wherein the sensor pixel group includes n effective sensor pixels and m invalid sensor pixels; A display pixel group, disposed in the display area, adjacent to the blurred area, and has a display pixel brightness value DV, wherein the display pixel group includes n+m effective display pixels and no invalid display pixels; and a blurred pixel group, disposed in the blurred area, between the sensor pixel group and the display pixel group, and has a blurred pixel brightness value BV; Determine the display pixel brightness value DV according to DV = [n / (n+m)] × (the maximum pixel brightness value SV); and After determining the display pixel brightness value DV, the blurred pixel brightness value BV is determined according to BV = (1-Z) × SV + Z × DV, where the distance between the display pixel group and the sensor pixel group A minimum distance of 1, a minimum distance between the blurred pixel set and the sensor pixel set is Z, and a minimum distance between the blurred pixel set and the display pixel set is (1-Z ). 依據請求項9模糊顯示下鏡頭裝置中的邊界線的方法,其中,該模糊化區域為一空心圓的形式,並且包括一內部同心圓和一外部同心圓,並且該內部同心圓具有該內部同心圓的一圓心。According to claim 9, the method for blurring and displaying the boundary line in the lower lens device, wherein the blurred area is in the form of a hollow circle and includes an inner concentric circle and an outer concentric circle, and the inner concentric circle has the inner concentric circle The center of a circle. 依據請求項10模糊顯示下鏡頭裝置中的邊界線的方法,其中,確定該模糊化像素亮度值BV是要模糊化該內部同心圓的該邊界線。According to claim 10, the method for blurring and displaying a boundary line in a lower lens device, wherein determining the blurred pixel brightness value BV is to blur the boundary line of the inner concentric circle. 依據請求項10模糊顯示下鏡頭裝置中的邊界線的方法,其中,一條直線穿過該內部同心圓的該圓心、該感測器像素組、該模糊化像素組、和該顯示像素組。According to claim 10, the method for blurring and displaying a boundary line in a lower lens device, wherein a straight line passes through the center of the inner concentric circle, the sensor pixel group, the blurred pixel group, and the display pixel group. 依據請求項9模糊顯示下鏡頭裝置中的邊界線的方法,其中,該模糊化像素亮度值BV表示該模糊化像素組中的一模糊化像素的一伽馬級。According to claim 9, the method for blurring a boundary line in a lower lens device, wherein the blurred pixel brightness value BV represents a gamma level of a blurred pixel in the blurred pixel group. 依據請求項9模糊顯示下鏡頭裝置中的邊界線的方法,其中,該感測器像素組包括具有該最大感測器像素亮度值SV的一第一感測器像素,和具有一最小感測器像素亮度值0的一第二感測器像素。According to claim 9, the method for blurring the boundary line in the lower lens device, wherein the sensor pixel group includes a first sensor pixel with the maximum sensor pixel brightness value SV, and has a minimum sensor pixel A second sensor pixel with sensor pixel intensity value 0. 依據請求項14模糊顯示下鏡頭裝置中的邊界線的方法,其中,該模糊化像素組包括具有一第一模糊化像素亮度值BV1的一第一模糊化像素,和具有一第二模糊化像素亮度值BV2的一第二模糊化像素。According to claim 14, the method for blurring and displaying the boundary line in the lower lens device, wherein the blurred pixel group includes a first blurred pixel with a first blurred pixel brightness value BV1, and a second blurred pixel A second blurred pixel of brightness value BV2. 依據請求項15模糊顯示下鏡頭裝置中的邊界線的方法,其中,該第一模糊化像素亮度值BV1不同於該第二模糊化像素亮度值BV2。According to claim 15, the method for blurring the boundary line in the lower lens device, wherein the first blurred pixel brightness value BV1 is different from the second blurred pixel brightness value BV2. 依據請求項16模糊顯示下鏡頭裝置中的邊界線的方法,其中,該第一模糊化像素亮度值BV1和該第二模糊化像素亮度值BV2分別表示一伽馬級。According to claim 16, the method for blurring and displaying a boundary line in a lower lens device, wherein the first blurred pixel brightness value BV1 and the second blurred pixel brightness value BV2 respectively represent a gamma level. 依據請求項15模糊顯示下鏡頭裝置中的邊界線的方法,其中,該第一感測器像素對應於該第一模糊化像素,並且該第二感測器像素對應於該第二模糊化像素。According to claim 15, the method for blurring and displaying a boundary line in a lower lens device, wherein the first sensor pixel corresponds to the first blurred pixel, and the second sensor pixel corresponds to the second blurred pixel . 依據請求項9模糊顯示下鏡頭裝置中的邊界線的方法,其中,該顯示像素組的一總亮度等於該模糊化像素組的一總亮度。According to claim 9, the method for blurring and displaying a boundary line in a lower lens device, wherein a total brightness of the display pixel group is equal to a total brightness of the blurred pixel group. 依據請求項9模糊顯示下鏡頭裝置中的邊界線的方法,其中,該感測器像素組的一總亮度等於該模糊化像素組的一總亮度。According to claim 9, the method for blurring and displaying a boundary line in a lower lens device, wherein a total brightness of the sensor pixel group is equal to a total brightness of the blurred pixel group.
TW110113920A 2021-04-19 2021-04-19 Display device and method to blur borderline in cud device TWI756109B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW110113920A TWI756109B (en) 2021-04-19 2021-04-19 Display device and method to blur borderline in cud device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW110113920A TWI756109B (en) 2021-04-19 2021-04-19 Display device and method to blur borderline in cud device

Publications (2)

Publication Number Publication Date
TWI756109B TWI756109B (en) 2022-02-21
TW202242822A true TW202242822A (en) 2022-11-01

Family

ID=81329307

Family Applications (1)

Application Number Title Priority Date Filing Date
TW110113920A TWI756109B (en) 2021-04-19 2021-04-19 Display device and method to blur borderline in cud device

Country Status (1)

Country Link
TW (1) TWI756109B (en)

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8502762B2 (en) * 2003-03-31 2013-08-06 Sharp Kabushiki Kaisha Image processing method and liquid-crystal display device using the same
US7728909B2 (en) * 2005-06-13 2010-06-01 Seiko Epson Corporation Method and system for estimating motion and compensating for perceived motion blur in digital video
US8345038B2 (en) * 2007-10-30 2013-01-01 Sharp Laboratories Of America, Inc. Methods and systems for backlight modulation and brightness preservation
TWI372377B (en) * 2007-11-21 2012-09-11 Mstar Semiconductor Inc Method and apparatus for eliminating image blur by pixel-based processing

Also Published As

Publication number Publication date
TWI756109B (en) 2022-02-21

Similar Documents

Publication Publication Date Title
CN107068102B (en) A kind of image processing method, image processing apparatus and display device
CN109192174B (en) Driving method and driving device of display panel and display device
CN105719608B (en) Image display method and image display
WO2020024479A1 (en) Bright spot compensation method and device for curved screen
CN110140163B (en) Display panel and control method and control device thereof
US11322103B2 (en) Driving method and driving device of display panel and display device
JPWO2013035635A1 (en) Image display device and image display method
CN109256077B (en) Control method and device of display panel and readable storage medium
KR20170129314A (en) Display device
US20200211163A1 (en) Image compensation method and image processing circuit
WO2011129376A1 (en) Liquid crystal display device and method for displaying fonts on liquid crystal display device
CN106560880A (en) Display Device And Image Rendering Method Thereof
US7142219B2 (en) Display method and display apparatus
US10783844B2 (en) Display device and method for controlling display device
US10777152B2 (en) Driving method and driving device for display panel, and display device
WO2020189768A1 (en) Display device
TW202242822A (en) Display device and method to blur borderline in cud device
CN109616074B (en) Display method and display device
CN109817158B (en) Display panel driving method and device and display device
US9135866B2 (en) Display apparatus and control method thereof
WO2022252555A1 (en) Grayscale compensation method and apparatus for display panel
CN115588409A (en) Sub-pixel rendering method and device and display equipment
CN115240613A (en) Method for boundary line between display device and camera device under fuzzy screen
US11545059B2 (en) Display device and method to blur borderline in CUD device
US10565944B2 (en) Display device