TWI775158B - Display system and image clarity enhancement method thereof - Google Patents

Display system and image clarity enhancement method thereof Download PDF

Info

Publication number
TWI775158B
TWI775158B TW109133284A TW109133284A TWI775158B TW I775158 B TWI775158 B TW I775158B TW 109133284 A TW109133284 A TW 109133284A TW 109133284 A TW109133284 A TW 109133284A TW I775158 B TWI775158 B TW I775158B
Authority
TW
Taiwan
Prior art keywords
processing circuit
image
image stream
display area
momentum
Prior art date
Application number
TW109133284A
Other languages
Chinese (zh)
Other versions
TW202213991A (en
Inventor
林子傑
Original Assignee
宏碁股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 宏碁股份有限公司 filed Critical 宏碁股份有限公司
Priority to TW109133284A priority Critical patent/TWI775158B/en
Publication of TW202213991A publication Critical patent/TW202213991A/en
Application granted granted Critical
Publication of TWI775158B publication Critical patent/TWI775158B/en

Links

Images

Landscapes

  • Image Processing (AREA)
  • Magnetic Resonance Imaging Apparatus (AREA)

Abstract

The disclosure provides a display system and an image clarity enhancement method thereof. The display system includes a remote device and a local device. A first camera of the remote device captures a first field of view to generate a first image stream. A second camera of the local device captures a second field of view to generate a second image stream. A processing circuit of the local device generates a third image stream, so that the display shows a screen including a first display area corresponding to the first image stream and a second display area corresponding to the second image stream. The processing circuit adjusts an image clarity of at least one of the first display area and the second display area based on an exposure information and a motion corresponding to at least one of the first image stream and the second image stream.

Description

顯示系統及其影像清晰度強化方法Display system and image definition enhancement method thereof

本發明是有關於一種顯示技術,且特別是有關於一種顯示系統及其影像清晰度強化方法。The present invention relates to a display technology, and more particularly, to a display system and a method for enhancing image definition thereof.

在現今的各種顯示系統應用上,像是視訊會議或其他娛樂、監控、商業、工程、醫療等等的應用情境,使用者觀看的即時影像可能是當前裝置(例如筆記型電腦、AIO電腦、桌上型電腦、頭戴顯示器、AR眼鏡、智慧型眼鏡等裝置)以及(或是)其他裝置的相機所擷取的影像。然而,此類顯示影像的清晰度會受到來源相機的曝光值(exposure)影響,在低光源下,相機的自動曝光機制通常會使得曝光時間增加而提高曝光量,然而曝光時間的增加容易造成影像模糊。In today's various display system applications, such as video conferencing or other entertainment, surveillance, business, engineering, medical, etc. application scenarios, the real-time image viewed by the user may be the current device (such as notebook computers, AIO computers, desks, etc.). devices such as laptops, head-mounted displays, AR glasses, smart glasses, etc.) and/or other devices’ cameras. However, the clarity of such displayed images is affected by the exposure of the source camera. Under low light sources, the camera's automatic exposure mechanism usually increases the exposure time to increase the exposure. Vague.

此影像模糊的現象,尤其在動態影像中,可能更加嚴重。而且,在部分軟硬體架構下,欲針對局部顯示影像進行調整的技術較受限制或難度較大。分割畫面中的多個顯示區域的內容是不同來源相機所提供的影像串流,因此不同顯示區域的內容具有不同的曝光時間(模糊程度)。當對分割畫面中的某一個顯示區域進行調整時,所述顯示區域外的其他區域也會以相同的強度進行調整。因此,如何考量來源相機的顯示影像在整張顯示影像中的重要性以進行參數設定,進而增進使用者的觀看品質,是個有必要重視的問題。This phenomenon of image blurring, especially in motion pictures, may be more serious. Moreover, under some software and hardware architectures, the technology for adjusting the partially displayed image is limited or difficult. The contents of multiple display areas in the split screen are image streams provided by different source cameras, so the contents of different display areas have different exposure times (blur levels). When a certain display area in the split screen is adjusted, other areas outside the display area will also be adjusted with the same intensity. Therefore, how to consider the importance of the display image of the source camera in the entire display image for parameter setting, thereby improving the viewing quality of the user, is a problem that must be paid attention to.

本發明提供一種顯示系統及其影像清晰度強化方法,以適當地調整顯示器所顯示畫面的影像清晰度。The invention provides a display system and an image definition enhancement method thereof, so as to properly adjust the image definition of the picture displayed by the display.

本發明的實施例提供一種顯示系統,包括遠端裝置以及本地裝置。遠端裝置包括第一相機,用以拍攝第一視野而產生第一影像串流。本地裝置包括第二相機,用以拍攝第二視野而產生第二影像串流。本地裝置還包括一顯示器以及處理電路。處理電路耦接至第二相機與顯示器。處理電路被配置為通過通訊網路獲得來自於遠端裝置的第一影像串流。處理電路使用第一影像串流與第二影像串流去產生第三影像串流給顯示器,以使顯示器所顯示的顯示畫面包含對應於第一影像串流的第一顯示區域以及對應於第二影像串流的第二顯示區域。處理電路依據第一影像串流與第二影像串流至少一者所對應的曝光資訊與動量,去調整第一顯示區域與第二顯示區域至少一者的影像清晰度。Embodiments of the present invention provide a display system including a remote device and a local device. The remote device includes a first camera for photographing the first field of view to generate a first image stream. The local device includes a second camera for capturing the second field of view to generate a second image stream. The local device also includes a display and processing circuitry. The processing circuit is coupled to the second camera and the display. The processing circuit is configured to obtain the first image stream from the remote device through the communication network. The processing circuit uses the first image stream and the second image stream to generate a third image stream to the display, so that the display screen displayed by the display includes a first display area corresponding to the first image stream and a second display area corresponding to the second image stream. The second display area of the video stream. The processing circuit adjusts the image definition of at least one of the first display area and the second display area according to exposure information and momentum corresponding to at least one of the first image stream and the second image stream.

本發明的實施例提供一種顯示系統的影像清晰度強化方法。所述影像清晰度強化方法包括:由遠端裝置的第一相機拍攝第一視野而產生第一影像串流;由本地裝置的第二相機拍攝第二視野而產生第二影像串流;由本地裝置的處理電路通過通訊網路獲得來自於遠端裝置的第一影像串流;由處理電路使用第一影像串流與第二影像串流去產生第三影像串流給本地裝置的顯示器,以使顯示器所顯示的顯示畫面包含對應於第一影像串流的第一顯示區域以及對應於第二影像串流的第二顯示區域;以及由處理電路依據第一影像串流與第二影像串流至少一者所對應的曝光資訊與動量,去調整第一顯示區域與第二顯示區域至少一者的影像清晰度。Embodiments of the present invention provide an image definition enhancement method of a display system. The image definition enhancement method includes: shooting a first field of view with a first camera of a remote device to generate a first image stream; shooting a second field of view with a second camera of a local device to generate a second image stream; The processing circuit of the device obtains the first image stream from the remote device through the communication network; the processing circuit uses the first image stream and the second image stream to generate a third image stream to the display of the local device, so that the The display screen displayed by the display includes a first display area corresponding to the first image stream and a second display area corresponding to the second image stream; and the processing circuit according to the first image stream and the second image stream at least The exposure information and momentum corresponding to one are used to adjust the image definition of at least one of the first display area and the second display area.

基於上述,本發明諸實施例所述的顯示系統及其影像清晰度強化方法可以使用該遠端裝置產生第一影像串流與本地裝置的第二影像串流去產生一第三影像串流給本地裝置的顯示器。此外,根據第一影像串流與第二影像串流至少一者所對應的曝光資訊與動量,本地裝置可以動態地調整第一顯示區域與第二顯示區域至少一者的影像清晰度,藉此可改善因曝光時間較長而造成影像模糊問題,增進觀看品質。Based on the above, the display system and the image definition enhancement method according to the embodiments of the present invention can use the remote device to generate the first image stream and the local device to generate the second image stream to generate a third image stream to the Display of the local device. In addition, according to the exposure information and momentum corresponding to at least one of the first image stream and the second image stream, the local device can dynamically adjust the image definition of at least one of the first display area and the second display area, thereby It can improve the problem of image blur caused by long exposure time and improve the viewing quality.

為讓本發明的上述特徵和優點能更明顯易懂,下文特舉實施例,並配合所附圖式作詳細說明如下。In order to make the above-mentioned features and advantages of the present invention more obvious and easy to understand, the following embodiments are given and described in detail with the accompanying drawings as follows.

在本案說明書全文(包括申請專利範圍)中所使用的「耦接(或連接)」一詞可指任何直接或間接的連接手段。舉例而言,若文中描述第一裝置耦接(或連接)於第二裝置,則應該被解釋成該第一裝置可以直接連接於該第二裝置,或者該第一裝置可以透過其他裝置或某種連接手段而間接地連接至該第二裝置。本案說明書全文(包括申請專利範圍)中提及的「第一」、「第二」等用語是用以命名元件(element)的名稱,或區別不同實施例或範圍,而並非用來限制元件數量的上限或下限,亦非用來限制元件的次序。另外,凡可能之處,在圖式及實施方式中使用相同標號的元件/構件/步驟代表相同或類似部分。不同實施例中使用相同標號或使用相同用語的元件/構件/步驟可以相互參照相關說明。The term "coupled (or connected)" as used throughout this specification (including the scope of the application) may refer to any direct or indirect means of connection. For example, if it is described in the text that a first device is coupled (or connected) to a second device, it should be interpreted that the first device can be directly connected to the second device, or the first device can be connected to the second device through another device or some other device. indirectly connected to the second device by a connecting means. Terms such as "first" and "second" mentioned in the full text of the description (including the scope of the patent application) in this case are used to designate the names of elements or to distinguish different embodiments or scopes, rather than to limit the number of elements The upper or lower limit of , nor is it intended to limit the order of the elements. Also, where possible, elements/components/steps using the same reference numerals in the drawings and embodiments represent the same or similar parts. Elements/components/steps that use the same reference numerals or use the same terminology in different embodiments may refer to relative descriptions of each other.

圖1是依照本發明的一實施例的一種顯示系統10的電路方塊(circuit block)示意圖。顯示系統10包括遠端裝置100和本地裝置200。遠端裝置100的相機110可以拍攝第一視野而產生影像串流112。本地裝置200的相機210可以拍攝第二視野而產生影像串流212。本地裝置200還包括顯示器220以及處理電路230。處理電路230耦接至相機210與顯示器220。處理電路230可以通過通訊網路獲得來自於遠端裝置100的影像串流112。FIG. 1 is a schematic diagram of a circuit block of a display system 10 according to an embodiment of the present invention. The display system 10 includes a remote device 100 and a local device 200 . The camera 110 of the remote device 100 can capture the first field of view to generate an image stream 112 . The camera 210 of the local device 200 can capture the second field of view to generate an image stream 212 . The local device 200 also includes a display 220 and a processing circuit 230 . The processing circuit 230 is coupled to the camera 210 and the display 220 . The processing circuit 230 can obtain the video stream 112 from the remote device 100 through the communication network.

圖2是依照本發明的一應用情境範例所繪示,顯示器220所顯示的顯示畫面300的示意圖。請參照圖1與圖2。處理電路230可以使用影像串流112與影像串流212去產生影像串流222給顯示器220,以使顯示器220所顯示的顯示畫面300包含對應於影像串流112的顯示區域310以及對應於影像串流212的顯示區域320。處理電路230可以依據影像串流112與影像串流212至少一者所對應的曝光資訊與動量,去調整顯示區域310與顯示區域320至少一者的影像清晰度。因此,顯示系統10可以適當地調整顯示器220所顯示畫面的影像清晰度。FIG. 2 is a schematic diagram of a display screen 300 displayed on the display 220 according to an example of an application scenario of the present invention. Please refer to FIG. 1 and FIG. 2 . The processing circuit 230 can use the image stream 112 and the image stream 212 to generate the image stream 222 to the display 220, so that the display screen 300 displayed by the display 220 includes the display area 310 corresponding to the image stream 112 and the display area 310 corresponding to the image stream Display area 320 of stream 212 . The processing circuit 230 can adjust the image definition of at least one of the display area 310 and the display area 320 according to exposure information and momentum corresponding to at least one of the image stream 112 and the image stream 212 . Therefore, the display system 10 can appropriately adjust the image definition of the picture displayed on the display 220 .

顯示系統10可以應用於像是視訊會議或其他應用,例如娛樂、監控、商業、工程、醫療等等的情境,本發明對此不設限。舉例來說,遠端裝置100和本地裝置200可以是筆記型電腦、AIO(All in One)電腦、桌上型電腦、頭戴顯示器、擴增實境(Augmented Reality,AR)眼鏡、智慧型眼鏡等裝置(但不限於此)。根據應用情境,相機110所產生的影像串流112和相機210所產生的影像串流212可以是相關的影像。舉例來說,在視訊會議的應用中,相機110與相機210可分別拍攝在同一會議室中的不同使用者而產生影像串流112與影像串流212。在另一應用情境中,相機110可拍攝在遠端會議室中的某一使用者而產生影像串流112,以及相機210可拍攝在本地會議室中的另一使用者而產生影像串流212。The display system 10 can be applied to situations such as video conferencing or other applications, such as entertainment, surveillance, business, engineering, medical, etc., which is not limited by the present invention. For example, the remote device 100 and the local device 200 may be a notebook computer, an AIO (All in One) computer, a desktop computer, a head-mounted display, Augmented Reality (AR) glasses, and smart glasses and other devices (but not limited to). Depending on the application context, the image stream 112 generated by the camera 110 and the image stream 212 generated by the camera 210 may be related images. For example, in a video conference application, the camera 110 and the camera 210 can respectively photograph different users in the same conference room to generate the image stream 112 and the image stream 212 . In another application scenario, the camera 110 can capture a user in the remote conference room to generate the image stream 112 , and the camera 210 can capture another user in the local conference room to generate the image stream 212 .

無論如何,影像串流112與影像串流212對應的曝光資訊與動量可能不同。本地裝置200的處理電路230可以依據該影像串流112與該影像串流212至少一者所對應的曝光資訊與動量,去調整顯示器220的顯示區域310與顯示區域320至少一者的影像清晰度。依照設計需求,在本發明的一實施例中,所述曝光資訊包括曝光時間長以及(或是)其他曝光資訊,而所述影像清晰度包括銳利度(sharpness)與對比度(contrast)其中至少一者。Regardless, the exposure information and momentum corresponding to image stream 112 and image stream 212 may be different. The processing circuit 230 of the local device 200 can adjust the image definition of at least one of the display area 310 and the display area 320 of the display 220 according to the exposure information and momentum corresponding to at least one of the image stream 112 and the image stream 212 . According to design requirements, in an embodiment of the present invention, the exposure information includes a long exposure time and/or other exposure information, and the image definition includes at least one of sharpness and contrast. By.

圖3是依照本發明的一實施例說明圖1所示處理電路230的電路方塊示意圖。在圖3所示實施例中,本地裝置200的處理電路230包括通訊介面電路240和運算電路250。通訊電路240可以透過通訊網路而與遠端裝置100建立連接。運算電路250耦接至通訊界面電路240,以獲得遠端裝置100的相機110的影像串流112以及影像串流112所對應的曝光資訊。運算電路250還耦接至本地裝置200的相機210,以獲得影像串流212以及影像串流212所對應的曝光資訊。運算電路250可以使用影像串流112與影像串流212去產生影像串流222給顯示器220。FIG. 3 is a circuit block diagram illustrating the processing circuit 230 shown in FIG. 1 according to an embodiment of the present invention. In the embodiment shown in FIG. 3 , the processing circuit 230 of the local device 200 includes a communication interface circuit 240 and an arithmetic circuit 250 . The communication circuit 240 can establish a connection with the remote device 100 through a communication network. The arithmetic circuit 250 is coupled to the communication interface circuit 240 to obtain the image stream 112 of the camera 110 of the remote device 100 and the exposure information corresponding to the image stream 112 . The arithmetic circuit 250 is also coupled to the camera 210 of the local device 200 to obtain the image stream 212 and exposure information corresponding to the image stream 212 . The arithmetic circuit 250 can use the video stream 112 and the video stream 212 to generate the video stream 222 for the display 220 .

圖4是依照本發明的一實施例說明圖3所示運算電路250的電路方塊示意圖。在圖4所示實施例中,運算電路250包括中央處理器(Central Processing Unit,CPU)253與圖形處理器(Graphics Processing Unit,GPU)257。中央處理器253耦接至通訊界面電路240,以透過通訊介面電路240獲得影像串流112以及影像串流112所對應的曝光資訊。中央處理器253還耦接至相機210,以獲得影像串流212以及影像串流212所對應的曝光資訊。中央處理器253可以使用影像串流112與影像串流212去產生影像內容。圖形處理器257耦接至中央處理器253,以接收影像內容。圖形處理器257可以依據該影像內容去產生影像串流222給顯示器220。FIG. 4 is a circuit block diagram illustrating the operation circuit 250 shown in FIG. 3 according to an embodiment of the present invention. In the embodiment shown in FIG. 4 , the operation circuit 250 includes a central processing unit (Central Processing Unit, CPU) 253 and a graphics processing unit (Graphics Processing Unit, GPU) 257 . The central processing unit 253 is coupled to the communication interface circuit 240 to obtain the image stream 112 and exposure information corresponding to the image stream 112 through the communication interface circuit 240 . The CPU 253 is also coupled to the camera 210 to obtain the image stream 212 and exposure information corresponding to the image stream 212 . The CPU 253 can use the video stream 112 and the video stream 212 to generate video content. The graphics processor 257 is coupled to the CPU 253 to receive image content. The graphics processor 257 can generate the video stream 222 to the display 220 according to the video content.

請參照圖1。在本發明的一實施例中,處理電路230可以使用影像串流112去計算影像串流112所對應的動量。此外,處理電路230還可以使用影像串流212去計算影像串流212所對應的動量。本實施例並不限制動量計算的實施方式。依照設計需求,在一些實施例中,所述動量可以相似(或相同)於習知的移動估計演算法(Motion Estimation Algorithm)中的移動向量(moving vector)。Please refer to Figure 1. In an embodiment of the present invention, the processing circuit 230 can use the image stream 112 to calculate the momentum corresponding to the image stream 112 . In addition, the processing circuit 230 can also use the video stream 212 to calculate the momentum corresponding to the video stream 212 . This embodiment does not limit the implementation of the momentum calculation. According to design requirements, in some embodiments, the momentum can be similar (or the same) as the moving vector in the conventional Motion Estimation Algorithm.

在一些實施例中,處理電路230可以使用影像串流222去將顯示畫面300切分出顯示區域310以及顯示區域320。處理電路230可以使用顯示區域310的內容去計算影像串流112所對應的動量。處理電路230還可以使用顯示區域320的內容去計算影像串流212所對應的動量。In some embodiments, the processing circuit 230 may use the video stream 222 to divide the display screen 300 into the display area 310 and the display area 320 . The processing circuit 230 can use the content of the display area 310 to calculate the momentum corresponding to the video stream 112 . The processing circuit 230 may also use the content of the display area 320 to calculate the momentum corresponding to the video stream 212 .

所述動量的計算方式可以依照設計需求來決定。舉例來說,在一些實施例,處理電路230可以計算在顯示區域310中的多個像素(pixel)的每一個的移動向量(在此稱為第一移動向量)。處理電路230可以計算這些第一移動向量的平均值作為影像串流112所對應的所述動量。以此類推,處理電路230可以計算在顯示區域320中的多個像素的每一個的移動向量(在此稱為第二移動向量),以及處理電路230可以計算這些第二移動向量的平均值作為影像串流212所對應的所述動量。The calculation method of the momentum can be determined according to design requirements. For example, in some embodiments, processing circuit 230 may calculate a motion vector (referred to herein as a first motion vector) for each of a plurality of pixels (pixels) in display area 310 . The processing circuit 230 can calculate the average value of these first motion vectors as the momentum corresponding to the image stream 112 . By analogy, processing circuit 230 may calculate a motion vector (referred to herein as a second motion vector) for each of the plurality of pixels in display area 320, and processing circuit 230 may calculate the average of these second motion vectors as The momentum corresponding to the video stream 212 .

例如(但不限於此),處理電路230可以使用下列式(1)去計算一個顯示區域的移動向量的平均值

Figure 02_image001
。在式(1)之中,
Figure 02_image003
代表在這個顯示區域中的第i個像素的移動向量的x分量,
Figure 02_image005
代表所述第i個像素的移動向量的y分量,而
Figure 02_image007
是在這個顯示區域中的像素總數。
Figure 02_image009
式(1) For example (but not limited to), the processing circuit 230 can use the following formula (1) to calculate the average value of the motion vectors of a display area
Figure 02_image001
. In formula (1),
Figure 02_image003
represents the x component of the motion vector for the ith pixel in this display area,
Figure 02_image005
represents the y-component of the motion vector for the ith pixel, and
Figure 02_image007
is the total number of pixels in this display area.
Figure 02_image009
Formula 1)

依照設計需求,在另一些實施例中,處理電路230可以按上述式(1)的相關說明去計算出顯示區域310的這些第一移動向量的平均值(在此稱為第一平均值)以及顯示區域320的這些第二移動向量的平均值(在此稱為第二平均值)。然後,處理電路230可以對這個第一平均值進行正規化,以獲得對應於這個第一平均值的影像動量等級(在此稱為第一影像動量等級)作為影像串流112所對應的所述動量。同理可推,處理電路230可以對這個第二平均值進行正規化,以獲得對應於這個第二平均值的影像動量等級(在此稱為第二影像動量等級)作為影像串流212所對應的所述動量。According to design requirements, in some other embodiments, the processing circuit 230 can calculate the average value of the first motion vectors of the display area 310 (herein referred to as the first average value) and The average of these second motion vectors of the display area 320 (herein referred to as the second average). Then, the processing circuit 230 may normalize the first average value to obtain an image momentum level (referred to herein as a first image momentum level) corresponding to the first average value as the image stream 112 corresponding to the momentum. Similarly, the processing circuit 230 can normalize the second average value to obtain an image momentum level (herein referred to as the second image momentum level) corresponding to the second average value as the image stream 212 corresponds to of the momentum.

所述正規化的進行方式可以依照設計需求來決定。舉例來說,在一些實施例中,所述平均值的值域可以被分為三個區間(如下述表1所示「影像動量等級」欄位)。當所述平均值落於第一個區間時,第一個影像動量等級「1」可以作為所述動量。當所述平均值落於第二個區間時,第一個影像動量等級「2」可以作為所述動量。當所述平均值落於第三個區間時,第一個影像動量等級「3」可以作為所述動量。The manner in which the normalization is performed may be determined according to design requirements. For example, in some embodiments, the range of the average value can be divided into three intervals (as shown in the "Image Momentum Level" field in Table 1 below). When the average value falls within the first interval, the first image momentum level "1" can be used as the momentum. When the average value falls within the second interval, the first image momentum level "2" can be used as the momentum. When the average value falls within the third interval, the first image momentum level "3" can be used as the momentum.

在一些實施例中(但不限於此),所述處理電路230可以將影像串流112所對應的曝光資訊與動量轉換為一個清晰度強化等級(在此稱為第一清晰度強化等級)。處理電路230可以將影像串流212所對應的曝光資訊與動量轉換為另一個清晰度強化等級(在此稱為第二清晰度強化等級)。舉例來說,處理電路230可以使用下述表1將相機曝光值(曝光資訊)與影像動量等級轉換為作為顯示影像清晰度強化等級(影像清晰度強化參數)。若來源相機曝光值越高,則顯示影像清晰度強化等級越高,而若來源相機曝光值越低,則顯示影像清晰度強化等級越低。在相同的相機曝光值下,若影像動量等級越高,則顯示影像清晰度強化等級越高。若影像動量等級越低,則顯示影像清晰度強化等級越低。 表1:處理電路230的輸入與輸出 輸入 輸出 相機曝光值 影像動量等級 顯示影像清晰度強化等級 -4 1 1 2 2 3 3 0 1 2 2 3 3 4 4 1 3 2 4 3 5 In some embodiments (but not limited thereto), the processing circuit 230 can convert the exposure information and momentum corresponding to the image stream 112 into a sharpness enhancement level (referred to herein as a first sharpness enhancement level). The processing circuit 230 can convert the exposure information and momentum corresponding to the image stream 212 into another sharpness enhancement level (referred to herein as a second sharpness enhancement level). For example, the processing circuit 230 can use the following Table 1 to convert the camera exposure value (exposure information) and the image momentum level into a display image sharpness enhancement level (image sharpness enhancement parameter). The higher the source camera exposure value, the higher the displayed image sharpness enhancement level, and the lower the source camera exposure value, the lower the displayed image sharpness enhancement level. Under the same camera exposure value, the higher the image momentum level, the higher the displayed image sharpness enhancement level. The lower the image momentum level, the lower the displayed image sharpness enhancement level. Table 1: Inputs and outputs of processing circuit 230 enter output camera exposure value Image Momentum Level Displays the image sharpness enhancement level -4 1 1 2 2 3 3 0 1 2 2 3 3 4 4 1 3 2 4 3 5

依照設計需求,在一些實施例中,處理電路230可以進行前端影像處理。例如,處理電路230可以基於所述第一清晰度強化等級去調整影像串流112的影像清晰度,以及基於所述第二清晰度強化等級去調整影像串流212的影像清晰度。藉此,本地裝置200可以獨立地調整顯示區域310與(或)顯示區域320的影像清晰度。因此,處理電路230可以改善因曝光時間較長而造成影像模糊問題,增進觀看品質。According to design requirements, in some embodiments, the processing circuit 230 may perform front-end image processing. For example, the processing circuit 230 may adjust the image sharpness of the image stream 112 based on the first sharpness enhancement level, and adjust the image sharpness of the image stream 212 based on the second sharpness enhancement level. In this way, the local device 200 can independently adjust the image definition of the display area 310 and/or the display area 320 . Therefore, the processing circuit 230 can improve the image blur caused by the long exposure time and improve the viewing quality.

在另一些實施例中,處理電路230可以進行後端影像處理。例如,處理電路230可以基於清晰度強化等級去調整影像串流222的影像清晰度。在設備允許對顯示畫面的不同顯示區域進行不同影像清晰度調整的情況下,處理電路230可以基於所述第一清晰度強化等級去調整顯示區域310的影像清晰度,以及基於所述第二清晰度強化等級去調整顯示區域320的影像清晰度。In other embodiments, the processing circuit 230 may perform back-end image processing. For example, the processing circuit 230 may adjust the image sharpness of the image stream 222 based on the sharpness enhancement level. In the case that the device allows different image definition adjustments for different display areas of the display screen, the processing circuit 230 may adjust the image definition of the display area 310 based on the first definition enhancement level, and adjust the image definition based on the second definition The sharpness of the image in the display area 320 can be adjusted by adjusting the intensity enhancement level.

然而,有些設備可以對顯示畫面300的全域進行影像清晰度的調整,卻無法對顯示畫面300的不同顯示區域進行差別性的調整。在這樣的情況下,處理電路230可以對顯示畫面300的顯示區域310以及顯示區域320定義各自的權重值。本實施例並不限制所述權重值的決定方式。在一些實施例中,所述權重值可以依照設計需求來決定。在另一些實施例中,所述權重值的決定方式可以相依於顯示區域在整個顯示畫面300中的佔比。比如說,在一個顯示畫面300中的顯示區域310與顯示區域320的佔比可能分別為70%與17%,則處理電路230可將顯示區域310與320的權重值分別定為70%與17%。處理電路230可以對所述第一清晰度強化等級與所述第二清晰度強化等級進行加權平均而獲得加權平均等級。然後,處理電路230可以基於這個加權平均等級去對顯示畫面300的全域進行影像清晰度的調整,亦即調整顯示區域310與顯示區域320的影像清晰度。比如說,假設顯示區域310的權重值為70%而顯示區域320的權重值為17%,以及假設所述第一清晰度強化等級為「5」而所述第二清晰度強化等級為「1」,則所述加權平均等級為

Figure 02_image011
。 However, some devices can adjust the image definition for the entire area of the display screen 300 , but cannot perform differential adjustment for different display areas of the display screen 300 . In such a case, the processing circuit 230 may define respective weight values for the display area 310 and the display area 320 of the display screen 300 . This embodiment does not limit the manner of determining the weight value. In some embodiments, the weight value may be determined according to design requirements. In other embodiments, the manner of determining the weight value may depend on the proportion of the display area in the entire display screen 300 . For example, the proportions of the display area 310 and the display area 320 in a display screen 300 may be 70% and 17%, respectively, then the processing circuit 230 may set the weight values of the display areas 310 and 320 as 70% and 17%, respectively. %. The processing circuit 230 may perform a weighted average of the first sharpness enhancement level and the second sharpness enhancement level to obtain a weighted average level. Then, the processing circuit 230 can adjust the image sharpness of the whole area of the display screen 300 based on the weighted average level, that is, adjust the image sharpness of the display area 310 and the display area 320 . For example, suppose that the weight value of display area 310 is 70% and the weight value of display area 320 is 17%, and that the first sharpness enhancement level is "5" and the second sharpness enhancement level is "1" , then the weighted average level is
Figure 02_image011
.

圖5是依照本發明的一實施例說明顯示系統的影像清晰度強化方法的流程示意圖。請參照圖1與圖5,在步驟S410中,遠端裝置100的相機110可以拍攝第一視野而產生影像串流112。在步驟S420中,本地裝置200的相機210可以拍攝第二視野而產生影像串流212。須注意的是,步驟S410與步驟S420二者並沒有先後順序的限制。在一些實施情境中,步驟S410與步驟S420可能同時進行。在另一些實施情境中,步驟S420的進行可能早於(或晚於)步驟S410的進行。FIG. 5 is a schematic flowchart illustrating an image definition enhancement method of a display system according to an embodiment of the present invention. Referring to FIG. 1 and FIG. 5 , in step S410 , the camera 110 of the remote device 100 can capture the first field of view to generate the image stream 112 . In step S420 , the camera 210 of the local device 200 can capture the second field of view to generate the image stream 212 . It should be noted that there is no restriction on the order of steps S410 and S420. In some implementation scenarios, step S410 and step S420 may be performed simultaneously. In other implementation scenarios, step S420 may be performed earlier (or later) than step S410 may be performed.

在步驟S430中,本地裝置200的處理電路230可以通過通訊網路而獲得來自於遠端裝置100的影像串流112。在步驟S440中,處理電路230可以使用影像串流112與影像串流212去產生影像串流222給本地裝置200的顯示器220,以使顯示器220所顯示的顯示畫面300包含對應於影像串流112的顯示區域310以及對應於影像串流212的顯示區域320。在步驟S450中,處理電路230可以依據影像串流112與影像串流212至少一者所對應的曝光資訊與動量,去調整顯示區域310與顯示區域320至少一者的影像清晰度。In step S430, the processing circuit 230 of the local device 200 can obtain the image stream 112 from the remote device 100 through the communication network. In step S440 , the processing circuit 230 can use the image stream 112 and the image stream 212 to generate the image stream 222 to the display 220 of the local device 200 , so that the display screen 300 displayed on the display 220 includes the corresponding image stream 112 and the display area 320 corresponding to the video stream 212 . In step S450 , the processing circuit 230 may adjust the image definition of at least one of the display area 310 and the display area 320 according to the exposure information and momentum corresponding to at least one of the image stream 112 and the image stream 212 .

圖6是依照本發明的再一實施例的影像清晰度強化方法的流程示意圖。請參照圖1與圖6,在步驟S610中,本地裝置200的處理電路230可以從來源相機(即遠端裝置100的相機110和/或本地裝置200的相機210)取得曝光資訊,其中該曝光資訊對應於相機110產生的影像串流112或相機210產生的影像串流212。在步驟S620中,處理電路230可以分析/計算影像串流112與影像串流212的動量,以及決定顯示區域310與顯示區域320的權重值。在步驟S630中,處理電路230可以依據曝光資訊、動量以及權重值決定顯示影像清晰度強化等級。例如,處理電路230可以使用表1的映射表(mapping table)或是具有類似作用的對照模型(mapping model),來將各種曝光資訊與動量轉換為對應的顯示影像清晰度強化等級。FIG. 6 is a schematic flowchart of an image definition enhancement method according to still another embodiment of the present invention. 1 and FIG. 6 , in step S610 , the processing circuit 230 of the local device 200 may obtain exposure information from the source camera (ie, the camera 110 of the remote device 100 and/or the camera 210 of the local device 200 ), wherein the exposure information is The information corresponds to the image stream 112 generated by the camera 110 or the image stream 212 generated by the camera 210 . In step S620 , the processing circuit 230 may analyze/calculate the momentum of the video stream 112 and the video stream 212 , and determine the weight value of the display area 310 and the display area 320 . In step S630, the processing circuit 230 may determine the enhancement level of the displayed image definition according to the exposure information, the momentum and the weight value. For example, the processing circuit 230 can use the mapping table in Table 1 or a mapping model with similar functions to convert various exposure information and momentum into corresponding display image sharpness enhancement levels.

在步驟S640中,處理電路230可以判斷從步驟S630可以獲得的顯示影像清晰度強化等級是否改變。若處理電路230判斷顯示影像清晰度強化等級沒有改變(步驟S640的判斷結果為「否」),則處理電路230可以回到步驟S610。若處理電路230判斷顯示影像清晰度強化等級以被改變(步驟S640的判斷結果為「是」),則處理電路230可以進行步驟S650。在步驟S650中,處理電路230可以依據新的顯示影像清晰度強化等級去進行顯示影像清晰度的調整。In step S640, the processing circuit 230 may determine whether the display image definition enhancement level obtained from step S630 has changed. If the processing circuit 230 determines that the display image definition enhancement level has not changed (the determination result in step S640 is "No"), the processing circuit 230 may return to step S610. If the processing circuit 230 determines that the display image definition enhancement level is to be changed (the determination result in step S640 is "Yes"), the processing circuit 230 may proceed to step S650. In step S650, the processing circuit 230 may adjust the display image sharpness according to the new display image sharpness enhancement level.

依照不同的設計需求,上述遠端裝置100、本地裝置200處理電路230、通訊界面電路240以及(或是)運算電路250的方塊的實現方式可以是硬體(hardware)、韌體(firmware)、軟體(software,即程式)或是前述三者中的多者的組合形式。According to different design requirements, the implementation of the blocks of the remote device 100 , the processing circuit 230 of the local device 200 , the communication interface circuit 240 and/or the operation circuit 250 may be hardware, firmware, Software (software, that is, programs) or a combination of more than one of the above three.

以硬體形式而言,上述遠端裝置100、本地裝置200處理電路230、通訊界面電路240以及(或是)運算電路250的方塊可以實現於積體電路(integrated circuit)上的邏輯電路。上述遠端裝置100、本地裝置200處理電路230、通訊界面電路240以及(或是)運算電路250的相關功能可以利用硬體描述語言(hardware description languages,例如Verilog HDL或VHDL)或其他合適的編程語言來實現為硬體。舉例來說,上述遠端裝置100、本地裝置200處理電路230、通訊界面電路240以及(或是)運算電路250的相關功能可以被實現於一或多個控制器、微控制器、微處理器、特殊應用積體電路(Application-specific integrated circuit, ASIC)、數位訊號處理器(digital signal processor, DSP)、場可程式邏輯閘陣列(Field Programmable Gate Array, FPGA)及/或其他處理單元中的各種邏輯區塊、模組和電路。In terms of hardware, the above-mentioned blocks of the remote device 100 , the processing circuit 230 of the local device 200 , the communication interface circuit 240 and/or the arithmetic circuit 250 can be implemented as logic circuits on an integrated circuit. The above-mentioned related functions of the remote device 100 , the processing circuit 230 of the local device 200 , the communication interface circuit 240 and/or the operation circuit 250 can be programmed using hardware description languages (such as Verilog HDL or VHDL) or other suitable programming. The language is implemented as hardware. For example, the above-mentioned related functions of the remote device 100, the processing circuit 230 of the local device 200, the communication interface circuit 240 and/or the arithmetic circuit 250 can be implemented in one or more controllers, microcontrollers, microprocessors , Application-specific integrated circuits (ASICs), digital signal processors (DSPs), Field Programmable Gate Arrays (FPGAs) and/or other processing units Various logic blocks, modules and circuits.

以軟體形式及/或韌體形式而言,上述遠端裝置100、本地裝置200處理電路230、通訊界面電路240以及(或是)運算電路250的相關功能可以被實現為編程碼(programming codes)。例如,利用一般的編程語言(programming languages,例如C、C++或組合語言)或其他合適的編程語言來實現上述遠端裝置100、本地裝置200處理電路230、通訊界面電路240以及(或是)運算電路250。所述編程碼可以被記錄/存放在記錄媒體中。在一些實施例中,所述記錄媒體例如包括唯讀記憶體(Read Only Memory,ROM)、隨機存取記憶體(Random Access Memory,RAM)以及(或是)儲存裝置。所述儲存裝置包括硬碟(hard disk drive,HDD)、固態硬碟(Solid-state drive,SSD)或是其他儲存裝置。在另一些實施例中,所述記錄媒體可以包括「非臨時的電腦可讀取媒體(non-transitory computer readable medium)」。舉例來說,帶(tape)、碟(disk)、卡(card)、半導體記憶體、可程式設計的邏輯電路等可以被使用來實現所述非臨時的電腦可讀取媒體。電腦、中央處理器(Central Processing Unit,CPU)、控制器、微控制器或微處理器可以從所述記錄媒體中讀取並執行所述編程碼。而且,所述編程碼也可經由任意傳輸媒體(通信網路或廣播電波等)而提供給所述電腦(或CPU)。所述通信網路例如是網際網路(Internet)、有線通信(wired communication)網路、無線通信(wireless communication)網路或其它通信介質。In the form of software and/or firmware, the above-mentioned functions of the remote device 100 , the processing circuit 230 of the local device 200 , the communication interface circuit 240 and/or the arithmetic circuit 250 can be implemented as programming codes. . For example, the above-mentioned remote device 100, local device 200 processing circuit 230, communication interface circuit 240 and/or operations can be implemented using common programming languages (such as C, C++, or assembly language) or other suitable programming languages. circuit 250. The programming code may be recorded/stored in a recording medium. In some embodiments, the recording medium includes, for example, a read only memory (Read Only Memory, ROM), a random access memory (Random Access Memory, RAM), and/or a storage device. The storage device includes a hard disk drive (HDD), a solid-state drive (SSD), or other storage devices. In other embodiments, the recording medium may include a "non-transitory computer readable medium". For example, tape, disk, card, semiconductor memory, programmable logic circuits, etc. may be used to implement the non-transitory computer-readable medium. A computer, a central processing unit (CPU), a controller, a microcontroller or a microprocessor can read and execute the programming code from the recording medium. Also, the programming code may be supplied to the computer (or CPU) via an arbitrary transmission medium (communication network, broadcast waves, etc.). The communication network is, for example, the Internet, a wired communication network, a wireless communication network, or other communication media.

綜上所述,上述諸實施例所述的顯示系統10及其影像清晰度強化方法可以使用遠端裝置100的相機110所產生的影像串流112與本地裝置200的相機210所產生的影像串流212去產生影像串流222給本地裝置200的顯示器220。此外,根據影像串流112與影像串流212至少一者所對應的曝光資訊與動量,本地裝置200可以動態地調整顯示區域310與顯示區域320至少一者的影像清晰度。藉此,本地裝置200可改善因曝光時間較長而造成來源相機顯示影像模糊的問題,增進觀看品質。To sum up, the display system 10 and the image definition enhancement method in the above-mentioned embodiments can use the image stream 112 generated by the camera 110 of the remote device 100 and the image stream generated by the camera 210 of the local device 200 Stream 212 to generate video stream 222 to display 220 of local device 200 . In addition, according to exposure information and momentum corresponding to at least one of the image stream 112 and the image stream 212 , the local device 200 can dynamically adjust the image definition of at least one of the display area 310 and the display area 320 . In this way, the local device 200 can solve the problem of blurred images displayed by the source camera due to a long exposure time, and improve the viewing quality.

雖然本發明已以實施例揭露如上,然其並非用以限定本發明,任何所屬技術領域中具有通常知識者,在不脫離本發明的精神和範圍內,當可作些許的更動與潤飾,故本發明的保護範圍當視後附的申請專利範圍所界定者為準。Although the present invention has been disclosed above by the embodiments, it is not intended to limit the present invention. Anyone with ordinary knowledge in the technical field can make some changes and modifications without departing from the spirit and scope of the present invention. Therefore, The protection scope of the present invention shall be determined by the scope of the appended patent application.

10:顯示系統 100:遠端裝置 110、210:相機 112、212、222:影像串流 200:本地裝置 220:顯示器 230:處理電路 240:通訊界面電路 250:運算電路 253:中央處理器 257:圖形處理器 300:顯示畫面 310、320:顯示區域 S410~S450、S610~S650:步驟 10: Display system 100: Remote device 110, 210: Camera 112, 212, 222: Video streaming 200: local device 220: Display 230: Processing Circuits 240: Communication interface circuit 250: Operational Circuits 253: CPU 257: Graphics processor 300: Display screen 310, 320: Display area S410~S450, S610~S650: Steps

圖1是依照本發明的一實施例的一種顯示系統的電路方塊(circuit block)示意圖。 圖2是依照本發明的一應用情境範例所繪示,顯示器所顯示的顯示畫面的示意圖。 圖3是依照本發明的一實施例說明圖1所示處理電路的電路方塊示意圖。 圖4是依照本發明的一實施例圖3所示運算電路的電路方塊示意圖。 圖5是依照本發明的一實施例說明顯示系統的影像清晰度強化方法的流程示意圖。 圖6是依照本發明的再一實施例的影像清晰度強化方法的流程示意圖。 FIG. 1 is a schematic diagram of a circuit block of a display system according to an embodiment of the present invention. FIG. 2 is a schematic diagram of a display screen displayed on a display according to an example of an application scenario of the present invention. FIG. 3 is a circuit block diagram illustrating the processing circuit shown in FIG. 1 according to an embodiment of the present invention. FIG. 4 is a circuit block diagram of the operation circuit shown in FIG. 3 according to an embodiment of the present invention. FIG. 5 is a schematic flowchart illustrating an image definition enhancement method of a display system according to an embodiment of the present invention. FIG. 6 is a schematic flowchart of an image definition enhancement method according to still another embodiment of the present invention.

S410~S450:步驟 S410~S450: Steps

Claims (14)

一種顯示系統,包括:一遠端裝置,包括一第一相機,用以拍攝一第一視野而產生一第一影像串流;以及一本地裝置,包括一第二相機,用以拍攝一第二視野而產生一第二影像串流;其中該本地裝置還包括:一顯示器;以及一處理電路,耦接至該第二相機與該顯示器,被配置為通過一通訊網路獲得來自於該遠端裝置的該第一影像串流,其中該處理電路使用該第一影像串流與該第二影像串流去產生一第三影像串流給該顯示器,以使該顯示器所顯示的一顯示畫面包含對應於該第一影像串流的一第一顯示區域以及對應於該第二影像串流的一第二顯示區域,以及該處理電路依據該第一影像串流與該第二影像串流至少一者所對應的一曝光資訊與一動量,去調整該第一顯示區域與該第二顯示區域至少一者的一影像清晰度,其中該曝光資訊包括一曝光時間長,以及該影像清晰度包括一銳利度與一對比度其中至少一者,其中該處理電路將該第一影像串流所對應的該曝光資訊與該動量轉換為一第一清晰度強化等級,該處理電路將該第二影像串流所對應的該曝光資訊與該動量轉換為一第二清晰度強化等級,該處理電路對該第一清晰度強化等級與該第二清晰度強化等級進 行加權平均而獲得一加權平均等級,以及該處理電路基於該加權平均等級去調整該第一顯示區域與該第二顯示區域的該影像清晰度。 A display system includes: a remote device including a first camera for capturing a first field of view to generate a first image stream; and a local device including a second camera for capturing a second The local device further includes: a display; and a processing circuit, coupled to the second camera and the display, configured to obtain information from the remote device through a communication network the first image stream, wherein the processing circuit uses the first image stream and the second image stream to generate a third image stream to the display, so that a display screen displayed by the display includes the corresponding in a first display area of the first image stream and a second display area corresponding to the second image stream, and the processing circuit is based on at least one of the first image stream and the second image stream A corresponding exposure information and a momentum to adjust an image sharpness of at least one of the first display area and the second display area, wherein the exposure information includes a long exposure time, and the image sharpness includes a sharp at least one of intensity and a contrast ratio, wherein the processing circuit converts the exposure information and the momentum corresponding to the first image stream into a first sharpness enhancement level, and the processing circuit converts the second image stream The corresponding exposure information and the momentum are converted into a second sharpness enhancement level, and the processing circuit processes the first sharpness enhancement level and the second sharpness enhancement level. A weighted average level is obtained by performing a line weighted average, and the processing circuit adjusts the image definition of the first display area and the second display area based on the weighted average level. 如請求項1所述的顯示系統,其中該處理電路使用該第一影像串流去計算該第一影像串流所對應的該動量,以及該處理電路使用該第二影像串流去計算該第二影像串流所對應的該動量。 The display system of claim 1, wherein the processing circuit uses the first image stream to calculate the momentum corresponding to the first image stream, and the processing circuit uses the second image stream to calculate the first image stream The momentum corresponding to the two video streams. 如請求項1所述的顯示系統,其中該處理電路使用該第三影像串流去從該顯示畫面切分出該第一顯示區域以及該第二顯示區域,該處理電路使用該第一顯示區域的內容計算該第一影像串流所對應的該動量,以及該處理電路使用該第二顯示區域的內容去計算該第二影像串流所對應的該動量。 The display system of claim 1, wherein the processing circuit uses the third image stream to segment the first display area and the second display area from the display screen, and the processing circuit uses the first display area The content of the second image stream is used to calculate the momentum corresponding to the first image stream, and the processing circuit uses the content of the second display area to calculate the momentum corresponding to the second image stream. 如請求項3所述的顯示系統,其中該處理電路計算在該第一顯示區域中的多個像素的每一個的一第一移動向量,該處理電路計算該些第一移動向量的一平均值作為該第一影像串流所對應的該動量,該處理電路計算在該第二顯示區域中的多個像素的每一個的一第二移動向量,以及該處理電路計算該些第二移動向量的一平均值作為該第二影像串流所對應的該動量。 The display system of claim 3, wherein the processing circuit calculates a first motion vector for each of a plurality of pixels in the first display area, the processing circuit calculates an average value of the first motion vectors As the momentum corresponding to the first image stream, the processing circuit calculates a second motion vector of each of the plurality of pixels in the second display area, and the processing circuit calculates the sum of the second motion vectors An average value is used as the momentum corresponding to the second video stream. 如請求項3所述的顯示系統,其中該處理電路計算在該第一顯示區域中的多個像素的每一個的一第一移動向量,該處理電路計算該些第一移動向量的一第一平均值,該處理電路對該第一平均值進行正規化以獲得一第一影像動量等級作為該第一影 像串流所對應的該動量,該處理電路計算在該第二顯示區域中的多個像素的每一個的一第二移動向量,該處理電路計算該些第二移動向量的一第二平均值,以及該處理電路對該第二平均值進行正規化以獲得一第二影像動量等級作為該第二影像串流所對應的該動量。 The display system of claim 3, wherein the processing circuit calculates a first motion vector for each of the plurality of pixels in the first display area, the processing circuit calculates a first motion vector of the first motion vectors an average value, the processing circuit normalizes the first average value to obtain a first image momentum level as the first image Like the momentum corresponding to the stream, the processing circuit calculates a second motion vector for each of the plurality of pixels in the second display area, the processing circuit calculates a second average of the second motion vectors , and the processing circuit normalizes the second average value to obtain a second image momentum level as the momentum corresponding to the second image stream. 如請求項1所述的顯示系統,其中該處理電路將該第一影像串流所對應的該曝光資訊與該動量轉換為一第一清晰度強化等級,該處理電路基於該第一清晰度強化等級去調整該第一影像串流的該影像清晰度,該處理電路將該第二影像串流所對應的該曝光資訊與該動量轉換為一第二清晰度強化等級,以及該處理電路基於該第二清晰度強化等級去調整該第二影像串流的該影像清晰度。 The display system of claim 1, wherein the processing circuit converts the exposure information and the momentum corresponding to the first image stream into a first sharpness enhancement level, and the processing circuit is based on the first sharpness enhancement level to adjust the image sharpness of the first image stream, the processing circuit converts the exposure information and the momentum corresponding to the second image stream into a second sharpness enhancement level, and the processing circuit is based on the The second sharpness enhancement level adjusts the image sharpness of the second image stream. 如請求項1所述的顯示系統,其中該處理電路將該第一影像串流所對應的該曝光資訊與該動量轉換為一第一清晰度強化等級,該處理電路基於該第一清晰度強化等級去調整該第一顯示區域的該影像清晰度,該處理電路將該第二影像串流所對應的該曝光資訊與該動量轉換為一第二清晰度強化等級,以及該處理電路基於該第二清晰度強化等級去調整該第二顯示區域的該影像清晰度。 The display system of claim 1, wherein the processing circuit converts the exposure information and the momentum corresponding to the first image stream into a first sharpness enhancement level, and the processing circuit is based on the first sharpness enhancement level to adjust the image sharpness of the first display area, the processing circuit converts the exposure information and the momentum corresponding to the second image stream into a second sharpness enhancement level, and the processing circuit is based on the first Two sharpness enhancement levels to adjust the image sharpness of the second display area. 一種顯示系統的影像清晰度強化方法,包括:由一遠端裝置的一第一相機拍攝一第一視野而產生一第一影像串流; 由一本地裝置的一第二相機拍攝一第二視野而產生一第二影像串流;由該本地裝置的一處理電路通過一通訊網路獲得來自於該遠端裝置的該第一影像串流;由該處理電路使用該第一影像串流與該第二影像串流去產生一第三影像串流給該本地裝置的一顯示器,以使該顯示器所顯示的一顯示畫面包含對應於該第一影像串流的一第一顯示區域以及對應於該第二影像串流的一第二顯示區域;由該處理電路依據該第一影像串流與該第二影像串流至少一者所對應的一曝光資訊與一動量,去調整該第一顯示區域與該第二顯示區域至少一者的一影像清晰度;由該處理電路將該第一影像串流所對應的該曝光資訊與該動量轉換為一第一清晰度強化等級;由該處理電路將該第二影像串流所對應的該曝光資訊與該動量轉換為一第二清晰度強化等級;由該處理電路對該第一清晰度強化等級與該第二清晰度強化等級進行加權平均而獲得一加權平均等級;以及由該處理電路基於該加權平均等級去調整該第一顯示區域與該第二顯示區域的該影像清晰度。 An image definition enhancement method of a display system, comprising: capturing a first field of view by a first camera of a remote device to generate a first image stream; A second camera of a local device captures a second field of view to generate a second image stream; a processing circuit of the local device obtains the first image stream from the remote device through a communication network; The first image stream and the second image stream are used by the processing circuit to generate a third image stream to a display of the local device, so that a display image displayed by the display includes a display image corresponding to the first image stream. a first display area of the image stream and a second display area corresponding to the second image stream; the processing circuit according to a corresponding one of at least one of the first image stream and the second image stream Exposure information and a momentum to adjust an image definition of at least one of the first display area and the second display area; the processing circuit converts the exposure information and the momentum corresponding to the first image stream into a first sharpness enhancement level; the processing circuit converts the exposure information and the momentum corresponding to the second image stream into a second sharpness enhancement level; the processing circuit converts the first sharpness enhancement level A weighted average level is obtained by performing a weighted average with the second sharpness enhancement level; and the processing circuit adjusts the image sharpness of the first display area and the second display area based on the weighted average level. 如請求項8所述的影像清晰度強化方法,更包括:由該處理電路使用該第一影像串流去計算該第一影像串流所對應的該動量;以及 由該運算電路使用該第二影像串流去計算該第二影像串流所對應的該動量。 The image definition enhancement method of claim 8, further comprising: using the first image stream to calculate the momentum corresponding to the first image stream by the processing circuit; and The computing circuit uses the second video stream to calculate the momentum corresponding to the second video stream. 如請求項8所述的影像清晰度強化方法,更包括:由該處理電路使用該第三影像串流去從該顯示畫面切分出該第一顯示區域以及該第二顯示區域;由該處理電路使用該第一顯示區域的內容計算該第一影像串流所對應的該動量;以及由該處理電路使用該第二顯示區域的內容去計算該第二影像串流所對應的該動量。 The image definition enhancement method according to claim 8, further comprising: using the third image stream by the processing circuit to divide the first display area and the second display area from the display screen; The circuit uses the content of the first display area to calculate the momentum corresponding to the first image stream; and the processing circuit uses the content of the second display area to calculate the momentum corresponding to the second image stream. 如請求項10所述的影像清晰度強化方法,更包括:由該處理電路計算在該第一顯示區域中的多個像素的每一個的一第一移動向量;由該處理電路計算該些第一移動向量的一平均值作為該第一影像串流所對應的該動量;由該處理電路計算在該第二顯示區域中的多個像素的每一個的一第二移動向量;以及由該處理電路計算該些第二移動向量的一平均值作為該第二影像串流所對應的該動量。 The image definition enhancement method of claim 10, further comprising: calculating, by the processing circuit, a first motion vector of each of a plurality of pixels in the first display area; calculating, by the processing circuit, the first motion vectors An average value of motion vectors is used as the momentum corresponding to the first image stream; a second motion vector for each of a plurality of pixels in the second display area is calculated by the processing circuit; and a second motion vector is calculated by the processing circuit The circuit calculates an average value of the second motion vectors as the momentum corresponding to the second image stream. 如請求項10所述的影像清晰度強化方法,更包括:由該處理電路計算在該第一顯示區域中的多個像素的每一個的一第一移動向量;由該處理電路計算該些第一移動向量的一第一平均值; 由該處理電路對該第一平均值進行正規化以獲得一第一影像動量等級作為該第一影像串流所對應的該動量;由該處理電路計算在該第二顯示區域中的多個像素的每一個的一第二移動向量;由該處理電路計算該些第二移動向量的一第二平均值;以及由該處理電路對該第二平均值進行正規化以獲得一第二影像動量等級作為該第二影像串流所對應的該動量。 The image definition enhancement method of claim 10, further comprising: calculating, by the processing circuit, a first motion vector of each of a plurality of pixels in the first display area; calculating, by the processing circuit, the first motion vectors a first mean value of a motion vector; The first average value is normalized by the processing circuit to obtain a first image momentum level as the momentum corresponding to the first image stream; the processing circuit calculates a plurality of pixels in the second display area a second motion vector of each of the as the momentum corresponding to the second video stream. 如請求項8所述的影像清晰度強化方法,更包括:由該處理電路將該第一影像串流所對應的該曝光資訊與該動量轉換為一第一清晰度強化等級;由該處理電路基於該第一清晰度強化等級去調整該第一影像串流的該影像清晰度;由該處理電路將該第二影像串流所對應的該曝光資訊與該動量轉換為一第二清晰度強化等級;以及由該處理電路基於該第二清晰度強化等級去調整該第二影像串流的該影像清晰度。 The image definition enhancement method according to claim 8, further comprising: converting, by the processing circuit, the exposure information and the momentum corresponding to the first image stream into a first definition enhancement level; Adjust the image sharpness of the first image stream based on the first sharpness enhancement level; the processing circuit converts the exposure information and the momentum corresponding to the second image stream into a second sharpness enhancement level; and adjusting the image definition of the second video stream by the processing circuit based on the second definition enhancement level. 如請求項8所述的影像清晰度強化方法,更包括:由該處理電路將該第一影像串流所對應的該曝光資訊與該動量轉換為一第一清晰度強化等級;由該處理電路基於該第一清晰度強化等級去調整該第一顯示區域的該影像清晰度;由該處理電路將該第二影像串流所對應的該曝光資訊與該動 量轉換為一第二清晰度強化等級;以及由該處理電路基於該第二清晰度強化等級去調整該第二顯示區域的該影像清晰度。 The image definition enhancement method according to claim 8, further comprising: converting, by the processing circuit, the exposure information and the momentum corresponding to the first image stream into a first definition enhancement level; Adjust the image sharpness of the first display area based on the first sharpness enhancement level; the processing circuit uses the exposure information corresponding to the second image stream and the motion The amount is converted into a second definition enhancement level; and the image definition of the second display area is adjusted by the processing circuit based on the second definition enhancement level.
TW109133284A 2020-09-25 2020-09-25 Display system and image clarity enhancement method thereof TWI775158B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW109133284A TWI775158B (en) 2020-09-25 2020-09-25 Display system and image clarity enhancement method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW109133284A TWI775158B (en) 2020-09-25 2020-09-25 Display system and image clarity enhancement method thereof

Publications (2)

Publication Number Publication Date
TW202213991A TW202213991A (en) 2022-04-01
TWI775158B true TWI775158B (en) 2022-08-21

Family

ID=82197429

Family Applications (1)

Application Number Title Priority Date Filing Date
TW109133284A TWI775158B (en) 2020-09-25 2020-09-25 Display system and image clarity enhancement method thereof

Country Status (1)

Country Link
TW (1) TWI775158B (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104243994A (en) * 2014-09-26 2014-12-24 厦门亿联网络技术股份有限公司 Method for real-time motion sensing of image enhancement
CN106303651A (en) * 2015-05-15 2017-01-04 中强光电股份有限公司 Display system and the display packing of display system
CN108307139A (en) * 2017-01-11 2018-07-20 华为技术有限公司 A kind of method of image adjustment, video conference terminal and video conferencing system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104243994A (en) * 2014-09-26 2014-12-24 厦门亿联网络技术股份有限公司 Method for real-time motion sensing of image enhancement
CN106303651A (en) * 2015-05-15 2017-01-04 中强光电股份有限公司 Display system and the display packing of display system
CN108307139A (en) * 2017-01-11 2018-07-20 华为技术有限公司 A kind of method of image adjustment, video conference terminal and video conferencing system

Also Published As

Publication number Publication date
TW202213991A (en) 2022-04-01

Similar Documents

Publication Publication Date Title
US9826149B2 (en) Machine learning of real-time image capture parameters
US9363446B2 (en) Automatic exposure control for sequential images
WO2021147657A1 (en) Frame interpolation processing method and related product
TWI464526B (en) Method of controlling exposure time of high dynamic range image
WO2017084255A1 (en) Real-time video enhancement method, terminal, and nonvolatile computer readable storage medium
US9998720B2 (en) Image processing method for locally adjusting image data of real-time image
TW201533705A (en) Dynamic exposure adjusting method and electronic apparatus using the same
JP6946566B2 (en) Static video recognition
CN111052732A (en) Processing video including physical writing surface
WO2017185957A1 (en) Image processing method, image processing apparatus and display device
WO2021104394A1 (en) Image processing method and apparatus, electronic device, and storage medium
WO2021180241A1 (en) Gaze point generation method, system, and device
US10127455B2 (en) Apparatus and method of providing thumbnail image of moving picture
US11721003B1 (en) Digital image dynamic range processing apparatus and method
CN112907617B (en) Video processing method and device
WO2018058476A1 (en) Image correction method and device
US11862053B2 (en) Display method based on pulse signals, apparatus, electronic device and medium
WO2020259123A1 (en) Method and device for adjusting image quality, and readable storage medium
US10373293B2 (en) Image processing apparatus, image processing method, and storage medium
JP7334470B2 (en) VIDEO PROCESSING DEVICE, VIDEO CONFERENCE SYSTEM, VIDEO PROCESSING METHOD, AND PROGRAM
TWI775158B (en) Display system and image clarity enhancement method thereof
JP2019180080A (en) Video processing device, communication terminal, video conference system, video processing method, and program
US10715743B2 (en) System and method for photographic effects
TW201820849A (en) Circuits for controlling image sensor and associated method
Lin et al. Extended Dynamic Range imaging: A spatial down-sampling approach

Legal Events

Date Code Title Description
GD4A Issue of patent certificate for granted invention patent