201227499 六、發明說明： 【發明所屬之技術領域】 &本發明相關於一種可提供三維音效之顯示系統及相關方法，尤 心-種可軸地提供三維音效之顯衫，统及相關方法。 【先前技術】 顯示系統在播放景>像時，可利用單聲道（m〇n〇 s〇und)、立體聲 ^tereophcmicsound)或環繞音效（s_unds〇und)來提供音效。 單聲道疋以單通道來重現聲音，通常只用—個麥克風和—個揚聲 器或疋將多重聲音訊號從同樣路徑送入訊號。立體聲通常使用兩 個獨立通道來重現聲音，通常_對以對稱方式配置的揚聲器來 模擬螢幕聲道」（中央、左前方、右前方）發出的聲音。環繞音效 通常使㈣侧立通道來重鱗音，通常糊四組或更多的揚聲器 來依據觀看者的位置來提升音效品f，亦即提供「魏聲道」（左環 繞、右環繞、背環繞）來模擬自然環境下的聽覺感受。 三維（three-dimensional，3D)顯示技術提供了較傳统二 維(―ensional，犯）顯示技術更為相麵如生的視覺^ 驗。在三維放三維影像的過程中，通常會使用 對揚聲器或耳機在觀看者附近的特定位置提 曰 y、二維音效。三4 曰效又稱做虛擬音效’其使用兩個獨立通道來模擬出 、’ 境中不同位置的聲音源，因此成本低於多重通道之俨縳立,:: 201227499 模擬在自然環境中人類聽覺感受，需要使用一種模擬心理學聽覺特 欲（psycho-acoustic cue)之三維定位運算法來將原始二維音頻訊 號轉換為一相對應之三維音頻訊號。 第1圖為先前技術中一顯示系統1〇〇之功能方塊圖。顯 不系統100為一種二維/三維兼用系統，其包含一二維/三維 影像處理器110、一二維/三維音頻處理器12〇、一螢幕13〇、一 音效產生裝置140，以及一使用者介面15〇。二維/三維影像處理器 11 〇可將一二維影像訊號V2d轉換為一三維影像訊號V3D。依據三 維疋位運算法，二維/三維音頻處理器12〇可將一二維音頻訊號 八犯轉換為一三維音頻訊號八扣，例如依據一種模擬心理學聽覺特徵 之三維粒運算法。觀看者可彻㈣者介面150來切換二維/ 一維〜像模式或二維/三維音效模式。在播放三維影片的過程 :，觀看者可選擇三維音效模式，此時音效產生裝置14〇會依據 二維音頻峨A3D來提供三維音效；或者，觀看者可選擇二維音 效模式’此時音效產生裝置14()會依據二維音頻減八①來提供二 維音效（例如單聲道、立體聲或環繞音效等）。 在先則技術之顯示系統1〇()中，觀看者可利用使用者介面 =0來啟動二維音效模式。絲，先前技術是依據—狀程序來 提供二維音效’提供三維音效之方式和三維影像訊號Vm之三維影 像内容並不相關。 201227499 【發明内容】 本發明提供一種可動態地提供三維音效之顯示系統，其包人 影像處理器，用來將一二維影像訊號轉換為一三維影傻知贴3201227499 VI. Description of the Invention: [Technical Field of the Invention] The present invention relates to a display system and a related method capable of providing a three-dimensional sound effect, and in particular to a display shirt, a system and a related method for axially providing three-dimensional sound effects. [Prior Art] When the display system is playing a scene, the sound can be provided by using mono (m〇n〇 s〇und), stereo ^tereophcmicsound, or surround sound (s_unds〇und). Mono channels reproduce sound in a single channel, usually using only one microphone and a speaker or cymbal to send multiple sound signals from the same path into the signal. Stereo usually uses two separate channels to reproduce the sound, usually _ a symmetrical speaker configured to simulate the sound of the screen channel (central, left front, right front). The surround sound usually makes the (four) side channel to re-scale the sound, usually four or more speakers to enhance the sound effect f according to the position of the viewer, that is, provide "wei channel" (left surround, right surround, back surround) To simulate the auditory experience in the natural environment. Three-dimensional (3D) display technology provides a more visual inspection than traditional two-dimensional (ensional) display technology. In the process of placing 3D images in 3D, it is usually used to raise the y and 2D sound effects at a specific position near the viewer for the speaker or earphone. The 3 4 effect is also called virtual sound effect. It uses two independent channels to simulate the sound source in different locations in the environment, so the cost is lower than the multiple channels. :: 201227499 Simulating human hearing in the natural environment Feeling, it is necessary to use a three-dimensional positioning algorithm that simulates psycho-acoustic cue to convert the original two-dimensional audio signal into a corresponding three-dimensional audio signal. Figure 1 is a functional block diagram of a display system 1 in the prior art. The display system 100 is a two-dimensional/three-dimensional dual-use system including a two-dimensional/three-dimensional image processor 110, a two-dimensional/three-dimensional audio processor 12A, a screen 13A, an audio effect generating device 140, and a use. The interface is 15〇. The 2D/3D image processor 11 转换 converts a 2D video signal V2d into a 3D video signal V3D. According to the three-dimensional clamping algorithm, the two-dimensional/three-dimensional audio processor 12 can convert a two-dimensional audio signal into a three-dimensional audio signal, for example, according to a three-dimensional granular algorithm that simulates psychological characteristics of psychology. The viewer can switch between the 2D/1D image mode or the 2D/3D sound mode by using the (4) interface 150. In the process of playing a three-dimensional movie: the viewer can select a three-dimensional sound mode, at which time the sound effect generating device 14 will provide a three-dimensional sound effect according to the two-dimensional audio 峨A3D; or, the viewer can select the two-dimensional sound effect mode ‘the sound effect is generated at this time. The device 14() provides a two-dimensional sound (eg, mono, stereo, surround sound, etc.) based on the two-dimensional audio minus eight. In the prior art display system 1(), the viewer can use the user interface =0 to activate the two-dimensional sound mode. Silk, the prior art is based on a program to provide two-dimensional sound effects. The way to provide three-dimensional sound effects is not related to the three-dimensional image content of the three-dimensional image signal Vm. 201227499 SUMMARY OF THE INVENTION The present invention provides a display system capable of dynamically providing a three-dimensional sound effect, which is used to convert a two-dimensional image signal into a three-dimensional image.
二維運真量指數來妝一 據該三維影像訊號之三維影像内容求出一 處理器，用來依據一三維定位運算法和該三維運算量指 維音頻訊號轉換為一三維音頻訊號；一螢 訊號來顯示影像；以及一音效產生裝置， 來產生一音效。 本發明另提供-種可在-顯示系統内動態地提供三維音欵 法，其包含將-二維影像訊號轉換為—三維影像訊號；求出相=方 該二維影像tfi號之三維影像内容的一三維運算量指數；以及佑於 二維定位運算法和該三維運算s指數來H音頻訊號轉f 三維音頻訊號。 、马― 【實施方式】 第2圖為本發明中一種可動態地提供三維音效之顯示系 統200的功能方塊圖。顯示系統2〇〇為一種二維/三維兼用系 、、先3 —維/二維影像處理器210、一二維/三維音頻處王里 器220、一螢幕230、一音效產生裝置240,以及一使用者介面250。 -維/二維練處理器2iG可將—二維影像訊號〜轉換為一三維 影像訊號V3D，並依據三維影像訊號V3D之三維影像内容來求出一 維運算量才日數（3D computation power loading indicator) 201227499 3DCPLI。三維運算量指數3DCPLI可能相關於螢幕230上每一區域 欲顯示立體物件之數量、尺寸或深度。若是相關於三維影像訊號 中一特定圖框的三維運算量指數3DCPLI越大，代表此特定圖框包 含越多二維影像内容，例如需要顯示較多或較大的立體物件。換而 言之，當特定圖框具較大三維運算量指數3DCPLI時，在對此特定 圖框進行二維/三維轉換時會需要較多運算量。 依據三維定位運算法和三維運算量指數3Dcpu，本發明之 •二維/三維音頻處理器320可將一二維音頻訊號八犯轉換為一三維 音頻訊號八犯。本發明可使用依據一種模擬心理學聽覺特徵之三維 定位運算法’例如雙耳時間差(interaural time difference, ITD)、雙耳 間強度差(intemuml intensity difference，IID)以及頭部相關傳輸函數 (head-related transfer ftmction, HRTF)。自然環境任意位置之聲音 源至雙耳的傳輸路徑長度不同，因此同時間發出的聲波抵達雙耳= 時間並不相同，此時間差即為ITD。此外，由於頭部遮蔽效應，聲 鲁波抵達雙耳時其強度衰減量不同，此強度差異即為ih>hrtf可模 擬聲波傳遞至人耳内的耳廓，耳道和鼓膜時其振幅變化和時間差， 讓大腦能根據經關斷丨聲音源的綠和麟。依據包含這些心理 學聽覺特徵的之三維音頻訊號‘，音效產生裝置在蚊位置 提供的三維音效會讓觀看者感受到係由不同位置所發出的聲音。 另-方面’二維/三維音頻處理器32〇可依據三維運算量指數 3DCPU來動態地調變三維音頻訊號八3〇。三維音頻訊號A3D中每一 201227499 圖框可能包含不同三維影像内容，因此在格式轉換時所需要的運算 量亦會不同。當較大的三維運算量指數3DCPLI指出包含較多三維 影像内容時，本發明可強化三維音頻訊號八犯。本發明可依據三維 運算量才曰數3DCPLI來調變三維音頻訊號A；3D之振幅或相位，相較 於顯示較少二維影像内容（例如較少或較小的立體物件）之處在 顯不較多二維影像内容（例如較多或較大的立體物件）之處會強化 三維音效。如此一來，本發明可提升人類聽覺對移動立體物件的感 受，進而提供更為生動的三維環境。 觀看者可利用使用者介面250來切換二維/三維影像模式或二 維/三維音效模式。在播放三維影片的過程中，觀看者可選擇 二維音效模式，此時音效產生裝置24〇會依據三維音頻訊號八犯來 提供二維音效，並依據每一圖框包含的三維影像内容來動態地調變 三維音效。或者，觀看者可選擇二維音效模式，此時音效產生裴 置240會依據二維音頻訊號八扣來提供二維音效（單聲道、立體聲 或環繞音效等）。使用者介面250可為顯示於螢幕230上之一螢幕顯 示(on-screen display, OSD )。 本發明係依據不同三維影像内容來動態地提供三維音效，因此能 提升人類聽覺對移動立體物件的感受，進而提供更為生動的三維環 境0 以上所述僅為本發明之較佳實施例，凡依本發明申請專利範圍 201227499 所做之均等變化與修飾，皆應屬本發明之涵蓋範圍。 【圖式簡單說明】 第1圖為先前技術中一三維顯示系統之功能方塊圖。 第2圖為本發明中一種可動態提供三維音效之顯示系統的功 能方塊圖。 【主要元件符號說明】 100 、 200 顯示系統 110 、 210 二維/三維影像處理器 120 、 220 二維/三維音頻處理器 130 、 230 螢幕 140 ' 240 音效產生裝置 150 > 250 使用者介面The two-dimensional transport volume index is used to obtain a processor according to the three-dimensional image content of the three-dimensional image signal, and is used for converting a three-dimensional positioning signal into a three-dimensional audio signal according to a three-dimensional positioning algorithm and the three-dimensional operation amount; a signal to display an image; and an audio effect generating device to generate a sound effect. The present invention further provides a three-dimensional sound method capable of dynamically providing a three-dimensional image signal in a display system, comprising: converting a two-dimensional image signal into a three-dimensional image signal; and determining a three-dimensional image content of the two-dimensional image tfi of the phase A three-dimensional operation volume index; and a two-dimensional positioning algorithm and the three-dimensional operation s index to the H audio signal to f three-dimensional audio signal. MAT. [Embodiment] Fig. 2 is a functional block diagram of a display system 200 capable of dynamically providing a three-dimensional sound effect in the present invention. The display system 2 is a two-dimensional/three-dimensional dual-use system, a first 3-dimensional/two-dimensional image processor 210, a two-dimensional/three-dimensional audio device 220, a screen 230, a sound effect generating device 240, and A user interface 250. -Dimensional/Two-Dimensional Processing Processor 2iG converts the two-dimensional image signal~ into a three-dimensional image signal V3D, and calculates the one-dimensional calculation quantity based on the three-dimensional image content of the three-dimensional image signal V3D (3D computation power loading) Indicator) 201227499 3DCPLI. The three-dimensional computational index 3DCPLI may be related to each area on the screen 230 to display the number, size, or depth of the three-dimensional objects. If the 3D operation index 3DCPLI related to a specific frame in the 3D image signal is larger, it means that the specific frame contains more 2D image content, for example, it is necessary to display more or larger three-dimensional objects. In other words, when a specific frame has a large three-dimensional computation index 3DCPLI, more computational complexity is required when performing 2D/3D conversion on this particular frame. According to the three-dimensional positioning algorithm and the three-dimensional operation amount index 3Dcpu, the two-dimensional/three-dimensional audio processor 320 of the present invention can convert a two-dimensional audio signal eight-person crime into a three-dimensional audio signal eight. The present invention may use a three-dimensional positioning algorithm based on a simulated psychological auditory feature, such as an interaural time difference (ITD), an intemum intensity difference (IID), and a head related transfer function (head- Related transfer ftmction, HRTF). Sound in any position in the natural environment The length of the transmission path from the source to the ears is different, so the sound waves emitted at the same time reach the binaural = the time is not the same, and the time difference is the ITD. In addition, due to the head shadow effect, the intensity attenuation of the sound Lubo wave is different when it reaches both ears. The difference in intensity is ih>hrtf can simulate the amplitude of the sound wave transmitted to the auricle in the human ear, the ear canal and the eardrum. The time difference allows the brain to follow the green and lining of the sound source. Based on the three-dimensional audio signal ‘containing these psychological and auditory features, the three-dimensional sound effect provided by the sound effect generating device at the mosquito position allows the viewer to feel the sound emitted by the different positions. The other aspect 2D/3D audio processor 32 can dynamically modulate the 3D audio signal according to the 3D computational index 3DCPU. Each 201227499 frame in the 3D audio signal A3D may contain different 3D image content, so the amount of computation required for format conversion will be different. When the larger three-dimensional operation index 3DCPLI indicates that more three-dimensional image content is included, the present invention can enhance the three-dimensional audio signal eight criminals. The invention can modulate the amplitude or phase of the three-dimensional audio signal A according to the three-dimensional operation quantity 3DCPLI; the amplitude or phase of the 3D is compared with the display of less two-dimensional image content (for example, a smaller or smaller three-dimensional object) Three-dimensional sound effects are enhanced where there are not many 2D image content (such as larger or larger solid objects). In this way, the present invention can enhance the human hearing perception of moving three-dimensional objects, thereby providing a more vivid three-dimensional environment. The viewer can use the user interface 250 to switch between 2D/3D image mode or 2D/3D sound mode. In the process of playing a three-dimensional movie, the viewer can select a two-dimensional sound mode, and the sound effect generating device 24 will provide a two-dimensional sound effect according to the three-dimensional audio signal, and dynamically according to the three-dimensional image content included in each frame. Adjust the three-dimensional sound effect. Alternatively, the viewer may select a two-dimensional sound mode, at which point the sound effect generation device 240 provides a two-dimensional sound effect (mono, stereo or surround sound, etc.) based on the two-dimensional audio signal. The user interface 250 can be an on-screen display (OSD) displayed on the screen 230. The present invention dynamically provides a three-dimensional sound effect according to different three-dimensional image content, thereby improving the human hearing perception of moving three-dimensional objects, thereby providing a more vivid three-dimensional environment. The above is only a preferred embodiment of the present invention. Equivalent changes and modifications made in accordance with the patent application scope 201227499 of the present invention are all covered by the present invention. BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a functional block diagram of a three-dimensional display system in the prior art. Figure 2 is a functional block diagram of a display system capable of dynamically providing three-dimensional sound effects in the present invention. [Main component symbol description] 100, 200 display system 110, 210 2D/3D image processor 120, 220 2D/3D audio processor 130, 230 Screen 140 '240 Sound generator 150 > 250 User interface