TWI517666B - Portable device with single image capturing module to form sterio-image and the method thereof - Google Patents

Portable device with single image capturing module to form sterio-image and the method thereof Download PDF

Info

Publication number
TWI517666B
TWI517666B TW100130833A TW100130833A TWI517666B TW I517666 B TWI517666 B TW I517666B TW 100130833 A TW100130833 A TW 100130833A TW 100130833 A TW100130833 A TW 100130833A TW I517666 B TWI517666 B TW I517666B
Authority
TW
Taiwan
Prior art keywords
image
generating
module
stereoscopic
stereoscopic image
Prior art date
Application number
TW100130833A
Other languages
Chinese (zh)
Other versions
TW201310968A (en
Inventor
江國慶
Original Assignee
江國慶
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 江國慶 filed Critical 江國慶
Priority to TW100130833A priority Critical patent/TWI517666B/en
Publication of TW201310968A publication Critical patent/TW201310968A/en
Application granted granted Critical
Publication of TWI517666B publication Critical patent/TWI517666B/en

Links

Landscapes

  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Description

以單一影像擷取裝置產生立體影像之方法及其裝置 Method and device for generating stereoscopic image by single image capturing device

本發明係關於一種可攜式裝置,特別是關於一具有立體影像擷取模組之裝置與方法。 The present invention relates to a portable device, and more particularly to an apparatus and method having a stereoscopic image capture module.

由於資訊科技(information technology,IT)的發展,資訊可以更快之速度與更高之容量(capacity)進行交換。網際網路(Internet)係設計為一自由交換資訊而不受限制之開放式結構(open structure)。第三代行動通訊(third generation)之手機規格可讓使用者享受多元服務,與即時資訊交換服務,可憑藉手機通訊網路或網際網路觀看實況轉播。然而目前無任何裝置得以產生立體影像之可攜式通訊裝置。 Due to the development of information technology (IT), information can be exchanged with higher capacity at a faster rate. The Internet is designed as an open structure with no restrictions on free exchange of information. The third generation mobile phone specification allows users to enjoy multiple services, and instant information exchange services, which can be viewed live on the mobile communication network or the Internet. However, there is currently no portable communication device that can generate stereoscopic images.

一種具有立體影像擷取模組之裝置,包含控制單元;顯示器耦合至控制單元;影像擷取模組,耦合至控制單元,以利於擷取第一影像;及類立體影像產生模組,耦合至控制單元,將該影像擷取模組所擷取之第一影像水平翻轉產生第二影像;第一與第二影像利於產生類立體影像,其中上述之類立體影像產生模組可儲存於遠端、雲端伺服器或該裝置中。 A device having a stereoscopic image capture module includes a control unit; the display is coupled to the control unit; the image capture module is coupled to the control unit to facilitate capturing the first image; and the stereoscopic image generation module is coupled to The control unit is configured to horizontally invert the first image captured by the image capturing module to generate a second image; the first and second images are used to generate a stereoscopic image, wherein the stereo image generating module can be stored at the remote end. , cloud server or the device.

其中影像擷取模組包含影像擷取元件;影像擷取元件包含CMOS或CCD。上述之類立體影像產生模組可執行類立體影像產生程序;以內插法處理第一影像與第二影像產生中間影像之程序。其中所述之類立體影像產生模組可執 行影像分割程序;該分割程序包含Delaunay分割。 The image capturing module includes an image capturing component; the image capturing component includes a CMOS or a CCD. The stereoscopic image generation module described above can execute a stereoscopic image generation program; and a program for processing the first image and the second image to generate an intermediate image by interpolation. The stereo image generation module described above can be implemented Line image segmentation program; the segmentation program includes Delaunay segmentation.

類立體影像產生模組可產生位移向量及深度資訊以利於產生立體影像之資訊。其中更包含影像分割模組耦合至該控制單元以利於分割顯示器之顯示區域以利顯示第一與第二等影像;其中該顯示器為三維顯示器。 The stereoscopic image generation module can generate displacement vectors and depth information to facilitate generation of stereoscopic image information. The image segmentation module is further coupled to the control unit to facilitate segmentation of the display area of the display for displaying the first and second images; wherein the display is a three-dimensional display.

本發明揭露一種產生類立體影像之方法,包含:以一影像擷取裝置擷取一物體之第一影像;水平翻轉該第一影像以產生第二影像;儲存第一影像與第二影像於記憶體中,做為產生類立體影像之資訊。 The invention discloses a method for generating a stereoscopic image, comprising: capturing an image of an object by an image capturing device; horizontally flipping the first image to generate a second image; and storing the first image and the second image in a memory In the body, as a kind of information to produce stereoscopic images.

其中更包含以類立體影像產生模組執行類立體影像產生程序;更包含以內插法處理第一影像與第二影像以利於產生中間影像;以類立體影像產生模組執行影像分割程序;其中該分割程序包含Delaunay分割;之後更包含以該類立體影像產生模組可產生位移向量及深度資訊。 The method further includes a stereoscopic image generation module executing a stereoscopic image generation program, and further comprising: processing the first image and the second image by interpolation to facilitate generating an intermediate image; and performing a video segmentation process by using the stereoscopic image generation module; The segmentation program includes a Delaunay segmentation; and further includes a stereo image generation module that generates displacement vectors and depth information.

在下列敘述中,各式特定細節係用以提供本發明實施例之通盤瞭解。本發明將配合其較佳實施例與後附之圖式詳述於下,應理解的是本發明中所有較佳實施例僅為例示之用,並非用以限制本發明。熟之該項技術者亦應理解,本發明之實施不須一或多特定細節,或其他特定方法。本發明可整合於手機、數位攝影機、數位照相機、個人數位助理、智慧型手機、衛星定位系統、數位相框、筆記型電腦等裝置。以下所例示只做一說明,非用以限定本發明。 In the following description, various specific details are set forth to provide a comprehensive understanding of the embodiments of the invention. The present invention will be described in detail with reference to the preferred embodiments and the accompanying drawings. It will be understood by those skilled in the art that the practice of the invention does not require one or more specific details or other specific methods. The invention can be integrated into a mobile phone, a digital camera, a digital camera, a personal digital assistant, a smart phone, a satellite positioning system, a digital photo frame, a notebook computer and the like. The following examples are merely illustrative and are not intended to limit the invention.

參考第一圖,其顯示出具有立體影像擷取模組之可攜式通訊裝置10的功能圖。若植於手機則可能包含承載SIM卡之SIM卡連接器,其為習知技術,故不贅述。在其他種類的手機中例如PHS或某些CDMA系統SIM卡係非必要。此圖式係用以描述說明,而非用以限定本發明之專利權範圍。可攜式通訊裝置10包含第一無線傳輸模組200A。可為視訊射頻模組(video RF module)用以傳輸或接收手機訊號,其為熟悉此領域之技藝者所熟知。如習知技術,射頻單元係耦合至一天線系統105,其可以為單一或多組天線,端視需求而定。上述射頻模組可包含基頻處理器(base band processor)等。此天線係連接至一用以接收及傳輸訊號之無線電收發機。第一無線傳輸模組200A係相容於各種手機協定,例如W-CDMA、CDMA2000、CDMA2001、TD-CDMA、TD-SCDMA、UWC0136、DECT、4G系統。這些系統可讓使用者利用視訊通訊溝通。射頻模組可用以執行訊號之傳輸與接收、頻率之同步、基頻處理及數位訊號處理等功能。SIM卡之硬體介面係用於容納一SIM卡。最後,訊號係傳送至最終之聲音輸入/輸出單元190。若非手機,則上述非為必要裝置。 Referring to the first figure, a functional diagram of the portable communication device 10 having a stereoscopic image capture module is shown. If it is implanted in a mobile phone, it may include a SIM card connector carrying a SIM card, which is a conventional technology, and therefore will not be described again. In other types of mobile phones, such as PHS or some CDMA system SIM cards are not necessary. This drawing is intended to be illustrative, and not to limit the scope of the invention. The portable communication device 10 includes a first wireless transmission module 200A. The video RF module can be used to transmit or receive mobile phone signals, which are well known to those skilled in the art. As is known in the art, the radio frequency unit is coupled to an antenna system 105, which may be a single or multiple sets of antennas, depending on the needs. The above RF module may include a base band processor and the like. The antenna is connected to a transceiver for receiving and transmitting signals. First wireless The transmission module 200A is compatible with various mobile phone protocols, such as W-CDMA, CDMA2000, CDMA2001, TD-CDMA, TD-SCDMA, UWC0136, DECT, 4G systems. These systems allow users to communicate using video communications. The RF module can be used to perform functions such as transmission and reception of signals, synchronization of frequencies, fundamental frequency processing, and digital signal processing. The hardware interface of the SIM card is used to accommodate a SIM card. Finally, the signal is transmitted to the final sound input/output unit 190. If it is not a mobile phone, the above is not a necessary device.

可攜式通訊裝置10可包含數位訊號處理器(digital signal processor,DSP)120或/及一中央控制單元100、編解碼器(未顯示)及類比/數位轉換器125,元件之配置端視應用而定。一立體顯示器160、作業系統(operating system, OS)145及記憶體155,記憶體155包含一ROM程式記憶體、一RAM記憶體及一非揮發性快閃記憶體(nonvolatile FLASH memory)。上述單元可分別耦合至中央控制單元100或DSP120。上述記憶體可為非揮發性記憶體、微型硬碟。有線輸入/輸出介面150耦合至中央控制單元100。上述有線輸入/輸出介面可為通用序列匯排流(universal serial bus,USB)或IEEE1394。 The portable communication device 10 can include a digital signal processor (DSP) 120 or/and a central control unit 100, a codec (not shown), and an analog/digital converter 125. And set. a stereoscopic display 160, an operating system (operating system, The OS 145 and the memory 155 include a ROM program memory, a RAM memory, and a nonvolatile FLASH memory. The above units may be coupled to the central control unit 100 or the DSP 120, respectively. The above memory may be a non-volatile memory or a micro hard disk. A wired input/output interface 150 is coupled to the central control unit 100. The wired input/output interface may be a universal serial bus (USB) or IEEE 1394.

可攜式通訊裝置10亦可包含第二無線傳輸模組200B,其可以為相較於第一無線傳輸模組200A傳輸距離為短之通訊協定,如WiFi、WiMax等。在一實施例中,其係採用一無線短距(區域)網路模組且其可相容於區域或都會網路協定或其他規格,例如Wi-Fi規格或802.11x(x係指a、b、g、n)規格相容之模組。短距係指通訊距離短於手機通訊距離。再者,無線區域網路模組可與WiMAX規格或標準相容。使用者欲藉由WiFi或WiMax可耦合至網際網路或熱點。 The portable communication device 10 can also include a second wireless transmission module 200B, which can be a communication protocol with a short transmission distance compared to the first wireless transmission module 200A, such as WiFi, WiMax, and the like. In one embodiment, it employs a wireless short-range (area) network module and is compatible with regional or metropolitan network protocols or other specifications, such as Wi-Fi specifications or 802.11x (x refers to a, b, g, n) modules with compatible specifications. Short distance means that the communication distance is shorter than the communication distance of the mobile phone. Furthermore, the wireless local area network module is compatible with WiMAX specifications or standards. The user wants to be able to couple to the internet or hotspot via WiFi or WiMax.

立體影像(Stereo Image)擷取模組600與立體影像產生模組650耦合上述之DSP120或/及一中央控制單元100。上述之立體影像擷取模組600包含至少兩分隔一距離之影像擷取元件與對應之鏡頭300(參第二圖),影像擷取元件其可以為CMOS、CCD等,其上配有複數微透鏡以利於聚光及立體成像。兩者之距離較佳約為人類兩瞳孔之距離,藉由兩分離之影像擷取元件模擬人對於物之觀察,基於視角 差異同時取像,進而產生左、右稍有視角差異之影像。其較佳為兩影像擷取元件之連線沿通訊裝置之長軸方向配置。再將所取之至少兩影像儲存後,藉由立體影像產生模組650加以處理以利於產生立體影像。此可以利於產生立體影像、照片,螢幕之立體桌布、顯示器之虛擬物件、供通訊電話簿或郵件名冊所需之立體影像。透過左、右立體影像對產生立體影像。其成需通常包含調整立體影像對,包含放大、縮小、旋轉、平移;左、右影像交換(Swapping Left & Right images);修整影像(Trim);減少雜訊(Smooth display by the noise reduction),若可配合三維顯示器(3D displays)則更佳,例如Sharp's Auto3D LCD、Horizontal Interleaved 3D Display,如vRex microPol 3D LCD、Vertical Interleaved 3D LCD,如DTI,Pavonine。美國專利公開案US20090153653號中亦揭露一種立體顯示器。立體影像之重建可以採用JPS Builder合成技術建立合成影像,例如Texnai Incorporated所開發之合成技術,在此引入做為一實施例參考,非用以限定本發明。藉由本可攜式通訊裝置所取立體影像,經過處理後以利於呈現立體影像之資訊,亦可以直接透過第一或第二無線傳輸模組200A、200B傳輸上傳至網站、部落格或其他人,直接且便利,無須透過記憶卡轉換再以電腦上傳。此立體影像產生模組650亦可置於遠端,將立體影像擷取模組600所擷取之影像,經第二無線傳輸模組200B或第一無線傳輸模組200A 傳輸與遠端電腦或伺服器連結,傳輸到遠端處理;或者當連結後,直接以可攜式通訊裝置10呼叫啟動遠端之立體影像產生模組650處理立體影像產生程序,其結果可儲存於遠端電腦、伺服器或本可攜式通訊裝置10。 The Stereo Image capture module 600 and the stereo image generation module 650 are coupled to the DSP 120 or/and a central control unit 100 described above. The stereoscopic image capture module 600 includes at least two image capturing elements separated from each other and a corresponding lens 300 (refer to the second figure). The image capturing component can be a CMOS, a CCD, etc., and is provided with a plurality of micro The lens facilitates concentrating and stereo imaging. The distance between the two is preferably about the distance between the two pupils of the human body. The two separate image capturing components simulate the observation of the object, based on the angle of view. The difference is taken at the same time, which results in an image with a slight difference in left and right viewing angles. Preferably, the connection of the two image capturing elements is arranged along the long axis direction of the communication device. After the at least two images are stored, the image is processed by the stereo image generation module 650 to facilitate the generation of the stereo image. This can be advantageous for producing stereoscopic images, photos, a three-dimensional tablecloth for a screen, a virtual object for a display, a stereoscopic image for a communication phone book or a mailing list. A stereoscopic image is generated through the left and right stereo image pairs. Its requirements usually include adjusting stereoscopic image pairs, including zooming in, zooming out, rotating, panning; Swapping Left & Right images; trimming images (Trim) and smoothing by noise reduction (Smooth display by the noise reduction), It is better if it can be used with 3D displays, such as Sharp's Auto3D LCD, Horizontal Interleaved 3D Display, such as vRex microPol 3D LCD, Vertical Interleaved 3D LCD, such as DTI, Pavonine. A stereoscopic display is also disclosed in U.S. Patent Publication No. US20090153653. The reconstruction of the stereoscopic image can be performed using the JPS Builder synthesis technique, such as the synthetic technique developed by Texnai Incorporated, which is incorporated herein by reference. The stereoscopic image taken by the portable communication device can be processed to facilitate the presentation of the stereoscopic image information, and can also be directly transmitted to the website, blog or other person through the first or second wireless transmission module 200A, 200B. Direct and convenient, no need to convert via memory card and upload it by computer. The stereoscopic image generation module 650 can also be placed at the remote end, and the image captured by the stereoscopic image capturing module 600 can be transmitted through the second wireless transmission module 200B or the first wireless transmission module 200A. The transmission is connected to the remote computer or the server, and is transmitted to the remote processing; or, when connected, the stereoscopic image generation module 650 is directly called by the portable communication device 10 to process the stereoscopic image generation program, and the result can be stored. The remote computer, the server or the portable communication device 10.

使用者影像資料由立體影像擷取模組600擷取,接著將影像資料轉為數位資料。轉換後之影像資料經組成或壓縮或處理形成一資料流(data stream)。透過己身影像產生模組660產生己身影像,隨之即時或適時將其在立體顯示器160上顯示,例如使用者之鏡像或可加以調整產生己身可觀察之影像,讓使用者可以觀察到自己的成像,顯示器與攝影鏡頭為同一側。而利用上述本發明之特徵、觀點、教示與光學成像原理,及利用通常攝影成像原理可讓使用者可於拍攝本身時可以觀察到己身影像,有別時先前技術只能觀察被拍攝之他人成像,此時顯示器之顯像可為左右映射。基於其屬動態及時影像,如此可利於使用者將其作為虛擬鏡使用,為便利觀察自己影像,顯示器與攝影鏡頭必須位於電子裝置之同一側,亦即面對拍攝者。當使用者想使用鏡子整容、照鏡或塗抹唇膏時,若身邊無鏡子,則本發明提供一便利功能,取代鏡子。使用者則無須攜帶鏡子出門。上述之己身影像產生模組660可以採用程式軟體、韌體或電腦可讀取指令實施,目前已有多種產生影像之程式,而目前電腦技術上具有許多種產生影像之應用軟體,而目前數位攝影機亦有多種程式可以用於顯像。 The user image data is captured by the stereo image capturing module 600, and then the image data is converted into digital data. The converted image data is composed or compressed or processed to form a data stream. The image generation module 660 generates an image of the body through the body image generation module 660, and then displays it on the stereoscopic display 160, such as a user's image or can be adjusted to produce an observable image for the user to observe. Own imaging, the display and the photographic lens are on the same side. By utilizing the above-described features, viewpoints, teachings, and optical imaging principles of the present invention, and by utilizing the principle of normal photographic imaging, the user can observe the image of the body while shooting itself, and the prior art can only observe the others being photographed. Imaging, at this time the display of the display can be left and right mapping. Based on its dynamic and timely image, it can be used by users as a virtual mirror. To facilitate the observation of their own images, the display and the photographic lens must be on the same side of the electronic device, that is, facing the photographer. When the user wants to use a mirror to face, mirror or apply a lipstick, the present invention provides a convenient function to replace the mirror if there is no mirror around. Users do not need to bring a mirror to go out. The above-mentioned image generating module 660 can be implemented by using a software, firmware or computer readable command. At present, there are various programs for generating images, and currently there are many kinds of application software for generating images in computer technology, and the current digital The camera also has a variety of programs that can be used for imaging.

為利於本發明之使用,本發明提供單一或多重照明光源模組(multi-illumination sources module)170耦合至中央控制單元100,以在昏暗或弱光的環境下產生鏡像。因此,一選擇介面係耦合至多重照明光源模組170以便於模式之選擇。光感測器係耦合至一耦合於多重照明光源模組170。當光的強度小於一預定水準時,控制單元將針對光感測器所偵測到之訊號做出反應而啟動照明,以提供視訊通訊或照相所需之光線。照明光源之一模式可為夜視模式例如紅外線(infrared,IR)模式。其可在黑暗的環境下支援拍攝。上述照明模組包含紅外線裝置或LED。再者,照明模組包含氙氣照明裝置。例如氣體係一混合氣體,其主要為氮並具有特定數量之氬、氖、氙或氪以提供一催化劑讓氮離子化。使用者可根據不同狀況與不同目的選擇適當的照明。特別的是本發明可在昏暗之環境下執行。 To facilitate the use of the present invention, the present invention provides a single or multiple multi-illumination sources module 170 coupled to the central control unit 100 to produce a mirror image in a dim or low light environment. Thus, a selection interface is coupled to the multiple illumination source module 170 to facilitate selection of modes. The light sensor is coupled to a plurality of illumination source modules 170. When the intensity of the light is less than a predetermined level, the control unit will activate the illumination in response to the signal detected by the light sensor to provide the light required for video communication or photography. One mode of the illumination source may be a night vision mode such as an infrared (IR) mode. It supports shooting in dark environments. The above lighting module includes an infrared device or an LED. Furthermore, the lighting module includes a xenon illumination device. For example, a gas system, a mixed gas, which is primarily nitrogen and has a specific amount of argon, helium, neon or krypton to provide a catalyst for ionizing nitrogen. The user can select the appropriate lighting according to different conditions and different purposes. In particular, the invention can be practiced in dimly lit environments.

可攜式通訊裝置10包含一影像分割單元126耦合至中央控制單元100用以同步分割顯示器上之顯示區域以多重顯示影像。分割顯示器之方法可參考Canon Kabushiki Kaisha所取得之美國專利第7,171,019號與第7,142,689號,以及Hitachi Ltd所取得之美國專利第7,059,729號。因此,達到多方視訊通訊之目的。所接收之影像將被分配至顯示器上已分割之顯示區域,且顯示區域可為獨立的(分開的(separated)、重疊的(overlap)或部份重疊的(partial overlap)。請參閱第三圖,複數供入影像係傳輸至多工器或 多工模組(multi-tasking module)500A,以處理由多方所接收之影像。在將影像資料訊號傳送至立體顯示器160之前,上述影像將先經由影像分割單元126處理。可採用影像處理單元510以在顯示之前調整處理過之影像。 The portable communication device 10 includes an image segmentation unit 126 coupled to the central control unit 100 for synchronously dividing the display area on the display to display images in multiples. For the method of dividing the display, reference is made to U.S. Patent Nos. 7,171,019 and 7,142,689, both to the name of U.S. Pat. Therefore, the purpose of multi-party video communication is achieved. The received image will be assigned to the divided display area on the display, and the display area can be independent (separated, overlap or partial overlap). See Figure 3 , multiple input images are transmitted to the multiplexer or A multi-tasking module 500A is used to process images received by multiple parties. The image will be processed by the image segmentation unit 126 prior to transmitting the image data signal to the stereoscopic display 160. Image processing unit 510 can be employed to adjust the processed image prior to display.

而以上方法需採用兩個鏡頭與感測器,才得以形成立體影像;本發明以下之實施例係以單一影像擷取裝置,舉例而言,一影像擷取裝置,包含一個鏡頭與一個感測器,用以形成類立體影像。參閱第四圖所示,大部分裝置或元件類似或相似於第一圖所示,故不贅述。而於此實施例中,本發明包含單一影像擷取模組6000與類立體影像產生模組6500耦合上述之DSP 120或/及一中央控制單元100。本實施例無需如上述之立體影像擷取模組600需包含至少兩分隔一距離之影像擷取元件與對應之鏡頭300。本實施例之單一影像擷取元件其包含CMOS、CCD之一,其上可以配有複數微透鏡以利於聚光與成像。 The above method requires two lenses and sensors to form a stereoscopic image; the following embodiment of the present invention uses a single image capturing device, for example, an image capturing device, including a lens and a sensing device. For forming a stereoscopic image. Referring to the fourth figure, most of the devices or components are similar or similar to those shown in the first figure, and therefore will not be described again. In this embodiment, the present invention includes a single image capturing module 6000 and a stereoscopic image generating module 6500 coupled to the DSP 120 or/and a central control unit 100 described above. In this embodiment, the stereo image capturing module 600 does not need to include at least two image capturing elements separated by a distance and the corresponding lens 300. The single image capturing component of this embodiment comprises one of a CMOS and a CCD, and a plurality of microlenses may be disposed thereon to facilitate focusing and imaging.

而本發明類立體影像之產生方法或程序參見第五圖,首先利用一影像擷取裝置6000擷取第一影像500(亦參照第七、八圖A、B),之後儲存該被擷取的第一影像於儲存媒體502,例如記憶體、資料庫或暫存器內,擷取影像最好與該物體成一角度θ(參照第七圖),例如五度到三十度,角度不宜過大,否則會造成影像過度失真。之後,類立體影像產生模組6500水平翻轉該第一影像形成第二影像504(參照第五圖、第八圖A、B),而上述之第一影像與第 二影像做為建立類立體影像之具有視差之左、右眼資訊。基於此第二影像並非實際透過鏡頭取像,故所建立之立體影像姑且稱為類立體影像。若第一影像之取像角度與被擷取物體正面法線N的夾角為ω,則經過水平翻轉的第二影像,則可視之與被擷取物體正面法線夾角為-ω。此結果類似從不同角度擷取兩個不同角度的影像。之後,類立體影像產生模組6500則可以利用上述之第一影像與第二影像做為建立類立體影像之左、右眼影像資訊以利於產生類立體影像506(參照第五圖、第七圖、第八圖A、B)。所產生之類立體影像資訊可以儲存於資料庫。以本發明所產生之類立體影像並非實際擷取左、右眼資訊,而是以模擬方式模擬其中一張影像,故需知其並非取代實際三維影像,而是產生出類似的效果,故不可以期待完全與兩感測器所得知結果一樣。因此,此類立體影像的原始取樣中,若其具有不對稱圖案或構造,則會使產生之類似三維立體影像與原始特徵會圖案有所不同或變異,如第八圖B中之花紋圖案在類立體影像會有所不同,或如第九圖A中之較明顯之斑點900。此在類立體影像形成後可能會變成兩個對稱之斑點;另外之做法是類立體影像產生模組6500包含過濾模組,可以對第一影像、第二影像進行影像校正步驟510時,過濾大於臨界值以上之不對稱圖案。第九圖B是不建議的取樣角度,因其產生過度不對稱性;第九圖C是比較好的方式。的再次強調,本發明並不是要取代或產生實際兩個 感測器的結果,而是模擬立體影像,故稱類立體影像,使得使用者無需增添硬體,而可以創造立體影像,提升樂趣。 For the method or procedure for generating the stereoscopic image of the present invention, refer to the fifth figure. First, the first image 500 is captured by an image capturing device 6000 (also referred to as the seventh and eighth images A and B), and then the captured image is stored. The first image is stored in the storage medium 502, such as a memory, a database or a temporary storage device. The captured image is preferably at an angle θ to the object (refer to the seventh figure), for example, five degrees to thirty degrees, and the angle should not be too large. Doing so may cause excessive distortion of the image. Then, the stereoscopic image generation module 6500 horizontally flips the first image to form a second image 504 (refer to the fifth image, the eighth image, the A, B), and the first image and the first image The second image is used as a stereoscopic image to display left and right eye information with parallax. Since the second image is not actually taken through the lens, the stereo image created is called a stereoscopic image. If the angle between the image capturing angle of the first image and the front normal N of the captured object is ω, then the second image that has been horizontally flipped may be viewed as an angle of -ω from the front normal of the object being captured. This result is similar to capturing images from two different angles from different angles. Then, the stereoscopic image generation module 6500 can use the first image and the second image as the left and right eye image information of the stereoscopic image to facilitate the generation of the stereoscopic image 506 (refer to the fifth and seventh images). 8, Figure A, B). The generated stereoscopic image information can be stored in the database. The stereoscopic image generated by the present invention does not actually capture the left and right eye information, but simulates one of the images in an analog manner. Therefore, it is not necessary to replace the actual three-dimensional image, but a similar effect is generated, so It can be expected to be exactly the same as the results obtained by the two sensors. Therefore, in the original sampling of such a stereoscopic image, if it has an asymmetric pattern or structure, the similar three-dimensional image generated will be different or mutated from the original feature, as in the eighth figure B. The stereoscopic image may vary, or the more pronounced spot 900 as in Figure 9A. This may become two symmetrical spots after the stereoscopic image is formed. Alternatively, the stereoscopic image generation module 6500 includes a filter module, and when the image correction step 510 is performed on the first image and the second image, the filtering is greater than An asymmetric pattern above the critical value. The ninth panel B is a sampling angle that is not recommended because it produces excessive asymmetry; the ninth panel C is a better way. Again, the invention is not intended to replace or produce the actual two The result of the sensor is to simulate a stereoscopic image, so it is called a stereoscopic image, so that the user can create a stereoscopic image without adding hardware, and enhance the fun.

另一實施例請參閱第六圖,在完成類立體影像產生模組水平翻轉第一影像形成第二影像504之程序之後;可以分別或同時(多工處理)對於上述之第一影像、第二影像進行影像校正510。影像校正包含前置處理、影像分割、特徵擷取與影像比對。特徵擷取與影像比對包含許多方式,例如亮度導向(intensity base)、特徵導向(feature base)、綜合法(hybrid base)。可以參閱Chun-Jen Tsai,Aggelos K Katsaggelos(1999),Dense Display Estimation with a Divide-and-Conquer Space Image Technique,IEEE Trans.,Volume 1,P.18-20.J.J Kweon,Kang and Kim(1989),a Stereo Matching Algorithm Using Line Segament Feature,tencon’89.Forth IEEE Region 10 International Conference.P.589-592. For another embodiment, refer to the sixth figure, after completing the process of horizontally flipping the first image to form the second image 504 by the stereoscopic image generation module; separately or simultaneously (multiplex processing) for the first image and the second image. The image is image corrected 510. Image correction includes pre-processing, image segmentation, feature capture, and image alignment. Feature capture and image alignment include many methods, such as intensity base, feature base, and hybrid base. See Chun-Jen Tsai, Aggelos K Katsaggelos (1999), Dense Display Estimation with a Divide-and-Conquer Space Image Technique, IEEE Trans., Volume 1, P.18-20. JJ Kweon, Kang and Kim (1989) , a Stereo Matching Algorithm Using Line Segament Feature, tencon'89. Forth IEEE Region 10 International Conference. P.589-592.

在另一實施例中,亦可在校正之前或後,利用上述之第一影像、第二影像以內插法產生第一層次中間影像,增加影像資訊,儲存於資料庫或暫存器或記憶體。同理,可以在第一影像與第一層次中間影像之間以內插法再產生第二層次的中間影像;在第二影像與第一層次中間影像之間以內插法再產生第二層次的中間影像隨後中間影像。依此類推,可以依據需求產生不同層次之中間影像(例如第n層次中間影像),而增加模擬樣本以利於立體模型之建構。 In another embodiment, the first image and the second image may be interpolated to generate the first level intermediate image before or after the correction, and the image information may be added to the database or the temporary memory or the memory. body. Similarly, an intermediate image of the second level can be generated by interpolation between the first image and the first intermediate image; and the second level is generated by interpolation between the second image and the first intermediate image. The intermediate image is followed by an intermediate image. And so on, different levels of intermediate images (such as the n-th intermediate image) can be generated according to the requirements, and the simulation samples are added to facilitate the construction of the three-dimensional model.

控制單元配合類立體影像產生模組6500則對於上述之第一影像、第二影像(及第一層次中間影像....第n層次中間影像)進行運算,並進行(三角形)畫面分割程序512。Fisher曾提出以三角形分割法分割影像以符合影像之自然邊。目前已經具有許多方法可以將給定點將畫面分割為不相交的三角形,Delaunay所提出的分割程序的特點為任何三角形的頂點不會落入到其他三角形外接圓之內。Delaunay圖形結構經過旋轉與位移後還是唯一,換言之其原始圖形、經旋轉、平移後圖形結構不變。上述分割影像模組可以將顯示其分割至少顯示該第一影像、第二影像。在一選擇性實施例中,可估算上述角度與被拍攝物體距離(以紅外線量測)而推知估算基準線。產生位移向量514係利用後續影像與原本影像特徵點之比對,進而計算出特徵點之位移向量;同時或分別可以產生深度資訊516。深度資訊依據以下公式:Z=λ-[λb/[(x2-x1)2+(y2-y1)2]1/2] The control unit cooperates with the stereoscopic image generation module 6500 to calculate the first image and the second image (and the first intermediate image.. nth intermediate image) and perform a (triangle) screen segmentation process. 512. Fisher has proposed dividing the image by triangle segmentation to match the natural edges of the image. There are many ways to divide a picture into disjoint triangles at a given point. Delaunay's proposed segmentation procedure is characterized by the fact that the vertices of any triangle do not fall within the circumscribed circles of other triangles. The Delaunay graphic structure is still unique after rotation and displacement, in other words, its original graphics, rotated, and translated graphics structure are unchanged. The segmented image module can display the segmentation to display at least the first image and the second image. In an alternative embodiment, the angle between the angle and the subject being measured (measured in infrared) can be estimated to estimate the baseline. The displacement vector 514 is generated by comparing the subsequent image with the original image feature points, thereby calculating the displacement vector of the feature point; and the depth information 516 can be generated at the same time or separately. The depth information is based on the following formula: Z = λ - [λb / [(x 2 - x 1 ) 2 + (y 2 - y 1 ) 2 ] 1/2 ]

以上Z為深度;λ鏡頭焦距;b為基準線,為兩個透鏡中心之距離,本案則為透鏡至法線N距離之兩倍;(x1,y1),(x2,y2)為兩影像對應特徵點座標。依據上述公式可以推導出深度資訊,以利於建立物體模型之深度圖。上述之深度資訊以及座標可儲存於資料庫或記憶體,例如類立體影像資料庫518。攝影機上述之類立體影像資料庫518、類立體影像產生模組6500可以同時或分別位於區域端、遠端或 雲端伺服器。之後,利用上述資訊可以產生類立體影像520。其步驟可能包含但不限於不同視角之座標轉換、網格融合等步驟。其顯示方式可以利用三維顯示器裸眼觀看;或是利用立體眼鏡等方式觀看。 The above Z is the depth; the focal length of the λ lens; b is the reference line, which is the distance between the centers of the two lenses, and the case is twice the distance from the lens to the normal N; (x 1 , y 1 ), (x 2 , y 2 ) Corresponding to the feature point coordinates for the two images. According to the above formula, depth information can be derived to facilitate the establishment of a depth map of the object model. The depth information and coordinates described above may be stored in a database or memory, such as a stereoscopic image library 518. The stereoscopic image database 518 and the stereoscopic image generation module 6500 of the camera may be located at the same time, respectively, at the regional end, the remote end or the cloud server. Thereafter, a stereoscopic image 520 can be generated using the above information. The steps may include, but are not limited to, steps of coordinate conversion, mesh fusion, and the like of different viewing angles. The display mode can be viewed by the naked eye using the three-dimensional display; or by using stereo glasses or the like.

以上之裝置不限於通訊裝置,亦可以為智慧型手機、數位照相機、數位攝影機、平板電腦、筆記型電腦等。利用本發明之方法可以利用一影像擷取裝置產生類立體影像,而無需添購雙鏡頭裝置,使得現有裝置亦可以產生立體影像。因此重複以不同角度取像,再依此水平翻轉,則可具有多數取樣。在另一實施例中頁可以以連拍模式產生數個樣本以利於上述之分析。 The above devices are not limited to communication devices, but may also be smart phones, digital cameras, digital cameras, tablets, notebook computers, and the like. By using the method of the present invention, a stereoscopic image can be generated by using an image capturing device without adding a dual lens device, so that the existing device can also generate a stereoscopic image. Therefore, repeating the image at different angles and then flipping it horizontally can have a majority of samples. In another embodiment, the page may generate a number of samples in a continuous shooting mode to facilitate the analysis described above.

另一實施例參見第十圖,以影像擷取裝置擷取影像1000;儲存該被擷取的第一影像1010;選擇性影像校正第一影像1020;對第一影像實施Delaunay分割1030;之後對於第一影像做座標旋轉,以產生第二影像1040。可視需求是否對第二影像Delaunay分割。之後,可以選擇性進行產生位移向量1060或/及產生深度資訊1070。之後第一影像與第二影像儲存於類立體影像資料庫1080,以利於產生類立體影像1090。 In another embodiment, referring to the tenth figure, the image capturing device captures the image 1000; the captured first image 1010 is stored; the selective image corrects the first image 1020; and the first image is subjected to Delaunay segmentation 1030; The first image is rotated in coordinates to produce a second image 1040. Whether the visual demand is split for the second image Delaunay. Thereafter, the displacement vector 1060 or/and the depth information 1070 can be selectively generated. The first image and the second image are then stored in the stereoscopic image database 1080 to facilitate the generation of the stereoscopic image 1090.

再經過第一影像實施Delaunay分割1030後,可將各點作一空間座標旋轉,若已知旋轉角度θ,則空間中任意座標點P(x,y,z),可以由下面矩陣得到: 若Pz軸旋轉θ角,,若Px軸旋轉α角,Py軸旋轉β角, After the Delaunay segmentation 1030 is performed on the first image, each point can be rotated as a space coordinate. If the rotation angle θ is known, any coordinate point P(x, y, z) in the space can be obtained from the following matrix: P rotates the θ angle around the z axis, If P rotates the α angle around the x axis, If P rotates the β angle around the y axis,

經過上述座標旋轉可以得到以Delaunay分割之第二影像模型,之後要對於建立表面模型1035。通常此領域是利用網狀建立模型。網越細,則模型越精密。對於各網狀上色則形成物體。配合原先原始二維影像資訊,則可以得到各角度之影像,包含模擬左、右眼之影像。此方法可以解決特徵點不對稱問題。 After the above coordinate rotation, a second image model divided by Delaunay can be obtained, and then a surface model 1035 is created. Usually this area is built using mesh. The finer the mesh, the more precise the model. An object is formed for each mesh color. With the original original 2D image information, you can get images of all angles, including images of the left and right eyes. This method can solve the problem of feature point asymmetry.

參閱第十一圖,定義夾角θ所觀察到的兩張影像,B為基線,假設空間中某一點投射到兩張影像之座標為(x1,y1),(xr,yr);可以算出以左影像為基準時深度: Referring to Figure 11, define two images observed at angle θ, B is the baseline, assuming that a point in space is projected to the coordinates of two images (x 1 , y 1 ), (x r , y r ); You can calculate the depth based on the left image:

另一實施例中,參第十二圖,世界座標系統與感測器系統之轉換為: In another embodiment, referring to the twelfth figure, the conversion of the world coordinate system and the sensor system is:

(XW,YW,ZW)為世界座標之一位置點;(CX,CY)光軸中心點;FK為像距;ri旋轉矩陣R=RXRYRZ係數;(X0,Y0,Z0)為世界座標之參考點;兩者座標關係為: (X W , Y W , Z W ) is one of the coordinates of the world coordinates; (C X , C Y ) the optical axis center point; F K is the image distance; r i rotation matrix R = R X R Y R Z coefficient; (X 0 , Y 0 , Z 0 ) is the reference point of the world coordinates; the coordinate relationship between the two is:

平移座標:R=R x R y R Z Translation coordinates: , R = R x R y R Z

Rx對Xk旋轉α角度: Rx rotates α angle to Xk:

Ry對Yk旋轉β角度: Ry rotates the β angle of Yk:

Rz對Yz旋轉γ角度: Rz rotates γ angle to Yz:

因此可以依照上述得到當模擬感測器對任何軸旋轉的對應位置。若由第一位置可以依此推出第二位置。參閱第十三圖,依據相似三角形關係可得:X1=x1(λ-Z1)/λ;λ為感測器之鏡頭焦距;X2=x2(λ-Z2)/λ;且X2=X1+b(感測器距離);Z=Z1=Z2 Z=λ-λb/(x2-x1) Therefore, the corresponding position when the analog sensor is rotated for any axis can be obtained as described above. The second position can be derived from the first position. Referring to the thirteenth figure, according to the similar triangle relationship: X 1 = x 1 (λ-Z 1 ) / λ; λ is the lens focal length of the sensor; X 2 = x 2 (λ - Z 2 ) / λ; And X 2 =X 1 +b (sensor distance); Z=Z 1 =Z 2 Z=λ-λb/(x 2 -x 1 )

本發明以較佳實施例說明如上,然其並非用以限定本發明所主張之專利權利範圍。其專利保護範圍當視後附之申請專利範圍及其等同領域而定。凡熟悉此領域之技藝者,在不脫離本專利精神或範圍內,所作之更動或潤飾,均屬於本發明所揭示精神下所完成之等效改變或設計,且應包含在下述之申請專利範圍內。 The present invention has been described above by way of a preferred embodiment, and is not intended to limit the scope of the claimed invention. The scope of patent protection is subject to the scope of the patent application and its equivalent fields. Any modification or refinement made by those skilled in the art without departing from the spirit or scope of the present invention is equivalent to the equivalent change or design made in the spirit of the present disclosure, and should be included in the following patent application scope. Inside.

10‧‧‧可攜式通訊裝置 10‧‧‧Portable communication device

100‧‧‧中央控制單元 100‧‧‧Central Control Unit

105‧‧‧天線系統 105‧‧‧Antenna system

125‧‧‧類比/數位轉換器 125‧‧‧ Analog/Digital Converter

126‧‧‧影像分割單元 126‧‧‧Image segmentation unit

145‧‧‧作業系統 145‧‧‧Operating system

155‧‧‧記憶體 155‧‧‧ memory

170‧‧‧多重照明光源模組 170‧‧‧Multiple illumination source module

190‧‧‧聲音輸入/輸出單元 190‧‧‧Sound input/output unit

200A‧‧‧第一無線傳輸模組 200A‧‧‧First wireless transmission module

200B‧‧‧第二無線傳輸模組 200B‧‧‧Second wireless transmission module

500A‧‧‧多工模組 500A‧‧‧Multiplex module

600‧‧‧立體影像擷取模組 600‧‧‧3D image capture module

650‧‧‧立體影像產生模組 650‧‧‧3D image generation module

660‧‧‧己身影像產生模組 660‧‧‧The body image generation module

6000‧‧‧類立體影像擷取模組 6000‧‧‧3D stereo image capture module

6500‧‧‧類立體影像產生模組 6500‧‧‧3D stereo image generation module

500‧‧‧以影像擷取裝置擷取影像 500‧‧‧Capture images with image capture device

502‧‧‧儲存該被擷取的第一影像於儲存媒體 502‧‧‧Storing the captured first image on the storage medium

504‧‧‧類立體影像產生模組水平翻轉該第一影像形成第二影像 The 504‧‧‧ type stereo image generating module horizontally flips the first image to form a second image

506‧‧‧類立體影像產生模組處理該第一影像與第二影像產生類立體影像 The 506‧‧‧ type stereo image generating module processes the first image and the second image to generate a stereoscopic image

508‧‧‧類立體影像產生模組以內插法處理該第一影像與第二影像產生中間影像 The 508‧‧‧ type stereo image generating module processes the first image and the second image to generate an intermediate image by interpolation

510‧‧‧影像校正第一影像與第二影像 510‧‧‧Image correction first image and second image

512‧‧‧Delaunay分割 512‧‧‧Delaunay segmentation

514‧‧‧產生位移向量 514‧‧‧ Generate displacement vector

516‧‧‧產生深度資訊 516‧‧‧ Generate in-depth information

518‧‧‧類立體影像資料庫 518‧‧‧3D stereoscopic image database

520‧‧‧類立體影像產生模組產生類立體影像 520‧‧‧3D stereo image generation module produces stereoscopic images

1000‧‧‧以影像擷取裝置擷取影像 1000‧‧‧Capture images with image capture device

1010‧‧‧儲存該被擷取的第一影像 1010‧‧‧Storing the first image captured

1020‧‧‧選擇性影像校正第一影像 1020‧‧‧Selective image correction first image

1030‧‧‧對第一影像實施Delaunay分割 1030‧‧‧Delunay segmentation of the first image

1040‧‧‧對於第一影像做座標旋轉,以產生第二影像 1040‧‧‧ coordinate rotation of the first image to produce a second image

1060‧‧‧產生位移向量 1060‧‧‧ Generate displacement vector

1070‧‧‧產生深度資訊 1070‧‧‧ Generated in-depth information

1080‧‧‧儲存於類立體影像資料庫 1080‧‧‧Stored in a stereoscopic image database

1090‧‧‧產生類立體影像 1090‧‧‧ produces stereoscopic images

藉由參考下列詳細敘述,將可以更快地瞭解上述觀點以及本發明之優點,並且藉由下面的描述以及附加圖式,可以更容易瞭解本發明之精神。其中: The above aspects and advantages of the present invention will be more readily understood from the following detailed description of the invention. among them:

第一圖顯示出本發明之裝置的方塊圖。 The first figure shows a block diagram of the apparatus of the present invention.

第二圖顯示出本發明實施例的方塊圖。 The second figure shows a block diagram of an embodiment of the invention.

第三圖顯示出本發明實施例的示意圖。 The third figure shows a schematic diagram of an embodiment of the invention.

第四圖顯示出本發明之裝置的方塊圖。 The fourth figure shows a block diagram of the apparatus of the present invention.

第五圖顯示出本發明實施例的流程圖。 The fifth figure shows a flow chart of an embodiment of the present invention.

第六圖顯示出本發明實施例的流程圖。 The sixth figure shows a flow chart of an embodiment of the present invention.

第七圖顯示出本發明實施例的示意圖。 The seventh figure shows a schematic diagram of an embodiment of the invention.

第八圖A、B顯示出本發明實施例的示意圖。 Eighth A and B show schematic views of an embodiment of the present invention.

第九圖A、B、C顯示出本發明實施例的示意圖。 The ninth diagrams A, B, and C show schematic views of an embodiment of the present invention.

第十圖顯示出本發明實施例的流程圖。 The tenth figure shows a flow chart of an embodiment of the present invention.

第十一圖顯示出本發明實施例的示意圖。 An eleventh drawing shows a schematic view of an embodiment of the present invention.

第十二圖顯示本發明相對座標示意圖。 Figure 12 is a schematic view showing the relative coordinates of the present invention.

第十三圖顯示感測器對軸旋轉的對應位置。 The thirteenth image shows the corresponding position of the sensor for the rotation of the shaft.

500‧‧‧以影像擷取裝置擷取影像 500‧‧‧Capture images with image capture device

502‧‧‧儲存該被擷取的第一影像於儲存媒體 502‧‧‧Storing the captured first image on the storage medium

504‧‧‧類立體影像產生模組水平翻轉該第一影像形成第二影像 The 504‧‧‧ type stereo image generating module horizontally flips the first image to form a second image

506‧‧‧類立體影像產生模組處理該第一影像與第二影像產生類立體影像 The 506‧‧‧ type stereo image generating module processes the first image and the second image to generate a stereoscopic image

Claims (20)

一種以單一影像擷取模組產生立體影像之裝置,包含:控制單元;顯示器耦合至該控制單元;影像擷取模組,耦合至該控制單元,以利於擷取第一影像;及類立體影像產生模組,耦合至該控制單元,以利於將該第一影像水平翻轉產生第二影像;該第一與該第二影像利於產生類立體影像資訊,其中上述之類立體影像產生模組可儲存於該裝置中,或儲存於遠端、雲端伺服器以利於使用者下載至該裝置,或上傳至該遠端、雲端伺服器處理,其中該類立體影像產生模組包含一過濾模組,用以過濾該第一影像與該第二影像中大於臨界值以上之不對稱圖案。 An apparatus for generating a stereoscopic image by using a single image capturing module includes: a control unit; a display coupled to the control unit; an image capturing module coupled to the control unit to facilitate capturing the first image; and a stereoscopic image a generating module coupled to the control unit to facilitate horizontally flipping the first image to generate a second image; the first and the second image are configured to generate stereoscopic image information, wherein the stereo image generating module can store In the device, or stored in the remote, cloud server for the user to download to the device, or uploaded to the remote, cloud server processing, wherein the stereo image generating module comprises a filtering module, And filtering an asymmetric pattern of the first image and the second image that is greater than a critical value. 如請求項1所述之以單一影像擷取模組產生立體影像之裝置,其中該影像擷取模組包含影像擷取元件。 The apparatus for generating a stereoscopic image by using a single image capturing module according to claim 1, wherein the image capturing module comprises an image capturing component. 如請求項2所述之以單一影像擷取模組產生立體影像之裝置,其中該影像擷取元件包含CMOS或CCD。 The apparatus for generating a stereoscopic image by using a single image capturing module according to claim 2, wherein the image capturing component comprises a CMOS or a CCD. 如請求項1或2或3所述之以單一影像擷取模組產生立體影像之裝置,其中該類立體影像產生模組可執行類立體影像產生程序。 The apparatus for generating a stereoscopic image by using a single image capturing module according to claim 1 or 2 or 3, wherein the stereoscopic image generating module can execute a stereoscopic image generating program. 如請求項1或2或3所述之以單一影像擷取模組產生立體影像之裝置,其中該類立體影像產生模組可執行以內插法處理該第一影像與第二影像以利於產生中間影像之程序。 The apparatus for generating a stereoscopic image by using a single image capturing module according to claim 1 or 2 or 3, wherein the stereoscopic image generating module can perform interpolation to process the first image and the second image to facilitate intermediate generation. Image program. 如請求項1或2或3所述之以單一影像擷取模組產生立體影像之裝置,其中該類立體影像產生模組可執行影像分割程序。 The apparatus for generating a stereoscopic image by using a single image capturing module according to claim 1 or 2 or 3, wherein the stereoscopic image generating module can perform an image segmentation process. 如請求項6所述之以單一影像擷取模組產生立體影像之裝置,其中該分割程序包含Delaunay分割。 The apparatus for generating a stereoscopic image by a single image capturing module as claimed in claim 6, wherein the segmentation program comprises a Delaunay segmentation. 如請求項7所述之以單一影像擷取模組產生立體影像之裝置,其中該類立體影像產生模組可產生位移向量及深度資訊。 The apparatus for generating a stereoscopic image by a single image capturing module as described in claim 7, wherein the stereoscopic image generating module generates displacement vectors and depth information. 如請求項1或2或3所述之以單一影像擷取模組產生立體影像之裝置,更包含影像分割模組耦合至該控制單元以利於分割該顯示器之顯示區域。 The apparatus for generating a stereoscopic image by a single image capturing module according to claim 1 or 2 or 3, further comprising a video segmentation module coupled to the control unit to facilitate segmentation of a display area of the display. 如請求項1或2或3所述之以單一影像擷取模組產生立體影像之裝置,其中該顯示器為三維顯示器。 A device for generating a stereoscopic image by a single image capturing module as claimed in claim 1 or 2 or 3, wherein the display is a three-dimensional display. 一種以單一影像擷取模組產生類立體影像之方法,包含:以一影像擷取裝置擷取一物體之第一影像;水平翻轉該第一影像以產生第二影像;過濾該第一影像與該第二影像中大於臨界值以上之不對稱圖案;儲存該第一影像與該第二影像於記憶體中,做為產生類立體影像之資訊。 A method for generating a stereoscopic image by using a single image capturing module, comprising: capturing an image of an object by an image capturing device; horizontally flipping the first image to generate a second image; filtering the first image and An asymmetric pattern of the second image that is greater than a threshold; storing the first image and the second image in the memory as information for generating a stereoscopic image. 如請求項11之以單一影像擷取模組產生類立體影像之方法,其中更包含以類立體影像產生模組執行類立體影像產生程序。 The method for generating a stereoscopic image by using a single image capturing module according to claim 11 further includes performing a stereoscopic image generating program by the stereoscopic image generating module. 如請求項11所述之以單一影像擷取模組產生類立體影像之方法,其中更包含以內插法處理該第一影像與第二影像以利於產生中間影像。 The method for generating a stereoscopic image by using a single image capturing module, as described in claim 11, further comprising processing the first image and the second image by interpolation to facilitate generating an intermediate image. 如請求項12所述之以單一影像擷取模組產生類立體影像之方法,其中更包含以該類立體影像產生模組執行影像分割程序。 The method for generating a stereoscopic image by using a single image capturing module as described in claim 12, further comprising performing a video segmentation process by using the stereoscopic image generating module. 如請求項14所述之以單一影像擷取模組產生類立體影 像之方法,其中該分割程序包含Delaunay分割。 Producing a stereoscopic image with a single image capture module as described in claim 14 Like the method, where the segmentation program contains Delaunay segmentation. 如請求項15所述之以單一影像擷取模組產生類立體影像之方法,其中該類立體影像產生模組可產生位移向量及深度資訊。 The method for generating a stereoscopic image by using a single image capturing module as described in claim 15, wherein the stereoscopic image generating module can generate a displacement vector and depth information. 一種以單一影像擷取模組產生類立體影像之方法,包含:以一影像擷取裝置擷取一物體之第一影像;座標旋轉該第一影像以產生第二影像;儲存該第一影像與該第二影像於記憶體中,做為產生類立體影像之資訊;以類立體影像產生模組產生位移向量及深度資訊。 A method for generating a stereoscopic image by using a single image capturing module includes: capturing an image of an object by an image capturing device; rotating the first image to generate a second image; storing the first image and The second image is used in the memory as information for generating stereoscopic images; the displacement vector and depth information are generated by the stereoscopic image generation module. 如請求項17所述之以單一影像擷取模組產生類立體影像之方法,其中更包含以內插法處理該第一影像與第二影像以利於產生中間影像。 The method for generating a stereoscopic image by using a single image capturing module, as described in claim 17, further comprising processing the first image and the second image by interpolation to facilitate generating an intermediate image. 如請求項17所述之以單一影像擷取模組產生類立體影像之方法,其中該類立體影像產生模組可執行影像分割程序。 The method for generating a stereoscopic image by using a single image capturing module as described in claim 17, wherein the stereoscopic image generating module can perform an image segmentation process. 如請求項19所述之以單一影像擷取模組產生類立體影 像之方法,其中該分割程序包含Delaunay分割。 Producing a stereoscopic image with a single image capture module as described in claim 19 Like the method, where the segmentation program contains Delaunay segmentation.
TW100130833A 2011-08-26 2011-08-26 Portable device with single image capturing module to form sterio-image and the method thereof TWI517666B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW100130833A TWI517666B (en) 2011-08-26 2011-08-26 Portable device with single image capturing module to form sterio-image and the method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW100130833A TWI517666B (en) 2011-08-26 2011-08-26 Portable device with single image capturing module to form sterio-image and the method thereof

Publications (2)

Publication Number Publication Date
TW201310968A TW201310968A (en) 2013-03-01
TWI517666B true TWI517666B (en) 2016-01-11

Family

ID=48482158

Family Applications (1)

Application Number Title Priority Date Filing Date
TW100130833A TWI517666B (en) 2011-08-26 2011-08-26 Portable device with single image capturing module to form sterio-image and the method thereof

Country Status (1)

Country Link
TW (1) TWI517666B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI725620B (en) * 2019-11-14 2021-04-21 大陸商南京深視光點科技有限公司 Omnidirectional stereo vision camera configuration system and camera configuration method

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI523469B (en) 2014-02-24 2016-02-21 廣達電腦股份有限公司 Multi-channel sharing apparatus and multi-channel sharing method

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI725620B (en) * 2019-11-14 2021-04-21 大陸商南京深視光點科技有限公司 Omnidirectional stereo vision camera configuration system and camera configuration method

Also Published As

Publication number Publication date
TW201310968A (en) 2013-03-01

Similar Documents

Publication Publication Date Title
CN110663245B (en) Apparatus and method for storing overlapping regions of imaging data to produce an optimized stitched image
TWI451358B (en) Banana codec
CN111279673B (en) System and method for image stitching with electronic rolling shutter correction
CN106101689B (en) The method that using mobile phone monocular cam virtual reality glasses are carried out with augmented reality
CN105339841B (en) The photographic method and bimirror head apparatus of bimirror head apparatus
US20190228500A1 (en) Information processing method, information processing device, and program
US9646404B2 (en) Information processing method, information processing device, and program that facilitates image processing operations on a mobile device
EP3429195A1 (en) Method and system for image processing in video conferencing for gaze correction
WO2017113681A1 (en) Video image processing method and apparatus based on virtual reality technology
US20160180593A1 (en) Wearable device-based augmented reality method and system
CN106797459A (en) The transmission of 3 D video
CN104599317A (en) Mobile terminal and method for achieving 3D (three-dimensional) scanning modeling function
JP2023065502A (en) Mixed reality display device and mixed reality display method
WO2023169283A1 (en) Method and apparatus for generating binocular stereoscopic panoramic image, device, storage medium, and product
WO2022166868A1 (en) Walkthrough view generation method, apparatus and device, and storage medium
TWI517666B (en) Portable device with single image capturing module to form sterio-image and the method thereof
US20230281916A1 (en) Three dimensional scene inpainting using stereo extraction
CN115002442B (en) Image display method and device, electronic equipment and storage medium
US11636708B2 (en) Face detection in spherical images
CN107087153A (en) 3D rendering generation method, device and VR equipment
CN107087114B (en) Shooting method and device
JP7336871B2 (en) All-dome video processing device and program
CN112804451B (en) Method and system for photographing by utilizing multiple cameras and mobile device
US20230072247A1 (en) Method and device for processing image content
US20110111699A1 (en) Portable Device Having Sterio-image Capturing Module

Legal Events

Date Code Title Description
MM4A Annulment or lapse of patent due to non-payment of fees