TW201502691A - Systems and methods for generating a panoramic image - Google Patents

Systems and methods for generating a panoramic image Download PDF

Info

Publication number
TW201502691A
TW201502691A TW103120316A TW103120316A TW201502691A TW 201502691 A TW201502691 A TW 201502691A TW 103120316 A TW103120316 A TW 103120316A TW 103120316 A TW103120316 A TW 103120316A TW 201502691 A TW201502691 A TW 201502691A
Authority
TW
Taiwan
Prior art keywords
camera
image data
cameras
downstream
data
Prior art date
Application number
TW103120316A
Other languages
Chinese (zh)
Other versions
TWI545388B (en
Inventor
Kuochin Chang
Hasan Gardjali
Original Assignee
Omnivision Tech Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Omnivision Tech Inc filed Critical Omnivision Tech Inc
Publication of TW201502691A publication Critical patent/TW201502691A/en
Application granted granted Critical
Publication of TWI545388B publication Critical patent/TWI545388B/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/698Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

Systems and methods for generating a panoramic image include capturing image data from a plurality of cameras and storing the image data within a memory buffer of the respective camera; transmitting image data from an upstream camera to a downstream camera; and combining, within the downstream camera, the image data from the upstream camera with the image data of the downstream camera as combined image data. Each of the plurality of cameras may include an imaging array for capturing image data of a scene; a receiver for receiving image data from an upstream camera of the plurality of cameras; a memory buffer for: combining the image data received from the upstream camera with image data captured by the imaging array to form combined image data, and storing the combined image data; and a transmitter for transmitting the stored combined image data to a downstream camera of the plurality of camera.

Description

產生全景圖像的系統和方法 System and method for generating panoramic images

本發明係關於產生全景視圖的圖像感測器。特別地,利用複數個CMOS圖像感測器構建行動產業處理器介面(MIPI)菊鍊(daisy chain),以建造全景視圖。 The present invention is directed to an image sensor that produces a panoramic view. Specifically, a Mobile Industry Processor Interface (MIPI) daisy chain is constructed using a plurality of CMOS image sensors to construct a panoramic view.

智慧手機通常使用單一攝像機以產生全景圖像,而使用者需適當地調整攝像機之角度與位置,以捕捉複數個圖像,惟,此操作步驟麻煩,且需耗費使用者心思與技巧,除此之外,將複數個場景融合為一全景圖像乃是一大技術考驗。 Smart phones usually use a single camera to create a panoramic image, and the user needs to adjust the angle and position of the camera to capture multiple images. However, this operation is cumbersome and requires user's mind and skill. In addition, the fusion of multiple scenes into a panoramic image is a major technical test.

本發明之第一觀點,揭示一種用以產生全景圖像之方法,包括:複數個攝像機所捕捉的圖像數據,並將圖像數據儲存於各自攝像機之記憶體緩衝器內圖像數據;自上游攝像機傳送圖像數據至下游攝像機;以及於下游攝像機內,將上游攝像機的圖像數據與下游攝像機的圖像數據相組合,以成為組合圖像數據。 A first aspect of the present invention discloses a method for generating a panoramic image, comprising: image data captured by a plurality of cameras, and storing the image data in image memory in a memory buffer of a respective camera; The upstream camera transmits the image data to the downstream camera; and in the downstream camera, combines the image data of the upstream camera with the image data of the downstream camera to become combined image data.

本發明之第二觀點,揭示一種用以產生全景圖像之系統,包括複數個攝像機,每一攝像機具有用以捕捉場景圖像數據的成像陣列、用以接收複數個攝像機上游攝像機圖像數據的接收器、記憶體緩衝器將上游攝像機接收到的圖像數據與成像陣列所捕捉到的圖像數據相組合,以成為組合圖像數據並儲存之,以及用以傳送組合圖像數據至複數個攝像機下游攝像機的傳送器。 A second aspect of the present invention discloses a system for generating a panoramic image, comprising a plurality of cameras each having an imaging array for capturing scene image data for receiving image data of a plurality of camera upstream cameras. The receiver and the memory buffer combine the image data received by the upstream camera with the image data captured by the imaging array to be combined image data and stored, and to transmit the combined image data to a plurality of The transmitter of the camera downstream of the camera.

1、2、102、104、106、302a-302d、307a-307d‧‧‧攝像機 1, 2, 102, 104, 106, 302a-302d, 307a-307d‧‧‧ cameras

100‧‧‧菊鍊 100‧‧‧ daisy chain

108‧‧‧主機 108‧‧‧Host

110‧‧‧數據線、線路 110‧‧‧Data lines, lines

112、114、116‧‧‧陣列 112, 114, 116‧‧‧ array

113、115、117‧‧‧圖像數據、數據 113, 115, 117‧‧‧ image data, data

118、120、122‧‧‧緩衝器 118, 120, 122‧‧ ‧ buffer

124、126、128‧‧‧MIPI接收器 124, 126, 128‧‧‧ MIPI Receiver

130、132、134‧‧‧MIPI傳送器 130, 132, 134‧‧‧ MIPI transmitter

300‧‧‧配置 300‧‧‧Configuration

302A-302D‧‧‧各側 302A-302D‧‧‧ sides

302、304、306‧‧‧配置 302, 304, 306‧‧‧ configuration

308‧‧‧CPU 308‧‧‧CPU

400‧‧‧方法 400‧‧‧ method

402、404、406、408、410、412‧‧‧步驟 402, 404, 406, 408, 410, 412‧ ‧ steps

500‧‧‧位址識別碼 500‧‧‧ address identification code

600、700‧‧‧數據傳輸圖 600, 700‧‧‧ data transmission diagram

601‧‧‧寫入位元 601‧‧‧Write bit

701‧‧‧讀出位元 701‧‧‧Reading bit

602、702、704‧‧‧認證 602, 702, 704‧‧‧ certification

800‧‧‧通用呼叫 800‧‧‧General Call

本發明將以較佳之實施例及觀點加以詳細敘述。下列圖式及描述提供本發明特定的施行細節,俾使閱者徹底瞭解這些實施例之實行方式。然該領域之熟習技藝者須瞭解本發明亦可在不具備這些細節之條件下實行。此外,文中不會對一些已熟知之結構或功能或是做細節描述,以避免各種實施例 間不必要相關描述之混淆,以下描述中之術語將以最廣義的合理方式解釋,即使其與本發明某特定實施例之細節描述一起使用。另外,附圖並未描繪實際實施例之每一特徵,所描繪之圖式元件係皆為相對尺寸而非按比例繪製。圖式中相同之元件符號係代表相同之元件,然而,為清楚說明之目的,於不同圖式中重複出現的元件未必會再標示元件符號。藉由參考下列詳細敘述,將可以更快速地瞭解上述觀點以及本發明之優點,並且藉由下面的描述及附加圖式,更容易了解本發明之精神。 The invention will be described in detail in the preferred embodiments and aspects. The following figures and description are provided to provide a detailed description of the specific embodiments of the present invention, and to provide a thorough understanding of the embodiments. Those skilled in the art will appreciate that the present invention may be practiced without these details. In addition, some well-known structures or functions or details are not described herein to avoid various embodiments. The terms in the following description are to be interpreted in a broadest sense, even if they are used in conjunction with the detailed description of a particular embodiment of the invention. In addition, the drawings do not depict each feature of the actual embodiments, and the depicted figures are in relative dimensions and not drawn to scale. The same component symbols in the drawings represent the same components, however, for the purpose of clarity, the components that are repeated in different figures are not necessarily labeled with the component symbols. The above aspects and the advantages of the present invention will be more readily understood from the following detailed description, and the <RTIgt;

第1圖係根據本發明之一實施例顯示全景圖像之複數個成像陣列之菊鍊架構圖。 1 is a daisy chain architecture diagram of a plurality of imaging arrays displaying panoramic images in accordance with an embodiment of the present invention.

第2圖示係根據第1圖菊鍊顯示複數個攝像機所接收到數據排之處理程序示意圖。 The second illustration is a schematic diagram showing a processing procedure for receiving data rows by a plurality of cameras according to the first diagram of the daisy chain.

第3圖係顯示菊鍊內複數個攝像機之示例性配置。 Figure 3 shows an exemplary configuration of a plurality of cameras within a daisy chain.

第4圖係根據本發明之一實施例顯示攝像機菊鍊產生圖像之流程圖。 Figure 4 is a flow chart showing the imagery produced by the camera daisy chain in accordance with an embodiment of the present invention.

第5圖係根據第1圖菊鍊內每一裝置的位址識別碼。 Figure 5 is an address identification code for each device in the daisy chain according to Figure 1.

第6圖係根據本發明之一實施例顯示主裝置寫入次要裝置之數據傳輸示意圖。 Figure 6 is a diagram showing the data transfer of a master device to a secondary device in accordance with an embodiment of the present invention.

第7圖係根據本發明之一實施例顯示主裝置讀取次要裝置之數據傳輸示意圖。 Figure 7 is a schematic diagram showing the data transfer of a master device reading a secondary device in accordance with an embodiment of the present invention.

第8圖係顯示第1圖I2C匯流排線路上的通用呼叫。 Figure 8 shows the general call on the I 2 C bus line of Figure 1.

本案之實施例可應用於全景或環繞視圖成像、3D成像、手勢識別。文中所描述的攝像機係由電纜耦接為菊鍊,而非光纖之形式。 Embodiments of the present invention are applicable to panoramic or surround view imaging, 3D imaging, gesture recognition. The cameras described herein are coupled by a cable to a daisy chain rather than an optical fiber.

複數個攝像機(或圖像感測器)可實現全景視圖。於某些實施例中,當攝像機對齊完成預校準(pre-calibration)後,複數個攝像機無須對齊任一軸向。由於複數個攝像機間會有重疊現象產生,然一次性可編程(OTP)記憶體得編程為讀出(read out),俾使攝像機產生的全景圖像無重疊現象。 A plurality of cameras (or image sensors) can implement a panoramic view. In some embodiments, after the camera alignment is pre-calibrated, the plurality of cameras need not be aligned with either axis. Since there is overlap between a plurality of cameras, one-time programmable (OTP) memory is programmed to read out, so that the panoramic images produced by the camera are not overlapped.

於一個實施例中,無影像記憶體存在,僅有列緩衝器(line buffer)記憶體。於另一個實施例中,下文所描述之額外影像記憶體用以處理每一單獨影像並加以組合之。 In one embodiment, no image memory is present, only column buffer memory. In another embodiment, the additional image memory described below is used to process each individual image and combine it.

於一些實施例中,列緩衝器(line buffer)與畫中畫(picture-in-picture)(PIP)主緩衝器共用數據。 In some embodiments, the line buffer shares data with a picture-in-picture (PIP) main buffer.

水平消隱時間(H消隱時間)係由每個感測器收集的圖像列數據傳輸至主機所需的時間來定義之。例如,H消隱時間可與系統中的圖像感測器數量成比例。數據傳輸率(即傳輸和接收速率)係由MIPI之傳送通道(Tx)和接收通道(Rx)所限制。 The horizontal blanking time (H blanking time) is defined by the time required for each image column data collected by each sensor to be transmitted to the host. For example, the H blanking time can be proportional to the number of image sensors in the system. The data transmission rate (ie, transmission and reception rate) is limited by the transmission channel (Tx) and reception channel (Rx) of MIPI.

於一個實施例中,全域內部積體電路識別碼(I2C ID)用以辨別攝像機鏈(或圖像感測器),且各自單獨的I2C ID用以辨別每一特定攝像機(或圖像感測器)。每一攝像機於初始設定期間,從OTP記憶體載入各自I2C ID。下文將進一步詳細討論與I2C協議相關的實施例。於一個實施例中,所描述之"中介"感測器僅用以旁通數據。實施例之攝像機對準排列如第3圖所示,舉例而言,裝置302描述位於手機上的四個攝像機所產生之全景圖像。配置304描述手勢識別之實施例。配置306係從俯視角度以描述示例性汽車監視系統。 In one embodiment, the global internal integrated circuit identification code (I 2 C ID) is used to identify the camera chain (or image sensor), and each individual I 2 C ID is used to identify each specific camera (or Image sensor). Each camera loads its respective I 2 C ID from the OTP memory during initial setup. Embodiments related to the I 2 C protocol are discussed in further detail below. In one embodiment, the described "intermediate" sensor is only used to bypass data. The camera alignment of an embodiment is shown in Figure 3, for example, device 302 depicts a panoramic image produced by four cameras located on a cell phone. Configuration 304 describes an embodiment of gesture recognition. Configuration 306 is from a top perspective to describe an exemplary automotive monitoring system.

第1圖係根據本發明之一實施例顯示複數個成像陣列之菊鍊100之示意圖,其用以形成全景圖像。菊鍊100可為MIPI菊鍊,其包括輸入介面和輸出介面。來自主機處理器之控制信號係通過I2C線以輸入至每一攝像機中,此外,每一攝像機包括同步信號(FSIN)輸入端,以使所有的攝像機同時獲取圖片,同步之優點在於,影像間無運動模糊現象。 1 is a schematic diagram showing a daisy chain 100 of a plurality of imaging arrays for forming a panoramic image in accordance with an embodiment of the present invention. The daisy chain 100 can be a MIPI daisy chain that includes an input interface and an output interface. Control signals from the host processor are input to each camera through the I 2 C line. In addition, each camera includes a sync signal (FSIN) input so that all cameras simultaneously acquire images. The advantage of synchronization is that the image There is no motion blur between them.

MIPI菊鍊100包括三個成像攝像機102、104和106,彼此串聯耦合,並且藉由I2C數據線110耦接至主機108。主機108可為處理器,或其他可替代性主機108,較佳地為下游攝像機(downstream camera),其包括經由I2C數據線110以控制上游攝像機(upstream camera)定時的處理器。本發明不侷限於僅I2C匯流排協定,亦即,可藉由其它連接協定(connection protocol)以耦接攝像機102、104和106以及主機108,此外,在不脫離本發明之精神與範圍的情況下,菊鍊100可包含更多或更少的攝像機,不侷限於3個攝像機。 The MIPI daisy chain 100 includes three imaging cameras 102, 104, and 106 coupled in series with each other and coupled to the host 108 by an I 2 C data line 110. The host 108 can be a processor, or other alternative host 108, preferably a downstream camera, that includes a processor that controls the timing of the upstream camera via the I 2 C data line 110. The present invention is not limited to only the I 2 C bus bar protocol, that is, the cameras 102, 104 and 106 and the host 108 can be coupled by other connection protocols, and further, without departing from the spirit and scope of the present invention. In the case of the daisy chain 100, more or fewer cameras may be included, not limited to three cameras.

每一攝像機102、104和106具有相關聯的攝像機子元件,其包括例如成像陣列(如攝像機內之陣列112、114、116)、相關聯的緩衝器(如緩衝器118、120和122)、相關聯的MIPI接收器(如MIPI接收器124、126和128)以及相關聯的MIPI傳送器(即MIPI傳送器130、132和134)。成像陣列112、114、116包含CMOS、CCD、NMOS、Live MOS,或其他能產生全景圖像數據的感光像素 陣列。緩衝器118、120和122為記憶體緩衝器,其用以儲存來自個別成像陣列的圖像數據,以及自菊鍊100內的上游攝像機所接收到的圖像數據,舉例而言,第二攝像機104的緩衝器120用以儲存來自陣列114的圖像數據,以及儲存自攝像機102之MIPI Tx 130並通過MIPI Rx 126所接收到的圖像數據。MIPI接收器用以接收自上游攝像機之圖像數據(即攝像機104的MIPI Rx 126自攝像機102的MIPI Tx 130接收圖像數據),MIPI收發器傳送圖像數據至下游攝像機(即MIPI Tx 132傳送數據至MIPI Rx 128)。 Each camera 102, 104, and 106 has associated camera sub-elements that include, for example, an imaging array (such as arrays 112, 114, 116 within the camera), associated buffers (such as buffers 118, 120, and 122), Associated MIPI receivers (such as MIPI receivers 124, 126, and 128) and associated MIPI transmitters (i.e., MIPI transmitters 130, 132, and 134). The imaging arrays 112, 114, 116 include CMOS, CCD, NMOS, Live MOS, or other photosensitive pixels capable of generating panoramic image data Array. Buffers 118, 120, and 122 are memory buffers for storing image data from individual imaging arrays, as well as image data received from upstream cameras within daisy chain 100, for example, a second camera. The buffer 120 of 104 is used to store image data from the array 114, as well as image data stored from the MIPI Tx 130 of the camera 102 and received by the MIPI Rx 126. The MIPI receiver is configured to receive image data from the upstream camera (ie, MIPI Rx 126 of camera 104 receives image data from MIPI Tx 130 of camera 102), and the MIPI transceiver transmits image data to the downstream camera (ie, MIPI Tx 132 transmits data) To MIPI Rx 128).

第1圖所示,上游攝像機朝向左側,而下游攝像機朝向右側,其中攝像機102是在MIPI菊鍊100中的第一攝像機,所有的攝像機102、104和106(以及潛在的主機108,倘若主機是攝像機)同時獲得圖像場景的圖像數據。舉例而言,攝像機102、104和106可獲取圖像數據的一或多排,並且將它們儲存於各自緩衝器118、120和122中。於第1圖內的箭頭(1)、(4)和(9)表示從每一陣列傳輸至各緩衝器的圖像數據。以第一攝像機102開始,緩衝器118內存儲的圖像數據自第一攝像機102傳輸至第二攝像機104,其該圖像數據與儲存於緩衝器120內的圖像數據相連結。舉例而言,MIPI Tx 130傳送儲存於緩衝器118內的圖像數據至攝像機104的MIPI Rx 126,如箭頭(3)所示;接續,如箭頭(5)所示,中介攝像機104的MIPI Rx 126發送鄰近上游的第一攝像機102之圖像數據至列緩衝器120,並儲存之,圖像數據係由陣列112生成的圖像數據與由陣列114生成的圖像數據串聯組合。如箭頭(2)、(3)和(5)所示的數據傳輸過程,可於圖像數據第一排傳輸至緩衝器118之後執行,但須早於收集陣列112的全陣列圖像數據之前開始執行,亦即,當攝像機102經由陣列112捕捉圖像數據時,攝像機102可同時傳輸圖像數據至攝像機104。 As shown in Figure 1, the upstream camera is toward the left and the downstream camera is toward the right, where camera 102 is the first camera in MIPI daisy chain 100, all cameras 102, 104 and 106 (and potential host 108, if the host is Camera) Obtain image data of an image scene at the same time. For example, cameras 102, 104, and 106 can acquire one or more rows of image data and store them in respective buffers 118, 120, and 122. Arrows (1), (4), and (9) in Fig. 1 represent image data transmitted from each array to each buffer. Starting with the first camera 102, image data stored in the buffer 118 is transmitted from the first camera 102 to the second camera 104, the image data being coupled to the image data stored in the buffer 120. For example, MIPI Tx 130 transmits the image data stored in buffer 118 to MIPI Rx 126 of camera 104 as indicated by arrow (3); continuation, as indicated by arrow (5), MIPI Rx of intermediate camera 104 126 sends the image data of the first camera 102 adjacent to the upstream to the column buffer 120, and stores the image data in series with the image data generated by the array 112 in combination with the image data generated by the array 114. Data transfer processes as indicated by arrows (2), (3), and (5) may be performed after the first row of image data is transmitted to buffer 118, but prior to collecting full array image data of array 112. The execution begins, that is, when the camera 102 captures image data via the array 112, the camera 102 can simultaneously transmit image data to the camera 104.

一旦在緩衝器120內組合,則組合圖像數據將會傳輸至MIPI Tx 132,如箭頭(6)所示,進而傳送圖像數據至下一個鄰近下游攝像機的MIPI Rx (即攝像機106的MIPI Rx 128),上述係為同時捕捉圖像數據。應當理解,每一攝像機得毋需同一時間捕捉圖像數據。於此實施例中,於攝像機102的MIPI Tx 130接收圖像數據之後或之前,攝像機104得進行捕捉場景以成像。因此,如箭頭(4)和(5)所示的數據傳輸的順序可相互對調。 Once combined within the buffer 120, the combined image data will be transmitted to the MIPI Tx 132 as indicated by arrow (6), which in turn transmits the image data to the MIPI Rx of the next adjacent downstream camera (i.e., the MIPI Rx of the camera 106). 128) The above is to simultaneously capture image data. It should be understood that each camera may need to capture image data at the same time. In this embodiment, after or before the MIPI Tx 130 of the camera 102 receives the image data, the camera 104 may perform a capture scene to image. Therefore, the order of data transmission as indicated by arrows (4) and (5) can be reversed.

由箭頭(3)至(6)所指的數據傳輸於MIPI菊鍊100中的每一額外下游攝像機(即攝像機106)反復操作,舉例而言,在數據傳輸(7)中,中 介攝像機104的MIPI Tx 132傳送數據組合排至下游右側攝像機106的MIPI Rx 128,於最右側攝像機106中繼續相同的過程,如箭頭(8)-(10)所示,最後,在菊鍊100中的最後攝像機傳送總數據組合排(11)至主機108。 The data referred to by arrows (3) through (6) are transmitted repeatedly to each additional downstream camera (i.e., camera 106) in the MIPI daisy chain 100, for example, in data transmission (7), The MIPI Tx 132 of the camera 104 transmits the data combination to the MIPI Rx 128 of the downstream right camera 106, continuing the same process in the rightmost camera 106, as indicated by arrows (8)-(10), and finally, at the daisy chain 100. The last camera in the middle transmits the total data combination row (11) to the host 108.

自最上游攝像機(即攝像機102)傳輸圖像數據特定排至主機108,其所耗費的時間定義為總體菊鍊100之H消隱時間。H消隱時間係顯著地小於自每一攝像機傳輸所有圖像數據,以及處理器將圖像數據組合為一體所需的處理時間。舉例而言,藉由"掃描"圖元第一排,以及接續掃描圖元第二排等,以此類推至所有圖元排掃描完成,以使攝像機捕捉圖像數據。有利地,在菊鍊100配置中,來自最上游攝像機之圖像數據第一排,可在第一攝像機之全成像陣列掃描完成前,傳輸至下一下游攝像機,據此,生成全景圖像所需之處理時間顯著地減少。除此之外,由於OTP會定義菊鍊中每一相鄰攝像機間的融合特性,因而無須複雜圖像融合技術所需之大量的處理時間,以減少全程處理時間。 The time taken to transfer the image data from the most upstream camera (i.e., camera 102) to the host 108 is defined as the H blanking time of the overall daisy chain 100. The H blanking time is significantly less than the processing time required to transfer all image data from each camera and the processor to combine the image data into one. For example, by "scanning" the first row of primitives, and continuing to scan the second row of primitives, etc., and so on, all scans of the primitives are completed, so that the camera captures image data. Advantageously, in the daisy chain 100 configuration, the first row of image data from the most upstream camera can be transmitted to the next downstream camera before the full imaging array scan of the first camera is completed, thereby generating a panoramic image The processing time required is significantly reduced. In addition, since OTP defines the fusion characteristics between each adjacent camera in the daisy chain, it does not require a large amount of processing time required by complex image fusion techniques to reduce the overall processing time.

於一實施例中,於第1圖中之每一攝像機內的架構特徵可概括如下:第一,每一攝像機讀出相同定時列排,並且將它保存於所屬的列緩衝器;第二,MIPI Tx自列緩衝器接收MIPI列數據,並且按順序將它傳遞至下一個攝像機,同時間,每一攝像機開始讀出下一個定時列排;第三,MIPI Rx自上游攝像機接收MIPI列數據,並將它傳遞至列緩衝器,以及最後攝像機MIPI之列數據傳遞至主機。 In an embodiment, the architectural features in each of the cameras in FIG. 1 can be summarized as follows: First, each camera reads the same timing column row and stores it in the associated column buffer; second, MIPI Tx receives MIPI column data from the column buffer and passes it to the next camera in sequence. At the same time, each camera starts to read the next timing column row. Third, MIPI Rx receives MIPI column data from the upstream camera. It is passed to the column buffer, and the last camera MIPI column data is passed to the host.

根據上文所述,圖像係由複數個排(row)所組成。實施例用以說明圖像數據如何產生、連結及傳送每一排。第2圖係根據第1圖之菊鍊100顯示複數個攝像機所接收到數據排之處理程序示意圖。數據攝像機1、2和3(未顯示於圖中)可對應至第1圖的攝像機112、114、116,並且每一數據會產生各自排1,其中每一排1數據通過列緩衝器傳送、組合,最後發送至處理器(或攝像機主機),以形成如圖所示之最後排1,上述過程得類推至排2、3等。 According to the above, the image is composed of a plurality of rows. Embodiments are used to illustrate how image data is generated, linked, and transmitted for each row. Fig. 2 is a schematic diagram showing a processing procedure for receiving data rows by a plurality of cameras according to the daisy chain 100 of Fig. 1. Data cameras 1, 2, and 3 (not shown) may correspond to cameras 112, 114, 116 of Figure 1, and each data will produce a respective row 1, where each row of 1 data is transmitted through the column buffer, The combination is finally sent to the processor (or camera host) to form the last row 1 as shown, and the above process is analogized to rows 2, 3, and so on.

據此,在菊鍊中的每一當前攝像機,接收每一上游攝像機的組合圖像數據,從當前的攝像機添加圖像數據排至組合圖像數據,接續,向下游發送更新的組合圖像數據至菊鏈中的下一攝像機,如第1圖中圓圈所示數據。舉例而言,攝像機102的數據113初始儲存於緩衝器118內,接續穿過每一下游緩衝器120和122,其中數據113與來自每一下游攝像機的額外數據相組合。類似地,數據115初始儲存於緩衝器120內,其與緩衝器120中的數據113相組合數據,在緩 衝器122中,組合數據113和115與數據117相組合。該過程反復直到所有的組合數據傳送至主機108。如上所述,攝像機對準以完成OTP的預校準,雖然仍存有複數個攝像機間重疊的問題,但OTP記憶體可編程地確切讀出,以使得在全景視圖中不存有重疊現象。 According to this, each current camera in the daisy chain receives the combined image data of each upstream camera, adds the image data from the current camera to the combined image data, and continues to send the updated combined image data downstream. To the next camera in the daisy chain, as shown by the circle in Figure 1. For example, data 113 of camera 102 is initially stored in buffer 118, traversing each downstream buffer 120 and 122, with data 113 combined with additional data from each downstream camera. Similarly, data 115 is initially stored in buffer 120, which combines data with data 113 in buffer 120, In the buffer 122, the combined data 113 and 115 are combined with the data 117. This process is iterated until all of the combined data is transferred to the host 108. As described above, the camera is aligned to complete the pre-calibration of the OTP, and although there is still a problem of overlapping between a plurality of cameras, the OTP memory is programmably and accurately read so that there is no overlap in the panoramic view.

第3圖顯示菊鍊內的複數個攝像機之示例性配置。每一攝像機得位於物件的各側上。舉例而言,配置300顯示具有四個攝像機302a-302d(如虛線圓圈所示)的智慧型手機配置圖,其中每一攝像機位於智慧型手機的各側302A-302D上,如圖所示,攝像機302a位於前側302A上,攝像機302b位於後側302B上,攝像機302c位於左側302C上,並且攝像機302d位於右側302D上。攝像機之配置型態為菊鍊,因此智慧型手機產生的全景圖像結合如第1圖及第2圖所描述的概念和結構。 Figure 3 shows an exemplary configuration of a plurality of cameras within a daisy chain. Each camera is located on each side of the object. For example, configuration 300 displays a smart phone configuration diagram with four cameras 302a-302d (shown by dashed circles), with each camera located on each side of the smartphone 302A-302D, as shown, the camera 302a is located on the front side 302A, camera 302b is located on the back side 302B, camera 302c is located on the left side 302C, and camera 302d is located on the right side 302D. The configuration of the camera is daisy chain, so the panoramic image produced by the smart phone combines the concepts and structures described in Figures 1 and 2.

配置304描述手勢識別配置,其中每一攝像機位於電子裝置的單一表面上,如智慧型手機。重要的是,採用菊鍊配置提供手勢識別諸多優點。如上文所述,採用菊鍊有助於減少處理時間,因此更加精準地識別快速手勢。 Configuration 304 describes a gesture recognition configuration in which each camera is located on a single surface of an electronic device, such as a smart phone. Importantly, the daisy-chain configuration provides many advantages for gesture recognition. As mentioned above, the use of daisy chain helps to reduce processing time and therefore more accurately recognizes fast gestures.

配置306係以俯視角度觀看汽車監視系統。每一攝像機位於汽車的不同側向。應當理解,汽車的每一側更可包含更多或更少的攝像機。行動裝置之高速移動有助於減少配置306內攝像機菊鍊配置的處理時間,因此,快速的處理時間有助於精準地且快速抓取周圍環境的成像。於配置306內,每一攝像機307a-307d可配置為菊鍊,如上文所述。此外,可以以操作主機108之類似方式操作CPU 308,如上文所述。CPU 308可以是主要交通工具之電腦,抑或是,用於輔助視覺識別的分離CPU,諸如視覺車道輔助電腦、自動前燈控制、雨刷輔助控制、停車輔助控制、制動輔助控制或利用視覺圖像數據以輔助其它車輛操作。CPU可接收及分析每一攝像機307a-307d所接收到的圖像數據,並且利用上述資訊以輔助車輛操作。 Configuration 306 is to view the vehicle monitoring system in a top view. Each camera is located on a different side of the car. It should be understood that each side of the car may contain more or fewer cameras. The high speed movement of the mobile device helps to reduce the processing time of the camera daisy chain configuration in configuration 306, so that fast processing times help to accurately and quickly capture the imaging of the surrounding environment. Within configuration 306, each camera 307a-307d can be configured as a daisy chain, as described above. Moreover, CPU 308 can be operated in a similar manner to operating host 108, as described above. The CPU 308 can be a computer of the primary vehicle or a separate CPU for assisting visual recognition, such as a visual lane assist computer, automatic headlight control, wiper assist control, parking assist control, brake assist control, or use of visual image data. To assist other vehicle operations. The CPU can receive and analyze the image data received by each of the cameras 307a-307d and utilize the above information to assist in vehicle operation.

第4圖根據本發明之一實施例顯示攝像機菊鍊生成圖像之方法400,方法400係使用第1圖的菊鍊100以執行下列步驟:於可選步驟402中,方法400會校準每一攝像機,並將校準設定值儲存於OTP記憶體中,有助於協調複數個攝像機間的圖像融合。舉例而言,由處理器或主機108以執行步驟402,校準每一攝像機102、104、106,俾使每一攝像機之圖像數據組合所產生的圖像無重疊模糊現象圖像數據。 4 illustrates a method 400 of displaying a camera daisy chain to generate an image in accordance with an embodiment of the present invention. The method 400 uses the daisy chain 100 of FIG. 1 to perform the following steps: In an optional step 402, the method 400 calibrates each The camera and the calibration settings are stored in the OTP memory to help coordinate image fusion between multiple cameras. For example, by the processor or host 108 to perform step 402, each camera 102, 104, 106 is calibrated so that the image data generated by combining the image data of each camera has no overlapping blur phenomenon image data.

於步驟404中,複數個攝像機捕捉圖像數據。每一攝像機102、104、106開始捕捉外部場景的圖像數據113、115、117,並儲存於各自列緩衝器118、120、122內圖像數據。舉例而言,為捕捉圖像數據,定時信號經由I2C匯流排線路110自主機108發送,以同時讀出每一陣列112、114、116的圖元排,並且儲存於各自緩衝器內。 In step 404, a plurality of cameras capture image data. Each camera 102, 104, 106 begins capturing image data 113, 115, 117 of the external scene and storing the image data in the respective column buffers 118, 120, 122. For example, to capture image data, timing signals are transmitted from host 108 via I 2 C bus line 110 to simultaneously read the primitive rows of each array 112 , 114 , 116 and store them in respective buffers.

於步驟406中,在步驟404中所儲存於第一攝像機緩衝器內的第一攝像機圖像數據與第二攝像機圖像數據組合,舉例而言,第一攝像機圖像數據自第一攝像機傳輸至第一攝像機下游的第二攝像機,來自第一攝像機圖像數據會在第二攝像機處與第二攝像機圖像數據組合。於步驟406之一實施例中,緩衝器118內的圖像數據第一排傳輸至MIPI Tx 130,圖像數據經由MIPI Tx 130傳輸至攝像機104的MIPI Rx 126,接續,儲存圖像數據113,並與緩衝器120內第二攝像機104所捕捉的圖像數據115第一排相組合。於攝像機102捕捉圖像數據113第一排之後執行步驟406,但須於捕捉全陣列112圖像數據之前執行步驟406。 In step 406, the first camera image data stored in the first camera buffer in step 404 is combined with the second camera image data. For example, the first camera image data is transmitted from the first camera to A second camera downstream of the first camera, the image data from the first camera is combined with the second camera image data at the second camera. In an embodiment of step 406, the first row of image data in the buffer 118 is transmitted to the MIPI Tx 130, and the image data is transmitted to the MIPI Rx 126 of the camera 104 via the MIPI Tx 130, and the image data 113 is stored. And combined with the first row of image data 115 captured by the second camera 104 in the buffer 120. Step 406 is performed after camera 102 captures the first row of image data 113, but step 406 is performed prior to capturing full array 112 image data.

於步驟408中,在步驟406中的第二攝像機緩衝器內所儲存的第一和第二攝像機的組合圖像數據會與額外攝像機的圖像數據相組合。舉例而言,圖像數據第一排的組合圖像數據(包括陣列114圖像數據第一排與陣列112圖像數據第一排之組合)傳輸至與第三攝像機之陣列116圖像數據117第一排組合。於操作步驟408之一實施例中,由第二攝像機104之圖像數據113及圖像數據115所組合的圖像數據113+115,經由MIPI Tx 132傳輸至第三攝像機106之MIPI Rx128,接續,組合圖像數據113+115數據會與在額外攝像機(即攝像機106)內的額外攝像機緩衝器(即緩衝器122)的圖像數據117第一排相結合。步驟408會在每一額外下游攝像機中反覆操作,直至組合圖像數據傳輸至主機108。 In step 408, the combined image data of the first and second cameras stored in the second camera buffer in step 406 is combined with the image data of the additional camera. For example, the combined image data of the first row of image data (including the combination of the first row of image data of array 114 and the first row of image data of array 112) is transmitted to image 116 of array 116 with the third camera. The first row of combinations. In an embodiment of operation step 408, the image data 113+115 combined by the image data 113 and the image data 115 of the second camera 104 is transmitted to the MIPI Rx128 of the third camera 106 via the MIPI Tx 132, and continues. The combined image data 113+115 data will be combined with the first row of image data 117 of the additional camera buffer (i.e., buffer 122) within the additional camera (i.e., camera 106). Step 408 will be repeated in each additional downstream camera until the combined image data is transmitted to host 108.

由菊鍊攝像機所捕捉的圖像數據每一排皆會進行步驟406-408。在步驟410中,方法400將現有組合圖像數據排與先前組合圖像數據排相結合。在一操作實施例中,主機108接收來自攝像機106的圖像數據之合併第二排(即經由MIPI Tx 134),並將圖像數據第二排與圖像數據第一排相結合。 Each row of image data captured by the daisy chain camera will proceed to steps 406-408. In step 410, method 400 combines the existing combined image data rows with the previous combined image data rows. In an operational embodiment, host 108 receives the merged second row of image data from camera 106 (i.e., via MIPI Tx 134) and combines the second row of image data with the first row of image data.

於步驟412中,方法400輸出一全景圖像,其包括來自每一攝像機的組合圖像數據之所有合併排的全景圖像。舉例而言,主機108輸出一全景圖像,其包括由每一攝像機102、104和106所接收到的組合圖像數據合併排的全景圖像。 In step 412, method 400 outputs a panoramic image that includes panoramic images of all of the merged rows of combined image data from each camera. For example, host 108 outputs a panoramic image that includes a panoramic image of the combined image data merged by each camera 102, 104, and 106.

上述實施例皆使用I2C協定以控制圖像捕捉排序的定時。於兩個I2C裝置間之兩條導線進行數據通信,藉此減少圖像系統菊鍊所需的佔用的空間。舉例而言,每一裝置連接一時鐘及一數據串列線,其分別控制定時和數據資訊數據。於I2C協定內,每一裝置可為主裝置或次要裝置。主裝置負責當下時間的匯流排、控制時鐘、生成開始和停止信號,並且發送數據或接收數據至次要裝置,以及自次要裝置發送數據或接收數據。次要裝置依匯流排控制接收的數據。一般而言,次要裝置之間不具備傳輸數據之功能。 The above embodiments all use the I 2 C protocol to control the timing of image capture sequencing. The two wires between the two I 2 C devices are in data communication, thereby reducing the space required for the daisy chain of the image system. For example, each device is connected to a clock and a data string line, which respectively control timing and data information data. Within the I 2 C agreement, each device can be a primary device or a secondary device. The master device is responsible for the busbar at the current time, controls the clock, generates start and stop signals, and transmits or receives data to the secondary device, as well as transmitting data or receiving data from the secondary device. The secondary device controls the received data according to the bus. In general, there is no function to transfer data between secondary devices.

第5圖係根據本發明之一實施例顯示第1圖的菊鍊100內每一裝置的位址識別碼500,例如每一陣列、MIPI Tx、MIPI Rx具有與其相關聯的識別碼。此外,特定裝置具有獨一無二之識別碼,據此,當主裝置發送一信號至一或多個次要裝置時,該信號亦同時播放至所有次要裝置。每一裝置會針對START位元後的第一個7位元與其本身位址相比較,以確定主裝置是否與特定次要裝置"通話talking"。倘若第一個7位元與其本身位址識別碼相匹配時,則次要裝置將自行認定為主裝置。位址識別碼的位元屬於讀取/寫入位元。應當理解,位址識別碼可包括定位部分和可編程部分。除此之外,在不脫離本發明範圍及精神情況下,可比第5圖更多或更少相關聯的位址識別碼。 Figure 5 is a diagram showing an address identification code 500 for each device within the daisy chain 100 of Figure 1 in accordance with an embodiment of the present invention, e.g., each array, MIPI Tx, MIPI Rx has an identification code associated therewith. In addition, the particular device has a unique identification code whereby, when the primary device transmits a signal to one or more secondary devices, the signal is simultaneously played to all secondary devices. Each device compares the first 7 bits after the START bit with its own address to determine if the primary device is "talking" with a particular secondary device. If the first 7-bit matches its own address, the secondary device will identify itself as the master. The bit of the address identifier belongs to the read/write bit. It should be understood that the address identification code can include a positioning portion and a programmable portion. In addition, address identifiers that are more or less associated with FIG. 5 may be used without departing from the scope and spirit of the invention.

第6圖係根據本發明之一實施例顯示主裝置寫入次要裝置之數據傳輸圖600。於第6圖中,空白填充表示數據自主裝置發送至次要裝置數據,而虛線填充表示數據自次要裝置發送至主裝置數據。於數據傳輸600中,傳輸開始並包含識別碼500以及寫入位元601,接續,主裝置等待來自次要裝置的認證602,於接收認證602後,主裝置方可開始數據傳輸。次要裝置於整個傳輸過程中,週期性傳輸認證數據,直至主裝置發送停止命令。 Figure 6 is a diagram showing a data transfer diagram 600 for a master device to write to a secondary device in accordance with an embodiment of the present invention. In Figure 6, blank padding indicates that the data autonomous device is transmitting to the secondary device data, while dashed padding indicates that data is sent from the secondary device to the primary device data. In data transmission 600, the transmission begins with an identification code 500 and a write bit 601. Continuing, the primary device waits for authentication 602 from the secondary device, and upon receiving the authentication 602, the primary device can begin data transmission. The secondary device periodically transmits the authentication data throughout the transmission until the primary device sends a stop command.

第7圖係根據本發明之一實施例顯示主裝置讀取次要裝置之數據傳輸圖700。於第7圖內,空白填充表示數據自主裝置發送至次要裝置數據,而虛線填充表示數據自次要裝置發送至主裝置數據。於數據傳輸700中,傳輸開始並包括識別碼500以及讀出位元701,接續,主裝置等待來自次要裝置的認證702,於接收認證702後,次要裝置開始傳輸數據至主裝置。主裝置週期性地發送次要裝置所接收數據的認證704數據,直至主裝置發送停止命令。 Figure 7 is a diagram showing a data transfer diagram 700 for a master device to read a secondary device in accordance with an embodiment of the present invention. In Figure 7, blank padding indicates that the data autonomous device is transmitting to the secondary device data, while dashed padding indicates that data is sent from the secondary device to the primary device data. In data transmission 700, the transmission begins and includes an identification code 500 and a read bit 701. Successively, the primary device waits for authentication 702 from the secondary device. Upon receiving the authentication 702, the secondary device begins transmitting data to the primary device. The master device periodically transmits the authentication 704 data of the data received by the secondary device until the master device transmits a stop command.

第8圖係根據本發明之一實施例顯示在I2C匯流排線路上的通用呼叫800。通用呼叫800包括第一位元組802和第二位元組804,第一位元組802用 以指定次要裝置呼叫定址,第二位元組804用以指定一行動。舉例而言,第一位元組802可指示全陣列進行定址,並且第二位元組804可指示開始捕捉圖像數據。於一操作實施例中,第1圖之主機108經由I2C匯流排線路110傳送通用呼叫800至攝像機102、104、106。如上文所述,主裝置每一次可定址超過一個次要裝置。 Figure 8 is a diagram showing a general call 800 displayed on an I 2 C bus line in accordance with an embodiment of the present invention. The universal call 800 includes a first byte 802 for specifying a secondary device call addressing and a second byte 804 for specifying an action. For example, the first byte 802 can indicate that the full array is addressed, and the second byte 804 can indicate the start of capturing image data. In an operational embodiment, host 108 of FIG. 1 transmits universal call 800 to cameras 102, 104, 106 via I 2 C bus line 110. As described above, the primary device can be addressed more than one secondary device at a time.

於某些實施例中,第二位元組可指示裝置採用其識別碼(即識別碼500)之可編程部分。於此態樣實施例中,第二位元組的最後位元可以是0或1,當最後位元是0時,所有次要裝置得重新設定,並容納其位址之可編程部分,抑或是,未重新設定而容納其位址之可編程部分;當第二位元組的最後位元是1時,主裝置所發出之呼叫未具備連接次要裝置位址之任一先前資訊。據此,主裝置採用其本身位址進行呼叫,以使得次要裝置可識別訊息來源。 In some embodiments, the second byte can indicate that the device employs a programmable portion of its identification code (ie, identification code 500). In this aspect, the last bit of the second byte may be 0 or 1. When the last bit is 0, all the secondary devices are reset and accommodate the programmable portion of the address, or Yes, the programmable portion of its address is not reconfigured; when the last bit of the second byte is 1, the call placed by the master device does not have any previous information to connect to the secondary device address. Accordingly, the primary device makes a call using its own address so that the secondary device can identify the source of the message.

成像系統菊鍊所使用的I2C協定具備諸多優點。舉例而言,I2C協議得以輔助攝像機初始化和同步,藉此有助於減少全景圖像融合部分間的模糊現象。舉例而言,於第1圖的菊鍊100內,由每一陣列112、114、116所收集到的圖像數據得以通用呼叫作為同步基礎,如上述於第8圖所討論之。 The I 2 C protocol used in the daisy chain of imaging systems has many advantages. For example, the I 2 C protocol assists in camera initialization and synchronization, thereby helping to reduce blurring between the panoramic image blending portions. For example, within the daisy chain 100 of Figure 1, the image data collected by each array 112, 114, 116 is used as a synchronization basis for a general call, as discussed above in FIG.

本發明並未侷限於上述所描述之特定細節特徵,此領域之技藝者,在不脫離本專利精神或範圍內,所作之更動或潤飾,均屬於本發明所揭示精神下所完成之等效改變或設計,且應包含在下述之申請專利範圍內。上述敘述係為本發明之較佳實施例,此領域之技藝者應得以領會其係用以說明本發明而非用以限定本發明所主張之專利權利範圍,其專利保護範圍當視後附之申請專利範圍及其等同領域而定。 The present invention is not limited to the specific details described above, and modifications or modifications made by those skilled in the art without departing from the spirit or scope of the present invention are equivalent to the equivalents of the present invention. Or design, and should be included in the scope of the following patent application. The above description is a preferred embodiment of the present invention, and those skilled in the art should understand that the present invention is not intended to limit the scope of patent claims claimed herein. The scope of patent application and its equivalent fields are determined.

102、104、106‧‧‧攝像機 102, 104, 106‧‧‧ cameras

100‧‧‧菊鍊 100‧‧‧ daisy chain

108‧‧‧主機 108‧‧‧Host

110‧‧‧數據線、線路 110‧‧‧Data lines, lines

112、114、116‧‧‧陣列 112, 114, 116‧‧‧ array

113、115、117‧‧‧圖像數據 113, 115, 117‧‧‧ image data

118、120、122‧‧‧緩衝器 118, 120, 122‧‧ ‧ buffer

124、126、128‧‧‧MIPI接收器 124, 126, 128‧‧‧ MIPI Receiver

130、132、134‧‧‧MIPI傳送器 130, 132, 134‧‧‧ MIPI transmitter

(1)-(11)‧‧‧箭頭 (1)-(11)‧‧‧ arrows

Claims (20)

一種用於產生全景圖像之方法,係包含:執行一捕捉步驟,由複數個攝像機捕捉一圖像數據,並將該圖像數據儲存於各自該攝像機內之一記憶體緩衝器;執行一傳送步驟,該複數個攝像機之一鄰近上游攝像機傳送該圖像數據至該複數個攝像機之一下游攝像機;以及執行一組合步驟,於該下游攝像機內,將來自該鄰近上游攝像機之該圖像數據與該下游攝像機之該圖像數據組合,以成為一組合圖像數據。 A method for generating a panoramic image includes: performing a capturing step of capturing an image data by a plurality of cameras, and storing the image data in a memory buffer of each of the cameras; performing a transfer Step, the one of the plurality of cameras transmits the image data to the downstream camera of the plurality of cameras adjacent to the upstream camera; and performs a combining step in which the image data from the adjacent upstream camera is The image data of the downstream camera is combined to become a combined image data. 如申請專利範圍第1項所述之方法,該捕捉步驟包括同時自該複數個攝像機捕捉該圖像數據。 The method of claim 1, wherein the capturing step comprises simultaneously capturing the image data from the plurality of cameras. 如申請專利範圍第1項所述之方法,該捕捉步驟包括自該每一攝像機之一圖像陣列捕捉該圖像數據,以作為該圖像數據之一系列排。 The method of claim 1, wherein the capturing step comprises capturing the image data from an image array of each of the cameras as a series of rows of the image data. 如申請專利範圍第3項所述之方法,其中該傳送步驟係於該上游攝相機捕捉該系列排之第一排之後執行,並於該上游攝像機捕捉該系列排之最後排之前執行。 The method of claim 3, wherein the transmitting step is performed after the upstream camera captures the first row of the series of rows and before the upstream camera captures the last row of the series of rows. 如申請專利範圍第1項所述之方法,進一步包含:自該下游攝像機傳送該組合圖像數據至該複數個攝像機之一額外下游攝像機;於該額外下游攝像機內,將該組合圖像數據與該額外下游數據之該圖像數據組合,以成為一額外組合圖像數據。 The method of claim 1, further comprising: transmitting the combined image data from the downstream camera to an additional downstream camera of the plurality of cameras; and in the additional downstream camera, combining the combined image data with The image data of the additional downstream data is combined to become an additional combined image data. 如申請專利範圍第1項所述之方法,其中該傳送步驟包括利用該鄰近上游攝像機內之一傳送器,以存取該鄰近上游攝像機內該記憶體緩衝器所儲存之該圖像數據,並將所存取之該圖像數據傳送至該下游攝像機之一接收器;以及 該組合步驟包括,將來自該鄰近上游攝像機之該圖像數據,自該下游攝像機之該接收器儲存至該下游攝像機之該記憶體緩衝器中。 The method of claim 1, wherein the transmitting step comprises utilizing a transmitter in the adjacent upstream camera to access the image data stored in the memory buffer in the adjacent upstream camera, and Transmitting the accessed image data to a receiver of the downstream camera; The combining step includes storing the image data from the adjacent upstream camera from the receiver of the downstream camera to the memory buffer of the downstream camera. 如申請專利範圍第1項所述之方法,其進一步包括一主機產生一呼叫信號,以控制該複數個攝像機間之數據傳輸。 The method of claim 1, further comprising a host generating a call signal to control data transmission between the plurality of cameras. 如申請專利範圍第7項所述之方法,更包括於一內部積體電路(I2C)匯流排上傳送該呼叫信號。 The method of claim 7, further comprising transmitting the call signal on an internal integrated circuit (I 2 C) bus. 如申請專利範圍第7項所述之方法,該呼叫信號包括一第一位元組以及一第二位元組,該第一位元組用以指示一位址識別碼,其用以識別一或多個該攝像機和攝像機子元件,該第二位元組用以指示一動作,該動作係藉由該攝像機、每一攝像機內之記憶體緩衝器、每一攝像機內之該傳送器中之一或多個定址而產生。 The method of claim 7, wherein the call signal comprises a first byte and a second byte, wherein the first byte is used to indicate an address identifier, which is used to identify a Or a plurality of the camera and camera sub-components, wherein the second byte is used to indicate an action by the camera, a memory buffer in each camera, and the transmitter in each camera Generated by one or more addressing. 一種用於產生全景圖像之系統,該系統包括多個攝像機,每一攝像機包括:一成像陣列,用以捕捉一場景之一圖像數據;一接收器,用以接收複數個攝像機之一鄰近上游攝像機之該圖像數據;一記憶體緩衝器,用以將從該鄰近上游攝像機所接收到的該圖像數據與該成像陣列捕捉到的該圖像數據相組合,以成為一組合圖像數據,並將該組合圖像數據儲存於該記憶體緩衝器內;以及一傳送器,用以將所儲存之該組合圖像數據傳送至複數個攝像機之一下游攝像機。 A system for generating a panoramic image, the system comprising a plurality of cameras, each camera comprising: an imaging array for capturing image data of one scene; and a receiver for receiving proximity of one of the plurality of cameras The image data of the upstream camera; a memory buffer for combining the image data received from the adjacent upstream camera with the image data captured by the imaging array to form a combined image Data, and storing the combined image data in the memory buffer; and a transmitter for transmitting the stored combined image data to a downstream camera of one of the plurality of cameras. 如申請專利範圍第10項所述之系統,更包括一主機,其用以協調該複數個攝像機間之數據傳輸。 The system of claim 10, further comprising a host for coordinating data transmission between the plurality of cameras. 如申請專利範圍第10項所述之系統,其中每一該複數個攝像機係同時捕捉該圖像數據。 The system of claim 10, wherein each of the plurality of cameras simultaneously captures the image data. 如申請專利範圍第10項所述之系統,其中每一該複數個攝像機係經由一內 部積體電路(I2C)匯流排以耦合為一體。 The system of claim 10, wherein each of the plurality of cameras is coupled via an internal integrated circuit (I 2 C) bus bar. 如申請專利範圍第11項所述之系統,其中該主機包括該複數個攝像機,其中一為主攝像機,其餘為次要攝像機。 The system of claim 11, wherein the host comprises the plurality of cameras, one of which is a primary camera and the others are secondary cameras. 如申請專利範圍第11項所述之系統,其中該主機包括一外部處理器。 The system of claim 11, wherein the host comprises an external processor. 如申請專利範圍第10項所述之系統,其中該圖像數據是一系列排,該圖像數據自該鄰近上游攝像機一次傳送一排至該下游攝像機。 The system of claim 10, wherein the image data is a series of rows, the image data being transmitted from the adjacent upstream camera to the downstream camera at a time. 如申請專利範圍第16項所述之系統,其中於捕捉該系列排之一第一排之後,而於捕捉該系列排之最後排之前,該上游攝像機開始傳輸該圖像數據至一第一下游攝像機。 The system of claim 16, wherein after capturing the first row of the series of rows, and before capturing the last row of the series, the upstream camera begins to transmit the image data to a first downstream. Camera. 如申請專利範圍第10項所述之系統,其中該複數個攝像機位於一物件的各側上。 The system of claim 10, wherein the plurality of cameras are located on each side of an object. 如申請專利範圍第10項所述之系統,更包括:一各自位址識別碼,其用以表示每一該複數個攝像機之每一該成像陣列、該記憶體緩衝器、該接收器、該傳送器;以及一內部積體電路(I2C)匯流排,其將該主機耦合至每一該攝像機;其中,該主機經由該I2C匯流排上傳送之一呼叫信號,以協調每一該攝像機間之數據傳輸,該呼叫信號指示該主機定址之位址識別碼。 The system of claim 10, further comprising: a respective address identifier for indicating each of the plurality of cameras, the imaging array, the memory buffer, the receiver, the a transmitter; and an internal integrated circuit (I 2 C) bus that couples the host to each of the cameras; wherein the host transmits a call signal via the I 2 C bus to coordinate each Data transmission between the cameras, the call signal indicating the address identifier of the host address. 如申請專利範圍第19項所述之系統,該呼叫信號包括一第一位元組以及一第二位元組,該第一位元組指示位址識別碼進行定址,該第二位元組指示一動作,該動作係藉由至少一攝像機子元件以執行之。 The system of claim 19, wherein the call signal comprises a first byte and a second byte, the first byte indicating an address identifier for addressing, the second byte Instructing an action is performed by at least one camera sub-element.
TW103120316A 2013-06-14 2014-06-12 Systems and methods for generating a panoramic image TWI545388B (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US201361835492P 2013-06-14 2013-06-14

Publications (2)

Publication Number Publication Date
TW201502691A true TW201502691A (en) 2015-01-16
TWI545388B TWI545388B (en) 2016-08-11

Family

ID=52018879

Family Applications (1)

Application Number Title Priority Date Filing Date
TW103120316A TWI545388B (en) 2013-06-14 2014-06-12 Systems and methods for generating a panoramic image

Country Status (4)

Country Link
US (1) US9681045B2 (en)
CN (1) CN104284144B (en)
HK (1) HK1202009A1 (en)
TW (1) TWI545388B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI645297B (en) * 2017-05-26 2018-12-21 聚晶半導體股份有限公司 Data transmission system
TWI667528B (en) * 2014-05-06 2019-08-01 查卡瑞亞 尼亞奇 Multicamera panoramic imaging system and method for forming panoramic imageimaging

Families Citing this family (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11019258B2 (en) 2013-08-21 2021-05-25 Verizon Patent And Licensing Inc. Aggregating images and audio data to generate content
US9451162B2 (en) 2013-08-21 2016-09-20 Jaunt Inc. Camera array including camera modules
US9911454B2 (en) 2014-05-29 2018-03-06 Jaunt Inc. Camera array including camera modules
US11108971B2 (en) 2014-07-25 2021-08-31 Verzon Patent and Licensing Ine. Camera array removing lens distortion
US10368011B2 (en) 2014-07-25 2019-07-30 Jaunt Inc. Camera array removing lens distortion
US9363569B1 (en) 2014-07-28 2016-06-07 Jaunt Inc. Virtual reality system including social graph
US9774887B1 (en) 2016-09-19 2017-09-26 Jaunt Inc. Behavioral directional encoding of three-dimensional video
US10186301B1 (en) 2014-07-28 2019-01-22 Jaunt Inc. Camera array including camera modules
US10701426B1 (en) 2014-07-28 2020-06-30 Verizon Patent And Licensing Inc. Virtual reality system including social graph
US10440398B2 (en) 2014-07-28 2019-10-08 Jaunt, Inc. Probabilistic model to compress images for three-dimensional video
US10033928B1 (en) * 2015-10-29 2018-07-24 Gopro, Inc. Apparatus and methods for rolling shutter compensation for multi-camera systems
JP6429829B2 (en) * 2016-05-25 2018-11-28 キヤノン株式会社 Image processing system, image processing apparatus, control method, and program
CN107249096B (en) 2016-06-14 2021-02-26 杭州海康威视数字技术股份有限公司 Panoramic camera and shooting method thereof
US11032535B2 (en) 2016-09-19 2021-06-08 Verizon Patent And Licensing Inc. Generating a three-dimensional preview of a three-dimensional video
US11032536B2 (en) 2016-09-19 2021-06-08 Verizon Patent And Licensing Inc. Generating a three-dimensional preview from a two-dimensional selectable icon of a three-dimensional reality video
US10681341B2 (en) 2016-09-19 2020-06-09 Verizon Patent And Licensing Inc. Using a sphere to reorient a location of a user in a three-dimensional virtual reality video
US10554958B2 (en) 2017-03-13 2020-02-04 Microsoft Technology Licensing, Llc Systems and methods for interleaving multiple active camera frames
US10694167B1 (en) 2018-12-12 2020-06-23 Verizon Patent And Licensing Inc. Camera array including camera modules
CN113992857B (en) * 2021-12-06 2022-03-18 北京拙河科技有限公司 Image acquisition, identification and classified storage method and device based on billion-level pixels

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7064783B2 (en) 1999-12-31 2006-06-20 Stmicroelectronics, Inc. Still picture format for subsequent picture stitching for forming a panoramic image
US6771304B1 (en) 1999-12-31 2004-08-03 Stmicroelectronics, Inc. Perspective correction device for panoramic digital camera
US7843487B2 (en) * 2006-08-28 2010-11-30 Panasonic Corporation System of linkable cameras, each receiving, contributing to the encoding of, and transmitting an image
JP4867552B2 (en) * 2006-09-28 2012-02-01 株式会社ニコン Imaging device
DE202008009834U1 (en) * 2008-07-22 2009-12-10 Liebherr-Elektronik Gmbh Camera for use in a digital network
CN101577795A (en) * 2009-06-17 2009-11-11 深圳华为通信技术有限公司 Method and device for realizing real-time viewing of panoramic picture
US8205017B2 (en) * 2009-11-17 2012-06-19 Aptina Imaging Corporation Systems and methods for addressing and synchronizing multiple devices
CA2794928A1 (en) 2010-03-30 2011-10-06 Social Animal, Inc. System and method for capturing and displaying cinema quality panoramic images
TW201137507A (en) 2010-04-16 2011-11-01 Hon Hai Prec Ind Co Ltd Panoramic image capturing apparatus and method thereof
US9282242B2 (en) 2011-08-24 2016-03-08 Htc Corporation Method and electric device for taking panoramic photograph
US9124801B2 (en) 2012-07-26 2015-09-01 Omnivision Technologies, Inc. Image processing system and method using multiple imagers for providing extended view
US9094907B2 (en) * 2013-02-11 2015-07-28 Telefonaktiebolaget L M Ericsson (Publ) High-precision time tagging for content synthesization

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI667528B (en) * 2014-05-06 2019-08-01 查卡瑞亞 尼亞奇 Multicamera panoramic imaging system and method for forming panoramic imageimaging
TWI708111B (en) * 2014-05-06 2020-10-21 查卡瑞亞 尼亞奇 Multicamera panoramic imaging system and multicamera imaging system
TWI645297B (en) * 2017-05-26 2018-12-21 聚晶半導體股份有限公司 Data transmission system

Also Published As

Publication number Publication date
US20140368609A1 (en) 2014-12-18
TWI545388B (en) 2016-08-11
HK1202009A1 (en) 2015-09-11
CN104284144B (en) 2018-02-06
CN104284144A (en) 2015-01-14
US9681045B2 (en) 2017-06-13

Similar Documents

Publication Publication Date Title
TWI545388B (en) Systems and methods for generating a panoramic image
KR101399718B1 (en) Combining data from multiple image sensors
KR101400515B1 (en) Combining data from multiple image sensors
JP6123274B2 (en) Imaging device
JP6695739B2 (en) Processing device, image sensor, and system
CN108432228B (en) Frame synchronization method of image data, image signal processing unit, device and terminal
JP2019030007A (en) Electronic device for acquiring video image by using plurality of cameras and video processing method using the same
US10148936B2 (en) Multi-band image sensor for providing three-dimensional color images
CN112672004B (en) Vehicle and method of controlling vehicle
US9071750B2 (en) Semiconductor integrated circuit and multi-angle video system
JP2008154073A (en) Imaging apparatus and imaging system
TWI637632B (en) Image capturing device and control method thereof
US11252305B2 (en) Processing apparatus, image device and system with image data via single common data bus
JP6330873B2 (en) Imaging device
JP2023179491A (en) System, program and the like
KR102099914B1 (en) Apparatus and method of processing images
CN109309784B (en) Mobile terminal
CN102497514B (en) Three-channel video forwarding equipment and forwarding method
KR101230397B1 (en) Method and Apparatus for Transmitting/Receiving Image Data with High Speed
KR102080927B1 (en) Method and Apparatus for Generating Stereo Image
CN103841039B (en) The method and apparatus of network streaming
CN108683866B (en) Image processing and transmitting method, image processor, and related storage medium and system
KR101254683B1 (en) Supporter Used in Photographing 3-Dimensional Image and Method for Controlling Photographing 3-Dimensional Image
KR20150034953A (en) Apparatus for processing high-speed camera image
CN110363705A (en) Fixed camera panorama imaging system and method based on FPGA