TWI463418B - Monolithic image perception device and method - Google Patents

Monolithic image perception device and method Download PDF

Info

Publication number
TWI463418B
TWI463418B TW095124992A TW95124992A TWI463418B TW I463418 B TWI463418 B TW I463418B TW 095124992 A TW095124992 A TW 095124992A TW 95124992 A TW95124992 A TW 95124992A TW I463418 B TWI463418 B TW I463418B
Authority
TW
Taiwan
Prior art keywords
image recognition
cognitive
recognition device
sensing
substrate
Prior art date
Application number
TW095124992A
Other languages
Chinese (zh)
Other versions
TW200805178A (en
Inventor
Guy Paillet
Anne Menendez
Original Assignee
Agc Flat Glass Na Inc
Norlitech Llc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Agc Flat Glass Na Inc, Norlitech Llc filed Critical Agc Flat Glass Na Inc
Priority to TW095124992A priority Critical patent/TWI463418B/en
Publication of TW200805178A publication Critical patent/TW200805178A/en
Application granted granted Critical
Publication of TWI463418B publication Critical patent/TWI463418B/en

Links

Landscapes

  • Solid State Image Pick-Up Elements (AREA)
  • Image Analysis (AREA)

Description

單石影像感測裝置及方法Single stone image sensing device and method

本發明大體上係關於成像裝置。詳言之,本發明係關於安置於透明基板(諸如玻璃)上或嵌入於透明基板(諸如玻璃)中用於影像辨識之微裝置。The present invention generally relates to imaging devices. In particular, the present invention relates to microdevices for image recognition disposed on a transparent substrate such as glass or embedded in a transparent substrate such as glass.

透明表面(諸如玻璃)已存在數百年。透明表面最初打算保護生存空間同時使居住者具有外部世界(風景、天氣及可能威脅)之感測。新近,大量需要透明表面用於顯示工業,以陰極射線管(CRT)開始且新近用於液晶顯示器(LCD)及許多其他種類的平板顯示器。使用中,在大多狀況下,人類或活生物(動物、植物)位於此等透明表面附近。Transparent surfaces such as glass have been around for hundreds of years. The transparent surface was originally intended to protect the living space while giving the occupants a sense of the outside world (landscape, weather and possible threats). More recently, a large number of transparent surfaces have been required for the display industry, starting with cathode ray tubes (CRTs) and more recently for liquid crystal displays (LCDs) and many other types of flat panel displays. In use, in most cases, humans or living organisms (animals, plants) are located near such transparent surfaces.

影像感應器已用了幾十年(例如,CCD或CMOS感應器)。舉例而言,見美國專利第6,617,565號用於單晶片CMOS影像感應器,該案之內容以引用的方式併入本文中。典型影像感應器基於相機設計且大體上包括位於透鏡之後的積體電路,該透鏡可為微型或可移動的(例如,螺旋安裝透鏡)。感應器用於將光能(光子)轉換為與由在感應器上以陣列組織之光敏元件所接收之光量成比例的電訊號。根據光敏元件之輸出來合成影像。Image sensors have been in use for decades (for example, CCD or CMOS sensors). For example, see U.S. Patent No. 6,617,565 for a single-chip CMOS image sensor, the contents of which are incorporated herein by reference. A typical image sensor is based on a camera design and generally includes an integrated circuit located behind the lens, which may be micro or movable (eg, a spiral mounted lens). The sensor is used to convert light energy (photons) into electrical signals that are proportional to the amount of light received by the photosensitive elements organized in an array on the inductor. The image is synthesized based on the output of the photosensitive element.

影像辨識技術成為日益有需要的。各種大小及製造之攝像機對於諸如安全、識別、智慧、品質檢查、交通監督之應用及更多應用為有需要的。攝像機通常藉由有線或無線連接而鏈接至顯示裝置。現今,手機常規地配備有連接至安置於其中之LCD顯示裝置的微型相機。Image recognition technology has become increasingly needed. Cameras of all sizes and manufacturing are needed for applications such as security, identification, intelligence, quality inspection, traffic surveillance and more. The camera is typically linked to the display device by a wired or wireless connection. Today, mobile phones are conventionally equipped with a miniature camera that is connected to an LCD display device disposed therein.

高級影像辨識需要高解析度成像合成。由於處理能力之不足及/或由於處理器一次僅可處理影像之一像素,因此現今影像辨識系統以相對低的速度來操作。Advanced image recognition requires high-resolution imaging synthesis. Today's image recognition systems operate at relatively low speeds due to insufficient processing power and/or because the processor can only process one pixel of the image at a time.

因此,存在對於在先前技術上改良之新成像辨識裝置的需要。Therefore, there is a need for a new imaging recognition device that has been improved in the prior art.

本發明之目標為提供一種影像辨識裝置,其具有直接包括於構成入射影像與感應區之間的光學界面之透明或半透明材料中之感應區(例如,光敏元件)。影像辨識裝置本身較佳為透明或半透明的。It is an object of the present invention to provide an image recognition device having a sensing region (e.g., a light sensitive element) that is directly included in a transparent or translucent material that forms an optical interface between an incident image and a sensing region. The image recognition device itself is preferably transparent or translucent.

本發明之又一目標為借助於可訓練處理元件之陣列提供具有"區域"決策能力之感應區。在本發明之一實施例中,可訓練認知記憶體元件或單元與一或多個光敏元件相關聯。區域決策能力提供其減少裝置之傳輸需求(意即,頻寬)的優點,尤其當光敏元件之數目較大時且當光敏元件之傳輸頻率必須較高時提供該優點。藉由提供每一者具有區域決策能力之感應區的較大陣列,可獲得高解析度、高速度成像裝置。Yet another object of the present invention is to provide a sensing zone with "regional" decision making capabilities by means of an array of trainable processing elements. In one embodiment of the invention, a trainable cognitive memory element or unit is associated with one or more photosensitive elements. The regional decision making capability provides the advantage of reducing the transmission requirements (i.e., bandwidth) of the device, especially when the number of photosensitive elements is large and when the transmission frequency of the photosensitive elements must be high. High resolution, high speed imaging devices can be obtained by providing a larger array of sensing regions each having regional decision making capabilities.

根據本發明之實施例,可訓練認知記憶體元件可以低頻率並行操作並引起非常低的電流。因此,確保每一元件之自律操作,且可使用非常經濟的能源(諸如太陽能電池或均等物)。According to embodiments of the present invention, the trainable cognitive memory elements can operate in parallel at low frequencies and cause very low currents. Therefore, the self-discipline operation of each component is ensured, and a very economical energy source such as a solar cell or an equalizer can be used.

根據本發明之實施例,由所有嵌入於基板中之一或多個光敏元件與一或多個可訓練認知記憶體元件相關聯來形成新穎單石影像辨識裝置。In accordance with an embodiment of the present invention, a novel solitolite image recognition device is formed from all of one or more light sensitive elements embedded in a substrate associated with one or more trainable cognitive memory elements.

根據本發明之實施例,與複數個可訓練認知元件相關聯之複數個光敏元件可以一或多個陣列來配置且遍佈在平坦透明或半透明基板上。陣列可具有可變幾何形狀及連接性。典型幾何形狀可為(但不限於)平行神經元之線形陣列、或以矩形矩陣或蜂窩狀幾何形狀連接之神經元的二維陣列。In accordance with embodiments of the present invention, a plurality of photosensitive elements associated with a plurality of trainable cognitive elements can be configured in one or more arrays and spread over a flat transparent or translucent substrate. The array can have variable geometry and connectivity. A typical geometry may be, but is not limited to, a linear array of parallel neurons, or a two-dimensional array of neurons connected in a rectangular matrix or honeycomb geometry.

以下參看圖式論述本發明之各種實施例的進一步應用及優點。Further applications and advantages of various embodiments of the present invention are discussed below with reference to the drawings.

雖然可以許多不同形式來體現本發明,但本文中描述許多說明性實施例,其中理解將本揭示案看作提供本發明之原理的實例且不期望此等實例將本發明限於本文中所描述及/或所說明之任何特定較佳實施例。While the invention may be embodied in a variety of different forms, the present invention is described herein, and it is understood that / or any particular preferred embodiment illustrated.

本發明為一成像裝置,該成像裝置可包括諸如光敏元件之感應器感測裝置,其連接至可訓練認知元件(trainable cognitive element)、與該可訓練認知元件結合或另外與該可訓練認知元件相關聯,其中兩個元件化學沈積或另外沈積於透明基板之表面上或嵌入於透明基板之表面中。貫穿此文獻將感應區與具有"區域"決策能力之可訓練認知元件的結合稱為"認知感應器"。貫穿此文獻將可訓練認知元件稱為"CogniMem"。感應區一般由一或多個光敏元件構成,但可涵蓋其他感應配置。The present invention is an imaging device that can include an inductor sensing device, such as a light sensitive element, coupled to a trainable cognitive element, in conjunction with or otherwise associated with the trainable cognitive element Correspondingly, two of the elements are chemically deposited or otherwise deposited on the surface of the transparent substrate or embedded in the surface of the transparent substrate. Throughout this document, the combination of a sensing zone with a trainable cognitive component with "regional" decision making capabilities is referred to as a "cognitive sensor." Throughout this document, the trainable cognitive component is called "CogniMem". The sensing area typically consists of one or more photosensitive elements, but may encompass other sensing configurations.

根據本發明之實施例,認知感應器可經組態以辨識入射光圖案(例如,影像或影像部分)、處理入射光圖案以產生區域決策及傳輸區域決策之指示結果。認知感應器可包括許多組件,諸如(但不限於):區域決策能力-資料輸入邏輯、"神經元"及決策輸出邏輯,記憶體緩衝器,用於能量自律(energy autonomy)之太陽能電池及更多。每一認知感應器較佳特徵化並聯配置之反應相關學習記憶體(reactive associative learning memory;REALM)。根據本發明之實施例,CogniMem能夠在無任何電腦指令的情況下進行數位或類比圖案辨識。In accordance with embodiments of the present invention, a cognitive sensor can be configured to recognize an incident light pattern (eg, an image or image portion), process an incident light pattern to produce an indication of regional decisions and transmission region decisions. Cognitive sensors can include many components such as, but not limited to, regional decision making capabilities - data entry logic, "neurons" and decision output logic, memory buffers, solar cells for energy autonomy, and more. many. Each cognitive sensor preferably characterizes a reactive associative learning memory (REALM) in a parallel configuration. In accordance with an embodiment of the present invention, CogniMem is capable of digital or analog pattern recognition without any computer instructions.

CogniMem可包含一或多個神經元,該等神經元為可並行存取之相關記憶體,其可對與其本身內容類似之輸入圖案作出反應。神經元可藉由基於其他鄰近神經元之回應增強其回應來個別或共同地作出反應。可經由連接至神經元之抑制/激勵輸入線來完成此選擇。A CogniMem can contain one or more neurons that are parallel-accessible related memories that can react to input patterns that are similar in their own content. Neurons can react individually or collectively by enhancing their response based on responses from other neighboring neurons. This selection can be done via a suppression/excitation input line connected to the neuron.

CogniMem之神經元內容構成"知識"。知識為一組靜態區別數位簽名。知識可為靜態知識(一次載入)或動態知識(由其他神經元之反應來更新或自外部知識庫合適地載入),但較佳由學習過程(learning process)自動產生而不需要電腦如此做。沈積於相同基板上之CogniMem可使用相同或不同知識。The neuronal content of CogniMem constitutes "knowledge." Knowledge is a set of static distinct digital signatures. Knowledge can be static knowledge (one-time load) or dynamic knowledge (updated by other neurons' responses or properly loaded from an external knowledge base), but is preferably automatically generated by the learning process without the need for a computer. do. The same or different knowledge can be used for CogniMem deposited on the same substrate.

CogniMem可沈積於基板上或嵌入於基板中(或另外與基板耦接)作為認知感應器之一部分,或作為獨立部分。在前者狀況下,CogniMem通常專用於辨識由光敏元件所傳輸之像素資料。在後者狀況下,CogniMem可用於支持其他CogniMem,且可用於(例如)辨識由其他CogniMem單元所傳輸之不同資料類型(例如以合併來自多個認知感應器之回應圖案)。The CogniMem can be deposited on the substrate or embedded in the substrate (or otherwise coupled to the substrate) as part of the cognitive sensor, or as a separate part. In the former case, CogniMem is usually dedicated to identifying the pixel data transmitted by the photosensitive element. In the latter case, CogniMem can be used to support other CogniMems and can be used, for example, to identify different data types transmitted by other CogniMem units (eg, to incorporate response patterns from multiple cognitive sensors).

以下列出專利及公開申請案(其每一者之全部內容以引用的方式併入本文中)描述適用於CogniMem及認知感應器之神經元及神經網路的各種態樣:美國專利第5,621,863號神經元電路;第5,717,832號改良神經元電路架構;第5,701,397號用於預充電空閒神經元電路之電路;第5,710,869號用於神經元電路之串聯連接的菊鏈電路;第5,740,326號用於搜尋/分類神經網路中之資料的電路;第6,332,137號用於單獨硬體辨識之並聯相關記憶體;第6,606,614號單線搜尋及分類;日本申請案JP8-171543用於神經元電路之串聯連接的菊鏈電路;JP8-171542高級負載電路;JP8-171541聚集電路(搜尋/分類);JP8-171540神經網路及神經晶片;JP8-069445神經元電路架構;韓國專利申請案KR164943創新神經元電路架構;歐洲專利EP0694852創新神經元電路架構;EP0694854改良神經半導體晶片架構;EP0694855神經網路之搜尋/分類;EP0694853用於在辨識階段預充電空閒神經元電路中之輸入向量組件(input vector component)的電路;EP0694856用於神經元電路之串聯連接的菊鏈電路;加拿大申請案CA2149478改良神經元電路架構;加拿大專利CA2149479改良神經半導體晶片架構。The following is a list of patents and published applications, the entire contents of each of which are hereby incorporated by reference, for each of the entire disclosures of the disclosure of the disclosure of the disclosure of the disclosure of the disclosure of the disclosure of the disclosures of Neuron circuit; modified neuron circuit architecture No. 5,717,832; circuit 5,701,397 for precharging idle neuron circuits; karaoke circuit for series connection of neuron circuits; 5,740,326 for search/ Circuits for classifying data in neural networks; No. 6,332,137 for parallel-related memory for separate hardware identification; single-line search and classification for No. 6,606,614; Japanese application JP8-171543 for daisy-chaining of series connection of neuron circuits Circuit; JP8-171542 advanced load circuit; JP8-171541 aggregation circuit (search/classification); JP8-171540 neural network and neural chip; JP8-069445 neuron circuit architecture; Korean patent application KR164943 innovative neuron circuit architecture; Patent EP0694852 innovative neuron circuit architecture; EP0694854 improved neural semiconductor chip architecture; EP0694855 neural network search / classification; EP0694853 for pre-charging the input vector component of the idle neuron circuit in the identification phase; EP0694856 for the serial connection of the neuron circuit daisy chain circuit; Canadian application CA2149478 modified neuron circuit Architecture; Canadian patent CA2149479 improves the neural semiconductor wafer architecture.

建構於CogniMem上之神經元數目可自1改變為N,其中歸因於神經元單元之架構,N理論上為無限的。目前,N可高達約1000。一般而言,由應用來判定N,且詳言之,由將辨識之圖案之多樣性及所傳輸決策之類型來判定N。熟習此項技術者將認識到矽技術可為判定每單位面積可提供之神經元數目的重要因素。The number of neurons constructed on CogniMem can be changed from 1 to N, which is theoretically infinite due to the architecture of the neuronal unit. Currently, N can be as high as about 1000. In general, N is determined by the application, and in particular, N is determined by the diversity of patterns to be recognized and the type of decision being transmitted. Those skilled in the art will recognize that sputum technology can be an important factor in determining the number of neurons that can be provided per unit area.

圖1A及圖1B說明根據本發明之實施例之影像辨識裝置的例示性組態。圖1A為裝置100之俯視圖,該裝置100包括可由許多透明或半透明材料(諸如玻璃、塑膠玻璃、透明塑料等)製成之基板102。一或多個認知感應器104(在此種狀況下,為成一陣列)可嵌入於基板102中,或如在此種狀況下附接於或膠合至基板102之表面,或以其他方式與基板102之表面耦接(見圖1B)。可在基板上在每一光敏元件之前面蝕刻或沈積一光徑。舉例而言,可在基板102之認知感應器104之位置處蝕刻以產生用於每一認知感應器104之透鏡102a。或者,微透鏡102a可於光敏元件前面插入於基板102中(圖2)或膠合至(圖3A-圖3B)基板102上。另一選項可為改變基板以改變靠近每一感應器之基板部分的折射率,從而聚焦入射光。如圖1B中所示,入射光由基板透鏡102a聚集於每一認知感應器104上。1A and 1B illustrate an exemplary configuration of an image recognition device in accordance with an embodiment of the present invention. 1A is a top plan view of a device 100 that includes a substrate 102 that can be made from a variety of transparent or translucent materials such as glass, plastic glass, transparent plastic, and the like. One or more cognitive sensors 104 (in this case, in an array) can be embedded in the substrate 102 or attached or glued to the surface of the substrate 102, or otherwise The surface of 102 is coupled (see Figure 1B). An optical path can be etched or deposited on the substrate before each photosensitive element. For example, etched at the location of the cognitive sensor 104 of the substrate 102 to create a lens 102a for each cognitive sensor 104. Alternatively, the microlens 102a can be inserted into the substrate 102 (Fig. 2) or glued to (Fig. 3A-3B) the substrate 102 in front of the photosensitive element. Another option may be to change the substrate to change the refractive index of the portion of the substrate adjacent each inductor to focus the incident light. As shown in FIG. 1B, incident light is collected by the substrate lens 102a on each of the cognitive sensors 104.

複數個透鏡102a允許認知感應器104涵蓋各種視場,較佳等於基板表面,但亦可能地涵蓋窄於或大於等於基板表面之視場的視場。微透鏡102a將認知感應器104之陣列變為具有無限制表面及視場之遠心影像感測裝置。The plurality of lenses 102a allow the cognitive sensor 104 to encompass a variety of fields of view, preferably equal to the surface of the substrate, but may also cover a field of view that is narrower or greater than the field of view of the surface of the substrate. The microlens 102a changes the array of cognitive sensors 104 into a telecentric image sensing device with an unrestricted surface and field of view.

圖2為根據本發明之另一實施例之單石成像裝置的俯視圖。如所示,透鏡102a嵌入於基板102中且安置在每一認知感應器104上方。如成像裝置之使用實例,其展示DNA片段202安置在基板102之表面上。每一認知感應器104可經組態以個別地或與鄰近認知感應器104合作辨識特定DNA片段,且當該片段已經識別時輸出一訊號。2 is a top plan view of a single stone imaging apparatus in accordance with another embodiment of the present invention. As shown, the lens 102a is embedded in the substrate 102 and disposed over each of the cognitive sensors 104. As an example of use of the imaging device, the display DNA fragment 202 is disposed on the surface of the substrate 102. Each cognitive sensor 104 can be configured to recognize a particular DNA segment individually or in cooperation with a neighboring cognitive sensor 104 and output a signal when the segment has been identified.

圖3A-圖3B說明個別認知感應器104之例示性實施例。如圖3A中所示,集中神經元區104a環繞像素感應區域104b。神經元區104a中之神經元可與像素區104b中之感應元件耦接,且可經組態以辨識由像素區104b所感應之圖案。如圖3B中所示,凸透鏡或微透鏡102a安置在基板102之表面上的像素區104b上方,以用於將入射光聚集於像素區104b上,或直接連接至感應器而無中間基板。透鏡102a可(例如)由習知方法化學地沈積於基板上。3A-3B illustrate an exemplary embodiment of an individual cognitive sensor 104. As shown in FIG. 3A, the concentrated neuron region 104a surrounds the pixel sensing region 104b. Neurons in neuron region 104a can be coupled to sensing elements in pixel region 104b and can be configured to recognize patterns induced by pixel region 104b. As shown in FIG. 3B, a convex lens or microlens 102a is disposed over the pixel region 104b on the surface of the substrate 102 for focusing incident light on the pixel region 104b or directly connected to the inductor without an intermediate substrate. Lens 102a can be chemically deposited on a substrate, for example, by conventional methods.

圖4為根據本發明之實施例之例示性認知感應器104的功能性方塊圖。認知感應器104包括感應器或感應區域402、資料呈現邏輯404、神經網路406及區域決策邏輯408。感應器402可包括一或多個感應元件(諸如光敏元件)。資料呈現邏輯404與感應區域402及神經網路406耦接,且經組態以適合於處理之方式來將自感應器輸出之資料呈現至神經元。神經元406為或變為受知識"教導"且可處理自呈現邏輯404輸入至神經元406的資料,並將所處理資料輸出至基於處理資料產生決策之區域決策邏輯408。區域決策邏輯408可由各種已知方法與其他認知感應器或CogniMem耦接。因此,可以陣列及陣列之陣列來配置認知感應器104。4 is a functional block diagram of an exemplary cognitive sensor 104 in accordance with an embodiment of the present invention. The cognitive sensor 104 includes a sensor or sensing region 402, data presentation logic 404, neural network 406, and region decision logic 408. The sensor 402 can include one or more inductive elements (such as light sensitive elements). Data presentation logic 404 is coupled to sensing area 402 and neural network 406 and is configured to present data output from the sensor to the neurons in a manner suitable for processing. Neuron 406 is or becomes subject to knowledge "teaching" and can process the data input from presentation logic 404 to neuron 406 and output the processed data to regional decision logic 408 based on the processing data generation decision. The region decision logic 408 can be coupled to other cognitive sensors or CogniMems by a variety of known methods. Thus, the cognitive sensor 104 can be configured in an array of arrays and arrays.

圖5A及圖5B展示認知感應器之陣列的配置。如圖5A中所示,每一認知感應器104可與複數個認知感應器104耦接以用於陣列502。如下所述,輸入及輸出匯流排可用於感應器之串聯或並聯耦接。5A and 5B show the configuration of an array of cognitive sensors. As shown in FIG. 5A, each cognitive sensor 104 can be coupled to a plurality of cognitive sensors 104 for use in array 502. As described below, the input and output busses can be used for series or parallel coupling of inductors.

如圖5B中所示,每一陣列502可與複數個陣列502耦接以形成一陣列組504。藉由配置認知感應器104之陣列的陣列,產生高解析度及高速度之極有功效的辨識裝置。即,可藉由增加感應器之數目來增加成像裝置之解析度。然而,藉由以CogniMem形式提供穩固區域決策能力,認知感應器之數目增加不減小裝置之處理速度。此外,應理解可以許多不同幾何形狀來組織陣列,且本發明不限於正方形陣列。As shown in FIG. 5B, each array 502 can be coupled to a plurality of arrays 502 to form an array of groups 504. By configuring an array of arrays of cognitive sensors 104, a highly efficient identification device with high resolution and high speed is produced. That is, the resolution of the imaging device can be increased by increasing the number of sensors. However, by providing a robust regional decision making capability in the form of CogniMem, the increase in the number of cognitive sensors does not reduce the processing speed of the device. Moreover, it should be understood that the array can be organized in a number of different geometries, and the invention is not limited to square arrays.

如上所提及,每一神經元可與複數個輸入端1-n耦接,該輸入端1-n可為(例如)多工輸入端,但不限於此。圖6A為具有多個輸入端之神經元的表示,在圖6B中簡化其。因此,可使用輸入匯流排602(圖6C上不存在匯流排602)來組合神經元之陣列,如圖6C中之簡易平行架構所示。神經元406之每一輸出端可連接至全域決策匯流排406。As mentioned above, each neuron can be coupled to a plurality of inputs 1-n, which can be, for example, a multiplex input, but are not limited thereto. Figure 6A is a representation of a neuron having multiple inputs, which is simplified in Figure 6B. Thus, the array of neurons can be combined using input bus 602 (the bus bar 602 is absent on Figure 6C), as shown in the simple parallel architecture of Figure 6C. Each output of neuron 406 can be coupled to global decision bus 406.

圖7為根據本發明之實施例之例示性神經元的功能性方塊圖。組織為無限膨脹網路之神經元的目的為學習及回憶數位向量或簽名(圖案)。數位簽名主要為由資料簡化過程所編碼之光強度的空間分佈。可如圖6C中所表示並聯連接神經元,該方式意味著並聯連接所有神經元輸入端以及其所有輸出端。7 is a functional block diagram of an exemplary neuron in accordance with an embodiment of the present invention. The purpose of organizing neurons that are infinitely expanding networks is to learn and recall digital vectors or signatures (patterns). The digital signature is primarily a spatial distribution of the intensity of light encoded by the data reduction process. The neurons can be connected in parallel as represented in Figure 6C, which means that all neuron inputs and all their outputs are connected in parallel.

可將資料訊號自多工輸入匯流排(未圖示)輸入至神經元700。學習認知多工器702可劃分多工輸入訊號,且將輸入資料訊號傳輸至神經元回憶記憶體704及相關邏輯元件706中。神經元回憶記憶體704處理輸入訊號,且將所處理訊號輸出至相關邏輯元件706。相關邏輯元件706包括相似係數決策元件706a。The data signal can be input to the neuron 700 from the multiplex input bus (not shown). The learning cognitive multiplexer 702 can divide the multiplexed input signals and transmit the input data signals to the neuron recall memory 704 and associated logic elements 706. The neuron recall memory 704 processes the input signal and outputs the processed signal to the associated logic element 706. Correlation logic element 706 includes a similarity coefficient decision element 706a.

每一神經元可接收由資料呈現邏輯404所產生之廣播圖案(意即,表示感應器資料之數位簽名的向量)。此廣播圖案可為瞬時或在時域中之感應器產生資料的轉換(資料簡化)。Each neuron can receive a broadcast pattern (i.e., a vector representing the digital signature of the sensor data) generated by the data presentation logic 404. This broadcast pattern can be used to convert data (simplified data) for sensors generated instantaneously or in the time domain.

神經元具有三種可能隨後時序狀態:休眠、即將學習(RTL)及此後確定。至少一神經元在所有時間在RTL狀態中,除非網路為滿的(意即,所有神經元將被確定)。若認為所有並聯連接神經元為一鏈,則RTL神經元可自鏈之第一位置移動至最後位置。在此表示的情形下,RTL神經元通常將在確定神經元之右側,且休眠神經元將在RTL神經元之右側。Neurons have three possible subsequent timing states: sleep, forthcoming learning (RTL), and subsequent determination. At least one neuron is in the RTL state at all times unless the network is full (ie, all neurons will be determined). If all of the parallel connected neurons are considered to be a chain, the RTL neurons can move from the first position of the chain to the last position. In the case indicated here, the RTL neurons will typically be on the right side of the determined neurons and the dormant neurons will be on the right side of the RTL neurons.

當神經元為休眠時,其將不對任何入射圖案作出反應。RTL神經元將會將入射圖案載入至其回憶記憶體中以在使用者過程決策學習時學習其。此RTL神經元將不參與辨識過程,但將專用於學習時建立新知識。When a neuron is dormant, it will not react to any incident pattern. The RTL neuron will load the incident pattern into its recall memory to learn it during the user process decision learning. This RTL neuron will not participate in the identification process, but will be dedicated to learning new knowledge.

學習過程包括當未知圖案出現且使用者決策學習其時產生新知識。此知識添加將發生在RTL神經元中。除了產生新知識,可能錯誤地識別入射圖案(意即,未能關聯適當類別)之確定神經元將減少其相似域,以避免進一步錯分類。此情況引起知識修改或"自適應學習"。The learning process involves generating new knowledge when an unknown pattern appears and the user decides to learn it. This knowledge addition will occur in RTL neurons. In addition to generating new knowledge, certain neurons that may incorrectly identify the incident pattern (ie, fail to correlate with the appropriate category) will reduce their similar domains to avoid further misclassification. This situation causes knowledge modification or "adaptive learning."

光元件可輸出數位化放射量測值。在空間分佈之上的所有值組合形成一圖案;此圖案亦可在時域中發展且產生圖案流。此圖案經歷導致放射量測圖案之數位簽名(向量)的資料簡化過程。簡化過程不能超過以下所述所謂的"最小區別矩陣"。列舉5x7矩陣之實例,區別所有歐洲大寫字母而非漢字為可行的,為此需要16x16矩陣。The optical component can output a digitized radiation measurement. All values above the spatial distribution combine to form a pattern; this pattern can also develop in the time domain and produce a pattern stream. This pattern undergoes a data simplification process that results in a digital signature (vector) of the radiation measurement pattern. The simplification process cannot exceed the so-called "minimum discrimination matrix" described below. To enumerate examples of 5x7 matrices, it is feasible to distinguish all European capital letters instead of Chinese characters, which requires a 16x16 matrix.

當確定神經元在RTL狀態中時,其藉由使載入至回憶記憶體704中之向量與保存在類別暫存器709中之類別相關聯來學習圖案。當入射圖案進入確定神經元時,學習/辨識多工器702將傳輸其至相關邏輯706,以使此圖案與保存在回憶記憶體704中之向量之相似性得以估計。若發現所計算相似性小於或等於相似係數706a,則神經元將為激發的,且因此訊號通過邏輯712。激勵/抑制邏輯之功能為當許多神經元變為激發的時在所有確定"受激"(意即,激發)神經元之中執行全域仲裁,且"抑制"不具有最佳相似性之彼等神經元。When it is determined that the neuron is in the RTL state, it learns the pattern by associating the vector loaded into the recall memory 704 with the category stored in the class register 709. When the incident pattern enters the determining neuron, the learning/recognition multiplexer 702 will transmit it to the correlation logic 706 to estimate the similarity of this pattern to the vector stored in the recall memory 704. If the calculated similarity is found to be less than or equal to the similarity coefficient 706a, then the neuron will be energized, and thus the signal passes through logic 712. The function of the stimulus/suppression logic is to perform global arbitration among all defined "aggressive" (ie, excited) neurons when many neurons become excited, and "suppress" those that do not have the best similarity Neurons.

所關注之區域Area of concern

每一認知感應器可針對一視訊訊框與所關注之區域(ROI)相關聯。每一認知感應器可提取ROI之簽名以廣播至其神經元(用於學習或辨識目的)。ROI之簽名為其像素值的壓縮格式,其經減化以適合一N個值之序列,其中N為神經元記憶體單元之大小。Each cognitive sensor can be associated with a region of interest (ROI) for a video frame. Each cognitive sensor can extract the signature of the ROI for broadcast to its neurons (for learning or identification purposes). The signature of the ROI is a compressed format of its pixel values that is reduced to fit a sequence of N values, where N is the size of the neuron memory unit.

列舉神經元配備有256位元組之記憶體容量的實例。認知感應器可分類NxM像素之矩形ROI。ROI簽名將藉由(例如)簡易區塊壓縮自NxM個值減化為256個值。An example of a memory capacity with 256-bit tuples is listed. The cognitive sensor classifies the rectangular ROI of NxM pixels. The ROI signature will be reduced to 256 values from NxM values by, for example, simple block compression.

認知感應器可經組態以處理任何形狀之ROI,且簽名提取之選擇可為特殊應用(例如,部分檢查、表面檢查、面部辨識、目標追蹤等)。一些簽名提取可整合時間、重複性等。又,神經元可配備有大於8位元之記憶體單元,以向感應器之輸入端供應12位元之像素解析度或更大解析度。The cognitive sensor can be configured to handle ROI of any shape, and the signature extraction can be selected for special applications (eg, partial inspection, surface inspection, facial recognition, target tracking, etc.). Some signature extractions can integrate time, repeatability, and more. Also, the neuron can be equipped with a memory unit greater than 8 bits to supply a pixel resolution of 12 bits or greater to the input of the sensor.

神經元連同感應器及資料呈現邏輯之組合構成完全新穎之方法,以用於嵌入影像辨識而無學習或辨識過程所需之任何軟體。The combination of neurons, together with the sensor and data presentation logic, constitutes a completely novel method for embedding image recognition without any software required for the learning or identification process.

CogniMem之定址可為傳遞或選擇性的(諸如由其他CogniMem單元之回應所驅動)。The location of the CogniMem can be either transitive or selective (such as driven by responses from other CogniMem units).

應理解承載認知感應器之基板充當機械支持且作為透鏡(見例如圖1-圖2)。基板可為(但不限於)由玻璃、塑膠玻璃、塑料、聚脂薄膜或其他材料製成之剛性或可撓性、平坦或彎曲表面。It should be understood that the substrate carrying the cognitive sensor acts as a mechanical support and acts as a lens (see, for example, Figures 1-2). The substrate can be, but is not limited to, a rigid or flexible, flat or curved surface made of glass, plastic glass, plastic, mylar or other materials.

在相同基板上在認知感應器與CogniMem單元之間的連接性應較佳使用最小數目之導線。The connection between the cognitive sensor and the CogniMem unit on the same substrate should preferably use a minimum number of wires.

載入至認知感應器中之知識可較佳解決相關或不相關之不同系列圖案的辨識。The knowledge loaded into the cognitive sensor can better resolve the identification of different series of patterns that are related or unrelated.

實例Instance

根據本發明之實施例,認知感應器在自動製造過程期間對於執行檢查為理想的。如圖8中所示,一或多個認知感應器可用於檢查水瓶。在此實例中,三不同認知感應器用於檢查三不同區域,稱為專家1-3。全域回應可視三個"專家"認知感應器之組合回應而定。According to an embodiment of the invention, the cognitive sensor is ideal for performing an inspection during the automated manufacturing process. As shown in Figure 8, one or more cognitive sensors can be used to inspect the water bottle. In this example, three different cognitive sensors are used to examine three different regions, referred to as Experts 1-3. The global response can be determined by a combination of three "expert" cognitive sensors.

在此實例中,認知感應器1(專家1)可經訓練以分類含有瓶蓋802之ROI的簽名。認知感應器1可分類其ROI為2個類別:好及壞。壞類別可結合若干狀況:蓋丟失或未適當擰緊蓋。In this example, cognitive sensor 1 (Expert 1) can be trained to classify the signature of the ROI containing cap 802. Cognitive Sensor 1 can classify its ROI into two categories: good and bad. A bad category can combine several conditions: the cover is missing or the cover is not properly tightened.

同樣地,認知感應器2(專家2)可學習與瓶中流體線804相交之ROI的簽名。ROI可為較窄垂直矩形且將理想地覆蓋瓶中之最小及最大可能填充高度。視製造者之品質控制標準而定,認知感應器2可將其ROI分類為任何數目之類別(例如):可接受及不可接受的;過高、可接受及過低;或過高、高但可接受;範圍內、低但可接受、過低。Likewise, cognitive sensor 2 (Expert 2) can learn the signature of the ROI that intersects the fluid line 804 in the bottle. The ROI can be a narrower vertical rectangle and will ideally cover the minimum and maximum possible fill height in the bottle. Depending on the quality control standards of the manufacturer, the cognitive sensor 2 can classify its ROI into any number of categories (for example): acceptable and unacceptable; too high, acceptable and too low; or too high, high but Acceptable; range, low but acceptable, too low.

認知感應器3(專家3)可學習覆蓋標籤區806之所關注之區域的簽名。認知感應器3可經訓練以辨識狀況之多樣性或狀況之組合,諸如(例如):丟失標籤、有缺陷標籤(撕破、有劃痕或折疊)、錯放標籤(顛倒、傾斜)及較好的。The cognitive sensor 3 (Expert 3) can learn to cover the signature of the area of interest of the tag area 806. The cognitive sensor 3 can be trained to recognize a variety of conditions or a combination of conditions, such as, for example, missing tags, defective tags (tear, scratches or folds), misplaced tags (reversed, tilted), and Ok.

可將來自認知感應器1-3之輸出提供至與自動製造過程相關之控制器,以基於藉此所產生之決策採取適當行動。The output from the cognitive sensors 1-3 can be provided to a controller associated with the automated manufacturing process to take appropriate action based on the decisions generated thereby.

根據本發明之實施例,可個別地封裝認知感應器以形成智慧光電池或智慧微透鏡。此裝置應用於許多技術且可用於(例如)偵測移動部分、在機械組裝過程中識別路線或按路線傳送移動部分(圖9A);用於生物測定識別,諸如在照相手機中(圖9B);或用於在門窺孔等物中之來賓偵測及辨識(圖9C)。In accordance with embodiments of the present invention, the cognitive sensor can be individually packaged to form a smart photocell or smart microlens. This device is used in many techniques and can be used, for example, to detect moving parts, identify routes during mechanical assembly or route moving parts (Fig. 9A); for biometric identification, such as in camera phones (Fig. 9B) Or for guest detection and identification in door peepholes and the like (Fig. 9C).

根據本發明之另一實施例,提供駕駛員察覺偵測系統。參看圖10,一或多個認知感應器104可嵌入於機動車輛之擋風玻璃、儀錶板平板顯示器或前燈中。可教導認知感應器104辨識指示駕駛員何時不再專心(例如,駕駛員入睡)之圖案,且輸出訊號以觸發警報。此等圖案可包括凝視追蹤、面部辨識、面部表情辨識及更多。此外,可教導擋風玻璃或前燈中之認知感應器104辨識在車輛外部之物件或事件,諸如以擋風玻璃水刮系統識別雨點,或識別行車事故以用於行車事故警告系統。In accordance with another embodiment of the present invention, a driver awareness detection system is provided. Referring to Figure 10, one or more of the cognitive sensors 104 can be embedded in a windshield, dashboard flat panel display or headlight of a motor vehicle. The cognitive sensor 104 can be taught to recognize a pattern indicating when the driver is no longer attentive (eg, the driver falls asleep) and output a signal to trigger an alarm. Such patterns may include gaze tracking, facial recognition, facial expression recognition and more. In addition, the cognitive sensor 104 in the windshield or headlight can be taught to identify objects or events external to the vehicle, such as identifying a raindrop with a windshield wiper system, or identifying a driving accident for a traffic accident warning system.

可用許多方式偵測在遠視場或近視場隨機出現的物件。舉例而言,兩個或三個感應器可配備有在不同距離處聚焦之透鏡。感應器可載入相同知識,但對具有不同大小之所關注之區域起作用。若至少一感應器辨識到物件,則可認為辨識系統之全域回應為正確的。There are many ways to detect objects that appear randomly in the far field or near field of view. For example, two or three sensors can be equipped with lenses that are focused at different distances. Sensors can load the same knowledge, but work with areas of different sizes. If at least one sensor recognizes the object, then the global response of the identification system is considered correct.

又,可用對不同波長(諸如近IR、IR、經過濾顏色(color filtered)等)敏感之輸入感應器來設計認知感應器。對於特定物件或景象,此等認知感應器將產生不同像素值,但可在其個別視訊影像上經訓練以辨識物件之類別。在目標追蹤中,近IR及IR認知感應器之組合將提供在一天中的任何時間辨識目標之能力。Also, cognitive sensors can be designed with input sensors that are sensitive to different wavelengths, such as near IR, IR, color filtered, and the like. For a particular object or scene, these cognitive sensors will produce different pixel values, but can be trained on their individual video images to identify the category of the object. In target tracking, the combination of near-IR and IR cognitive sensors will provide the ability to identify targets at any time of the day.

根據本發明之另一實施例,成陣列之認知感應器可用於許多其他製造應用。舉例而言,如圖11A中所示,一維陣列之認知感應器1102可用於在製造過程中檢查玻璃浮子(glass float)1103。如圖11B中所示,二維陣列之認知感應器1104可用於偵測容器1105(諸如飲料瓶)之底部的污染物。在此等應用中,可教導每一認知感應器識別指示玻璃裂縫或流體污染物之圖案。In accordance with another embodiment of the present invention, an array of cognitive sensors can be used in many other manufacturing applications. For example, as shown in FIG. 11A, a one-dimensional array of cognitive sensors 1102 can be used to inspect a glass float 1103 during manufacturing. As shown in FIG. 11B, a two-dimensional array of cognitive sensors 1104 can be used to detect contaminants at the bottom of the container 1105, such as a beverage bottle. In such applications, each cognitive sensor can be taught to identify a pattern indicative of a glass crack or fluid contaminant.

根據本發明之另一實施例,可在玻璃平面等物上配置認知感應器以執行多個獨力功能。認知感應器可為成群的且每群以不同知識來教導。圖12展示滑動玻璃門1202為一實例,該滑動玻璃門1202包括若干認知感應器群1204,以用於偵測不同大小之接近中物件。第一群可用辨識人或動物(例如,狗)之第一大小1208的知識來教導,同時第二群可用不同大小的人(例如,男孩)1210教導,第三群用於另一大小的人(例如,成人)1212,等等。每一群1204可與一或多個CogniMem 1206耦接以用於滑動門之控制。According to another embodiment of the present invention, a cognitive sensor can be disposed on a glass plane or the like to perform a plurality of independent functions. Cognitive sensors can be grouped and each group taught with different knowledge. 12 shows an example of a sliding glass door 1202 that includes a plurality of cognitive sensor groups 1204 for detecting objects of different sizes. The first group can be taught by knowledge of a first size 1208 that identifies a person or animal (eg, a dog) while the second group can be taught by people of different sizes (eg, boys) 1210, and the third group is used for people of another size (for example, adult) 1212, and so on. Each group of 1204 can be coupled to one or more CogniMem 1206 for control of the sliding door.

對於熟習此項技術者顯而易見:如在閱讀此專利文獻之後,本發明之成像裝置在此處未列出之許多其他應用中可為有用的。舉例而言,另一應用包括在壩、橋或其他人造構造中之永久損害的偵測(紋理變化)。此應用之實施應根據本發明實施例之以上描述而顯而易見。此外,功率及訊號傳輸可為無線的(例如,紅外線、光電池、感應線圈等)。It will be apparent to those skilled in the art that the imaging device of the present invention may be useful in many other applications not listed herein, as after reading this patent document. Another application, for example, includes detection of permanent damage (texture changes) in dams, bridges, or other man-made structures. The implementation of this application should be apparent from the above description of embodiments of the invention. In addition, power and signal transmission can be wireless (eg, infrared, photocell, induction coil, etc.).

因此,以上已參看圖式完整描述許多較佳實施例。儘管已基於此等較佳實施例描述本發明,但對於熟習此項技術者顯而易見:在本發明之精神及範疇內可對所述實施例進行一些修改、變化及替代建構。Thus, many preferred embodiments have been described above in detail with reference to the drawings. Although the present invention has been described in terms of the preferred embodiments thereof, it is apparent to those skilled in the art that the invention may be modified, modified, and substituted in the spirit and scope of the invention.

100...裝置100. . . Device

102...基板102. . . Substrate

102a...透鏡102a. . . lens

104...認知感應器104. . . Cognitive sensor

104a...神經元區104a. . . Neuronal area

104b...像素區104b. . . Pixel area

202...DNA片段202. . . DNA fragment

402...感應器/感應區域402. . . Sensor/sensing area

404...資料呈現邏輯404. . . Data presentation logic

406...神經網路406. . . Neural network

408...區域決策邏輯408. . . Regional decision logic

502...陣列502. . . Array

504...陣列組504. . . Array group

700...神經元700. . . Neurons

702...學習認知多工器702. . . Learning cognitive multiplexer

704...神經元回憶記憶體704. . . Neuron recall memory

706...相關邏輯元件706. . . Related logic components

706a...相似係數決策元件706a. . . Similarity coefficient decision component

709...類別暫存器709. . . Category register

712...邏輯712. . . logic

802...瓶蓋802. . . Cap

804...瓶中流體線804. . . Fluid line in the bottle

806...標籤區806. . . Label area

1102...認知感應器之之一維陣列1102. . . One-dimensional array of cognitive sensors

1103...玻璃浮子1103. . . Glass float

1104...認知感應器之二維陣列1104. . . Two-dimensional array of cognitive sensors

1105...容器1105. . . container

1202...滑動玻璃門1202. . . Sliding glass door

1204...認知感應器群1204. . . Cognitive sensor group

1206...CogniMem1206. . . CogniMem

1208...第一大小的人或動物1208. . . First size person or animal

1210...不同大小的人1210. . . People of different sizes

1212...另一大小的人1212. . . Another size person

圖1A-圖1B分別包括根據本發明實施例之安置於玻璃或塑膠玻璃或其他透明塑料或透明基板上之感應器陣列的前視圖及俯視圖,在該玻璃或塑膠玻璃或基板中具有蝕刻透鏡;圖2為根據本發明實施例之安置於玻璃或神經叢基板上之感應器陣列的俯視圖,其展示偵測DNA片段,在該玻璃或基板中具有蝕刻透鏡;圖3A-圖3B分別說明根據本發明之一實施例之感應器模的側視圖及俯視圖;圖4為根據本發明之實施例之感應器的方塊圖;圖5A為根據本發明之實施例之感應器陣列的方塊圖;圖5B為根據本發明之實施例之感應器陣列組的方塊圖;圖6A-6C說明根據本發明之實施例之神經組態;圖7為根據本發明之實施例之神經元的方塊圖;及圖8-圖12說明根據本發明之實施例之影像辨識裝置的例示性應用。1A-1B respectively include front and top views of an array of inductors disposed on glass or plastic glass or other transparent plastic or transparent substrate having an etched lens in the glass or plastic glass or substrate, in accordance with an embodiment of the present invention; 2 is a top plan view of an array of inductors disposed on a glass or plexus substrate, showing a detected DNA fragment having an etched lens in the glass or substrate, according to an embodiment of the invention; FIGS. 3A-3B illustrate Side view and top view of an inductor mold of one embodiment of the invention; FIG. 4 is a block diagram of an inductor according to an embodiment of the present invention; FIG. 5A is a block diagram of an inductor array according to an embodiment of the present invention; a block diagram of a sensor array set in accordance with an embodiment of the present invention; FIGS. 6A-6C illustrate a neural configuration in accordance with an embodiment of the present invention; FIG. 7 is a block diagram of a neuron according to an embodiment of the present invention; 8- Figure 12 illustrates an illustrative application of an image recognition device in accordance with an embodiment of the present invention.

100...裝置100. . . Device

102...基板102. . . Substrate

102a...透鏡102a. . . lens

104...認知感應器104. . . Cognitive sensor

Claims (35)

一種影像辨識裝置,其包含:一感應區,其嵌入於一透明或半透明基板中或安置於一透明或半透明基板上;及一處理元件,其與該感應區耦接,該處理元件嵌入於該基板中或安置於該基板上;其中該透明或半透明基板構成一在待感應之入射影像與該感應區之一感應像素之間的一光學界面。 An image recognition device comprising: a sensing region embedded in a transparent or translucent substrate or disposed on a transparent or translucent substrate; and a processing component coupled to the sensing region, the processing component being embedded Or being disposed on the substrate; wherein the transparent or translucent substrate forms an optical interface between the incident image to be sensed and one of the sensing pixels of the sensing region. 如請求項1之影像辨識裝置,其中該感應區為透明或半透明的。 The image recognition device of claim 1, wherein the sensing area is transparent or translucent. 如請求項1之影像辨識裝置,其中該基板包含玻璃、塑膠玻璃或其他透明材料。 The image recognition device of claim 1, wherein the substrate comprises glass, plastic glass or other transparent material. 如請求項1之影像辨識裝置,其中該感應區包含一或多個光敏元件,且該處理元件包括一或多個認知記憶體元件,其中每一該光敏元件經組態以基於在一輸入端處接收之光來輸出一訊號,且每一該認知記憶體元件經組態以根據該等光敏元件所輸出之該等訊號辨識一圖案。 The image recognition device of claim 1, wherein the sensing region comprises one or more photosensitive elements, and the processing element comprises one or more cognitive memory elements, wherein each of the photosensitive elements is configured to be based on an input The received light outputs a signal, and each of the cognitive memory elements is configured to recognize a pattern based on the signals output by the photosensitive elements. 如請求項4之影像辨識裝置,其中該認知記憶體元件為可訓練的。 The image recognition device of claim 4, wherein the cognitive memory component is trainable. 如請求項4之影像辨識裝置,其中每一該認知記憶體元件包含由一多工輸入匯流排耦接至其一輸入端側上且由一輸出匯流排耦接至其一輸出端側上之複數個神經元,每一該神經元受一知識教導,該知識允許該相應神經元 辨識一訊號且執行一決策。 The image recognition device of claim 4, wherein each of the cognitive memory elements comprises a multiplex input bus coupled to an input side thereof and coupled to an output side of an output bus. a plurality of neurons, each of which is taught by a knowledge that allows the corresponding neuron Identify a signal and perform a decision. 如請求項1之影像辨識裝置,其中該基板包括複數個透鏡部分,每一透鏡部分向一光學界面提供該影像辨識裝置之一感應像素或像素區。 The image recognition device of claim 1, wherein the substrate comprises a plurality of lens portions, each lens portion providing an optical interface with an inductive pixel or pixel region of the image recognition device. 如請求項7之影像辨識裝置,其中每一透鏡部分由該基板之蝕刻所形成。 The image recognition device of claim 7, wherein each lens portion is formed by etching of the substrate. 如請求項1之影像辨識裝置,其中該影像辨識裝置包括以一陣列組織之複數個該等感應區。 The image recognition device of claim 1, wherein the image recognition device comprises a plurality of the sensing regions organized in an array. 如請求項1之影像辨識裝置,其中該影像辨識裝置經組態以輸出一無線輸出訊號。 The image recognition device of claim 1, wherein the image recognition device is configured to output a wireless output signal. 如請求項1之影像辨識裝置,其中該裝置係無線供電的。 The image recognition device of claim 1, wherein the device is wirelessly powered. 一種影像辨識裝置,其包含:複數個認知感應器,其安置在一透明或半透明基板上,每一感應器包含:一光敏元件;及一可訓練認知記憶體單元,其與該光敏元件相關聯;形成於該基板上之複數個光學界面,其每一者與該複數個認知感應器之一相應認知感應器光學地耦接。 An image recognition device comprising: a plurality of cognitive sensors disposed on a transparent or translucent substrate, each sensor comprising: a photosensitive element; and a trainable cognitive memory unit associated with the photosensitive element And a plurality of optical interfaces formed on the substrate, each of which is optically coupled to a respective one of the plurality of cognitive sensors. 如請求項12之影像辨識裝置,其中該等光學界面為藉由在靠近每一該認知感應器之位置處蝕刻該基板而形成之透鏡。 The image recognition device of claim 12, wherein the optical interfaces are lenses formed by etching the substrate at a position adjacent to each of the cognitive sensors. 如請求項12之影像辨識裝置,其中每一認知感應器為可 訓練的,且經組態以基於入射光來辨識各種圖案。 The image recognition device of claim 12, wherein each cognitive sensor is Trained and configured to recognize various patterns based on incident light. 如請求項12之影像辨識裝置,其中該基板包含玻璃、塑膠玻璃或其他透明材料。 The image recognition device of claim 12, wherein the substrate comprises glass, plastic glass or other transparent material. 如請求項12之影像辨識裝置,其中每一該認知記憶體元件包含由一多工輸入匯流排耦接至其一輸入端側上且由一輸出匯流排耦接至其一輸出端側上之複數個神經元,每一該神經元受一知識教導,該知識允許該相應神經元辨識一訊號且執行一決策。 The image recognition device of claim 12, wherein each of the cognitive memory elements comprises a multiplex input bus coupled to an input side thereof and coupled to an output side of an output bus. A plurality of neurons, each of which is taught by a knowledge that allows the corresponding neuron to recognize a signal and perform a decision. 如請求項16之影像辨識裝置,其中每一認知記憶體單元經教導以辨識一影像之一不同部分,且該複數個認知記憶體單元經組態以共同地操作從而辨識該影像。 The image recognition device of claim 16, wherein each cognitive memory unit is taught to identify a different portion of an image, and the plurality of cognitive memory units are configured to operate in common to identify the image. 如請求項17之影像辨識裝置,其中該等認知感應器經組態以於該影像之該辨識時輸出一訊號。 The image recognition device of claim 17, wherein the cognitive sensors are configured to output a signal for the identification of the image. 如請求項12之影像辨識裝置,其中該等認知感應器以低頻率並行操作。 The image recognition device of claim 12, wherein the cognitive sensors operate in parallel at a low frequency. 如請求項12之影像辨識裝置,其中該等認知感應器以非常低的電流來操作。 The image recognition device of claim 12, wherein the cognitive sensors operate at a very low current. 如請求項12之影像辨識裝置,其中每一認知感應器經組態以發送並接收若干無線訊號。 The image recognition device of claim 12, wherein each cognitive sensor is configured to transmit and receive a plurality of wireless signals. 如請求項12之影像辨識裝置,其中該裝置係無線供電的。 The image recognition device of claim 12, wherein the device is wirelessly powered. 一種影像辨識裝置,其包含:一透明或半透明基板;認知感應構件,其用於感應入射光之各種圖案且基於 該等感應圖案輸出一訊號,該認知感應構件嵌入於該基板中;及光學界面構件,其用於提供一光學界面給該認知感應構件;其中該認知感應構件包含複數個認知感應器,每一者包含:一光敏元件;及一可訓練認知記憶體單元,其與該光敏元件相關聯。 An image recognition device comprising: a transparent or translucent substrate; a cognitive sensing member for sensing various patterns of incident light and based on The sensing patterns output a signal, the cognitive sensing member is embedded in the substrate, and the optical interface member is configured to provide an optical interface to the cognitive sensing member; wherein the cognitive sensing member comprises a plurality of cognitive sensors, each The method comprises: a photosensitive element; and a trainable cognitive memory unit associated with the photosensitive element. 如請求項23之影像辨識裝置,其中每一光敏元件為一光偵測器,其中每一該光偵測器經組態以基於在一輸入端處接收之光來輸出一訊號,且每一該認知記憶體單元經組態以根據該等光偵測器所輸出之該等訊號辨識一圖案。 The image recognition device of claim 23, wherein each of the photosensitive elements is a photodetector, wherein each of the photodetectors is configured to output a signal based on light received at an input, and each The cognitive memory unit is configured to recognize a pattern based on the signals output by the photodetectors. 如請求項23之影像辨識裝置,其中該光學界面構件包含形成於該基板中之複數個透鏡。 The image recognition device of claim 23, wherein the optical interface member comprises a plurality of lenses formed in the substrate. 如請求項23之影像辨識裝置,其中每一該認知記憶體單元包含由一多工輸入匯流排耦接至其一輸入端側上且由一輸出匯流排耦接至其一輸出端側上之複數個神經元,每一該神經元受一知識教導,該知識允許該相應神經元辨識一訊號且執行一決策。 The image recognition device of claim 23, wherein each of the cognitive memory units comprises a multiplex input bus coupled to an input side thereof and coupled to an output side of an output bus. A plurality of neurons, each of which is taught by a knowledge that allows the corresponding neuron to recognize a signal and perform a decision. 如請求項23之影像辨識裝置,其中認知感應構件經由複數個平行元件數位化執行影像辨識操作而無需一軟體程式,每一平行元件具有自給自足的、自律的行為。 The image recognition device of claim 23, wherein the cognitive sensing component performs image recognition operations by digitizing a plurality of parallel components without a software program, each parallel component having self-sufficient, self-regulating behavior. 如請求項23之影像辨識裝置,其中認知感應構件經組態以發送並接收若干無線訊號。 The image recognition device of claim 23, wherein the cognitive sensing component is configured to transmit and receive a plurality of wireless signals. 如請求項23之影像辨識裝置,其中該裝置係無線供電的。 The image recognition device of claim 23, wherein the device is wirelessly powered. 一種影像辨識裝置,其包含具有一感應器的神經元及資料呈現邏輯之一組合,其中該組合嵌入於一透明或半透明基板中或安置於一透明或半透明基板上。 An image recognition device comprising a combination of a neuron having a sensor and a data presentation logic, wherein the combination is embedded in a transparent or translucent substrate or disposed on a transparent or translucent substrate. 一種影像辨識方法,其包含以下步驟:使認知感應構件嵌入於一透明或半透明基板中或沈積於一透明或半透明基板上,該認知感應構件用於感應若干入射光之圖案且基於該等感應圖案輸出一訊號;及提供光學界面構件,該光學界面構件用於提供一光學界面給該認知感應構件;其中該認知感應構件包含複數個認知感應,每一者包含:一光敏元件;及一可訓練認知記憶體單元,其與該光敏元件相關聯。 An image recognition method comprising the steps of: embedding a cognitive sensing member in a transparent or translucent substrate or depositing on a transparent or translucent substrate, the cognitive sensing member for sensing a pattern of incident light and based on the The sensing pattern outputs a signal; and provides an optical interface member for providing an optical interface to the cognitive sensing member; wherein the cognitive sensing member comprises a plurality of cognitive sensors, each comprising: a photosensitive element; and a A cognitive memory unit can be trained that is associated with the photosensitive element. 如請求項31之影像辨識方法,其中每一光敏元件為一光偵測器,其中每一該光偵測器經組態以基於在一輸入端處接收之光輸出一訊號,且每一該認知記憶體單元經組態以從該等光偵測器所輸出之該等訊號中辨識一圖案。 The image recognition method of claim 31, wherein each of the photosensitive elements is a photodetector, wherein each of the photodetectors is configured to output a signal based on light received at an input, and each of the The cognitive memory unit is configured to recognize a pattern from the signals output by the photodetectors. 如請求項31之影像辨識方法,其進一步包含提供形成於 該基板中或沈積於該基板上以作為該光學界面構件之一部分之複數個透鏡的一步驟。 The image recognition method of claim 31, further comprising providing the image formation A step of the plurality of lenses in the substrate or deposited on the substrate as part of the optical interface member. 如請求項31之影像辨識方法,其中每一該認知記憶體單元包含由一多工輸入匯流排耦接至其一輸入端側且由一輸出匯流排耦接至其一輸出端側之複數個神經元,每一該神經元受一知識教導,該知識允許該相應神經元辨識一訊號且執行一決策。 The image recognition method of claim 31, wherein each of the cognitive memory units comprises a plurality of input buffers coupled to one of the input sides and coupled to an output side of an output bus. Neurons, each of which is taught by a knowledge that allows the corresponding neuron to recognize a signal and perform a decision. 一種影像辨識方法,其包含:使用複數個光學界面以提供至複數個感應元件之一光學路徑,該複數個光學界面嵌入於一透明或半透明基板中或提供於一透明或半透明基板上,該複數個感應元件嵌入於該基板中或提供於該基板上;及於複數個處理元件中平行處理產生自該複數個感應元件之若干信號,該複數個處理元件之每一者耦接至該複數個感應元件之一者且該複數個處理元件之每一者嵌入於該基板中或提供於該基板上。 An image recognition method comprising: using a plurality of optical interfaces to provide an optical path to one of a plurality of sensing elements, the plurality of optical interfaces being embedded in a transparent or translucent substrate or provided on a transparent or translucent substrate; The plurality of sensing elements are embedded in or provided on the substrate; and a plurality of signals generated from the plurality of sensing elements are processed in parallel in the plurality of processing elements, each of the plurality of processing elements being coupled to the plurality of processing elements One of a plurality of sensing elements and each of the plurality of processing elements is embedded in or provided on the substrate.
TW095124992A 2006-07-07 2006-07-07 Monolithic image perception device and method TWI463418B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW095124992A TWI463418B (en) 2006-07-07 2006-07-07 Monolithic image perception device and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW095124992A TWI463418B (en) 2006-07-07 2006-07-07 Monolithic image perception device and method

Publications (2)

Publication Number Publication Date
TW200805178A TW200805178A (en) 2008-01-16
TWI463418B true TWI463418B (en) 2014-12-01

Family

ID=44766036

Family Applications (1)

Application Number Title Priority Date Filing Date
TW095124992A TWI463418B (en) 2006-07-07 2006-07-07 Monolithic image perception device and method

Country Status (1)

Country Link
TW (1) TWI463418B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8478081B2 (en) * 2005-06-30 2013-07-02 Agc Flat Glass North America, Inc. Monolithic image perception device and method

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW374889B (en) * 1999-03-03 1999-11-21 Gemintek Corp Vehicle parking fare rating report and the monitoring system
EP0717366B1 (en) * 1994-12-12 2002-08-14 Xerox Corporation A neural network incorporating direct optical imaging
TW200424593A (en) * 2003-05-08 2004-11-16 Micron Technology Inc Multiple microlens system for image sensors or display units
TW200507253A (en) * 2003-07-03 2005-02-16 Taiwan Semiconductor Mfg Co Ltd Packaged image sensor with improved sensitivity and device comprising the same
TWI240216B (en) * 2002-06-27 2005-09-21 Ind Tech Res Inst Pattern recognition method by reducing classification error

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0717366B1 (en) * 1994-12-12 2002-08-14 Xerox Corporation A neural network incorporating direct optical imaging
TW374889B (en) * 1999-03-03 1999-11-21 Gemintek Corp Vehicle parking fare rating report and the monitoring system
TWI240216B (en) * 2002-06-27 2005-09-21 Ind Tech Res Inst Pattern recognition method by reducing classification error
TW200424593A (en) * 2003-05-08 2004-11-16 Micron Technology Inc Multiple microlens system for image sensors or display units
TW200507253A (en) * 2003-07-03 2005-02-16 Taiwan Semiconductor Mfg Co Ltd Packaged image sensor with improved sensitivity and device comprising the same

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
S. Vitabile et al., 2002. "MULTI-LAYER PERCEPTRON MAPPING ON A SIMD ARCHITECTURE". Neural Networks for Signal Processing, 2002. Proceedings of the 2002 12th IEEE Workshop. *

Also Published As

Publication number Publication date
TW200805178A (en) 2008-01-16

Similar Documents

Publication Publication Date Title
CA2613922C (en) Monolithic image perception device and method
US9092689B2 (en) Monolithic image perception device and method
US9158954B2 (en) Systems and methods to read machine-readable symbols
CN104143098B (en) Night pedestrian recognition method based on far-infrared camera head
CN108139484A (en) The control method of range unit and range unit
US11532233B2 (en) Vehicle vision system with cross traffic detection
CN104039610B (en) Camera chain, the camera chain particularly for vehicle
Liu et al. Vision-based stop sign detection and recognition system for intelligent vehicles
CN102324166A (en) Fatigue driving detection method and device
JP5083164B2 (en) Image processing apparatus and image processing method
TWI463418B (en) Monolithic image perception device and method
JPH11353580A (en) Method and device for discriminating kind of vehicle at night
Xie et al. The research of traffic cones detection based on Haar-like features and adaboost classification
JP4887539B2 (en) Object type determination device

Legal Events

Date Code Title Description
MM4A Annulment or lapse of patent due to non-payment of fees