WO2022099904A1 - Dispositif de détection multimodal en fonction d'un capteur d'image - Google Patents
Dispositif de détection multimodal en fonction d'un capteur d'image Download PDFInfo
- Publication number
- WO2022099904A1 WO2022099904A1 PCT/CN2020/142001 CN2020142001W WO2022099904A1 WO 2022099904 A1 WO2022099904 A1 WO 2022099904A1 CN 2020142001 W CN2020142001 W CN 2020142001W WO 2022099904 A1 WO2022099904 A1 WO 2022099904A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image sensor
- sensing unit
- signal
- optical
- device based
- Prior art date
Links
- 230000003287 optical effect Effects 0.000 claims abstract description 41
- 230000004044 response Effects 0.000 claims abstract description 15
- 239000000126 substance Substances 0.000 claims description 34
- 238000006243 chemical reaction Methods 0.000 claims description 12
- 238000012545 processing Methods 0.000 claims description 9
- 230000000007 visual effect Effects 0.000 claims description 8
- 230000008447 perception Effects 0.000 claims description 5
- 238000006073 displacement reaction Methods 0.000 claims description 4
- 230000008054 signal transmission Effects 0.000 claims description 4
- 238000005286 illumination Methods 0.000 claims description 3
- 230000002452 interceptive effect Effects 0.000 claims description 3
- 230000000903 blocking effect Effects 0.000 claims description 2
- 230000005284 excitation Effects 0.000 claims description 2
- 238000001514 detection method Methods 0.000 abstract description 13
- 238000005516 engineering process Methods 0.000 abstract description 5
- 230000010354 integration Effects 0.000 abstract description 3
- 239000004065 semiconductor Substances 0.000 abstract description 3
- 239000007789 gas Substances 0.000 description 29
- 238000000034 method Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 7
- 230000001133 acceleration Effects 0.000 description 5
- 235000019645 odor Nutrition 0.000 description 5
- CURLTUGMZLYLDI-UHFFFAOYSA-N Carbon dioxide Chemical compound O=C=O CURLTUGMZLYLDI-UHFFFAOYSA-N 0.000 description 4
- 241000255925 Diptera Species 0.000 description 4
- 238000004458 analytical method Methods 0.000 description 4
- 230000008859 change Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- UHOVQNZJYSORNB-UHFFFAOYSA-N Benzene Chemical compound C1=CC=CC=C1 UHOVQNZJYSORNB-UHFFFAOYSA-N 0.000 description 3
- 241000219095 Vitis Species 0.000 description 3
- 235000009754 Vitis X bourquina Nutrition 0.000 description 3
- 235000012333 Vitis X labruscana Nutrition 0.000 description 3
- 235000014787 Vitis vinifera Nutrition 0.000 description 3
- VLKZOEOYAKHREP-UHFFFAOYSA-N n-Hexane Chemical compound CCCCCC VLKZOEOYAKHREP-UHFFFAOYSA-N 0.000 description 3
- LFQSCWFLJHTTHZ-UHFFFAOYSA-N Ethanol Chemical compound CCO LFQSCWFLJHTTHZ-UHFFFAOYSA-N 0.000 description 2
- KDLHZDBZIXYQEI-UHFFFAOYSA-N Palladium Chemical compound [Pd] KDLHZDBZIXYQEI-UHFFFAOYSA-N 0.000 description 2
- 239000004698 Polyethylene Substances 0.000 description 2
- 230000009471 action Effects 0.000 description 2
- 239000001569 carbon dioxide Substances 0.000 description 2
- 229910002092 carbon dioxide Inorganic materials 0.000 description 2
- 239000003086 colorant Substances 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 239000007788 liquid Substances 0.000 description 2
- RLSSMJSEOOYNOY-UHFFFAOYSA-N m-cresol Chemical compound CC1=CC=CC(O)=C1 RLSSMJSEOOYNOY-UHFFFAOYSA-N 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 229910052751 metal Inorganic materials 0.000 description 2
- 239000002184 metal Substances 0.000 description 2
- 229910044991 metal oxide Inorganic materials 0.000 description 2
- 150000004706 metal oxides Chemical class 0.000 description 2
- -1 polyethylene Polymers 0.000 description 2
- 229920000573 polyethylene Polymers 0.000 description 2
- 238000007639 printing Methods 0.000 description 2
- 238000001179 sorption measurement Methods 0.000 description 2
- 239000003039 volatile agent Substances 0.000 description 2
- MGWGWNFMUOTEHG-UHFFFAOYSA-N 4-(3,5-dimethylphenyl)-1,3-thiazol-2-amine Chemical compound CC1=CC(C)=CC(C=2N=C(N)SC=2)=C1 MGWGWNFMUOTEHG-UHFFFAOYSA-N 0.000 description 1
- 239000004925 Acrylic resin Substances 0.000 description 1
- 229920000178 Acrylic resin Polymers 0.000 description 1
- UFHFLCQGNIYNRP-UHFFFAOYSA-N Hydrogen Chemical compound [H][H] UFHFLCQGNIYNRP-UHFFFAOYSA-N 0.000 description 1
- JVTAAEKCZFNVCJ-UHFFFAOYSA-N Lactic Acid Natural products CC(O)C(O)=O JVTAAEKCZFNVCJ-UHFFFAOYSA-N 0.000 description 1
- 102000007562 Serum Albumin Human genes 0.000 description 1
- 108010071390 Serum Albumin Proteins 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000007664 blowing Methods 0.000 description 1
- 108010064114 carbon dioxide receptor Proteins 0.000 description 1
- 150000001868 cobalt Chemical class 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000010668 complexation reaction Methods 0.000 description 1
- 238000011109 contamination Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000002845 discoloration Methods 0.000 description 1
- 239000000428 dust Substances 0.000 description 1
- 239000000975 dye Substances 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005265 energy consumption Methods 0.000 description 1
- 235000019674 grape juice Nutrition 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 239000001257 hydrogen Substances 0.000 description 1
- 229910052739 hydrogen Inorganic materials 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000004310 lactic acid Substances 0.000 description 1
- 235000014655 lactic acid Nutrition 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 239000011664 nicotinic acid Substances 0.000 description 1
- JCXJVPUVTGWSNB-UHFFFAOYSA-N nitrogen dioxide Inorganic materials O=[N]=O JCXJVPUVTGWSNB-UHFFFAOYSA-N 0.000 description 1
- 229910052763 palladium Inorganic materials 0.000 description 1
- 239000011148 porous material Substances 0.000 description 1
- VCRBUDCZLSQJPZ-UHFFFAOYSA-N porphyrinogen Chemical compound C1C(N2)=CC=C2CC(N2)=CC=C2CC(N2)=CC=C2CC2=CC=C1N2 VCRBUDCZLSQJPZ-UHFFFAOYSA-N 0.000 description 1
- 238000004451 qualitative analysis Methods 0.000 description 1
- 238000004445 quantitative analysis Methods 0.000 description 1
- 238000006479 redox reaction Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 239000011540 sensing material Substances 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 239000002904 solvent Substances 0.000 description 1
- 238000009987 spinning Methods 0.000 description 1
- 238000005507 spraying Methods 0.000 description 1
- 238000010186 staining Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000003860 storage Methods 0.000 description 1
- 230000002195 synergetic effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000016776 visual perception Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/75—Systems in which material is subjected to a chemical reaction, the progress or the result of the reaction being investigated
- G01N21/77—Systems in which material is subjected to a chemical reaction, the progress or the result of the reaction being investigated by observing the effect on a chemical indicator
- G01N21/78—Systems in which material is subjected to a chemical reaction, the progress or the result of the reaction being investigated by observing the effect on a chemical indicator producing a change of colour
- G01N21/783—Systems in which material is subjected to a chemical reaction, the progress or the result of the reaction being investigated by observing the effect on a chemical indicator producing a change of colour for analysing gases
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/01—Arrangements or apparatus for facilitating the optical investigation
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02A—TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
- Y02A90/00—Technologies having an indirect contribution to adaptation to climate change
- Y02A90/10—Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation
Definitions
- the invention relates to physical sensing, chemical sensing and image sensing, and belongs to the field of intelligent sensing.
- bionic robots can use cameras to obtain image information, use mechanical sensors on the robot hand to obtain tactile signals, and use metal oxides and other types of gas sensors to form an array to detect odors.
- metal oxides and other types of gas sensors to form an array to detect odors.
- integrated sensing devices capable of multimodal perception has important application value in the field of smart devices.
- image sensors mainly include photosensitive coupling element type and complementary metal oxide semiconductor type.
- Each image sensor integrates a large number of photoelectric conversion units, image signal processing systems and signal interfaces. This makes image sensors ideal for signal detection in optical sensor arrays.
- the traditional method is to use the image sensor and the lens module to capture the image of the optical sensor array at a distance away from it, but the entire detection system is bulky, and the size of the sensing unit generally needs to be at the millimeter level to obtain a clearer image.
- Image is to use the image sensor and the lens module to capture the image of the optical sensor array at a distance away from it, but the entire detection system is bulky, and the size of the sensing unit generally needs to be at the millimeter level to obtain a clearer image.
- the purpose of the present invention is to provide a multi-modal sensing device based on an image sensor in view of the deficiencies of the prior art.
- the technical solution adopted by the present invention is: a multi-modal sensing device based on an image sensor, comprising the following structures: an image sensor, an optical sensing unit and a lens module; part of the surface of the image sensor is modified to generate The optical sensing unit that responds to the optical signal is used to detect the sensing signal. Meanwhile, the part of the image sensor that does not modify the optical sensing unit can detect external image information by using the lens module.
- the device directly decorates the optical sensing unit on the surface of the image sensor, and directly obtains a clear image of the micron-sized sensing unit without the lens module focusing light. This greatly reduces the size of the sensing unit and detection system. In addition, due to the reduction in the size of the sensing unit, after the surface of the image sensor is modified with an optical sensor array for physical or chemical signal detection, there are still a large number of photoelectric conversion units that are not covered. These photoelectric conversion units cooperate with the lens module to obtain clear external image signals.
- the multi-modal sensing device of the present invention has high integration and obtains multiple dimensions of information, which is conducive to the miniaturization of the intelligent device and the improvement of the perception capability.
- the image sensor of the present invention includes an array photoelectric conversion unit and a signal transmission module.
- the image sensor of the present invention further includes a signal processing module.
- optical sensing unit of the present invention is a physical signal sensing unit and/or a chemical signal sensing unit.
- the physical signal sensing unit of the present invention can generate optical signal changes including changes in color, light intensity, shape, displacement, and the like.
- the chemical signal sensing unit of the present invention can generate optical signal changes including changes in color, light intensity, shape, refractive index, fluorescence signal, and the like.
- the image sensor-based multimodal sensing device of the present invention further includes a housing, the lens module is fixed on the housing, the housing is placed on the image sensor, and one or more gas circulation structures are arranged on the housing.
- the multimodal sensing device based on the image sensor described in the present invention further includes one or more light sources, which are used to provide illumination for the optical sensing unit, or used as excitation light sources for fluorescent signals.
- the image sensor-based multimodal sensing device of the present invention further includes one or more light path control modules for blocking the light source and airflow from interfering with the external image information received by the image sensor.
- the present invention also provides a specific application device based on the above-mentioned multimodal sensing device - a visual and olfactory cooperative sensing device, which includes the following structures:
- an image sensor for collecting optical signals
- the gas sensing unit directly modified on the surface of the image sensor is used to detect the gas sensing signal that generates an optical signal response; when there is detectable gas around, the gas sensing unit will generate optical signal changes that can be detected by the image sensor;
- the lens module installed above the surface of the image sensor is used to acquire external image signals.
- the above visual and olfactory synergistic perception device can simultaneously realize end-to-side detection and analysis of visual and olfactory information.
- the present invention has the following beneficial effects:
- the present invention utilizes a physical signal sensing unit and a chemical signal sensing unit that can generate an optical signal response to be fixed on the surface of the image sensor part to realize multimodal signal detection on the same device.
- a physical signal sensing unit and a chemical signal sensing unit that can generate an optical signal response to be fixed on the surface of the image sensor part to realize multimodal signal detection on the same device.
- it is small in size and simple in structure, and is more suitable for integrated applications on size-sensitive smart devices such as micro-robots and smart phones.
- the image detected by the multi-modal sensing device based on the image sensor of the present invention contains visual, physical and chemical information, and multiple types of signals can be analyzed simultaneously in one image signal processing, which significantly improves the ability of smart devices to respond.
- the efficiency of information acquisition and analysis reduces the time cost and computing power cost.
- the image sensor used in the present invention is compatible with semiconductor and integrated circuit technologies, so the storage and computing functions can be integrated in the image sensor to realize end-to-side detection and analysis of multi-dimensional information, and further improve the integration degree and computing capability of the intelligent system.
- the multimodal sensing device based on the image sensor of the present invention has a simple structure, low cost, good repeatability, is convenient for mass production and has a good market application prospect.
- Figure 1a and Figure 1b are a schematic diagram of the overall structure of the multimodal sensing device and a schematic diagram of each part of the split;
- FIG. 2 is a schematic diagram of an image signal of a multimodal sensing device
- 3a, 3b, and 3c are a schematic structural diagram of a lens module, a disassembled schematic diagram of a multimodal sensing device, and a cross-sectional view of the multimodal sensing device, respectively.
- Figure 4a and Figure 4b are schematic diagrams of images before and after the response of the physical signal sensing unit
- Fig. 5a and Fig. 5b are schematic diagrams of the images before and after the response of the chemical signal sensing unit, respectively.
- the image sensor-based multimodal sensing device 1 of the present invention includes an image sensor 11 , an optical sensing unit (physical signal sensing unit 12 , chemical signal sensing unit 13 ) and a lens module.
- the physical signal sensing unit 12 and the chemical signal sensing unit 13 can be selected and combined to be modified on the image sensor 11 as required.
- the image sensor 11 can directly obtain the image 21 of the physical signal sensing unit 12 and the chemical signal sensor without using the lens module. Image 22 of sensor unit 13 .
- the part of the surface of the image sensor 11 that is not covered by the physical signal sensing unit 12 and the chemical signal sensing unit 13 can acquire an image 23 of an external object through the focusing function of the lens module, such as the image of a person included in the image shown in FIG. 2 .
- the lens module is fixed on a housing 14 , and the image sensor and the optical sensing unit decorated on the surface of the image sensor are located inside the housing, which can prevent dust and other contamination of the image sensor 11 and affect the detection accuracy. .
- a light source 142 may be added to the image sensor-based multimodal sensing device 1 .
- the light source 142 is located at the top inside the housing 14 to provide illumination to the physical signal sensing unit 12 and the chemical signal sensing unit 13 .
- the light path control module 1 143 is arranged between the image sensor 11 and the light source 142 to block the light generated by the light source 142 to prevent the light source 142 from interfering with the external image information received by the image sensor 11. As shown in FIGS.
- the second optical path control module 111 is disposed between the optical sensing unit and the gas circulation structure 141 , which can block the external light entering from the gas circulation structure 141 and reduce the reception of the external light to the image sensor 11 .
- the image information of the physical signal sensing unit 12 and the chemical signal sensing unit 13 interfere.
- the light source, the light path control module and the gas circulation structure are all adaptively set according to the optical sensing unit. For example, if it is a sensing unit related to wind direction, wind speed and acceleration, the light path control module may not be provided to avoid affecting the detection.
- the physical signal sensing unit 12 and the chemical signal sensing unit 13 can be processed and modified on the surface of the image sensor 11 by techniques such as printing, spraying, spinning, printing, and stamp transfer.
- the minimum size of the physical signal sensing unit 12 and the chemical signal sensing unit 13 is the size of a single photoelectric conversion unit of the image sensor 11 , and the maximum size is the size of the entire image sensitive area of the image sensor 11 .
- the physical quantities detectable by the physical signal sensing unit 12 include, but are not limited to, temperature, humidity, wind direction, wind speed, acceleration, and the like. Changes in these physical signals may cause changes in the optical signals generated by the physical signal sensing unit 12 .
- the temperature sensing unit 311 when the temperature is low and the temperature sensing unit 312 when the temperature is high show different colors, and the temperature sensing unit can use, but not limited to, organic, inorganic and liquid crystal thermochromic materials ;
- the humidity sensing unit 321 when the humidity is low and the humidity sensing unit 322 when the humidity is high can show different colors, and the humidity sensing materials that the humidity sensing unit can use include cobalt salts, etc.; Different wind directions and wind speeds can change different shapes.
- the airflow sensing unit 331 in the absence of wind becomes a deformed airflow sensing unit 332 when the left side is blowing.
- the dashed line represents the shape without deformation; Displacement will be generated under the action, for example, the acceleration sensing unit 341 in a static state will become the acceleration sensing unit 342 that generates displacement when there is a rightward acceleration.
- the factors that produce the optical signal change include, but are not limited to, changes in parameters such as light intensity, color, shape, and refractive index.
- the reaction mechanisms that generate these optical signals include, but are not limited to, redox reactions, pH discoloration, Schiff-type reactions, complexation reactions, metal staining, lyochromism, solvent adsorption, pore adsorption, and the like. As shown in FIG.
- the light-colored chemical sensing unit 411 before the reaction becomes a dark-colored chemical sensing unit 412 after reacting with the gas sample, for example, containing light brown N,N-dimethyl-1-naphthalene It can react with nitrogen dioxide to produce a dark brown product;
- the color-changing chemical sensing unit 421 before the reaction becomes a chemical sensing unit 422 with a different color after reacting with the gas sample, such as blue m-cresol violet in the It turns yellow after reacting with carbon dioxide;
- the expandable chemical sensing unit 431 before the reaction becomes a larger chemical sensing unit 432 after reacting with the gas sample.
- the chemical sensing unit 441 with variable refractive index before reacting with the gas sample becomes the chemical sensing unit 442 with different spot positions.
- the refractive index of acrylic resin will change after combining with benzene gas;
- the strip-shaped chemical sensing unit 451 becomes a curved chemical sensing unit 452 after reacting with the gas sample, for example, a sensing unit composed of a layer of polyethylene coated paper, when exposed to hexane gas, polyethylene. will expand and lengthen while the paper does not change, so the sensing unit will bend towards one side of the paper.
- the device of the present invention can be widely used in the fields of detection and identification.
- the following uses the visual and olfactory cooperative sensing device (the optical sensing unit only uses the gas sensing unit) as a specific example to introduce the application of the device of the present invention in analyzing and identifying substances.
- the gas sensing unit is composed of serum albumin modified with 6-propionyl-2-dansyl chloride, oxidized porphyrinogen and lyochromic dyes, and is based on the known odor and the response of the gas sensing unit.
- the signal builds a database of gas responses.
- Step 1 place the visual and olfactory cooperative sensing device near two transparent containers containing objects, and use the visual and olfactory cooperative sensing device to collect image signals including gas sensing information and image information of the object to be measured from the two transparent containers respectively.
- Step 2 The image signal is transmitted to a signal processing module inside or outside the image sensor 11 through the signal transmission module of the image sensor 11 .
- the signal processing module compares the response signal of the gas sensing unit 12 with the established gas response database, and determines that the gaseous volatiles in the first transparent container contain alcohol and grape odor components, and the gaseous volatiles in the second transparent container contain alcohol and grape odors. Contains grape odor components.
- the signal processing module compares the external image information with the established image database, and determines that both transparent containers contain purple liquid.
- Step 3 The signal processing module integrates the response signal of the gas sensing unit 12 and the external image information, and can determine that the first transparent container is wine and the second transparent container is grape juice.
- the present invention can be used to detect and identify solids, liquids and gases.
- the qualitative and quantitative analysis of the substance may also be performed solely by utilizing the response signal of the gas sensing unit 12 and the external image information.
- the present invention simulates the method of using multi-dimensional sensory information when organisms recognize substances, which greatly improves the recognition and detection capabilities of traditional machine olfactory and machine vision systems.
Landscapes
- Physics & Mathematics (AREA)
- Chemical & Material Sciences (AREA)
- Pathology (AREA)
- General Health & Medical Sciences (AREA)
- Immunology (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Analytical Chemistry (AREA)
- Biochemistry (AREA)
- General Physics & Mathematics (AREA)
- Chemical Kinetics & Catalysis (AREA)
- Plasma & Fusion (AREA)
- Engineering & Computer Science (AREA)
- Investigating Or Analysing Materials By Optical Means (AREA)
- Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)
- Investigating Or Analysing Materials By The Use Of Chemical Reactions (AREA)
Abstract
Un dispositif de détection multimodal (1) en fonction d'un capteur d'image comprend la structure suivante : un capteur d'image (11), des unités de détection optique (12, 13) et un module de lentille. Une partie de la surface du capteur d'image (11) est modifiée avec les unités de détection optique (12, 13) qui peuvent générer une réponse de signal optique et qui sont utilisées pour détecter un signal de détection ; la partie du capteur d'image (11) qui n'est pas modifiée avec les unités de détection optique (12, 13) peut détecter, conjointement avec le module de lentille, des informations d'une image externe (23). L'utilisation d'un capteur d'image qui est compatible avec la technologie des semi-conducteurs et la technologie des circuits intégrés permet de réduire la taille et d'atteindre un degré élevé d'intégration, d'effectuer une détection parallèle simultanée de multiples signaux de détection et de signaux d'image sur le même dispositif, et d'améliorer la capacité d'un dispositif intelligent à acquérir des informations externes.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011257142.8 | 2020-11-10 | ||
CN202011257142.8A CN112415002B (zh) | 2020-11-10 | 2020-11-10 | 一种基于图像传感器的多模态传感器件 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022099904A1 true WO2022099904A1 (fr) | 2022-05-19 |
Family
ID=74781132
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2020/142001 WO2022099904A1 (fr) | 2020-11-10 | 2020-12-31 | Dispositif de détection multimodal en fonction d'un capteur d'image |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN112415002B (fr) |
WO (1) | WO2022099904A1 (fr) |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112415002B (zh) * | 2020-11-10 | 2023-03-14 | 之江实验室 | 一种基于图像传感器的多模态传感器件 |
CN113607782A (zh) * | 2021-07-28 | 2021-11-05 | 浙江工业大学 | 一种利用嗅觉信号增强的视觉感知式水质预警系统及方法 |
CN114531555B (zh) * | 2022-04-24 | 2022-08-26 | 之江实验室 | 一种端侧轮廓增强的仿生视觉传感器 |
CN114821576A (zh) * | 2022-06-30 | 2022-07-29 | 之江实验室 | 一种基于视觉嗅觉协同感知器件的目标识别方法和装置 |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2004094969A1 (fr) * | 2003-04-22 | 2004-11-04 | Raytheon Company | Microbolometre spectroscopique integre dote de reseaux de microfiltres |
CN101514956A (zh) * | 2008-08-18 | 2009-08-26 | 北京九州泰康生物科技有限责任公司 | 一类分子检测系统 |
CN103502798A (zh) * | 2011-04-05 | 2014-01-08 | 集成等离子光子学公司 | 集成等离子激元感测装置和设备 |
CN106918626A (zh) * | 2017-04-14 | 2017-07-04 | 中国石油化工股份有限公司 | 危险气氛综合状态指纹识别方法 |
CN107402244A (zh) * | 2017-06-30 | 2017-11-28 | 江苏大学 | 一种双模态交互传感阵列芯片制造与信息获取方法 |
CN109447130A (zh) * | 2018-09-30 | 2019-03-08 | 江苏大学 | 一种基于可视化气敏阵列的哈败腊肉检测装置与方法 |
WO2020097748A1 (fr) * | 2018-11-12 | 2020-05-22 | 深圳市汇顶科技股份有限公司 | Appareil de détection optique et terminal |
CN111539234A (zh) * | 2020-05-28 | 2020-08-14 | 厦门大学 | 基于模块化超构表面和cmos图像传感器的分子条形码检测法 |
CN112415002A (zh) * | 2020-11-10 | 2021-02-26 | 之江实验室 | 一种基于图像传感器的多模态传感器件 |
Family Cites Families (24)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2958458B1 (ja) * | 1998-08-26 | 1999-10-06 | 防衛庁技術研究本部長 | 多眼画像センサ |
KR100801448B1 (ko) * | 2007-05-16 | 2008-02-11 | (주)실리콘화일 | 바이오칩 |
US8456523B2 (en) * | 2009-07-20 | 2013-06-04 | Precitec Kg | Laser processing head and method for compensating for the change in focus position in a laser processing head |
FR2948815B1 (fr) * | 2009-07-31 | 2012-02-03 | E2V Semiconductors | Structure de plots de connexion pour composant electronique |
US10101571B2 (en) * | 2012-07-10 | 2018-10-16 | Novadaq Technologies ULC | Perfusion assessment multi-modality optical medical device |
DE102012014503A1 (de) * | 2012-07-20 | 2014-01-23 | Dräger Safety AG & Co. KGaA | Gasmesssystem |
CN103325804A (zh) * | 2013-06-28 | 2013-09-25 | 上海宏力半导体制造有限公司 | Cmos图像传感器结构 |
CN104459098B (zh) * | 2013-09-23 | 2016-11-23 | 西门子医疗保健诊断公司 | 一种采集医学样本图像的诊断装置 |
US10097780B2 (en) * | 2014-06-05 | 2018-10-09 | Invisage Technologies, Inc. | Sensors and systems for the capture of scenes and events in space and time |
CN105738292A (zh) * | 2014-12-12 | 2016-07-06 | 中国科学院大连化学物理研究所 | 一种比色传感器阵列的手机成像方法 |
KR101749734B1 (ko) * | 2015-07-09 | 2017-06-22 | (주)옵토레인 | 유해가스 감지장치 및 그 방법 |
CN105784840B (zh) * | 2016-04-27 | 2018-09-28 | 浙江大学 | 基于微小血液样品的血液粘弹力测定装置及方法 |
CN105898122B (zh) * | 2016-05-09 | 2018-08-31 | 中国兵器工业计算机应用技术研究所 | 一种光电感知系统 |
CN109475328A (zh) * | 2016-06-09 | 2019-03-15 | 因赛特系统公司 | 用于检测生物特性的集成发光显示器及传感器 |
US20180073989A1 (en) * | 2016-09-09 | 2018-03-15 | Medtronic, Inc. | Fluid sensor card |
CN108229255A (zh) * | 2016-12-21 | 2018-06-29 | 江苏迪康姆生物技术有限公司 | 一种掌纹采集一体机 |
WO2018200995A2 (fr) * | 2017-04-27 | 2018-11-01 | Polybiomics, Inc. | Systèmes de polybiodétection et d'imagerie orthogonaux |
GB201708338D0 (en) * | 2017-05-24 | 2017-07-05 | Univ Court Univ Of Glasgow | Metabolite detection apparatus and method of detecting metabolites |
CN109801934A (zh) * | 2018-12-13 | 2019-05-24 | 深圳市灵明光子科技有限公司 | 一种图像传感单元及其制作方法、图像传感器 |
JP2019148801A (ja) * | 2019-03-20 | 2019-09-05 | ザ ボード オブ トラスティーズ オブ ザ レランド スタンフォード ジュニア ユニバーシティー | 落射蛍光顕微鏡を使用する方法、イメージング装置を使用する方法、及び落射蛍光顕微鏡 |
CN110155364A (zh) * | 2019-05-08 | 2019-08-23 | 之江实验室 | 一种带有振动检测功能的无人机电子调速器及多旋翼无人机 |
CN110392214A (zh) * | 2019-08-05 | 2019-10-29 | Oppo广东移动通信有限公司 | 图像处理方法、装置、存储介质及电子设备 |
CN111145190B (zh) * | 2019-12-27 | 2022-06-17 | 之江实验室 | 一种基于医学图像处理与可视化的单个器官互动方法 |
CN111617515B (zh) * | 2020-05-15 | 2021-08-17 | 浙江大学 | 一种基于阵列传感器的气液固三相分离装置及分离方法 |
-
2020
- 2020-11-10 CN CN202011257142.8A patent/CN112415002B/zh active Active
- 2020-12-31 WO PCT/CN2020/142001 patent/WO2022099904A1/fr active Application Filing
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2004094969A1 (fr) * | 2003-04-22 | 2004-11-04 | Raytheon Company | Microbolometre spectroscopique integre dote de reseaux de microfiltres |
CN101514956A (zh) * | 2008-08-18 | 2009-08-26 | 北京九州泰康生物科技有限责任公司 | 一类分子检测系统 |
CN103502798A (zh) * | 2011-04-05 | 2014-01-08 | 集成等离子光子学公司 | 集成等离子激元感测装置和设备 |
CN106918626A (zh) * | 2017-04-14 | 2017-07-04 | 中国石油化工股份有限公司 | 危险气氛综合状态指纹识别方法 |
CN107402244A (zh) * | 2017-06-30 | 2017-11-28 | 江苏大学 | 一种双模态交互传感阵列芯片制造与信息获取方法 |
CN109447130A (zh) * | 2018-09-30 | 2019-03-08 | 江苏大学 | 一种基于可视化气敏阵列的哈败腊肉检测装置与方法 |
WO2020097748A1 (fr) * | 2018-11-12 | 2020-05-22 | 深圳市汇顶科技股份有限公司 | Appareil de détection optique et terminal |
CN111539234A (zh) * | 2020-05-28 | 2020-08-14 | 厦门大学 | 基于模块化超构表面和cmos图像传感器的分子条形码检测法 |
CN112415002A (zh) * | 2020-11-10 | 2021-02-26 | 之江实验室 | 一种基于图像传感器的多模态传感器件 |
Non-Patent Citations (1)
Title |
---|
SHAKOOR ABDUL, CHEAH BOON C., HAO DANNI, AL-RAWHANI MOHAMMED, NAGY BENCE, GRANT JAMES, DALE CARL, KEEGAN NEIL, MCNEIL CALUM, CUMMI: "Plasmonic Sensor Monolithically Integrated with a CMOS Photodiode", ACS PHOTONICS, vol. 3, no. 10, 16 September 2016 (2016-09-16), pages 1926 - 1933, XP055930329, ISSN: 2330-4022, DOI: 10.1021/acsphotonics.6b00442 * |
Also Published As
Publication number | Publication date |
---|---|
CN112415002B (zh) | 2023-03-14 |
CN112415002A (zh) | 2021-02-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2022099904A1 (fr) | Dispositif de détection multimodal en fonction d'un capteur d'image | |
Xu et al. | Automatic smartphone-based microfluidic biosensor system at the point of care | |
Lopez-Ruiz et al. | Smartphone-based simultaneous pH and nitrite colorimetric determination for paper microfluidic devices | |
AU2019222844B2 (en) | Device and system for collecting and analyzing vapor condensate, particularly exhaled breath condensate, as well as method of using the same | |
Yang et al. | Detection platforms for point-of-care testing based on colorimetric, luminescent and magnetic assays: A review | |
Yang et al. | Novel developments in mobile sensing based on the integration of microfluidic devices and smartphones | |
Askim et al. | Hand-held reader for colorimetric sensor arrays | |
CN101821620B (zh) | 微流体传感器复合结构 | |
CN102707051B (zh) | 金标免疫层析试纸条检测系统的性能校正方法 | |
CA2802318C (fr) | Dispositif de detection d'un analyte dans un liquide corporel | |
Han et al. | Low-cost point-of-care biosensors using common electronic components as transducers | |
Kassal et al. | Wireless and mobile optical chemical sensors and biosensors | |
WO2021175239A1 (fr) | Carte de test de système à multiples groupes sanguins automatique et procédé de test | |
Geng et al. | Colorimetric biosensor based on smartphone: State-of-art | |
Balsam et al. | Capillary array waveguide amplified fluorescence detector for mHealth | |
Rasooly et al. | Improving the sensitivity and functionality of mobile webcam-based fluorescence detectors for point-of-care diagnostics in global health | |
CN102128830A (zh) | 免疫层析检测试纸条显色信号定量检测器 | |
CN101387601A (zh) | Pc式免疫试纸图像识别及定量分析仪 | |
CN102095497A (zh) | 基于小孔成像的免疫层析检测试纸条显色信号定量检测器 | |
CN210742126U (zh) | 一种检测微囊藻毒素的生物传感器 | |
CN109342414A (zh) | 一种可视化传感阵列芯片及其制备方法 | |
US20190017987A1 (en) | Performing one or more analyses on a thin layer of biologic fluid using optically responsive chemical sensors | |
CN207502541U (zh) | 一种免疫层析便携式分析仪 | |
Kim et al. | Smartphone-based medical diagnostics with microfluidic devices | |
KR20150048381A (ko) | 휴대용 바이오센서 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20961456 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 20961456 Country of ref document: EP Kind code of ref document: A1 |