CN104822033A - Visual sensor based on infrared and visible light image fusion and using method thereof - Google Patents

Visual sensor based on infrared and visible light image fusion and using method thereof Download PDF

Info

Publication number
CN104822033A
CN104822033A CN201510223733.6A CN201510223733A CN104822033A CN 104822033 A CN104822033 A CN 104822033A CN 201510223733 A CN201510223733 A CN 201510223733A CN 104822033 A CN104822033 A CN 104822033A
Authority
CN
China
Prior art keywords
infrared
image
module
ccd
processing module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510223733.6A
Other languages
Chinese (zh)
Other versions
CN104822033B (en
Inventor
乔铁柱
陈路路
王宇
王东
王峰
靳保全
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Taiyuan University of Technology
Original Assignee
Taiyuan University of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Taiyuan University of Technology filed Critical Taiyuan University of Technology
Priority to CN201510223733.6A priority Critical patent/CN104822033B/en
Publication of CN104822033A publication Critical patent/CN104822033A/en
Application granted granted Critical
Publication of CN104822033B publication Critical patent/CN104822033B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Transforming Light Signals Into Electric Signals (AREA)
  • Studio Devices (AREA)

Abstract

The invention, which belongs to the field of the visual sensor, provides a visual sensor based on infrared and visible light image fusion and a using method thereof. The sensor is characterized in that the sensor is a binocular visual sensor with integration of an infrared CCD and an industrial CCD. According to the visual sensor, the principle that two special interfaces in a beam splitter prism can reflect certain primary-color light selectively and enable other light to pass through the prism is fully utilized; coaxial light emitted by a same lens is respectively projected to an infrared CCD and an industrial CCD and thus the infrared CCD and the industrial CCD can collect an infrared image and a visible light image at the same point of an object simultaneously, so that obtained images can be integrated directly without registering. Therefore, the real-time performance and reliability of the visual sensor are improved.

Description

A kind of infrared vision sensor with visual image fusion and using method thereof
Technical field
A kind of infrared vision sensor with visual image fusion of the present invention and using method thereof, belong to vision sensor field, be specifically related to the technical scheme of a kind of infrared CCD and industrial CCD integration binocular vision sensor.
Background technology
Along with the development of computer vision and transducer, vision sensor is widely used in the fields such as on-line monitoring with untouchable, certainty of measurement high.Not only appearance profile is clear for the target scene image that present machine vision applications requirement vision sensor obtains, and detailed details also will be had to describe.And catch with camera these two requirements that image that non-visible light (lower than 400nm and the part higher than more than 700nm) and visible light signal obtain can meet vision application, therefore people want the problem that solves infrared image and visual image fusion urgently.But the solution of prior art but can only be, use two cameras simultaneously, one for visible light, another is for infrared spectrum, this scheme from the angle of user, on the one hand two cameras not only expensive but also inefficiency, two cameras acquisition images can not strictly be consistent on the other hand, want infrared image and visible images are merged, then must carry out registration before fusion, thus reduce real-time and reliability.
Summary of the invention
The present invention is a kind of to be infraredly with the vision sensor of visual image fusion and the object of using method thereof: in order to overcome prior art above shortcomings, a kind of vision sensor and using method thereof of infrared and visual image fusion are provided, this vision sensor is infrared CCD and industrial CCD integration binocular vision sensor, and 2 CCD have identical sample frequency and focal length.
The vision sensor of a kind of infrared and visual image fusion of the present invention, it is characterized in that a kind of vision sensor of infrared and visual image fusion, this vision sensor is infrared CCD and industrial CCD integration binocular vision sensor, 2 CCD have identical sample frequency and focal length, in Amici prism two prism facets are utilized selectively to reflect certain primary colours light, other light is made to be projected to infrared CCD and industrial CCD respectively from the axis light of same camera lens incidence, infrared CCD and industrial CCD gather infrared image and the visible images of target same point simultaneously, registration is not needed just directly to merge, this vision sensor is primarily of camera lens 1, LED light source 2, image capture module 3, infrared image processing module 4, Visual image processing module 5, image co-registration module 6, communication module 7, power module 8, shell 9, electrical wire interface 10 forms, wherein camera lens 1 and LED light source 2 are positioned at the outside of shell 9, image capture module 3, infrared image processing module 4, Visual image processing module 5, image co-registration module 6, communication module 7, power module 8, electrical wire interface 10 is all positioned at the inside of shell 9, image capture module 3, image co-registration module 6, communication module 7, it is inner that power module 8 is fixed on shell 9 with lower bayonet slot, infrared image processing module 4 and Visual image processing module 5 in the enclosure the same vertical plane in portion are fixed on shell 9 top and bottom with draw-in groove respectively, electrical wire interface 10 is fixed on shell 9 inner back side, for being connected with outer computer, be connected successively by electric wire between its inner each module, described image capture module 3 comprises Amici prism 31, infrared CCD 32 and industrial CCD 33, wherein the output of infrared CCD 32 connects the input of infrared image processing module 4, the output of industrial CCD 33 connects the input of Visual image processing module 5, infrared image processing module 4 and Visual image processing module 5 select DSP module and memory module, memory module comprises SDRAM, be mainly used to the data of the image of storage of collected and the result of image procossing, communication module is RS--485.
Above-mentioned a kind of infrared using method with the vision sensor of visual image fusion, it is characterized in that this vision sensor utilizes this principle of prismatic decomposition, and higher than object more than absolute zero all can irradiating infrared light and visible light source irradiate after object can the feature of reflect visible light, by Amici prism 31, the light that camera lens 1 focuses on is divided into visible ray and infrared light, infrared sensor in infrared CCD 32 in image capture module 3 receives the infrared light that Amici prism separates, be converted to containing target scene signals, ccd image sensor in infrared CCD 32 gathers the infrared image that this signal obtains containing target scene signals, senser in industrial CCD 33 meanwhile in image capture module 3 receives the visible ray that Amici prism separates, be converted to containing target scene signals, ccd image sensor in industrial CCD 33 gathers the visible images that this signal obtains containing target scene signals, first infrared image processing module 4 carries out maximum entropy image segmentation to infrared image, infrared image is divided into target area and background area, again medium filtering denoising is carried out to target area, image enhaucament, Morphological scale-space, Visual image processing module 5 pairs of visible images carry out image enhaucament, to make visible images more clear, target area infrared image after process and visible images employing pixel grey scale are got large method and are merged by image co-registration module 6, by the infrared gray value put at this as fused images with the gray scale maximum of visible images identical point, if infrared image is f (x, y), visible images is h (x, y), image after then merging is g (x, y)=max{f (x, y), h (x, y) }, wherein, (x, y) position of corresponding pixel points in presentation video, f (x, y) corresponding relevant position (x in infrared image is represented, y) gray value on, h (x, y) corresponding relevant position (x in visible images is represented, y) gray value on, g (x, y) corresponding relevant position (x in fused images is represented, y) gray value on, image after image co-registration module 6 finally merges by communication module 7 is transmitted by RS-485 bus, power module 8 pairs of image capture modules 3, infrared image processing module 4, Visual image processing module 5, image co-registration module 6 and communication module 7 are powered, vision sensor technical parameter:
Valid pixel: 1024 (H) × 768 (V)
Adjustable focal length: 8mm-75mm
Pixel dimension: 4.56 × 4.56 μm
Horizontal resolution: 330TVL-480TVL
Infrared survey spectral region: 2.0-2.5 μm/3-5 μm/8-12 μm
Visible ray measure spectrum scope: 400nm-700nm
Working temperature :-20 DEG C-60 DEG C
Picture frame frequency: 30 frames/s
Color of image: black and white/colour
Focusing mode: automatic/hand
Voltage: 6-15V
Power consumption: be less than or equal to 6W
Signal to noise ratio: be greater than 48db
Communication protocol: RS-485
A kind of infrared vision sensor with visual image fusion of the present invention and using method, its advantage is:
1, this transducer take full advantage of all temperature can infrared radiation higher than the object of absolute zero, and utilize LED as the feature of visible light source when illumination condition deficiency, not only can work by whole day 24H, and severe operational environment can be adapted to, greatly improve the reliability of vision sensor.
2, vision sensor of the present invention have cured ripe machine vision algorithm, and user just can obtain the image after infrared image and visual image fusion, for vision-based detection provides real-time without the need to programming.
3, this vision sensor is infrared CCD and industrial CCD integration binocular vision sensor, two particular interface made full use of in Amici prism selectively can reflect certain primary colours light and make other light by this principle, axis light from same camera lens incidence is projected to infrared CCD and industrial CCD respectively, thus make infrared CCD and industrial CCD can gather infrared image and the visible images of target same point simultaneously, make acquisition image not need registration just can directly merge, improve real-time and the reliability of vision sensor.
Accompanying drawing explanation
Fig. 1 is infrared and the structure cutaway view of the vision sensor of visual image fusion
Fig. 2 is infrared CCD and Visible-light CCD optical imaging concept figure
Wherein, 1. camera lens, 2.LED light source, 3. image capture module (31. Amici prisms, 32. infrared CCDs, 33. industrial CCDs), 4. infrared image processing module, 5. Visual image processing module, 6. image co-registration module, 7. communication module, 8. power module, 9. shell, 10. electrical wire interface, 11. prism facets 1,12. prism facets 2,13. prism facets 3
Embodiment
This vision sensor is universal vision sensor, can implement for any target, below in conjunction with embodiment and with reference to accompanying drawing, carries out illustrating in detail, clearly to this vision sensor invention technology.
Execution mode 1
Fig. 1 is the cutaway view of this vision sensor, and this transducer forms primarily of camera lens 1, LED light source 2, image capture module 3, infrared image processing module 4, Visual image processing module 5, image co-registration module 6, communication module 7, power module 8, shell 9, electrical wire interface 10.Wherein camera lens 1 and LED light source 2 are positioned at the outside of shell 9, image capture module 3, infrared image processing module 4, Visual image processing module 5, image co-registration module 6, communication module 7, power module 8, electrical wire interface 10 is all positioned at the inside of shell 9, wherein image capture module 3, image co-registration module 6, communication module 7, it is inner that power module 8 is fixed on shell 9 with lower bayonet slot, infrared image processing module 4 and Visual image processing module 5 in the enclosure the same vertical plane in portion are fixed on shell 9 top and bottom with draw-in groove respectively, electrical wire interface 10 is fixed on shell 9 inner back side, for being connected with outer computer, be connected successively by electric wire between its inner each module, described image capture module 3 comprises Amici prism 31, infrared CCD 32, industrial CCD 33, wherein the output of infrared CCD 32 connects the input of infrared image processing module 4, industrial CCD 33 output connects the input of Visual image processing module 5.Camera lens 1 is positioned at before Amici prism 31 prism facets 1, and the optical axis of camera lens 1 is vertical with Amici prism 31 prism facets 1, and infrared CCD 32 is parallel with Amici prism 31 prism facets 3, and industrial CCD 33 is vertical with the optical axis of camera lens 1; Optical lens is adjustable focus camera lens, can environmentally automatically regulate with target requirement, to reach best imaging effect.Infrared image processing module 4 and Visual image processing module 5 select DSP module and memory module, memory module comprises SDRAM, be mainly used to the data of the image of storage of collected and the result of image procossing, image co-registration module selects dsp chip, and communication module is RS-485.
Fig. 2 is infrared CCD and the industrial CCD optical imaging concept figure of vision sensor of the present invention, camera lens 1 focuses on image capture module 3 by the infrared light of target object radiation with through the visible ray that LED light source 2 irradiates back reflection, Amici prism 31 in image capture module 3 is prism groups of a kind of particular design, two particular interface in prism group can reflect certain primary colours light selectively and other light are passed through, wherein the bottom of the prism facets 1 of Amici prism 31 can make infrared light and visible ray pass through simultaneously, the top of prism facets 1 and prism facets 2 being coated with wavelength spectro-film can reflects infrared light visible ray is passed through, prism facets 3 can make infrared light pass through.The light (comprising visible ray and infrared light) of lens focus is divided into visible ray and infrared light by prismatic decomposition technology by the Amici prism 31 in image capture module 3, infrared sensor in infrared CCD receives infrared light, be converted to containing target scene signals, the ccd image sensor in infrared CCD gathers the infrared image that this signal obtains containing target scene signals; Senser in industrial CCD receives visible ray, is converted to containing target scene signals, and the ccd image sensor in industrial CCD gathers the visible images that this signal obtains containing target scene signals.
The using method of the vision sensor of a kind of infrared and visual image fusion that the present invention proposes, first according to target scene location, vision sensor is installed to relevant position, then the focal length of vision sensor is suitably adjusted, after having focused, by moving in parallel transducer, its parameter being demarcated, determining the parameter of mapping relations between the two dimensional image on three dimensions point and vision sensor imaging plane.The visible ray of the infrared light of object radiation and transmitting after LED light source 2 irradiates is focused on image capture module 3 by camera lens 1, the light that camera lens 1 focuses on is divided into visible ray and infrared light by the Amici prism 31 be fixed in the image capture module 3 of shell 9 inside, infrared sensor in infrared CCD 32 in image capture module 3 receives the infrared light that Amici prism separates, be converted to containing target scene signals, ccd image sensor in infrared CCD 32 gathers the infrared image that this signal obtains containing target scene signals, senser in industrial CCD 33 meanwhile in image capture module 3 receives the visible ray that Amici prism separates, be converted to containing target scene signals, ccd image sensor in industrial CCD 33 gathers the visible images that this signal obtains containing target scene signals, first infrared image processing module 4 carries out maximum entropy image segmentation to infrared image, infrared image is divided into target area and background area, again medium filtering denoising is carried out to target area, image enhaucament and Morphological scale-space, Visual image processing module 5 pairs of visible images carry out image enhaucament, to make visible images more clear, target area infrared image after process and visible images employing pixel grey scale are got large method and are merged by image co-registration module 6, by the infrared gray value put at this as fused images with the gray scale maximum of visible images identical point, if infrared image is f (x, y), visible images is h (x, y), image after then merging is g (x, y)=max{f (x, y), h (x, y) }, wherein, (x, y) position of corresponding pixel points in presentation video, f (x, y) corresponding relevant position (x in infrared image is represented, y) gray value on, h (x, y) corresponding relevant position (x in visible images is represented, y) gray value on, g (x, y) corresponding relevant position (x in fused images is represented, y) gray value on, image after image co-registration module 6 finally merges by communication module 7 is transmitted by RS-485 bus, and power module 8 pairs of image capture modules 3, infrared image processing module 4, Visual image processing module 5, image co-registration module 6 and communication module 7 are powered.The running parameter of this transducer is:
Valid pixel: 1024 (H) × 768 (V)
Adjustable focal length: 8mm-75mm
Pixel dimension: 4.56 × 4.56 μm
Horizontal resolution: 400TVL
Infrared survey spectral region: 8-12 μm
Visible ray measure spectrum scope: 400-700nm
Working temperature: 20 DEG C
Picture frame frequency: 30 frames/s
Color of image: black and white/colour
Focusing mode: automatic/hand
Voltage: 6-15V
Power consumption: be less than or equal to 6W
Signal to noise ratio: be greater than 48db
Communication protocol: RS-485
Execution mode 2
Valid pixel: 1024 (H) × 768 (V)
Adjustable focal length: 8mm-75mm
Pixel dimension: 4.56 × 4.56 μm
Horizontal resolution: 330TVL
Infrared survey spectral region: 3-5 μm
Visible ray measure spectrum scope: 400-700nm
Working temperature: 0 DEG C
Picture frame frequency: 30 frames/s
Color of image: black and white/colour
Focusing mode: automatic/hand
Voltage: 6-15V
Power consumption: be less than or equal to 6W
Signal to noise ratio: be greater than 48db
Communication protocol: RS-485
Other is with execution mode 1.
Execution mode 3
Valid pixel: 1024 (H) × 768 (V)
Adjustable focal length: 8mm-75mm
Pixel dimension: 4.56 × 4.56 μm
Horizontal resolution: 480TVL
Infrared survey spectral region: 2.0-2.5 μm
Visible ray measure spectrum scope: 400-700nm
Working temperature: 40 DEG C
Picture frame frequency: 30 frames/s
Color of image: black and white/colour
Focusing mode: automatic/hand
Voltage: 6-15V
Power consumption: be less than or equal to 6W
Signal to noise ratio: be greater than 48db
Communication protocol: RS-485
Other is with execution mode 1.

Claims (2)

1. the vision sensor of a kind infrared and visual image fusion, it is characterized in that a kind of vision sensor of infrared and visual image fusion, this vision sensor is infrared CCD and industrial CCD integration binocular vision sensor, 2 CCD have identical sample frequency and focal length, in Amici prism two prism facets are utilized selectively to reflect certain primary colours light, other light is made to be projected to infrared CCD and industrial CCD respectively from the axis light of same camera lens incidence, infrared CCD and industrial CCD gather infrared image and the visible images of target same point simultaneously, registration is not needed just directly to merge, this vision sensor is primarily of camera lens (1), LED light source (2), image capture module (3), infrared image processing module (4), Visual image processing module (5), image co-registration module (6), communication module (7), power module (8), shell (9), electrical wire interface (10) forms, wherein camera lens (1) and LED light source (2) are positioned at the outside of shell (9), image capture module (3), infrared image processing module (4), Visual image processing module (5), image co-registration module (6), communication module (7), power module (8), electrical wire interface (10) is all positioned at the inside of shell (9), image capture module (3), image co-registration module (6), communication module (7), it is inner that power module (8) is fixed on shell (9) with lower bayonet slot, infrared image processing module (4) and Visual image processing module (5) in the enclosure the same vertical plane in portion are fixed on shell (9) top and bottom with draw-in groove respectively, electrical wire interface (10) is fixed on shell (9) inner back side, for being connected with outer computer, be connected successively by electric wire between its inner each module, described image capture module (3) comprises Amici prism (31), infrared CCD (32) and industrial CCD (33), wherein the output of infrared CCD (32) connects the input of infrared image processing module (4), the output of industrial CCD (33) connects the input of Visual image processing module (5), infrared image processing module (4) and Visual image processing module (5) select DSP module and memory module, memory module comprises SDRAM, be mainly used to the data of the image of storage of collected and the result of image procossing, communication module is RS--485.
2. a kind of infrared using method with the vision sensor of visual image fusion described in claim 1, it is characterized in that this vision sensor utilizes this principle of prismatic decomposition, and higher than object more than absolute zero all can irradiating infrared light and visible light source irradiate after object can the feature of reflect visible light, by Amici prism (31), the light that camera lens (1) focuses on is divided into visible ray and infrared light, infrared sensor in infrared CCD (32) in image capture module (3) receives the infrared light that Amici prism separates, be converted to containing target scene signals, ccd image sensor in infrared CCD (32) gathers the infrared image that this signal obtains containing target scene signals, senser in industrial CCD (33) meanwhile in image capture module (3) receives the visible ray that Amici prism separates, be converted to containing target scene signals, ccd image sensor in industrial CCD (33) gathers the visible images that this signal obtains containing target scene signals, infrared image processing module (4) first carries out maximum entropy image segmentation to infrared image, infrared image is divided into target area and background area, again medium filtering denoising is carried out to target area, image enhaucament, Morphological scale-space, Visual image processing module (5) carries out image enhaucament to visible images, to make visible images more clear, target area infrared image after process and visible images employing pixel grey scale are got large method and are merged by image co-registration module (6), by the infrared gray value put at this as fused images with the gray scale maximum of visible images identical point, if infrared image is f (x, y), visible images is h (x, y), image after then merging is g (x, y)=max{f (x, y), h (x, y) }, wherein, (x, y) position of corresponding pixel points in presentation video, f (x, y) corresponding relevant position (x in infrared image is represented, y) gray value on, h (x, y) corresponding relevant position (x in visible images is represented, y) gray value on, g (x, y) corresponding relevant position (x in fused images is represented, y) gray value on, image after image co-registration module (6) finally merges by communication module (7) is transmitted by RS-485 bus, power module (8) is powered to image capture module (3), infrared image processing module (4), Visual image processing module (5), image co-registration module (6) and communication module (7), vision sensor technical parameter:
Valid pixel: 1024 (H) × 768 (V)
Adjustable focal length: 8mm-75mm
Pixel dimension: 4.56 × 4.56 μm
Horizontal resolution: 330TVL-480TVL
Infrared survey spectral region: 2.0-2.5 μm/3-5 μm/8-12 μm
Visible ray measure spectrum scope: 400nm-700nm
Working temperature :-20 DEG C-60 DEG C
Picture frame frequency: 30 frames/s
Color of image: black and white/colour
Focusing mode: automatic/hand
Voltage: 6-15V
Power consumption: be less than or equal to 6W
Signal to noise ratio: be greater than 48db
Communication protocol: RS-485.
CN201510223733.6A 2015-05-05 2015-05-05 A kind of infrared vision sensor and its application method with visual image fusion Active CN104822033B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510223733.6A CN104822033B (en) 2015-05-05 2015-05-05 A kind of infrared vision sensor and its application method with visual image fusion

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510223733.6A CN104822033B (en) 2015-05-05 2015-05-05 A kind of infrared vision sensor and its application method with visual image fusion

Publications (2)

Publication Number Publication Date
CN104822033A true CN104822033A (en) 2015-08-05
CN104822033B CN104822033B (en) 2017-09-01

Family

ID=53732187

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510223733.6A Active CN104822033B (en) 2015-05-05 2015-05-05 A kind of infrared vision sensor and its application method with visual image fusion

Country Status (1)

Country Link
CN (1) CN104822033B (en)

Cited By (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106060364A (en) * 2016-07-28 2016-10-26 浙江宇视科技有限公司 Optical fog-penetrating color image acquisition method and camera
WO2017036270A1 (en) * 2015-08-28 2017-03-09 杭州海康威视数字技术股份有限公司 Image signal processing method and system
CN106796720A (en) * 2016-04-12 2017-05-31 深圳华盛昌机械实业有限公司 Image interfusion method, device and infrared thermal imagery equipment
CN106803940A (en) * 2017-03-06 2017-06-06 广州英卓电子科技有限公司 A kind of far infrared intelligent monitoring system
CN106840034A (en) * 2015-12-04 2017-06-13 宁波舜宇光电信息有限公司 3 D scanning system and its application with the speckle projector
CN107911592A (en) * 2017-12-14 2018-04-13 合肥金星机电科技发展有限公司 Kiln flame temperature monitors camera
CN107990986A (en) * 2017-12-14 2018-05-04 合肥金星机电科技发展有限公司 Ethane cracking furnace temperature field on-line detecting system
CN108814635A (en) * 2018-04-19 2018-11-16 云南电网有限责任公司电力科学研究院 A kind of X-ray digital imaging method
CN108924388A (en) * 2018-06-21 2018-11-30 殷创科技(上海)有限公司 Sense fusing device and the camera including sensing fusing device
CN109348116A (en) * 2018-11-28 2019-02-15 国网电力科学研究院武汉南瑞有限责任公司 Single channel visible light merges monitoring system with infrared image acquisition
CN109936690A (en) * 2017-12-15 2019-06-25 百度(美国)有限责任公司 System and method for capturing two or more groups light image simultaneously
CN109936685A (en) * 2017-12-18 2019-06-25 格科微电子(上海)有限公司 Method based on pre- focusing optimization camera module assembly
WO2019153787A1 (en) * 2018-02-11 2019-08-15 浙江宇视科技有限公司 Single sensor-based dual-spectral camera system and image processing method
CN110239914A (en) * 2019-06-19 2019-09-17 太原理工大学 Infrared audiovisual frequency spectrum fusion conveyer belt longitudinal tear detection prior-warning device and method
CN110796598A (en) * 2019-10-12 2020-02-14 劢微机器人科技(深圳)有限公司 Autonomous mobile robot, map splicing method and device thereof, and readable storage medium
CN111402134A (en) * 2020-03-15 2020-07-10 国科天成(北京)科技有限公司 Visible/infrared double-light fusion system
CN113225485A (en) * 2021-03-19 2021-08-06 浙江大华技术股份有限公司 Image acquisition assembly, fusion method, electronic device and storage medium
CN113284127A (en) * 2021-06-11 2021-08-20 中国南方电网有限责任公司超高压输电公司天生桥局 Image fusion display method and device, computer equipment and storage medium
WO2022068106A1 (en) * 2020-09-29 2022-04-07 诚瑞光学(深圳)有限公司 Camera and imaging assembly thereof
WO2022068598A1 (en) * 2020-09-29 2022-04-07 华为技术有限公司 Imaging method and apparatus
CN114755877A (en) * 2019-11-26 2022-07-15 深圳市大疆创新科技有限公司 Vehicle vision system and vehicle
CN116761050A (en) * 2023-08-14 2023-09-15 合肥航谱时代科技有限公司 Image acquisition system based on visible light and infrared fusion
CN117800039A (en) * 2024-02-23 2024-04-02 太原理工大学 Belt deviation detecting system of belt conveyor

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006238093A (en) * 2005-02-25 2006-09-07 Sony Corp Imaging device
JP2008079172A (en) * 2006-09-25 2008-04-03 Mitsubishi Electric Corp Two-wavelength image sensor and imaging method using dual-wavelength image sensor
US20090059046A1 (en) * 2006-02-13 2009-03-05 Jai Corporation Field Sequential Color Camera System
CN201804195U (en) * 2010-09-21 2011-04-20 程抒一 Rear protection display system capable of generating touch screen on projection screen
CN102721469A (en) * 2012-06-14 2012-10-10 中国科学院自动化研究所 Multispectral imaging system and method based on two cameras

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006238093A (en) * 2005-02-25 2006-09-07 Sony Corp Imaging device
US20090059046A1 (en) * 2006-02-13 2009-03-05 Jai Corporation Field Sequential Color Camera System
JP2008079172A (en) * 2006-09-25 2008-04-03 Mitsubishi Electric Corp Two-wavelength image sensor and imaging method using dual-wavelength image sensor
CN201804195U (en) * 2010-09-21 2011-04-20 程抒一 Rear protection display system capable of generating touch screen on projection screen
CN102721469A (en) * 2012-06-14 2012-10-10 中国科学院自动化研究所 Multispectral imaging system and method based on two cameras

Cited By (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10979654B2 (en) 2015-08-28 2021-04-13 Hangzhou Hikvision Digital Technology Co., Ltd. Image signal processing method and system
WO2017036270A1 (en) * 2015-08-28 2017-03-09 杭州海康威视数字技术股份有限公司 Image signal processing method and system
CN106840034A (en) * 2015-12-04 2017-06-13 宁波舜宇光电信息有限公司 3 D scanning system and its application with the speckle projector
CN106796720A (en) * 2016-04-12 2017-05-31 深圳华盛昌机械实业有限公司 Image interfusion method, device and infrared thermal imagery equipment
US10586314B2 (en) 2016-04-12 2020-03-10 Shenzhen Everbest Machinery Industry Co., Ltd Image fusion method, apparatus, and infrared thermal imaging device
WO2017177370A1 (en) * 2016-04-12 2017-10-19 深圳华盛昌机械实业有限公司 Image fusion method and apparatus, and infrared thermography device
CN106796720B (en) * 2016-04-12 2020-11-13 深圳市华盛昌科技实业股份有限公司 Image fusion method and device and infrared thermal image equipment
CN106060364A (en) * 2016-07-28 2016-10-26 浙江宇视科技有限公司 Optical fog-penetrating color image acquisition method and camera
CN106803940A (en) * 2017-03-06 2017-06-06 广州英卓电子科技有限公司 A kind of far infrared intelligent monitoring system
CN107990986A (en) * 2017-12-14 2018-05-04 合肥金星机电科技发展有限公司 Ethane cracking furnace temperature field on-line detecting system
CN107911592A (en) * 2017-12-14 2018-04-13 合肥金星机电科技发展有限公司 Kiln flame temperature monitors camera
US10834341B2 (en) 2017-12-15 2020-11-10 Baidu Usa Llc Systems and methods for simultaneous capture of two or more sets of light images
CN109936690A (en) * 2017-12-15 2019-06-25 百度(美国)有限责任公司 System and method for capturing two or more groups light image simultaneously
CN109936685A (en) * 2017-12-18 2019-06-25 格科微电子(上海)有限公司 Method based on pre- focusing optimization camera module assembly
CN109936685B (en) * 2017-12-18 2021-02-26 格科微电子(上海)有限公司 Camera module assembly optimizing method based on pre-focusing
US11252345B2 (en) 2018-02-11 2022-02-15 Zhejiang Uniview Technologies Co., Ltd Dual-spectrum camera system based on a single sensor and image processing method
WO2019153787A1 (en) * 2018-02-11 2019-08-15 浙江宇视科技有限公司 Single sensor-based dual-spectral camera system and image processing method
CN108814635A (en) * 2018-04-19 2018-11-16 云南电网有限责任公司电力科学研究院 A kind of X-ray digital imaging method
CN108924388A (en) * 2018-06-21 2018-11-30 殷创科技(上海)有限公司 Sense fusing device and the camera including sensing fusing device
CN109348116A (en) * 2018-11-28 2019-02-15 国网电力科学研究院武汉南瑞有限责任公司 Single channel visible light merges monitoring system with infrared image acquisition
CN110239914A (en) * 2019-06-19 2019-09-17 太原理工大学 Infrared audiovisual frequency spectrum fusion conveyer belt longitudinal tear detection prior-warning device and method
CN110239914B (en) * 2019-06-19 2020-12-22 太原理工大学 Longitudinal tearing detection early warning device and method for infrared audio-visual frequency spectrum fusion conveying belt
CN110796598A (en) * 2019-10-12 2020-02-14 劢微机器人科技(深圳)有限公司 Autonomous mobile robot, map splicing method and device thereof, and readable storage medium
CN114755877A (en) * 2019-11-26 2022-07-15 深圳市大疆创新科技有限公司 Vehicle vision system and vehicle
CN111402134A (en) * 2020-03-15 2020-07-10 国科天成(北京)科技有限公司 Visible/infrared double-light fusion system
CN111402134B (en) * 2020-03-15 2020-12-22 国科天成(北京)科技有限公司 Visible/infrared double-light fusion system
WO2022068598A1 (en) * 2020-09-29 2022-04-07 华为技术有限公司 Imaging method and apparatus
WO2022068106A1 (en) * 2020-09-29 2022-04-07 诚瑞光学(深圳)有限公司 Camera and imaging assembly thereof
CN113225485A (en) * 2021-03-19 2021-08-06 浙江大华技术股份有限公司 Image acquisition assembly, fusion method, electronic device and storage medium
CN113284127A (en) * 2021-06-11 2021-08-20 中国南方电网有限责任公司超高压输电公司天生桥局 Image fusion display method and device, computer equipment and storage medium
CN113284127B (en) * 2021-06-11 2023-04-07 中国南方电网有限责任公司超高压输电公司天生桥局 Image fusion display method and device, computer equipment and storage medium
CN116761050A (en) * 2023-08-14 2023-09-15 合肥航谱时代科技有限公司 Image acquisition system based on visible light and infrared fusion
CN116761050B (en) * 2023-08-14 2023-11-03 合肥航谱时代科技有限公司 Image acquisition system based on visible light and infrared fusion
CN117800039A (en) * 2024-02-23 2024-04-02 太原理工大学 Belt deviation detecting system of belt conveyor
CN117800039B (en) * 2024-02-23 2024-05-14 太原理工大学 Belt deviation detecting system of belt conveyor

Also Published As

Publication number Publication date
CN104822033B (en) 2017-09-01

Similar Documents

Publication Publication Date Title
CN104822033A (en) Visual sensor based on infrared and visible light image fusion and using method thereof
CN106385530B (en) Double-spectrum camera
KR101824290B1 (en) High resolution multispectral image capture
US8427632B1 (en) Image sensor with laser for range measurements
CN106060364A (en) Optical fog-penetrating color image acquisition method and camera
WO2021073140A1 (en) Monocular camera, and image processing system and image processing method
CN104270570A (en) Binocular video camera and image processing method thereof
CN107820066A (en) A kind of low-luminance color video camera
CN111141997A (en) Inspection robot based on ultraviolet and visible light image fusion and detection method
WO2014011182A1 (en) Convergence/divergence based depth determination techniques and uses with defocusing imaging
WO2021022696A1 (en) Image acquisition apparatus and method, electronic device and computer-readable storage medium
CN107518879A (en) A kind of fluoroscopic imaging device and method
CN110017897A (en) A kind of compact monocular multichannel combined multi-optical spectrum imaging system
CN109348116A (en) Single channel visible light merges monitoring system with infrared image acquisition
US20190058837A1 (en) System for capturing scene and nir relighting effects in movie postproduction transmission
CN106254796A (en) A kind of iraser laser spot detection imaging device based on iconoscope and method
CN106934349B (en) Dual-camera imaging and iris acquisition and recognition integrated equipment
CN209805953U (en) Double-spectrum temperature measurement camera
CN111811431A (en) Three-dimensional scanner, three-dimensional scanning system and method
CN102982324A (en) Multispectral sensor for fingerprint identification
CN109848413A (en) Increasing material manufacturing process monitoring system based on multisensor coupling
CN209624768U (en) Active laser detection apparatus
CN103632135A (en) Iris image capture device based on double image sensors
CN103591892B (en) A kind of Portable multi-waveband light source three-dimensional reconnaissance at criminal scene forensics instrument and evidence collecting method
CN111272101A (en) Four-dimensional hyperspectral depth imaging system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
EXSB Decision made by sipo to initiate substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant