CN216210267U - Image fusion device based on spectroscope - Google Patents
Image fusion device based on spectroscope Download PDFInfo
- Publication number
- CN216210267U CN216210267U CN202122709265.7U CN202122709265U CN216210267U CN 216210267 U CN216210267 U CN 216210267U CN 202122709265 U CN202122709265 U CN 202122709265U CN 216210267 U CN216210267 U CN 216210267U
- Authority
- CN
- China
- Prior art keywords
- image
- light beam
- image sensor
- lens
- receiving
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Spectrometry And Color Measurement (AREA)
Abstract
The utility model relates to an image fusion device based on a spectroscope, which comprises an optical component, the spectroscope, a first image sensor, a reflective mirror, a second image sensor and a processor, wherein the optical component is arranged on the spectroscope; the optical assembly is used for receiving an incident beam reflected by an object; the spectroscope is used for receiving the light beam processed by the optical component and dividing the incident light beam into a first light beam and a second light beam; the first image sensor is used for receiving the first light beam to form a first image; the reflector is used for receiving the second light beam and reflecting the second light beam to form a third light beam; the second image sensor is used for receiving the third light beam to form a second image; the processor is respectively connected with the first image sensor and the second image sensor and used for receiving the first image and the second image and fusing the first image and the second image into a third image. The spectroscope is used for enabling the optical path of the imaging of the first image sensor and the imaging of the second image sensor to be the same, and convenience is brought to a fusion algorithm of a subsequent first image and a subsequent second image.
Description
Technical Field
The utility model belongs to the technical field of image fusion, and particularly relates to an image fusion device based on a spectroscope.
Background
In the application of the binocular camera, the binocular image matching is very difficult due to the parallax between the two cameras. Cis (contact Image sensor) is a conventional Image sensor, and the Image sensor has low imaging quality and large data volume. DVS (dynamic Vision sensor) is a new type of image sensor, unlike conventional image sensors, DVS is an event-based image sensor; when the change of the illumination intensity exceeds a certain threshold value, an event of becoming stronger or weaker is generated; the DVS image sensor has the advantages of high resolution of a single pixel, low power consumption, fast response, and the like.
However, since the DVS image sensor generates sparse event data, it is more difficult to fuse images of the CIS image sensor and the DVS image sensor.
SUMMERY OF THE UTILITY MODEL
The utility model aims to solve the defects in the prior art at least to a certain extent and provides an image fusion device based on a spectroscope.
To achieve the above object, the present invention provides a spectroscope-based image fusion apparatus, including:
an optical assembly for receiving an incident beam reflected by an object;
the beam splitter is used for receiving the light beam processed by the optical assembly and splitting the incident light beam into a first light beam and a second light beam;
a first image sensor for receiving the first light beam to form a first image;
a reflector for receiving the second light beam and reflecting the second light beam to form a third light beam;
a second image sensor for receiving the third light beam to form a second image;
and the processor is respectively connected with the first image sensor and the second image sensor, and is used for receiving the first image and the second image and fusing the first image and the second image into a third image.
Optionally, the optical assembly is configured to optically process the incident light beam to increase the light condensation of the incident light beam and increase the field angle.
Optionally, the optical assembly includes a first lens and a second lens arranged at an interval, and the first lens is configured to receive the incident light beam and converge the incident light beam to a focal point of the first lens; the second lens is used for changing the light beam focused by the first lens into a parallel light beam and transmitting the parallel light beam to the spectroscope.
Optionally, a distance between the first lens and the second lens is equal to a sum of a focal length of the first lens and a focal length of the second lens.
Optionally, a focal length of the first lens is equal to a focal length of the second lens.
Optionally, the beam splitter is a half-mirror, and is configured to half-transmit the light beam processed by the optical component into a first light beam in a parallel direction and half-reflect the light beam into a second light beam in a perpendicular direction.
Optionally, the reflector is disposed at an angle of 45 degrees and is configured to reflect the second light beam into a third light beam parallel to the first light beam.
Optionally, the first image sensor is a CIS image sensor, and the second image sensor is a DVS image sensor.
According to the image fusion device based on the spectroscope, the spectroscope is used for enabling the optical paths of the images of the first image sensor and the second image sensor to be the same, and theoretically, no parallax exists between the first image sensor and the second image sensor, so that convenience is brought to a fusion algorithm of a subsequent first image and a subsequent second image.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a schematic structural diagram of an embodiment of a spectroscopic-based image fusion apparatus according to the present invention;
description of the main elements:
11. an optical component; 111. a first lens; 112. a second lens; f. a focal point; 12. a beam splitter; 13. a reflective mirror; 14. a first image sensor; 15. a second image sensor; s1, a first light beam; s2, a second light beam; s3, third light beam.
Detailed Description
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary and intended to be illustrative of the present invention and should not be construed as limiting the present invention, and all other embodiments that can be obtained by one skilled in the art based on the embodiments of the present invention without inventive efforts shall fall within the scope of protection of the present invention.
In the description of the present invention, it is to be understood that the terms "central," "longitudinal," "lateral," "length," "width," "thickness," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," "clockwise," "counterclockwise," "axial," "circumferential," "radial," and the like are used in the orientations and positional relationships indicated in the drawings for convenience in describing the present invention and to simplify the description, and are not intended to indicate or imply that the referenced device or element must have a particular orientation, be constructed and operated in a particular orientation, and are not to be construed as limiting the present invention.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the present invention, "a plurality" means two or more unless specifically defined otherwise.
Referring to fig. 1, an embodiment of the utility model provides a spectroscope-based image fusion apparatus, which includes an optical assembly 11, a spectroscope 12, a reflective mirror 13, a first image sensor 14, a second image sensor 15, and a processor (not shown). In the present embodiment, the first image sensor 14 is a CIS image sensor, and the second image sensor 15 is a DVS image sensor.
The optical assembly 11 is used for receiving an incident light beam reflected by an object; the beam splitter 12 is used for receiving the light beam processed by the optical assembly 11 and splitting the incident light beam into a first light beam S1 and a second light beam S2; the first image sensor 14 is used for receiving the first light beam S1 to form a first image; the reflector 13 is used for receiving the second light beam S2 and reflecting the second light beam S2 to form a third light beam S3; the second image sensor 15 is used for receiving the third light beam S3 to form a second image; the processor is connected to the first image sensor 14 and the second image sensor 15, respectively, and is configured to receive the first image and the second image, and fuse the first image and the second image into a third image.
According to the image fusion device based on the spectroscope in the embodiment, the incident light beam reflected by the object is subjected to light splitting by the spectroscope 12, so that the imaging light paths of the CIS image sensor and the DVS image sensor are the same, and theoretically, no parallax exists between the CIS image sensor and the DVS image sensor, thereby providing convenience for the subsequent fusion algorithm of the CIS image sensor and the DVS image sensor.
In one embodiment, the optical assembly 11 includes a first lens 111 and a second lens 112 arranged at intervals, the first lens 111 is used for receiving an incident light beam and converging the incident light beam to a focal point f of the first lens 111; the second lens 112 is used for changing the light beam focused by the first lens 111 into a parallel light beam and transmitting the parallel light beam to the beam splitter 12.
The first lens 111 and the second lens 112 are both double-convex lenses, and the distance between the first lens 111 and the second lens 112 is equal to the sum of the focal length of the first lens 111 and the focal length of the second lens 112, preferably, the focal length of the first lens 111 is equal to the focal length of the second lens 112; in this way, the first lens 111 and the second lens 112 can increase the light gathering and the field angle of the incident light beam reflected by the object, which is beneficial for the subsequent sensor to acquire more light signals, thereby improving the imaging quality of the image, i.e. improving the resolution of the generated first image and the second image.
It will be appreciated that the optical component 11 may be an optical device with a corresponding converging function according to actual needs, for example, a plano-convex lens may also be used.
In one embodiment, the beam splitter 12 is a half mirror, and is used for half-transmitting the light beam processed by the optical assembly 11 into a first light beam S1 in a parallel direction and half-reflecting the light beam into a second light beam S2 in a perpendicular direction; the first light beam S1 enters the first image sensor 14, and the second light beam S2 is reflected by the reflective mirror 13 to the second image sensor 15, so that there is no parallax between the first image sensor 14 and the second image sensor 15, which is beneficial to facilitate the subsequent fusion algorithm.
In one embodiment, the reflective mirror 13 is disposed at an angle of 45 degrees and is located right below the beam splitter 12 for reflecting the second light beam S2 into a third light beam S3 parallel to the first light beam S1, i.e., the first image sensor 14 and the second image sensor 15 can realize real-time registration; in this way, by overlapping the detection field of view of the first image sensor 14 and the detection field of view of the second image sensor 15, it is possible to reduce the parallax between the CIS image sensor and the DVS image sensor, thereby reducing the complexity in the subsequent image fusion calculation. Because the DVS camera has high response speed, low power consumption, small data volume and high single-pixel resolution, and the CIS camera has large data volume and low single-pixel resolution, the first image generated by the DVS image sensor and the second image generated by the CIS image sensor are fused, and an image with higher resolution, namely the third image in the scheme of the utility model, can be obtained.
In this embodiment, the processor may obtain the normalization factor based on information corresponding to each pixel in the first image and the second image, and fuse the first image and the second image based on the normalization factor to obtain the third image. The image fusion is to synthesize two or more images into a new image by using a specific algorithm, so that the fused image contains more information. Image fusion algorithms that are currently frequently used include: the mathematical morphology method, the HIS transform, the laplacian pyramid fusion, the wavelet transform, and the like are not limited to the fusion method.
It should be noted that in other embodiments, the actual fusion process may also be placed in other devices, that is, the image fusion apparatus based on the spectroscope in this embodiment is used to generate the first image and the second image, the processor sends the generated first image and the second image to the other devices, and the other devices perform image fusion to generate the third image with higher resolution.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In view of the above description of the technical solutions provided by the present invention, those skilled in the art will recognize that there may be variations in the technical solutions and the application ranges according to the concepts of the embodiments of the present invention, and in summary, the content of the present specification should not be construed as limiting the present invention.
Claims (8)
1. A spectroscopic-based image fusion apparatus, comprising:
an optical assembly for receiving an incident beam reflected by an object;
the beam splitter is used for receiving the light beam processed by the optical assembly and splitting the incident light beam into a first light beam and a second light beam;
a first image sensor for receiving the first light beam to form a first image;
a reflector for receiving the second light beam and reflecting the second light beam to form a third light beam;
a second image sensor for receiving the third light beam to form a second image;
and the processor is respectively connected with the first image sensor and the second image sensor, and is used for receiving the first image and the second image and fusing the first image and the second image into a third image.
2. A spectroscopic-based image fusion device as set forth in claim 1 in which the optical assembly is adapted to optically process the incident beam of light to increase the concentration of the incident beam of light and increase the field of view.
3. The spectroscopic-based image fusion device of claim 2 wherein said optical assembly includes first and second spaced apart lenses, said first lens being adapted to receive said incident beam and to focus said incident beam at a focal point of said first lens; the second lens is used for changing the light beam focused by the first lens into a parallel light beam and transmitting the parallel light beam to the spectroscope.
4. A spectroscopic-based image fusion device as set forth in claim 3 wherein the separation distance between the first lens and the second lens is equal to the sum of the focal length of the first lens and the focal length of the second lens.
5. A spectroscopic-based image fusion device as set forth in claim 4 wherein the focal length of the first lens is equal to the focal length of the second lens.
6. The beam splitter-based image fusion apparatus of claim 1, wherein the beam splitter is a half mirror for half-transmitting the light beam processed by the optical element into a first light beam in a parallel direction and half-reflecting the light beam into a second light beam in a perpendicular direction.
7. A beam splitter-based image fusion apparatus according to claim 6 and wherein said mirror is disposed at a 45 degree angle for reflecting said second beam of light into a third beam of light parallel to said first beam of light.
8. A spectroscopic-based image fusion device as set forth in claim 1 wherein the first image sensor is a CIS image sensor and the second image sensor is a DVS image sensor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202122709265.7U CN216210267U (en) | 2021-11-05 | 2021-11-05 | Image fusion device based on spectroscope |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202122709265.7U CN216210267U (en) | 2021-11-05 | 2021-11-05 | Image fusion device based on spectroscope |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN216210267U true CN216210267U (en) | 2022-04-05 |
Family
ID=80904509
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202122709265.7U Active CN216210267U (en) | 2021-11-05 | 2021-11-05 | Image fusion device based on spectroscope |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN216210267U (en) |
-
2021
- 2021-11-05 CN CN202122709265.7U patent/CN216210267U/en active Active
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105578019B (en) | Image extraction system capable of obtaining depth information and focusing method | |
| US8149327B2 (en) | Camera module with dual lens modules and image sensors | |
| JPH11331654A (en) | Omnidirectional viewing angle sensor | |
| JP2008294819A (en) | Image pick-up device | |
| JP2000515704A (en) | Wide angle image forming system and method | |
| WO2012117617A1 (en) | 3d imaging device | |
| KR20130037883A (en) | Aspheric lens | |
| CN108181782A (en) | Zigzag type panorama imager without blind spot | |
| CN209765040U (en) | Laser radar receiving system based on deformable objective lens | |
| CN210834102U (en) | Virtual image detection optical system | |
| CN110376725B (en) | Fisheye lens system | |
| CN216210267U (en) | Image fusion device based on spectroscope | |
| CN105979128A (en) | Image acquisition device and panoramic camera | |
| CN211880472U (en) | Image acquisition device and camera | |
| WO2023090191A1 (en) | Imaging device | |
| JP2012242488A (en) | Imaging device, stereoscopic imaging optical system and program | |
| CN215344717U (en) | Image acquisition device and imaging device | |
| CN111413786B (en) | Short wave infrared/visible light double-light imaging lens | |
| CN105573007A (en) | Liquid crystal lens imaging device and liquid crystal lens imaging method | |
| US4623932A (en) | Video camera having an automatic focusing system | |
| WO2020244273A1 (en) | Dual camera three-dimensional stereoscopic imaging system and processing method | |
| CN103412461A (en) | Three-dimensional imaging system based on beam splitter plate | |
| CN109698897B (en) | All-in-one optical system of dynamic zoom lens | |
| CN207833091U (en) | Double mirror and thermal infrared imager | |
| CN111766699A (en) | Imaging device and method, and endoscope system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| GR01 | Patent grant | ||
| GR01 | Patent grant |