CN114189614B - Multi-image-distance super-field-depth imaging system of adjustable-focus multi-image sensor - Google Patents

Multi-image-distance super-field-depth imaging system of adjustable-focus multi-image sensor Download PDF

Info

Publication number
CN114189614B
CN114189614B CN202111483673.3A CN202111483673A CN114189614B CN 114189614 B CN114189614 B CN 114189614B CN 202111483673 A CN202111483673 A CN 202111483673A CN 114189614 B CN114189614 B CN 114189614B
Authority
CN
China
Prior art keywords
image
image sensor
module
spectroscope
light
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202111483673.3A
Other languages
Chinese (zh)
Other versions
CN114189614A (en
Inventor
王宣银
汤继祥
周欢
裴育斌
叶子健
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang University ZJU
Original Assignee
Zhejiang University ZJU
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang University ZJU filed Critical Zhejiang University ZJU
Priority to CN202111483673.3A priority Critical patent/CN114189614B/en
Publication of CN114189614A publication Critical patent/CN114189614A/en
Application granted granted Critical
Publication of CN114189614B publication Critical patent/CN114189614B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/45Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B37/00Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B37/00Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe
    • G03B37/04Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe with cameras or projectors providing touching or overlapping fields of view
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • H04N23/51Housings
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • H04N23/54Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • H04N23/55Optical parts specially adapted for electronic image sensors; Mounting thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/67Focus control based on electronic image sensor signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95Computational photography systems, e.g. light-field imaging systems
    • H04N23/958Computational photography systems, e.g. light-field imaging systems for extended depth of field imaging
    • H04N23/959Computational photography systems, e.g. light-field imaging systems for extended depth of field imaging by adjusting depth of field during image capture, e.g. maximising or setting range based on scene characteristics
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02ATECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
    • Y02A90/00Technologies having an indirect contribution to adaptation to climate change
    • Y02A90/30Assessment of water resources

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computing Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Automatic Focus Adjustment (AREA)

Abstract

The invention discloses a multi-image-distance super-depth-of-field imaging system of a multi-image-sensor capable of focusing. Comprises an optical unit, an imaging and electromechanical control unit and a system shell; the optical unit adopts a single lens to match with a multipath spectroscope, and light rays entering from the lens are equally divided into multiple paths to respectively irradiate on the multiple image sensors. The imaging and electromechanical control unit comprises an image sensor module and an embedded vision controller. The automatic image distance adjusting focusing module can control the image sensor module to move back and forth, and the effect of changing the focusing position of the image is achieved by changing the image distance. The multi-image-distance image fusion module can fuse a plurality of images with different image distances to form a super-depth image. The combination of the units finally achieves the purposes of exposing a plurality of image distances at one time and simultaneously imaging, and obtaining the super-depth-of-field image through image fusion. The method has the advantages of quick imaging, high precision, wide field of view, large imaging depth of field and the like, and is suitable for being applied to imaging and detecting scenes with super depth of field requirements.

Description

Multi-image-distance super-field-depth imaging system of adjustable-focus multi-image sensor
Technical Field
The invention relates to an imaging system in the field of opto-electromechanical imaging, in particular to a multi-image-distance super-depth-of-field imaging system of a multi-image-sensor with adjustable focus.
Background
Existing imaging systems, such as digital cameras, industrial cameras, etc., are limited by the optical structure of the lens and the imaging principles, and the depth of field of the captured photographs is limited. By depth of field is meant that when the imaging system is focused on a plane at a distance, only objects within a certain depth in front of and behind the plane can be imaged sharp, and the remaining objects closer or farther are blurred. The imaging depth of field of an imaging system is increased in the daily photography field or the machine vision application field.
Existing methods of extending depth of field include the use of double telecentric lenses, wavefront coding techniques, coded aperture techniques, and multi-focus image fusion techniques. The double telecentric lens has a small field of view range and a fixed focusing distance, and has certain application in small-range machine vision detection. The wavefront coding technology and the coding aperture technology directly modulate light rays in a lens, and then the light rays are recovered through an algorithm so as to extend the depth of field, the method inevitably causes information loss in the modulation process, the imaging quality is poor, and the practical effect is difficult to achieve.
The multi-focus image fusion technology uses a plurality of different focus images to fuse into a super-depth image, and requires that different focus parameters are continuously adjusted at the same position to perform multiple exposure on a shot object. Therefore, the characteristic that clear positions in different images are inconsistent can be utilized to fuse all the clear positions together to form a new super-depth image. However, the existing imaging system needs multiple focusing and multiple exposure, the use of the imaging system is still limited, and the imaging speed still cannot meet the requirement especially in machine vision detection scenes requiring real-time detection.
Disclosure of Invention
In order to solve the problems in the background technology, the invention provides a multi-image-distance super-depth-of-field imaging system of a focusing multi-image sensor, which can directly output super-depth-of-field images through one exposure and can be directly used for an application scene requiring real-time acquisition of large-field super-depth-of-field images.
The technical scheme adopted by the invention is as follows:
the invention comprises an imaging system shell, an optical unit and an imaging and electromechanical control unit, wherein the optical unit is arranged on the imaging system shell;
the optical unit comprises a lens, a support column, a spectroscope support and a spectroscope module; the imaging system shell is provided with a through hole, the lens is arranged at the through hole on the outer side of the imaging system shell, the spectroscope support is arranged at the through hole on the inner side of the imaging system shell through the support column, and the spectroscope module is fixedly arranged on the spectroscope support; the center of the through hole and the optical axis of the lens are overlapped with the optical axis of the spectroscope module;
the beam splitter module is provided with three emergent ray ports, and light rays entering the beam splitter module are reflected by refraction and reflection inside the beam splitter module and then are emitted from the three emergent ray ports, and each emergent ray port is provided with an imaging and electromechanical control unit;
the imaging and electromechanical control unit comprises an automatic image distance adjusting image sensor module and an embedded vision controller; the three automatic image distance adjusting image sensor modules are respectively arranged at three emergent ray ports of the spectroscope module and are connected with the embedded vision controller through respective data cables; the imaging system shell is provided with a data interface, the signal output end of the embedded visual controller is connected with one end of the data interface, and the other end of the data interface is connected with external equipment.
The lens passes through a universal lens mount orPerson(s)The threaded port is mounted in a through hole of the imaging system housing.
The automatic image distance adjusting image sensor module comprises an image sensor bracket, an image sensor module, a motor bracket and a linear displacement driving mechanism; one end of the image sensor support is connected to the end face of the spectroscope module, the other end of the image sensor support is fixedly connected with one end of the motor support through a plurality of parallel guide rods, the image sensor module is arranged between the image sensor support and the motor support, the guide rods movably penetrate through holes formed in the image sensor module, a linear displacement driving mechanism is mounted at the other end of the motor support and connected with the image sensor module, and the image sensor module is driven to move along the guide rods.
The linear displacement driving mechanism comprises a screw bracket, a nut, a large gear, a small gear, a bearing, a motor and a motor bracket; the motor is arranged on the outer side surface of the motor support, the motor output shaft is coaxially connected with a pinion, the pinion is meshed with a large gear, the pinion is hinged to the outer side surface of the motor support, the left end of the large gear is fixed on a bearing, the bearing is embedded in the motor support, the large gear is provided with a central through hole, and a nut is coaxially and fixedly sleeved in the central through hole of the large gear; one end of the screw rod movably penetrates through the motor support and then is connected with the nut through a threaded sleeve, the other end of the screw rod is fixed on the screw rod support, and the screw rod support is fixed on the image sensor module.
The three automatic image distance adjusting image sensor modules are respectively an image sensor I, an image sensor II and an image sensor III.
The spectroscope module comprises a multipath spectroscope, the multipath spectroscope is mainly formed by sequentially and closely attaching three prisms, and the attaching surfaces between the prisms are plated with a spectroscope film for carrying out partial reflection.
In the multipath spectroscope, light enters from a first prism and enters a first light splitting surface between the first prism and a second prism, part of the light is reflected by the first light splitting surface and then exits through total reflection on the inner surface of the first prism to form third light L3, then enters an image sensor III, the rest of the light enters a second light splitting surface between the second prism and the third prism after being transmitted by the first light splitting surface, part of the light exits from the second prism to form second light L2 after being reflected by the second light splitting surface, then enters an image sensor II, and the rest of the light exits from the third prism to form first light L1 after being transmitted by the second light splitting surface, and then enters the image sensor I.
The first light splitting surface has a light splitting ratio of 2:1, and the second light splitting surface has a light splitting ratio of 1:1.
The embedded vision controller comprises an image distance automatic adjustment focusing module and a multi-image distance image fusion module; the image distance automatic adjustment focusing module is respectively and electrically connected with motors in the three automatic image distance adjustment image sensor modules, and the multi-image distance image fusion module is respectively and electrically connected with the image sensor modules in the three automatic image distance adjustment image sensor modules.
The image distance automatic adjustment focusing module is used for controlling the motor in each automatic image distance adjustment image sensor module to work so as to drive the image sensor module to axially move along the optical axis, and the image focusing position is changed by adjusting the image distance, so that the optical path from the image sensor module in each automatic image distance adjustment image sensor module to the lens is different; the multi-image-distance image fusion module is used for receiving images with different image distances collected by the image sensor module of each automatic image-distance adjustment image sensor module, and fusing a plurality of images with different image distances to generate a super-depth image.
The invention has the beneficial effects that:
1) The invention adopts a multi-path spectroscope to simultaneously image in combination with a plurality of image sensors, provides an automatic focusing structure of a multi-image-distance image, and achieves the aim of adjusting the image distance by controlling the distance between the image sensor and the spectroscope through a motor, thereby realizing the simultaneous imaging of a plurality of image distances through one-time exposure, and finally obtaining the super-depth-of-field image in real time by using a multi-focusing image fusion algorithm.
2) The invention provides a focusing real-time large-field super-depth imaging system. Compared with the existing large-depth-of-field imaging scheme, the system has the advantages of being quick in imaging, high in precision, large in visual field range and the like, and is suitable for being applied to large-size object super-depth-of-field visual detection scenes.
Drawings
FIG. 1 is a schematic diagram of a multi-image-distance super depth of field imaging system of an adjustable-focus multi-image sensor of the present invention;
FIG. 2 is a schematic diagram of an optical unit of the adjustable-focus multi-image sensor multi-image-distance super-depth-of-field imaging system of the present invention;
fig. 3 and 4 are schematic structural views of an automatic image distance adjusting image sensor module according to the present invention.
The imaging system comprises a 1-imaging system shell, a 2-lens, a 3-support column, a 4-spectroscope support, a 5-spectroscope module, a 6-automatic image distance adjustment image sensor module, a 7-embedded visual controller, an 8-data interface, a 60-image sensor module, a 61-image sensor fixing support, a 62-screw support, a 63-motor support, a 64-motor pinion, a 65-motor, a 66-nut, a 67-nut large gear, a 68-bearing, a 501-multipath spectroscope, a 601-image sensor I, a 602-image sensor II and a 603-image sensor III.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples.
As shown in fig. 1, the imaging system comprises an imaging system housing 1, an optical unit and an imaging and electromechanical control unit, wherein the optical unit is arranged on the imaging system housing 1, and the imaging and electromechanical control unit is arranged on the optical unit;
the optical unit comprises a lens 2, a support column 3, a spectroscope support 4 and a spectroscope module 5; the imaging system housing 1 is provided with a through hole, the lens 2 is arranged at the through hole outside the imaging system housing 1, and the lens 2 is arranged in the through hole of the imaging system housing 1 in a connection mode of a universal lens mount or a threaded port.
The spectroscope support 4 is arranged at a through hole on the inner side of the imaging system shell 1 through the support column 3, the support column 3 plays a role in fixing, and meanwhile, the space between the lens 2 and the spectroscope module 5 is ensured to be sufficient; the spectroscope module 5 is fixedly arranged on the spectroscope bracket 4; the center of the through hole and the optical axis of the lens 2 are coincident with the optical axis of the spectroscope module 5, so that external light enters the through hole from the lens 2 and then enters the spectroscope module 5;
the spectroscope module 5 is provided with three emergent ray ports, and the rays entering the spectroscope module 5 are reflected by refraction and reflection in the spectroscope module 5 and then are emitted from the three emergent ray ports, and each emergent ray port is provided with an imaging and electromechanical control unit; therefore, during implementation, external light enters through the lens 2, and the light is split into multiple paths in the beam splitter module 5, and finally exits from different end faces of the beam splitter module 5.
As shown in fig. 1, the imaging and electromechanical control unit includes an automatic image distance adjustment image sensor module 6 and an embedded vision controller 7. The three automatic image distance adjusting image sensor modules 6 are respectively arranged at the three emergent ray ports of the spectroscope module 5, and the three automatic image distance adjusting image sensor modules 6 are connected with the embedded vision controller 7 through respective data cables; the imaging system shell 1 is provided with a data interface 8, the signal output end of the embedded vision controller 7 is connected with one end of the data interface 8, and the other end of the data interface 8 is connected with external equipment. In specific implementation, the embedded vision controller 7 can acquire the image acquired by the image sensor in the image sensor module 6 through the data cable, and can control the image sensor in the image sensor module 6 to move back and forth through the data cable, so as to adjust the image distance; the embedded vision controller 7 can fuse the images of the plurality of automatic image distance adjustment image sensor modules 6 to obtain a super-depth image, and transmit the super-depth image to external equipment through the data interface 8.
As shown in fig. 3, the automatic image distance adjustment image sensor module 6 includes an image sensor bracket 61, an image sensor module 60, a motor bracket 63, and a linear displacement driving mechanism; one end of the image sensor support 61 is connected to the end face of the spectroscope module 5, the other end of the image sensor support 61 is fixedly connected with one end of the motor support 63 through a plurality of parallel guide rods, the guide rods are distributed at the peripheral edge positions, the image sensor module 60 is arranged between the image sensor support 61 and the motor support 63, the guide rods movably penetrate through holes formed in the image sensor module 60, a linear displacement driving mechanism is mounted at the other end of the motor support 63 and connected with the image sensor module 60, and the image sensor module 60 is driven to move along the guide rods.
Specifically, the linear displacement driving mechanism includes a screw bracket 62, a nut 66, a large gear 67, a small gear 64, a bearing 68, a motor 65, and a motor bracket 63; the lateral surface of motor support 63 is provided with motor 65, motor 65 output shaft coaxial coupling has pinion 64, pinion 64 and gear wheel 67 intermeshing, pinion 64 articulated mounting is on the lateral surface of motor support 63, gear wheel 67 left end is fixed on bearing 68, bearing 68 embeds in motor support 63, the central through-hole has been seted up to gear wheel 67, the coaxial fixed cover is equipped with nut 66 in the central through-hole of gear wheel 67, the one end activity of screw rod passes behind the motor support 63 and is connected through the screw thread suit with nut 66, the other end of screw rod is fixed on screw rod support 62, screw rod support 62 is fixed on image sensor module 60. Therefore, the pinion gear 64 and the large gear 67 can freely rotate against the outer surface of the motor bracket 63, so that the pinion gear 64 can drive the large gear 67 to rotate, and then the large gear 67 drives the nut 66 to rotate. The left end of the motor bracket 63 is fixed to 3 parallel guide rails of the image sensor bracket 61, thereby ensuring that the linear drive is parallel to the guide rails. In this embodiment, the linear displacement driving mechanism adopts a screw transmission mode. In the linear displacement driving process, the motor 65 is controlled to rotate, after the speed reduction is realized through the pinion 64 and the large gear 67, the nut 66 rotates to drive the screw bracket 62 and the image sensor module 60 connected with the screw bracket to move forwards and backwards, and finally, the purpose of automatically adjusting the image distance is achieved.
As shown in fig. 2, the three automatic image distance adjustment image sensor modules 6 are 601-image sensor I, 602-image sensor II, 603-image sensor III, respectively; the beam splitter module 5 comprises a multi-path beam splitter 501; specifically, the multipath spectroscope 501 is mainly formed by sequentially and closely attaching three prisms, and the attaching surfaces between the prisms are all plated with a spectroscope for carrying out partial reflection; the light-splitting film can divide visible light of all colors into one part for transmission and the other part for reflection according to the light-splitting ratio; the ratio of the light splitting can be arbitrarily selected.
In the implementation, in the multipath spectroscope 501, light enters from the first prism and enters the first light splitting surface between the first prism and the second prism, and a part of light is reflected on the first light splitting surface and then exits after total reflection on the inner surface of the first prism to form a third light L3, and then enters the image sensor III603; the rest part of light rays are transmitted on the first light splitting surface and then are incident on a second light splitting surface between the second prism and the third prism, and part of light rays are reflected on the second light splitting surface and then are emitted from the second prism to form second light rays L2 and then are incident on the image sensor II602; the other part of the light rays are transmitted through the second light splitting surface and then are emitted out of the third prism to form first light rays L1, and then the first light rays L1 are incident to the image sensor I601;
the first light splitting surface has a light splitting ratio of 2:1, and the second light splitting surface has a light splitting ratio of 1:1. The light intensities of the three light rays are equal, and the passing optical paths in the multipath spectroscope 501 are also equal, that is, the paths along which the light rays travel are equal.
As shown in fig. 2, the embedded vision controller 7 includes an image distance automatic adjustment focusing module and a multi-image distance image fusion module; the image distance automatic adjustment focusing module is respectively and electrically connected with motors 65 in the three automatic image distance adjustment image sensor modules 6, and the multi-image distance image fusion module is respectively and electrically connected with image sensor modules 60 in the three automatic image distance adjustment image sensor modules 6; the image distance automatic adjustment focusing module of the embedded vision controller 7 can obtain a plurality of images with inconsistent focusing distances at the same time when the image distances of the image sensors are adjusted to be different from each other, and then the images are fused by utilizing a multi-focusing image fusion algorithm to obtain the super-depth image. The super-depth-of-field image is synthesized by the clear areas of a plurality of common images with different focusing distances, and the depth of field of the super-depth-of-field image is several times of that of the common images. When the image distance automatic adjustment focusing module of the embedded vision controller 7 synchronously increases or decreases the image distances of all the image sensors, the focusing position of the super-depth image can be adjusted, and automatic focusing is realized.
In this embodiment, as shown in fig. 2, light is incident from the left side of the figure, and sequentially passes through a lens 2 and a multi-path beam splitter 501, wherein in the multi-path beam splitter 501, A1 surface and A2 surface adjacent to a prism are plated with beam splitting films; the beam splitting film can transmit one part of light rays and reflect the other part of light rays, so that the 1-path light rays are divided into 2-path light rays. In the multipath spectroscope 501, when light enters from the left end face and passes through the A1 face, a large part of light is transmitted and advances along the original direction, the rest small part of light is reflected to form L3, and when the transmitted light passes through the A2 face, half of light is reflected to form L2, and the other half of light is continuously transmitted to form L1; light L1 and light L2 are directly emitted from the end face of the multipath spectroscope 501 to reach the image sensor I601 and the image sensor II602, respectively; the light L3 reaches the left end face of the beam splitter 501 after being reflected, where the light L3 is totally reflected, and then exits from the lower end face to the image sensor III603.
The light-splitting films plated on the A1 surface and the A2 surface of the spectroscope 501 can split visible light of all colors; the light splitting ratio of the light splitting film on the A1 surface is 2:1, and the light splitting ratio of the light splitting film on the A2 surface is 1:1; therefore, the light intensities of the light rays L1, L2 and L3 are 1/3 of the light intensity entering the lens. In this embodiment, the paths of the light rays L1, L2, L3 in the beam splitter 501 are equal, so that the image distance is automatically adjusted more intuitively and conveniently.
The image sensor I601 and the image sensor II602, the image sensor III603 can move back and forth relative to the spectroscope end face, and the distances between the image sensor I601, the image sensor II602 and the image sensor III relative to the spectroscope end face are x1, x2 and x3 respectively; all image sensors are connected to the embedded vision controller 7 by means of data cables.
The image distance automatic adjustment focusing module of the embedded vision controller 7 can obtain a plurality of images with different image distances at the same time when the x1, the x2 and the x3 are adjusted to be different from each other; focusing distances of a plurality of images with different image distances are inconsistent, namely clear parts in the images are inconsistent; and then the multi-image-distance image fusion module extracts the sharpest part in a plurality of images with different image distances to reserve, the unclear part is replaced by the clear part in other images, and finally the clear part of the images is expanded after fusion, namely the imaging depth of field is improved.
The image distance automatic adjustment focusing module of the embedded vision controller 7 can synchronously increase or decrease x1, x2 and x3 while keeping the distance difference of x1, x2 and x3, so that the focusing position of the super-depth image can be adjusted, and the automatic focusing of the super-depth image can be realized.

Claims (4)

1. A multi-image-distance super-field-depth imaging system of a focusing multi-image sensor is characterized in that:
the imaging system comprises an imaging system shell (1), an optical unit and an imaging and electromechanical control unit, wherein the optical unit is arranged on the imaging system shell (1), and the imaging and electromechanical control unit is arranged on the optical unit;
the optical unit comprises a lens (2), a support column (3), a spectroscope bracket (4) and a spectroscope module (5); the imaging system comprises an imaging system shell (1), a lens (2), a spectroscope support (4), a spectroscope module (5) and a lens module, wherein the imaging system shell (1) is provided with a through hole, the lens (2) is arranged at the through hole at the outer side of the imaging system shell (1), the spectroscope support (4) is arranged at the through hole at the inner side of the imaging system shell (1) through a support column (3), and the spectroscope module (5) is fixedly arranged on the spectroscope support (4); the center of the through hole and the optical axis of the lens (2) are overlapped with the optical axis of the spectroscope module (5);
the beam splitter module (5) is provided with three emergent ray ports, and the rays entering the beam splitter module (5) are reflected by refraction and reflection in the beam splitter module (5) and then are emitted from the three emergent ray ports, and each emergent ray port is provided with an imaging and electromechanical control unit;
the imaging and electromechanical control unit comprises an automatic image distance adjusting image sensor module (6) and an embedded vision controller (7); the three automatic image distance adjusting image sensor modules (6) are respectively arranged at three emergent ray ports of the spectroscope module (5), and the three automatic image distance adjusting image sensor modules (6) are connected with the embedded vision controller (7) through respective data cables; a data interface (8) is arranged on the imaging system shell (1), a signal output end of the embedded vision controller (7) is connected with one end of the data interface (8), and the other end of the data interface (8) is connected with external equipment;
the three automatic image distance adjusting image sensor modules (6) are respectively an image sensor I (601), an image sensor II (602) and an image sensor III (603);
the spectroscope module (5) comprises a multipath spectroscope (501), wherein the multipath spectroscope (501) is mainly formed by sequentially and tightly attaching three prisms, and the attaching surfaces between the prisms are plated with a spectroscope film for carrying out partial reflection;
in the multipath spectroscope (501), light enters from a first prism and enters a first light splitting surface between the first prism and a second prism, one part of light is reflected by the first light splitting surface and then exits through total reflection of the inner surface of the first prism to form a third light L3, and then enters an image sensor III (603), the other part of light enters a second light splitting surface between the second prism and the third prism after being transmitted by the first light splitting surface, one part of light exits from the second prism to form a second light L2 after being reflected by the second light splitting surface, and then enters an image sensor II (602), and the other part of light exits from the third prism to form a first light L1 after being transmitted by the second light splitting surface and then enters an image sensor I (601);
the light splitting film of the multipath spectroscope (501) splits visible light of all colors into a part for transmission and another part for reflection according to the splitting ratio;
the light splitting ratio of the first light splitting surface is 2:1, and the light splitting ratio of the second light splitting surface is 1:1;
the light intensities of the first light ray L1, the second light ray L2 and the third light ray L3 are equal, and the passing light paths in the multipath spectroscope (501) are equal;
the embedded vision controller (7) comprises an image distance automatic adjustment focusing module and a multi-image distance image fusion module; the image distance automatic adjustment focusing module is respectively and electrically connected with motors (65) in the three automatic image distance adjustment image sensor modules (6), and the multi-image distance image fusion module is respectively and electrically connected with image sensor modules (60) in the three automatic image distance adjustment image sensor modules (6);
the image distance automatic adjustment focusing module is used for controlling a motor (65) in each automatic image distance adjustment image sensor module (6) to work so as to drive the image sensor module (60) to axially move along the optical axis, and the image focusing position is changed by adjusting the image distance, so that the optical paths from the image sensor module (60) in each automatic image distance adjustment image sensor module (6) to the lens (2) are different; the multi-image-distance image fusion module is used for receiving images with different image distances acquired by the image sensor module (60) of each automatic image-distance adjustment image sensor module (6), and fusing a plurality of images with different image distances to generate a super-depth image.
2. The adjustable-focus multi-image sensor multi-image-distance super depth-of-field imaging system of claim 1, wherein: the lens (2) is arranged on the lens holder or the lens holderPerson(s)The connection mode of the threaded port is arranged in a through hole of the imaging system shell (1).
3. The adjustable-focus multi-image sensor multi-image-distance super depth-of-field imaging system of claim 1, wherein: the automatic image distance adjusting image sensor module (6) comprises an image sensor bracket (61), an image sensor module (60), a motor bracket (63) and a linear displacement driving mechanism; one end of the image sensor support (61) is connected to the end face of the spectroscope module (5), the other end of the image sensor support (61) is fixedly connected with one end of the motor support (63) through a plurality of parallel guide rods, the image sensor module (60) is arranged between the image sensor support (61) and the motor support (63), the guide rods movably penetrate through holes formed in the image sensor module (60), a linear displacement driving mechanism is mounted at the other end of the motor support (63), the linear displacement driving mechanism is connected with the image sensor module (60), and the image sensor module (60) is driven to move along the guide rods.
4. A multi-image-distance super depth-of-field imaging system of an adjustable-focus multi-image sensor as claimed in claim 3, wherein: the linear displacement driving mechanism comprises a screw bracket (62), a nut (66), a large gear (67), a small gear (64), a bearing (68), a motor (65) and a motor bracket (63); the motor is characterized in that a motor (65) is arranged on the outer side surface of the motor support (63), a pinion (64) is coaxially connected with an output shaft of the motor (65), the pinion (64) is meshed with a large gear (67), the pinion (64) is hinged to the outer side surface of the motor support (63), the left end of the large gear (67) is fixed on a bearing (68), the bearing (68) is embedded in the motor support (63), a central through hole is formed in the large gear (67), and a nut (66) is coaxially and fixedly sleeved in the central through hole of the large gear (67); one end of the screw rod movably penetrates through the motor support (63) and then is connected with the nut (66) through a threaded sleeve, the other end of the screw rod is fixed on the screw rod support (62), and the screw rod support (62) is fixed on the image sensor module (60).
CN202111483673.3A 2021-12-07 2021-12-07 Multi-image-distance super-field-depth imaging system of adjustable-focus multi-image sensor Active CN114189614B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111483673.3A CN114189614B (en) 2021-12-07 2021-12-07 Multi-image-distance super-field-depth imaging system of adjustable-focus multi-image sensor

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111483673.3A CN114189614B (en) 2021-12-07 2021-12-07 Multi-image-distance super-field-depth imaging system of adjustable-focus multi-image sensor

Publications (2)

Publication Number Publication Date
CN114189614A CN114189614A (en) 2022-03-15
CN114189614B true CN114189614B (en) 2023-04-28

Family

ID=80603598

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111483673.3A Active CN114189614B (en) 2021-12-07 2021-12-07 Multi-image-distance super-field-depth imaging system of adjustable-focus multi-image sensor

Country Status (1)

Country Link
CN (1) CN114189614B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115061264A (en) * 2022-06-29 2022-09-16 维沃移动通信有限公司 Camera module and electronic equipment
CN115314624A (en) * 2022-08-19 2022-11-08 维沃移动通信有限公司 Camera module and electronic equipment

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4890398B2 (en) * 2007-09-19 2012-03-07 パナソニック株式会社 Imaging device
CN103747186A (en) * 2013-12-30 2014-04-23 华中科技大学 Time-division three-path image acquisition device and calibration method for same
JP6025130B2 (en) * 2015-03-23 2016-11-16 パナソニックIpマネジメント株式会社 Endoscope and endoscope system
CN107357116B (en) * 2016-05-09 2019-09-06 杭州海康威视数字技术股份有限公司 Burnt regulating mechanism and the video camera with it afterwards
CN107861242B (en) * 2017-12-20 2019-07-05 嘉兴中润光学科技有限公司 Imaging system with multisensor
CN109491176A (en) * 2019-01-09 2019-03-19 凌云光技术集团有限责任公司 Big depth field imaging system and method based on prismatic decomposition
CN210300952U (en) * 2019-05-17 2020-04-14 上海新眼光医疗器械股份有限公司 Portable auto-focusing fundus imaging system

Also Published As

Publication number Publication date
CN114189614A (en) 2022-03-15

Similar Documents

Publication Publication Date Title
CN114189614B (en) Multi-image-distance super-field-depth imaging system of adjustable-focus multi-image sensor
US6546208B1 (en) Stereoscopic telescope with camera
US5635947A (en) Eye movement tracking display
EP3480648A1 (en) Adaptive three-dimensional imaging system
US5502480A (en) Three-dimensional vision camera
US6160607A (en) Camera focus indicator
EP0795142A1 (en) Improvements in microscope illumination and stereo viewing
CN211457203U (en) Binocular camera
EP0500910B1 (en) Device and method for stereoscopic viewing of slides and prints
CN107797263B (en) 3D operation microscope optics main mirror
GB2052781A (en) Inoculars including an eye span adjustment mechanism
WO2005040891A2 (en) Viewing device with orientating imaging device
CN111761203B (en) High-magnification online real-time imaging device for laser processing
US3622242A (en) Stereoscopic rangefinder with movable reticles
GB2104679A (en) Electronic cinema camera with beam switching system
EP1403677B1 (en) Observation system with binoculars with image sensor for an image recording functionality
CN113566734B (en) High-precision three-dimensional imaging device based on coaxial translation speckle projector
CN215300796U (en) Binocular stereo vision processing device and system
GB2073904A (en) Automatically focussing binoculars
JP2002010293A (en) Stereoscopic image display device
US20040169922A1 (en) Stereo microscopy
JP2002090921A (en) Stereoscopic photographic optical unit and stereoscopic photographic optical system
CN219496783U (en) Miniaturized automatic focusing device
CN112099179B (en) Dual CMOS continuous zooming television system based on prism beam splitting
CN211028543U (en) Focusing device of high-power optical fiber laser cutting machine

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant