CN113132582A - Imaging method, imaging device and electronic equipment - Google Patents
Imaging method, imaging device and electronic equipment Download PDFInfo
- Publication number
- CN113132582A CN113132582A CN201911424996.8A CN201911424996A CN113132582A CN 113132582 A CN113132582 A CN 113132582A CN 201911424996 A CN201911424996 A CN 201911424996A CN 113132582 A CN113132582 A CN 113132582A
- Authority
- CN
- China
- Prior art keywords
- detection module
- target scene
- module
- light intensity
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 82
- 238000001514 detection method Methods 0.000 claims abstract description 187
- 230000003287 optical effect Effects 0.000 claims description 18
- 238000000034 method Methods 0.000 claims description 17
- 230000001960 triggered effect Effects 0.000 claims description 12
- 230000008859 change Effects 0.000 claims description 6
- 238000010586 diagram Methods 0.000 description 5
- 230000004075 alteration Effects 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 239000006185 dispersion Substances 0.000 description 2
- 230000010354 integration Effects 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 229920006395 saturated elastomer Polymers 0.000 description 2
- 206010010071 Coma Diseases 0.000 description 1
- 201000009310 astigmatism Diseases 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/54—Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/56—Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
Abstract
The invention relates to an imaging method, an imaging device and electronic equipment, wherein the imaging device comprises a lighting module, a detection module and a control module, wherein the lighting module is provided with at least one through hole; the detection module is used for receiving light rays which are emitted from the target scene and pass through the through hole of the lighting module; the detection module is also used for recording the light intensity of the target scene; the control module is electrically connected with the detection module and used for constructing an image of a target scene according to the light intensity recorded by the detection module. The imaging device can reconstruct the image of the target scene, and has simple data processing and clear imaging.
Description
Technical Field
The present invention relates to the field of imaging technologies, and in particular, to an imaging method, an imaging apparatus, and an electronic device.
Background
The pinhole imaging is the most original and concise imaging mode, and compared with the common lens imaging, the pinhole imaging has the advantages of no chromatic dispersion, no aberration, infinite depth of field, clear images at different distances, simple zooming by adjusting the distance between the pinhole and the sensor, simple structure, simple data processing, low cost and the like.
Pinhole imaging, however, has not been widely adopted because of a significant drawback. In order to obtain a clear image, the hole in the pinhole imaging is required to be small enough, the light quantity entering the hole is extremely small due to the small diameter of the hole, and the common image sensor has weak response or no response, which is smaller than the noise of the sensor and a circuit, so that the clear imaging cannot be realized. If the light input quantity is increased, only the integration time can be increased or the diameter of the hole can be increased, however, the frame rate of the camera is reduced by increasing the integration time, and the light spot from the point source is increased by increasing the aperture, so that imaging blurring is caused.
Disclosure of Invention
Based on this, it is necessary to provide an imaging method, an imaging apparatus, and an electronic device to acquire image information with a clear scene.
An imaging method, comprising:
step S1, the detection module receives the light which is emitted from the target scene and passes through the through hole of the lighting module, wherein the lighting module is provided with at least one through hole;
step S2, the detection module records the light intensity of the target scene;
and step S3, constructing a two-dimensional image of the target scene according to the light intensity recorded by the detection module.
The imaging method comprises the following steps that a detection module receives light rays which are emitted from a target scene and pass through a through hole of a lighting module, wherein the lighting module is provided with at least one through hole; the detection module records the light intensity of a target scene; and a two-dimensional image of the target scene is constructed according to the light intensity recorded by the detection module, so that the image of the target scene can be reconstructed, the data processing is simple, and the imaging is clear.
In one embodiment, the method further comprises the following steps: changing the relative position of the lighting module and the detection module in the first direction and/or the second direction;
the step S3 further includes: and constructing a two-dimensional image of the target scene according to the light intensity recorded by the detection module at each relative position so as to improve the resolution of the two-dimensional image.
In one embodiment, before the step S1, the method further includes:
step S11, the light source emits photons to the target scene;
step S12, the detection module records the time of the light source emitting photons;
the step S2 further includes:
the detection module records the time of receiving the corresponding photon;
before the step S3, the method further includes:
step S31, calculating the distance between the detection module and the target scene according to the time when the light source emits the photons and the time when the detection module receives the corresponding photons;
the step S3 further includes:
and constructing a three-dimensional image of the target scene according to the distance between the detection module and the target scene and the light intensity recorded by the detection module.
In one embodiment, the relative position of the lighting module and the detection module in the first direction and/or the second direction is changed;
the step S3 further includes: and constructing a three-dimensional image of the target scene according to the distance between the detection module and the target scene and the light intensity recorded by the detection module at each relative position so as to improve the resolution of the three-dimensional image.
In one embodiment, the method further comprises the following steps:
and changing the relative positions of the lighting module and the detection module in a third direction, wherein the third direction is respectively vertical to the first direction and the second direction.
In one embodiment, the method further comprises the following steps:
increasing the brightness of the target scene.
In one embodiment, the method further comprises the following steps:
and detecting the ambient light intensity of the environment where the target scene is located.
In one embodiment, the step of detecting the ambient light intensity of the environment in which the target scene is located specifically includes:
the detection unit receives light rays which are emitted from the environment where the target scene is located and pass through the through hole of the lighting module;
the detection unit records the ambient light intensity of the environment where the target scene is located.
In one embodiment, the detection module comprises a single photon avalanche diode.
In one embodiment, the detection module detects the light intensity by recording the number of times the light is triggered within a preset time.
In one embodiment, the detection unit comprises a photodiode or an ambient light sensor or a single photon avalanche diode.
An image forming apparatus comprising:
the lighting module is provided with at least one through hole;
the detection module is used for receiving the light rays which are emitted from the target scene and pass through the through hole of the lighting module;
the detection module is also used for recording the light intensity of the target scene;
and the control module is electrically connected with the detection module and used for constructing a two-dimensional image of the target scene according to the light intensity recorded by the detection module.
In one embodiment, the method further comprises the following steps:
the driving device is electrically connected with the lighting module and the detection module respectively and used for changing the relative positions of the lighting module and the detection module in the first direction and/or the second direction;
the control module is also electrically connected with the driving device and is also used for constructing a two-dimensional image of the target scene according to the light intensity recorded by the detection module at each relative position so as to improve the resolution of the two-dimensional image.
In one embodiment, the method further comprises the following steps:
a light source for emitting photons to the target scene;
the detection module is also electrically connected with the light source and is also used for recording the time when the light source emits the photons and the time when the corresponding photons are received;
the control module is also used for calculating the distance between the detection module and the target scene according to the time when the light source emits the photons and the time when the detection module receives the corresponding photons;
the control module also constructs a three-dimensional image of the target scene according to the distance between the detection module and the target scene and the light intensity recorded by the detection module.
In one embodiment, the method further comprises the following steps:
the driving device is electrically connected with the lighting module and the detection module respectively and used for changing the relative positions of the lighting module and the detection module in the first direction and/or the second direction;
the control module is also electrically connected with the driving device and is further used for constructing a three-dimensional image of the target scene according to the distance between the detection module and the target scene and the light intensity recorded by the detection module at each relative position so as to improve the resolution of the three-dimensional image.
In one embodiment, the method further comprises the following steps:
the driving device is further used for changing the relative positions of the lighting module and the detection module in a third direction, wherein the third direction is perpendicular to the first direction and the second direction respectively.
In one embodiment, the light source is further configured to increase the brightness of the target scene.
In one embodiment, the detection module comprises a single photon avalanche diode.
In one embodiment, the detection module detects the light intensity by recording the number of times the light is triggered within a preset time.
In one embodiment, the lighting module further comprises a detection unit, wherein the detection unit is used for receiving light rays emitted from the environment where the target scene is located and passing through the through hole of the lighting module, and is also used for recording the ambient light intensity of the environment where the target scene is located.
In one embodiment, the detection unit comprises a photodiode or an ambient light sensor or a single photon avalanche diode.
In one embodiment, the method further comprises the following steps:
the optical filters correspond to the through holes one by one, and each optical filter is arranged on one corresponding through hole.
In one embodiment, the method further comprises the following steps:
a plurality of optical filters;
the detection module comprises a plurality of pixel units;
the plurality of optical filters correspond to the plurality of pixel units one by one, and each optical filter is arranged on one corresponding pixel unit.
In one embodiment, the drive device comprises a micro-electromechanical system.
In one embodiment, the light source is a pulsed laser light source.
An electronic device comprises the imaging device.
In one embodiment, the electronic device is an endoscope.
The through hole is formed in the lighting module, the detection module receives light rays which are emitted by the target scene and pass through the through hole of the lighting module, the detection module records light intensity of the target scene, the control module constructs a two-dimensional image of the target scene according to the light intensity recorded by the detection module, and the imaging device and the electronic equipment are simple in structure, simple in data processing and clear in imaging.
Drawings
FIG. 1 is a flow diagram of an imaging method in one embodiment;
FIG. 2 is a flow chart of an imaging method in another embodiment;
FIG. 3 is a sub-flow diagram of an imaging method in one embodiment;
FIG. 4 is a schematic view of an imaging device in one embodiment;
FIG. 5 is a diagram illustrating a variation of an imaging view angle of a through hole of a lighting module according to an embodiment;
FIG. 6 is a top view of a detection module in one embodiment;
FIG. 7 is a schematic diagram of a pixel cell in an embodiment;
FIG. 8 is a diagram illustrating a change in the viewing angle of the detection module caused by a change in the position of the lighting module in an embodiment.
Detailed Description
To facilitate an understanding of the present application, the present application will now be described more fully with reference to the accompanying drawings. Preferred embodiments of the present application are given in the accompanying drawings. This application may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein in the description of the present application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application.
Referring to fig. 1, an imaging method according to an embodiment of the present application includes the following steps.
Step S1, the detecting module receives the light emitted from the target scene and passing through the through hole of the lighting module, wherein the lighting module is provided with at least one through hole.
In step S2, the detection module records the light intensity of the target scene.
And step S3, constructing an image of the target scene according to the light intensity recorded by the detection module.
The image obtained through the above steps is a two-dimensional image.
In one embodiment, the above imaging method further comprises: and changing the relative positions of the lighting module and the detection module in the first direction and/or the second direction. Step S3 further includes: and constructing an image of the target scene according to the light intensity recorded by the detection module at each relative position so as to improve the resolution of the image. This embodiment improves the resolution of the two-dimensional image.
Referring to fig. 2, in an embodiment, before step S1, the method further includes:
step S11, the light source emits photons toward the target scene.
In step S12, the detection module records the time when the light source emits photons.
Step S2 further includes:
the detection module records the time at which the corresponding photon was received.
Before step S3, the method further includes:
step S31, calculating the distance between the detection module and the target scene according to the time when the light source emits the photons and the time when the detection module receives the corresponding photons.
Step S3 further includes:
and constructing an image of the target scene according to the distance between the detection module and the target scene and the light intensity recorded by the detection module.
In this embodiment, a three-dimensional image of the target scene may be constructed according to the distance between the detection module and the target scene and the light intensity recorded by the detection module.
In an embodiment, the imaging method further includes: and changing the relative positions of the lighting module and the detection module in the first direction and/or the second direction. Step S3 further includes: and constructing an image of the target scene according to the distance between the detection module and the target scene and the light intensity recorded by the detection module at each relative position so as to improve the resolution of the image. This embodiment improves the resolution of the three-dimensional image.
In an embodiment, the imaging method further includes: and changing the relative positions of the lighting module and the detection module in a third direction, wherein the third direction is respectively vertical to the first direction and the second direction. The relative position of the lighting module and the detection module in the third direction is changed, so that the focal length of the detection module is changed, and the field angle of the detection module can be changed.
In an embodiment, the imaging method further includes: the brightness of the target scene is increased. When the ambient light intensity of the environment where the target scene is located is weak, the light source can be adopted to increase the brightness of the target scene, so that light is supplemented for imaging of the target scene.
In one embodiment, the detection module comprises a single photon avalanche diode, and the detection module detects the light intensity by recording the number of times of triggering within a preset time. The above-described image forming method further includes: the ambient light intensity of the environment in which the target scene is located is detected. Generally, the detection module is triggered when receiving photons, if the detection module is in a strong-light environment, the number of triggered times within a certain time is large, the detection module is easy to saturate, and after the detection module is saturated, the detection module is not triggered by photons any more, and then the number of photons can not be recorded any more. The time per frame may be reduced when the ambient light intensity is strong, and increased when the ambient light intensity is weak.
It should be noted that, before the detection module reaches saturation, the received photons are absorbed with a certain probability and trigger the single photon avalanche diode, the triggering probability increases with the increase of the light intensity, and if the light intensity of the target scene is higher, the number of times the detection module is triggered is larger.
Referring to fig. 3, the step of detecting the ambient light intensity of the environment where the target scene is located specifically includes:
step S101, a detection unit receives light rays which are emitted from the environment where the target scene is located and pass through a through hole of a lighting module;
step S102, the detection unit records the ambient light intensity of the environment where the target scene is located.
The detection unit may comprise a photodiode or an ambient light sensor or a single photon avalanche diode.
In one embodiment, the through holes are circular holes and have a diameter of 1-300 μm.
The imaging method comprises the steps that a detection module receives light rays which are emitted from a target scene and pass through a through hole of a lighting module, wherein the lighting module is provided with at least one through hole; the detection module records the light intensity of a target scene; and a two-dimensional image of the target scene is constructed according to the light intensity recorded by the detection module, so that the image of the target scene can be reconstructed, the data processing is simple, and the imaging is clear.
Referring to fig. 4, an imaging device according to an embodiment of the present disclosure further includes a lighting module 10, a detecting module 20, a driving device 30, a control module 40, and a light source 60.
The lighting module 10 is provided with at least one through hole. The detecting module 20 is used for receiving the light emitted from the target scene 100 and passing through the through hole of the lighting module 10. The detection module 20 is also used to record the light intensity of the target scene. The control module 40 is electrically connected to the detection module 20, and is configured to construct an image of the target scene 100 according to the light intensity recorded by the detection module 20.
In an embodiment, the driving device 30 is electrically connected to the lighting module 10 and the detecting module 20, respectively, and is used for changing the relative positions of the lighting module 10 and the detecting module 20 in the first direction x and/or the second direction y. The control module 40 is also electrically connected to the driving device 30, and is further configured to construct an image of the target scene 100 according to the light intensity recorded by the detection module 20 at each relative position, so as to improve the resolution of the image.
In an embodiment, the light source 60 is used to emit photons into the target scene 100. The detection module 20 is electrically connected to the light source 60, and is further configured to record a time when the light source 60 emits a photon and record a time when a corresponding photon is received. The control module 40 is also used for calculating the distance between the detection module 20 and the target scene 100 according to the time when the light source 60 emits the photon and the time when the detection module 20 receives the corresponding photon. The control module 40 is further configured to construct an image of the target scene 100 according to the distance between the detection module 20 and the target scene 100 and the light intensity recorded by the detection module 20.
In this embodiment, the control module 40 may further construct an image of the target scene 100 according to the distance between the detection module 20 and the target scene 100 and the light intensity recorded by the detection module 20.
It is understood that the control module 40 obtains the relative position of the lighting module 10 and the detecting module 20 in the first direction x and/or the second direction y from the driving device 30, and obtains the light intensity recorded by the detecting module 20 from the detecting module 20, and the control module 40 can enable the detecting module 20 and the driving device 30 to work synchronously and cooperatively, that is, the detecting module 20 records the light intensity at the relative position every time the driving device 30 changes the relative position of the lighting module 10 and the detecting module 20 in the first direction x and/or the second direction y.
In an embodiment, the distance between the light source 60 and the target scene 100 is equal to the distance between the detection module 20 and the target scene 100. The distance d between the detection module 20 and the target scene 100 is c · Δ t/2, where c is the propagation speed of light in vacuum, and Δ t is the difference between the time when the detection module 20 receives a photon and the time when the light source 60 emits a corresponding photon. The position of the target scene 100 may be determined according to the distance between the detection module 20 and the target scene 100. In this case, the light source used is a pulsed laser light source.
In an embodiment, the driving device 30 is electrically connected to the lighting module 10 and the detecting module 20, respectively, and is used for changing the relative positions of the lighting module 10 and the detecting module 20 in the first direction x and/or the second direction y. The control module 40 is also electrically connected to the driving device 30, and is further configured to construct an image of the target scene 100 according to the distance between the detection module 10 and the target scene 100 and the light intensity recorded by the detection module 20 at each relative position, so as to improve the resolution of the image.
The through hole of the lighting module 10 images the target scene 100, that is, the light emitted from the target scene 100 is incident to the through hole of the lighting module 10 and reaches the detecting module 20 through the through hole of the lighting module 10, so as to be received by the detecting module 20. Each through hole is a circular hole and the diameter of each through hole is 1-300 microns. Pinhole imaging has the advantages of no dispersion, no aberration (such as spherical aberration, coma, astigmatism and distortion), infinite depth of field and the like. In addition, zooming can be achieved by adjusting the distance between the small hole and the sensor, and the image is zoomed, as shown in fig. 5, when the distance between the lighting module 10 and the detection module 20 is close, the imaging angle of view of the target scene 100 on the detection module 20 through the through hole of the lighting module 10 is larger, and when the distance between the lighting module 10 and the detection module 20 is longer, the imaging angle of view of the target scene 100 on the detection module 20 through the through hole of the lighting module 10 becomes smaller. The imaging of the target scene 100 through the through hole on the lighting module 10 does not need to use a complex multi-lens group, and has simple structure and low cost.
The lighting module 10 may be a light shielding plate with a through hole, and the light of the target scene 100 cannot reach the detection module 20 through a place other than the through hole of the light shielding plate. The through holes of the lighting module 10 may be regularly arranged, such as mura (modified uniform reduced array), or irregularly arranged. In practical application, the arrangement mode of the through holes on the lighting module 10 may be designed according to the light intensity of different target points of the target scene 100, the movement track is determined when the lighting module 10 leaves a factory, and the lighting module 10 moves according to the determined movement track. The control module 40 transmits the moving track to the driving device 30, and the driving device 30 controls the movement of the lighting module 10 or the detection module 20 according to the moving track.
It should be noted that the relative position between the lighting module 10 and the detecting module 20 in the first direction x and/or the second direction y can be changed by moving the lighting module 10 or the detecting module 20. The plane formed by the first direction and the second direction is a plane parallel to the plane where the lighting module 10 is located or the plane where the detecting module 20 is located.
In one embodiment, the detection module 20 comprises a single photon avalanche diode, and the detection module 20 detects the light intensity by recording the number of times that the light intensity is triggered within a preset time. The target scene 100 is imaged by the through hole, so that a clear image can be obtained, the diameter of the through hole needs to be small enough, the light incident amount of the through hole is small, the number of photons received by the detection module 20 is small, the response is weak, the signal to noise ratio is low, if the light amount received by the detection module 20 is increased by increasing the light-collecting time, the frame rate of the imaging device can be reduced, the diameter of the through hole is increased, the light spot of a target point from the target scene 100 can be increased, imaging blurring is caused, single photon-level light quantity detection can be realized by adopting the avalanche single-photon diode, the weak light incident to the through hole with the small diameter can be collected, high-gain and high-sensitivity photoelectric detection is realized, and the clear image can be obtained without increasing the light-collecting time and reducing the imaging. In other embodiments, the detection module 20 may include a Quantum Image Sensor (QIS), or a Charge Coupled Device (CCD) type photosensor, or a Solid State Light (SSL) sensor, such as a CMOS sensor or a photosensor fabricated using III-V materials or II-VI materials.
If the detecting module 20 includes a single photon avalanche diode, the detecting module 20 obtains a frame of image by recording the number of times of triggering within a preset time, where the time of a frame is the preset time. Before the detection module 20 reaches saturation, the received photons are absorbed with a certain probability and trigger the single photon avalanche diode, the triggering probability increases with the increase of the light intensity, and if the light intensity of the target scene 100 is higher, the number of times the detection module 20 is triggered is larger. If the detection module 20 is in a strong-light environment, the number of times of triggering within a certain period of time is large, saturation is easy, after the detection module 20 is saturated, the detection module is not triggered by photons any more, and the number of photons cannot be recorded any more, therefore, before the detection module 20 is used for collecting and imaging the target scene 100, the time of each frame can be determined by detecting the ambient light intensity of the environment where the target scene 100 is located, if the ambient light is strong enough, the collection time required by each frame can be short, and thus the detection module 20 can accurately record each frame of image.
The imaging device further comprises a detection unit, wherein the detection unit is used for receiving light rays which are emitted from the environment where the target scene is located and pass through the through hole of the lighting module, and is also used for recording the ambient light intensity of the environment where the target scene is located. The detection unit may include a Photo-sensor such as a PD (Photo-diode), an ALS (Ambient light sensor), an SPAD (single photon avalanche diode), or the like.
When the light of the environment where the target scene 100 is located is weak, the collection time of the detection module 20 may be increased to increase the number of photons received by the detection module 20, or the light source may be used to increase the brightness of the target scene 100, so as to increase the light incident amount of the through hole, thereby increasing the number of times that the detection module 20 is triggered. The light source that increases the brightness of the target scene 100 may be a pulsed laser light source or a continuous light source.
Referring to fig. 6 and 7, in one embodiment, the driving device 30 includes a Micro-Electro-Mechanical System (MEMS). Microelectromechanical systems can achieve high speed control of mechanical motion on the micrometer scale in multiple dimensions. The through hole of the lighting module 10 is adopted to image the target scene 100, the light incoming amount of the through hole is small, the detection module 20 comprises a plurality of pixel units 21 which are arranged in an array, each pixel unit 21 comprises a photosensitive area 211, the area of the detection module 20 is limited due to the large size of the pixel unit 21, therefore, the number of the pixel units 21 on the detection module 20 is small, the imaging resolution of the detection module 20 is low, in order to obtain a clearer image, the lighting module 10 or the detection module 20 needs to be moved in the first direction x and/or the second direction y, and the relative positions of the lighting module 10 and the detection module 20 are changed, so that the photosensitive area receives the light rays incident from the complete target scene 100 through the through hole.
As shown in fig. 8, when the lighting module 10 is located at the first position, since the area of the photosensitive region 211 only occupies a part of the area of the pixel unit 21, and only a part of the light rays of the field of view in the field of view corresponding to the pixel unit 21 are collected by the photosensitive region 211 (the visible portion a is labeled in the figure), and the other part of the light rays of the field of view cannot be collected (the invisible portion B is labeled in the figure), the lighting module 10 or the detecting module 20 is moved in the first direction x and/or the second direction y, for example, when the lighting module 10 is moved to the second position, the invisible portion B becomes the visible angle when the lighting module 10 is located at the first position, so that the field of view of the photosensitive region 211 covers the whole target scene 100, and when the relative position of the lighting module 10 or the detecting module 20 in the first direction x and/or the second direction y is changed N times, the resolution of the image of the target scene 100 is increased by a factor of N. Due to the small diameter of the through hole, the micro-electro-mechanical system can realize a slight change of the relative position of the through hole and the photosensitive region 211 in the first direction x and/or the second direction y.
The control module 40 may be a computer.
When the number of the through holes of the lighting module 10 is multiple, the collection efficiency of the imaging device on the light field information can be improved, and the control module 40 can generate a preset driving track according to the arrangement rule of the through holes on the lighting module 10 and transmit the driving track to the driving device 30 to control the movement track of the lighting module 10 or the detection module 20, so that the detection module 20 can distinguish the intensities of the light rays from different target points of the target scene 100.
The driving means 30 is further adapted to change the relative position of the lighting module 10 and the detecting module 20 in the third direction z. The third direction z is perpendicular to the first direction and the second direction respectively. The driving device 30 changes the relative position of the lighting module 10 and the detecting module 20 in the third direction z, and further changes the focal length of the detecting module 20, so as to change the field angle of the detecting module 20, thereby realizing zooming of the target scene 100.
In an embodiment, the imaging device further includes at least one optical filter, the optical filters correspond to the through holes one to one, and each optical filter is disposed on a corresponding through hole. By disposing the optical filter on the through hole, the target scene 100 is imaged as a color image on the detection module 20 through the through hole. In other embodiments, the imaging device may include a plurality of optical filters, the optical filters correspond to the pixel units 21 one by one, each optical filter is disposed on a corresponding pixel unit 21, and the control module 40 obtains the color information of the image of the target scene 100 through a certain algorithm according to the optical filters disposed on the detection module 20.
The imaging device of this application, through set up the through-hole on daylighting module 10, detection module 20 receives the light that target scene 100 sent and pass through daylighting module 10's through-hole, and detection module 20 records the light intensity of target scene, and control module 40 constructs the two-dimensional image of target scene 100 according to the light intensity that detection module 20 recorded, and simple structure, data processing is simple, and it is clear to form images.
The embodiment of the application also provides electronic equipment, and the electronic equipment comprises the imaging device. In one embodiment, the electronic device is an endoscope.
The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (27)
1. An imaging method, comprising:
step S1, the detection module receives the light which is emitted from the target scene and passes through the through hole of the lighting module, wherein the lighting module is provided with at least one through hole;
step S2, the detection module records the light intensity of the target scene;
and step S3, constructing an image of the target scene according to the light intensity recorded by the detection module.
2. The imaging method according to claim 1, further comprising: changing the relative position of the lighting module and the detection module in the first direction and/or the second direction;
the step S3 further includes: and constructing an image of the target scene according to the light intensity recorded by the detection module at each relative position so as to improve the resolution of the image.
3. The imaging method according to claim 1,
before the step S1, the method further includes:
step S11, the light source emits photons to the target scene;
step S12, the detection module records the time of the light source emitting photons;
the step S2 further includes:
the detection module records the time of receiving the corresponding photon;
before the step S3, the method further includes:
step S31, calculating the distance between the detection module and the target scene according to the time when the light source emits the photons and the time when the detection module receives the corresponding photons;
the step S3 further includes:
and constructing an image of the target scene according to the distance between the detection module and the target scene and the light intensity recorded by the detection module.
4. The imaging method according to claim 3, further comprising: changing the relative position of the lighting module and the detection module in the first direction and/or the second direction;
the step S3 further includes: and constructing an image of the target scene according to the distance between the detection module and the target scene and the light intensity recorded by the detection module at each relative position so as to improve the resolution of the image.
5. The imaging method according to claim 2 or 4, further comprising:
and changing the relative positions of the lighting module and the detection module in a third direction, wherein the third direction is respectively vertical to the first direction and the second direction.
6. The imaging method according to claim 5, further comprising:
increasing the brightness of the target scene.
7. The imaging method according to claim 6, further comprising:
and detecting the ambient light intensity of the environment where the target scene is located.
8. The imaging method according to claim 7, wherein the step of detecting the ambient light intensity of the environment in which the target scene is located specifically comprises:
the detection unit receives light rays which are emitted from the environment where the target scene is located and pass through the through hole of the lighting module;
the detection unit records the ambient light intensity of the environment where the target scene is located.
9. The imaging method of any one of claims 1-4, wherein the detection module comprises a single photon avalanche diode.
10. The imaging method of claim 9, wherein the detection module detects the light intensity by recording the number of times it is triggered within a preset time.
11. The imaging method according to claim 8, wherein the detection unit comprises a photodiode or an ambient light sensor or a single photon avalanche diode.
12. An image forming apparatus, comprising:
the lighting module is provided with at least one through hole;
the detection module is used for receiving the light rays which are emitted from the target scene and pass through the through hole of the lighting module;
the detection module is also used for recording the light intensity of the target scene;
and the control module is electrically connected with the detection module and used for constructing the image of the target scene according to the light intensity recorded by the detection module.
13. The imaging apparatus of claim 12, further comprising:
the driving device is electrically connected with the lighting module and the detection module respectively and used for changing the relative positions of the lighting module and the detection module in the first direction and/or the second direction;
the control module is also electrically connected with the driving device and is also used for constructing an image of the target scene according to the light intensity recorded by the detection module at each relative position so as to improve the resolution of the image.
14. The imaging apparatus of claim 12, further comprising:
a light source for emitting photons to the target scene;
the detection module is also electrically connected with the light source and is also used for recording the time when the light source emits the photons and the time when the corresponding photons are received;
the control module is also used for calculating the distance between the detection module and the target scene according to the time when the light source emits the photons and the time when the detection module receives the corresponding photons;
the control module also constructs an image of the target scene according to the distance between the detection module and the target scene and the light intensity recorded by the detection module.
15. The imaging apparatus of claim 14, further comprising:
the driving device is electrically connected with the lighting module and the detection module respectively and used for changing the relative positions of the lighting module and the detection module in the first direction and/or the second direction;
the control module is also electrically connected with the driving device and is further used for constructing an image of the target scene according to the distance between the detection module and the target scene and the light intensity recorded by the detection module at each relative position so as to improve the resolution of the image.
16. An imaging device according to claim 13 or 15, wherein the driving device is further configured to change the relative position of the light collecting module and the detecting module in a third direction, wherein the third direction is perpendicular to the first direction and the second direction, respectively.
17. The imaging apparatus of claim 14, wherein the light source is further configured to increase a brightness of the target scene.
18. The imaging apparatus of claim 14, wherein the detection module comprises a single photon avalanche diode.
19. The imaging apparatus of claim 18, wherein the detection module detects the light intensity by recording a number of times that the light intensity is triggered within a predetermined time.
20. The imaging apparatus according to claim 12, further comprising a detection unit for receiving light emitted from an environment in which the target scene is located and passing through the through hole of the lighting module, and for recording an ambient light intensity of the environment in which the target scene is located.
21. The imaging apparatus of claim 20, wherein the detection unit comprises a photodiode or an ambient light sensor or a single photon avalanche diode.
22. The imaging apparatus of claim 14, further comprising:
the optical filters correspond to the through holes one by one, and each optical filter is arranged on one corresponding through hole.
23. The imaging apparatus of claim 14, further comprising:
a plurality of optical filters;
the detection module comprises a plurality of pixel units;
the plurality of optical filters correspond to the plurality of pixel units one by one, and each optical filter is arranged on one corresponding pixel unit.
24. The imaging apparatus of claim 16, wherein the driving means comprises a micro-electromechanical system.
25. The imaging apparatus of claim 14, wherein the light source is a pulsed laser light source.
26. An electronic device characterized by comprising the imaging apparatus of any one of claims 12 to 25.
27. The electronic device of claim 26, wherein the electronic device is an endoscope.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911424996.8A CN113132582A (en) | 2019-12-31 | 2019-12-31 | Imaging method, imaging device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911424996.8A CN113132582A (en) | 2019-12-31 | 2019-12-31 | Imaging method, imaging device and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113132582A true CN113132582A (en) | 2021-07-16 |
Family
ID=76770900
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911424996.8A Pending CN113132582A (en) | 2019-12-31 | 2019-12-31 | Imaging method, imaging device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113132582A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2708914A1 (en) * | 2012-09-18 | 2014-03-19 | Sick Ag | Optoelectronic sensor and method for recording a depth map |
| CN105072358A (en) * | 2015-06-04 | 2015-11-18 | 南京瑞派宁信息科技有限公司 | Low-pixel-density camera imaging method and device |
| CN109115121A (en) * | 2018-07-06 | 2019-01-01 | 华东师范大学 | A kind of big visual field laser three-dimensional imaging instrument and imaging method |
| CN110187357A (en) * | 2019-06-14 | 2019-08-30 | 中国科学技术大学 | The Laser Active Imaging System Used of 3-D image reconstruct |
| CN211406089U (en) * | 2019-12-31 | 2020-09-01 | 深圳市灵明光子科技有限公司 | Imaging device and electronic apparatus |
-
2019
- 2019-12-31 CN CN201911424996.8A patent/CN113132582A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2708914A1 (en) * | 2012-09-18 | 2014-03-19 | Sick Ag | Optoelectronic sensor and method for recording a depth map |
| CN105072358A (en) * | 2015-06-04 | 2015-11-18 | 南京瑞派宁信息科技有限公司 | Low-pixel-density camera imaging method and device |
| CN109115121A (en) * | 2018-07-06 | 2019-01-01 | 华东师范大学 | A kind of big visual field laser three-dimensional imaging instrument and imaging method |
| CN110187357A (en) * | 2019-06-14 | 2019-08-30 | 中国科学技术大学 | The Laser Active Imaging System Used of 3-D image reconstruct |
| CN211406089U (en) * | 2019-12-31 | 2020-09-01 | 深圳市灵明光子科技有限公司 | Imaging device and electronic apparatus |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN211406089U (en) | Imaging device and electronic apparatus | |
| US11994618B2 (en) | Rotating compact light ranging system | |
| KR102695382B1 (en) | Optical ranging device having an electronically scanned emitter array and a synchronized sensor array | |
| KR102657365B1 (en) | Brightness Enhanced Optical Imaging Transmitter | |
| CN112351270B (en) | Method and device for determining faults and sensor system | |
| WO2019113368A1 (en) | Rotating compact light ranging system | |
| CN211352285U (en) | Image forming apparatus with a plurality of image forming units | |
| CN113132582A (en) | Imaging method, imaging device and electronic equipment | |
| CN112335049B (en) | Imaging assembly, touch screen, camera module, intelligent terminal, camera and distance measurement method | |
| KR20100071537A (en) | Camera device | |
| EP4384849A1 (en) | Coaxial lidar system using a diffractive waveguide | |
| CN113132581A (en) | Imaging method, imaging device and electronic equipment | |
| AU2006267263A1 (en) | 3-dimensional image detector | |
| CN108802980B (en) | Four-piece focusing medium wave infrared optical system | |
| US20240039632A1 (en) | Light receiving device, reception device, communication device, and communication system | |
| JP4327625B2 (en) | Light position information detection device | |
| WO2022113028A1 (en) | Methods and systems for infrared sensing | |
| CN114690339A (en) | Lidar receiver with filter and baffle for reducing crosstalk |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |