CN112560835A - Imaging assembly for shielding ambient light interference and image imaging method - Google Patents

Imaging assembly for shielding ambient light interference and image imaging method Download PDF

Info

Publication number
CN112560835A
CN112560835A CN201910918496.3A CN201910918496A CN112560835A CN 112560835 A CN112560835 A CN 112560835A CN 201910918496 A CN201910918496 A CN 201910918496A CN 112560835 A CN112560835 A CN 112560835A
Authority
CN
China
Prior art keywords
image signal
image
image sensor
ambient light
light interference
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910918496.3A
Other languages
Chinese (zh)
Inventor
代玲玲
严鸿飞
周方明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suzhou Lichuang Zhiheng Electronic Technology Co ltd
Original Assignee
Suzhou Lichuang Zhiheng Electronic Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou Lichuang Zhiheng Electronic Technology Co ltd filed Critical Suzhou Lichuang Zhiheng Electronic Technology Co ltd
Priority to CN201910918496.3A priority Critical patent/CN112560835A/en
Priority to PCT/CN2019/121128 priority patent/WO2021056801A1/en
Publication of CN112560835A publication Critical patent/CN112560835A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/10Image acquisition
    • G06V10/12Details of acquisition arrangements; Constructional details thereof
    • G06V10/14Optical characteristics of the device performing the acquisition or on the illumination arrangements
    • G06V10/141Control of illumination
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/10Image acquisition
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/10Image acquisition
    • G06V10/12Details of acquisition arrangements; Constructional details thereof
    • G06V10/14Optical characteristics of the device performing the acquisition or on the illumination arrangements
    • G06V10/147Details of sensors, e.g. sensor lenses
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/588Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
    • HELECTRICITY
    • H01ELECTRIC ELEMENTS
    • H01LSEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
    • H01L27/00Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate
    • H01L27/14Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate including semiconductor components sensitive to infrared radiation, light, electromagnetic radiation of shorter wavelength or corpuscular radiation and specially adapted either for the conversion of the energy of such radiation into electrical energy or for the control of electrical energy by such radiation
    • H01L27/144Devices controlled by radiation
    • H01L27/146Imager structures
    • H01L27/148Charge coupled imagers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof

Abstract

The invention discloses an imaging component for shielding ambient light interference and an image imaging method, wherein the imaging component comprises a camera lens, a compensation light source, an image sensor and a processor, the image sensor is arranged between the camera lens and the processor, and the output end of the image sensor is connected with the processor; the compensating light source has an on state and an off state, and provides compensating light for the image sensor in the on state; the image sensor is used for respectively acquiring a first image signal when the compensation light source is in an open state and acquiring a second image signal when the compensation light source is in a closed state; the processor is used for carrying out CCD photosensitive charge number subtraction operation on the first image signal and the second image signal to obtain an image signal for removing ambient light interference. One or two image sensors are arranged in the imaging component designed by the invention, and an image for shielding ambient light interference is obtained through subtraction operation; the image for shielding the ambient light interference can be obtained through subtraction in the imaging method, and the ambient light interference can be completely removed.

Description

Imaging assembly for shielding ambient light interference and image imaging method
Technical Field
The invention relates to the field of image imaging systems, in particular to an imaging assembly for shielding ambient light interference and an image imaging method.
Background
In the field of rail transit industry, machine vision safety-keeping systems are distinguished from installation angles, mainly ground-to-vehicle and vehicle-to-ground-to-vehicle systems are arranged on rails to shoot key component images such as the bottom of a vehicle, a side frame part and the top of the vehicle to monitor the state of a train and guarantee the safety of the train, the vehicle-to-ground systems are mainly arranged on the train to shoot steel rails, contact networks and objects beside the rails to guarantee the normal running of the train, the machine vision safety-keeping systems are classified from image angles and are divided into two-dimensional imaging and three-dimensional imaging at present, the two-dimensional imaging is divided into linear array scanning and planar array scanning from the types of cameras, the three-dimensional imaging methods mainly comprise a laser triangulation method and a binocular three-dimensional imaging method, and no matter which method is used for imaging, the.
The existing technology has the following problems of ambient light interference:
1. line-scan two-dimensional or area-scan two-dimensional imaging
When the light source is used outdoors, the light source is used for supplementing light for the camera, but the light source is used in a real use environment as follows: the superposition of the illumination of train lights and sunlight lights causes the overexposure of a camera during shooting;
2. laser triangulation three-dimensional imaging
A beam of laser emitted by a light source irradiates on a plane of an object to be detected, and is finally imaged on a detector through reflection; when the position of the object surface changes, the image it forms is displaced on the detector accordingly. Through the relational expression between image shift and the actual displacement, real object displacement can be obtained by detection and calculation to image shift, consequently, when the camera was when gathering own line laser, if have the sun or come with the light irradiation of line laser with the spectrum, other faculas will be shot to the camera, consequently, the camera will make mistakes when extracting every light spot on the line of linear array laser, and then the difference can appear in the position of far and near.
The current common method of the technology is to increase the brightness of the laser, reduce the exposure time of the camera, and increase the threshold value of the camera to remove the ambient light, but the following reasons cannot be solved all the time: (1) the power of the laser is greatly increased, so that the risk of safety factor exists, the brightness of the laser is stronger than that of direct sunlight, a light source is difficult to manufacture, and the size of the laser is large; (2) a detection shed (with high price) is installed in the used outdoor environment, so that direct sunlight is avoided, the brightness of the laser is properly enhanced, and the threshold value is increased to remove the light interference below the brightness of the laser.
Ambient light interference affects the imaging as follows: (1) the imaging effect is that when light interference exists, the two-dimensional image has an overexposure phenomenon, so people cannot see the real state of train components clearly, and potential safety hazards caused by train running due to the fault leakage phenomenon may exist. (2) The image recognition effect, along with the introduction of the machine vision imaging technology, the original train detection is changed from outdoor manual train inspection into indoor train inspection and overhaul by looking at pictures, but in recent years, the train is greatly accelerated for six times, the number of motor train units and subways is continuously increased, the supply of railway personnel is not in demand, and the original detection mode by looking at pictures cannot meet the requirements, so that the hope of solving the image recognition is brought to the intelligent train image recognition due to the intervention of three-dimensional imaging in recent years. First equipment is installed in the big-arch shelter and is verified experimental effect better, but outdoors, especially when shooting car shoulder, roof and contact net, there is the direct sunlight problem inevitable, even, for solving this problem on the railway, the detection car can only detect evening, and leads to efficiency greatly reduced.
Disclosure of Invention
In order to solve the problems in the prior art, the invention provides an imaging assembly and an image imaging method for shielding ambient light interference, which can completely remove the ambient light interference, and the technical scheme is as follows:
the invention provides an imaging component for shielding ambient light interference, which comprises a camera lens, a compensation light source, an image sensor and a processor,
the image sensor is arranged between the camera lens and the processor, and the output end of the image sensor is connected with the input end of the processor;
the compensation light source has an on state and an off state, and provides compensation light for the image sensor in the on state;
the image sensor is used for acquiring a first image signal when the compensation light source is in an open state and acquiring a second image signal when the compensation light source is in a closed state;
the processor is used for carrying out CCD photosensitive charge number subtraction operation on the first image signal and the second image signal to obtain an image signal for removing ambient light interference.
Further, the imaging assembly further comprises an optical filter, and the optical filter is arranged on an optical path between the camera lens and the image sensor.
Furthermore, the imaging assembly further comprises an optical filter, and the optical filter is arranged in front of the light incidence side of the camera lens.
The invention provides another imaging assembly for shielding ambient light interference, which comprises a camera lens, a beam splitter, a compensation light source, a first image sensor, a second image sensor and a processor,
the light splitting sheet is arranged between the camera lens and the processor, light passes through the light splitting sheet to form a first light path and a second light path, the first image sensor is arranged on the first light path, and the second image sensor is arranged on the second light path; the output end of the first image sensor and the output end of the second image sensor are both connected with a processor;
the compensation light source has an on state and an off state, and provides compensation light for the first image sensor and the second image sensor in the on state;
the first image sensor is used for acquiring a first image signal when the compensation light source is in an open state;
the second image sensor is used for acquiring a second image signal when the compensation light source is in a closed state; the acquisition angles of the first image sensor and the second image sensor are consistent;
the processor is used for carrying out CCD photosensitive charge number subtraction operation on the first image signal and the second image signal to obtain an image signal for removing ambient light interference.
Further, a first optical filter is arranged on a first light path between the light splitter and the first image sensor, and a second optical filter is arranged on a second light path between the light splitter and the second image sensor.
Furthermore, an optical filter is arranged in front of the light incidence side of the camera lens.
The invention provides another imaging component for shielding ambient light interference, which comprises a camera lens, an optical filter, a beam splitter, a compensation light source, a first image sensor, a second image sensor, a processor and a display component,
the optical filter is arranged on an optical path between the camera lens and the light splitting sheet, and the output end of the first image sensor and the output end of the second image sensor are both connected with the processor;
the light passes through the light splitting sheet to form a first light path and a second light path, the first image sensor is arranged on the first light path, and the second image sensor is arranged on the second light path;
the compensation light source has an on state and an off state, and provides compensation light for the first image sensor and the second image sensor in the on state;
the first image sensor is used for acquiring a first image signal when the compensation light source is in an open state;
the second image sensor is used for acquiring a second image signal when the compensation light source is in a closed state; the acquisition angles of the first image sensor and the second image sensor are consistent;
the processor is used for carrying out CCD photosensitive charge number subtraction operation on the first image signal and the second image signal to obtain an image signal for removing ambient light interference.
Further, an included angle between the first light path and the second light path is 90 degrees.
Furthermore, the imaging assembly for shielding the ambient light interference further comprises a display assembly, and the output end of the processor is connected with the input end of the display assembly.
Further, the difference between the acquisition time of the first image signal and the acquisition time of the second image signal is smaller than a preset time threshold.
Further, the compensation light source is a laser or an LED.
Further, the processor comprises a subtraction module and a data conversion module,
the subtraction module is used for performing subtraction of CCD photosensitive charge number on a first image signal and a second image signal acquired by the image sensor to obtain an image without ambient light interference and outputting an electric signal of the image without ambient light interference;
the data conversion module is used for converting the electric signals into a data format which can be displayed by the display component.
The invention provides an image imaging method for shielding ambient light interference, which comprises the following steps:
s1, turning on a compensation light source, and collecting a first image signal by using an image sensor, wherein the first image signal comprises the CCD photosensitive charge number of each pixel position;
s2, turning off the compensation light source within a preset time threshold range, and collecting a second image signal by using the image sensor, wherein the second image signal comprises the CCD photosensitive charge number of each pixel position;
and S3, performing CCD photosensitive charge number subtraction on the first image signal in the S1 step and the second image signal in the S2 step to obtain an image signal without ambient light interference.
Further, the image imaging method further includes the steps of:
s4, converting the image signal without the ambient light interference in the step S3 into a data format which can be displayed by a display component.
Further, in step S1, a first image signal is acquired by the first image sensor; in step S2, a second image signal is acquired by a second image sensor, and the acquisition angles of the first image sensor and the second image sensor are the same.
Further, in steps S1 and S2, both the first image signal and the second image signal are acquired by the same image sensor.
Further, in step S3, the CCD photo-sensitive charge number at each pixel position in the first image signal is subtracted by the CCD photo-sensitive charge number at the corresponding pixel position in the second image signal to obtain a CCD photo-sensitive charge number difference value at the corresponding pixel position, and the ambient light interference-free image signal is obtained according to the CCD photo-sensitive charge number difference value at the corresponding pixel position.
The invention provides another image imaging method for shielding ambient light interference, which comprises the following steps:
s1, turning off a compensation light source, and collecting a first image signal by using an image sensor, wherein the first image signal comprises the CCD photosensitive charge number of each pixel position;
s2, turning on a compensation light source within a preset time threshold range, and collecting a second image signal by using an image sensor, wherein the second image signal comprises the CCD photosensitive charge number of each pixel position;
and S3, performing CCD photosensitive charge number subtraction on the first image signal in the S1 step and the second image signal in the S2 step to obtain an image signal without ambient light interference.
Further, the image imaging method further includes the steps of:
s4, converting the image signal without the ambient light interference in the step S3 into a data format which can be displayed by a display component.
Further, in step S1, a first image signal is acquired by the first image sensor; in step S2, a second image signal is acquired by a second image sensor, and the acquisition angles of the first image sensor and the second image sensor are the same.
Further, in steps S1 and S2, both the first image signal and the second image signal are acquired by the same image sensor.
Further, in step S3, the CCD photo-sensitive charge number at each pixel position in the second image signal is subtracted by the CCD photo-sensitive charge number at the corresponding pixel position in the first image signal to obtain a CCD photo-sensitive charge number difference value at the corresponding pixel position, and the ambient light interference-free image signal is obtained according to the CCD photo-sensitive charge number difference value at the corresponding pixel position.
The technical scheme provided by the invention has the following beneficial effects:
a. the imaging component designed by the invention is provided with one image sensor or two image sensors, and an image for shielding ambient light interference can be obtained through subtraction operation;
b. the image imaging method designed by the invention can obtain the image for shielding the ambient light interference through subtraction operation, and can completely remove the ambient light interference.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
FIG. 1 is a schematic diagram of an imaging assembly for shielding ambient light interference according to an embodiment of the present invention for capturing laser lines and sun or ambient light;
FIG. 2 is a schematic diagram of an imaging assembly for shielding ambient light interference according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of the imaging assembly for shielding ambient light interference provided by the embodiment of the invention after subtraction of the imaging assembly of FIGS. 1 and 2;
FIG. 4 is a first block diagram of an imaging assembly for shielding ambient light interference according to an embodiment of the present invention;
FIG. 5 is a second block diagram of an imaging assembly for shielding ambient light interference according to an embodiment of the present invention;
FIG. 6 is a third block diagram of an imaging assembly for shielding ambient light interference according to an embodiment of the present invention;
FIG. 7 is a fourth block diagram of an imaging assembly for shielding ambient light interference according to an embodiment of the present invention;
FIG. 8 is a fifth block diagram of an imaging assembly for shielding ambient light interference according to an embodiment of the present invention;
FIG. 9 is a sixth block diagram of an imaging assembly for shielding ambient light interference according to an embodiment of the present invention;
FIG. 10 is a seventh block diagram of an imaging assembly for shielding ambient light interference according to an embodiment of the present invention;
fig. 11 is a flowchart of an imaging method of an imaging assembly for shielding ambient light interference according to an embodiment of the present invention.
Wherein the reference numerals include: the image sensor comprises a camera lens 1, a camera lens 2, a light filter 3, a compensation light source 4, an image sensor 5, a processor 6, a display assembly 7, a light splitting sheet 8, a first image sensor 9, a second image sensor 10, a first light filter 11 and a second light filter 11.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, apparatus, article, or device that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or device.
The measured object has static state and moving state, and under two kinds of states, can shoot through the imaging element who shields the ambient light interference that this application provided and get and remove ambient light interference image, the principle explanation is as follows:
in the first case: when the measured object is static, the camera is exposed fast and continuously, and the possibility of the change of the ambient light is regarded as 0 due to the fast and continuous exposure of the camera, the two photographed images are as shown in fig. 1 (the camera photographs a laser line and the sun or ambient light) and fig. 2 (the camera photographs only the sun or the ambient light), because the measured object is static, the measured object in the two images does not move, the corresponding coordinates of the two images are subtracted to obtain a diagram 3 (the diagrams in fig. 1, fig. 2 and fig. 3 are schematic diagrams), and only the laser line and no sun or ambient light are shown in fig. 3, which shows that the imaging component is used for shielding the ambient light interference and obtaining an image shielding the ambient light interference.
In the second case: when the measured object (such as a high-speed train) moves, because the camera adopts a high-speed camera, the connected exposure frequency is within 20US, when the running speed of the high-speed train is up to 300KM/H, the length of 1 second is about 83 meters, the length of 1ms is about 83mm, and the length of 20US train is about 1.6mm, in the image algorithm, the error is basically not influenced, and because the time is short, the measured object can be regarded as static, and the same is the first situation described above.
When the storage time is needed for shooting by the individual camera, the cameras cannot be exposed continuously and quickly, so that the shooting cannot be performed after the train moves far, and therefore the shooting cannot be performed.
Example 1
In an embodiment of the present invention, an imaging assembly for shielding ambient light interference is provided, and is applied to various fields, such as the rail transit vehicle industry, and the specific structure of the imaging assembly is shown in fig. 4, and the imaging assembly includes a camera lens 1, a compensation light source 3, an image sensor 4, a processor 5 and a display assembly 6, wherein the compensation light source 3 is a laser or an LED, when the imaging assembly is applied to the rail transit industry, the image sensor faces a rail transit vehicle, and a spatial angle is formed between the light source 1 and the image sensor; the image sensor 4 is arranged between the camera lens 1 and the processor 5, the output end of the image sensor is connected with the input end of the processor 5, the output end of the processor 5 is connected with the input end of the display component 6, and the display component 6 comprises a display connected with the processor 5.
The compensation light source 3 has an on-state and an off-state, which provides compensation light for the image sensor 4 in the on-state; the image sensor 4 is configured to collect a first image signal when the compensation light source 3 is in an on state and collect a second image signal when the compensation light source 3 is in an off state (the compensation light source is turned off within a preset time threshold range, and the image sensor 4 collects the second image signal), where the first image signal includes the number of CCD photosensitive charges at each pixel position, and the second image signal includes the number of CCD photosensitive charges at each pixel position; the processor 5 is configured to perform CCD photosensitive charge number subtraction on the first image signal and the second image signal to obtain an image signal without ambient light interference, specifically, subtract the CCD photosensitive charge number of each pixel position in the first image signal from the CCD photosensitive charge number of the corresponding pixel position in the second image signal to obtain a CCD photosensitive charge number difference value of the corresponding pixel position, and obtain the image signal without ambient light interference according to the CCD photosensitive charge number difference value of the corresponding pixel position. The processor 5 comprises a subtraction module and a data conversion module, wherein the subtraction module is used for performing subtraction of CCD photosensitive charge numbers on a first image signal and a second image signal acquired by an image sensor to obtain an image without ambient light interference, and outputting an electric signal without the image with the ambient light interference; the data conversion module is used for converting the electric signals into a data format which can be displayed by the display component.
Or, the compensation light source is closed firstly, the image sensor is used for collecting a first image signal, then the compensation light source is opened within a preset time threshold range, the image sensor is used for collecting a second image signal, and then CCD photosensitive charge number subtraction operation is carried out on the first image signal and the second image signal to obtain an image signal without ambient light interference.
When the object to be measured is static, the image without the ambient light interference is obtained through shooting by the scheme, and the image is not influenced by time; when the measured object moves, the difference between the acquisition time of the first image signal and the acquisition time of the second image signal is smaller than a preset time threshold, and the measured object can be regarded as static when the moving speed of the measured object is higher and the preset time threshold is smaller; in one embodiment, the predetermined time threshold is 20 Us.
The image sensor and the CCD photosensitive charge number are explained, and the concrete steps are as follows: CCD image sensor CCD is made of semiconductor material with high light sensitivity, and can convert light into electric charge and convert the electric charge into digital signal via A/D converter chip, and the digital signal is compressed and stored in flash memory or hard disc card inside camera, so that the data may be transferred to computer easily and the image may be modified as required. A CCD consists of many photosites, usually in mega pixels. When the CCD surface is irradiated by light, each photosensitive unit reflects charges on the component, and signals generated by all the photosensitive units are added together to form a complete picture.
Example 2
In another embodiment of the present invention, an imaging assembly for shielding ambient light interference is provided, and is applied to various fields, such as the rail transit vehicle industry, and the specific structure of the imaging assembly is shown in fig. 5, including a camera lens 1, an optical filter 2, a compensation light source 3, an image sensor (CCD), a processor 5 and a display assembly 6, where the compensation light source 3 is a laser or an LED, and when the imaging assembly is applied to the rail transit industry, the image sensor faces a rail transit vehicle, and a spatial angle is formed between the light source 1 and the image sensor; embodiment 2 differs from embodiment 1 in that an optical filter is added, the optical filter 2 is disposed in front of the light incident side of the camera lens 1, the output end of the image sensor is connected to the input end of the processor 5, the output end of the processor 5 is connected to the input end of the display module 6, and the display module 6 includes a display connected to the processor 5. The optical filter is used for filtering stray light, is selected according to the spectrum of the compensation light source, and determines different optical filters according to specific requirements.
Example 3
In another embodiment of the present invention, an imaging assembly for shielding ambient light interference is provided, which is applied to various fields, such as the rail transit vehicle industry, and the specific structure of the imaging assembly is shown in fig. 6, including a camera lens 1, an optical filter 2, a compensation light source 3, an image sensor (CCD), a processor 5 and a display assembly 6, where the compensation light source 3 is a laser or an LED, and when the imaging assembly is applied to the rail transit industry, the image sensor faces a rail transit vehicle, and a spatial angle is formed between the light source 1 and the image sensor; embodiment 3 differs from embodiment 1 in that an optical filter is added, the optical filter 2 is disposed on an optical path between the camera lens 1 and the image sensor 4, an output of the image sensor is connected to an input of a processor 5, an output of the processor 5 is connected to an input of a display assembly 6, and the display assembly 6 includes a display connected to the processor 5. The optical filter is used for filtering stray light, is selected according to the spectrum of the compensation light source, and determines different optical filters according to specific requirements.
Example 4
In a further embodiment of the present invention, an imaging assembly for shielding ambient light interference is provided, and is applied to various fields, such as the rail transit vehicle industry, and the specific structure of the imaging assembly is shown in fig. 7, which includes a camera lens 1, a beam splitter 7, a compensation light source 3, a first image sensor 8, a second image sensor 9, a processor 5 and a display assembly 6, wherein the compensation light source 3 is a laser or an LED, when the imaging assembly is applied to the rail transit industry, the first image sensor 8 and the second image sensor 9 both face a rail transit vehicle, and a spatial angle is formed between the light source 1 and each of the first image sensor 8 and the second image sensor 9; the light splitting sheet 7 is arranged between the camera lens 1 and the processor 5, the light passes through the light splitting sheet 7 to form a first light path and a second light path, the first image sensor 8 is arranged on the first light path, the second image sensor 9 is arranged on the second light path, and the included angle between the first light path and the second light path is preferably 90 degrees; the output end of the first image sensor 8 and the output end of the second image sensor 9 are both connected with the processor 5;
the compensation light source 3 has an on-state and an off-state, which in the on-state provides compensation light for both the first image sensor 8 and the second image sensor 9; the first image sensor 8 is used for acquiring a first image signal when the compensation light source 3 is in an on state; the second image sensor 9 is configured to acquire a second image signal when the compensation light source 3 is in an off state, where the first image signal includes the number of CCD photosensitive charges at each pixel position, and the second image signal includes the number of CCD photosensitive charges at each pixel position; the processor 5 is configured to perform CCD photosensitive charge number subtraction on the first image signal and the second image signal to obtain an image signal without ambient light interference, specifically, subtract the CCD photosensitive charge number of each pixel position in the first image signal from the CCD photosensitive charge number of the corresponding pixel position in the second image signal to obtain a CCD photosensitive charge number difference value of the corresponding pixel position, and obtain the image signal without ambient light interference according to the CCD photosensitive charge number difference value of the corresponding pixel position; preferably, the first image sensor and the second image sensor have the same collection angle, the collection angle refers to the angle of the first image sensor and the second image sensor towards the measured object, the consistent collection angle can ensure that the images of the measured object are shot consistently, and the processor can conveniently perform CCD photosensitive charge number subtraction operation on the first image signal and the second image signal to obtain the image signal for removing the ambient light interference.
The processor 5 comprises a subtraction module and a data conversion module, wherein the subtraction module is used for performing subtraction of CCD photosensitive charge numbers on a first image signal and a second image signal acquired by a first image sensor to obtain an ambient light interference removing image and outputting an electric signal of the ambient light interference removing image; the data conversion module is used for converting the electric signals into a data format which can be displayed by the display component.
Or, the compensation light source is closed firstly, the first image sensor is used for collecting the first image signal, then the compensation light source is opened within a preset time threshold range, the second image sensor is used for collecting the second image signal, and then CCD photosensitive charge number subtraction operation is carried out on the first image signal and the second image signal to obtain the image signal without the ambient light interference.
Further, the imaging assembly further includes an optical filter, the setting position of the optical filter is three structures, and the first position is that the optical filter 2 is arranged in front of the light incident side of the camera lens 1, specifically referring to fig. 8. The second position is where the filter 2 is disposed on the optical path between the camera lens 1 and the beam splitter 7, see fig. 10 in particular. The third position is that a first optical filter 10 is disposed on a first optical path between the spectroscope 7 and the first image sensor 8, and a second optical filter 11 is disposed on a second optical path between the spectroscope 7 and the second image sensor 9, see fig. 9 in particular. The optical filter is selected according to the spectrum of the compensation light source, and different optical filters are determined according to specific requirements.
When the object to be measured is static, the image without the ambient light interference is obtained through shooting by the scheme, and the image is not influenced by time; when the measured object moves, the acquisition time difference between the first image signal and the second image signal is smaller than a preset time threshold, and the measured object can be regarded as static when the moving speed of the measured object is higher and the preset time threshold is smaller.
The difference between the embodiment 4 and the embodiments 1-3 is the number of the image sensors, 1 image sensor is provided in the embodiments 1-3, 2 image sensors are provided in the embodiment 4, and when 1 image sensor exists, the storage time is affected by two times of shooting, so that the requirement on the camera is high, and a high-speed camera is needed; the other 1 image sensor ensures that the angles of the two-time shooting of the measured object are completely consistent; when two image sensors are arranged, the influence of the two-time shooting and storage time is small, the time gap between two-time acquisition is negligible, continuous and rapid exposure can be realized, and the requirement on a camera is low; the angles of the two other image sensors for shooting the measured object twice may have deviation, so it is necessary to ensure that the acquisition angles of the first image sensor and the second image sensor are consistent to reduce the influence of the deviation.
Example 4 in the present application is further explained as follows:
adopt two image sensor in embodiment 4 of this application, when light got into the camera lens, it is unanimous to make the influence of the object scene that two cameras were shot and ambient light unanimous through the beam splitting, and the device need guarantee simultaneously that two image sensor models sensitization are all unanimous, and the parameter that two image sensor set up of use is all unanimous, and concrete the signal is as follows: turning on a light source, turning off the light source, stopping acquisition by the first image sensor, and exposing and acquiring by the second camera independently as shown in fig. 2 (the camera only shoots the sun or the ambient light) when the first image sensor shoots a moving or static object, and finally subtracting to obtain an image which is shown in fig. 3, only has laser lines and does not have the sun or the ambient light, and the imaging component shields the ambient light interference and obtains the image shielding the ambient light interference.
The invention provides an image imaging method for shielding ambient light interference, as shown in fig. 11, comprising the following steps:
s1, turning on a compensation light source, and collecting a first image signal by using an image sensor, wherein the first image signal comprises the CCD photosensitive charge number of each pixel position;
s2, turning off the compensation light source within a preset time threshold range, and collecting a second image signal by using the image sensor, wherein the second image signal comprises the CCD photosensitive charge number of each pixel position;
s3, performing a CCD photosensitive charge number subtraction operation on the first image signal in the step S1 and the second image signal in the step S2 to obtain an image signal without ambient light interference, specifically, in step S3, subtracting the CCD photosensitive charge number of the corresponding pixel position in the second image signal from the CCD photosensitive charge number of each pixel position in the first image signal to obtain a CCD photosensitive charge number difference value of the corresponding pixel position, and obtaining the image signal without ambient light interference according to the CCD photosensitive charge number difference value of the corresponding pixel position.
Further, the image imaging method further includes, after the step of S3, the steps of:
s4, converting the image signal without the ambient light interference in the step S3 into a data format which can be displayed by a display component.
In the image imaging method for shielding ambient light interference provided by the application, the image sensor has two selected situations, the first situation is as follows: there are two image sensors, and in step S1, a first image signal is acquired with the first image sensor; in step S2, a second image signal is acquired by a second image sensor, and the acquisition angles of the first image sensor and the second image sensor are the same. The second case is: there is an image sensor, and in steps S1 and S2, the first image signal and the second image signal are both acquired by the same image sensor.
The invention provides another image imaging method for shielding ambient light interference, which comprises the following steps:
s1, turning off a compensation light source, and collecting a first image signal by using an image sensor, wherein the first image signal comprises the CCD photosensitive charge number of each pixel position;
s2, turning on a compensation light source within a preset time threshold range, and collecting a second image signal by using an image sensor, wherein the second image signal comprises the CCD photosensitive charge number of each pixel position;
s3, performing a CCD photosensitive charge number subtraction operation on the first image signal in the step S1 and the second image signal in the step S2 to obtain an image signal without ambient light interference, specifically, in step S3, subtracting the CCD photosensitive charge number of the corresponding pixel position in the first image signal from the CCD photosensitive charge number of each pixel position in the second image signal to obtain a CCD photosensitive charge number difference value of the corresponding pixel position, and obtaining the image signal without ambient light interference according to the CCD photosensitive charge number difference value of the corresponding pixel position.
Further, the image imaging method further includes, after the step of S3, the steps of:
s4, converting the image signal without the ambient light interference in the step S3 into a data format which can be displayed by a display component.
In another image imaging method for shielding ambient light interference provided by the present application, the image sensor has two selected situations, the first situation is: there are two image sensors, and in step S1, a first image signal is acquired with the first image sensor; in step S2, a second image signal is acquired by a second image sensor, and the acquisition angles of the first image sensor and the second image sensor are the same. The second case is: there are two image sensors, and in steps S1 and S2, the first image signal and the second image signal are both acquired by the same image sensor.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.

Claims (22)

1. An imaging assembly for shielding ambient light interference, which is characterized by comprising a camera lens (1), a compensation light source (3), an image sensor (4) and a processor (5),
the image sensor (4) is arranged between the camera lens (1) and the processor (5), and the output end of the image sensor is connected with the input end of the processor (5);
the compensation light source (3) has an on-state and an off-state, which in the on-state provides compensation light for the image sensor (4);
the image sensor (4) is used for respectively acquiring a first image signal when the compensation light source (3) is in an open state and acquiring a second image signal when the compensation light source (3) is in a closed state;
and the processor (5) is used for carrying out CCD photosensitive charge number subtraction operation on the first image signal and the second image signal to obtain an image signal for removing ambient light interference.
2. The imaging assembly shielded from ambient light interference according to claim 1, further comprising a filter (2), the filter (2) being disposed in an optical path between the camera lens (1) and the image sensor (4).
3. The imaging assembly of claim 1, further comprising a filter (2), wherein the filter (2) is disposed in front of the light incident side of the camera lens (1).
4. An imaging assembly for shielding ambient light interference is characterized by comprising a camera lens (1), a beam splitter (7), a compensation light source (3), a first image sensor (8), a second image sensor (9) and a processor (5),
the light splitting sheet (7) is arranged between the camera lens (1) and the processor (5), light passes through the light splitting sheet (7) to form a first light path and a second light path, the first image sensor (8) is arranged on the first light path, and the second image sensor (9) is arranged on the second light path; the output end of the first image sensor (8) and the output end of the second image sensor (9) are both connected with a processor (5);
the compensation light source (3) has an on-state and an off-state, which in the on-state provides compensation light for both the first image sensor (8) and the second image sensor (9);
the first image sensor (8) is used for acquiring a first image signal when the compensation light source (3) is in an open state;
the second image sensor (9) is used for acquiring a second image signal when the compensation light source (3) is in an off state; the acquisition angles of the first image sensor and the second image sensor are consistent;
and the processor (5) is used for carrying out CCD photosensitive charge number subtraction operation on the first image signal and the second image signal to obtain an image signal for removing ambient light interference.
5. An imaging assembly shielded from ambient light interference according to claim 4, characterized in that a filter (2) is arranged in front of the light entrance side of the camera lens (1).
6. The imaging assembly for shielding ambient light interference according to claim 4, wherein a filter (2) is disposed on the light path between the camera lens (1) and the beam splitter (7).
7. The imaging assembly of claim 4, characterized in that a first optical filter (10) is arranged on a first optical path between the beam splitter (7) and the first image sensor (8), and a second optical filter (11) is arranged on a second optical path between the beam splitter (7) and the second image sensor (9).
8. An imaging assembly according to any of claims 4 to 7, wherein the angle between the first and second optical paths is 90 degrees.
9. An ambient light interference shielded imaging assembly according to any of claims 1-7, further comprising a display assembly (6), wherein an output of the processor (5) is connected to an input of the display assembly (6).
10. The ambient light interference shielded imaging assembly of any of claims 1-7 wherein the difference in acquisition time of the first and second image signals is less than a preset time threshold.
11. An imaging assembly shielded from ambient light interference according to any of claims 1-7, characterized in that the compensating light source (3) is a laser or an LED.
12. An imaging assembly shielded from ambient light interference according to any of claims 1-7, characterized in that the processor (5) comprises a subtraction module and a data conversion module,
the subtraction module is used for performing subtraction of CCD photosensitive charge number on a first image signal and a second image signal acquired by the image sensor to obtain an image without ambient light interference and outputting an electric signal of the image without ambient light interference;
the data conversion module is used for converting the electric signals into a data format which can be displayed by the display component.
13. An image forming method for shielding ambient light interference, comprising the steps of:
s1, turning on a compensation light source, and collecting a first image signal by using an image sensor, wherein the first image signal comprises the CCD photosensitive charge number of each pixel position;
s2, turning off the compensation light source within a preset time threshold range, and collecting a second image signal by using the image sensor, wherein the second image signal comprises the CCD photosensitive charge number of each pixel position;
and S3, performing CCD photosensitive charge number subtraction on the first image signal in the S1 step and the second image signal in the S2 step to obtain an image signal without ambient light interference.
14. The ambient light interference shielded image imaging method according to claim 13, further comprising the steps of:
s4, converting the image signal without the ambient light interference in the step S3 into a data format which can be displayed by a display component.
15. The ambient light interference shielded image imaging method according to claim 13, wherein in step S1, a first image signal is acquired by a first image sensor; in step S2, a second image signal is acquired by a second image sensor, and the acquisition angles of the first image sensor and the second image sensor are the same.
16. The ambient light interference shielded image imaging method according to claim 13, wherein in steps S1 and S2, the first image signal and the second image signal are both acquired by the same image sensor.
17. The method for imaging an image with shielding effect on ambient light according to claim 13, wherein in step S3, the CCD photo-sensitive charge number at each pixel position in the first image signal is subtracted from the CCD photo-sensitive charge number at the corresponding pixel position in the second image signal to obtain a CCD photo-sensitive charge number difference value at the corresponding pixel position, and the image signal with shielding effect on ambient light is obtained according to the CCD photo-sensitive charge number difference value at the corresponding pixel position.
18. An image forming method for shielding ambient light interference, comprising the steps of:
s1, turning off a compensation light source, and collecting a first image signal by using an image sensor, wherein the first image signal comprises the CCD photosensitive charge number of each pixel position;
s2, turning on a compensation light source within a preset time threshold range, and collecting a second image signal by using an image sensor, wherein the second image signal comprises the CCD photosensitive charge number of each pixel position;
and S3, performing CCD photosensitive charge number subtraction on the first image signal in the S1 step and the second image signal in the S2 step to obtain an image signal without ambient light interference.
19. The ambient light interference shielded image imaging method according to claim 18, further comprising the steps of:
s4, converting the image signal without the ambient light interference in the step S3 into a data format which can be displayed by a display component.
20. The ambient light interference shielded image imaging method according to claim 18, wherein in step S1, a first image signal is acquired with a first image sensor; in step S2, a second image signal is acquired by a second image sensor, and the acquisition angles of the first image sensor and the second image sensor are the same.
21. The ambient light interference shielded image imaging method according to claim 18, wherein in steps S1 and S2, the first image signal and the second image signal are both acquired by the same image sensor.
22. The method for imaging an image with shielding effect on ambient light according to claim 18, wherein in step S3, the CCD photo-sensitive charge number at each pixel position in the second image signal is subtracted from the CCD photo-sensitive charge number at the corresponding pixel position in the first image signal to obtain a CCD photo-sensitive charge number difference value at the corresponding pixel position, and the image signal with shielding effect on ambient light is obtained according to the CCD photo-sensitive charge number difference value at the corresponding pixel position.
CN201910918496.3A 2019-09-26 2019-09-26 Imaging assembly for shielding ambient light interference and image imaging method Pending CN112560835A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201910918496.3A CN112560835A (en) 2019-09-26 2019-09-26 Imaging assembly for shielding ambient light interference and image imaging method
PCT/CN2019/121128 WO2021056801A1 (en) 2019-09-26 2019-11-27 Imaging component for blocking ambient light interference, and image imaging method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910918496.3A CN112560835A (en) 2019-09-26 2019-09-26 Imaging assembly for shielding ambient light interference and image imaging method

Publications (1)

Publication Number Publication Date
CN112560835A true CN112560835A (en) 2021-03-26

Family

ID=75029936

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910918496.3A Pending CN112560835A (en) 2019-09-26 2019-09-26 Imaging assembly for shielding ambient light interference and image imaging method

Country Status (2)

Country Link
CN (1) CN112560835A (en)
WO (1) WO2021056801A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113848639A (en) * 2021-09-09 2021-12-28 苏州浪潮智能科技有限公司 Quantum imaging method, system and related assembly

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4377013B2 (en) * 1999-11-18 2009-12-02 國寛 渡辺 Solid-state imaging device and solid-state imaging device
JP2006011671A (en) * 2004-06-24 2006-01-12 Alpine Electronics Inc Vehicle-mounted surrounding circumstance detection device
CN100576231C (en) * 2007-01-15 2009-12-30 中国科学院自动化研究所 Image collecting device and use the face identification system and the method for this device
CN105407300B (en) * 2014-09-10 2018-08-31 原相科技股份有限公司 Image sensor and its operation method
CN108289179A (en) * 2018-02-08 2018-07-17 深圳泰华安全技术工程有限公司 A method of improving video signal collection anti-interference ability

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113848639A (en) * 2021-09-09 2021-12-28 苏州浪潮智能科技有限公司 Quantum imaging method, system and related assembly

Also Published As

Publication number Publication date
WO2021056801A1 (en) 2021-04-01

Similar Documents

Publication Publication Date Title
CN210377502U (en) Imaging assembly for shielding ambient light interference
EP2813841B1 (en) X-ray inspection device and inspection method
CN110352346B (en) Method and apparatus for inspecting assets
CN104567726B (en) Vehicle operation troubles detecting system and method
WO2010016137A1 (en) Inspection system
JP2005127989A (en) Flaw detector and flaw detecting program
CA2820723A1 (en) A visible light and ir hybrid digital camera
CN109374636B (en) Pantograph image acquisition system, detection system and detection method
CN101458300B (en) Circuit discharging detecting system
CN107003116A (en) Image capture device component, 3 d shape measuring apparatus and motion detection apparatus
WO2016095490A1 (en) Vehicle operation fault detection system and method
WO2014159786A1 (en) Single die inspection on a dark field inspection tool
CN105185420B (en) The cooling moisture film coverage rate automatic detection device and method on nuclear power plant containment shell surface
CN102374997A (en) High-precision detection device of coin surface quality based on vision system
CN112560835A (en) Imaging assembly for shielding ambient light interference and image imaging method
CN107980094B (en) Visual detection system and method
JP2013024653A (en) Distance measuring apparatus and program
CN209821051U (en) Multispectral integrated detection device
Riza et al. Data efficient digital micromirror device-based image edge detection sensor using space-time processing
KR102421775B1 (en) Method for detecting damage and contamination of solar-light panel
CN108827594B (en) Analytical force detection method and detection system of structured light projector
CN107643289A (en) A kind of transparent material micro devices bonding quality detecting system
CN105300899A (en) Digital orientated acquisition device and method of poultry multispectral image
JP7442848B2 (en) Imaging device and method of controlling the imaging device
JPH08186808A (en) Method and device for processing image

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination