CN111397854A - Time delay measuring equipment and method for image fusion system - Google Patents
Time delay measuring equipment and method for image fusion system Download PDFInfo
- Publication number
- CN111397854A CN111397854A CN202010182437.7A CN202010182437A CN111397854A CN 111397854 A CN111397854 A CN 111397854A CN 202010182437 A CN202010182437 A CN 202010182437A CN 111397854 A CN111397854 A CN 111397854A
- Authority
- CN
- China
- Prior art keywords
- image
- chopper
- camera
- fusion system
- reference point
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01M—TESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
- G01M11/00—Testing of optical apparatus; Testing structures by optical methods not otherwise provided for
- G01M11/02—Testing optical properties
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01M—TESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
- G01M11/00—Testing of optical apparatus; Testing structures by optical methods not otherwise provided for
- G01M11/02—Testing optical properties
- G01M11/0285—Testing optical properties by measuring material or chromatic transmission properties
Abstract
The embodiment of the invention provides time delay measuring equipment and a time delay measuring method for an image fusion system, and belongs to the field of photoelectricity. The apparatus comprises: the system comprises a multiband light source, a chopper, a first camera, a second camera and a processor, wherein the first camera and the second camera are the same camera, two different reference points are arranged on the chopper, the two same cameras are controlled to shoot a chopper entity and the chopper displayed on an image fusion system at the same time, an included angle between a first connecting line between the two reference points on an image acquired by one camera and a second connecting line between the two reference points on a corresponding image acquired by the other camera at the same moment is calculated in the same coordinate system, and then the time delay of the image fusion system to be measured can be measured quickly and accurately according to the included angle and the rotating speed of the chopper.
Description
The application is a divisional application of Chinese patent application with application date of 04.06.2018 and application number of 201810565305.5, and the invention name of the invention is 'delay measuring equipment and method for an image fusion system'.
Technical Field
The invention relates to the field of photoelectricity, in particular to a time delay measuring device and method for an image fusion system.
Background
With the rapid development of various detector technologies such as visible light, infrared and the like, a video image processing system for a multi-source sensor comes, and an image fusion video processing system is one of important branches. The time delay of an image fusion processing video system is an important parameter which cannot be ignored in a real-time application environment. If the system is applied to a vehicle driving observation system, when an obstacle is found in front, the system delay is large, the reaction of avoiding of a driver is slowed down, and bad results are possibly caused when the vehicle runs at high speed; or when the helicopter airborne image fusion night vision system is used for observing the target, the driver cannot accurately judge the position of the target due to system delay.
Therefore, the time delay is also increasingly important as an important index affecting the function of the image fusion system, and for example, when the image fusion processing board is accepted, the time delay of the image fusion processing board is generally required to be measured to evaluate the performance of the image fusion processing board.
Disclosure of Invention
The embodiment of the invention aims to provide a time delay measuring device and a time delay measuring method for an image fusion system, which are used for realizing time delay measurement of the image fusion system.
In order to achieve the above object, an embodiment of the present invention provides a delay measuring device for an image fusion system, where the delay measuring device includes: the system comprises a multiband light source, a chopper, a first camera, a second camera and a processor, wherein the first camera and the second camera are the same camera, a first reference point and a second reference point different from the first reference point are arranged on a blade of the chopper, the chopper is used for modulating light output by the multiband light source to form modulated light, and the modulated light is incident to an image fusion system to be measured for fusion; after the image fusion system to be tested outputs a fusion image, the first camera is controlled to shoot the chopper to generate a first image set, and the second camera is controlled to shoot an image displayed by the image fusion system to be tested to generate a second image set, wherein the first camera and the second camera are controlled to start shooting at the same time; the processor is configured to: calculating an angle between a first line between the first reference point and the second reference point displayed in a specific image in the first image set and a second line between the first reference point and the second reference point displayed in an image corresponding to the specific image in the second image set in the same coordinate system; and calculating the time delay of the image fusion system to be detected according to the included angle and the rotating speed of the chopper.
Optionally, the first reference point or the second reference point is a center of rotation of a blade of the chopper.
Optionally, the processor is configured to select an image corresponding to the specific image from the second image set according to a file name of the specific image.
Optionally, the apparatus further comprises: and the collimator is arranged between the chopper and the image fusion system to be detected, and the modulated light is incident to the image fusion system to be detected through the collimator.
Optionally, the diameter of the blade of the chopper is equal to the target diameter of the collimator.
Optionally, the collimator is an off-axis reflective collimator.
Optionally, the apparatus further comprises: a signal generator for outputting a synchronization control signal for the first camera and the second camera.
Optionally, the apparatus further comprises: a rotational speed control device by which the processor drives the chopper to operate at a fixed rotational speed.
Optionally, the rotational speed control means comprises a stepper motor and a stepper motor driver.
Correspondingly, the embodiment of the invention also provides a time delay measuring method for the image fusion system, which comprises the following steps: modulating light output by a multiband light source by a chopper to form modulated light, wherein the modulated light is incident to an image fusion system to be measured for fusion, and a first reference point and a second reference point different from the first reference point are arranged on a blade of the chopper; after the image fusion system to be detected outputs a fusion image, controlling a first camera to shoot the chopper to generate a first image set, and controlling a second camera to shoot an image displayed by the image fusion system to be detected to generate a second image set, wherein the first camera and the second camera are controlled to start shooting at the same time; calculating an included angle between a first connecting line between a first reference point and a second reference point displayed in a specific image in the first image set and a second connecting line between the first reference point and the second reference point displayed in an image corresponding to the specific image in the second image set in the same coordinate system; and calculating the time delay of the image fusion system to be detected according to the included angle and the rotating speed of the chopper.
Correspondingly, an embodiment of the present invention further provides a delay measurement device for an image fusion system, where the device includes: the system comprises a multiband light source, a chopper and a processor, wherein a blade of the chopper is provided with a reference point, the reference point is any point except for the rotation center of the blade of the chopper, the chopper is used for modulating light output by the multiband light source to form modulated light, and the modulated light is incident to an image fusion system to be measured for fusion; after the fused image is output by the image fusion system to be tested, the processor is configured to: intercepting a frame of fused image from the fused image output by the image fusion system to be detected, wherein the light output by the multiband light source comprises infrared light and visible light, the fused image output by the image fusion system to be detected is formed by fusing a visible light image and an infrared image, and calculating an included angle between a first connecting line between the reference point displayed in the visible light image of the intercepted fused image and the displayed rotation center and a second connecting line between the reference point displayed in the infrared image of the intercepted fused image and the displayed rotation center; and calculating the time delay of the image fusion system to be detected according to the included angle and the rotating speed of the chopper.
Optionally, the apparatus further comprises: and the collimator is arranged between the chopper and the image fusion system to be detected, and the modulated light is incident to the image fusion system to be detected through the collimator.
Optionally, the diameter of the blade of the chopper is equal to the target diameter of the collimator.
Optionally, the collimator is an off-axis reflective collimator.
Optionally, the apparatus further comprises: a rotational speed control device by which the processor drives the chopper to operate at a fixed rotational speed.
Optionally, the rotational speed control means comprises a stepper motor and a stepper motor driver.
Correspondingly, the embodiment of the invention also provides a time delay measuring method for the image fusion system, which comprises the following steps: modulating light output by the multiband light source by a chopper to form modulated light, and enabling the modulated light to be incident to an image fusion system to be detected for fusion; after the fusion image is output by the image fusion system to be detected, intercepting a frame of fusion image from the fusion image output by the image fusion system to be detected, wherein the light output by the multiband light source comprises infrared light and visible light, and the fusion image output by the image fusion system to be detected is formed by fusing the visible light image and the infrared image; calculating an angle between a first line between a reference point displayed in the intercepted visible light image of the fused image and the displayed rotation center and a second line between the reference point displayed in the intercepted infrared image of the fused image and the displayed rotation center; and calculating the time delay of the image fusion system to be detected according to the included angle and the rotating speed of the chopper.
The technical scheme has the following advantages:
(1) setting two different reference points on the chopper, controlling two identical cameras to shoot a chopper entity and a chopper displayed on an image fusion system respectively and simultaneously, calculating an included angle between a first connecting line between the two reference points on an image acquired by one camera and a second connecting line between the two reference points on a corresponding image acquired by the other camera at the same moment in the same coordinate system, and then quickly and accurately measuring the time delay of the image fusion system to be measured according to the included angle and the rotating speed of the chopper.
(2) Selecting any point except the rotation center of the blade of the wave filter on the chopper as a reference point, intercepting a frame of fused image after the fused image is output by the image fusion system, calculating an included angle between a first connecting line between the reference point displayed in the visible light image of the intercepted fused image and the displayed rotation center and a second connecting line between the reference point displayed in the infrared image of the intercepted fused image and the displayed rotation center, and then quickly and accurately measuring the relative delay time of the infrared image and the visible light image processing of the image fusion system to be measured according to the included angle and the rotation speed of the chopper.
Additional features and advantages of embodiments of the invention will be set forth in the detailed description which follows.
Drawings
The accompanying drawings, which are included to provide a further understanding of the embodiments of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the embodiments of the invention without limiting the embodiments of the invention. In the drawings:
fig. 1 is a block diagram showing a configuration of a delay measuring apparatus for an image fusion system according to an embodiment of the present invention;
FIG. 2 is a block diagram of a delay measuring device for an image fusion system according to an embodiment of the present invention;
FIG. 3 shows a schematic diagram of a camera capturing an image;
FIG. 4 is a schematic diagram of a process for calculating the delay of the image fusion system under test by the processor;
FIG. 5 is a flow chart illustrating a delay measurement method for an image fusion system according to an embodiment;
FIG. 6 is a block diagram showing a delay measuring apparatus for an image fusion system according to another embodiment of the present invention; and
fig. 7 is a flowchart illustrating a delay measurement method for an image fusion system in another embodiment.
Detailed Description
The following detailed description of embodiments of the invention refers to the accompanying drawings. It should be understood that the detailed description and specific examples, while indicating embodiments of the invention, are given by way of illustration and explanation only, not limitation.
Fig. 1 is a block diagram illustrating a delay measuring apparatus for an image fusion system according to an embodiment of the present invention. As shown in fig. 1, the present invention provides a delay measuring apparatus for an image fusion system, which may include: a multiband light source 10, a chopper 20, a first camera 30, a second camera 50, and a processor 60, wherein the first camera 30 and the second camera 50 may be the same camera, for example, two high speed cameras of the same model. A first reference point and a second reference point different from the first reference point can be arranged on the blade of the chopper 20, the chopper 20 is used for modulating the light output by the multiband light source 10 to form modulated light, and the modulated light is incident to the image fusion system 40 to be measured for fusion; after the image fusion system 40 to be tested outputs the fused image, the first camera 30 is controlled to shoot the chopper 20 to generate a first image set, and the second camera 50 is controlled to shoot the image displayed by the image fusion system 40 to be tested to generate a second image set, wherein the first camera 30 and the second camera 50 are controlled to start shooting at the same time; the processor 60 is configured to: calculating an angle between a first line between the first reference point and the second reference point displayed in a specific image in the first image set and a second line between the first reference point and the second reference point displayed in an image corresponding to the specific image in the second image set in the same coordinate system; and calculating the time delay of the image fusion system 40 to be measured according to the included angle and the rotating speed of the chopper 20. The light emitted by the multi-band light source 10 can cause the image fusion system 40 to be tested to image the chopper 20. Wherein the specific image is an image in the first image set that simultaneously contains images of the first reference point and the second reference point.
And under the condition that the blades of the chopper uniformly rotate at a certain speed, the ratio of the included angle to the rotating speed of the chopper is the delay time of the image fusion system to be detected. Through the implementation mode, two different reference points are arranged on the chopper, two identical cameras are controlled to shoot a chopper entity and the chopper displayed on the image fusion system at the same time respectively, an included angle between a first connecting line between the two reference points on an image acquired by one camera and a second connecting line between the two reference points on a corresponding image acquired by the other camera at the same moment is calculated in the same coordinate system, and then the time delay of the image fusion system to be measured can be measured quickly and accurately according to the included angle and the rotating speed of the chopper.
Alternatively, a small hole may be provided in the blade of the chopper as a reference point. One of the first reference point and the second reference point may be a center of rotation of the chopper blade, and the other is an aperture provided in the blade.
The light emitted by the multiband light source (10) can comprise infrared light and visible light, the light source power of the multiband light source (10) can be 15W, the multiband light source (10) can be composed of a light strip L ED and a semiconductor refrigeration system, the semiconductor refrigeration system comprises a semiconductor refrigeration chip (TEC), a heat dissipation plate, a fan and a power supply, and the difference between the semiconductor refrigeration system and the ambient temperature is precisely controlled.
Fig. 2 is a block diagram illustrating a delay measuring apparatus for an image fusion system according to an embodiment of the present invention. As shown in fig. 2, the delay measuring device for an image fusion system provided by the present invention may further include: and a collimator 70, wherein the collimator 70 can be arranged between the chopper 20 and the image fusion system 40 to be tested, and the modulated light output by the chopper can be incident to the image fusion system 40 to be tested through the collimator. The collimator 70 can correct the modulated light modulated by the chopper 20 into parallel light, which is equivalent to that the visible light and the infrared light in the modulated light are equivalent to parallel light from infinity, and ensure the parallelism of the visible light beam and the infrared light beam to be absorbed by the visible light detector and the infrared detector in the image fusion system 40 to be detected.
The chopper 20 may be placed at the target of the collimator 70. The blade diameter of the chopper 20 may be designed to be equal to the target diameter dimension of the collimator 70, for example, the collimator target diameter dimension may be 90mm, and the blade diameter of the chopper 20 may be designed to be equal to 90 mm. The diameter of the small hole provided on the blade of the chopper 20 may be 8 mm. The image fusion system under test 40 can image the chopper via a collimator.
Optionally, the collimator 70 may be an off-axis reflective collimator, which can eliminate the interference of chromatic aberration on the imaging quality, so that the fusion registration of the visible light image and the infrared image is more accurate, each pixel of the fusion image is ensured to be aligned, and the fusion quality of the to-be-detected image fusion system is improved.
Further, the delay measuring device for an image fusion system provided by the present invention may further include: a rotational speed control device by which the processor can drive the chopper to operate at a fixed rotational speed. The rotational speed control means may comprise a stepper motor (which may be a bi-directional hybrid stepper motor, for example) and a stepper motor driver. The processor may be a PC, and the user may input the rotation speed on the display screen of the PC, and then the driver drives the motor to rotate the chopper at the rotation speed.
Fig. 3 shows a schematic view of a camera capturing an image. As shown in fig. 3, after the fused image starts to be output on the display screen 41 of the image fusion system 40 to be tested, the signal generator 80 may be controlled to output synchronous control signals for the first camera 30 and the second camera 50, respectively, so that there is a very small relative error between the images captured by the two cameras. The first camera 30 starts to photograph the entity of the chopper 20 in response to the received synchronization control signal and outputs an image resulting from the photographing to the processor 60, and the second camera 50 starts to photograph the chopper displayed on the display screen 41 of the image fusion system to be measured 40 at the same time in response to the received synchronization control signal and outputs an image resulting from the photographing to the processor 60.
Fig. 4 is a schematic flow chart illustrating a process of calculating the delay of the image fusion system to be measured by the processor. As shown in fig. 4, the processor may calculate the delay by performing the following process: image screening, image matching, image segmentation, feature extraction, time delay calculation and display and the like. In particular, the processor may filter out an image containing two reference points from a first set of images captured by the second camera to the first memory module. When two cameras with the same model start shooting at the same time, the file names and the file types of the images shot at the same time are consistent, based on the file names and the file types of the images stored in the first storage module, corresponding images which are consistent with the file names and the file types of the images stored in the first storage module can be screened out from the second image set shot by the second camera, and the images screened out from the second image set are stored in the second storage module. Pairing the images in the first storage module and the second storage module in pairs according to file names, then respectively carrying out image segmentation processing on the images after pairing in pairs so as to extract an area only containing a chopper, then carrying out processing such as graying, binaryzation and the like, detecting the shape of a reference point on the image, and solving the mass center of the reference point on the image. If one of the reference points is the rotation center of the chopper, the position of the center of the chopper circle in the image needs to be determined. And then in the same coordinate system, calculating the angle of an included angle between a first connecting line of two reference points in one image and a second connecting line of two reference points in the other image in the pair of images, and dividing the angle by the rotating speed of the chopper to obtain the delay time of the image fusion system to be detected. Alternatively, multiple pairs of images may be used to find multiple delay times, which are then averaged to determine a relatively accurate delay time. The processor may also display the calculated delay time via a display screen.
Fig. 5 shows a flow chart of a delay measurement method for an image fusion system. As shown in fig. 5, the present invention further provides a delay measuring method for an image fusion system, which may include: step S51, modulating light output by the multiband light source by a chopper to form modulated light, and enabling the modulated light to enter an image fusion system to be measured for fusion, wherein a first reference point and a second reference point different from the first reference point are arranged on a blade of the chopper; step S52, after the image fusion system to be detected outputs the fusion image, controlling a first camera to shoot the chopper to generate a first image set, and controlling a second camera to shoot the image displayed by the image fusion system to be detected to generate a second image set, wherein the first camera and the second camera are controlled to start shooting at the same time; step S53 of calculating, in the same coordinate system, an angle between a first line between a first reference point and a second reference point displayed in a specific image in the first image set and a second line between the first reference point and the second reference point displayed in an image corresponding to the specific image in the second image set; and step S54, calculating the time delay of the image fusion system to be measured according to the included angle and the rotating speed of the chopper. The method can quickly and accurately measure the time delay of the image fusion system to be measured.
The specific working principle and the benefits of the delay measurement method for the image fusion system provided by the embodiment of the invention are similar to those of the delay measurement device for the image fusion system, and are not repeated here.
Fig. 6 is a block diagram illustrating a delay measuring apparatus for an image fusion system according to an embodiment of the present invention. As shown in fig. 6, correspondingly, an embodiment of the present invention further provides a delay measuring device for an image fusion system, where the delay measuring device includes: the system comprises a multiband light source 10, a chopper 20 and a processor 60, wherein a reference point is arranged on a blade of the chopper 20, the reference point is any point except for the rotation center of the blade of the chopper 20, the chopper 20 is used for modulating light output by the multiband light source 10 to form modulated light, and the modulated light is incident to an image fusion system 40 to be measured for fusion; after the image fusion system under test 40 outputs the fused image, the processor 60 is configured to: intercepting a frame of fused image from the fused image output by the image fusion system 40 to be detected, wherein the light output by the multiband light source comprises infrared light and visible light, the fused image output by the image fusion system 40 to be detected is formed by fusing a visible light image and an infrared image, and calculating an included angle between a first connecting line between the reference point displayed in the visible light image of the intercepted fused image and the displayed rotation center and a second connecting line between the reference point displayed in the infrared image of the intercepted fused image and the displayed rotation center; and calculating the time delay of the image fusion system 40 to be measured according to the included angle and the rotating speed of the chopper.
The time delay of the image fusion system calculated in this embodiment refers to the synchronization degree of the image fusion system, and the synchronization degree of the image fusion system refers to the time difference between the time delays from the different band images (such as visible light and infrared images) received by the detector of the image fusion system to the time delay of the display screen of the image fusion system in the process of displaying the corresponding band images. Due to the fact that the delay time of the fusion processing of the visible image and the infrared image is different, the two images are displayed in a delayed mode, display is asynchronous, the phenomenon that the fused images are separated appears on a display screen, and therefore the synchronization degree of the image fusion system to be detected can be obtained by measuring the display delay between the visible image and the infrared image. The larger the synchronization degree is, the poorer the synchronization of the image output of different wave bands of the image fusion system is.
And under the condition that the blades of the chopper uniformly rotate at a certain speed, the ratio of the included angle to the rotating speed of the chopper is the delay time of the image fusion system to be detected. During specific measurement, a plurality of frames of images output by image fusion can be intercepted aiming at a certain rotating speed, the delay time is respectively calculated aiming at each frame of image, and then the average delay time of the plurality of frames of images is taken as the delay time of the image fusion system. Alternatively, a delay time may be calculated for each of a plurality of different rotational speeds, and then an average value of the calculated plurality of delay times is used as the delay time of the image fusion system.
In actual implementation, the processor 60 may be, for example, a PC, and may output a video signal (e.g., gigabit ethernet, USB, etc.) output by the image fusion system to the PC by using an image transmission device.
The processor may calculate the delay by: image screening, image segmentation, feature extraction, time delay calculation and display and the like. Specifically, the processor may convert the video signal output by the image fusion system to be tested into images frame by frame, and screen out the images containing the reference points from the converted images. Then, image segmentation processing is carried out on the screened image to extract an area only containing the chopper, and a first mass center of a reference point displayed on the infrared image, a second mass center of the reference point displayed on the visible light image and a third mass center of a chopper rotation center displayed on the image are detected. In the same coordinate system, an included angle between a first connecting line between the first centroid and the third centroid and a second connecting line between the second centroid and the third centroid is calculated according to coordinates of the three centroids. The time delay (i.e., the degree of synchronization) of the image fusion system to be measured can be obtained by dividing the included angle by the rotating speed of the chopper.
Further, the delay measuring device for an image fusion system provided by the embodiment of the present invention may further include: and a collimator, which may be disposed between the chopper 20 and the image fusion system 40 to be tested, through which the modulated light output by the chopper may be incident to the image fusion system 40 to be tested. The collimator can correct the modulated light modulated by the chopper 20 into parallel light, which is equivalent to that the visible light and the infrared light in the modulated light are equivalent to parallel light from infinity, and the parallelism of the visible light beam and the infrared light beam is ensured so as to be absorbed by the visible light detector and the infrared detector in the image fusion system 40 to be detected.
Further, the delay measuring device for an image fusion system provided by the present invention may further include: a rotational speed control device by which the processor can drive the chopper to operate at a fixed rotational speed. The rotational speed control means may comprise a stepper motor (which may be a bi-directional hybrid stepper motor, for example) and a stepper motor driver.
The specific working principle and parameter selection of the chopper, the collimator and the multiband light source are described in detail above, and will not be described herein again.
Fig. 7 is a flowchart illustrating a delay measurement method for an image fusion system in another embodiment. As shown in fig. 7, an embodiment of the present invention further provides a delay measurement method for an image fusion system, where the method includes the following steps: step S71, modulating light output by the multiband light source by a chopper to form modulated light, and enabling the modulated light to enter an image fusion system to be measured for fusion, wherein a blade of the chopper is provided with a reference point, and the reference point is any point except the rotation center of the blade of the chopper; step S72, after the fusion image is output by the image fusion system to be detected, intercepting a frame of fusion image from the fusion image output by the image fusion system to be detected, wherein the light output by the multiband light source comprises infrared light and visible light, and the fusion image output by the image fusion system to be detected is formed by fusing the visible light image and the infrared image; step S73 of calculating an angle between a first line between the reference point displayed in the intercepted visible light image of the fused image and the displayed rotation center and a second line between the reference point displayed in the intercepted infrared image of the fused image and the displayed rotation center; and step S74, calculating the time delay of the image fusion system to be measured according to the included angle and the rotating speed of the chopper.
The specific working principle and the benefits of the delay measurement method for the image fusion system provided by the embodiment of the invention are similar to those of the delay measurement device for the image fusion system, and are not repeated here.
According to the delay measurement device and method for the image fusion system, provided by the embodiment of the invention, through accurate synchronous control, the system delay can be measured with high precision while the fusion system outputs the fusion video image, the measured delay error is small, and the delay detection precision and the synchronous detection precision are not more than +/-1 ms, so that the measurement requirement of the image fusion system is met.
Although the embodiments of the present invention have been described in detail with reference to the accompanying drawings, the embodiments of the present invention are not limited to the details of the above embodiments, and various simple modifications can be made to the technical solutions of the embodiments of the present invention within the technical idea of the embodiments of the present invention, and the simple modifications all belong to the protection scope of the embodiments of the present invention.
It should be noted that the various features described in the above embodiments may be combined in any suitable manner without departing from the scope of the invention. In order to avoid unnecessary repetition, the embodiments of the present invention do not describe every possible combination.
Those skilled in the art will understand that all or part of the steps in the method according to the above embodiments may be implemented by a program, which is stored in a storage medium and includes several instructions to enable a single chip, a chip, or a processor (processor) to execute all or part of the steps in the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
In addition, any combination of various different implementation manners of the embodiments of the present invention is also possible, and the embodiments of the present invention should be considered as disclosed in the embodiments of the present invention as long as the combination does not depart from the spirit of the embodiments of the present invention.
Claims (10)
1. A delay measurement device for an image fusion system, the device comprising: the system comprises a multiband light source, a chopper, a first camera, a second camera and a processor, wherein the first camera and the second camera are the same camera, a first reference point and a second reference point different from the first reference point are arranged on a blade of the chopper,
the chopper is used for modulating light output by the multiband light source to form modulated light, and the modulated light is incident to the image fusion system to be measured for fusion;
after the image fusion system to be tested outputs a fusion image, the first camera is controlled to shoot the chopper to generate a first image set, and the second camera is controlled to shoot an image displayed by the image fusion system to be tested to generate a second image set, wherein the first camera and the second camera are controlled to start shooting at the same time;
the processor is configured to:
calculating an angle between a first line between the first reference point and the second reference point displayed in a specific image in the first image set and a second line between the first reference point and the second reference point displayed in an image corresponding to the specific image in the second image set in the same coordinate system; and
and calculating the time delay of the image fusion system to be detected according to the included angle and the rotating speed of the chopper.
2. The apparatus of claim 1, wherein the first or second reference point is a center of rotation of a blade of the chopper.
3. The device of claim 1, wherein the processor is configured to select an image from the second set of images that corresponds to the particular image based on a file name of the particular image.
4. The apparatus of claim 1, further comprising:
and the collimator is arranged between the chopper and the image fusion system to be detected, and the modulated light is incident to the image fusion system to be detected through the collimator.
5. The apparatus of claim 4 wherein the diameter of the blades of said chopper is equal to the target diameter of said collimator.
6. The apparatus of claim 4, wherein the collimator is an off-axis reflective collimator.
7. The apparatus of claim 1, further comprising:
a signal generator for outputting a synchronization control signal for the first camera and the second camera.
8. The apparatus of claim 1, further comprising:
a rotational speed control device by which the processor drives the chopper to operate at a fixed rotational speed.
9. The apparatus of claim 8, wherein the rotational speed control device comprises a stepper motor and a stepper motor driver.
10. A time delay measurement method for an image fusion system, the method comprising:
modulating light output by a multiband light source by a chopper to form modulated light, wherein the modulated light is incident to an image fusion system to be measured for fusion, and a first reference point and a second reference point different from the first reference point are arranged on a blade of the chopper;
after the image fusion system to be detected outputs a fusion image, controlling a first camera to shoot the chopper to generate a first image set, and controlling a second camera to shoot an image displayed by the image fusion system to be detected to generate a second image set, wherein the first camera and the second camera are controlled to start shooting at the same time;
calculating an angle between a first line between the first reference point and the second reference point displayed in a specific image in the first image set and a second line between the first reference point and the second reference point displayed in an image corresponding to the specific image in the second image set in the same coordinate system; and
and calculating the time delay of the image fusion system to be detected according to the included angle and the rotating speed of the chopper.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010182437.7A CN111397854A (en) | 2018-06-04 | 2018-06-04 | Time delay measuring equipment and method for image fusion system |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810565305.5A CN109060308B (en) | 2018-06-04 | 2018-06-04 | Time delay measuring equipment and method for image fusion system |
| CN202010182437.7A CN111397854A (en) | 2018-06-04 | 2018-06-04 | Time delay measuring equipment and method for image fusion system |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810565305.5A Division CN109060308B (en) | 2018-06-04 | 2018-06-04 | Time delay measuring equipment and method for image fusion system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111397854A true CN111397854A (en) | 2020-07-10 |
Family
ID=64820290
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810565305.5A Active CN109060308B (en) | 2018-06-04 | 2018-06-04 | Time delay measuring equipment and method for image fusion system |
| CN202010182437.7A Pending CN111397854A (en) | 2018-06-04 | 2018-06-04 | Time delay measuring equipment and method for image fusion system |
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810565305.5A Active CN109060308B (en) | 2018-06-04 | 2018-06-04 | Time delay measuring equipment and method for image fusion system |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN109060308B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112584132A (en) * | 2019-09-29 | 2021-03-30 | 深圳市光鉴科技有限公司 | Device and method for measuring delay time between cameras in different wave bands |
| CN114441137A (en) * | 2022-01-12 | 2022-05-06 | 上海宏景智驾信息科技有限公司 | Camera time delay measuring system and method |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2003153303A (en) * | 2001-11-12 | 2003-05-23 | Sony Corp | Apparatus and method for measuring optical axis of imaging camera |
| CN106644397A (en) * | 2016-12-16 | 2017-05-10 | 捷开通讯(深圳)有限公司 | VR device delay time detection device and method |
| CN107687932A (en) * | 2016-08-05 | 2018-02-13 | 成都理想境界科技有限公司 | The detection method and device of head-mounted display apparatus delay |
| CN107870080A (en) * | 2017-10-23 | 2018-04-03 | 北京理工大学 | Time delay measurement device and method for image fusion system |
| CN207248488U (en) * | 2017-10-18 | 2018-04-17 | 宁波神州泰岳锐智信息科技有限公司 | For testing the revolution speed control device of VR equipment delay |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6407805B1 (en) * | 2000-06-02 | 2002-06-18 | Agilent Technologies, Inc. | Time delay measurement using optical signals modulated at multiple frequencies |
| CN107169947B (en) * | 2017-04-26 | 2021-02-12 | 国网上海市电力公司 | Image fusion experimental method based on feature point positioning and edge detection |
| CN108053386B (en) * | 2017-11-27 | 2021-04-09 | 北京理工大学 | Method and device for image fusion |
-
2018
- 2018-06-04 CN CN201810565305.5A patent/CN109060308B/en active Active
- 2018-06-04 CN CN202010182437.7A patent/CN111397854A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2003153303A (en) * | 2001-11-12 | 2003-05-23 | Sony Corp | Apparatus and method for measuring optical axis of imaging camera |
| CN107687932A (en) * | 2016-08-05 | 2018-02-13 | 成都理想境界科技有限公司 | The detection method and device of head-mounted display apparatus delay |
| CN106644397A (en) * | 2016-12-16 | 2017-05-10 | 捷开通讯(深圳)有限公司 | VR device delay time detection device and method |
| CN207248488U (en) * | 2017-10-18 | 2018-04-17 | 宁波神州泰岳锐智信息科技有限公司 | For testing the revolution speed control device of VR equipment delay |
| CN107870080A (en) * | 2017-10-23 | 2018-04-03 | 北京理工大学 | Time delay measurement device and method for image fusion system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109060308A (en) | 2018-12-21 |
| CN109060308B (en) | 2020-01-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11145071B2 (en) | Image processing method, non-transitory computer-readable storage medium, and electronic apparatus | |
| CN104040427B (en) | For measuring the apparatus and method of video camera | |
| CN106657802B (en) | A kind of rotary-type multispectral camera automatic exposure regulating system and adjusting method | |
| US11196919B2 (en) | Image processing method, electronic apparatus, and computer-readable storage medium | |
| CN108020825A (en) | Laser radar, Laser video camera head, the fusion calibration system of video camera and method | |
| CN101813520B (en) | Two-dimensional spectrum measuring device | |
| CN106885622B (en) | A kind of big visual field multiple spot three-dimensional vibrating measurement method | |
| CN105717513B (en) | A kind of cost laser distance measuring method based on common camera chip | |
| CN109060308B (en) | Time delay measuring equipment and method for image fusion system | |
| CN111323125B (en) | Temperature measurement method and device, computer storage medium and electronic equipment | |
| US11538193B2 (en) | Methods and systems for calibrating a camera | |
| CN109444077B (en) | Quantitative measurement system and method for refractive index field based on phase calibration | |
| CN105928627B (en) | A kind of heteropical method of elimination refrigeration mode thermal imaging system picture reproduction | |
| CN108871587A (en) | The Intelligent target device and its application method of thermal infrared imager NETD test | |
| CN104111330A (en) | Up-conversion luminescence immunochromatography analyzer and detection method thereof | |
| CN107270867B (en) | Active ranging system and method | |
| CN109870453B (en) | Measuring device and system | |
| CN110095783A (en) | VR ranging information shows device and VR ranging mould group | |
| CN104236695A (en) | Dynamic system multi-physics field imaging detection system | |
| EP4242609A1 (en) | Temperature measurement method, apparatus, and system, storage medium, and program product | |
| Aruga et al. | Color contamination correction based on light intensity correlation in two-color, double-exposure particle tracking velocimetry | |
| CN115469115B (en) | Fluorescence detection method and device | |
| CN104198038B (en) | The brightness detection method of built-in light source | |
| CN219996348U (en) | Imaging type optical radiation measuring device | |
| US20230316572A1 (en) | Target for multispectral geometrical calibration |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200710 |
|
| RJ01 | Rejection of invention patent application after publication |