CN110166714A - Double light fusion methods of adjustment, double light fusion adjustment device and double light fusion devices - Google Patents
Double light fusion methods of adjustment, double light fusion adjustment device and double light fusion devices Download PDFInfo
- Publication number
- CN110166714A CN110166714A CN201910289836.0A CN201910289836A CN110166714A CN 110166714 A CN110166714 A CN 110166714A CN 201910289836 A CN201910289836 A CN 201910289836A CN 110166714 A CN110166714 A CN 110166714A
- Authority
- CN
- China
- Prior art keywords
- visible images
- infrared light
- light image
- light
- imaging unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
Abstract
The application is suitable for double light integration technology fields, provides a kind of double light fusion methods of adjustment, double light fusion adjustment device, double light fusion devices and computer readable storage medium, comprising: obtain the visible images and infrared light image of target object；The visible images and the infrared light image are subjected to central point overlapping fusion；Obtain position deviation of the corner object of reference in the visible images and the infrared light image；According to position deviation of the corner object of reference in the visible images and the infrared light image, the position of visual light imaging unit is adjusted.Can be in infrared imaging unit and visual light imaging unit there are when position deviation by the application, regulated efficiency is improved in the position of adjust automatically visual light imaging unit.
Description
Technical field
The application belongs to double light integration technology fields more particularly to a kind of double light fusion methods of adjustment, the fusion adjustment of double light
Device, double light fusion devices and computer readable storage medium.
Background technique
Infrared imaging abbreviation infrared thermal imaging is a kind of novel observation technology largely used in recent years, extensively
Applied to purposes such as electric power, fire-fighting, forest fire protection, search and rescue, medical treatment, high-end monitoring and defense military.Infrared thermal imaging is substantially former
Reason and visual light imaging are close, and main difference is that infrared thermal imaging carries out photosensitive imaging to infrared band.
It is limited to the material precision of current graphic images sensor, difficulty of processing, manufacture difficulty etc., current infrared heat
Imaging and common visual light imaging Technical comparing, it is independent in practical application there are the problems such as at high cost, image resolution ratio is lower
The problems such as image on human eye subjective consciousness is fuzzy, details resolution is unclear is easily caused using the image of low resolution, is influenced
User experience.Based on this problem, industry proposes that (referred to as double light melt using visible light and the technology of infrared imaging fusion at present
Close), enhance infrared effect using the details of visible light, infrared image details and visualization can be improved.Due to infrared light
There are position deviations when imaging unit and visual light imaging unit are installed, in order to realize that double light fusions need to adjust some imaging
The position of unit, it is ensured that visible light is consistent with the coincidence of the infrared imaging visual field.The prior art is fixed using manually adjusting position
Screw, it is time-consuming and laborious, need to put into a large amount of time and human resources.
Summary of the invention
In view of this, the embodiment of the present application provides a kind of double light fusion method of adjustment, double light fusion adjustment device, double light
Fusion device and computer readable storage medium, in infrared imaging unit and visual light imaging unit, there are position deviations
When, regulated efficiency is improved in the position of adjust automatically visual light imaging unit.
The first aspect of the embodiment of the present application provides a kind of double light fusion methods of adjustment, and double light merge method of adjustment
Include:
Obtain the visible images and infrared light image of target object；
The visible images and the infrared light image are subjected to central point overlapping fusion；
Obtain position deviation of the corner object of reference in the visible images and the infrared light image；
According to position deviation of the corner object of reference in the visible images and the infrared light image, adjustment can
The position of light-exposed imaging unit.
The second aspect of the embodiment of the present application provides a kind of double light fusion adjustment devices, double light fusion adjustment devices
Include:
Image collection module, for obtaining the visible images and infrared light image of target object；
Center Fusion module, for the visible images and the infrared light image to be carried out central point overlapping fusion；
Deviation obtains module, for obtaining position of the corner object of reference in the visible images and the infrared light image
Set deviation；
Position adjusting type modules are used for according to the corner object of reference in the visible images and the infrared light image
Position deviation, adjust visual light imaging unit position.
The third aspect of the embodiment of the present application provides a kind of double light fusion devices, including memory, processor and deposits
The computer program that can be run in the memory and on the processor is stored up, the processor executes the computer journey
The step of double light fusion methods of adjustment as described in above-mentioned first aspect are realized when sequence.
The fourth aspect of the embodiment of the present application provides a kind of computer readable storage medium, the computer-readable storage
Media storage has computer program, realizes that double light melt as described in above-mentioned first aspect when the computer program is executed by processor
The step of closing method of adjustment.
The 5th aspect of the application provides a kind of computer program product, and the computer program product includes computer
Program realizes double light fusion adjustment as described in above-mentioned first aspect when the computer program is executed by one or more processors
The step of method.
Therefore application scheme obtains the visible images and infrared light image of target object respectively, first it will be seen that
Light image and infrared light image carry out central point overlapping fusion, then obtain corner object of reference in visible images and infrared light image
In position deviation, according to the position deviation can with the position of adjust automatically visual light imaging unit, without manually adjusting, thus
It realizes while ensuring that visible light is consistent with the coincidence of the infrared imaging visual field, improves the regulated efficiency of visual light imaging unit.
Detailed description of the invention
It in order to more clearly explain the technical solutions in the embodiments of the present application, below will be to embodiment or description of the prior art
Needed in attached drawing be briefly described, it should be apparent that, the accompanying drawings in the following description is only some of the application
Embodiment for those of ordinary skill in the art without any creative labor, can also be according to these
Attached drawing obtains other attached drawings.
Fig. 1 is the implementation process schematic diagram for double light fusion method of adjustment that the embodiment of the present application one provides；
Fig. 2 is the optical axis of the visual light imaging unit exemplary diagram parallel with the optical axis of infrared imaging unit；
Fig. 3 is that there are the exemplary diagrams of position deviation in visible images and infrared light image for corner object of reference；
Fig. 4 a is the exemplary diagram that center is aligned that latter two corner object of reference is misaligned；Fig. 4 b is a corner reference in Fig. 4 a
The exemplary diagram of object horizontal direction position deviation in both images and vertical direction position deviation；
Fig. 5 is the implementation process schematic diagram for double light fusion method of adjustment that the embodiment of the present application two provides；
Fig. 6 is the exemplary diagram of driving device；
Fig. 7 is the exemplary diagram of position locking mechanism；
Fig. 8 is the schematic diagram for double light fusion adjustment device that the embodiment of the present application three provides；
Fig. 9 is the schematic diagram for double light fusion devices that the embodiment of the present application four provides.
Specific embodiment
In being described below, for illustration and not for limitation, the tool of such as particular system structure, technology etc is proposed
Body details, so as to provide a thorough understanding of the present application embodiment.However, it will be clear to one skilled in the art that there is no these specific
The application also may be implemented in the other embodiments of details.In other situations, it omits to well-known system, device, electricity
The detailed description of road and method, so as not to obscure the description of the present application with unnecessary details.
It should be appreciated that ought use in this specification and in the appended claims, term " includes " instruction is described special
Sign, entirety, step, operation, the presence of element and/or component, but be not precluded one or more of the other feature, entirety, step,
Operation, the presence or addition of element, component and/or its set.
It should be understood that the size of the serial number of each step is not meant that the order of the execution order in the present embodiment, each process
Execution sequence should be determined by its function and internal logic, and the implementation process without coping with the embodiment of the present application constitutes any restriction.
In order to illustrate technical solution described herein, the following is a description of specific embodiments.
It is the implementation process schematic diagram for double light fusion method of adjustment that the embodiment of the present application one provides, as schemed institute referring to Fig. 1
Show that double light fusion methods of adjustment may comprise steps of:
Step S101 obtains the visible images and infrared light image of target object.
In the embodiment of the present application, double light fusion devices include visual light imaging unit and infrared imaging unit, double light
Fusion device can obtain the visible images of target object by visual light imaging unit, be obtained by infrared imaging unit
The infrared light image of target object.
The visible images and the infrared light image are carried out central point overlapping fusion by step S102.
It in the embodiment of the present application, can be by adjusting the direction of double light fusion devices when installing double light fusion devices
With the parameters such as tilt angle so that center object of reference and corner object of reference for calibration can complete visible images and
It is imaged in infrared light image, and center object of reference is overlapped with the central point of infrared light image.Wherein, center object of reference and corner ginseng
The correction of double light fusions is used for according to object, be generally selected in infrared imaging and visual light imaging be easy photosensitive component (such as
Target object heat producing light sources in the scene) centered on object of reference and corner object of reference.Optionally, user can be according to reality
Border needs the voluntarily position of selected corners object of reference and quantity, for example, the quantity of selected corners object of reference is four, by object
Body is located at the heat producing light sources at four angles of coverage as edge object of reference in the scene.
Optionally, center object of reference is overlapped with the central point of the infrared light image, by the visible images and institute
After stating infrared light image progress central point overlapping fusion, the embodiment of the present application further include:
The center object of reference is detected in the visible images and the infrared light image with the presence or absence of position deviation；
If the center object of reference is in the visible images and the infrared light image, there are position deviation, bases
Position deviation of the center object of reference in the visible images and the infrared light image, adjusts the visual light imaging
The position of unit.
In the embodiment of the present application, the center position of visible images and the center point of infrared light image are obtained respectively
It sets, central point overlapping fusion is carried out according to the center position of visible images and the center position of infrared light image, can
When the optical axis of light-exposed imaging unit and the not parallel optical axis of infrared imaging unit, overlapping fusion rear center's object of reference is in visible light
Usually there is deviation in the position in image and the position in infrared light image, at this time can be according to center object of reference in visible light
Position deviation in image and infrared light image adjusts position or the movement visible images of visual light imaging unit, thus
So that position of the center object of reference in visible images and infrared light image is overlapped.
Step S103 obtains position deviation of the corner object of reference in the visible images and the infrared light image.
In the embodiment of the present application, after it will be seen that light image and infrared light image carry out central point overlapping fusion, and
When position deviation is not present in center object of reference in visible images and infrared light image, corner object of reference is detected in visible light figure
It whether there is position deviation in picture and infrared light image, when there are positions in visible images and infrared light image for corner object of reference
When setting deviation, then determine that the optical axis of the optical axis and infrared imaging unit of visual light imaging unit is not parallel, it is available at this time
Position deviation of the corner object of reference in visible images and infrared light image adjusts visual light imaging list according to the position deviation
The position of member, so that the optical axis of visual light imaging unit adjusted is parallel with the optical axis of infrared imaging unit.As shown in Figure 2
It is the optical axis of the visual light imaging unit exemplary diagram parallel with the optical axis of infrared imaging unit.Fig. 3 is corner object of reference can
It is due to visual light imaging unit and infrared imaging list there are the exemplary diagram of position deviation in light-exposed image and infrared light image
Caused by first mounting surface is not parallel.
Optionally, the position deviation for obtaining corner object of reference in the visible images and the infrared light image
Include:
It is inclined to obtain horizontal direction pixel of the corner object of reference in the visible images and the infrared light image
Poor number and vertical direction pixel deviation number；
It is inclined according to horizontal direction pixel of the corner object of reference in the visible images and the infrared light image
The pixel size of poor number and the visual light imaging unit obtains the corner object of reference in visible images and described
Horizontal direction position deviation in infrared light image；
It is inclined according to vertical direction pixel of the corner object of reference in the visible images and the infrared light image
The pixel size of poor number and the visual light imaging unit obtains the corner object of reference in visible images and described
Vertical direction position deviation in infrared light image.
In the embodiment of the present application, it is seen that light image is obtained by visual light imaging unit (such as imaging sensor),
According to the number of pixel on the target surface size of visual light imaging unit and the target surface, visual light imaging unit can be calculated
Pixel size (i.e. the size of each pixel on target surface).Wherein, it is seen that the target surface size of light imaging unit includes but is not limited to 1/3
Inch, 1/2 inch, 1 inch etc..
Horizontal direction pixel deviations number of the corner object of reference in visible images and infrared light image and visible light at
As the product of the pixel size of unit is that horizontal direction position of the corner object of reference in visible images and infrared light image is inclined
Difference；Vertical direction pixel deviation number of the corner object of reference in visible images and infrared light image and visual light imaging unit
Pixel size product be vertical direction position deviation of the corner object of reference in visible images and infrared light image.
Step S104, it is inclined according to position of the corner object of reference in the visible images and the infrared light image
Difference adjusts the position of visual light imaging unit.
In the embodiment of the present application, by adjusting the position of visual light imaging unit, visual light imaging unit can be made
Optical axis it is parallel with the optical axis of infrared imaging unit, complete the adjust automatically of double light fusions.
Optionally, the position according to the corner object of reference in the visible images and the infrared light image
Deviation adjusts the position of visual light imaging unit:
The target object is obtained at a distance from double light fusion devices；
According to the target object at a distance from double light fusion devices and the corner object of reference is described visible
Horizontal direction position deviation in light image and the infrared light image obtains the corner object of reference in the visible images
With the horizontal direction misalignment angle in the infrared light image；
According to the target object at a distance from double light fusion devices and the corner object of reference is described visible
Vertical direction position deviation in light image and the infrared light image obtains the corner object of reference in the visible images
With the vertical direction misalignment angle in the infrared light image；
According to the horizontal direction angle of deviation of the corner object of reference in the visible images and the infrared light image
Degree, adjusts the position of the visual light imaging unit.
In the embodiment of the present application, according to formula α=arctan (a/L), wherein α indicates corner object of reference in visible light
Horizontal direction misalignment angle in image and infrared light image, a indicate corner object of reference in visible images and infrared light image
In horizontal direction position deviation, L indicate target object at a distance from pair light fusion devices；According to formula β=arctan (b/
L), wherein β indicates vertical direction misalignment angle of the corner object of reference in visible images and infrared light image, and b indicates corner
Vertical direction position deviation of the object of reference in visible images and infrared light image, L indicate that target object is merged with double light and set
Standby distance.It is the exemplary diagram that center is aligned that latter two corner object of reference is misaligned as shown in fig. 4 a, Fig. 4 b is one in Fig. 4 a
The exemplary diagram of corner object of reference horizontal direction position deviation in both images and vertical direction position deviation.
The embodiment of the present application obtains the visible images and infrared light image of target object respectively, first it will be seen that light image and
Infrared light image carries out central point overlapping fusion, then obtains position of the corner object of reference in visible images and infrared light image
Deviation, can be with the position of adjust automatically visual light imaging unit, without manually adjusting, to realize true according to the position deviation
While guarantor's visible light is consistent with the coincidence of the infrared imaging visual field, the regulated efficiency of visual light imaging unit is improved.
It is the implementation process schematic diagram for double light fusion method of adjustment that the embodiment of the present application two provides, as schemed institute referring to Fig. 5
Show that double light fusion methods of adjustment may comprise steps of:
Step S501 obtains the visible images and infrared light image of target object.
The step is identical as step S101, and for details, reference can be made to the associated descriptions of step S101, and details are not described herein.
The visible images and the infrared light image are carried out central point overlapping fusion by step S502.
The step is identical as step S102, and for details, reference can be made to the associated descriptions of step S102, and details are not described herein.
Step S503 obtains position deviation of the corner object of reference in the visible images and the infrared light image.
The step is identical as step S103, and for details, reference can be made to the associated descriptions of step S103, and details are not described herein.
Step S504, it is inclined according to position of the corner object of reference in the visible images and the infrared light image
Difference adjusts the position of visual light imaging unit by driving device.
In the embodiment of the present application, the driving device is responsible for adjusting visual light imaging unit visual field scope, the drive
Dynamic device can be three-dimensional motor, including but not limited to three motors, and the distribution of three motors is distributed similar to 120 ° of angles,
By adjusting three motor respective positions, the position adjustment to visual light imaging unit all directions may be implemented, such as Fig. 6 institute
Show be driving device exemplary diagram, the visible light position adjustment unit in Fig. 6 is driving device, for the level side in Fig. 4 b
It can be optimized by motor Z to misalignment angle α (i.e. control motor Z designated movement α angle), vertical direction misalignment angle β can be with
By motor X optimization (i.e. control motor designated movement β angle), the motor control drive in Fig. 6 is responsible for visual light imaging
The control of unit and driving device, the drive fed back during receiving the position for adjusting visual light imaging unit by driving device
The current location information of dynamic device, realizes the precise flange to driving device.
It should be noted that during adjusting the position of visual light imaging unit by driving device, it can be real-time
The current location information for obtaining driving device, detects whether the current location information changes, if not changing, terminates
Double light fusion adjustment；If changing, whether the position for detecting driving device is adjusted to maximum；If being adjusted to maximum,
Then terminate double light fusion adjustment；If not being adjusted to maximum, detect whether corner fusion is completed, if being completed, terminates double
Light fusion adjustment；If not completing, return step S503, continue double light fusion adjustment.
Optionally, after the position for adjusting the visual light imaging unit by driving device, the embodiment of the present application is also
Include:
The position of the driving device is locked by position locking mechanism.
In the embodiment of the present application, after the completion of double light fusion device adjust automaticallies, related adjustment structure can be locked, is kept away
Exempt from the later period is changed using the position of middle visual light imaging unit.It is the exemplary diagram of position locking mechanism as shown in Figure 7, specifically
Realization, which can be, realizes the phase line of three-dimensional motor by relay, and relay controls whether phase line is connected by hardware port,
Relay power is disconnected on hardware after the completion of adjusting, the phase line short circuit of three-dimensional motor is together；It needs to adjust again when the later period
When, relay power is connected, user can calibrate again.Wherein, relay is generally single-pole double throw, and three-dimensional motor phase line succeeds electricity
Device common end, default relay are failure to actuate, and three-dimensional motor phase line is connected to the phase line of motor control drive, and three-dimensional motor is normal
Operating；When needing locked, the actuating of relay, three-dimensional motor phase line is switched to the other end of relay, and relay is another at this time
Three-dimensional motor phase line has been shorted by one end in advance；When the later period needing to adjust three-dimensional motor again, relay is switched back to again
Origin is connected with the phase line of motor control drive.Motor driven phase line in Fig. 7 refers to the phase of motor control drive
Line.
Optionally, the position for adjusting the visual light imaging unit by driving device includes:
Pass through the revolving speed and position rate of driving device described in deceleration institutional adjustment；
According to the revolving speed and position rate of the driving device adjusted, the position of the visual light imaging unit is adjusted
It sets.
In the embodiment of the present application, deceleration mechanism can be connected in the output end of driving device, it can by the deceleration mechanism
To realize with the position of lower revolving speed and position rate adjustment visual light imaging unit.
The embodiment of the present application is in position deviation of the corner object of reference in visible images and infrared light image, according to this
Position deviation can be by the position of driving device adjust automatically visual light imaging unit, without manually adjusting, to realize
While ensuring that visible light is consistent with the coincidence of the infrared imaging visual field, the regulated efficiency of visual light imaging unit is improved.
It is the schematic diagram for double light fusion adjustment device that the embodiment of the present application three provides referring to Fig. 8, for ease of description,
Illustrate only part relevant to the embodiment of the present application.
Double light fusions adjust device and include:
Image collection module 81, for obtaining the visible images and infrared light image of target object；
Center Fusion module 82 is melted for the visible images and the infrared light image to be carried out central point overlapping
It closes；
Deviation obtains module 83, for obtaining corner object of reference in the visible images and the infrared light image
Position deviation；
Position adjusting type modules 84 are used for according to the corner object of reference in the visible images and the infrared light image
In position deviation, adjust visual light imaging unit position.
Optionally, center object of reference is overlapped with the central point of the infrared light image, and double light fusion adjustment devices are also
Include:
Separate-blas estimation module 85, for detecting the center object of reference in the visible images and the infrared light image
In whether there is position deviation；
Position processing module 86, if for the center object of reference in the visible images and the infrared light image
There are position deviations, then inclined according to position of the center object of reference in the visible images and the infrared light image
Difference adjusts the position of the visual light imaging unit.
Optionally, the deviation acquisition module 83 includes:
Number acquiring unit, for obtaining the corner object of reference in the visible images and the infrared light image
Horizontal direction pixel deviations number and vertical direction pixel deviation number；
Position acquisition unit is used for according to the corner object of reference in the visible images and the infrared light image
Horizontal direction pixel deviations number and the visual light imaging unit pixel size, obtain the corner object of reference described
Horizontal direction position deviation in visible images and the infrared light image；
Deviation acquiring unit is used for according to the corner object of reference in the visible images and the infrared light image
Vertical direction pixel deviation number and the visual light imaging unit pixel size, obtain the corner object of reference described
Vertical direction position deviation in visible images and the infrared light image.
Optionally, the position adjusting type modules 84 include:
Distance acquiring unit, for obtaining the target object at a distance from double light fusion devices；
First angle acquiring unit, at a distance from double light fusion devices and described according to the target object
Horizontal direction position deviation of the corner object of reference in the visible images and the infrared light image obtains the corner ginseng
According to horizontal direction misalignment angle of the object in the visible images and the infrared light image；
Second angle acquiring unit, at a distance from double light fusion devices and described according to the target object
Vertical direction position deviation of the corner object of reference in the visible images and the infrared light image obtains the corner ginseng
According to vertical direction misalignment angle of the object in the visible images and the infrared light image；
Adjustment unit, for the water according to the corner object of reference in the visible images and the infrared light image
Square to misalignment angle, the position of the visual light imaging unit is adjusted.
Optionally, the position adjusting type modules 84 are specifically used for:
The position of the visual light imaging unit is adjusted by driving device.
Optionally, double light fusion adjustment devices further include:
Position locks module 87, for locking the position of the driving device by position locking mechanism.
Optionally, the position adjusting type modules 84 are specifically used for:
Pass through the revolving speed and position rate of driving device described in deceleration institutional adjustment；
According to the revolving speed and position rate of the driving device adjusted, the position of the visual light imaging unit is adjusted
It sets.
Double light fusion adjustment devices provided by the embodiments of the present application can be applied in preceding method embodiment one and embodiment
In two, details are referring to the description of above method embodiment one and embodiment two, and details are not described herein.
Fig. 9 is the schematic diagram for double light fusion devices that the embodiment of the present application four provides.As shown in figure 9, the embodiment is double
Light fusion device 9 includes: processor 90, memory 91 and is stored in the memory 91 and can be on the processor 90
The computer program 92 of operation.The processor 90 realizes above-mentioned each double light fusion adjustment when executing the computer program 92
Step in embodiment of the method, such as step S101 to S103 shown in FIG. 1.Alternatively, the processor 90 executes the calculating
The function of each module/unit in above-mentioned each Installation practice, such as the function of module 81 to 87 shown in Fig. 8 are realized when machine program 92
Energy.
Illustratively, the computer program 92 can be divided into one or more module/units, it is one or
Multiple module/units are stored in the memory 91, and are executed by the processor 90, to complete the application.Described one
A or multiple module/units can be the series of computation machine program instruction section that can complete specific function, which is used for
Implementation procedure of the computer program 92 in double light fusion devices 9 is described.For example, the computer program 92 can be with
It is divided into image collection module, Center Fusion module, deviation and obtains module, position adjusting type modules, separate-blas estimation module, position
Processing module and position lock module, and each module concrete function is as follows:
Image collection module, for obtaining the visible images and infrared light image of target object；
Center Fusion module, for the visible images and the infrared light image to be carried out central point overlapping fusion；
Deviation obtains module, for obtaining position of the corner object of reference in the visible images and the infrared light image
Set deviation；
Position adjusting type modules are used for according to the corner object of reference in the visible images and the infrared light image
Position deviation, adjust visual light imaging unit position.
Optionally, center object of reference is overlapped with the central point of the infrared light image；
Separate-blas estimation module, for detecting the center object of reference in the visible images and the infrared light image
With the presence or absence of position deviation；
Position processing module, if being deposited in the visible images and the infrared light image for the center object of reference
In position deviation, then the position deviation according to the center object of reference in the visible images and the infrared light image,
Adjust the position of the visual light imaging unit.
Optionally, the deviation acquisition module includes:
Number acquiring unit, for obtaining the corner object of reference in the visible images and the infrared light image
Horizontal direction pixel deviations number and vertical direction pixel deviation number；
Position acquisition unit is used for according to the corner object of reference in the visible images and the infrared light image
Horizontal direction pixel deviations number and the visual light imaging unit pixel size, obtain the corner object of reference described
Horizontal direction position deviation in visible images and the infrared light image；
Deviation acquiring unit is used for according to the corner object of reference in the visible images and the infrared light image
Vertical direction pixel deviation number and the visual light imaging unit pixel size, obtain the corner object of reference described
Vertical direction position deviation in visible images and the infrared light image.
Optionally, the position adjusting type modules include:
Distance acquiring unit, for obtaining the target object at a distance from double light fusion devices；
First angle acquiring unit, at a distance from double light fusion devices and described according to the target object
Horizontal direction position deviation of the corner object of reference in the visible images and the infrared light image obtains the corner ginseng
According to horizontal direction misalignment angle of the object in the visible images and the infrared light image；
Second angle acquiring unit, at a distance from double light fusion devices and described according to the target object
Vertical direction position deviation of the corner object of reference in the visible images and the infrared light image obtains the corner ginseng
According to vertical direction misalignment angle of the object in the visible images and the infrared light image；
Adjustment unit, for the water according to the corner object of reference in the visible images and the infrared light image
Square to misalignment angle, the position of the visual light imaging unit is adjusted.
Optionally, the position adjusting type modules are specifically used for:
The position of the visual light imaging unit is adjusted by driving device.
Optionally, position locks module, for locking the position of the driving device by position locking mechanism.
Optionally, the position adjusting type modules are specifically used for:
Pass through the revolving speed and position rate of driving device described in deceleration institutional adjustment；
According to the revolving speed and position rate of the driving device adjusted, the position of the visual light imaging unit is adjusted
It sets.
Double light fusion devices 9 can be compatible video camera, monitoring head, explosion-proof video camera etc..Double light fusions
Equipment may include, but be not limited only to, processor 90, memory 91.It will be understood by those skilled in the art that Fig. 9 is only double light
The example of fusion device 9 does not constitute the restriction to double light fusion devices 9, may include components more more or fewer than diagram,
Perhaps certain components or different components are combined, such as double light fusion devices can also include input-output equipment, net
Network access device, bus etc..
Alleged processor 90 can be central processing unit (Central Processing Unit, CPU), can also be
Other general processors, digital signal processor (Digital Signal Processor, DSP), specific integrated circuit
(Application Specific Integrated Circuit, ASIC), ready-made programmable gate array (Field-
Programmable Gate Array, FPGA) either other programmable logic device, discrete gate or transistor logic,
Discrete hardware components etc..General processor can be microprocessor or the processor is also possible to any conventional processor
Deng.
The memory 91 can be the internal storage unit of double light fusion devices 9, such as double light fusion devices 9
Hard disk or memory.The memory 91 is also possible to the External memory equipment of double light fusion devices 9, such as double light melt
Close the plug-in type hard disk being equipped in equipment 9, intelligent memory card (Smart Media Card, SMC), secure digital (Secure
Digital, SD) card, flash card (Flash Card) etc..Further, the memory 91 can also both include double light
The internal storage unit of fusion device 9 also includes External memory equipment.The memory 91 is for storing the computer program
And other programs and data needed for double light fusion devices.The memory 91 can be also used for temporarily storing
Output or the data that will be exported.
It is apparent to those skilled in the art that for convenience of description and succinctly, only with above-mentioned each function
Can unit, module division progress for example, in practical application, can according to need and by above-mentioned function distribution by different
Functional unit, module are completed, i.e., the internal structure of described device is divided into different functional unit or module, more than completing
The all or part of function of description.Each functional unit in embodiment, module can integrate in one processing unit, can also
To be that each unit physically exists alone, can also be integrated in one unit with two or more units, it is above-mentioned integrated
Unit both can take the form of hardware realization, can also realize in the form of software functional units.In addition, each function list
Member, the specific name of module are also only for convenience of distinguishing each other, the protection scope being not intended to limit this application.Above system
The specific work process of middle unit, module, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, is not described in detail or remembers in some embodiment
The part of load may refer to the associated description of other embodiments.
Those of ordinary skill in the art may be aware that list described in conjunction with the examples disclosed in the embodiments of the present disclosure
Member and algorithm steps can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually
It is implemented in hardware or software, the specific application and design constraint depending on technical solution.Professional technician
Each specific application can be used different methods to achieve the described function, but this realization is it is not considered that exceed
Scope of the present application.
In embodiment provided herein, it should be understood that disclosed device/bis- light fusion device and method,
It may be implemented in other ways.For example, device described above/terminal device embodiment is only schematical, example
Such as, the division of the module or unit, only a kind of logical function partition, can there is other division side in actual implementation
Formula, such as multiple units or components can be combined or can be integrated into another system, or some features can be ignored, or not
It executes.Another point, shown or discussed mutual coupling or direct-coupling or communication connection can be to be connect by some
Mouthful, the INDIRECT COUPLING or communication connection of device or unit can be electrical property, mechanical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit
The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple
In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme
's.
It, can also be in addition, each functional unit in each embodiment of the application can integrate in one processing unit
It is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated list
Member both can take the form of hardware realization, can also realize in the form of software functional units.
If the integrated module/unit be realized in the form of SFU software functional unit and as independent product sale or
In use, can store in a computer readable storage medium.Based on this understanding, the application realizes above-mentioned implementation
All or part of the process in example method, can also instruct relevant hardware to complete, the meter by computer program
Calculation machine program can be stored in a computer readable storage medium, the computer program when being executed by processor, it can be achieved that on
The step of stating each embodiment of the method.Wherein, the computer program includes computer program code, the computer program generation
Code can be source code form, object identification code form, executable file or certain intermediate forms etc..The computer-readable medium
It may include: any entity or device, recording medium, USB flash disk, mobile hard disk, magnetic that can carry the computer program code
Dish, CD, computer storage, read-only memory (ROM, Read-Only Memory), random access memory (RAM,
Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium etc..It should be noted that described
The content that computer-readable medium includes can carry out increasing appropriate according to the requirement made laws in jurisdiction with patent practice
Subtract, such as does not include electric carrier signal and electricity according to legislation and patent practice, computer-readable medium in certain jurisdictions
Believe signal.
Embodiment described above is only to illustrate the technical solution of the application, rather than its limitations；Although referring to aforementioned reality
Example is applied the application is described in detail, those skilled in the art should understand that: it still can be to aforementioned each
Technical solution documented by embodiment is modified or equivalent replacement of some of the technical features；And these are modified
Or replacement, the spirit and scope of each embodiment technical solution of the application that it does not separate the essence of the corresponding technical solution should all
Comprising within the scope of protection of this application.
Claims (10)
1. a kind of double light merge method of adjustment, which is characterized in that double light merge methods of adjustment and include:
Obtain the visible images and infrared light image of target object；
The visible images and the infrared light image are subjected to central point overlapping fusion；
Obtain position deviation of the corner object of reference in the visible images and the infrared light image；
According to position deviation of the corner object of reference in the visible images and the infrared light image, visible light is adjusted
The position of imaging unit.
2. double light as described in claim 1 merge method of adjustment, which is characterized in that center object of reference and the infrared light image
Central point be overlapped, after the visible images and the infrared light image to be carried out to central point overlapping fusion, further includes:
The center object of reference is detected in the visible images and the infrared light image with the presence or absence of position deviation；
If the center object of reference is in the visible images and the infrared light image, there are position deviations, according to
Position deviation of the center object of reference in the visible images and the infrared light image adjusts the visual light imaging unit
Position.
3. light as described in claim 1 double merge methods of adjustment, which is characterized in that the acquisition corner object of reference it is described can
Position deviation in light-exposed image and the infrared light image includes:
Obtain horizontal direction pixel deviations of the corner object of reference in the visible images and the infrared light image
Several and vertical direction pixel deviation number；
According to horizontal direction pixel deviations of the corner object of reference in the visible images and the infrared light image
Several and the visual light imaging unit pixel sizes obtain the corner object of reference in visible images and described infrared
Horizontal direction position deviation in light image；
According to vertical direction pixel deviation of the corner object of reference in the visible images and the infrared light image
Several and the visual light imaging unit pixel sizes obtain the corner object of reference in visible images and described infrared
Vertical direction position deviation in light image.
4. light as claimed in claim 3 double merge methods of adjustment, which is characterized in that it is described according to the corner object of reference in institute
The position deviation in visible images and the infrared light image is stated, the position of visual light imaging unit is adjusted:
The target object is obtained at a distance from double light fusion devices；
According to the target object at a distance from double light fusion devices and the corner object of reference is in the visible light figure
Horizontal direction position deviation in picture and the infrared light image obtains the corner object of reference in the visible images and institute
State the horizontal direction misalignment angle in infrared light image；
According to the target object at a distance from double light fusion devices and the corner object of reference is in the visible light figure
Vertical direction position deviation in picture and the infrared light image obtains the corner object of reference in the visible images and institute
State the vertical direction misalignment angle in infrared light image；
According to horizontal direction misalignment angle of the corner object of reference in the visible images and the infrared light image, adjust
The position of the whole visual light imaging unit.
5. double light as described in claim 1 merge method of adjustment, which is characterized in that the position of the adjustment visual light imaging unit
It sets and includes:
The position of the visual light imaging unit is adjusted by driving device.
6. double light as claimed in claim 5 merge method of adjustment, which is characterized in that described visible being adjusted by driving device
After the position of light imaging unit, further includes:
The position of the driving device is locked by position locking mechanism.
7. light as claimed in claim 5 double merge methods of adjustment, which is characterized in that it is described by driving device adjust described in can
The position of light-exposed imaging unit includes:
Pass through the revolving speed and position rate of driving device described in deceleration institutional adjustment；
According to the revolving speed and position rate of the driving device adjusted, the position of the visual light imaging unit is adjusted.
8. a kind of double light fusion adjustment devices, which is characterized in that double light fusions adjust devices and include:
Image collection module, for obtaining the visible images and infrared light image of target object；
Center Fusion module, for the visible images and the infrared light image to be carried out central point overlapping fusion；
Deviation obtains module, inclined for obtaining position of the corner object of reference in the visible images and the infrared light image
Difference；
Position adjusting type modules, for the position according to the corner object of reference in the visible images and the infrared light image
Deviation is set, the position of visual light imaging unit is adjusted.
9. a kind of double light fusion devices, including memory, processor and storage are in the memory and can be in the processing
The computer program run on device, which is characterized in that the processor realizes such as claim 1 when executing the computer program
The step of merging method of adjustment to any one of 7 double light.
10. a kind of computer readable storage medium, the computer-readable recording medium storage has computer program, and feature exists
In realizing double light fusion methods of adjustment as described in any one of claim 1 to 7 when the computer program is executed by processor
Step.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910289836.0A CN110166714A (en) | 2019-04-11 | 2019-04-11 | Double light fusion methods of adjustment, double light fusion adjustment device and double light fusion devices |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910289836.0A CN110166714A (en) | 2019-04-11 | 2019-04-11 | Double light fusion methods of adjustment, double light fusion adjustment device and double light fusion devices |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110166714A true CN110166714A (en) | 2019-08-23 |
Family
ID=67639205
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910289836.0A Pending CN110166714A (en) | 2019-04-11 | 2019-04-11 | Double light fusion methods of adjustment, double light fusion adjustment device and double light fusion devices |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110166714A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111083381A (en) * | 2019-12-31 | 2020-04-28 | 深圳市道通智能航空技术有限公司 | Image fusion method and device, double-optical camera and unmanned aerial vehicle |
| CN112367472A (en) * | 2020-11-09 | 2021-02-12 | 杭州视辉科技有限公司 | Method for fusion correction of visible light image and infrared thermal imaging image |
| CN113068019A (en) * | 2021-03-17 | 2021-07-02 | 杭州海康消防科技有限公司 | Dual-optical camera calibration apparatus, method, electronic apparatus, and storage medium |
| CN113420702A (en) * | 2021-07-03 | 2021-09-21 | 深圳市迈斯泰克电子有限公司 | Method, device and system for detecting temperature based on human face and storage medium |
| CN113628255A (en) * | 2021-07-28 | 2021-11-09 | 武汉三江中电科技有限责任公司 | Three-light fusion nondestructive testing image registration algorithm |
| WO2023168858A1 (en) * | 2022-03-09 | 2023-09-14 | 武汉高德智感科技有限公司 | Image fusion method and apparatus, and terminal and storage medium |
| CN117129809A (en) * | 2023-08-30 | 2023-11-28 | 上海紫红光电技术有限公司 | Power fault diagnosis method based on unmanned aerial vehicle-mounted multi-light imaging technology |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2011239060A (en) * | 2010-05-07 | 2011-11-24 | Sanyo Electric Co Ltd | Image data processor |
| KR20140023488A (en) * | 2012-08-16 | 2014-02-27 | 엘지이노텍 주식회사 | Apparatus and method thereof for controlling mirror of vehicle |
| CN105701827A (en) * | 2016-01-15 | 2016-06-22 | 中林信达（北京）科技信息有限责任公司 | Method and device for jointly calibrating parameters of visible light camera and infrared camera |
| CN207730423U (en) * | 2017-11-22 | 2018-08-14 | 信利光电股份有限公司 | It is a kind of to take the photograph module system for testing optical axis with visible light and the double of infrared light |
| CN108447097A (en) * | 2018-03-05 | 2018-08-24 | 清华-伯克利深圳学院筹备办公室 | Depth camera scaling method, device, electronic equipment and storage medium |
-
2019
- 2019-04-11 CN CN201910289836.0A patent/CN110166714A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2011239060A (en) * | 2010-05-07 | 2011-11-24 | Sanyo Electric Co Ltd | Image data processor |
| KR20140023488A (en) * | 2012-08-16 | 2014-02-27 | 엘지이노텍 주식회사 | Apparatus and method thereof for controlling mirror of vehicle |
| CN105701827A (en) * | 2016-01-15 | 2016-06-22 | 中林信达（北京）科技信息有限责任公司 | Method and device for jointly calibrating parameters of visible light camera and infrared camera |
| CN207730423U (en) * | 2017-11-22 | 2018-08-14 | 信利光电股份有限公司 | It is a kind of to take the photograph module system for testing optical axis with visible light and the double of infrared light |
| CN108447097A (en) * | 2018-03-05 | 2018-08-24 | 清华-伯克利深圳学院筹备办公室 | Depth camera scaling method, device, electronic equipment and storage medium |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11805220B2 (en) | 2019-12-31 | 2023-10-31 | Autel Robotics Co., Ltd. | Image fusion method and bifocal camera |
| WO2021135825A1 (en) * | 2019-12-31 | 2021-07-08 | 深圳市道通智能航空技术股份有限公司 | Image fusion method and device, dual-light camera and unmanned aerial vehicle |
| CN111083381B (en) * | 2019-12-31 | 2021-10-22 | 深圳市道通智能航空技术股份有限公司 | Image fusion method and device, double-optical camera and unmanned aerial vehicle |
| CN111083381A (en) * | 2019-12-31 | 2020-04-28 | 深圳市道通智能航空技术有限公司 | Image fusion method and device, double-optical camera and unmanned aerial vehicle |
| US12081898B2 (en) | 2019-12-31 | 2024-09-03 | Autel Robotics Co., Ltd. | Image fusion method and bifocal camera |
| CN112367472A (en) * | 2020-11-09 | 2021-02-12 | 杭州视辉科技有限公司 | Method for fusion correction of visible light image and infrared thermal imaging image |
| CN112367472B (en) * | 2020-11-09 | 2022-04-05 | 杭州视辉科技有限公司 | Method for fusion correction of visible light image and infrared thermal imaging image |
| CN113068019A (en) * | 2021-03-17 | 2021-07-02 | 杭州海康消防科技有限公司 | Dual-optical camera calibration apparatus, method, electronic apparatus, and storage medium |
| CN113068019B (en) * | 2021-03-17 | 2023-02-03 | 杭州海康消防科技有限公司 | Dual-optical camera calibration apparatus, method, electronic apparatus, and storage medium |
| CN113420702A (en) * | 2021-07-03 | 2021-09-21 | 深圳市迈斯泰克电子有限公司 | Method, device and system for detecting temperature based on human face and storage medium |
| CN113628255A (en) * | 2021-07-28 | 2021-11-09 | 武汉三江中电科技有限责任公司 | Three-light fusion nondestructive testing image registration algorithm |
| CN113628255B (en) * | 2021-07-28 | 2024-03-12 | 武汉三江中电科技有限责任公司 | Three-light fusion nondestructive detection image registration algorithm |
| WO2023168858A1 (en) * | 2022-03-09 | 2023-09-14 | 武汉高德智感科技有限公司 | Image fusion method and apparatus, and terminal and storage medium |
| CN117129809A (en) * | 2023-08-30 | 2023-11-28 | 上海紫红光电技术有限公司 | Power fault diagnosis method based on unmanned aerial vehicle-mounted multi-light imaging technology |
| CN117129809B (en) * | 2023-08-30 | 2024-04-19 | 上海紫红光电技术有限公司 | Power fault diagnosis method based on unmanned aerial vehicle-mounted multi-light imaging technology |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110166714A (en) | Double light fusion methods of adjustment, double light fusion adjustment device and double light fusion devices | |
| US20190191106A1 (en) | Multi camera image processing | |
| EP3192345A1 (en) | Fill level indicator for an automated unloading system | |
| CN108377345B (en) | Exposure parameter value determination method and device, multi-view camera and storage medium | |
| CN102982548A (en) | Multi-view stereoscopic video acquisition system and camera parameter calibrating method thereof | |
| CN110470238A (en) | A kind of hand-held laser 3 d scanner, scan method and device | |
| CN109166156A (en) | A kind of generation method, mobile terminal and the storage medium of camera calibration image | |
| US20210182633A1 (en) | Localization method and helmet and computer readable storage medium using the same | |
| TWI541767B (en) | Method for controlling a surveillance system with aid of automatically generated patrol routes, and associated apparatus | |
| US20160050367A1 (en) | Information processing device, imaging device, information processing method, and program | |
| CN102739922B (en) | Image processing apparatus, image processing method and program | |
| CN107767424A (en) | Scaling method, multicamera system and the terminal device of multicamera system | |
| CN101021669A (en) | Whole-view field imaging and displaying method and system | |
| EP4220547A1 (en) | Method and apparatus for determining heat data of global region, and storage medium | |
| CN111210386A (en) | Image shooting and splicing method and system | |
| CN105488766A (en) | Fish-eye lens image correcting method and device | |
| CN106027917B (en) | Picture pick-up device and its control method | |
| CN112261293A (en) | Remote inspection method and device for transformer substation and electronic equipment | |
| JP2017142613A (en) | Information processing device, information processing system, information processing method and information processing program | |
| WO2021022989A1 (en) | Calibration parameter obtaining method and apparatus, processor, and electronic device | |
| CN114554093B (en) | Image acquisition system and target tracking method | |
| CN101529893B (en) | Network image synthesizing display system | |
| CN104297896A (en) | Focusing method and electronic equipment | |
| CN210428541U (en) | Laser ranging auxiliary splicing system | |
| CN205647708U (en) | System for use hardware circuit to correct and concatenation image that fisheye lens becomes is real -time |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190823 |