CN112637502A - Self-adaptive visible light panoramic shooting system and method based on infrared camera shooting - Google Patents
Self-adaptive visible light panoramic shooting system and method based on infrared camera shooting Download PDFInfo
- Publication number
- CN112637502A CN112637502A CN202011531609.3A CN202011531609A CN112637502A CN 112637502 A CN112637502 A CN 112637502A CN 202011531609 A CN202011531609 A CN 202011531609A CN 112637502 A CN112637502 A CN 112637502A
- Authority
- CN
- China
- Prior art keywords
- shooting
- image
- infrared camera
- panoramic
- images
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/73—Circuitry for compensating brightness variation in the scene by influencing the exposure time
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/95—Computational photography systems, e.g. light-field imaging systems
- H04N23/951—Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/30—Transforming light or analogous information into electric information
- H04N5/33—Transforming infrared radiation
Abstract
The invention provides an infrared camera based self-adaptive visible light panoramic shooting system and method, and relates to the technical field of images. When the infrared camera and the panoramic camera are used, panoramic images which are simultaneously imaged and exposed through the infrared camera and the panoramic camera can be uniformly adjusted, the panoramic images and infrared thermal images are uniformly collected, collected images are processed through corresponding algorithms, the influence on synthetic images under different illumination conditions is further reduced, self-adaptive visible light panoramic shooting is completed, meanwhile, the exposure time of the infrared camera and the panoramic camera can be intelligently adjusted, and the influence of exposure errors on the synthetic images is avoided.
Description
Technical Field
The invention relates to the technical field of images, in particular to an infrared camera based self-adaptive visible light panoramic shooting system and method.
Background
Image acquisition is a means for acquiring real-time image information by utilizing a modern technology, and plays an important role in the modern multimedia technology. The method has wide application in the fields of daily life, biomedicine, aerospace and the like.
At present, a widely used panoramic image acquisition method is obtained by respectively acquiring images in different angle views by a plurality of sensors and then synthesizing the images.
However, in the current panoramic shooting process, the shooting process is very easily affected by visible light, especially under the condition of different illumination, the shooting synthesized image is very easily blurred, meanwhile, the shooting exposure time cannot be intelligently adjusted, and the market demand is difficult to meet.
Disclosure of Invention
The invention aims to provide an infrared camera based self-adaptive visible light panoramic shooting system and method, when in use, panoramic images subjected to imaging exposure simultaneously through an infrared camera and a panoramic camera can be uniformly adjusted, the panoramic images and infrared thermal images are uniformly collected, the collected images are processed through corresponding algorithms, further, the influence on a synthesized image under different illumination conditions is reduced, self-adaptive visible light panoramic shooting is completed, meanwhile, the exposure time of the infrared camera and the panoramic camera can be intelligently adjusted, and the influence of exposure errors on the synthesized image is avoided.
In order to achieve the above-mentioned effects, the present invention provides the following technical solutions: an adaptive visible light panorama shooting system based on infrared camera shooting, comprising:
the panoramic camera is installed in the shooting area and can carry out panoramic shooting on scenes in the shooting area.
The infrared camera is installed right above or below the panoramic camera and can be used for locally shooting a shooting area.
And the processing center unit is arranged in the control monitoring room, can collect and store the acquired images and can process and synthesize the collected images.
And the image output unit is installed in the control monitoring room, performs definition processing on the synthesized image, and generates and outputs the processed image.
Furthermore, the panoramic camera and the infrared camera are in bidirectional signal connection with the processing center unit, and the input end of the image output unit is in signal connection with the input end of the processing center unit.
Furthermore, the processing center unit comprises an exposure control module and an image collection module, wherein the output end of the image collection module is electrically connected with the input end of the image storage module, the output end of the image storage module is electrically connected with the input end of the image processing module, the output end of the image processing module is electrically connected with the input end of the image synthesis module, and the output end of the image processing module is electrically connected with the input end of the exposure control module.
Furthermore, the image output unit comprises a definition adjusting module and an image generating module, and an output end of the definition adjusting module is electrically connected with an input end of the image generating module.
An adaptive visible light panoramic shooting method based on infrared shooting comprises the following steps:
and S1, carrying out panoramic shooting and local shooting on the shooting area.
And S2, collecting the shot images, and collecting and storing the shot images.
And S3, processing the collected and stored images and synthesizing the images.
And S4, performing definition processing on the synthesized image according to the definition condition of the synthesized image.
And S5, generating and outputting the image after the definition processing for monitoring by monitoring personnel.
Further, according to the operation step in S1, before the photographing is performed, the photographing exposure times of the panoramic camera and the infrared camera are set so that the photographing times of the panoramic camera and the infrared camera are synchronized.
Further, according to the operation step in S1, when the infrared camera performs shooting, the infrared camera can perform 360 ℃ back and forth rotation at a constant speed.
Further, according to the operation in S3, when the images are processed, the images captured in a capturing period, which is a time period during which the infrared camera makes one turn at 360 ℃, are collected in a periodic classification manner.
Further, according to the operation step in S3, when the images are synthesized, an algorithm is used to synthesize the panoramic image and the local image.
The invention provides an adaptive visible light panoramic shooting system and method based on infrared camera shooting, which have the following beneficial effects:
(1) when the infrared camera and the panoramic camera are used, the panoramic image can be uniformly adjusted through simultaneous imaging exposure of the infrared camera and the panoramic camera, the panoramic image and the infrared thermal imaging can be uniformly collected, the collected images are processed through corresponding algorithms, the influence on the synthesized image under different illumination conditions is further reduced, and self-adaptive visible light panoramic shooting is completed.
(2) According to the invention, the exposure time of the infrared camera and the exposure time of the panoramic camera can be intelligently adjusted, so that the exposure time of the infrared camera and the exposure time of the panoramic camera are synchronous, and the influence of exposure errors on a synthesized image is avoided.
Drawings
FIG. 1 is a system diagram of an adaptive visible light panoramic shooting system based on infrared camera shooting according to the present invention;
fig. 2 is a flowchart of an adaptive visible light panoramic shooting system based on infrared shooting according to the present invention.
Description of the drawings: 1. a panoramic camera; 2. an infrared camera; 3. a processing center unit; 4. an image output unit.
Detailed Description
The invention provides a technical scheme that: an adaptive visible light panoramic shooting system and method based on infrared camera shooting comprises the following steps:
the panoramic camera 1 is installed in a shooting area, and can perform panoramic shooting on scenes in the shooting area.
And the processing center unit 3 is installed in the control monitoring room, can collect and store the acquired images, and can process and synthesize the collected images.
And the image output unit 4 is installed in the control monitoring room, performs definition processing on the synthesized image, and generates and outputs the processed image.
Specifically, the panoramic camera 1 and the infrared camera 2 are both in bidirectional signal connection with the processing center unit 3, and the input end of the image output unit 4 is in signal connection with the input end of the processing center unit 3.
Specifically, the processing center unit 3 includes an exposure control module and an image collection module, an output terminal of the image collection module is electrically connected to an input terminal of the image storage module, an output terminal of the image storage module is electrically connected to an input terminal of the image processing module, an output terminal of the image processing module is electrically connected to an input terminal of the image synthesis module, and an output terminal of the image processing module is electrically connected to an input terminal of the exposure control module.
Specifically, the image output unit 4 includes a definition adjustment module and an image generation module, and an output end of the definition adjustment module is electrically connected to an input end of the image generation module.
An adaptive visible light panoramic shooting method based on infrared shooting comprises the following steps:
step one, carrying out panoramic shooting and local shooting on a shooting area.
And step two, collecting the shot images, and collecting and storing the shot images.
And step three, processing the collected and stored images and synthesizing the images.
And step four, performing definition processing on the synthesized image according to the definition condition of the synthesized image.
And fifthly, generating and outputting the image after the definition processing for monitoring by monitoring personnel.
Specifically, according to the operation step in the step one, before shooting, shooting exposure times of the panoramic camera 1 and the infrared camera 2 are set, so that the shooting times of the panoramic camera 1 and the infrared camera 2 are synchronized.
Specifically, according to the operation steps in the first step, when the infrared camera 2 performs shooting, the infrared camera 2 can perform 360 ℃ reciprocating rotation at a constant speed.
Specifically, according to the operation steps in the third step, when processing the image, the images shot in a shooting period are collected in a cycle classification manner, and the shooting period is the time when the infrared camera 2 rotates for one circle at 360 ℃.
Specifically, according to the operation steps in the third step, when the images are synthesized, the synthesis of the panoramic image and the local image is realized by adopting an algorithm.
The method of the examples was performed for detection analysis and compared to the prior art to yield the following data:
| influence of light | Image effect | |
| Examples | Weak influence | Is excellent in |
| Prior Art | Large influence | Not good at |
According to the table data, the self-adaptive visible light panoramic shooting system and method based on infrared shooting can obtain the effects of weak illumination influence and excellent synthesized image effect.
As shown in fig. 1-2, the present invention provides an adaptive visible light panoramic shooting system based on infrared camera shooting, comprising: the panoramic camera comprises a panoramic camera 1, the panoramic camera 1 is installed in a shooting area and can perform panoramic shooting on scenes in the shooting area, an infrared camera 2 is installed right above or below the panoramic camera 1 and can perform local shooting on the shooting area, the infrared camera 2 can collect infrared thermal imaging, a processing center unit 3 is installed in a control monitoring room and can collect and store acquired images and process and synthesize the collected images, an image output unit 4 is installed in the control monitoring room and performs definition processing on the synthesized images and generates and outputs the processed images.
Specifically, the panoramic camera 1 and the infrared camera 2 are both in bidirectional signal connection with the processing center unit 3, the input end of the image output unit 4 is in signal connection with the input end of the processing center unit 3, the shot images are transmitted to the processing center unit 3, the images are processed through the processing center unit 3, the processed and synthesized images are output to the image output unit 4, and the shot images are output.
Specifically, the processing center unit 3 comprises an exposure control module and an image collection module, the output end of the image collection module is electrically connected with the input end of the image storage module, the output end of the image storage module is electrically connected with the input end of the image processing module, the output end of the image processing module is electrically connected with the input end of the image synthesis module, the output end of the image processing module is electrically connected with the input end of the exposure control module, the arranged exposure control module can carry out shooting exposure time error comparison according to the shot images of the panoramic camera 1 and the infrared camera 2, and then realize the adjustment to shoot exposure time, the picture that will shoot will be collected through the image collecting module, carry on the image storage through the image storage module with the collected image, process the picture stored by the image processing module, there is the image synthesis module to carry on the image synthesis again.
Specifically, image output unit 4 includes definition adjustment module and image generation module, and definition adjustment module's output and image generation module's input electric connection, the definition adjustment module of setting can carry out the definition adjustment to the synthetic image, carries out image output by image generation module again, and the person of facilitating the use looks over.
An adaptive visible light panoramic shooting method based on infrared shooting comprises the following steps: step one, carrying out panoramic shooting and local shooting on a shooting area, setting shooting exposure time of a panoramic camera 1 and an infrared camera 2 before carrying out shooting, setting shooting exposure error, and adjusting the shooting exposure time when the shooting exposure time error is larger than the error until the shooting exposure time error is smaller than the exposure error time, so that the shooting time of the panoramic camera 1 and the shooting time of the infrared camera 2 are synchronous, when the infrared camera 2 shoots, the infrared camera 2 can carry out 360 ℃ reciprocating rotation at a constant speed, step two, carrying out image collection on shot images, collecting and storing the shot images, step three, processing the collected and stored images, synthesizing the images, and carrying out periodic classified collection on the images shot in a shooting period when processing the images, the shooting period is the time that the infrared camera 2 rotates for one circle at 360 ℃, when the images are synthesized, the synthesis of a panoramic image and a local image is realized by adopting an algorithm, after the images are processed, if the main edge is displayed on the images, the images are considered to form a binaryzation edge image which meets the requirements and can embody the image characteristics, then the potential matching image and the template image are matched by utilizing the following matching method of the correlation coefficient, and the correlation coefficient function (maximum) is a standardized covariance function.
maxβ(p，q)＝C12/C11*C22Beta is less than or equal to 1, wherein C12I.e. the covariance of the grey levels in the two windows, G11、C22The variance of the gray levels in the two windows is respectively, and the value range of beta is-1 to 1.
And step five, generating and outputting the image after the definition processing for monitoring personnel.
When the infrared camera panoramic camera is used, panoramic images which are imaged and exposed simultaneously through the infrared camera 2 and the panoramic camera 1 can be adjusted in a unified mode, the panoramic images and infrared thermal images are collected in a unified mode, collected images are processed through corresponding algorithms, influences on synthetic images under different illumination conditions are further reduced, self-adaptive visible light panoramic shooting is completed, meanwhile, exposure time of the infrared camera 2 and the panoramic camera 1 can be adjusted intelligently, and influences of exposure errors on the synthetic images are avoided.
Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that changes, modifications, substitutions and alterations can be made in these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.
Claims (9)
1. An adaptive visible light panorama shooting system based on infrared camera shooting, characterized by comprising:
the panoramic camera is arranged in the shooting area and can carry out panoramic shooting on scenes in the shooting area;
the infrared camera is arranged right above or below the panoramic camera and can be used for locally shooting a shooting area;
the processing center unit is arranged in the control monitoring room, can collect and store the acquired images and processes and synthesizes the collected images;
and the image output unit is installed in the control monitoring room, performs definition processing on the synthesized image, and generates and outputs the processed image.
2. The adaptive visible light panoramic shooting system based on infrared camera shooting as claimed in claim 1, wherein the panoramic camera and the infrared camera are both in bidirectional signal connection with the processing center unit, and the input end of the image output unit is in signal connection with the input end of the processing center unit.
3. The system of claim 1, wherein the processing center unit comprises an exposure control module and an image collection module, an output of the image collection module is electrically connected to an input of the image storage module, an output of the image storage module is electrically connected to an input of the image processing module, an output of the image processing module is electrically connected to an input of the image synthesis module, and an output of the image processing module is electrically connected to an input of the exposure control module.
4. The infrared camera based adaptive visible light panoramic shooting system of claim 1, wherein the image output unit comprises a definition adjusting module and an image generating module, and an output end of the definition adjusting module is electrically connected with an input end of the image generating module.
5. The adaptive visible light panoramic shooting method based on infrared camera shooting is characterized by comprising the following steps:
s1, carrying out panoramic shooting and local shooting on the shooting area;
s2, collecting the shot images, and collecting and storing the shot images;
s3, processing the collected and stored images and synthesizing the images;
s4, performing definition processing on the synthesized image according to the definition condition of the synthesized image;
and S5, generating and outputting the image after the definition processing for monitoring by monitoring personnel.
6. The adaptive visible light panorama shooting method based on infrared camera shooting of claim 5, wherein according to the operation step in S1, before shooting is performed, shooting exposure times of the panorama camera and the infrared camera are set so that the shooting times of the panorama camera and the infrared camera are synchronized.
7. The adaptive visible light panoramic shooting method based on infrared camera shooting as claimed in claim 5, wherein according to the operation step in S1, when the infrared camera is shooting, the infrared camera can perform 360 ° of shooting at a constant speedOC, reciprocating rotation.
8. The adaptive visible light panorama shooting method based on infrared camera shooting as claimed in claim 5, wherein according to the operation step in S3, when processing the image, the image shot in a shooting period is collected by periodic classification, and the shooting period is the infrared camera 360OC time of one rotation.
9. The adaptive visible light panorama shooting method based on infrared camera shooting according to claim 5, characterized in that, when synthesizing the images in the operation step of S3, the synthesis of the panorama image and the local image is realized by using an algorithm.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011531609.3A CN112637502B (en) | 2020-12-23 | 2020-12-23 | Self-adaptive visible light panoramic shooting system and method based on infrared camera shooting |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011531609.3A CN112637502B (en) | 2020-12-23 | 2020-12-23 | Self-adaptive visible light panoramic shooting system and method based on infrared camera shooting |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112637502A true CN112637502A (en) | 2021-04-09 |
| CN112637502B CN112637502B (en) | 2022-11-01 |
Family
ID=75321131
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011531609.3A Active CN112637502B (en) | 2020-12-23 | 2020-12-23 | Self-adaptive visible light panoramic shooting system and method based on infrared camera shooting |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112637502B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005252426A (en) * | 2004-03-02 | 2005-09-15 | Seiko Epson Corp | Generation of image file containing image quality limiting information for image data |
| CN104702895A (en) * | 2013-12-05 | 2015-06-10 | 大连掌控科技有限公司 | Video image enhancing system applied to player |
| CN107580163A (en) * | 2017-08-12 | 2018-01-12 | 四川精视科技有限公司 | A kind of twin-lens black light camera |
| US9947108B1 (en) * | 2016-05-09 | 2018-04-17 | Scott Zhihao Chen | Method and system for automatic detection and tracking of moving objects in panoramic video |
| CN109035193A (en) * | 2018-08-29 | 2018-12-18 | 成都臻识科技发展有限公司 | A kind of image processing method and imaging processing system based on binocular solid camera |
| CN110336955A (en) * | 2019-07-12 | 2019-10-15 | 易诚高科（大连）科技有限公司 | A kind of adaptive visible light panoramic shooting system |
-
2020
- 2020-12-23 CN CN202011531609.3A patent/CN112637502B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005252426A (en) * | 2004-03-02 | 2005-09-15 | Seiko Epson Corp | Generation of image file containing image quality limiting information for image data |
| CN104702895A (en) * | 2013-12-05 | 2015-06-10 | 大连掌控科技有限公司 | Video image enhancing system applied to player |
| US9947108B1 (en) * | 2016-05-09 | 2018-04-17 | Scott Zhihao Chen | Method and system for automatic detection and tracking of moving objects in panoramic video |
| CN107580163A (en) * | 2017-08-12 | 2018-01-12 | 四川精视科技有限公司 | A kind of twin-lens black light camera |
| CN109035193A (en) * | 2018-08-29 | 2018-12-18 | 成都臻识科技发展有限公司 | A kind of image processing method and imaging processing system based on binocular solid camera |
| CN110336955A (en) * | 2019-07-12 | 2019-10-15 | 易诚高科（大连）科技有限公司 | A kind of adaptive visible light panoramic shooting system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112637502B (en) | 2022-11-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20130107072A1 (en) | Multi-resolution ip camera | |
| EP2881915B1 (en) | Techniques for disparity estimation using camera arrays for high dynamic range imaging | |
| JP5470959B2 (en) | Multi-frame reconstruction method, system and software | |
| CN107123091B (en) | Near-infrared face image super-resolution reconstruction method based on deep learning | |
| WO2019174544A1 (en) | Image synthesis method and apparatus, and computer storage medium and electronic device | |
| WO2021098080A1 (en) | Multi-spectral camera extrinsic parameter self-calibration algorithm based on edge features | |
| US9741143B2 (en) | Multocular imaging system, synthesis process method of acquired images, and program | |
| CN104023166B (en) | A kind of environment self-adaption video image noise reducing method and device | |
| ZA200401970B (en) | Method, device and computer program product for demultiplexing of video images | |
| CN105809640A (en) | Multi-sensor fusion low-illumination video image enhancement method | |
| CN110742631B (en) | Imaging method and device for medical image | |
| WO2020062393A1 (en) | Initial data processing method and system based on machine learning | |
| CN108937905B (en) | Non-contact heart rate detection method based on signal fitting | |
| US20100302394A1 (en) | Blinked eye artifact removal for a digital imaging device | |
| CN108322648B (en) | Image processing method and device, electronic equipment and computer readable storage medium | |
| CN110414558A (en) | Characteristic point matching method based on event camera | |
| CN109685748A (en) | Image processing method, device, electronic equipment, computer readable storage medium | |
| Qu et al. | Capturing ground truth super-resolution data | |
| Yang et al. | Learning event guided high dynamic range video reconstruction | |
| CN112637502B (en) | Self-adaptive visible light panoramic shooting system and method based on infrared camera shooting | |
| CN111696044A (en) | Large-scene dynamic visual observation method and device | |
| US20230132230A1 (en) | Efficient Video Execution Method and System | |
| CN115984124A (en) | Method and device for de-noising and super-resolution of neuromorphic pulse signals | |
| CN110740297B (en) | Automatic-identification monitoring device and monitoring method based on computer | |
| US11443403B2 (en) | Image and video processing using multiple pipelines |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |