CN111246081B - Method for simulating low-resolution camera imaging by high-resolution image - Google Patents
Method for simulating low-resolution camera imaging by high-resolution image Download PDFInfo
- Publication number
- CN111246081B CN111246081B CN201911335915.7A CN201911335915A CN111246081B CN 111246081 B CN111246081 B CN 111246081B CN 201911335915 A CN201911335915 A CN 201911335915A CN 111246081 B CN111246081 B CN 111246081B
- Authority
- CN
- China
- Prior art keywords
- img
- psf
- num
- low
- resolution
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/64—Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/71—Charge-coupled device [CCD] sensors; Charge-transfer registers specially adapted for CCD sensors
Abstract
The method for simulating the imaging of the low-resolution camera by the high-resolution image, provided by the invention, is a low-resolution image method for simulating the design parameters according to the preset input of the ideal high-resolution image, by combining optical design parameters and CCD size parameters and considering the influence of CCD and optical transfer function sampling on the imaging.
Description
Technical Field
The invention relates to the technical field of computer simulation, in particular to a method for simulating low-resolution camera imaging by using a high-resolution image.
Background
Resolution is an important index parameter of a satellite-borne optical remote sensing system, and due to the long development period and high complexity of a camera, the imaging effect of a story is evaluated according to parameters such as optical design and the like, which is particularly important.
Disclosure of Invention
In view of the above, there is a need to provide a method for simulating low-resolution camera imaging with high-resolution images, which is economical, simple and convenient, and facilitates design optimization of the camera.
In order to achieve the purpose, the invention adopts the following technical scheme:
the invention provides a method for simulating low-resolution camera imaging by a high-resolution image, which comprises the following steps:
inputting an original high-resolution image Img _ high, wherein the size of the image is W x H;
inputting the resolution of the original high-resolution image, recorded as gsd _ high;
inputting the resolution of a low-resolution image to be fitted, and recording as gsd _ low;
inputting the CCD size of a simulated low-resolution camera, recording the CCD size as CCD _ size and optical PSF size, recording the PSF _ size and the optical transfer function of the camera to be simulated as PSF _ OP;
calculating a proportionality coefficient k of gsd _ high and gsd _ low, wherein k is gsd _ low/gsd _ high;
if k is an integer, define num _ repeat as k; if k is a decimal, taking a decimal point of k and counting the number of n to obtain k1, defining that n _ ccd is k1 × 10n, and n _ psf is 10 n;
calculating the greatest common divisor r of n _ ccd and n _ psf, and calculating num _ response which is n _ ccd/r;
determining the size of a low-resolution image point diffusion function map Img _ psf, wherein row is 3 × num _ repeat, column low is 3 × num _ repeat, and the initial value is assigned to 0;
assigning the central position of Img _ psf, wherein the specific assignment ranges from num _ response +1 to num _ response × 2 rows, num _ response +1 to num _ response columns, and the regions are assigned as 1;
the Img _ psf is normalized by a first formula,
the first formula is: img _ psf ═ Img _ psf/sum (Img _ psf); wherein sum (Img _ psf) represents the sum of point spread functions;
obtaining an initial resolution image Img _ con by using a high resolution image convolution point spread function Img _ psf by using a second formula, wherein the second formula is as follows:
img _ con ═ conv2(Img _ high, Img _ psf, 'same'), where conv2 represents the convolution operation in the matlab tool two-dimensional;
down-sampling the image img _ conv by n times to obtain an image img _ low0 without considering the actual optical transfer function, wherein n is 1/num _ response; img _ low0 ═ imresize (img _ conv, n, 'biliar');
wherein, imresize represents an interpolation tool in MATLAB tool, 'bilinar' is cubic interpolation;
calculating num _ reset 1 according to the CCD size of the input simulated low-resolution camera and the optical transfer function of the camera to be simulated, wherein num _ reset 1 is CCD _ size/psf _ size;
according to the img _ low0 interpolation, aligning num _ response 1 with the size of psf and obtaining an image img _ res according to a third formula:
the third formula is img _ res ═ imres (img _ low0, num _ repeat 1, 'bilinar'), where imres represents one of the MATLAB tools and 'bilinar' is cubic interpolation;
convolving the image img _ res with the input optical PSF _ OP to obtain an image img _ conv2, img _ conv2 being conv2(img _ res, PSF _ OP, 'same'); wherein conv2 represents the convolution operation in two dimensions of matlab tool;
sampling img _ conv2 to obtain an output analog low-resolution image img _ low, wherein img _ low is imresize (img _ conv2,1/num _ response, 'biliner'); wherein, imresize represents one of the interpolation tools in MATLAB tool, 'bilinar' is cubic interpolation.
The invention adopts the technical scheme that the method has the advantages that:
the method for simulating the imaging of the low-resolution camera by the high-resolution image, provided by the invention, is a low-resolution image method for simulating the design parameters according to the preset input of the ideal high-resolution image, by combining optical design parameters and CCD size parameters and considering the influence of CCD and optical transfer function sampling on the imaging.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a flowchart illustrating steps of a method for simulating low-resolution camera imaging by using a high-resolution image according to an embodiment of the present invention.
Fig. 2 is an input original high resolution image provided by an embodiment of the present invention.
Fig. 3 is a diagram illustrating PSF _ OP of an optical transfer function of a camera to be simulated according to an embodiment of the invention.
FIG. 4 shows that the resolution of 5m is obtained without considering the optical transfer function according to the embodiment of the present invention.
FIG. 5 is a low resolution image of an output simulation obtained by an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, a flowchart of steps of a method for simulating low-resolution camera imaging by using a high-resolution image according to an embodiment of the present invention includes the following steps:
step S110: an original high-resolution image Img _ high is input, and the image size is W x H.
Referring to fig. 2, the original high resolution image input by the embodiment of the present invention has an image size of 4000 × 5000, and the resolution image is 1 m.
Step S120: the resolution of the original high resolution image is input, noted gsd _ high.
Step S130: the resolution of the low resolution image to be fitted is input, noted gsd _ low.
Step S140: the CCD dimensions of the simulated low resolution camera, denoted as CCD _ size and optical PSF size, denoted PSF _ size and the optical transfer function of the camera to be simulated, denoted PSF _ OP.
Please refer to fig. 3, which is a diagram illustrating PSF _ OP of an optical transfer function of a camera to be simulated according to an embodiment of the present invention.
Step S150: calculating a proportionality coefficient k of gsd _ high and gsd _ low, wherein k is gsd _ low/gsd _ high;
if k is an integer, define num _ repeat as k; when k is a decimal, k is counted to n digits to obtain k1, and n _ ccd is defined as k1 × 10n, and n _ psf is defined as 10 n.
Step S160: the greatest common divisor r of n _ ccd and n _ psf is calculated, and num _ response which is n _ ccd/r is calculated.
Step S170: and determining the size of the low-resolution image point diffusion function map Img _ psf, wherein row is 3 × num _ repeat, column low is 3 × num _ repeat, and the initial value is set to 0.
Step S180: the central position of Img _ psf is assigned, specifically, the assigned values range from num _ response +1 to num _ response × 2 rows, and num _ response +1 to num _ response columns, and the assigned values of the regions are all 1.
Step S190: carrying out normalization processing on the Img _ psf by adopting a first formula, wherein the first formula is as follows: img _ psf ═ Img _ psf/sum (Img _ psf); where sum (Img _ psf) represents the sum of the point spread functions.
Step S210: obtaining an initial resolution image Img _ con by using a high resolution image convolution point spread function Img _ psf by using a second formula, wherein the second formula is as follows:
img _ con ═ conv2(Img _ high, Img _ psf, 'same'), where conv2 represents the convolution operation in the matlab tool two dimensions.
Step S220: down-sampling the image img _ conv by n times to obtain an image img _ low0 without considering the actual optical transfer function, wherein n is 1/num _ response; img _ low0 ═ imresize (img _ conv, n, 'biliar');
wherein, imresize represents one of the interpolation tools in MATLAB tool, 'bilinar' is cubic interpolation.
Referring to fig. 4, an image with a resolution of 5m, 800 x 1000, was obtained for an embodiment of the present invention without considering the optical transfer function.
Step S230: num _ reset 1 is calculated according to the CCD size of the input simulated low resolution camera and the optical transfer function of the camera to be simulated, num _ reset 1 is CCD _ size/psf _ size.
Step S240: according to the img _ low0 interpolation, aligning num _ response 1 with the size of psf and obtaining an image img _ res according to a third formula;
the third formula is img _ res ═ imres (img _ low0, num _ repeat 1, 'bilinar'), where imres represents one of the MATLAB tools and 'bilinar' is cubic interpolation.
Step S250: convolving the image img _ res with the input optical PSF _ OP to obtain an image img _ conv2, img _ conv2 being conv2(img _ res, PSF _ OP, 'same'); wherein conv2 represents the convolution operation in two dimensions of the matlab tool.
Step S260: sampling img _ conv2 to obtain an output analog low-resolution image img _ low, wherein img _ low is imresize (img _ conv2,1/num _ response, 'biliner'); wherein, imresize represents one of the interpolation tools in MATLAB tool, 'bilinar' is cubic interpolation.
Referring to fig. 5, the output analog low-resolution image img _ low obtained through the above steps is an image with a resolution of 5m and a size of 800 × 1000.
The method for simulating the imaging of the low-resolution camera by the high-resolution image, provided by the invention, is a low-resolution image method for simulating the design parameters according to the preset input of the ideal high-resolution image, by combining optical design parameters and CCD size parameters and considering the influence of CCD and optical transfer function sampling on the imaging.
Of course, the method for simulating low-resolution camera imaging by using high-resolution images of the present invention may also have various changes and modifications, and is not limited to the specific structure of the above-mentioned embodiments. In conclusion, the scope of the present invention should include those changes or substitutions and modifications which are obvious to those of ordinary skill in the art.
Claims (1)
1. A method for simulating low-resolution camera imaging by using a high-resolution image is characterized by comprising the following steps:
inputting an original high-resolution image Img _ high, wherein the size of the image is W x H;
inputting the resolution of the original high-resolution image, recorded as gsd _ high;
inputting the resolution of a low-resolution image to be fitted, and recording as gsd _ low;
inputting the CCD size of a simulated low-resolution camera, recording the CCD size as CCD _ size and optical PSF size, recording the PSF _ size and the optical transfer function of the camera to be simulated as PSF _ OP;
calculating a proportionality coefficient k of gsd _ high and gsd _ low, wherein k is gsd _ low/gsd _ high;
if k is an integer, define num _ repeat as k; if k is a decimal, taking a decimal point of k and counting the number of n to obtain k1, defining that n _ ccd is k1 × 10n, and n _ psf is 10 n;
calculating the greatest common divisor r of n _ ccd and n _ psf, and calculating num _ response which is n _ ccd/r;
determining the size of a low-resolution image point diffusion function map Img _ psf, wherein row is 3 × num _ repeat, column low is 3 × num _ repeat, and the initial value is assigned to 0;
assigning the central position of Img _ psf, wherein the specific assignment ranges from num _ response +1 to num _ response × 2 rows, num _ response +1 to num _ response columns, and the regions are assigned as 1;
the Img _ psf is normalized by a first formula,
the first formula is: normalizing the Img _ psf into a quotient of the sum of the point spread function and the point spread function sum (Img _ psf);
obtaining an initial resolution image Img _ conv by using a high resolution image convolution point spread function Img _ psf by adopting a second formula as follows:
img _ conv ═ conv2(Img _ high, Img _ psf, 'same'), where conv2 represents the convolution operation in matlab tool two dimensions;
down-sampling the image img _ conv by n times to obtain an image img _ low0 without considering the actual optical transfer function, wherein n is 1/num _ response; img _ low0 ═ imresize (img _ conv, n, 'biliar');
wherein, imresize represents an interpolation tool in MATLAB tool, 'bilinar' is cubic interpolation;
calculating num _ reset 1 according to the CCD size of the input simulated low-resolution camera and the optical transfer function of the camera to be simulated, wherein num _ reset 1 is CCD _ size/psf _ size;
according to the img _ low0 interpolation, aligning num _ response 1 with the size of psf and obtaining an image img _ res according to a third formula:
the third formula is img _ res ═ img _ low0, num _ response 1, 'biliyet');
convolving the image img _ res with the input optical PSF _ OP to obtain an image img _ conv2, img _ conv2 being conv2(img _ res, PSF _ OP, 'same'); wherein conv2 represents the convolution operation in two dimensions of matlab tool;
the img _ conv2 is sampled to obtain an output analog low-resolution image img _ low, which is an imresize (img _ conv2,1/num _ response, 'biliyet').
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911335915.7A CN111246081B (en) | 2019-12-23 | 2019-12-23 | Method for simulating low-resolution camera imaging by high-resolution image |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911335915.7A CN111246081B (en) | 2019-12-23 | 2019-12-23 | Method for simulating low-resolution camera imaging by high-resolution image |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111246081A CN111246081A (en) | 2020-06-05 |
| CN111246081B true CN111246081B (en) | 2021-03-23 |
Family
ID=70863911
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911335915.7A Active CN111246081B (en) | 2019-12-23 | 2019-12-23 | Method for simulating low-resolution camera imaging by high-resolution image |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111246081B (en) |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5696848A (en) * | 1995-03-09 | 1997-12-09 | Eastman Kodak Company | System for creating a high resolution image from a sequence of lower resolution motion images |
| CN102798851B (en) * | 2012-08-27 | 2014-02-05 | 电子科技大学 | Geometric-imaging-based MODIS (Moderate Resolution Imaging Spectroradiometer) LAI product verification method |
| US10217190B2 (en) * | 2016-12-27 | 2019-02-26 | Kla-Tencor Corporation | System and method for reconstructing high-resolution point spread functions from low-resolution inspection images |
| CN107292819A (en) * | 2017-05-10 | 2017-10-24 | 重庆邮电大学 | A kind of infrared image super resolution ratio reconstruction method protected based on edge details |
| CN108765288B (en) * | 2018-05-25 | 2022-05-31 | 杭州电子科技大学 | POCS image super-resolution reconstruction method based on edge preservation |
-
2019
- 2019-12-23 CN CN201911335915.7A patent/CN111246081B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN111246081A (en) | 2020-06-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10630960B2 (en) | Machine vision 3D line scan image acquisition and processing | |
| KR101035836B1 (en) | Image processing apparatus, image processing system, imaging apparatus and image processing method | |
| TWI512686B (en) | Texture unit for general purpose computing | |
| US20090262223A1 (en) | Apparatus and method for improving image quality of image sensor | |
| Harpsøe et al. | Bayesian photon counting with electron-multiplying charge coupled devices (EMCCDs) | |
| CN110533707A (en) | Illuminant estimation | |
| CN104182962A (en) | Picture definition evaluation method and device | |
| CN111246081B (en) | Method for simulating low-resolution camera imaging by high-resolution image | |
| US20090295818A1 (en) | Method and Apparatus for Rendering Images With and Without Radially Symmetric Distortions | |
| CN113806601B (en) | Peripheral interest point retrieval method and storage medium | |
| Cenni et al. | Behavioral modeling of a CMOS video sensor platform using SystemC AMS/TLM | |
| TWI502988B (en) | Electronic devices and methods for enhancing image resolution and computer-readable mediums thereof | |
| CN102663666A (en) | Two-dimensional image resampling algorithm accelerator based on field-programmable gate array (FPGA) | |
| CN113747066A (en) | Image correction method, image correction device, electronic equipment and computer-readable storage medium | |
| KR20010004946A (en) | Method and Apparatus for high speed Convolution | |
| CN112669432A (en) | Volume cloud rendering method and device, electronic equipment and storage medium | |
| JP5759126B2 (en) | Pattern identification apparatus, control method therefor, and program | |
| Efremov et al. | Reconstruction of continuous image using maximum likelihood estimates from grouped data for measuring light intensity and interpolation by atomic functions according to aperture of photosensitive element of sensor | |
| CN113327217B (en) | Convolution processing method and device, computer equipment and storage medium | |
| Snyder | Modifications of the Lucy–Richardson iteration for restoring Hubble Space Telescope imagery | |
| CN115546038A (en) | Image noise reduction method, circuit, electronic device and storage medium | |
| US6765960B1 (en) | Method and device for detecting a change between pixel signals which chronologically follow one another | |
| Krylov et al. | On Markov random sets | |
| KR100390847B1 (en) | Color interpolation apparatus in image sensor | |
| CN113111891B (en) | Image reconstruction method and device, terminal equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |