CN111915521A - Spliced image correction method and device - Google Patents
Spliced image correction method and device Download PDFInfo
- Publication number
- CN111915521A CN111915521A CN202010756675.4A CN202010756675A CN111915521A CN 111915521 A CN111915521 A CN 111915521A CN 202010756675 A CN202010756675 A CN 202010756675A CN 111915521 A CN111915521 A CN 111915521A
- Authority
- CN
- China
- Prior art keywords
- image
- target scene
- spliced
- sub
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 51
- 238000003702 image correction Methods 0.000 title claims description 23
- 238000012937 correction Methods 0.000 claims description 24
- 238000004590 computer program Methods 0.000 claims description 15
- 238000012545 processing Methods 0.000 claims description 13
- 238000003860 storage Methods 0.000 claims description 12
- 208000011580 syndromic disease Diseases 0.000 claims description 6
- 230000003321 amplification Effects 0.000 claims description 2
- 238000003199 nucleic acid amplification method Methods 0.000 claims description 2
- 230000007704 transition Effects 0.000 abstract description 9
- 230000006870 function Effects 0.000 description 13
- 238000004891 communication Methods 0.000 description 12
- 238000010586 diagram Methods 0.000 description 12
- 239000011159 matrix material Substances 0.000 description 8
- 230000008569 process Effects 0.000 description 7
- 239000000872 buffer Substances 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- 238000000605 extraction Methods 0.000 description 3
- 239000013598 vector Substances 0.000 description 3
- 238000001914 filtration Methods 0.000 description 2
- 238000009616 inductively coupled plasma Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 239000000758 substrate Substances 0.000 description 2
- 230000002194 synthesizing effect Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000002059 diagnostic imaging Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000001000 micrograph Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000002086 nanomaterial Substances 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000007500 overflow downdraw method Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000005096 rolling process Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/80—Geometric correction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/90—Dynamic range modification of images or parts thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
- G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
- G06T7/337—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods involving reference images or patches
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20081—Training; Learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20084—Artificial neural networks [ANN]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20172—Image enhancement details
- G06T2207/20192—Edge enhancement; Edge preservation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Image Processing (AREA)
- Studio Devices (AREA)
Abstract
The invention provides a method and a device for correcting a spliced image, wherein the method comprises the following steps: acquiring sub-images corresponding to all areas on a target scene and a panoramic image corresponding to the target scene; wherein the target scene is divided into a plurality of regions; splicing the sub-images corresponding to the areas to obtain a spliced image of the target scene; and correcting the spliced image of the target scene based on the panoramic image corresponding to the target scene. The invention can reduce the distortion degree of the spliced area and the divergence degree of the edge on the spliced image, so that the edge sharpness of the spliced image and the transition degree of the spliced area are more natural.
Description
Technical Field
The invention relates to the technical field of image splicing, in particular to a method and a device for correcting a spliced image.
Background
Image stitching is a method for stitching a plurality of sub-images in the same scene into a wider field image, and is mainly used for solving the problem of limited field of view in single imaging. The method has important significance in the fields of medical imaging, computer vision, unmanned aerial vehicle aerial photography, remote sensing images, satellite data, military target automatic identification and the like. The image splicing output is a union set of two images, namely, the overlapped parts of the two input images are extracted, registration is carried out according to the characteristic points, a coordinate transformation matrix is constructed, the fusion of the two images is realized, and an image with a wider field of view is output. The current image mosaic algorithm is realized based on the assumption, has simple logic and certain universality, but has certain problems, and usually needs to introduce an additional correction algorithm to enable the mosaic image to be displayed more naturally.
The microscopic image is a micro-area image amplified by an optical or electronic microscope, and has wide application in the fields of nano materials, biomedicine and the like. The larger the magnification of the microscope, the smaller the field of view, and generally a panoramic high resolution image needs to be obtained by an image stitching method. At present, splicing gaps or dislocation usually exist in splicing of multiple microscopic images, and the chroma contrast of a transition region is obvious.
Therefore, a simple and efficient method for correcting the spliced microscope image is needed.
Disclosure of Invention
Aiming at the problems in the prior art, the invention provides a method and a device for correcting a spliced image, which can reduce the distortion degree and the edge divergence degree of a spliced area on the spliced image, so that the edge sharpness of the spliced image and the transition degree of the spliced area are more natural.
In order to solve the technical problems, the invention provides the following technical scheme:
in a first aspect, the present invention provides a method for correcting a stitched image, including:
acquiring sub-images corresponding to all areas on a target scene and a panoramic image corresponding to the target scene; wherein the target scene is divided into a plurality of regions;
splicing the sub-images corresponding to the areas to obtain a spliced image of the target scene;
and correcting the spliced image of the target scene based on the panoramic image corresponding to the target scene.
The acquiring of the sub-image corresponding to each region on the target scene and the panoramic image corresponding to the target scene includes:
acquiring an image of the target area by adopting a low-power objective lens to obtain a panoramic image corresponding to the target scene;
and respectively carrying out image acquisition on each area on the target area by adopting a high-power objective lens to obtain sub-images corresponding to each area on the target scene.
The obtaining of the stitched image of the target scene by stitching the sub-images corresponding to the respective regions includes:
determining an overlapping area corresponding to each sub-image and extracting image characteristics corresponding to each overlapping area;
and splicing any two adjacent sub-images according to the image characteristics to obtain a spliced image of the target scene.
Wherein the correcting the spliced image of the target scene based on the panoramic image corresponding to the target scene comprises:
amplifying the panoramic image to enable the scale of the panoramic image to be the same as that of the spliced image;
determining a target subarea on the amplified panoramic image;
and correcting the spliced positions and edges on the spliced images according to the target subarea.
Wherein the correcting the spliced part and the edge on the spliced image according to the target sub-region comprises:
and performing position correction and chromaticity correction on the spliced position and the edge on the spliced image.
In a second aspect, the present invention provides a device for correcting a stitched image, comprising:
the acquisition unit is used for acquiring sub-images corresponding to all areas on a target scene and a panoramic image corresponding to the target scene; wherein the target scene is divided into a plurality of regions;
the splicing unit is used for splicing the sub-images corresponding to the areas to obtain a spliced image of the target scene;
and the correction unit is used for correcting the spliced image of the target scene based on the panoramic image corresponding to the target scene.
Wherein, the collection unit includes:
the first acquisition subunit is used for acquiring an image of the target area by adopting a low-power objective lens to obtain a panoramic image corresponding to the target scene;
and the second acquisition subunit is used for respectively acquiring images of each area on the target area by adopting a high-power objective lens to obtain sub-images corresponding to each area on the target scene.
Wherein, the concatenation unit includes:
the image characteristic subunit is used for determining the respective corresponding overlapping areas of the sub-images and extracting the respective corresponding image characteristics of the overlapping areas;
and the image processing subunit is used for splicing any two adjacent sub-images according to the image characteristics to obtain a spliced image of the target scene.
Wherein the correction unit includes:
the amplification subunit is used for amplifying the panoramic image so as to enable the scale of the panoramic image to be the same as that of the spliced image;
the correction area subunit is used for determining a target subarea on the amplified panoramic image;
and the syndrome unit is used for correcting the spliced positions and edges on the spliced image according to the target sub-region.
Wherein the syndrome unit includes:
and the correction module is used for carrying out position correction and chromaticity correction on the spliced position and the edge on the spliced image.
In a third aspect, the present invention provides an electronic device, comprising a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the stitched image correction method when executing the program.
In a fourth aspect, the present invention provides a computer readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of the stitched image correction method described herein.
According to the technical scheme, the invention provides the method and the device for correcting the spliced image, which are characterized in that the sub-images corresponding to all the areas on the target scene and the panoramic image corresponding to the target scene are obtained; wherein the target scene is divided into a plurality of regions; splicing the sub-images corresponding to the areas to obtain a spliced image of the target scene; and correcting the spliced image of the target scene based on the panoramic image corresponding to the target scene, so that the distortion degree of a spliced area on the spliced image and the divergence degree of edges can be reduced, and the edge sharpness of the spliced image and the transition degree of the spliced area are more natural.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a schematic flow chart of a stitched image correction method in an embodiment of the present invention.
Fig. 2 is a schematic flowchart of step S103 in the method for correcting a stitched image according to the embodiment of the present invention.
Fig. 3 is a schematic structural diagram of a stitched image correction device in an embodiment of the present invention.
Fig. 4 is a schematic structural diagram of a correction unit in the stitched image correction device according to the embodiment of the present invention.
Fig. 5 is a schematic structural diagram of an electronic device in an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The invention provides an embodiment of a method for correcting a spliced image, which specifically comprises the following contents in reference to fig. 1:
s101: acquiring sub-images corresponding to all areas on a target scene and a panoramic image corresponding to the target scene; wherein the target scene is divided into a plurality of regions;
when the high-resolution microscopic image is collected, a proper low-power objective lens is selected according to the size of a tiny object to collect a wide-field panoramic image of a target scene, wherein the target scene refers to an interested area on the microscopic image. And carrying out regional acquisition on the target scene under a high-power objective lens. One panoramic image (i.e., a wide-field image) and a plurality of sub-images (i.e., high-resolution sub-images) can be obtained.
S102: splicing the sub-images corresponding to the areas to obtain a spliced image of the target scene;
in the step, the image registration and image fusion method based on the image characteristics realizes the splicing of two or more images. The registration method based on the image features is to derive the image features of the sub-images through the pixels of the sub-images, and then search and match corresponding feature areas of the overlapping parts of the adjacent sub-images by taking the image features as a standard.
It should be noted that the registration method based on image features has two processes: feature extraction and feature registration. Firstly, extracting the characteristics of points, lines, areas and the like with obvious gray level change from two adjacent sub-images to form a characteristic set network. And then selecting the feature pairs with corresponding relations as much as possible in the feature sets corresponding to the two adjacent images by using a feature matching algorithm. And finally, projecting the sub-images to be spliced to the same curved surface after the sub-images are deformed, and completing splicing. Any image can be spliced based on the method.
In specific implementation, when a plurality of sub-images are spliced, because uncertain factors such as parallax, lens distortion, scene motion, exposure difference and the like exist among the sub-images, the spliced images after splicing usually have splicing gaps, abrupt chromaticity change, edge divergence and the like.
S103: and correcting the spliced image of the target scene based on the panoramic image corresponding to the target scene.
In this step, the stitched image after the stitching process is corrected based on the panoramic image corresponding to the target scene, so that the divergence of the edge area of the stitched image is eliminated, and the stitching gap and the abrupt change of chromaticity at the stitching position of the stitched image are eliminated.
As can be seen from the above description, in the method for correcting a stitched image according to the embodiment of the present invention, sub-images corresponding to respective areas on a target scene and a panoramic image corresponding to the target scene are obtained; wherein the target scene is divided into a plurality of regions; splicing the sub-images corresponding to the areas to obtain a spliced image of the target scene; and correcting the spliced image of the target scene based on the panoramic image corresponding to the target scene, so that the distortion degree of a spliced area on the spliced image and the divergence degree of edges can be reduced, and the edge sharpness of the spliced image and the transition degree of the spliced area are more natural.
In an embodiment of the present invention, an implementation manner of step S102 in the foregoing embodiment is provided, and a specific implementation process is as follows:
A. acquiring each subimage to be spliced;
B. extracting the respective corresponding characteristics of each subimage;
in the step, (a) reading n sub-images of different fields under the same magnification;
(b) extracting input SURF characteristic vectors of n sub-images under different views;
(c) constructing a Hessian matrix: the filtered Hessian matrix can be simplified as follows: calculating an H matrix discriminant, and judging whether the H matrix discriminant is greater than 0 or less than 0 to determine whether the point is an extreme point or not;
(d) constructing a Gaussian pyramid scale space by using a Hessian matrix, and rolling the box filters with different scales and the original image to ensure that the original sub-image is kept unchanged and only the size of the filter is changed;
(e) firstly, determining candidate points by using a Hessian matrix, then preliminarily determining characteristic points by suppressing a non-maximum value, and further accurately defining the characteristic points by filtering key points with weaker energy and key points with wrong positioning;
(f) and finally, computing haar wavelet responses in the x and y directions in each sector range in the circular neighborhood of the feature points, finding out the sector direction with the maximum modulus, and taking the sector direction as the main direction of the feature points, namely completing the extraction of 64-dimensional SURF feature vectors.
C. Matching features of the sub-images;
in the step, (a) two adjacent sub-images A, B are selected from the plurality of sub-images, the key points of A and B are generated by using the step B, and the standardized Euclidean distance of SURF feature vectors of the key points is used as the basis for detecting the similarity of the key points of the two sub-images;
(b) finding the closest 2 matching points in B for each key point in A through violent search;
(c) and (c) for the two matching points in the step (b), if the standard Euclidean distance of the nearest point divided by the standard Euclidean distance of the next nearest point is less than a certain proportional threshold, accepting the pair of matching points. To ensure the stability of feature matching, we specifically define the scaling threshold here to be 0.5.
D. And (5) splicing and synthesizing the subimages.
(a) Finding out consistency matching by adopting an ICP (inductively coupled plasma) algorithm, so that key points of the two sub-images correspond to one another;
(b) training by adopting VGG16 to obtain a feature matrix of all sub-images, and verifying the validity of image matching on the basis; VGG16 is a CNN of 16-tier network, with 13 convolutional layers, 3 full link layers;
(c) after the matching is verified to be effective, finding out a connected component in the matched sub-image;
(d) finding out a proper rotation angle and a proper matching connection point for each connected component;
(e) performing rendering optimization by adopting filtering, and smoothly connecting to complete splicing and synthesizing of the sub-images;
(f) and obtaining a spliced image with complete slices.
In an embodiment of the present invention, an implementation manner of step S103 in the foregoing embodiment is provided, and referring to fig. 2, a specific implementation process is as follows:
s1031: amplifying the panoramic image to enable the scale of the panoramic image to be the same as that of the spliced image;
in the step, the wide field image obtained under the low-power lens is amplified in equal proportion to the degree of the same proportion as the sub-image under the high-power lens;
s1032: determining a target subarea on the amplified panoramic image;
it should be noted that the target sub-region is an edge that needs to be corrected on the stitched image and a projection of the stitched image on the panoramic image after the enlargement processing. The two images should be one hundred percent overlapped except for the difference in resolution between the magnified panoramic image and the stitched image.
S1033: and correcting the spliced positions and edges on the spliced images according to the target subarea.
In this step, the geometric correspondence between the panoramic image and the stitched image is established so that they can be transformed, compared and analyzed in a common frame of reference.
The panoramic image and the spliced image are overlapped, the panoramic image is used as a substrate, the edge and the seam area (spliced part) of the spliced image are corrected, and the phenomena of edge divergence, seam distortion and the like are eliminated. Specifically, position correction and chromaticity correction are carried out on the spliced position and the edge on the spliced image.
It can be understood that the panoramic image amplified by the equal scale is used as a substrate, the panoramic image and the spliced image are overlapped through feature extraction and image registration, and the edge and the seam area of the spliced image are corrected, so that the problems of distortion of the spliced area between the spliced images and edge divergence of the spliced image can be solved.
As can be seen from the above description, in the embodiment of the present invention, the panoramic image obtained under the low-power lens is used to correct the stitched image under the high-power lens, so as to eliminate the distortion at the stitched region of the stitched image and the problem of edge divergence of the stitched image, and thus the edge sharpness of the stitched image and the transition degree of the stitched region are more natural.
An embodiment of the present invention provides a specific implementation manner of a stitched image correction device capable of implementing all contents in the stitched image correction method, and referring to fig. 3, the stitched image correction device specifically includes the following contents:
the device comprises an acquisition unit 10, a processing unit and a display unit, wherein the acquisition unit is used for acquiring sub-images corresponding to all areas on a target scene and a panoramic image corresponding to the target scene; wherein the target scene is divided into a plurality of regions;
the splicing unit 20 is configured to splice the sub-images corresponding to the respective regions to obtain a spliced image of the target scene;
a correcting unit 30, configured to correct the stitched image of the target scene based on the panoramic image corresponding to the target scene.
Wherein the acquisition unit 10 comprises:
the first acquisition subunit is used for acquiring an image of the target area by adopting a low-power objective lens to obtain a panoramic image corresponding to the target scene;
and the second acquisition subunit is used for respectively acquiring images of each area on the target area by adopting a high-power objective lens to obtain sub-images corresponding to each area on the target scene.
Wherein the splicing unit 20 includes:
the image characteristic subunit is used for determining the respective corresponding overlapping areas of the sub-images and extracting the respective corresponding image characteristics of the overlapping areas;
and the image processing subunit is used for splicing any two adjacent sub-images according to the image characteristics to obtain a spliced image of the target scene.
In an embodiment of the present invention, referring to fig. 4, a specific structure of a calibration unit in the above apparatus embodiment is provided, including:
an enlarging subunit 31, configured to enlarge the panoramic image so that a scale of the panoramic image is the same as a scale of the stitched image;
a correction sub-unit 32, configured to determine a target sub-area on the magnified panoramic image;
and a syndrome unit 33, configured to correct the joint and the edge on the joint image according to the target sub-region.
Wherein the syndrome unit 33 includes:
and the correction module is used for carrying out position correction and chromaticity correction on the spliced position and the edge on the spliced image.
The embodiment of the device for correcting a stitched image according to the present invention may be specifically used to execute the processing procedure of the embodiment of the method for correcting a stitched image in the above embodiment, and the functions of the device for correcting a stitched image are not described herein again, and refer to the detailed description of the embodiment of the method.
As can be seen from the above description, the device for correcting a stitched image according to the embodiment of the present invention obtains the sub-images corresponding to the respective regions on the target scene and the panoramic image corresponding to the target scene; wherein the target scene is divided into a plurality of regions; splicing the sub-images corresponding to the areas to obtain a spliced image of the target scene; and correcting the spliced image of the target scene based on the panoramic image corresponding to the target scene, so that the distortion degree of a spliced area on the spliced image and the divergence degree of edges can be reduced, and the edge sharpness of the spliced image and the transition degree of the spliced area are more natural.
The application provides an embodiment of an electronic device for implementing all or part of contents in the stitched image correction method, where the electronic device specifically includes the following contents:
a processor (processor), a memory (memory), a communication Interface (Communications Interface), and a bus; the processor, the memory and the communication interface complete mutual communication through the bus; the communication interface is used for realizing information transmission between related devices; the electronic device may be a desktop computer, a tablet computer, a mobile terminal, and the like, but the embodiment is not limited thereto. In this embodiment, the electronic device may be implemented with reference to the embodiment for implementing the method for correcting the stitched image and the embodiment for implementing the device for correcting the stitched image in the embodiments, and the contents thereof are incorporated herein, and repeated details are not repeated.
Fig. 5 is a schematic block diagram of a system configuration of an electronic device 9600 according to an embodiment of the present application. As shown in fig. 5, the electronic device 9600 can include a central processor 9100 and a memory 9140; the memory 9140 is coupled to the central processor 9100. Notably, this FIG. 5 is exemplary; other types of structures may also be used in addition to or in place of the structure to implement telecommunications or other functions.
In one embodiment, the stitched image correction functionality may be integrated into the central processor 9100. The central processor 9100 may be configured to control as follows:
acquiring sub-images corresponding to all areas on a target scene and a panoramic image corresponding to the target scene; wherein the target scene is divided into a plurality of regions;
splicing the sub-images corresponding to the areas to obtain a spliced image of the target scene;
and correcting the spliced image of the target scene based on the panoramic image corresponding to the target scene.
As can be seen from the above description, in the electronic device provided in the embodiment of the present application, the sub-images corresponding to the respective areas on the target scene and the panoramic image corresponding to the target scene are obtained; wherein the target scene is divided into a plurality of regions; splicing the sub-images corresponding to the areas to obtain a spliced image of the target scene; and correcting the spliced image of the target scene based on the panoramic image corresponding to the target scene, so that the distortion degree of a spliced area on the spliced image and the divergence degree of edges can be reduced, and the edge sharpness of the spliced image and the transition degree of the spliced area are more natural.
In another embodiment, the stitched image correction apparatus may be configured separately from the central processor 9100, for example, the stitched image correction apparatus may be configured as a chip connected to the central processor 9100, and the stitched image correction function is realized by the control of the central processor.
As shown in fig. 5, the electronic device 9600 may further include: a communication module 9110, an input unit 9120, an audio processor 9130, a display 9160, and a power supply 9170. It is noted that the electronic device 9600 also does not necessarily include all of the components shown in fig. 5; further, the electronic device 9600 may further include components not shown in fig. 5, which may be referred to in the art.
As shown in fig. 5, a central processor 9100, sometimes referred to as a controller or operational control, can include a microprocessor or other processor device and/or logic device, which central processor 9100 receives input and controls the operation of the various components of the electronic device 9600.
The memory 9140 can be, for example, one or more of a buffer, a flash memory, a hard drive, a removable media, a volatile memory, a non-volatile memory, or other suitable device. The information relating to the failure may be stored, and a program for executing the information may be stored. And the central processing unit 9100 can execute the program stored in the memory 9140 to realize information storage or processing, or the like.
The input unit 9120 provides input to the central processor 9100. The input unit 9120 is, for example, a key or a touch input device. Power supply 9170 is used to provide power to electronic device 9600. The display 9160 is used for displaying display objects such as images and characters. The display may be, for example, an LCD display, but is not limited thereto.
The memory 9140 can be a solid state memory, e.g., Read Only Memory (ROM), Random Access Memory (RAM), a SIM card, or the like. There may also be a memory that holds information even when power is off, can be selectively erased, and is provided with more data, an example of which is sometimes called an EPROM or the like. The memory 9140 could also be some other type of device. Memory 9140 includes a buffer memory 9141 (sometimes referred to as a buffer). The memory 9140 may include an application/function storage portion 9142, the application/function storage portion 9142 being used for storing application programs and function programs or for executing a flow of operations of the electronic device 9600 by the central processor 9100.
The memory 9140 can also include a data store 9143, the data store 9143 being used to store data, such as contacts, digital data, pictures, sounds, and/or any other data used by an electronic device. The driver storage portion 9144 of the memory 9140 may include various drivers for the electronic device for communication functions and/or for performing other functions of the electronic device (e.g., messaging applications, contact book applications, etc.).
The communication module 9110 is a transmitter/receiver 9110 that transmits and receives signals via an antenna 9111. The communication module (transmitter/receiver) 9110 is coupled to the central processor 9100 to provide input signals and receive output signals, which may be the same as in the case of a conventional mobile communication terminal.
Based on different communication technologies, a plurality of communication modules 9110, such as a cellular network module, a bluetooth module, and/or a wireless local area network module, may be provided in the same electronic device. The communication module (transmitter/receiver) 9110 is also coupled to a speaker 9131 and a microphone 9132 via an audio processor 9130 to provide audio output via the speaker 9131 and receive audio input from the microphone 9132, thereby implementing ordinary telecommunications functions. The audio processor 9130 may include any suitable buffers, decoders, amplifiers and so forth. In addition, the audio processor 9130 is also coupled to the central processor 9100, thereby enabling recording locally through the microphone 9132 and enabling locally stored sounds to be played through the speaker 9131.
An embodiment of the present invention further provides a computer-readable storage medium capable of implementing all the steps in the stitched image correction method in the above embodiment, where the computer-readable storage medium stores thereon a computer program, and when the computer program is executed by a processor, the computer program implements all the steps in the stitched image correction method in the above embodiment, for example, when the processor executes the computer program, the processor implements the following steps:
acquiring sub-images corresponding to all areas on a target scene and a panoramic image corresponding to the target scene; wherein the target scene is divided into a plurality of regions;
splicing the sub-images corresponding to the areas to obtain a spliced image of the target scene;
and correcting the spliced image of the target scene based on the panoramic image corresponding to the target scene.
As can be seen from the above description, in the computer-readable storage medium provided in the embodiment of the present invention, the sub-images corresponding to the respective areas on the target scene and the panoramic image corresponding to the target scene are obtained; wherein the target scene is divided into a plurality of regions; splicing the sub-images corresponding to the areas to obtain a spliced image of the target scene; and correcting the spliced image of the target scene based on the panoramic image corresponding to the target scene, so that the distortion degree of a spliced area on the spliced image and the divergence degree of edges can be reduced, and the edge sharpness of the spliced image and the transition degree of the spliced area are more natural.
Although the present invention provides method steps as described in the examples or flowcharts, more or fewer steps may be included based on routine or non-inventive labor. The order of steps recited in the embodiments is merely one manner of performing the steps in a multitude of orders and does not represent the only order of execution. When an actual apparatus or client product executes, it may execute sequentially or in parallel (e.g., in the context of parallel processors or multi-threaded processing) according to the embodiments or methods shown in the figures.
As will be appreciated by one skilled in the art, embodiments of the present description may be provided as a method, apparatus (system) or computer program product. Accordingly, embodiments of the present description may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment. In this document, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. It should be noted that the embodiments and features of the embodiments may be combined with each other without conflict. The present invention is not limited to any single aspect, nor is it limited to any single embodiment, nor is it limited to any combination and/or permutation of these aspects and/or embodiments. Moreover, each aspect and/or embodiment of the present invention may be utilized alone or in combination with one or more other aspects and/or embodiments thereof.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; such modifications and substitutions do not depart from the spirit and scope of the present invention, and they should be construed as being included in the following claims and description.
Claims (12)
1. A method for correcting a stitched image, comprising:
acquiring sub-images corresponding to all areas on a target scene and a panoramic image corresponding to the target scene; wherein the target scene is divided into a plurality of regions;
splicing the sub-images corresponding to the areas to obtain a spliced image of the target scene;
and correcting the spliced image of the target scene based on the panoramic image corresponding to the target scene.
2. The method for correcting the stitched images according to claim 1, wherein the acquiring the sub-images corresponding to the respective regions of the target scene and the panoramic image corresponding to the target scene comprises:
acquiring an image of the target area by adopting a low-power objective lens to obtain a panoramic image corresponding to the target scene;
and respectively carrying out image acquisition on each area on the target area by adopting a high-power objective lens to obtain sub-images corresponding to each area on the target scene.
3. The method for correcting the stitched image according to claim 1, wherein the stitching the sub-images corresponding to the respective regions to obtain the stitched image of the target scene comprises:
determining an overlapping area corresponding to each sub-image and extracting image characteristics corresponding to each overlapping area;
and splicing any two adjacent sub-images according to the image characteristics to obtain a spliced image of the target scene.
4. The method for correcting the stitched image according to claim 1, wherein the correcting the stitched image of the target scene based on the panoramic image corresponding to the target scene comprises:
amplifying the panoramic image to enable the scale of the panoramic image to be the same as that of the spliced image;
determining a target subarea on the amplified panoramic image;
and correcting the spliced positions and edges on the spliced images according to the target subarea.
5. The method for correcting the spliced image according to claim 4, wherein the correcting the spliced positions and the edges on the spliced image according to the target sub-regions comprises:
and performing position correction and chromaticity correction on the spliced position and the edge on the spliced image.
6. A stitched image correction apparatus, comprising:
the acquisition unit is used for acquiring sub-images corresponding to all areas on a target scene and a panoramic image corresponding to the target scene; wherein the target scene is divided into a plurality of regions;
the splicing unit is used for splicing the sub-images corresponding to the areas to obtain a spliced image of the target scene;
and the correction unit is used for correcting the spliced image of the target scene based on the panoramic image corresponding to the target scene.
7. The stitched image correction apparatus of claim 6, wherein the acquisition unit comprises:
the first acquisition subunit is used for acquiring an image of the target area by adopting a low-power objective lens to obtain a panoramic image corresponding to the target scene;
and the second acquisition subunit is used for respectively acquiring images of each area on the target area by adopting a high-power objective lens to obtain sub-images corresponding to each area on the target scene.
8. The stitched image correction apparatus of claim 6, wherein the stitching unit comprises:
the image characteristic subunit is used for determining the respective corresponding overlapping areas of the sub-images and extracting the respective corresponding image characteristics of the overlapping areas;
and the image processing subunit is used for splicing any two adjacent sub-images according to the image characteristics to obtain a spliced image of the target scene.
9. The stitched image correction apparatus of claim 6, wherein the correction unit comprises:
the amplification subunit is used for amplifying the panoramic image so as to enable the scale of the panoramic image to be the same as that of the spliced image;
the correction area subunit is used for determining a target subarea on the amplified panoramic image;
and the syndrome unit is used for correcting the spliced positions and edges on the spliced image according to the target sub-region.
10. The stitched image correction apparatus of claim 9, wherein the syndrome unit comprises:
and the correction module is used for carrying out position correction and chromaticity correction on the spliced position and the edge on the spliced image.
11. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the steps of the method of correcting a stitched image according to any one of claims 1 to 5 are implemented by the processor when executing the program.
12. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the stitched image correction method of any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010756675.4A CN111915521B (en) | 2020-07-31 | 2020-07-31 | Spliced image correction method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010756675.4A CN111915521B (en) | 2020-07-31 | 2020-07-31 | Spliced image correction method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111915521A true CN111915521A (en) | 2020-11-10 |
| CN111915521B CN111915521B (en) | 2024-08-02 |
Family
ID=73287419
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010756675.4A Active CN111915521B (en) | 2020-07-31 | 2020-07-31 | Spliced image correction method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111915521B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115937050A (en) * | 2023-03-02 | 2023-04-07 | 图兮数字科技(北京)有限公司 | Image processing method, image processing device, electronic equipment and storage medium |
| CN117438056A (en) * | 2023-12-20 | 2024-01-23 | 达州市中心医院(达州市人民医院) | Editing, screening and storage control method and system for digestive endoscopy image data |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101751659A (en) * | 2009-12-24 | 2010-06-23 | 北京优纳科技有限公司 | Large-volume rapid image splicing method |
| US9589350B1 (en) * | 2013-05-30 | 2017-03-07 | 360 Lab Llc. | Utilizing three overlapping images for exposure correction during panoramic image stitching |
| CN106651767A (en) * | 2016-12-30 | 2017-05-10 | 北京星辰美豆文化传播有限公司 | Panoramic image obtaining method and apparatus |
| CN107465906A (en) * | 2017-08-09 | 2017-12-12 | 广东欧珀移动通信有限公司 | Panorama shooting method, device and the terminal device of scene |
| CN107945113A (en) * | 2017-11-17 | 2018-04-20 | 北京天睿空间科技股份有限公司 | The antidote of topography's splicing dislocation |
-
2020
- 2020-07-31 CN CN202010756675.4A patent/CN111915521B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101751659A (en) * | 2009-12-24 | 2010-06-23 | 北京优纳科技有限公司 | Large-volume rapid image splicing method |
| US9589350B1 (en) * | 2013-05-30 | 2017-03-07 | 360 Lab Llc. | Utilizing three overlapping images for exposure correction during panoramic image stitching |
| CN106651767A (en) * | 2016-12-30 | 2017-05-10 | 北京星辰美豆文化传播有限公司 | Panoramic image obtaining method and apparatus |
| CN107465906A (en) * | 2017-08-09 | 2017-12-12 | 广东欧珀移动通信有限公司 | Panorama shooting method, device and the terminal device of scene |
| CN107945113A (en) * | 2017-11-17 | 2018-04-20 | 北京天睿空间科技股份有限公司 | The antidote of topography's splicing dislocation |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115937050A (en) * | 2023-03-02 | 2023-04-07 | 图兮数字科技(北京)有限公司 | Image processing method, image processing device, electronic equipment and storage medium |
| CN115937050B (en) * | 2023-03-02 | 2023-10-13 | 图兮数字科技(北京)有限公司 | Image processing method, device, electronic equipment and storage medium |
| CN117438056A (en) * | 2023-12-20 | 2024-01-23 | 达州市中心医院(达州市人民医院) | Editing, screening and storage control method and system for digestive endoscopy image data |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111915521B (en) | 2024-08-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110622497B (en) | Device with cameras having different focal lengths and method of implementing a camera | |
| US20230388638A1 (en) | Dual aperture zoom camera with video support and switching / non-switching dynamic control | |
| US10789671B2 (en) | Apparatus, system, and method of controlling display, and recording medium | |
| CN107409166B (en) | Automatic generation of panning shots | |
| CN108965742B (en) | Special-shaped screen display method and device, electronic equipment and computer readable storage medium | |
| US8217956B1 (en) | Method and apparatus for rendering spherical panoramas | |
| US20180160046A1 (en) | Depth-based zoom function using multiple cameras | |
| CN109691080B (en) | Image shooting method and device and terminal | |
| JP5757592B2 (en) | Method, apparatus and computer program product for generating super-resolution images | |
| CN112584034B (en) | Image processing method, image processing device and electronic equipment applying same | |
| CN111915521B (en) | Spliced image correction method and device | |
| EP2842105B1 (en) | Method, apparatus and computer program product for generating panorama images | |
| CN112367459A (en) | Image processing method, electronic device, and non-volatile computer-readable storage medium | |
| CN101727663A (en) | Method and system for image deblurring | |
| CN114022662B (en) | Image recognition method, device, equipment and medium | |
| JP2007241356A (en) | Image processor and image processing program | |
| US8908988B2 (en) | Method and system for recovering a code image including blurring | |
| CN113592720B (en) | Image scaling processing method, device, equipment and storage medium | |
| KR20230017774A (en) | Information processing device, information processing method, and program | |
| JP6838918B2 (en) | Image data processing device and method | |
| JP4898655B2 (en) | Imaging apparatus and image composition program | |
| JP5562812B2 (en) | Transmission / reception switching circuit, radio apparatus, and transmission / reception switching method | |
| CN111754435A (en) | Image processing method, image processing device, terminal equipment and computer readable storage medium | |
| CN110896444B (en) | Double-camera switching method and equipment | |
| JP5458877B2 (en) | Imaging apparatus and imaging program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |