CN111145309B

CN111145309B - Image superposition method and related equipment

Info

Publication number: CN111145309B
Application number: CN201911309680.4A
Authority: CN
Inventors: 李晨楠
Original assignee: Shenzhen Wanyi Digital Technology Co ltd
Current assignee: Shenzhen Wanyi Digital Technology Co ltd
Priority date: 2019-12-18
Filing date: 2019-12-18
Publication date: 2023-07-28
Anticipated expiration: 2039-12-18
Also published as: CN111145309A

Abstract

The application discloses an image superposition method and related equipment, which are applied to electronic equipment, wherein the method comprises the following steps: acquiring N CAD images to be superimposed, wherein N is an integer greater than 1; determining the superposition sequence and superposition direction of the N CAD images; and superposing the N CAD images based on the superposition order and the superposition direction to obtain a superposition file. By adopting the embodiment of the application, the image superposition efficiency can be improved.

Description

Image superposition method and related equipment

Technical Field

The present disclosure relates to the field of image processing technologies, and in particular, to an image stacking method and related devices.

Background

With the development of digital display technology, digital processing of images is becoming more and more common. Compared with the traditional paper image, the digitized image is favorable for storage and editing. However, the present digital processing of images is mainly focused on editing a single image, and lacks collective processing of a plurality of images having an inherent relationship. For example, in the field of building construction, a large number of closely related images are included in a construction file, and the images are subjected to superposition processing, so that precious data can be provided for subsequent inspection before construction, guidance in construction and maintenance after construction, and the manner of gradually clearing the internal links of the images and then superposing the images is low in efficiency.

Disclosure of Invention

The embodiment of the application provides an image superposition method and related equipment, which are used for improving the image superposition efficiency.

In a first aspect, an embodiment of the present application provides an image superimposition method, applied to an electronic device, where the method includes:

acquiring N CAD images to be superimposed, wherein N is an integer greater than 1;

determining the superposition sequence and superposition direction of the N CAD images;

and superposing the N CAD images based on the superposition order and the superposition direction to obtain a superposition file.

In a second aspect, an embodiment of the present application provides an image superimposing apparatus, applied to an electronic device, where the apparatus includes:

the acquisition unit is used for acquiring N CAD images to be superimposed, wherein N is an integer greater than 1;

the determining unit is used for determining the superposition sequence and the superposition direction of the N CAD images;

and the stacking unit is used for stacking the N CAD images based on the stacking sequence and the stacking direction to obtain a stacking file.

In a third aspect, embodiments of the present application provide an electronic device comprising a processor, a memory, a communication interface, and one or more programs stored in the memory and configured to be executed by the processor, the programs comprising instructions for performing part or all of the steps described in the method of the first aspect of embodiments of the present application.

In a fourth aspect, embodiments of the present application provide a computer readable storage medium, where the computer readable storage medium is used to store a computer program, where the computer program is executed by a processor to implement some or all of the steps described in the method according to the first aspect of the embodiments of the present application.

In a fifth aspect, embodiments of the present application provide a computer program product, wherein the computer program product comprises a non-transitory computer readable storage medium storing a computer program, the computer program being operable to cause a computer to perform some or all of the steps described in the method according to the first aspect of the embodiments of the present application. The computer program product may be a software installation package.

It can be seen that, in the embodiment of the present application, the electronic device acquires N CAD images to be superimposed; determining the superposition sequence and superposition direction of the N CAD images; and overlapping the N CAD images based on the overlapping sequence and the overlapping direction to obtain an overlapping file, so that the steps of manual alignment and overlapping are reduced, and the image overlapping efficiency is improved.

These and other aspects of the present application will be more readily apparent from the following description of the embodiments.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a schematic hardware structure of an electronic device according to an embodiment of the present application;

fig. 2 is a schematic flow chart of an image overlaying method according to an embodiment of the present application;

fig. 3 is a schematic flow chart of another image overlaying method according to an embodiment of the present application;

fig. 4 is a schematic structural diagram of another electronic device according to an embodiment of the present application;

fig. 5 is a schematic structural diagram of an image superimposing apparatus according to an embodiment of the present application.

Detailed Description

In order to make the present application solution better understood by those skilled in the art, the following description will be made in detail and with reference to the accompanying drawings in the embodiments of the present application, it is apparent that the described embodiments are only some embodiments of the present application, not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art based on the embodiments herein without making any inventive effort, shall fall within the scope of the present application.

The following will describe in detail.

The terms "first," "second," "third," and "fourth" and the like in the description and in the claims of this application and in the drawings, are used for distinguishing between different objects and not for describing a particular sequential order. Furthermore, the terms "comprise" and "have," as well as any variations thereof, are intended to cover a non-exclusive inclusion. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those listed steps or elements but may include other steps or elements not listed or inherent to such process, method, article, or apparatus.

Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least one embodiment of the present application. The appearances of such phrases in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. Those of skill in the art will explicitly and implicitly appreciate that the embodiments described herein may be combined with other embodiments.

In the following, some terms in the present application are explained for easy understanding by those skilled in the art.

As shown in fig. 1, fig. 1 is a schematic hardware structure of an electronic device according to an embodiment of the present application. The electronic device includes a processor, memory, signal processor, communication interface, display screen, speaker, microphone, random access memory (Random Access Memory, RAM), camera module, sensor, and the like. The device comprises a memory, a signal processor, a display screen, a loudspeaker, a microphone, a RAM, a camera module, a sensor and an IR, wherein the memory, the signal processor, the display screen, the loudspeaker, the microphone, the RAM, the camera module, the sensor and the IR are connected with the processor, and the communication interface is connected with the signal processor.

The display screen may be a liquid crystal display (Liquid Crystal Display, LCD), an Organic Light-Emitting Diode (OLED), an Active Matrix Organic Light-Emitting Diode panel (AMOLED), or the like.

The camera module may include a common camera or an infrared camera, which is not limited herein. The camera may be a front camera or a rear camera, which is not limited herein.

Wherein the sensor comprises at least one of: light sensing sensors, gyroscopes, infrared light (Infrared light source, IR) sensors, fingerprint sensors, pressure sensors, and the like. Wherein a light sensor, also called ambient light sensor, is used to detect the ambient light level. The light sensor may comprise a photosensitive element and an analog-to-digital converter. The photosensitive element is used for converting the collected optical signals into electric signals, and the analog-to-digital converter is used for converting the electric signals into digital signals. Optionally, the optical sensor may further include a signal amplifier, where the signal amplifier may amplify the electrical signal converted by the photosensitive element and output the amplified electrical signal to the analog-to-digital converter. The photosensitive element may include at least one of a photodiode, a phototransistor, a photoresistor, and a silicon photocell.

The processor is a control center of the electronic device, and is connected with various parts of the whole electronic device by various interfaces and lines, and executes various functions of the electronic device and processes data by running or executing software programs and/or modules stored in the memory and calling data stored in the memory, so that the electronic device is monitored as a whole.

The processor may integrate an application processor and a modem processor, wherein the application processor primarily handles operating systems, user interfaces, applications, etc., and the modem processor primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor.

The memory is used for storing software programs and/or modules, and the processor executes the software programs and/or modules stored in the memory so as to execute various functional applications of the electronic device and data processing. The memory may mainly include a memory program area and a memory data area, wherein the memory program area may store an operating system, a software program required for at least one function, and the like; the storage data area may store data created according to the use of the electronic device, etc. In addition, the memory may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device.

The working principle of the embodiment of the application is as follows:

As shown in fig. 2, fig. 2 is a flowchart of an image overlaying method provided in an embodiment of the present application, and the method is applied to an electronic device, and includes:

step 201: and acquiring N CAD images to be superimposed, wherein N is an integer greater than 1.

Step 202: and determining the superposition sequence and the superposition direction of the N CAD images.

Step 203: and superposing the N CAD images based on the superposition order and the superposition direction to obtain a superposition file.

Among them, computer aided design (Computer Aided Design, CAD) refers to the use of a computer and its graphic equipment to assist a designer in performing design work. CAD graphics refer to file diagrams made by CAD software and are widely applied to industries such as machinery, electronics, aerospace, chemical industry, construction and the like. In the application process of each industry, a plurality of CAD images are usually included, and different angles and details of the same object need to be described, and because the angles and details have internal connection with each other, the stacking sequence and stacking direction are also required.

Further, after the N CAD images to be superimposed are acquired, the method further includes:

numbering the N CAD images, wherein each CAD image corresponds to one number;

and determining the number of the CAD images according to the number, and determining the superposition sequence of the N CAD images.

In an implementation manner of the present application, the stacking the N CAD images based on the stacking order and the stacking direction to obtain a stacked file includes:

if the pixel arrangement information carried by the N CAD images is the same, determining coordinates corresponding to pixels included in the N CAD images to obtain N first coordinate sets;

determining a first coordinate mapping relation among the N first coordinate sets based on the superposition order and the superposition direction;

and superposing the N CAD images based on the first coordinate mapping relation to obtain a superposition file.

Further, the method further comprises:

if the N CAD images all comprise m multiplied by N pixels, determining that the pixel arrangement information carried by the N CAD images is the same, wherein m is the number of rows of pixels carried by the N CAD images, N is the number of columns of pixels carried by the N CAD images, and both m and N are positive integers.

In an implementation manner of the present application, the method further includes:

if the pixel arrangement information carried by the N CAD images is different, determining whether the N CAD images comprise the same area;

if the N CAD images comprise the same area, determining coordinates corresponding to the same area in the N CAD images to obtain N second coordinate sets;

determining a second coordinate mapping relation between the N second coordinate sets based on the superposition order and the superposition direction;

and superposing the N CAD images based on the second coordinate mapping relation to obtain a superposition file.

Illustrating: assuming that the CAD image i and the CAD image j comprise k pixels, the pixel values of the k pixels are the same, and the coordinate positions of the k pixels are in one-to-one correspondence, determining that the region formed by the k pixels is the same region of the CAD image i and the CAD image j.

if the N CAD images do not comprise the same area, determining one of the N CAD images as a reference image;

scaling the rest N-1 CAD images except the reference image based on the reference image to obtain scaled N-1 CAD images, wherein pixel arrangement information carried by the scaled N-1 CAD images is the same as pixel arrangement information carried by the reference image;

determining coordinates corresponding to pixels included in the reference image and coordinates corresponding to pixels included in the scaled N-1 CAD images to obtain N third coordinate sets;

determining a third coordinate mapping relation among the N third coordinate sets based on the superposition order and the superposition direction;

and superposing the reference image and the rest N-1 CAD images based on the third coordinate mapping relation to obtain a superposition file.

For example, assuming that the pixel arrangement information carried by the CAD image i is m×n and the pixel arrangement information carried by the CAD image j is m/2×n/2, if the CAD image i is taken as the reference image, the CAD image j can be enlarged by two times; if the CAD image j is taken as a reference image, the CAD image i can be amplified by two times; and scaling the CAD image i and the CAD image j by taking other CAD images as reference images.

Further, the determining one of the N CAD images as a reference image includes:

determining N definition, N image sizes and N geometric feature sets of the N CAD drawings, wherein the N definition, the N image sizes and the N geometric feature sets are in one-to-one correspondence with the N CAD images;

determining N first values corresponding to the N definition, N second values corresponding to the N image sizes, and N third values corresponding to the N geometric feature sets;

determining a first weight corresponding to definition, a second weight corresponding to image size and a third weight corresponding to geometric features, wherein the sum of the first weight, the second weight and the third weight is 1;

determining N image quality evaluation values based on the N first values, the N second values, the N third values, the first weights, the second weights, and the third weights, the N quality evaluation values being used to evaluate the quality of the N CAD images;

and determining the CAD image corresponding to the largest image quality evaluation value in the N image quality evaluation values as a reference image.

Wherein, the definition is used to represent the recognizable degree of the minutiae points of the image, the image size is used to represent how much the image includes, and the geometric features include points, lines, planes, etc.

For example, as shown in table 1, table 2, and table 3, table 1 is a correspondence between a definition and a first value provided in the embodiment of the present application, table 2 is a correspondence between an image size and a second value provided in the embodiment of the present application, and table 3 is a correspondence between a geometric feature and a third value provided in the embodiment of the present application.

TABLE 1

Definition of definition	First numerical value
		0～10％	1
10％～20％	2
		20％～30％	3
···	···

TABLE 2

Image size	Second value of
		0～1kb	1
1kb～10kb	2
		10kb～20kb	3
···	···

TABLE 3 Table 3

Geometric characteristics (number of points, lines and faces)	Third numerical value
		0～10	1
10～20	2
		20～30	3
···	···

For example, assuming that the sharpness of the CAD image i is 80%, the sharpness corresponds to a first value 8, the image size is 30kb, the sharpness corresponds to a second value 3, the number of geometric features of the image is 5, the sharpness corresponds to a third value 5, the sharpness corresponds to a first weight of 20%, the image size corresponds to a second weight of 30%, the geometric features corresponds to a third weight of 50%, and the image quality evaluation value of the CAD image i is 5.

In an implementation manner of the present application, before the stacking the N CAD images based on the stacking order and the stacking direction, the method further includes:

determining whether the objects described by the N CAD images are matched;

if the objects described by the N CAD images are not matched, marking the unmatched CAD images, and correcting the unmatched CAD images based on the matched CAD images.

For example, assuming that CAD image i depicts object a and CAD image depicts object B, if the dimensions are not the same, it may be determined that the two do not match. In CAD drawing, because the image is made by a user, human factors are inevitably introduced, so that the size of the made image may deviate, and the CAD image is not matched.

As shown in fig. 3, fig. 3 is a flowchart of another image overlaying method provided in an embodiment of the present application, and the method is applied to an electronic device, and includes:

step 301: and acquiring N CAD images to be superimposed, wherein N is an integer greater than 1.

Step 302: determining whether the objects described by the N CAD images are matched;

if yes, go to step 304;

if not, go to step 303.

Step 303: a non-matching CAD image is noted and corrected based on the matching CAD image, and then step 304 is performed.

Step 304: and determining the superposition sequence and the superposition direction of the N CAD images.

Step 305: determining whether pixel arrangement information carried by the N CAD images is the same;

if yes, go to step 306;

if not, go to step 309.

Step 306: and determining coordinates corresponding to pixels included in the N CAD images to obtain N first coordinate sets.

Step 307: and determining a first coordinate mapping relation among the N first coordinate sets based on the superposition order and the superposition direction.

Step 308: and superposing the N CAD images based on the first coordinate mapping relation to obtain a superposition file.

Step 309: determining whether the N CAD images include the same region;

if yes, go to step 310;

if not, go to step 313.

Step 310: and determining coordinates corresponding to the same area in the N CAD images to obtain N second coordinate sets.

Step 311: and determining a second coordinate mapping relation among the N second coordinate sets based on the superposition order and the superposition direction.

Step 312: and superposing the N CAD images based on the second coordinate mapping relation to obtain a superposition file.

Step 313: and determining one of the N CAD images as a reference image.

Step 314: and scaling the rest N-1 CAD images except the reference image based on the reference image to obtain scaled N-1 CAD images, wherein pixel arrangement information carried by the scaled N-1 CAD images is the same as pixel arrangement information carried by the reference image.

Step 315: and determining coordinates corresponding to pixels included in the reference image and coordinates corresponding to pixels included in the scaled N-1 CAD images to obtain N third coordinate sets.

Step 316: and determining a third coordinate mapping relation among the N third coordinate sets based on the superposition order and the superposition direction.

Step 317: and superposing the reference image and the rest N-1 CAD images based on the third coordinate mapping relation to obtain a superposition file.

It should be noted that, the specific implementation process of this embodiment may refer to the specific implementation process described in the foregoing method embodiment, which is not described herein.

Referring to fig. 4, fig. 4 is a schematic structural diagram of another electronic device provided in the embodiment of the present application, as shown in fig. 2 and 3, where the electronic device includes a processor, a memory, a communication interface, and one or more programs, where the one or more programs are stored in the memory and configured to be executed by the processor, and the programs include instructions for performing the following steps:

In an implementation manner of the present application, in the aspect of overlaying the N CAD images based on the overlaying sequence and the overlaying direction to obtain an overlaid file, the program includes instructions specifically configured to perform the following steps:

In one implementation of the present application, the program includes instructions for performing the following steps:

In an implementation manner of the present application, before the stacking of the N CAD images based on the stacking order and the stacking direction, to obtain a stacked document, the program includes instructions for further performing the following steps:

determining whether the objects described by the N CAD images are matched;

The foregoing embodiments mainly describe the solutions of the embodiments of the present application from the point of view of the method-side execution procedure. It will be appreciated that the electronic device, in order to achieve the above-described functions, includes corresponding hardware structures and/or software modules that perform the respective functions. Those of skill in the art will readily appreciate that the elements and algorithm steps of the examples described in connection with the embodiments disclosed herein may be implemented as hardware or combinations of hardware and computer software. Whether a function is implemented as hardware or computer software driven hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

According to the embodiment of the application, the electronic device may be divided into the functional units according to the method example, for example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated into one processing unit. The integrated units may be implemented in hardware or in software functional units.

It should be noted that, in the embodiment of the present application, the division of the units is schematic, which is merely a logic function division, and other division manners may be implemented in actual practice.

The following is an embodiment of the apparatus, which is configured to execute a method implemented by an embodiment of the method of the present application. Referring to fig. 5, fig. 5 is a schematic structural diagram of an image superimposing apparatus according to an embodiment of the present application, which is applied to an electronic device, and the apparatus includes:

an obtaining unit 501, configured to obtain N CAD images to be superimposed, where N is an integer greater than 1;

a determining unit 502, configured to determine an overlapping sequence and an overlapping direction of the N CAD images;

and a stacking unit 503, configured to stack the N CAD images based on the stacking order and the stacking direction, to obtain a stacking file.

In an implementation manner of the present application, the stacking unit 503 is specifically configured to stack the N CAD images based on the stacking order and the stacking direction to obtain a stacking file:

In an implementation manner of the present application, the stacking unit 503 is specifically configured to:

In an implementation manner of the present application, before the stacking of the N CAD images based on the stacking order and the stacking direction, to obtain a stacked document, the apparatus further includes:

a matching unit 504, configured to determine whether the objects described by the N CAD images match;

the labeling unit 505 is configured to label the unmatched CAD images if the objects described by the N CAD images are unmatched;

a correction unit 506, configured to correct the unmatched CAD image based on the matched CAD image.

It should be noted that the acquiring unit 501, the determining unit 502, the stacking unit 503, the matching unit 504, the labeling unit 505, and the correcting unit 506 may be implemented by a processor.

The present application also provides a computer storage medium storing a computer program for electronic data exchange, the computer program causing a computer to execute some or all of the steps of any one of the methods described in the method embodiments above.

Embodiments of the present application also provide a computer program product comprising a non-transitory computer-readable storage medium storing a computer program operable to cause a computer to perform some or all of the steps of any one of the methods described in the method embodiments above. The computer program product may be a software installation package.

It should be noted that, for simplicity of description, the foregoing method embodiments are all expressed as a series of action combinations, but it should be understood by those skilled in the art that the present application is not limited by the order of actions described, as some steps may be performed in other order or simultaneously in accordance with the present application. Further, those skilled in the art will also appreciate that the embodiments described in the specification are all preferred embodiments, and that the acts and modules referred to are not necessarily required in the present application.

In the foregoing embodiments, the descriptions of the embodiments are emphasized, and for parts of one embodiment that are not described in detail, reference may be made to related descriptions of other embodiments.

In the several embodiments provided in this application, it should be understood that the disclosed apparatus may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, such as the above-described division of units, merely a division of logic functions, and there may be additional manners of dividing in actual implementation, such as multiple units or components may be combined or integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, or may be in electrical or other forms.

The units described above as separate components may or may not be physically separate, and components shown as units may or may not be physical units, may be located in one place, or may be distributed over a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.

The integrated units described above, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable memory. Based on such understanding, the technical solution of the present application may be embodied in essence or a part contributing to the prior art or all or part of the technical solution in the form of a software product stored in a memory, including several instructions for causing a computer device (which may be a personal computer, a server or a network device, etc.) to perform all or part of the steps of the above-mentioned method of the various embodiments of the present application. And the aforementioned memory includes: a U-disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a removable hard disk, a magnetic disk, or an optical disk, or other various media capable of storing program codes.

Those of ordinary skill in the art will appreciate that all or a portion of the steps in the various methods of the above embodiments may be implemented by a program that instructs associated hardware, and the program may be stored in a computer readable memory, which may include: flash disk, read-Only Memory (ROM), random access Memory (Random Access Memory, RAM), magnetic disk or optical disk.

The foregoing has outlined rather broadly the more detailed description of embodiments of the present application, wherein specific examples are provided herein to illustrate the principles and embodiments of the present application, the above examples being provided solely to assist in the understanding of the methods of the present application and the core ideas thereof; meanwhile, as those skilled in the art will have modifications in the specific embodiments and application scope in accordance with the ideas of the present application, the present description should not be construed as limiting the present application in view of the above.

Claims

1. An image superimposition method, applied to an electronic device, comprising:

and superposing the N CAD images based on the superposition order and the superposition direction to obtain a superposition file, wherein the superposition file comprises: if the pixel arrangement information carried by the N CAD images is the same, determining coordinates corresponding to pixels included in the N CAD images to obtain N first coordinate sets; determining a first coordinate mapping relation among the N first coordinate sets based on the superposition order and the superposition direction; and superposing the N CAD images based on the first coordinate mapping relation to obtain a superposition file.

2. The method according to claim 1, wherein the method further comprises:

3. The method according to claim 2, wherein the method further comprises:

4. A method according to any one of claims 1-3, wherein, before the superimposing the N CAD images based on the superimposing order and the superimposing direction, the method further comprises:

determining whether the objects described by the N CAD images are matched;

5. An image superimposition apparatus, characterized by being applied to an electronic device, comprising:

the stacking unit is configured to stack the N CAD images based on the stacking sequence and the stacking direction, to obtain a stacking file, and includes: if the pixel arrangement information carried by the N CAD images is the same, determining coordinates corresponding to pixels included in the N CAD images to obtain N first coordinate sets; determining a first coordinate mapping relation among the N first coordinate sets based on the superposition order and the superposition direction; and superposing the N CAD images based on the first coordinate mapping relation to obtain a superposition file.

6. The apparatus of claim 5, wherein the stacking unit is specifically configured to:

7. An electronic device comprising a processor, a memory, a communication interface, and one or more programs stored in the memory and configured to be executed by the processor, the programs comprising instructions for performing the steps in the method of any of claims 1-4.

8. A computer readable storage medium, characterized in that the computer readable storage medium stores a computer program, which is executed by a processor to implement the method of any of claims 1-4.