CN111899149A - Image processing method and device based on operator fusion and storage medium - Google Patents
Image processing method and device based on operator fusion and storage medium Download PDFInfo
- Publication number
- CN111899149A CN111899149A CN202010657863.1A CN202010657863A CN111899149A CN 111899149 A CN111899149 A CN 111899149A CN 202010657863 A CN202010657863 A CN 202010657863A CN 111899149 A CN111899149 A CN 111899149A
- Authority
- CN
- China
- Prior art keywords
- target
- atom
- target operation
- atoms
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000004927 fusion Effects 0.000 title claims abstract description 31
- 238000003672 processing method Methods 0.000 title claims abstract description 22
- 238000000034 method Methods 0.000 claims abstract description 42
- 238000004364 calculation method Methods 0.000 claims abstract description 23
- 239000011159 matrix material Substances 0.000 claims description 9
- 238000006243 chemical reaction Methods 0.000 claims description 8
- 230000008569 process Effects 0.000 abstract description 21
- 230000005540 biological transmission Effects 0.000 abstract description 14
- 230000015654 memory Effects 0.000 description 18
- 238000004590 computer program Methods 0.000 description 11
- 230000003993 interaction Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 6
- 238000005457 optimization Methods 0.000 description 6
- 238000004891 communication Methods 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000004422 calculation algorithm Methods 0.000 description 2
- 238000005034 decoration Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000009825 accumulation Methods 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000008030 elimination Effects 0.000 description 1
- 238000003379 elimination reaction Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000007500 overflow downdraw method Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T1/00—General purpose image data processing
- G06T1/20—Processor architectures; Processor configuration, e.g. pipelining
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Image Processing (AREA)
Abstract
The invention discloses an image processing method and device based on operator fusion and a storage medium. Wherein, the method comprises the following steps: acquiring an operation atom for executing target operation on a target image, wherein the operation atom represents a calculation type for executing the target operation; converting the operation atom into a corresponding target operation atom according to the attribute information of target equipment for executing the target operation, and determining a target operation operator corresponding to the target operation atom; the operators with the same target operation are merged to obtain a merged target image, namely, the repeated addressing in a storage medium is eliminated through the merging of the operators with the same atomic operation, and the processes of loading data and storing the data are adopted, so that the performance of multiple operators in simultaneous use is improved, the access times of the storage medium and the pressure on a transmission medium are reduced, and the technical problem of low processing performance caused by the fact that the access times of multiple operators are too many in the image processing process in the prior art is solved.
Description
Technical Field
The invention relates to the field of image processing, in particular to an image processing method and device based on operator fusion and a storage medium.
Background
The currently used image processing algorithm needs to call different operator interfaces respectively aiming at different operators, so that the performance of the algorithm does not reach an optimal scheme, and even if the performance of each platform is optimized to the utmost by aiming at the operators, unnecessary performance and occupation of equipment processing and transmission bandwidth caused by repeated reloading and storage of the same atom of the same image data exist, so that the performance cannot reach the optimal standard.
In view of the above problems, no effective solution has been proposed.
Disclosure of Invention
The embodiment of the invention provides an image processing method and device based on operator fusion and a storage medium, which are used for at least solving the technical problem of low processing performance caused by excessive access times of a plurality of operators in the image processing process in the prior art.
According to an aspect of the embodiments of the present invention, there is provided an image processing method based on operator fusion, including: acquiring an operation atom for executing a target operation on a target image, wherein the operation atom represents a calculation type for executing the target operation; converting the operation atom into a corresponding target operation atom according to the attribute information of target equipment for executing the target operation, and determining a target operation operator corresponding to the target operation atom; and merging the operators with the same target operation to obtain a merged target image.
According to another aspect of the embodiments of the present invention, there is also provided an image processing apparatus based on operator fusion, including: an obtaining unit, configured to obtain an operation atom for performing a target operation on a target image, where the operation atom represents a calculation type for performing the target operation; the determining unit is used for converting the operation atoms into corresponding target operation atoms according to the attribute information of target equipment executing the target operation and determining target operation operators corresponding to the target operation atoms; and the merging unit is used for merging the same target operation operators to obtain a merged target image.
According to another aspect of the embodiments of the present invention, there is also provided a computer-readable storage medium, in which a computer program is stored, where the computer program is configured to execute the above image processing method based on operator fusion when the computer program runs.
According to another aspect of the embodiments of the present invention, there is also provided an electronic apparatus, including a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor executes the above image processing method based on operator fusion through the computer program.
In the embodiment of the invention, an operation atom for executing a target operation on a target image is obtained, wherein the operation atom represents the calculation type for executing the target operation; converting the operation atom into a corresponding target operation atom according to the attribute information of target equipment for executing the target operation, and determining a target operation operator corresponding to the target operation atom; the method comprises the steps of merging the operators with the same target operation to obtain a merged target image, and achieving the purpose that the operation atoms with the same operation operators are merged according to attribute information of target equipment for processing the target image and the operation atoms of the target image, namely, the repeated processes of addressing in a storage medium, loading data and storing the data are eliminated through merging the operators with the same atomic operation, so that the performance of multiple operators when the multiple operators are used simultaneously is improved, the access times of the storage medium and the pressure on a transmission medium are reduced, and the technical problem of low processing performance caused by excessive access times of the multiple operators in the image processing process in the prior art is solved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
FIG. 1 is a schematic diagram of an application environment of an alternative operator fusion-based image processing method according to an embodiment of the present invention;
FIG. 2 is a flow diagram of an alternative method of image processing based on operator fusion according to an embodiment of the present invention;
FIG. 3 is a flow diagram of an alternative method of image processing via operator fusion in accordance with embodiments of the present invention;
FIG. 4 is a schematic structural diagram of an alternative image processing apparatus based on operator fusion according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of an electronic device of an alternative image processing method based on operator fusion according to an embodiment of the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
According to an aspect of the embodiment of the present invention, an image processing method based on operator fusion is provided, and optionally, as an optional implementation manner, the image processing method based on operator fusion may be applied to, but is not limited to, a hardware environment as shown in fig. 1, where the image processing method based on operator fusion may include, but is not limited to, a terminal device 102, a network 110, and a server 112. A view client is run in the terminal device 102, and is used for presenting a target image.
The terminal device 102 may include, but is not limited to: a human-computer interaction screen 104, a processor 106 and a memory 108. The man-machine interaction screen 104 is used for acquiring a man-machine interaction instruction through a man-machine interaction interface and is also used for displaying a target image; the processor 106 is configured to display the target image in response to the human-computer interaction instruction. The memory 108 is used to store target image attribute information. Here, the server 112 may include, but is not limited to: the processing engine 116 is used for calling the target image stored in the database 114 and acquiring an operation atom for executing a target operation on the target image, wherein the operation atom represents a calculation type for executing the target operation; converting the operation atom into a corresponding target operation atom according to the attribute information of target equipment for executing the target operation, and determining a target operation operator corresponding to the target operation atom; the method comprises the steps of merging the operators with the same target operation to obtain a merged target image, and achieving the purpose that the operation atoms with the same operation operators are merged according to attribute information of target equipment for processing the target image and the operation atoms of the target image, namely, the repeated processes of addressing in a storage medium, loading data and storing the data are eliminated through merging the operators with the same atomic operation, so that the performance of multiple operators when the multiple operators are used simultaneously is improved, the access times of the storage medium and the pressure on a transmission medium are reduced, and the technical problem of low processing performance caused by excessive access times of the multiple operators in the image processing process in the prior art is solved.
The specific process comprises the following steps: the man-machine interaction screen 104 in the terminal device 102 displays an interaction interface (shown as a game screen in a shooting type game in fig. 1) for a game client to run a game task. The target image is acquired and transmitted to the server 112 via the network 110 as in steps S102-S110. Obtaining, at the server 112, an operation atom for performing a target operation on the target image, wherein the operation atom represents a calculation type for performing the target operation; converting the operation atom into a corresponding target operation atom according to the attribute information of target equipment for executing the target operation, and determining a target operation operator corresponding to the target operation atom; and merging the operators with the same target operation to obtain a merged target image. And then returns the determined result to the terminal device 102.
Then, as shown in steps S102-S110, the terminal device 102 acquires an operation atom for performing a target operation on the target image, where the operation atom indicates a calculation type for performing the target operation; converting the operation atom into a corresponding target operation atom according to the attribute information of target equipment for executing the target operation, and determining a target operation operator corresponding to the target operation atom; and merging the operation operators with the same target to obtain a merged target image, wherein the operation atoms with the same operation operators are merged according to the attribute information of the target equipment for processing the target image and the operation atoms of the target image. The method and the device achieve the purpose that the operation atoms with the same operation operators are merged according to the attribute information of the target device for processing the target image and the operation atoms of the target image. That is to say, the operators of the same atomic operation are merged to eliminate the repeated processes of addressing in the storage medium, loading data and storing data, so that the performance of multiple operators in simultaneous use is improved, the access times of the storage medium and the pressure on the transmission medium are reduced, and the technical problem of lower processing performance caused by excessive access times of multiple operators in the image processing process in the prior art is solved.
Optionally, in this embodiment, the image processing method based on operator fusion described above may be applied, but not limited to, in the server 112, for assisting the target image in the application client to be processed. The application client may be but not limited to run in the terminal device 102, and the terminal device 102 may be but not limited to a mobile phone, a tablet computer, a notebook computer, a PC, and other terminal devices that support running the application client. The server 112 and the terminal device 102 may implement data interaction through a network, which may include but is not limited to a wireless network or a wired network. Wherein, this wireless network includes: bluetooth, WIFI, and other networks that enable wireless communication. Such wired networks may include, but are not limited to: wide area networks, metropolitan area networks, and local area networks. The above is merely an example, and this is not limited in this embodiment.
Optionally, as an optional implementation manner, as shown in fig. 2, the image processing method based on operator fusion includes:
step S202, obtaining an operation atom for executing a target operation on the target image, wherein the operation atom represents a calculation type for executing the target operation.
Step S204, converting the operation atom into a corresponding target operation atom according to the attribute information of the target device executing the target operation, and determining a target operation operator corresponding to the target operation atom.
And step S206, merging the operation atoms with the same target operation operator to obtain a merged target image.
Optionally, in this embodiment, the target image may include, but is not limited to, any form of image, such as a screenshot of a game process, a captured landscape image, a captured character image, and the like.
The operation atoms may include, but are not limited to, data used for image processing, for example, image processing according to pixel points, image processing by a matrix, and the like.
Optionally, in this embodiment, the target operator may include, but is not limited to, performing addition processing, phase processing, and the like on the operation atom.
It should be noted that, acquiring an operation atom for performing a target operation on a target image may include:
and acquiring an operation atom of the target image for executing the target operation according to the attribute information of the target device.
In this embodiment, converting an operation atom into a corresponding target operation atom according to attribute information of a target device that performs a target operation, and determining a target operator corresponding to the target operation atom, may include:
converting the operation atom into a target operation atom according to a preset rule;
and carrying out merging processing based on the same target operation operator according to the target operation atoms to obtain a merged target image.
Wherein, the operation atoms can be converted into the same byte number for processing.
It should be noted that, in the case that the operation atom is of a matrix type, converting the operation atom into a target operation atom according to a preset rule may include:
and converting the matrix into the column as the minimum target operation atom by means of row-column conversion.
It should be further noted that, in the case that the operation atom is of the pixel type, converting the operation atom into the target operation atom according to the preset rule may include:
and acquiring the minimum vector of the pixel point, and taking the minimum vector as a target operation atom.
Optionally, in this embodiment, converting the operation atom into a corresponding target operation atom according to the attribute information of the target device that executes the target operation, and determining a target operation operator corresponding to the target operation atom, may include:
acquiring parameters of a target device for processing a target image;
and determining the attribute information of the target equipment according to the parameters.
According to the embodiment provided by the application, the operation atom for executing the target operation on the target image is obtained, wherein the operation atom represents the calculation type for executing the target operation; converting the operation atom into a corresponding target operation atom according to the attribute information of target equipment for executing the target operation, and determining a target operation operator corresponding to the target operation atom; the method comprises the steps of merging the operators with the same target operation to obtain a merged target image, and achieving the purpose that the operation atoms with the same operation operators are merged according to attribute information of target equipment for processing the target image and the operation atoms of the target image, namely, the repeated processes of addressing in a storage medium, loading data and storing the data are eliminated through merging the operators with the same atomic operation, so that the performance of multiple operators when the multiple operators are used simultaneously is improved, the access times of the storage medium and the pressure on a transmission medium are reduced, and the technical problem of low processing performance caused by excessive access times of the multiple operators in the image processing process in the prior art is solved.
As an optional embodiment, the present application further provides an optional image processing method through operator fusion. As shown in fig. 3, a flow chart of an image processing method by operator fusion.
Step S301, selecting an operation atom;
the operation atoms may include, but are not limited to, pixel points, matrices, and the like.
Different operation atoms are selected according to an optimal operation atom principle instead of a minimum operation atom principle, a pixel point can be calculated by taking the minimum vector capable of being operated as a basic operation atom according to the parallel processing capacity of the equipment, or atoms with proper operation are selected according to the size of a cache, so that the performance can be improved by fully utilizing the calculation and storage units of the equipment, and the atoms such as a matrix can convert the matrix into a column as the minimum operation atom in a row-column conversion mode.
Step S302, selecting a platform;
such platforms may include, but are not limited to, computing units, storage media, and the like.
The selection can be further screened according to the parallel processing capacity and the cache size of different platforms, the performance and the storage medium resources can be reasonably allocated through parameter configuration to achieve the required balance, and the selection can also be processed in a performance optimal mode.
Step S303, selecting an operation data type;
the operation data type may include, but is not limited to, u8, int32, fioat, etc., among others.
And different data types have different lengths and different used optimization modes, and the required optimization mode is selected according to the actual operation data type.
Step S304, selecting the same atomic operation operator;
the operation operators comprise add, sub multiply, add weight and the like.
And selecting the needed operator combination with the same atomic operation, judging whether the operator combination operation can be carried out or not according to the transmitted combination, and multiplexing the source storage medium and the target storage medium operated by the operator according to the operator cascade mode.
Step S305, selecting an optimization mode;
different optimization modes are adopted due to different factors of operation atoms, data types, data sizes, platform caches and the like, and specific optimization modes can be used for certain specific operator combinations, such as: the multiplication and addition calculations are combined into an accumulation calculation unit.
Step S306, a loop internal merge calculation process is performed according to the selected calculation unit.
In this embodiment, the scene processed by the scheme for image processing is often a large number of atoms arranged in order rather than a single atom, and is processed according to a certain order, and the arrangement and use modes of the atoms by different operators to be processed are the same.
In the embodiment, the redundancy overhead of the storage medium and the transmission medium is reduced, the redundancy overhead of the repeated circulation is reduced, and the data loading and storing rules are conveniently optimized
It should be noted that, in this embodiment, under the condition of mathematical promotion, the elimination of redundant operations of loading and storing the storage medium is considered, so that not only the pressure on the storage medium and the transmission medium is reduced, but also the loop is merged to reduce the repeated loop overhead. After the calculation is combined, the expenses of loading and storing are saved, and the expenses of cycle jump and pipeline updating are saved.
Performance is improved: taking pure c code and arm cpu performance improvement as examples, the arithmetic operator combination can be improved by about one time.
It should be further noted that the repeated processes of addressing, loading data and storing data in the storage medium are eliminated by merging the operators of the same atomic operation, so that the performance of multiple operators in simultaneous use is improved, and the access times of the storage medium and the pressure on the transmission medium are reduced.
In the implementation, the use conditions are limited to the same atomic operation and the processing under the condition of a certain cascade relation, after the operators are fused in different atomic operations, the operated atomic loading and storing sequences are different, and after the fusion, the performance cannot be improved and the pressure on the storage medium and the transmission medium cannot be reduced by reloading or storing. If the stepless connection relation is over complicated, the performance is finally influenced, and the effect of performance optimization cannot be achieved if the calculation pressure is improved.
According to the embodiment provided by the application, the operator fusion method is applied to the general image processing or data processing process, so that other atomic calculations which operate the same atoms and have specific relations except for the neural network operator can be fused, the processing efficiency is improved, the problem that the repeated loading and storage processes of different operators on data are reduced under the condition that the operator application loads and stores the data from a storage medium is solved, and the performance is improved.
It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the order of acts, as some steps may occur in other orders or concurrently in accordance with the invention. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required by the invention.
According to another aspect of the embodiment of the present invention, there is also provided an operator fusion-based image processing apparatus for implementing the above-mentioned operator fusion-based image processing method. As shown in fig. 4, the apparatus includes: an acquisition unit 41, a determination unit 43, and a merging unit 45.
An obtaining unit 41, configured to obtain an operation atom for performing a target operation on a target image, where the operation atom indicates a calculation type for performing the target operation.
The determining unit 43 is configured to convert the operation atom into a corresponding target operation atom according to the attribute information of the target device that executes the target operation, and determine a target operation operator corresponding to the target operation atom.
And a merging unit 45, configured to merge the operation atoms with the same target operation operator to obtain a merged target image.
Optionally, in this embodiment, the obtaining unit 41 may include:
and the first acquisition module is used for acquiring the operation atoms of the target image for executing the target operation according to the attribute information of the target device.
Optionally, in this embodiment, the determining unit 43 may include:
the conversion module is used for converting the operation atoms into target operation atoms according to a preset rule;
and the merging module is used for merging the target operation atoms based on the same target operation operator to obtain a merged target image.
The conversion module is further configured to convert the matrix into a column as a minimum target operation atom in a row-column conversion manner when the operation atom is of a matrix type.
The conversion module is further configured to obtain a minimum vector of a pixel point under the condition that the operation atom is of the pixel point type, and use the minimum vector as a target operation atom.
Optionally, in this embodiment, the determining unit 43 may include:
the second acquisition module is used for acquiring parameters of the target image processed by the target equipment;
and the determining module is used for determining the attribute information of the target equipment according to the parameters.
By the embodiment provided by the present application, the obtaining unit 41 obtains an operation atom for performing a target operation on a target image, where the operation atom indicates a calculation type for performing the target operation; the determining unit 43 converts the operation atom into a corresponding target operation atom according to the attribute information of the target device executing the target operation, and determines a target operation operator corresponding to the target operation atom; the merging unit 45 merges the operation atoms having the same target operation operator to obtain a merged target image. The method and the device achieve the aim of merging the operation atoms with the same operation operators according to the attribute information of the target device for processing the target image and the operation atoms of the target image, namely, the operators operated by the same atoms are merged to eliminate repeated addressing in the storage medium, and the processes of loading data and storing data are eliminated, so that the performance of multiple operators in simultaneous use is improved, the access times of the storage medium and the pressure on the transmission medium are reduced, and the technical problem of low processing performance caused by excessive access times of multiple operators in the image processing process in the prior art is solved.
According to yet another aspect of the embodiments of the present invention, there is also provided an electronic device for implementing the operator fusion-based image processing method, as shown in fig. 5, the electronic device includes a memory 502 and a processor 504, the memory 502 stores a computer program therein, and the processor 504 is configured to execute the steps in any one of the method embodiments through the computer program.
Optionally, in this embodiment, the electronic apparatus may be located in at least one network device of a plurality of network devices of a computer network.
Optionally, in this embodiment, the processor may be configured to execute the following steps by a computer program:
s1, obtaining an operation atom for executing target operation on the target image, wherein the operation atom represents the calculation type for executing the target operation;
s2, converting the operation atoms into corresponding target operation atoms according to the attribute information of the target equipment executing the target operation, and determining target operation operators corresponding to the target operation atoms;
and S3, merging the operation atoms with the same target operation operator to obtain a merged target image.
Alternatively, it can be understood by those skilled in the art that the structure shown in fig. 5 is only an illustration, and the electronic device may also be a terminal device such as a smart phone (e.g., an Android phone, an iOS phone, etc.), a tablet computer, a palm computer, a Mobile Internet Device (MID), a PAD, and the like. Fig. 5 is a diagram illustrating a structure of the electronic device. For example, the electronic device may also include more or fewer components (e.g., network interfaces, etc.) than shown in FIG. 5, or have a different configuration than shown in FIG. 5.
The memory 502 may be used to store software programs and modules, such as program instructions/modules corresponding to the image processing method and apparatus based on operator fusion in the embodiment of the present invention, and the processor 504 executes various functional applications and data processing by running the software programs and modules stored in the memory 502, that is, implements the image processing method based on operator fusion. The memory 502 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 502 may further include memory located remotely from the processor 504, which may be connected to the terminal over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof. The memory 502 may be specifically but not limited to information such as a target image and an operation atom corresponding to the target image. As an example, as shown in fig. 5, the memory 502 may include, but is not limited to, the obtaining unit 41, the determining unit 43, and the merging unit 45 in the image processing apparatus based on operator fusion. In addition, the image processing apparatus may further include, but is not limited to, other module units in the image processing apparatus based on operator fusion, which is not described in detail in this example.
Optionally, the transmission device 506 is used for receiving or sending data via a network. Examples of the network may include a wired network and a wireless network. In one example, the transmission device 506 includes a Network adapter (NIC) that can be connected to a router via a Network cable and other Network devices to communicate with the internet or a local area Network. In one example, the transmission device 506 is a Radio Frequency (RF) module, which is used for communicating with the internet in a wireless manner.
In addition, the electronic device further includes: a display 508 for displaying the merged target image information; and a connection bus 510 for connecting the respective module parts in the above-described electronic apparatus.
According to a further aspect of an embodiment of the present invention, there is also provided a computer-readable storage medium having a computer program stored thereon, wherein the computer program is arranged to perform the steps of any of the above method embodiments when executed.
Alternatively, in the present embodiment, the above-mentioned computer-readable storage medium may be configured to store a computer program for executing the steps of:
s1, obtaining an operation atom for executing target operation on the target image, wherein the operation atom represents the calculation type for executing the target operation;
s2, converting the operation atoms into corresponding target operation atoms according to the attribute information of the target equipment executing the target operation, and determining target operation operators corresponding to the target operation atoms;
and S3, merging the operation atoms with the same target operation operator to obtain a merged target image.
Alternatively, in this embodiment, a person skilled in the art may understand that all or part of the steps in the methods of the foregoing embodiments may be implemented by a program instructing hardware associated with the terminal device, where the program may be stored in a computer-readable storage medium, and the storage medium may include: flash disks, Read-Only memories (ROMs), Random Access Memories (RAMs), magnetic or optical disks, and the like.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
The integrated unit in the above embodiments, if implemented in the form of a software functional unit and sold or used as a separate product, may be stored in the above computer-readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing one or more computer devices (which may be personal computers, servers, network devices, etc.) to execute all or part of the steps of the method according to the embodiments of the present invention.
In the above embodiments of the present invention, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the several embodiments provided in the present application, it should be understood that the disclosed client may be implemented in other manners. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one type of division of logical functions, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, units or modules, and may be in an electrical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The foregoing is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and decorations can be made without departing from the principle of the present invention, and these modifications and decorations should also be regarded as the protection scope of the present invention.
Claims (11)
1. An image processing method based on operator fusion is characterized by comprising the following steps:
acquiring an operation atom for executing a target operation on a target image, wherein the operation atom represents a calculation type for executing the target operation;
converting the operation atom into a corresponding target operation atom according to the attribute information of target equipment for executing the target operation, and determining a target operation operator corresponding to the target operation atom;
and merging the operation atoms with the same target operation operator to obtain a merged target image.
2. The method of claim 1, the obtaining operation atoms for performing a target operation on a target image, comprising:
and acquiring the operation atom of the target operation executed by the target image according to the attribute information of the target device.
3. The method of claim 1, converting the operation atom into a corresponding target operation atom according to attribute information of a target device executing the target operation, and determining a target operation operator corresponding to the target operation atom, comprising:
converting the operation atom into the target operation atom according to a preset rule;
and carrying out merging processing based on the same target operation operator according to the target operation atoms to obtain the merged target image.
4. The method of claim 1, wherein in the case that the operation atom is of a matrix type, converting the operation atom into the target operation atom according to a preset rule, comprises:
and converting the matrix into a column as a minimum target operation atom by means of row-column conversion.
5. The method according to claim 1, wherein in a case that the operation atom is of a pixel type, converting the operation atom into the target operation atom according to a preset rule, includes:
and acquiring the minimum vector of the pixel point, and taking the minimum vector as the target operation atom.
6. The method of claim 1, converting the operation atom into a corresponding target operation atom according to attribute information of a target device executing the target operation, and determining a target operation operator corresponding to the target operation atom, comprising:
acquiring parameters of the target equipment for processing the target image;
and determining the attribute information of the target equipment according to the parameters.
7. An image processing apparatus based on operator fusion, comprising:
an obtaining unit, configured to obtain an operation atom for performing a target operation on a target image, where the operation atom represents a calculation type for performing the target operation;
the determining unit is used for converting the operation atoms into corresponding target operation atoms according to the attribute information of target equipment executing the target operation and determining target operation operators corresponding to the target operation atoms;
and the merging unit is used for merging the operation atoms with the same target operation operator to obtain a merged target image.
8. The apparatus of claim 7, the obtaining unit, comprising:
a first obtaining module, configured to obtain the operation atom of the target operation executed by the target image according to the attribute information of the target device.
9. The apparatus of claim 7, the determination unit, comprising:
the conversion module is used for converting the operation atoms into the target operation atoms according to a preset rule;
and the merging module is used for merging the target operation atoms based on the same target operation operator to obtain the merged target image.
10. The apparatus of claim 7, the determination unit, comprising:
the second acquisition module is used for acquiring parameters of the target image processed by the target equipment;
and the determining module is used for determining the attribute information of the target equipment according to the parameters.
11. A computer-readable storage medium, comprising a stored program, wherein the program is operable to perform the method of any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010657863.1A CN111899149B (en) | 2020-07-09 | 2020-07-09 | Image processing method and device based on operator fusion and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010657863.1A CN111899149B (en) | 2020-07-09 | 2020-07-09 | Image processing method and device based on operator fusion and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111899149A true CN111899149A (en) | 2020-11-06 |
| CN111899149B CN111899149B (en) | 2024-07-02 |
Family
ID=73192134
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010657863.1A Active CN111899149B (en) | 2020-07-09 | 2020-07-09 | Image processing method and device based on operator fusion and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111899149B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114254563A (en) * | 2021-12-20 | 2022-03-29 | Oppo广东移动通信有限公司 | Data processing method and device, electronic equipment and storage medium |
| CN114492737A (en) * | 2021-12-31 | 2022-05-13 | 北京百度网讯科技有限公司 | Data processing method, data processing device, electronic equipment, storage medium and program product |
| CN114615519A (en) * | 2022-01-27 | 2022-06-10 | 百果园技术(新加坡)有限公司 | Video processing method, device, equipment and storage medium |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110066813A1 (en) * | 2009-09-08 | 2011-03-17 | Advanced Micro Devices, Inc. | Method And System For Local Data Sharing |
| CN105637482A (en) * | 2014-09-15 | 2016-06-01 | 华为技术有限公司 | Method and device for processing data stream based on gpu |
| CN107798714A (en) * | 2017-09-11 | 2018-03-13 | 深圳创维数字技术有限公司 | A kind of image data display method and relevant apparatus and computer-readable storage medium |
| CN108805901A (en) * | 2018-05-04 | 2018-11-13 | 北京航空航天大学 | A kind of quick detecting and tracking parallel computation of sensation target based on multi-core DSP and fusion method |
| CN108960012A (en) * | 2017-05-22 | 2018-12-07 | 中科创达软件股份有限公司 | Feature point detecting method, device and electronic equipment |
| CN109033323A (en) * | 2018-07-18 | 2018-12-18 | 中国人民解放军91776部队 | A kind of tree structure basic data change record method based on operator |
| CN109345497A (en) * | 2018-09-14 | 2019-02-15 | 淮阴师范学院 | Image fusion processing method and system, computer program based on fuzzy operator |
| WO2019134606A1 (en) * | 2018-01-05 | 2019-07-11 | Oppo广东移动通信有限公司 | Terminal control method, device, storage medium, and electronic apparatus |
| CN110533742A (en) * | 2019-09-03 | 2019-12-03 | 广州视源电子科技股份有限公司 | Image color filling method, device, equipment and storage medium |
| US20190392296A1 (en) * | 2019-06-28 | 2019-12-26 | John Brady | Hardware agnostic deep neural network compiler |
| CN110780982A (en) * | 2018-07-27 | 2020-02-11 | 深圳百迈技术有限公司 | Image processing method, device and equipment |
| CN110780921A (en) * | 2019-08-30 | 2020-02-11 | 腾讯科技（深圳）有限公司 | Data processing method and device, storage medium and electronic device |
| CN111309479A (en) * | 2020-02-14 | 2020-06-19 | 北京百度网讯科技有限公司 | Method, device, equipment and medium for realizing task parallel processing |
-
2020
- 2020-07-09 CN CN202010657863.1A patent/CN111899149B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110066813A1 (en) * | 2009-09-08 | 2011-03-17 | Advanced Micro Devices, Inc. | Method And System For Local Data Sharing |
| CN105637482A (en) * | 2014-09-15 | 2016-06-01 | 华为技术有限公司 | Method and device for processing data stream based on gpu |
| CN108960012A (en) * | 2017-05-22 | 2018-12-07 | 中科创达软件股份有限公司 | Feature point detecting method, device and electronic equipment |
| CN107798714A (en) * | 2017-09-11 | 2018-03-13 | 深圳创维数字技术有限公司 | A kind of image data display method and relevant apparatus and computer-readable storage medium |
| WO2019134606A1 (en) * | 2018-01-05 | 2019-07-11 | Oppo广东移动通信有限公司 | Terminal control method, device, storage medium, and electronic apparatus |
| CN108805901A (en) * | 2018-05-04 | 2018-11-13 | 北京航空航天大学 | A kind of quick detecting and tracking parallel computation of sensation target based on multi-core DSP and fusion method |
| CN109033323A (en) * | 2018-07-18 | 2018-12-18 | 中国人民解放军91776部队 | A kind of tree structure basic data change record method based on operator |
| CN110780982A (en) * | 2018-07-27 | 2020-02-11 | 深圳百迈技术有限公司 | Image processing method, device and equipment |
| CN109345497A (en) * | 2018-09-14 | 2019-02-15 | 淮阴师范学院 | Image fusion processing method and system, computer program based on fuzzy operator |
| US20190392296A1 (en) * | 2019-06-28 | 2019-12-26 | John Brady | Hardware agnostic deep neural network compiler |
| CN110780921A (en) * | 2019-08-30 | 2020-02-11 | 腾讯科技（深圳）有限公司 | Data processing method and device, storage medium and electronic device |
| CN110533742A (en) * | 2019-09-03 | 2019-12-03 | 广州视源电子科技股份有限公司 | Image color filling method, device, equipment and storage medium |
| CN111309479A (en) * | 2020-02-14 | 2020-06-19 | 北京百度网讯科技有限公司 | Method, device, equipment and medium for realizing task parallel processing |
Non-Patent Citations (7)
| Title |
|---|
| 孙挺;王华东;耿国华;: "基于字典学习和原子聚类的图像去噪算法", 计算机应用研究, no. 07, 30 September 2015 (2015-09-30) * |
| 左宪禹;张哲;黄祥志;葛强;张理涛;臧文乾;: "一种适用于GPU图像处理算法的合并存储结构", 计算机工程与科学, vol. 42, no. 02, 29 February 2020 (2020-02-29), pages 1 - 4 * |
| 左宪禹等: "一种适用于GPU图像处理算法的合并存储结构", 计算机工程与科学, vol. 42, no. 02, pages 1 - 4 * |
| 左颢睿;张启衡;徐勇;赵汝进;: "基于GPU的快速Sobel边缘检测算法", 光电工程, no. 01 * |
| 徐伟;华月园;徐研;: "数学形态学的合并综合算子研究", 海洋测绘, no. 05 * |
| 徐金波;窦勇;: "面向多兴趣区域图像处理应用的高效无冲突并行访问存储模型", 计算机学报, no. 11 * |
| 王芳;钱炜;李文超;: "基于数学形态学的图像边缘提取方法", 机械工程与自动化, no. 01, 28 February 2015 (2015-02-28) * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114254563A (en) * | 2021-12-20 | 2022-03-29 | Oppo广东移动通信有限公司 | Data processing method and device, electronic equipment and storage medium |
| CN114492737A (en) * | 2021-12-31 | 2022-05-13 | 北京百度网讯科技有限公司 | Data processing method, data processing device, electronic equipment, storage medium and program product |
| US11983086B2 (en) | 2021-12-31 | 2024-05-14 | Beijing Baidu Netcom Science Technology Co., Ltd. | Method for processing data, and electronic device, storage medium and program product |
| CN114615519A (en) * | 2022-01-27 | 2022-06-10 | 百果园技术(新加坡)有限公司 | Video processing method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111899149B (en) | 2024-07-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111899149A (en) | Image processing method and device based on operator fusion and storage medium | |
| CN107066631A (en) | Display methods, device and the electronic equipment of the page | |
| CN108829868B (en) | Data display method and device, storage medium and electronic device | |
| CN110780921A (en) | Data processing method and device, storage medium and electronic device | |
| CN112506584B (en) | Resource file loading method, device, equipment, storage medium and product | |
| KR20110044210A (en) | Method, apparatus and computer program product for providing context triggered distribution of context models | |
| CN112657182A (en) | Game equipment switching method, device and system and terminal equipment | |
| CN110334074A (en) | Data processing method, device, server and storage medium | |
| CN111258680A (en) | Resource loading method and device, storage medium and electronic device | |
| CN112953994B (en) | Data acquisition method, acquisition device, terminal equipment and readable storage medium | |
| CN113703407A (en) | Method, system and equipment for constructing robot production line operating system based on digital twin | |
| CN112631649A (en) | Intelligent contract management method, device, terminal equipment and medium | |
| CN116127219A (en) | Method and device for displaying pages in applet and computer equipment | |
| CN109976744B (en) | Visual programming method, system and terminal equipment | |
| CN108062401B (en) | Application recommendation method and device and storage medium | |
| US9916391B2 (en) | Method, apparatus and terminal for webpage content browsing | |
| CN110032385A (en) | Component update method, device and electronic equipment | |
| CN114285831B (en) | Data transmission method and device for automobile open architecture | |
| CN103617052B (en) | Method and device for processing cache of application program | |
| CN114860295A (en) | Resource file updating method, device, equipment and readable storage medium | |
| CN113805854A (en) | Method, system and device for realizing Hook of application layer based on Linux system and storage medium | |
| CN112416470B (en) | Command execution method and device, storage medium and electronic device | |
| CN110737780A (en) | Method and device for sending data and method and device for receiving data | |
| CN112073505A (en) | Method for unloading on cloud server, control device and storage medium | |
| CN111901500A (en) | Image processing method and apparatus, storage medium, and electronic apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant |