CN110555120A - picture compression control method and device, computer equipment and storage medium - Google Patents
picture compression control method and device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN110555120A CN110555120A CN201910749531.3A CN201910749531A CN110555120A CN 110555120 A CN110555120 A CN 110555120A CN 201910749531 A CN201910749531 A CN 201910749531A CN 110555120 A CN110555120 A CN 110555120A
- Authority
- CN
- China
- Prior art keywords
- picture
- compression algorithm
- compression
- type information
- compressed
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/53—Querying
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Abstract
The invention discloses a picture compression control method, a picture compression control device, computer equipment and a storage medium, wherein the method comprises the following steps: receiving a picture compression instruction sent by a terminal, wherein the picture compression instruction comprises type information of shooting equipment corresponding to a picture to be compressed; inputting the type information into a preset compression algorithm configuration model to obtain a target compression algorithm corresponding to the picture to be compressed, wherein the preset compression algorithm configuration model is provided with a mapping relation between the type information and the compression algorithm; and compressing the picture to be compressed according to the target compression algorithm. Aiming at the pictures needing to be compressed, the method carries out targeted compression algorithm configuration according to the type information of the pictures, intelligently matches the compression algorithm which is most suitable for compressing the pictures to be compressed, solves the problems of poor picture compression quality, low recognition rate and the like, simultaneously improves the system performance, and meets the actual compression requirements of users on the pictures.
Description
Technical Field
The invention relates to the technical field of image processing, in particular to a picture compression control method and device, computer equipment and a storage medium.
Background
With the development of mobile network technology, more and more people choose to perform various interactive communications through mobile terminals, and the photographing function of the mobile terminals is widely used in the interactive communications process. At present, mobile terminals are fast to update and the brands of mobile terminals on the market are various, and for different mobile terminals, the pictures shot by the shooting function of the mobile terminals are different. Existing systems typically compress pictures using a fixed picture compression algorithm. The method leads the system not to carry out targeted compression on the picture according to the actual situation of the picture, and easily causes the problems of poor picture compression quality, low recognition rate and the like; meanwhile, the performance of the system is also affected, and the actual picture compression requirement is difficult to meet.
Disclosure of Invention
the invention aims to solve at least one of the technical defects, in particular to solve the technical defects that the picture cannot be compressed in a targeted manner according to the actual situation of the picture, the picture compression quality is poor, the recognition rate is low and the like.
in order to solve the above technical problem, the present invention provides a picture compression control method, which comprises the following steps:
receiving a picture compression instruction sent by a terminal, wherein the picture compression instruction comprises type information of shooting equipment corresponding to a picture to be compressed;
inputting the type information into a preset compression algorithm configuration model to obtain a target compression algorithm corresponding to the picture to be compressed, wherein the preset compression algorithm configuration model is provided with a mapping relation between the type information and the compression algorithm;
And compressing the picture to be compressed according to the target compression algorithm.
optionally, before the step of inputting the type information into a preset compression algorithm configuration model to obtain a target compression algorithm corresponding to the picture to be compressed, the method further includes:
At least one compression algorithm is pre-configured in the preset compression algorithm configuration model;
performing sample picture training on the compression algorithm to identify target type information matched with the compression algorithm from the sample picture training;
And mapping and associating the compression algorithm with the matched target type information to generate a compression algorithm configuration model trained to a convergence state.
Optionally, the step of performing sample picture training on the compression algorithm to identify target type information matched with the compression algorithm from the sample picture training further includes:
acquiring a sample picture and first type information of shooting equipment corresponding to the sample picture;
grouping the obtained sample pictures according to the first type information so that the sample pictures belonging to the same group have the same or similar first type information;
compressing the sample pictures by adopting the pre-configured compression algorithm, and grouping and recording corresponding processing effect data of the compressed sample pictures belonging to the same group;
and calculating the matching degree between the compression algorithm and each grouped sample picture according to the processing effect data, and judging whether the first type information is target type information matched with the compression algorithm or not according to the matching degree.
Optionally, the processing effect data includes an actually measured time-consuming parameter in the picture compression process and an actually measured picture quality parameter after the picture compression.
Optionally, the step of calculating a matching degree between the compression algorithm and each group of sample pictures according to the processing effect data, and determining whether the first type information is target type information matched with the compression algorithm according to the matching degree further includes:
acquiring an actual measurement time consumption parameter value and an actual measurement picture quality parameter value in the processing effect data;
Acquiring a first matching value corresponding to the actually-measured time-consuming parameter value and a second matching value corresponding to the actually-measured picture quality parameter value from a preset matching value mapping relation table;
Performing weighted summation calculation on the first matching degree value and the second matching degree value to obtain a total matching degree value between the compression algorithm and each grouped sample picture;
and comparing the total matching degree value with a preset matching degree threshold value, and judging that the first type information is target type information matched with the compression algorithm when the total matching degree value meets the preset matching degree threshold value requirement.
optionally, when two or more compression algorithms are pre-configured in the preset compression algorithm configuration model, the step of calculating a matching degree between the compression algorithm and each group of sample pictures according to the processing effect data, and determining whether the first type information is target type information matched with the compression algorithm according to the matching degree further includes:
and for any grouped sample picture, comparing the corresponding matching degrees of the grouped sample pictures when different compression algorithms are adopted, and acquiring the compression algorithm with the highest matching degree as the compression algorithm matched with the target type information.
in order to solve the above technical problem, the present invention further provides an image compression control apparatus, including:
The device comprises a receiving module and a processing module, wherein the receiving module is used for receiving a picture compression instruction sent by a terminal, and the picture compression instruction comprises type information of shooting equipment corresponding to a picture to be compressed;
the processing module is used for inputting the target type information into a preset compression algorithm configuration model to obtain a target compression algorithm corresponding to the picture to be compressed, wherein the preset compression algorithm configuration model is provided with a mapping relation between the type information and the compression algorithm;
and the execution module is used for compressing the picture to be compressed according to the target compression algorithm.
Optionally, the picture compression control apparatus further includes:
The first setting submodule is used for pre-configuring at least one compression algorithm in the preset compression algorithm configuration model;
the first processing submodule is used for carrying out sample picture training on the compression algorithm so as to identify target type information matched with the compression algorithm from the sample picture training;
And the first execution submodule is used for mapping and associating the compression algorithm with the matched target type information so as to generate a compression algorithm configuration model trained to a convergence state.
Optionally, the picture compression control apparatus further includes:
the first obtaining sub-module is used for obtaining a sample picture and first type information of shooting equipment corresponding to the sample picture;
The second processing submodule is used for carrying out group division on the obtained sample pictures according to the first type information so as to enable the sample pictures belonging to the same group to have the same or similar first type information;
The third processing submodule is used for compressing the sample pictures by adopting the preconfigured compression algorithm and performing grouping recording on corresponding processing effect data of the sample pictures belonging to the same group after compression processing;
And the second execution sub-module is used for calculating the matching degree between the compression algorithm and each group of sample pictures according to the processing effect data, and judging whether the first type information is the target type information matched with the compression algorithm or not according to the matching degree.
Optionally, in the image compression control apparatus, the processing effect data includes an actually measured time-consuming parameter of an image compression process and an actually measured image quality parameter after image compression.
optionally, the picture compression control apparatus further includes:
The second obtaining submodule is used for obtaining an actually-measured time-consuming parameter value and an actually-measured picture quality parameter value in the processing effect data;
A third obtaining sub-module, configured to obtain, from a preset matching degree value mapping relationship table, a first matching degree value corresponding to the actually-measured time-consuming parameter value and a second matching degree value corresponding to the actually-measured picture quality parameter value;
The fourth processing submodule is used for carrying out weighted summation calculation on the first matching degree value and the second matching degree value so as to obtain a total matching degree value between the compression algorithm and each grouped sample picture;
and the third execution sub-module is used for comparing the total matching degree value with a preset matching degree threshold value, and judging that the first type information is target type information matched with the compression algorithm when the total matching degree value meets the preset matching degree threshold value requirement.
Optionally, when two or more compression algorithms are pre-configured in the preset compression algorithm configuration model, the picture compression control device further includes:
And the fourth execution sub-module is used for comparing the corresponding matching degrees of the grouped sample pictures when different compression algorithms are adopted for the arbitrarily grouped sample pictures, and acquiring the compression algorithm with the highest matching degree as the compression algorithm matched with the target type information.
in order to solve the above technical problem, the present invention further provides a computer device, which includes a memory and a processor, where the memory stores computer readable instructions, and the computer readable instructions, when executed by the processor, cause the processor to execute the steps of the above picture compression control method.
in order to solve the above technical problem, the present invention further provides a storage medium storing computer-readable instructions, which when executed by one or more processors, cause the one or more processors to execute the steps of the above picture compression control method.
the invention has the beneficial effects that:
According to the method, a picture compression instruction sent by a terminal is received, so that the picture compression instruction comprises type information of shooting equipment corresponding to a picture to be compressed; then inputting the type information into a preset compression algorithm configuration model to pertinently perform compression algorithm configuration according to the type information, and further acquiring a target compression algorithm corresponding to the picture to be compressed; and finally, compressing the picture to be compressed by adopting the obtained target compression algorithm. Because each picture is subjected to targeted compression algorithm configuration according to the type information of the corresponding shooting equipment, a compression algorithm most suitable for compressing the picture to be compressed is intelligently matched, the problems of poor picture compression quality, low recognition rate and the like are solved, the system performance is improved, and the actual compression requirements of users on the picture are met.
additional aspects and advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.
drawings
in order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic flowchart of a basic method of a picture compression control method according to an embodiment of the present invention;
Fig. 2 is a schematic flow chart of a method for generating a preset compression algorithm configuration model in the picture compression control method according to the embodiment of the present invention;
Fig. 3 is a schematic flow chart of a method for establishing a mapping relationship between a compression algorithm and type information when a preset compression algorithm configuration model is generated by the picture compression control method according to the embodiment of the present invention;
fig. 4 is a schematic flowchart of another method for establishing a mapping relationship between a compression algorithm and type information when a preset compression algorithm configuration model is generated by the picture compression control method according to the embodiment of the present invention;
FIG. 5 is a block diagram of a basic structure of a picture compression control apparatus according to an embodiment of the present invention;
fig. 6 is a block diagram of a basic structure of a computer device according to an embodiment of the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention.
in some of the flows described in the present specification and claims and in the above-described figures, a number of operations are included that occur in a particular order, but it should be clearly understood that these operations may be performed out of order or in parallel as they occur herein, and that the order of the operations is merely to distinguish between the various operations, which by themselves do not represent any order of execution. Additionally, the flows may include more or fewer operations, and the operations may be performed sequentially or in parallel. It should be noted that, the descriptions of "first", "second", etc. in this document are used for distinguishing different messages, devices, modules, etc., and do not represent a sequential order, nor limit the types of "first" and "second" to be different.
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without inventive step, are within the scope of the present invention.
Examples
as will be appreciated by those skilled in the art, "terminal" as used herein includes both devices that are wireless signal receivers, devices that have only wireless signal receivers without transmit capability, and devices that include receive and transmit hardware, devices that have receive and transmit hardware capable of performing two-way communication over a two-way communication link. Such a device may include: a cellular or other communication device having a single line display or a multi-line display or a cellular or other communication device without a multi-line display; PCS (Personal Communications Service), which may combine voice, data processing, facsimile and/or data communication capabilities; a PDA (Personal Digital Assistant), which may include a radio frequency receiver, a pager, internet/intranet access, a web browser, a notepad, a calendar and/or a GPS (Global Positioning System) receiver; a conventional laptop and/or palmtop computer or other device having and/or including a radio frequency receiver. As used herein, a "terminal" or "terminal device" may be portable, transportable, installed in a vehicle (aeronautical, maritime, and/or land-based), or situated and/or configured to operate locally and/or in a distributed fashion at any other location(s) on earth and/or in space. As used herein, a "terminal Device" may also be a communication terminal, a web terminal, a music/video playing terminal, such as a PDA, an MID (Mobile Internet Device) and/or a Mobile phone with music/video playing function, or a smart tv, a set-top box, etc.
The user terminal mentioned in this embodiment is the above terminal.
Referring to fig. 1, fig. 1 is a schematic flowchart illustrating a basic method of a picture compression control method according to an embodiment of the present invention.
As shown in fig. 1, the picture compression control method includes the following steps:
S100: receiving a picture compression instruction sent by a terminal, wherein the picture compression instruction comprises type information of shooting equipment corresponding to a picture to be compressed.
A picture is an information carrier or a medium for a terminal to interact with another terminal. Pictures are commonly used in various interactive communication scenes between terminals, such as picture storage, picture sharing, picture verification, and the like. In the process of using pictures for interactive communication between the terminals, the pictures can be used generally only by preprocessing, wherein the preprocessing comprises compression processing. The picture compression control method provided by the invention can be applied to various interactive communication scenes between the terminal and the terminal, and the pictures used in the interactive communication process between the terminal and the terminal can be generally obtained by shooting through a terminal shooting function or obtained by intercepting from a video stream, namely, each picture has attribute information representing the picture attribute characteristics, and the attribute information comprises type information of shooting equipment corresponding to the picture, parameter information of the picture, format information of the picture and the like. In this embodiment, by analyzing the attributes of the picture according to the user-defined requirement or the built-in requirement of the terminal, the type information of the shooting device corresponding to the picture is obtained, and thus, a picture compression algorithm matched with the type information is obtained according to the type information of the shooting device corresponding to the picture to perform targeted compression processing on the picture. Specifically, when a terminal uses a picture for interactive communication, the terminal is triggered to send a picture compression instruction to a system server, wherein the picture compression instruction comprises type information of a shooting device corresponding to the picture to be compressed, so that the system server performs subsequent picture compression operation according to the type information of the shooting device corresponding to the picture to be compressed in the picture compression instruction after receiving the picture compression instruction sent by the terminal.
s200: inputting the type information into a preset compression algorithm configuration model to obtain a target compression algorithm corresponding to the picture to be compressed, wherein the preset compression algorithm configuration model is provided with a mapping relation between the type information and the compression algorithm.
In this embodiment, after the system server receives a picture compression instruction sent by a terminal and obtains type information of a shooting device corresponding to the picture to be compressed, the system server configures a compression algorithm with a preset type information input value in a preset compression algorithm configuration model, where the preset compression algorithm configuration model is provided with a mapping relationship between the type information and the compression algorithm, so that the preset compression algorithm configuration model configures the compression algorithm for the picture to be compressed according to the type information to obtain a target compression algorithm matched with the picture to be compressed.
the preset compression algorithm configuration model is a convolutional neural network model trained to be in a convergence state, and the convolutional neural network model is trained to be used for obtaining a picture compression algorithm matched with the picture according to the type information of the shooting equipment of the picture. The convolutional neural network model may be a CNN convolutional neural network model or a VGG convolutional neural network model. The convolutional neural network model in this embodiment records the type information of the shooting device corresponding to the picture to be compressed sent by the system in the picture compression operation process executed each time during the model training and the compression algorithm selected correspondingly, and counts the processing effect data such as the time consumed by compression and the quality of the compressed picture after each picture compression processing, so as to determine which compression algorithm the picture to be compressed with different types of information is suitable for according to the processing effect data. And analyzing the matching degree between the picture attribute information and the compression algorithm according to the collected processing effect data as a sample, and training the preset compression algorithm configuration model to a convergence state, so that the preset compression algorithm configuration model has the capability of obtaining a target compression algorithm matched with the picture according to the type information of the shooting equipment corresponding to the picture. In this way, the target compression algorithm matched with the type information of the shooting equipment can be obtained only by inputting the attribute information corresponding to the picture to be compressed, which needs to be compressed, into the preset compression algorithm configuration model, so that the system can automatically allocate the optimal compression algorithm for compressing the current picture to be compressed.
S300: and compressing the picture to be compressed according to the target compression algorithm.
In this embodiment, a plurality of image compression algorithms are set in the preset compression algorithm configuration model, and each compression algorithm has an attribute information range corresponding to and applicable to the compression algorithm. The target compression algorithm is an image compression algorithm which is obtained by comparing the attribute information of the image to be compressed with a plurality of preset image compression algorithms in the model through the preset compression algorithm configuration model and is most suitable for compressing the target image to be compressed. And after the target compression algorithm is obtained, compressing the picture to be compressed according to the compression logic corresponding to the target compression algorithm so as to obtain a compressed picture closest to the requirements of the user or the terminal.
the picture compression control method in the embodiment obtains the type information of the shooting equipment corresponding to the picture to be compressed in the picture compression instruction by receiving the picture compression instruction sent by the terminal; then inputting the type information into a preset compression algorithm configuration model to pertinently perform compression algorithm configuration according to the type information, and further acquiring a target compression algorithm corresponding to the picture to be compressed; and finally, compressing the picture to be compressed by adopting the obtained target compression algorithm. Because each picture is subjected to targeted compression algorithm configuration according to the type information of the corresponding shooting equipment, a compression algorithm most suitable for compressing the picture to be compressed is intelligently matched, the problems of poor picture compression quality, low recognition rate and the like are solved, the system performance is improved, and the actual compression requirements of users on the picture are met.
in some embodiments, please refer to fig. 2, and fig. 2 is a flowchart illustrating a method for generating a preset compression algorithm configuration model in a picture compression control method according to an embodiment of the present invention.
As shown in fig. 2, the step S200 further includes a step S400 to a step S600. Which comprises the following steps:
S400: and at least one compression algorithm is configured in the preset compression algorithm configuration model in advance.
In this embodiment, before the target compression algorithm corresponding to the picture to be compressed is obtained, a compression algorithm configuration model needs to be generated in advance, and the preset compression algorithm configuration model has the capability of obtaining a corresponding matched compression algorithm according to the shooting device type information of the picture to be compressed. Specifically, at least one compression algorithm, such as a size compression algorithm, a format compression algorithm, a quality compression algorithm, and the like, is pre-configured in the preset compression algorithm configuration model. The size compression is to actually reduce the pixel value by reducing the pixel value of a unit size to achieve the compression effect. For example, in some compression algorithms, the picture compression is completed by obtaining the height and width of the picture to be compressed, and performing numerical value multiplication on the height and width of the picture to be compressed and a scale factor transmitted in advance to obtain the compressed height and width of the picture to be compressed; for another example, in some compression algorithms, the height and width of the picture to be compressed are obtained, and the height and width of the picture to be compressed are multiplied by a scale factor which is transmitted in advance to obtain the compressed height and width of the picture to be compressed, and the height and width of the picture are initialized by an affinetransform op object to complete picture compression. The format compression algorithm is to convert bitMap into image formats such as jpeg, PNG and the like, wherein the bitMap is the simplest bitMap of the image, the corresponding image is an original uncompressed bitMap, and the image algorithms such as jpeg, PNG and the like can compress and store the bitMap according to the corresponding image compression algorithm and resolution ratio and can also restore the bitMap. Since jpeg and PNG are lossy compression, distortion occurs after compression compared to the original image. The quality compression algorithm assimilates pixels close to some pixel points in the picture through the algorithm, thereby achieving the purposes of reducing the quality and reducing the size of the picture. For example, in some compression algorithms, the picture to be compressed is compressed through the JPEGEncodeParam object parameters according to the quality parameters of the picture to be compressed and the scale factors transmitted in advance by acquiring the quality parameters of the picture to be compressed, and the algorithm only changes the picture quality, does not change the size of the picture, and is suitable for scenes with low requirements on the picture quality; for another example, in some algorithms, the quality parameter of the picture to be compressed is obtained, and the picture to be compressed is compressed through the ImageWriteParam object parameter according to the quality parameter of the picture to be compressed and the scale factor which is transmitted in advance.
S500: and carrying out sample picture training on the compression algorithm to identify target type information matched with the compression algorithm from the sample picture training.
In this embodiment, after the compression algorithm is pre-configured in the preset compression algorithm configuration model, sample picture training is performed on the pre-configured compression algorithm in the preset compression algorithm configuration model, so as to identify target type information matched with the compression algorithm from the sample picture training. For example, a large number of sample pictures are obtained first, and attribute analysis is performed on each sample picture to obtain type information of the photographing device corresponding to each sample picture, it can be understood that the sample pictures are obtained by taking into account the diversity of the type information of the photographing device and the number of sample pictures of each photographing device type. And then compressing the sample picture by adopting a preset compression algorithm in the preset compression algorithm configuration model and recording processing effect data corresponding to the sample picture, such as the time consumption for compression, the quality of the compressed picture and the like. Furthermore, according to the analysis of the processing effect data after the sample picture compression, the type information of the shooting device corresponding to the sample picture matched with the compression algorithm is obtained as the target type information, for example, a certain compression algorithm is adopted to compress the sample picture shot by the model (or type) 1 shooting device and the sample picture shot by the model (or type) 2 shooting device, if the compressed processing effect data is obtained through analysis, the compression time consumption of the algorithm when compressing the sample picture shot by the model (or type) 1 shooting device is shorter, the quality of the compressed picture is better, it is shown that the compression algorithm is more matched with the model (or type) 1 shooting device, and then the model (or type) 1 is the target type information matched with the compression algorithm.
S600: and mapping and associating the compression algorithm with the matched target type information to generate a compression algorithm configuration model trained to a convergence state.
In this embodiment, for a compression algorithm configured in advance in the preset compression algorithm configuration model, the target type information matched with the compression algorithm and the matching degree between the target type information and the compression algorithm are identified through sample picture training, and the compression algorithm is mapped and associated with the target type information matched with the compression algorithm, so as to generate a compression algorithm configuration model trained to a convergence state, so that the preset compression algorithm configuration model has the capability of obtaining the target compression algorithm matched with the picture according to the type information of the shooting device corresponding to the picture.
In some embodiments, the image compression control method may be applied to a face recognition scene, please refer to fig. 3, where fig. 3 is a schematic flow chart of a method for establishing a mapping relationship between a compression algorithm and type information when a preset compression algorithm configuration model is generated by the image compression control method according to the embodiment of the present invention.
As shown in fig. 3, the step S500 further includes steps S510 to S540. Wherein, S510: acquiring a sample picture and first type information of shooting equipment corresponding to the sample picture; s520: grouping the obtained sample pictures according to the first type information so that the sample pictures belonging to the same group have the same or similar first type information; s530: compressing the sample pictures by adopting the pre-configured compression algorithm, and grouping and recording corresponding processing effect data of the compressed sample pictures belonging to the same group; and S540, calculating the matching degree between the compression algorithm and each group of sample pictures according to the processing effect data, and judging whether the first type information is the target type information matched with the compression algorithm or not according to the matching degree.
In this embodiment, in the process of training sample pictures for the compression algorithm configured in advance in the preset compression algorithm configuration model, by acquiring a large number of sample pictures and performing attribute analysis on each sample picture, the first type information of the shooting device corresponding to each sample picture is acquired, and it can be understood that the diversity of the shooting device type information and the sufficient number of sample pictures of each shooting device type should be considered when acquiring the sample pictures. After obtaining the first type information of each sample picture and the corresponding shooting device, group division is performed on the obtained sample pictures according to the first type information, so that the sample pictures belonging to the same group have the same or similar first type information, for example, the sample pictures of which the corresponding first type information is type (or type) 1 are divided into one group, the sample pictures of which the corresponding first type information is type (or type) 2 are divided into another group, and the like, and other sample pictures different from the type (or type) 1 and the type (or type) 2 are also grouped according to the first type information. After grouping is completed, the sample pictures are compressed by adopting the preset compression algorithm, corresponding processing effect data of the sample pictures belonging to the same group are subjected to compression processing and are grouped and recorded, the processing effect data corresponding to each group representing one type (or type) is also obtained, furthermore, the matching degree between the compression algorithm and the grouped sample pictures is calculated according to the processing effect data corresponding to each group, and whether the first type information is the target type information matched with the compression algorithm is judged according to the matching degree. For example, if the processing effect data corresponding to the group is analyzed to obtain that the time consumed for compressing the group of sample pictures corresponding to more than eighty percent of the sample pictures is short and the quality of the compressed pictures is good, it can be determined that the first type information is the target type information matched with the compression algorithm.
In some embodiments, please refer to fig. 4, where fig. 4 is a schematic flow chart of another method for establishing a mapping relationship between a compression algorithm and type information when a preset compression algorithm configuration model is generated by the picture compression control method according to the embodiment of the present invention.
As shown in fig. 4, the step S540 may further include steps S541 to S544. Wherein, S541: acquiring an actual measurement time consumption parameter value and an actual measurement picture quality parameter value in the processing effect data; s542: acquiring a first matching value corresponding to the actually-measured time-consuming parameter value and a second matching value corresponding to the actually-measured picture quality parameter value from a preset matching value mapping relation table; s543: performing weighted summation calculation on the first matching degree value and the second matching degree value to obtain a total matching degree value between the compression algorithm and each grouped sample picture; s544: and comparing the total matching degree value with a preset matching degree threshold value, and judging that the first type information is target type information matched with the compression algorithm when the total matching degree value meets the preset matching degree threshold value requirement.
In this embodiment, before determining whether a compression algorithm matches with the first type information of the shooting device corresponding to the grouped sample picture, the system is preset with a matching degree value mapping table, where the matching degree value mapping table is a standard for determining whether a compression algorithm matches with the first type information of the shooting device corresponding to the grouped sample picture, for example, taking compression time consumption as an example, the compression time consumption is divided into four levels of 0.5 second, 1 second, 2 seconds, and 3 seconds, and the matching degree values corresponding to the compression algorithm are 90%, 80%, 70%, and 60%, respectively. Therefore, when a compression algorithm is matched with the shooting equipment type information corresponding to the grouped sample pictures, the method specifically comprises the step of obtaining an actual measurement time consumption value and an actual measurement picture quality parameter value in the processing effect data, wherein the actual measurement time consumption value and the actual measurement picture quality parameter value are a compression time consumption value and a picture quality parameter value obtained after the sample pictures are compressed by adopting the compression algorithm. And then, searching from a preset matching degree value mapping relation table according to the actually-measured time-consuming parameter value and the actually-measured picture quality parameter value, and acquiring a first matching degree value corresponding to the actually-measured time-consuming parameter value and a second matching degree value corresponding to the actually-measured picture quality parameter value. After the first matching degree value and the second matching degree value are obtained, weighting and summing calculation is carried out on the first matching degree value and the second matching degree value according to the weight values corresponding to the first matching degree value and the second matching degree value, a total matching degree value between the compression algorithm and the grouped sample pictures is obtained, furthermore, the total matching degree value is compared with a preset matching degree threshold value, when the total matching degree value meets the preset matching degree threshold value requirement, the compression algorithm is judged to be matched with shooting equipment type information corresponding to the grouped sample pictures, and then the first type information is determined to be target type information matched with the compression algorithm.
In some embodiments, when two or more compression algorithms are pre-configured in the preset compression algorithm configuration model, each compression algorithm is used to compress the sample pictures of each group, so that each group of sample pictures has multiple groups of processing effect data, where each group of processing effect data corresponds to one compression algorithm. At the moment, the first type information corresponding to the grouped sample pictures is the target type information, and the compression algorithm with the highest matching degree is obtained as the compression algorithm matched with the target type information by comparing the matching degrees corresponding to the grouped sample pictures when different compression algorithms are adopted.
To solve the above technical problem, an embodiment of the present invention further provides a picture compression control apparatus. Referring to fig. 5, fig. 5 is a block diagram of a basic structure of a picture compression control apparatus according to an embodiment of the present invention.
As shown in fig. 5, a picture compression control apparatus includes: a receiving module 10, a processing module 20 and an executing module 30. The receiving module 10 is configured to receive a picture compression instruction sent by a terminal, where the picture compression instruction includes type information of a shooting device corresponding to a picture to be compressed; the processing module 20 is configured to input the target type information into a preset compression algorithm configuration model to obtain a target compression algorithm corresponding to the picture to be compressed, where a mapping relationship between the type information and the compression algorithm is set in the preset compression algorithm configuration model; the execution module 30 is configured to perform compression processing on the picture to be compressed according to the target compression algorithm.
in some embodiments, the picture compression control apparatus further comprises: the device comprises a first setting submodule, a first processing submodule and a first executing submodule. The first setting submodule is used for pre-configuring at least one compression algorithm in the preset compression algorithm configuration model; the first processing sub-module is used for carrying out sample picture training on the compression algorithm so as to identify target type information matched with the compression algorithm from the sample picture training; the first execution submodule is used for mapping and associating the compression algorithm with the matched target type information so as to generate a compression algorithm configuration model trained to a convergence state.
in some embodiments, the picture compression control apparatus further comprises: the device comprises a first obtaining submodule, a second processing submodule, a third processing submodule and a second executing submodule. The first obtaining sub-module is used for obtaining a sample picture and first type information of shooting equipment corresponding to the sample picture; the second processing sub-module is used for carrying out group division on the obtained sample pictures according to the first type information so as to enable the sample pictures belonging to the same group to have the same or similar first type information; the third processing submodule is used for compressing the sample pictures by adopting the preconfigured compression algorithm and performing grouping recording on corresponding processing effect data of the sample pictures belonging to the same group after compression processing; the second execution submodule is used for calculating the matching degree between the compression algorithm and each group of sample pictures according to the processing effect data, and judging whether the first type information is the target type information matched with the compression algorithm or not according to the matching degree.
In some embodiments, in the apparatus for controlling picture compression, the processing effect data includes an actually measured time-consuming parameter of a picture compression process and an actually measured picture quality parameter after picture compression.
In some embodiments, the picture compression control apparatus further comprises: a second obtaining submodule, a third obtaining submodule, a fourth processing submodule and a third executing submodule. The second obtaining submodule is used for obtaining an actually-measured time-consuming parameter value and an actually-measured picture quality parameter value in the processing effect data; the third obtaining submodule is used for obtaining a first matching value corresponding to the actually-measured time-consuming parameter value and a second matching value corresponding to the actually-measured picture quality parameter value from a preset matching value mapping relation table; the fourth processing submodule is used for carrying out weighted summation calculation on the first matching degree value and the second matching degree value so as to obtain a total matching degree value between the compression algorithm and each grouped sample picture; and the third execution sub-module is used for comparing the total matching degree value with a preset matching degree threshold value, and judging that the first type information is target type information matched with the compression algorithm when the total matching degree value meets the preset matching degree threshold value requirement.
In some embodiments, when two or more compression algorithms are pre-configured in the preset compression algorithm configuration model, the picture compression control device further includes: and a fourth execution submodule. The fourth execution submodule is used for comparing the matching degrees of the grouped sample pictures when different compression algorithms are adopted for the arbitrarily grouped sample pictures, and acquiring the compression algorithm with the highest matching degree as the compression algorithm matched with the target type information.
The picture compression control device in the above embodiment obtains the type information of the shooting device corresponding to the picture to be compressed in the picture compression instruction by receiving the picture compression instruction sent by the terminal; then inputting the type information into a preset compression algorithm configuration model to pertinently perform compression algorithm configuration according to the type information, and further acquiring a target compression algorithm corresponding to the picture to be compressed; and finally, compressing the picture to be compressed by adopting the obtained target compression algorithm. Because each picture is subjected to targeted compression algorithm configuration according to the type information of the corresponding shooting equipment, a compression algorithm most suitable for compressing the picture to be compressed is intelligently matched, the problems of poor picture compression quality, low recognition rate and the like are solved, the system performance is improved, and the actual compression requirements of users on the picture are met.
In order to solve the technical problem, an embodiment of the present invention further provides a computer device. Referring to fig. 6 in detail, fig. 6 is a block diagram of a basic structure of a computer device according to an embodiment of the present invention.
As shown in fig. 6, the internal structure of the computer device is schematically illustrated. As shown in fig. 6, the computer device includes a processor, a non-volatile storage medium, a memory, and a network interface connected through a system bus. The non-volatile storage medium of the computer device stores an operating system, a database and computer readable instructions, the database can store control information sequences, and the computer readable instructions can enable the processor to realize a picture compression control method when being executed by the processor. The processor of the computer device is used for providing calculation and control capability and supporting the operation of the whole computer device. The memory of the computer device may have stored therein computer readable instructions that, when executed by the processor, may cause the processor to perform a picture compression control method. The network interface of the computer device is used for connecting and communicating with the terminal. Those skilled in the art will appreciate that the architecture shown in fig. 6 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In the present embodiment, the processor is configured to execute specific functions of the receiving module 10, the processing module 20 and the executing module 30 in fig. 5, and the memory stores program codes and various types of data required for executing the modules. The network interface is used for data transmission between user terminals or servers. The memory in this embodiment stores program codes and data required for executing all the sub-modules in the picture compression control device, and the server can call the program codes and data of the server to execute the functions of all the sub-modules.
the computer device in the above embodiment obtains, by receiving a picture compression instruction sent by a terminal, type information of a shooting device corresponding to a picture to be compressed included in the picture compression instruction; then inputting the type information into a preset compression algorithm configuration model to pertinently perform compression algorithm configuration according to the type information, and further acquiring a target compression algorithm corresponding to the picture to be compressed; and finally, compressing the picture to be compressed by adopting the obtained target compression algorithm. Because each picture is subjected to targeted compression algorithm configuration according to the type information of the corresponding shooting equipment, a compression algorithm most suitable for compressing the picture to be compressed is intelligently matched, the problems of poor picture compression quality, low recognition rate and the like are solved, the system performance is improved, and the actual compression requirements of users on the picture are met.
The present invention also provides a storage medium storing computer-readable instructions, which when executed by one or more processors, cause the one or more processors to perform the steps of the picture compression control method according to any of the above embodiments.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and can include the processes of the embodiments of the methods described above when the computer program is executed. The storage medium may be a non-volatile storage medium such as a magnetic disk, an optical disk, a Read-Only Memory (ROM), or a Random Access Memory (RAM).
it should be understood that, although the steps in the flowcharts of the figures are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and may be performed in other orders unless explicitly stated herein. Moreover, at least a portion of the steps in the flow chart of the figure may include multiple sub-steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, which are not necessarily performed in sequence, but may be performed alternately or alternately with other steps or at least a portion of the sub-steps or stages of other steps.
The foregoing is only a partial embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and decorations can be made without departing from the principle of the present invention, and these modifications and decorations should also be regarded as the protection scope of the present invention.
Claims (10)
1. a picture compression control method is characterized by comprising the following steps:
Receiving a picture compression instruction sent by a terminal, wherein the picture compression instruction comprises type information of shooting equipment corresponding to a picture to be compressed;
inputting the type information into a preset compression algorithm configuration model to obtain a target compression algorithm corresponding to the picture to be compressed, wherein the preset compression algorithm configuration model is provided with a mapping relation between the type information and the compression algorithm;
and compressing the picture to be compressed according to the target compression algorithm.
2. The method according to claim 1, wherein before the step of inputting the type information into a preset compression algorithm configuration model to obtain a target compression algorithm corresponding to the picture to be compressed, the method further comprises:
At least one compression algorithm is pre-configured in the preset compression algorithm configuration model;
performing sample picture training on the compression algorithm to identify target type information matched with the compression algorithm from the sample picture training;
And mapping and associating the compression algorithm with the matched target type information to generate a compression algorithm configuration model trained to a convergence state.
3. the method according to claim 2, wherein the step of performing sample picture training on the compression algorithm to identify target type information matching the compression algorithm from the sample picture training further comprises:
Acquiring a sample picture and first type information of shooting equipment corresponding to the sample picture;
grouping the obtained sample pictures according to the first type information so that the sample pictures belonging to the same group have the same or similar first type information;
Compressing the sample pictures by adopting the pre-configured compression algorithm, and grouping and recording corresponding processing effect data of the compressed sample pictures belonging to the same group;
And calculating the matching degree between the compression algorithm and each grouped sample picture according to the processing effect data, and judging whether the first type information is target type information matched with the compression algorithm or not according to the matching degree.
4. The method according to claim 3, wherein the processing effect data comprises measured time-consuming parameters of the picture compression process and measured picture quality parameters after the picture compression.
5. The picture compression control method according to claim 4, wherein the step of calculating a matching degree between the compression algorithm and each of the grouped sample pictures according to the processing effect data, and judging whether the first type information is target type information that matches the compression algorithm according to the matching degree, further comprises:
acquiring an actual measurement time consumption parameter value and an actual measurement picture quality parameter value in the processing effect data;
acquiring a first matching value corresponding to the actually-measured time-consuming parameter value and a second matching value corresponding to the actually-measured picture quality parameter value from a preset matching value mapping relation table;
Performing weighted summation calculation on the first matching degree value and the second matching degree value to obtain a total matching degree value between the compression algorithm and each grouped sample picture;
And comparing the total matching degree value with a preset matching degree threshold value, and judging that the first type information is target type information matched with the compression algorithm when the total matching degree value meets the preset matching degree threshold value requirement.
6. The method according to claim 3, wherein when two or more compression algorithms are pre-configured in the preset compression algorithm configuration model, the step of calculating a matching degree between the compression algorithm and each group of sample pictures according to the processing effect data, and determining whether the first type information is target type information matched with the compression algorithm according to the matching degree further comprises:
And for any grouped sample picture, comparing the corresponding matching degrees of the grouped sample pictures when different compression algorithms are adopted, and acquiring the compression algorithm with the highest matching degree as the compression algorithm matched with the target type information.
7. a picture compression control apparatus, comprising:
The device comprises a receiving module and a processing module, wherein the receiving module is used for receiving a picture compression instruction sent by a terminal, and the picture compression instruction comprises type information of shooting equipment corresponding to a picture to be compressed;
the processing module is used for inputting the target type information into a preset compression algorithm configuration model to obtain a target compression algorithm corresponding to the picture to be compressed, wherein the preset compression algorithm configuration model is provided with a mapping relation between the type information and the compression algorithm;
And the execution module is used for compressing the picture to be compressed according to the target compression algorithm.
8. the picture compression control apparatus according to claim 7, further comprising:
the first setting submodule is used for pre-configuring at least one compression algorithm in the preset compression algorithm configuration model;
The first processing submodule is used for carrying out sample picture training on the compression algorithm so as to identify target type information matched with the compression algorithm from the sample picture training;
And the first execution submodule is used for mapping and associating the compression algorithm with the matched target type information so as to generate a compression algorithm configuration model trained to a convergence state.
9. a computer device comprising a memory and a processor, the memory having stored therein computer-readable instructions that, when executed by the processor, cause the processor to perform the picture compression control method of any one of claims 1 to 6.
10. a storage medium storing computer-readable instructions which, when executed by one or more processors, cause the one or more processors to perform the picture compression control method of any one of claims 1 to 6 above.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910749531.3A CN110555120B (en) | 2019-08-14 | 2019-08-14 | Picture compression control method, device, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910749531.3A CN110555120B (en) | 2019-08-14 | 2019-08-14 | Picture compression control method, device, computer equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110555120A true CN110555120A (en) | 2019-12-10 |
| CN110555120B CN110555120B (en) | 2023-09-08 |
Family
ID=68737618
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910749531.3A Active CN110555120B (en) | 2019-08-14 | 2019-08-14 | Picture compression control method, device, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110555120B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111552670A (en) * | 2020-04-30 | 2020-08-18 | 福建天晴在线互动科技有限公司 | Method and system for expanding and supporting compressed file and decompressed file |
| EP3945471A1 (en) * | 2020-07-28 | 2022-02-02 | Siemens Aktiengesellschaft | Method for automated determination of a model compression technique for compression of an artificial intelligence-based model |
| CN114095730A (en) * | 2022-01-11 | 2022-02-25 | 山东捷瑞数字科技股份有限公司 | Picture compression method and system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7257158B1 (en) * | 1998-05-18 | 2007-08-14 | Kendyl A. Román | System for transmitting video images over a computer network to a remote receiver |
| CN103503381A (en) * | 2011-11-21 | 2014-01-08 | 华为技术有限公司 | Method, device and system for device redirection data transmission |
| CN108399052A (en) * | 2018-02-07 | 2018-08-14 | 深圳壹账通智能科技有限公司 | Picture compression method, apparatus, computer equipment and storage medium |
| CN110035308A (en) * | 2019-04-10 | 2019-07-19 | 青岛海信电器股份有限公司 | Data processing method, equipment and storage medium |
-
2019
- 2019-08-14 CN CN201910749531.3A patent/CN110555120B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7257158B1 (en) * | 1998-05-18 | 2007-08-14 | Kendyl A. Román | System for transmitting video images over a computer network to a remote receiver |
| CN103503381A (en) * | 2011-11-21 | 2014-01-08 | 华为技术有限公司 | Method, device and system for device redirection data transmission |
| CN108399052A (en) * | 2018-02-07 | 2018-08-14 | 深圳壹账通智能科技有限公司 | Picture compression method, apparatus, computer equipment and storage medium |
| CN110035308A (en) * | 2019-04-10 | 2019-07-19 | 青岛海信电器股份有限公司 | Data processing method, equipment and storage medium |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111552670A (en) * | 2020-04-30 | 2020-08-18 | 福建天晴在线互动科技有限公司 | Method and system for expanding and supporting compressed file and decompressed file |
| EP3945471A1 (en) * | 2020-07-28 | 2022-02-02 | Siemens Aktiengesellschaft | Method for automated determination of a model compression technique for compression of an artificial intelligence-based model |
| WO2022023022A1 (en) * | 2020-07-28 | 2022-02-03 | Siemens Aktiengesellschaft | Method for automated determination of a model compression technique for compression of an artificial intelligence-based model |
| CN114095730A (en) * | 2022-01-11 | 2022-02-25 | 山东捷瑞数字科技股份有限公司 | Picture compression method and system |
| CN114095730B (en) * | 2022-01-11 | 2022-04-19 | 山东捷瑞数字科技股份有限公司 | Picture compression method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110555120B (en) | 2023-09-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110555120B (en) | Picture compression control method, device, computer equipment and storage medium | |
| US8718378B2 (en) | Image topological coding for visual search | |
| US20170193639A1 (en) | Computational-complexity adaptive method and system for transferring low dynamic range image to high dynamic range image | |
| CN111523347A (en) | Image detection method and device, computer equipment and storage medium | |
| US20230401833A1 (en) | Method, computer device, and storage medium, for feature fusion model training and sample retrieval | |
| CN115442575B (en) | Video self-adaptive transmission method and system based on video quality evaluation | |
| CN112950640A (en) | Video portrait segmentation method and device, electronic equipment and storage medium | |
| CN114418121A (en) | Model training method, object processing method and device, electronic device and medium | |
| CN112132279A (en) | Convolutional neural network model compression method, device, equipment and storage medium | |
| CN108446688B (en) | Face image gender judgment method and device, computer equipment and storage medium | |
| CN114861790A (en) | Method, system and device for optimizing federal learning compression communication | |
| CN112399177B (en) | Video coding method, device, computer equipment and storage medium | |
| CN111539353A (en) | Image scene recognition method and device, computer equipment and storage medium | |
| CN111369477A (en) | Method for pre-analysis and tool self-adaptation of video recovery task | |
| CN112070211B (en) | Image recognition method based on computing unloading mechanism | |
| CN116363641A (en) | Image processing method and device and electronic equipment | |
| CN115115986A (en) | Video quality evaluation model production method, device, equipment and medium | |
| CN111476060A (en) | Face definition analysis method and device, computer equipment and storage medium | |
| CN115278225A (en) | Method and device for selecting chroma coding mode and computer equipment | |
| CN115082828A (en) | Video key frame extraction method and device based on dominating set | |
| CN111243046B (en) | Image quality detection method, device, electronic equipment and storage medium | |
| US10764578B2 (en) | Bit rate optimization system and method | |
| US20240119637A1 (en) | Image synthesis method and system | |
| US20080165760A1 (en) | Method and Apparatus For Optimizing Flow Control Over Wlans | |
| Nami et al. | Lightweight Multitask Learning for Robust JND Prediction using Latent Space and Reconstructed Frames |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20230810 Address after: 135 Baicaowa, Taiziyu, Fengtai District, Beijing, 100071 Applicant after: Xiang Yu Address before: 518000 Room 202, block B, aerospace micromotor building, No.7, Langshan No.2 Road, Xili street, Nanshan District, Shenzhen City, Guangdong Province Applicant before: Shenzhen LIAN intellectual property service center Effective date of registration: 20230810 Address after: 518000 Room 202, block B, aerospace micromotor building, No.7, Langshan No.2 Road, Xili street, Nanshan District, Shenzhen City, Guangdong Province Applicant after: Shenzhen LIAN intellectual property service center Address before: 518000 Room 201, building A, No. 1, Qian Wan Road, Qianhai Shenzhen Hong Kong cooperation zone, Shenzhen, Guangdong (Shenzhen Qianhai business secretary Co., Ltd.) Applicant before: PING AN PUHUI ENTERPRISE MANAGEMENT Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |