CN109712082B - Method and device for collaboratively repairing picture - Google Patents
Method and device for collaboratively repairing picture Download PDFInfo
- Publication number
- CN109712082B CN109712082B CN201811482595.3A CN201811482595A CN109712082B CN 109712082 B CN109712082 B CN 109712082B CN 201811482595 A CN201811482595 A CN 201811482595A CN 109712082 B CN109712082 B CN 109712082B
- Authority
- CN
- China
- Prior art keywords
- picture
- terminals
- operation step
- list
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a method and a device for collaboratively repairing a picture, wherein the method comprises the following steps: the server sends the picture to be repaired to at least two terminals of the collaborative repair picture according to the collaborative repair picture request of the terminals; the server receives a picture modification operation step list of the picture to be modified and corresponding face areas from the at least two terminals respectively; the server combines the picture trimming operation steps into a total picture trimming operation step list according to the picture trimming operation step list and the corresponding face area; the total picture trimming operation step list comprises picture trimming operation step lists sent by the at least two terminals and corresponding face areas; and the server respectively sends the total picture repairing operation step lists to the at least two terminals, so that the at least two terminals respectively modify the pictures to be repaired locally stored in the terminals according to the total picture repairing operation step lists. The invention can realize high-efficiency multi-person collaborative map repair.
Description
Technical Field
The present invention relates to the field of image processing, and in particular, to a method, a server, a terminal, a system, an apparatus, and a storage medium for collaborative cropping.
Background
At present, a problem is encountered when a mobile phone is used for being combined with a plurality of people: that is, when everyone needs to repair their own part of the picture and then combine it into the same picture, the process is inefficient. The figure trimming includes cutting, color matching, portrait beautifying, picture synthesis, filter adding, etc.
The current solutions are three:
1. one person repairs the drawings, which can be difficult to satisfy all.
2. The same person takes turns, but this requires all to be present and is inefficient.
3. The photos are sequentially transmitted to the next person for trimming the pictures, so that the pictures are trimmed and stored for multiple times, the picture effect is poor, and the process is complicated.
Disclosure of Invention
To this end, the present invention provides a method, server, terminal, system, apparatus, and computer-readable storage medium for collaborative cropping in an effort to solve, or at least alleviate, at least one of the problems identified above.
According to an aspect of the present invention, there is provided a method of collaborative pruning, performed in a server, the method including:
sending the picture to be repaired to at least two terminals of the collaborative repair picture according to the collaborative repair picture request of the terminals;
receiving a picture modification operation list of the picture to be modified and a corresponding face area from the at least two terminals respectively, wherein the picture modification operation list and the corresponding face area are generated according to the terminal according to the modification operation of a user on the face area in the picture to be modified;
merging the picture trimming operation steps into a total picture trimming operation step list according to the picture trimming operation step list and the corresponding face area; the total picture trimming operation step list comprises picture trimming operation step lists sent by the at least two terminals and corresponding face areas;
and respectively sending the total picture repairing operation step lists to the at least two terminals, so that the at least two terminals respectively modify the pictures to be repaired, which are locally stored in the terminals, according to the total picture repairing operation step lists.
Optionally, before the step of receiving the list of the image modifying operation steps of the to-be-modified image and the corresponding face region from the at least two terminals, the method further includes:
judging whether the at least two terminals use the effect kernel library of the same version or not, and generating a judgment result;
and if so, executing a step of respectively receiving a picture modification operation list of the picture to be modified and a corresponding face area from at least two terminals.
Optionally, after the step of determining whether the at least two terminals use the same version of the effect kernel library, the method further includes:
when the judgment result is negative, receiving at least two processed pictures which are obtained by the user through picture modification processing on the picture to be modified stored locally in the terminal from the at least two terminals;
and merging the retouching effects of the at least two processed pictures into one target picture.
Optionally, the step of combining the retouching effect on the at least two processed pictures into one target picture includes:
detecting all faces in the at least two processed pictures to obtain a candidate face frame;
traversing all the candidate face frames for identification, and judging whether the candidate face frames are the same face so as to acquire the regions of the same face in the at least two processed pictures;
making a mask of a human face on the region, and performing opacity attenuation from inside to outside by using a smoothing algorithm;
judging whether the human face in the area is subjected to deformation processing or not;
when the deformation processing is judged to be performed, calculating a deviation image of the American type by using an inverse American type algorithm, and applying the effect of the deviation image to a target image with a mask.
Optionally, the step of combining the retouching effect of the at least two processed pictures into one target picture further includes:
judging whether each region of the face uses mapping processing or not;
if the mapping processing is judged to be used, pixels at various positions in the picture are merged by using a fusion algorithm.
According to another aspect of the present invention, there is provided a method for collaborative map repair, which is performed in a terminal, the method including:
acquiring a picture to be repaired;
recording the picture modification operation step list and the corresponding face area according to the modification operation of the user on the face area on the picture to be modified;
sending the picture repairing operation step list and the corresponding face area to a server;
receiving a general repair picture operation step list from a server; the total picture trimming operation step list comprises picture trimming operation step lists sent by all terminals of all the collaborative trimming pictures and corresponding face areas;
according to the total picture repairing operation step list, carrying out picture repairing processing on the picture to be modified which is locally stored in the terminal, and generating a modified picture; and displayed.
According to another aspect of the present invention, there is provided an apparatus for collaborative cropping, residing in a server, comprising:
the sending unit is used for sending the picture to be repaired to at least two terminals of the collaborative repair picture according to the collaborative repair picture request of the terminals;
the receiving unit is used for respectively receiving a picture modification operation step list and a corresponding face area of the picture to be modified from at least two terminals, wherein the picture modification operation step list and the corresponding face area are recorded and generated according to the modification operation of the terminal on the face area in the picture to be modified by a user;
the merging unit merges the operation steps into a total image trimming operation step list according to the image trimming operation step list and the corresponding face area; the total picture trimming operation step list comprises picture trimming operation step lists sent by the at least two terminals and corresponding face areas;
and the sending unit is used for sending the total picture repairing operation step lists to the at least two terminals respectively, so that the at least two terminals modify the pictures to be repaired locally stored in the terminals respectively according to the total picture repairing operation step lists.
Optionally, the apparatus further includes:
the judging unit is used for judging whether the at least two terminals use the effect kernel library of the same version or not and generating a judging result; and when the judgment result is yes, starting the receiving unit.
According to another aspect of the present invention, there is provided an apparatus for collaborative map repair, which resides in a terminal, and includes:
the acquisition unit is used for acquiring a picture to be repaired;
the recording unit is used for recording the picture modification operation step list and the corresponding face area according to the modification operation of the user on the face area on the picture to be modified;
the sending unit is used for sending the picture repairing operation step list and the corresponding face area to a server;
the receiving unit is used for receiving the general repair picture operation step list from the server; the total picture trimming operation step list comprises picture trimming operation step lists sent by terminals of all the collaborative picture trimming and corresponding face areas;
the processing unit is used for carrying out image modification processing on the image to be modified which is locally stored according to the total image modification operation step list to generate a modified image;
and the display unit is used for displaying the modified picture.
According to another aspect of the present invention, there is provided a server comprising:
one or more processors;
a memory; and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing any of the methods described above.
According to another aspect of the present invention, there is provided a terminal including:
one or more processors;
a memory; and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing the methods described above.
According to another aspect of the invention, there is provided a computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a server, cause the server to perform any of the methods described above.
According to another aspect of the present invention, there is provided a system for collaborative map repair, comprising a server as described above and at least two terminals as described above.
According to the scheme of the collaborative map repairing, the cloud synchronization technology is mainly integrated into the traditional map repairing technology, so that users can repair the map in a collaborative mode, and the problem that the efficiency is low when multiple people meet the requirement of repairing the map in a collaborative mode is solved.
Drawings
To the accomplishment of the foregoing and related ends, certain illustrative aspects are described herein in connection with the following description and the annexed drawings, which are indicative of various ways in which the principles disclosed herein may be practiced, and all aspects and equivalents thereof are intended to be within the scope of the claimed subject matter. The above and other objects, features and advantages of the present disclosure will become more apparent from the following detailed description read in conjunction with the accompanying drawings. Throughout this disclosure, like reference numerals generally refer to like parts or elements.
FIG. 1 shows a flow diagram (server side) of a method 100 of collaborative pruning according to one embodiment of the present invention;
FIG. 2 shows a flow diagram (server side) of a method 200 of collaborative pruning according to another embodiment of the present invention;
FIG. 3 shows a flow diagram (terminal side) of a method 300 of collaborative pruning according to another embodiment of the present invention;
fig. 4 is a schematic diagram of an apparatus 400 (server side) for collaborative map modification according to an embodiment of the present invention.
Fig. 5 is a schematic diagram of an apparatus 500 (terminal side) for collaborative map modification according to an embodiment of the present invention.
FIG. 6 is a schematic connection diagram illustrating a system 600 for collaborative pruning according to an embodiment of the present invention;
FIG. 7 illustrates a schematic diagram of a computing device 700, according to an embodiment of the invention.
Detailed Description
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
Fig. 1 is a method (server side) for collaborative map repair according to a first embodiment of the present invention, where the method includes:
and 140, the server sends the total picture repairing operation step lists to the at least two terminals respectively, so that the at least two terminals modify the pictures to be repaired locally stored in the terminals respectively according to the total picture repairing operation step lists. In this step, the server only needs to merge the list of the map repairing operation steps, and does not need to repair the map at the server side, and the total map repairing is completed at each terminal side according to the data of the map repairing steps of all the users.
Optionally, in this embodiment, the total image modifying according to the image modifying steps of all the users is completed on one terminal side, and then the finally modified target image is added to the other terminal side.
In the embodiment, the cloud synchronization technology is integrated into the traditional image repairing technology, so that users can repair images cooperatively, and pain points of low efficiency caused by image repairing needed by multiple people in combined illumination are solved.
Application scenarios of the above embodiments are described below. In the application scene, on the basis of a cloud processing and intelligent rapid image synthesis algorithm, a multi-person cooperation image repairing function is added on the basis of a traditional mobile phone image repairing app, and the method specifically comprises the following steps:
1) the pool is shared to the friends through the social app.
2) The respective repair pictures of the friends are shown,
3) merging the repairing results: and the user uploads the picture to the server after the picture is repaired. At this time, the step data of the repair picture is uploaded. When the user clicks synchronization, the app synchronizes the data uploaded by other users from the server to the local, and then merges the data to the respective users according to the step data of the other users by using a face recognition technology.
In the above scheme, the app reproduces respective image repairing processes according to the step data, and finally shows that respective image repairing effects are synthesized on the same image.
In the scheme, the cloud synchronization technology is integrated into the traditional picture repairing app, users can collaboratively repair pictures together, the problem that multiple people need to repair pictures in a coordinated manner but the efficiency is low is solved, and interaction can be increased among the users through the function compared with the traditional single picture repairing app, so that better community development is achieved.
As shown in fig. 2, a method (server side) for collaborative map repair according to a second embodiment of the present invention is described, where the method includes:
as shown in fig. 2, the method 200 starts with step S210, where the server sends the picture to be modified to at least two terminals of the collaborative modification according to the collaborative modification request of the terminals;
then, step 220 is entered, the server judges whether the at least two terminals use the same version of effect kernel library, and a judgment result is generated; when the determination result is yes, step 230 is performed. Otherwise, step 260 is performed. In the step, whether the terminal uses an effect kernel library of the same version is judged, if so, the data of the image modification step of each terminal are collected, the modification is completed on each terminal side, and if not, the modification effect of each terminal on the same image is collected on the server side and is sent to each terminal.
Then, in step 230, the server receives a list of image modification operations on the image to be modified and corresponding face regions from the at least two terminals, respectively, where the list of image modification operations and the corresponding face regions are generated according to the terminal according to the user's modification operations on the face regions in the image to be modified;
then, step 240 is entered, and the server merges the list of the total image modifying operation steps into a list of the total image modifying operation steps according to the list of the image modifying operation steps and the corresponding face areas; the total picture trimming operation step list comprises picture trimming operation step lists sent by the at least two terminals and corresponding face areas;
then, step 250 is entered, and the server sends the total picture repairing operation list to the at least two terminals, so that the at least two terminals modify the picture to be repaired locally stored in the terminals according to the total picture repairing operation list.
Then, step 260 is carried out, and when the judgment result is negative, the server receives at least two processed pictures obtained after the picture modification processing is carried out on the picture to be modified locally stored in the terminal by the user from the at least two terminals;
finally, step 270 is entered, and the server merges the retouching effect of the at least two processed pictures into one target picture.
Wherein step 270 comprises: the server detects all faces in the at least two processed pictures to obtain a candidate face frame; the server traverses all the candidate face frames to identify, judges whether the candidate face frames are the same face or not, and acquires the regions of the same face in the at least two processed pictures; making a mask of a human face on the region, and performing opacity attenuation from inside to outside by using a smoothing algorithm; judging whether the human face in the area is subjected to deformation processing or not; when the deformation processing is judged to be performed, calculating a deviation image of the American type by using an inverse American type algorithm, and applying the effect of the deviation image to a target image with a mask.
Further, the step of merging, by the server, the retouching effect on the at least two processed pictures into one target picture may further include: judging whether each region of the face uses mapping processing or not; if the mapping processing is judged to be used, pixels at various positions in the picture are merged by using a fusion algorithm.
The application scenarios of the above embodiments are described above.
When the multi-end user uses the same app, firstly, whether the operation of the multi-end user is to use the same version of the effect kernel library is judged.
If the face IDs are the same, the operation steps of the user are directly recorded, an operation list is formed and uploaded to the service end, and the operation list is only spliced to the corresponding face IDs operated at the service end and returned to each service end.
If the images are different, the images received by the server are formed by compressing the images of the client after respective face processing, the size is small, the precision is not high, network transmission is facilitated, and user flow and server resources are saved.
And when the server receives the picture, restoring the compressed picture. The restoring technology uses an 'effect' enhanced model for various effect training of the American picture APP, the model is formed by training hundreds of thousands of pictures before and after the user finishes the picture, the picture compressed by the American picture APP can be restored most perfectly, and the actual test restoring degree is as high as 80%.
After the picture is restored, all the figures in the picture are detected to obtain a candidate face frame, all the face frames are traversed for recognition, and whether the face frames are the same face is judged.
After the regions of the same face on pictures sent by different terminals are obtained, a face mask is firstly made for the regions, and opacity attenuation is made from inside to outside by using smoothing algorithms such as horizontal and vertical Gauss and the like.
Then, whether the human face has deformation such as face thinning is judged. If the deformation is made, calculating the offset graph of the American shape by using an inverse American shape algorithm, and then applying the effect of the offset graph to the target picture with the mask, so that the target picture has the corresponding American shape.
Then, it is determined which different maps are used in each region of the face, and the pixels in each region of the picture are merged by a common merging algorithm (positive overlay, color filtering, linear overlay, etc.)
And finally, returning the target graph to each client, so that the whole cloud cooperation graph repairing is completed.
Correspondingly, the invention also provides a method for collaboratively repairing the picture at the terminal side.
As shown in fig. 3, a method (terminal side) for collaborative map pruning according to another embodiment of the present invention includes:
as shown in fig. 3, the method 300 begins at step S310. In step 310, the terminal acquires a picture to be repaired;
then, executing step 320, and recording the picture modification operation step list and the corresponding face area by the terminal according to the modification operation of the user on the face area on the picture to be modified;
then, step 330 is executed, and the terminal sends the list of the image modifying operation steps and the corresponding face area to a server;
then, step 340 is executed, and the terminal receives the general repair map operation step list from the server; the total picture trimming operation step list comprises picture trimming operation step lists sent by all terminals of all the collaborative trimming pictures and corresponding face areas;
finally, executing step 350, and performing image modification processing on the to-be-modified image locally stored by the terminal according to the total image modification operation step list by the terminal to generate a modified image; and displayed.
In the embodiment, the terminals finish the picture trimming at the respective terminal sides according to the summarized data of the trimming steps of the terminals, so that the load of the server is reduced.
As shown in fig. 4, an apparatus 400 for collaborative map modification according to an embodiment of the present invention resides in a server, and includes:
the sending unit 410 is used for sending the picture to be repaired to at least two terminals of the collaborative repair picture according to the collaborative repair picture request of the terminals;
a receiving unit 420, configured to receive, from at least two terminals, a list of image modification steps for the picture to be modified and a corresponding face region, where the list of image modification steps and the corresponding face region are recorded and generated according to a modification operation performed by the terminal on the face region in the picture to be modified by a user;
a merging unit 430, merging the map modifying operation step list and the corresponding face area into a total map modifying operation step list; the total picture trimming operation step list comprises picture trimming operation step lists sent by the at least two terminals and corresponding face areas;
the sending unit 440 is configured to send the total map modification operation step lists to the at least two terminals, so that the at least two terminals modify the to-be-modified picture locally stored in the terminal according to the total map modification operation step lists.
Optionally, the apparatus further includes:
the determining unit 450 determines whether the at least two terminals use the same version of the effect kernel library to generate a determination result; and when the judgment result is yes, starting the receiving unit.
As shown in fig. 5, an apparatus 500 for collaborative map modification according to an embodiment of the present invention resides in a terminal, and includes:
an obtaining unit 510, configured to obtain a picture to be repaired;
a recording unit 520, configured to record the list of the image modification operation steps and the corresponding face area according to a user modification operation on the face area on the image to be modified;
a sending unit 530, configured to send the list of the cropping operation steps and the corresponding face area to a server;
a receiving unit 540, configured to receive a summary map operation step list from a server; the total picture trimming operation step list comprises picture trimming operation step lists sent by terminals of all the collaborative picture trimming and corresponding face areas;
a processing unit 550, configured to perform, according to the total map modification operation step list, map modification processing on the to-be-modified picture stored locally, and generate a modified picture;
and a display unit 560 for displaying the modified picture.
As shown in fig. 6, a system for collaborative map modification according to an embodiment of the present invention includes:
the server 610 is used for sending the picture to be repaired to at least two terminals of the collaborative repair picture according to the collaborative repair picture request of the terminals; receiving a picture modification operation list of the picture to be modified and a corresponding face area from at least two terminals respectively, wherein the picture modification operation list and the corresponding face area are generated according to the terminal according to the modification operation of a user on the face area in the picture to be modified; merging the picture trimming operation steps into a total picture trimming operation step list according to the picture trimming operation step list and the corresponding face area; the total picture trimming operation step list comprises picture trimming operation step lists sent by the at least two terminals and corresponding face areas; and respectively sending the total picture repairing operation step lists to the at least two terminals, so that the at least two terminals respectively modify the pictures to be repaired, which are locally stored in the terminals, according to the total picture repairing operation step lists.
The terminal 620 is used for acquiring a picture to be repaired; recording the picture modification operation step list and the corresponding face area according to the modification operation of the user on the face area on the picture to be modified; sending the picture repairing operation step list and the corresponding face area to a server; receiving a general repair picture operation step list from a server; the total picture trimming operation step list comprises picture trimming operation step lists sent by terminals of all the collaborative picture trimming and corresponding face areas; according to the total picture modification operation step list, carrying out picture modification processing on the picture to be modified which is locally stored, and generating a modified picture; and displaying the modified picture.
An embodiment of the present invention further provides a server, including:
one or more processors;
a memory; and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing any of the methods of fig. 1 and 2.
An embodiment of the present invention further provides a terminal, including:
one or more processors;
a memory; and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing the method of FIG. 3.
FIG. 7 shows a schematic diagram of a server of one embodiment of the invention. As shown in fig. 7, in a basic configuration 702, a computing device 700 typically includes a system memory 706 and one or more processors 704. A memory bus 708 may be used for communicating between the processor 704 and the system memory 706.
Depending on the desired configuration, processor 704 may be any type of processing including, but not limited to, a microprocessor (μ P), a microcontroller (μ C), a digital information processor (DSP), or any combination thereof processor 604 may include one or more levels of cache such as a level one cache 710 and a level two cache 712, a processor core 714, and registers 716 example processor core 714 may include an arithmetic logic unit (A L U), a Floating Point Unit (FPU), a digital signal processing core (DSP core), or any combination thereof example memory controller 718 may be used with processor 704 or, in some implementations, memory controller 718 may be an internal part of processor 704.
Depending on the desired configuration, the system memory 706 may be any type of memory including, but not limited to: volatile memory (such as RAM), non-volatile memory (such as ROM, flash memory, etc.), or any combination thereof. The system memory 706 may include an operating system 720, one or more applications 722, and program data 724. The application 722 is actually a plurality of program instructions that direct the processor 704 to perform corresponding operations. In some embodiments, the application 722 may be arranged to cause the processor 704 to operate with program data 724 on an operating system.
The computing device 700 may also include an interface bus 740 that facilitates communication from various interface devices (e.g., output devices 742, peripheral interfaces 744, and communication devices 746) to the basic configuration 702 via the bus/interface controller 730. The example output devices 742 include a graphics processing unit 748 and an audio processing unit 750. They may be configured to facilitate communication with various external devices, such as a display or speakers, via one or more a/V ports 752. Example peripheral interfaces 744 can include a serial interface controller 754 and a parallel interface controller 756, which can be configured to facilitate communications with external devices such as input devices (e.g., keyboard, mouse, pen, voice input device, touch input device) or other peripherals (e.g., printer, scanner, etc.) via one or more I/O ports 758. The example communication device 746 may include a network controller 760 that may be arranged to facilitate communications with one or more other servers 762 over a network communication link via one or more communication ports 764.
A network communication link may be one example of a communication medium. Communication media may typically be embodied by computer readable instructions, data structures, program modules, and may include any information delivery media, such as carrier waves or other transport mechanisms, in a modulated data signal. A "modulated data signal" may be a signal that has one or more of its data set or its changes made in such a manner as to encode information in the signal. By way of non-limiting example, communication media may include wired media such as a wired network or private-wired network, and various wireless media such as acoustic, Radio Frequency (RF), microwave, Infrared (IR), or other wireless media. The term computer readable media as used herein may include both storage media and communication media.
Computing device 700 may be implemented as a server of the present invention in which case application 722 includes apparatus 400 for collaborative profiling, apparatus 400 including program instructions that may direct processor 704 to perform a server-side collaborative profiling method of the present invention.
Computing device 700 may also be implemented as a terminal of the present invention where application 722 includes apparatus 500 for collaborative cropping, apparatus 500 including program instructions that may direct processor 704 to perform a method for collaborative cropping at a terminal side of the present invention.
The computing device 700 shown in fig. 7 may be implemented as a server or a terminal of the present invention. It will be understood by those skilled in the art that the computing device 700 shown in fig. 7 is only one example, and when the computing device 700 is implemented as a server or a terminal, some components may be added to or deleted from the structure shown in fig. 7, and the present invention is not limited to the specific configuration of the server or the terminal.
A11: a terminal, comprising:
one or more processors;
a memory; and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for performing the method of claim 6.
A12: a computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a server, cause the server to perform any of the methods of claims 1-6.
A13: a system for collaborative cropping, comprising a server according to claim 10 and at least two terminals according to claim 11.
Embodiments of the present invention also provide a computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a server, cause the server to perform any of the methods described above.
In the description provided herein, numerous specific details are set forth. It is understood, however, that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.
Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be interpreted as reflecting an intention that: that the invention as claimed requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.
Those skilled in the art will appreciate that the modules or units or components of the devices in the examples disclosed herein may be arranged in a device as described in this embodiment or alternatively may be located in one or more devices different from the devices in this example. The modules in the foregoing examples may be combined into one module or may be further divided into multiple sub-modules.
Those skilled in the art will appreciate that the modules in the device in an embodiment may be adaptively changed and disposed in one or more devices different from the embodiment. The modules or units or components of the embodiments may be combined into one module or unit or component, and furthermore they may be divided into a plurality of sub-modules or sub-units or sub-components. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where at least some of such features and/or processes or elements are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.
Furthermore, those skilled in the art will appreciate that while some embodiments described herein include some features included in other embodiments, rather than other features, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments. For example, in the following claims, any of the claimed embodiments may be used in any combination.
The various techniques described herein may be implemented in connection with hardware or software or, alternatively, with a combination of both. Thus, the methods and apparatus of the present invention, or certain aspects or portions thereof, may take the form of program code (i.e., instructions) embodied in tangible media, such as floppy diskettes, CD-ROMs, hard drives, or any other machine-readable storage medium, wherein, when the program is loaded into and executed by a machine, such as a computer, the machine becomes an apparatus for practicing the invention.
In the case of program code execution on programmable computers, the mobile terminal generally includes a processor, a storage medium readable by the processor (including volatile and non-volatile memory and/or storage elements), at least one input device, and at least one output device. Wherein the memory is configured to store program code; the processor is configured to execute the method for optimizing internet speed according to the instructions in the program codes stored in the memory.
Furthermore, some of the described embodiments are described herein as a method or combination of method elements that can be performed by a processor of a computer system or by other means of performing the described functions. A processor having the necessary instructions for carrying out the method or method elements thus forms a means for carrying out the method or method elements. Further, the elements of the apparatus embodiments described herein are examples of the following apparatus: the apparatus is used to implement the functions performed by the elements for the purpose of carrying out the invention.
As used herein, unless otherwise specified the use of the ordinal adjectives "first", "second", "third", etc., to describe a common object, merely indicate that different instances of like objects are being referred to, and are not intended to imply that the objects so described must be in a given sequence, either temporally, spatially, in ranking, or in any other manner.
While the invention has been described with respect to a limited number of embodiments, those skilled in the art, having benefit of this description, will appreciate that other embodiments can be devised which do not depart from the scope of the invention as described herein. Furthermore, it should be noted that the language used in the specification has been principally selected for readability and instructional purposes, and may not have been selected to delineate or circumscribe the inventive subject matter. Accordingly, many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the appended claims. The present invention has been disclosed in an illustrative rather than a restrictive sense, and the scope of the present invention is defined by the appended claims.
Claims (13)
1. A method of collaborative pruning, performed in a server, the method comprising:
sending the picture to be repaired to at least two terminals of the collaborative repair picture according to the collaborative repair picture request of the terminals;
receiving a picture modification operation list of the picture to be modified and a corresponding face area from the at least two terminals respectively, wherein the picture modification operation list and the corresponding face area are generated according to the terminal according to the modification operation of a user on the face area in the picture to be modified;
merging the picture trimming operation steps into a total picture trimming operation step list according to the picture trimming operation step list and the corresponding face area; the total picture trimming operation step list comprises picture trimming operation step lists sent by the at least two terminals and corresponding face areas;
and respectively sending the total picture repairing operation step lists to the at least two terminals, so that the at least two terminals respectively modify the pictures to be repaired, which are locally stored in the terminals, according to the total picture repairing operation step lists.
2. The method according to claim 1, wherein before the step of receiving the list of the cropping operation steps of the picture to be cropped and the corresponding face region from the at least two terminals, the method further comprises:
judging whether the at least two terminals use the effect kernel library of the same version or not, and generating a judgment result;
and if so, executing a step of respectively receiving a picture modification operation list of the picture to be modified and a corresponding face area from at least two terminals.
3. The method of claim 2, after the step of determining whether the at least two terminals use the same version of the effect kernel library, the method further comprising:
when the judgment result is negative, receiving at least two processed pictures which are obtained by the user through picture modification processing on the picture to be modified stored locally in the terminal from the at least two terminals;
and merging the retouching effects of the at least two processed pictures into one target picture.
4. The method of claim 3, wherein the step of merging the retouching effects of the at least two processed pictures into one target picture comprises:
detecting all faces in the at least two processed pictures to obtain a candidate face frame;
traversing all the candidate face frames for identification, and judging whether the candidate face frames are the same face so as to acquire the regions of the same face in the at least two processed pictures;
making a mask of a human face on the region, and performing opacity attenuation from inside to outside by using a smoothing algorithm;
judging whether the human face in the area is subjected to deformation processing or not;
when the deformation processing is judged to be performed, calculating a deviation image of the American type by using an inverse American type algorithm, and applying the effect of the deviation image to a target image with a mask.
5. The method of claim 4, wherein the step of merging the retouching effects of the at least two processed pictures into one target picture further comprises:
judging whether each region of the face uses mapping processing or not;
if the mapping processing is judged to be used, pixels at various positions in the picture are merged by using a fusion algorithm.
6. A method for collaborative repairing of a picture, which is executed in a terminal, the method comprising:
acquiring a picture to be repaired;
recording the picture modification operation step list and the corresponding face area according to the modification operation of the user on the face area on the picture to be modified;
sending the picture repairing operation step list and the corresponding face area to a server;
receiving a general repair picture operation step list from a server; the total picture trimming operation step list comprises picture trimming operation step lists sent by all terminals of all the collaborative trimming pictures and corresponding face areas;
the terminal carries out image modification processing on the image to be modified locally stored by the terminal according to the total image modification operation step list to generate a modified image; and displayed.
7. An apparatus for collaborative cropping, residing in a server, comprising:
the sending unit is used for sending the picture to be repaired to at least two terminals of the collaborative repair picture according to the collaborative repair picture request of the terminals;
the receiving unit is used for respectively receiving a picture modification operation step list and a corresponding face area of the picture to be modified from at least two terminals, wherein the picture modification operation step list and the corresponding face area are recorded and generated according to the modification operation of the terminal on the face area in the picture to be modified by a user;
the merging unit merges the operation steps into a total image trimming operation step list according to the image trimming operation step list and the corresponding face area; the total picture trimming operation step list comprises picture trimming operation step lists sent by the at least two terminals and corresponding face areas;
and the sending unit is used for sending the total picture repairing operation step lists to the at least two terminals respectively, so that the at least two terminals modify the pictures to be repaired locally stored in the terminals respectively according to the total picture repairing operation step lists.
8. The apparatus of claim 7, further comprising:
the judging unit is used for judging whether the at least two terminals use the effect kernel library of the same version or not and generating a judging result; and when the judgment result is yes, starting the receiving unit.
9. An apparatus for collaborative cropping, residing in a terminal, comprising:
the acquisition unit is used for acquiring a picture to be repaired;
the recording unit is used for recording the picture modification operation step list and the corresponding face area according to the modification operation of the user on the face area on the picture to be modified;
the sending unit is used for sending the picture repairing operation step list and the corresponding face area to a server;
the receiving unit is used for receiving the general repair picture operation step list from the server; the total picture trimming operation step list comprises picture trimming operation step lists sent by terminals of all the collaborative picture trimming and corresponding face areas;
the processing unit is used for carrying out image modification processing on the image to be modified which is locally stored according to the total image modification operation step list to generate a modified image;
and the display unit is used for displaying the modified picture.
10. A server, comprising:
one or more processors;
a memory; and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for performing any of the methods of claims 1-5.
11. A terminal, comprising:
one or more processors;
a memory; and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for performing the method of claim 6.
12. A computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a server, cause the server to perform any of the methods of claims 1-6.
13. A system for collaborative cropping, comprising a server according to claim 10 and at least two terminals according to claim 11.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811482595.3A CN109712082B (en) | 2018-12-05 | 2018-12-05 | Method and device for collaboratively repairing picture |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811482595.3A CN109712082B (en) | 2018-12-05 | 2018-12-05 | Method and device for collaboratively repairing picture |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109712082A CN109712082A (en) | 2019-05-03 |
| CN109712082B true CN109712082B (en) | 2020-08-07 |
Family
ID=66254644
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811482595.3A Active CN109712082B (en) | 2018-12-05 | 2018-12-05 | Method and device for collaboratively repairing picture |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109712082B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110377574B (en) * | 2019-07-15 | 2023-08-25 | 腾讯科技（深圳）有限公司 | Picture collaborative processing method and device, storage medium and electronic device |
| CN111292224B (en) * | 2020-02-18 | 2024-01-16 | 维沃移动通信有限公司 | Image processing method and electronic equipment |
| CN112036310A (en) * | 2020-08-31 | 2020-12-04 | 北京字节跳动网络技术有限公司 | Picture processing method, device, equipment and storage medium |
| CN113992789A (en) * | 2021-10-29 | 2022-01-28 | 维沃移动通信有限公司 | Image processing method and device |
| CN114025215A (en) * | 2021-11-04 | 2022-02-08 | 深圳传音控股股份有限公司 | File processing method, mobile terminal and storage medium |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20050047483A (en) * | 2003-11-17 | 2005-05-20 | 가부시키가이샤 아틀루스 | Image processing apparatus |
| CN102982401A (en) * | 2011-10-05 | 2013-03-20 | 微软公司 | Multi-user and multi-device cooperation |
| CN103108020A (en) * | 2011-11-09 | 2013-05-15 | 日本电气株式会社 | Service collaboration device, service collaboration method, and computer-readable recording medium |
| CN105303523A (en) * | 2014-12-01 | 2016-02-03 | 维沃移动通信有限公司 | Image processing method and mobile terminal |
| CN105531694A (en) * | 2013-06-15 | 2016-04-27 | 微软技术许可有限责任公司 | Showing presence of multiple authors in a spreadsheet |
| CN105631417A (en) * | 2015-12-24 | 2016-06-01 | 武汉鸿瑞达信息技术有限公司 | Video beautification system and method applied to Internet video live broadcast |
| CN105787878A (en) * | 2016-02-25 | 2016-07-20 | 杭州格像科技有限公司 | Beauty processing method and device |
| CN107392110A (en) * | 2017-06-27 | 2017-11-24 | 五邑大学 | Beautifying faces system based on internet |
| CN107995415A (en) * | 2017-11-09 | 2018-05-04 | 深圳市金立通信设备有限公司 | A kind of image processing method, terminal and computer-readable medium |
-
2018
- 2018-12-05 CN CN201811482595.3A patent/CN109712082B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20050047483A (en) * | 2003-11-17 | 2005-05-20 | 가부시키가이샤 아틀루스 | Image processing apparatus |
| CN102982401A (en) * | 2011-10-05 | 2013-03-20 | 微软公司 | Multi-user and multi-device cooperation |
| CN103108020A (en) * | 2011-11-09 | 2013-05-15 | 日本电气株式会社 | Service collaboration device, service collaboration method, and computer-readable recording medium |
| CN105531694A (en) * | 2013-06-15 | 2016-04-27 | 微软技术许可有限责任公司 | Showing presence of multiple authors in a spreadsheet |
| CN105303523A (en) * | 2014-12-01 | 2016-02-03 | 维沃移动通信有限公司 | Image processing method and mobile terminal |
| CN105631417A (en) * | 2015-12-24 | 2016-06-01 | 武汉鸿瑞达信息技术有限公司 | Video beautification system and method applied to Internet video live broadcast |
| CN105787878A (en) * | 2016-02-25 | 2016-07-20 | 杭州格像科技有限公司 | Beauty processing method and device |
| CN107392110A (en) * | 2017-06-27 | 2017-11-24 | 五邑大学 | Beautifying faces system based on internet |
| CN107995415A (en) * | 2017-11-09 | 2018-05-04 | 深圳市金立通信设备有限公司 | A kind of image processing method, terminal and computer-readable medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109712082A (en) | 2019-05-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109712082B (en) | Method and device for collaboratively repairing picture | |
| Jam et al. | A comprehensive review of past and present image inpainting methods | |
| CN108921782B (en) | Image processing method, device and storage medium | |
| CN111582085B (en) | Document shooting image recognition method and device | |
| CN107277615B (en) | Live broadcast stylization processing method and device, computing device and storage medium | |
| CN108876804B (en) | Matting model training and image matting method, device and system and storage medium | |
| JP2016523397A (en) | Method and system for information recognition | |
| US20100331047A1 (en) | Methods and apparatuses for facilitating generation and editing of multiframe images | |
| US20100250588A1 (en) | Image searching system and image searching method | |
| CN110493512B (en) | Photographic composition method, photographic composition device, photographic equipment, electronic device and storage medium | |
| CN109886223B (en) | Face recognition method, bottom library input method and device and electronic equipment | |
| CN111008935A (en) | Face image enhancement method, device, system and storage medium | |
| WO2020125062A1 (en) | Image fusion method and related device | |
| CN111027438A (en) | Human body posture migration method, mobile terminal and computer storage medium | |
| CN112712487A (en) | Scene video fusion method and system, electronic equipment and storage medium | |
| CN111353965B (en) | Image restoration method, device, terminal and storage medium | |
| CN107734207B (en) | Video object transformation processing method and device and computing equipment | |
| WO2022089185A1 (en) | Image processing method and image processing device | |
| CN113688839B (en) | Video processing method and device, electronic equipment and computer readable storage medium | |
| JP6669390B2 (en) | Information processing apparatus, information processing method, and program | |
| CN110197459B (en) | Image stylization generation method and device and electronic equipment | |
| TW201732733A (en) | Image processing method and device | |
| CN111062924A (en) | Image processing method, device, terminal and storage medium | |
| CN110782390A (en) | Image correction processing method and device and electronic equipment | |
| CN114973293A (en) | Similarity judgment method, key frame extraction method, device, medium and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |