CN108986017B

CN108986017B - Image special effect processing method, device and computer readable storage medium

Info

Publication number: CN108986017B
Application number: CN201810697083.2A
Authority: CN
Inventors: 游东; 冯宇飞; 刘昂
Original assignee: Beijing Microlive Vision Technology Co Ltd
Current assignee: Beijing Microlive Vision Technology Co Ltd
Priority date: 2018-06-29
Filing date: 2018-06-29
Publication date: 2023-06-20
Anticipated expiration: 2038-06-29
Also published as: CN108986017A

Abstract

The present disclosure discloses an image effect processing method, an image effect processing device, an image effect processing hardware device, a computer-readable storage medium, and an image effect processing terminal. The image special effect processing method comprises the steps of obtaining a special effect data packet; determining whether the special effect data packet contains a special effect of the filter to be loaded; when the special effect data packet contains the special effect of the filter to be loaded, special effect processing is carried out on the image according to the special effect data packet and the special effect of the loaded filter on the image. According to the embodiment of the disclosure, when the filter special effect to be loaded exists in the acquired special effect data packet, special effect processing can be performed on the image according to the acquired special effect data packet and the loaded filter special effect, so that the special effect processing can be performed on the image by considering the loaded filter special effect on the image under the condition that the filter special effect is included in the special effect data packet to be loaded, the special effect of the image is enabled to better accord with expectations, and the technical problem of how to improve the user experience effect is solved.

Description

Image special effect processing method, device and computer readable storage medium

Technical Field

The present disclosure relates to the field of image technology, and in particular, to an image special effect processing method, an image special effect processing device, and a computer readable storage medium.

Background

With the development of portable device technologies such as mobile phones and tablet computers, portable devices have more and more functions, for example: surfing the internet, photographing, navigating, etc. In particular, the photographing function becomes an integral part of the portable device. To accommodate the increasing personalized demands of users on photos, adding special effects to photos has become a popular way of making pictures, for example, users add cat beards, red halos, etc. to faces after photographing. In order to facilitate the user to add special effects to the shot photos, the shooting function on the terminal device can have some image processing functions, such as a filter for skin care, and the user can download special effect data packages from the cloud and load the special effect data packages onto the shot photos.

Disclosure of Invention

The technical problem solved by the present disclosure is to provide an image special effect processing method to at least partially solve the technical problem how to improve the user experience effect. Furthermore, an image special effect processing device, an image special effect processing hardware device and a computer readable storage medium are provided.

In order to achieve the above object, according to one aspect of the present disclosure, there is provided the following technical solutions:

an image special effect processing method, comprising:

determining whether the special effect data packet contains a special effect of the filter to be loaded;

when the special effect data packet contains the special effect of the filter to be loaded, special effect processing is carried out on the image according to the special effect data packet and the special effect of the loaded filter on the image.

Further, obtaining the special effect data packet includes:

and downloading the corresponding special effect data packet from the cloud according to the special effect selected by the user.

Further, determining whether the special effect data packet includes a special effect of the filter to be loaded includes:

analyzing the special effect data packet;

and determining whether the parsed special effect data packet contains a filter field corresponding to the special effect of the filter to be loaded.

Further, when the special effect data packet includes a special effect of the filter to be loaded, special effect processing is performed on the image according to the special effect data packet and the special effect of the loaded filter on the image, including:

and removing the loaded filter special effect when the to-be-loaded filter special effect conflicts with the loaded filter special effect.

Further, when there is a conflict between the filter effect to be loaded and the loaded filter effect, removing the loaded filter effect includes:

determining the type of the special effect of the filter to be loaded;

and removing the loaded filter special effect when the type of the filter special effect to be loaded conflicts with the type of the loaded filter special effect.

Further, when the type of the filter effect to be loaded conflicts with the type of the loaded filter effect, removing the loaded filter effect includes:

and removing the loaded filter special effect when the type of the filter special effect to be loaded is different from the type of the loaded filter special effect.

matching the type of the special effect of the loaded filter with a preset type set; the preset type set comprises at least one preset type which conflicts with the type of the special effect of the filter to be loaded;

and removing the special effect of the loaded filter when the matching is successful.

Matching the type of the special effect of the loaded filter with a preset type set; the preset type set comprises at least one preset type which does not conflict with the type of the special effect of the filter to be loaded;

and removing the loaded filter special effect when the matching is unsuccessful.

Further, the removing the loaded filter effect includes:

and updating a rendering chain table to remove the items corresponding to the recorded filter special effects from the rendering chain table.

Further, when the special effect data packet includes a special effect of the filter to be loaded, special effect processing is performed on the image according to the special effect data packet and the special effect of the loaded filter on the image, and the method further includes:

and carrying out special effect processing on the image according to the rendering chain table.

and when the special effect of the filter to be loaded and the special effect of the filter to be loaded do not conflict, superposing the special effect of the filter to be loaded and the special effect of the filter to be loaded.

Further, the loaded filter special effect is a locally stored filter special effect; the special effect data packet is a special effect data packet downloaded by a cloud.

In order to achieve the above object, according to another aspect of the present disclosure, there is further provided the following technical solutions:

an image special effect processing apparatus comprising:

the acquisition module is used for acquiring the special effect data packet;

the determining module is used for determining whether the special effect data packet contains a special effect of the filter to be loaded or not;

and the processing module is used for carrying out special effect processing on the image according to the special effect data packet and the special effect of the loaded filter on the image when the special effect data packet contains the special effect of the filter to be loaded.

Further, the acquisition module includes:

and the downloading sub-module is used for downloading the corresponding special effect data packet from the cloud according to the special effect selected by the user.

Further, the determining module includes:

the analysis submodule is used for analyzing the special effect data packet;

the first determining submodule is used for determining whether the parsed special effect data packet contains a filter field corresponding to the special effect of the filter to be loaded.

Further, the processing module includes:

the first removing submodule is used for removing the loaded filter special effects when the to-be-loaded filter special effects conflict with the loaded filter special effects.

Further, the first removal sub-module includes:

the second determining submodule is used for determining the type of the special effect of the filter to be loaded;

and the second removing submodule is used for removing the loaded filter special effects when the types of the filter special effects to be loaded conflict with the types of the loaded filter special effects.

Further, the second removing sub-module includes:

and the third removing submodule is used for removing the special effects of the loaded filter when the type of the special effects of the filter to be loaded is different from the type of the special effects of the loaded filter.

Further, the second removing sub-module includes:

the first matching sub-module is used for matching the type of the special effect of the loaded filter with a preset type set; the preset type set comprises at least one preset type which conflicts with the type of the special effect of the filter to be loaded;

and the fourth removing submodule is used for removing the special effects of the loaded filter when the matching is successful.

Further, the second removing sub-module includes:

the second matching sub-module is used for matching the type of the special effect of the loaded filter with a preset type set; the preset type set comprises at least one preset type which does not conflict with the type of the special effect of the filter to be loaded;

And a fifth removing sub-module, configured to remove the loaded filter special effect when the matching is unsuccessful.

Any one of the first, second, third, fourth, and fifth removal sub-modules includes:

and the updating sub-module is used for updating a rendering chain table so as to remove the items corresponding to the recorded filter special effects from the rendering chain table.

Further, the processing module includes:

and the processing sub-module is used for carrying out special effect processing on the image according to the rendering chain table.

Further, the processing module includes:

and the superposition sub-module is used for superposing the special effects of the loaded filter and the special effects of the filter to be loaded when the special effects of the filter to be loaded and the special effects of the filter to be loaded do not conflict.

In order to achieve the above object, according to still another aspect of the present disclosure, there is further provided the following technical solutions:

an image special effects processing hardware apparatus, comprising:

a memory for storing non-transitory computer readable instructions; and

And the processor is used for running the computer readable instructions so that the steps in the technical scheme of any image special effect processing method are realized when the processor executes the instructions.

a computer readable storage medium storing non-transitory computer readable instructions which, when executed by a computer, cause the computer to perform the steps recited in any of the image special effects processing method aspects described above.

an image special effect processing terminal comprises any one of the image special effect processing devices.

The embodiment of the disclosure provides an image special effect processing method, an image special effect processing device, an image special effect processing hardware device, a computer readable storage medium and an image special effect processing terminal. The image special effect processing method comprises the steps of obtaining a special effect data packet; determining whether the special effect data packet contains a special effect of the filter to be loaded; when the special effect data packet contains the special effect of the filter to be loaded, special effect processing is carried out on the image according to the special effect data packet and the special effect of the loaded filter on the image. By adopting the technical scheme, the embodiment of the disclosure can perform special effect processing on the image according to the acquired special effect data packet and the loaded special effect of the filter when the special effect of the filter to be loaded exists in the acquired special effect data packet, so that the special effect processing on the image can be further performed by considering the loaded special effect of the filter on the image under the condition that the special effect of the filter is included in the special effect data packet to be loaded, the special effect of the image better accords with expectations, and the user experience effect is improved.

The foregoing description is only an overview of the disclosed technology, and may be implemented in accordance with the disclosure of the present disclosure, so that the above-mentioned and other objects, features and advantages of the present disclosure can be more clearly understood, and the following detailed description of the preferred embodiments is given with reference to the accompanying drawings.

Drawings

FIG. 1 is a flow diagram of an image special effects processing method according to one embodiment of the present disclosure;

FIG. 2 is a schematic step flow chart of step S2 in the embodiment shown in FIG. 1;

FIG. 3 is a flowchart illustrating steps in special effects processing according to an embodiment of the present disclosure;

fig. 4 is a schematic structural view of an image special effect processing apparatus according to an embodiment of the present disclosure;

FIG. 5 is a schematic diagram of an image special effects processing hardware apparatus according to one embodiment of the present disclosure;

FIG. 6 is a schematic structural diagram of a computer-readable storage medium according to one embodiment of the present disclosure;

fig. 7 is a schematic structural view of an image special effect processing terminal according to an embodiment of the present disclosure.

Detailed Description

Other advantages and effects of the present disclosure will become readily apparent to those skilled in the art from the following disclosure, which describes embodiments of the present disclosure by way of specific examples. It will be apparent that the described embodiments are merely some, but not all embodiments of the present disclosure. The disclosure may be embodied or practiced in other different specific embodiments, and details within the subject specification may be modified or changed from various points of view and applications without departing from the spirit of the disclosure. It should be noted that the following embodiments and features in the embodiments may be combined with each other without conflict. All other embodiments, which can be made by one of ordinary skill in the art without inventive effort, based on the embodiments in this disclosure are intended to be within the scope of this disclosure.

It is noted that various aspects of the embodiments are described below within the scope of the following claims. It should be apparent that the aspects described herein may be embodied in a wide variety of forms and that any specific structure and/or function described herein is merely illustrative. Based on the present disclosure, one skilled in the art will appreciate that one aspect described herein may be implemented independently of any other aspect, and that two or more of these aspects may be combined in various ways. For example, an apparatus may be implemented and/or a method practiced using any number of the aspects set forth herein. In addition, such apparatus may be implemented and/or such methods practiced using other structure and/or functionality in addition to one or more of the aspects set forth herein.

It should also be noted that the illustrations provided in the following embodiments merely illustrate the basic concepts of the disclosure by way of illustration, and only the components related to the disclosure are shown in the drawings and are not drawn according to the number, shape and size of the components in actual implementation, and the form, number and proportion of the components in actual implementation may be arbitrarily changed, and the layout of the components may be more complicated.

In addition, in the following description, specific details are provided in order to provide a thorough understanding of the examples. However, it will be understood by those skilled in the art that the aspects may be practiced without these specific details.

In order to solve the technical problem of how to improve the user experience effect, the embodiment of the disclosure provides an image special effect processing method. As shown in fig. 1, the image special effect processing method mainly includes the following steps S1 to S3. Wherein:

step S1: and obtaining the special effect data packet.

The special effect data packet may include various elements for performing special effect processing on the image, such as a filter, a sticker, etc., where the filter is used to implement various special effects on the image, for example: black and white, nostalgic, clouds, distortion, woodcut, lighting effects, hue separation, and the like. The decal may be a small-sized image with a pattern or image that may be applied to the image to be processed.

Step S2: and determining whether the special effect data packet contains the special effect of the filter to be loaded.

Wherein, whether the special effect data packet contains the special effect of the filter to be loaded can be checked by analyzing the special effect data packet. Different elements in the special effect data packet can be described by different fields, so that whether the special effect data packet comprises the filter can be determined by matching the fields corresponding to the filter.

Step S3: when the special effect data packet contains the special effect of the filter to be loaded, special effect processing is carried out on the image according to the special effect data packet and the special effect of the loaded filter on the image.

The filter to be loaded and the filter to be loaded are both filters, and may be of the same type, even the same filter, or different types of filters. The loaded filter is a filter that has been loaded onto the image, i.e. the image has been subjected to special effects processing by the loaded filter, and the filter to be loaded is a filter to be loaded onto the image.

For ease of understanding, the procedure of image special effect processing is described in detail below with specific examples.

In this embodiment, the image special effect processing method can be applied to intelligent terminals such as smart phones, smart cameras, palm computers, tablet computers, electronic books, portable computers, computers and the like with photographing and image processing functions and touch screens, and achieves special effect processing of images. For example, after taking a photograph, the user may choose to load one or more special effects on the currently taken photograph according to an interface provided by the image special effect processing system on the mobile phone. The image special effect processing system can acquire special effect data packets corresponding to one or more special effects to be loaded according to the selection of a user.

In this embodiment, the image special effect processing system may preset a special effect database for storing various special effect data packets. The effects database may include a local effects database and/or a cloud effects database. If the selected special effect data packet is stored in the cloud special effect database, the cloud special effect data packet can be downloaded to the local, and if the selected special effect data packet is in the local special effect database, the special effect data packet is directly obtained from the local special effect database.

In this embodiment, after the special effect data packet is obtained, the code corresponding to the special effect data packet may be parsed, and whether the code includes a filter field may be checked, if so, the filter field to be loaded may be considered to be included, and if not, the filter to be loaded may not be included. The special effect data packet may include only the special effect of the filter or only other special effects such as a sticker, or may be a data packet formed by combining the special effect of the filter with other special effects such as a sticker. Of course, in other embodiments, it may be determined whether the filter effect is included in other manners, for example, in order to be suitable for the image effect processing method of this embodiment, an identifier for identifying whether the filter effect is included may be separately added to each effect packet, and in this case, whether the filter effect to be loaded is included may be determined directly by the identifier.

In this embodiment, when it is determined that the special effect data packet includes the special effect of the filter to be loaded, special effect processing may be performed on the image according to the special effect of the filter already loaded on the image and the special effect of the filter to be loaded in the special effect data packet. Of course, it can be understood that, in the case where the special effect data packet does not include the special effect of the filter to be loaded, special effect processing can be performed according to the normal processing flow, which is not limited in the disclosure.

The filter special effects already loaded on the image may be special effects selected by the user before that, or filter special effects automatically loaded according to the user's settings. For example, when a user takes a photograph or live broadcast, the user defaults to a skin care effect, and then the acquired image or video frame is loaded with a skin care related filter special effect. Of course, it will be understood that, in the case where the filter special effect is not loaded on the image before that, special effect processing may also be performed according to the normal processing flow, which is not limited in the present disclosure.

In this embodiment, when the filter special effect is already loaded on the image, special effect processing can be performed on the image by comprehensively considering the filter special effect to be loaded and the loaded filter special effect. For example, in some cases, the special effect processing may be performed by superimposing the special effect of the filter to be loaded on the special effect of the filter to be loaded, in other cases, the special effect processing may be performed by removing the special effect of the filter to be loaded and then applying the special effect of the filter to be loaded, or in some cases, the special effect of the filter to be loaded may be retained and the special effect processing may be performed by discarding the special effect of the filter to be loaded. Of course, it can be understood that, in the case that the special effect data packet further includes other special effect elements, the other special effect elements are loaded onto the image according to the normal processing flow of the other special effect elements.

According to the embodiment of the disclosure, after the special effect data packet is obtained, whether the special effect data packet has the special effect of the filter or not is analyzed, and under the condition that the special effect of the filter is obtained, the special effect of the loaded filter on the image and the special effect of the filter to be loaded in the special effect data packet are comprehensively considered to process the image, so that the situation that the processed image of the special effect is inconsistent with the expected image due to the conflict between the special effect of the loaded filter and the special effect of the filter to be loaded is avoided, and the experience effect of a user is improved.

In an alternative embodiment, step S1 may include:

In this alternative embodiment, in order to save resources, the image special effect processing system may store the special effect data packet in the cloud end in the initial situation, the user may select the special effect that the user wants to add through the page provided by the image special effect processing system, and the image special effect processing system may download the corresponding special effect data packet from the cloud end according to the selection of the user, and store the corresponding special effect data packet in the local special effect database. If the special effect data packet corresponding to the special effect selected by the user exists in the local special effect database, the special effect data packet can be directly obtained from the local special effect database. Because the image special effect processing system can provide various special effect data packets, the space occupied by each special effect data packet can be larger, and therefore the special effect data packets can be stored in the cloud as much as possible, so that the space on the intelligent terminal is saved. The image special effect processing system can only provide the special effect image corresponding to the special effect data packet for the user on the display interface, but the corresponding special effect data packet can be downloaded to the local when the user selects to use.

In an alternative embodiment, as shown in fig. 2, the step of determining whether the special effect data packet includes the special effect of the filter to be loaded in step S2 may include:

step S21: analyzing the special effect data packet;

step S22: and determining whether the parsed special effect data packet contains a filter field corresponding to the special effect of the filter to be loaded.

In this alternative embodiment, from the application level, the special effect data packet may include other special effect elements such as a filter special effect and a sticker, and from the specific data layer, the special effect data packet may include a code portion, a picture, etc. for implementing the special effect corresponding to the special effect data packet, where the code portion may include fields of the filter special effect and/or other special effect elements and corresponding parameters, etc., before the special effect processing is performed on the image, the special effect data packet needs to be parsed by the image special effect processing system, a special effect processing manner for the image is determined according to the fields corresponding to the special effect elements in the code portion in the special effect data packet, and processing parameters when the special effect processing manner is performed on the image are determined according to values following the fields. For example, if the code portion of the special effects packet includes a field corresponding to a certain type of filter special effect, it may be determined that the type of filter processing is required for the image, and based on the corresponding value following the filter special effect field, processing parameters, such as transparency, brightness, contrast, etc., may be determined when the filter processing is performed for the image.

In an optional embodiment, step S3, that is, when the special effect data packet includes a special effect of the filter to be loaded, the step of performing special effect processing on the image according to the special effect data packet and the special effect of the loaded filter on the image may include:

In this alternative embodiment, if the special effect data packet includes the special effect of the filter to be loaded, and if the special effect of the filter has already been loaded in the image, it may also be determined whether there is a conflict between the special effect of the filter to be loaded and the special effect of the filter to be loaded, and if there is a conflict, the special effect of the filter to be loaded is removed, that is, the influence of the special effect of the filter to be loaded on the image is recovered. For example, the loaded filter effect is a black-and-white filter effect on an image, and the filter effect to be loaded is an effect of adding a halation to the image, and it is obvious that there is a conflict between the two effects, because the image generated under the effect of the black-and-white filter is black-and-white, and the halation cannot be represented on the black-and-white image, so that the black-and-white filter effect can be removed to restore the color of the image, and the halation effect can be added to the image.

According to the embodiment of the disclosure, whether the special effect of the filter to be loaded and the special effect filter to be loaded conflict with each other or not is judged, so that the image is further processed, namely, when the special effect of the filter to be loaded and the special effect of the filter to be loaded conflict with each other, the loaded filter image is removed, and the problems that in the prior art, no matter whether the special effect of the filter to be loaded conflicts or not, the special effect of the filter to be loaded is directly overlapped on the special effect of the filter to be loaded, and in some cases, the effect overlapping effect of the image is poor, and the user experience effect is affected are solved.

In an alternative embodiment, as shown in fig. 3, when the filter effect to be loaded and the loaded filter effect conflict, the step of removing the loaded filter effect may include:

step S31: determining the type of the special effect of the filter to be loaded;

step S32: and removing the loaded filter special effect when the type of the filter special effect to be loaded conflicts with the type of the loaded filter special effect.

In this alternative embodiment, whether a conflict is generated between the filter effect to be loaded and the loaded filter effect may be determined according to the type of the filter effect. In general, there is no conflict between filter effects of the same type, but there is less possibility of conflict between filter effects of similar types, and there is greater possibility of conflict between filter effects of different types. Therefore, the conflict possibility sizes of the filter special effects of different types can be predetermined, and whether the conflict is generated between the type of the loaded filter special effect and the type of the filter special effect to be loaded or not can be judged according to the conflict possibility sizes in actual operation.

In an alternative embodiment, when the type of the filter effect to be loaded conflicts with the type of the loaded filter effect, the step of removing the loaded filter effect may include:

In this alternative embodiment, since the filter special effects of the same type are not in conflict, in order to optimize the effect of the filter special effect to be loaded, whether the filter special effect to be loaded and the loaded filter special effect are in conflict can be determined by judging whether the filter special effect to be loaded and the loaded filter special effect are the same. If the types of the two types are different, the loaded filter special effects are directly removed, so that the loaded filter special effects are prevented from affecting the representing effect of the filter special effects to be loaded. The optional embodiment can be applied to some predefined scenes, such as the conditions that the special effects of the filters provided by the image special effect processing system and the combined special effects in the special effect data packet are independent, that is, in some scenes that the special effects of the two filters cannot be overlapped to realize the ultra-expected special effect, the optional embodiment can be directly operated, and the operation mode is simple and easy to implement, does not consume too much resources for implementation, and can improve the real-time performance of real-time image special effect processing.

In an alternative embodiment, when the type of the filter effect to be loaded conflicts with the type of the loaded filter effect, removing the loaded filter effect includes:

In this alternative embodiment, a conflict correspondence between different types of filter special effects may be established in advance according to the types of filter special effects, that is, a conflict correspondence is established between two types of filter special effects that may conflict, so as to indicate that the two types of filter special effects may conflict and cannot be simultaneously superimposed and loaded on the same image. The preset type set can be established according to the conflict corresponding relation. In the actual application process, the type of the special effect of the loaded filter can be determined whether to conflict with the type of the special effect of the filter to be loaded by matching the special effect type of the filter with the conflict corresponding relation with the special effect type of the filter to be loaded, and when the conflict exists, the special effect of the loaded filter is removed.

In the alternative embodiment, the overlapping corresponding relation between the special effects of the filters in different types can be established in advance according to the special effect types of the filters, namely, the overlapping corresponding relation is established between the special effect types of the two filters which cannot conflict, so that the special effects of the two filters cannot conflict, and the special effects of the two filters can be simultaneously overlapped and loaded on the same image. And establishing a preset type set according to the superposition corresponding relation. In the actual application process, the type of the special effect of the loaded filter can be determined whether to conflict with the type of the special effect of the filter to be loaded or not by matching the special effect type of the filter which does not have conflict with the special effect type of the filter to be loaded, and when the conflict exists, the special effect of the loaded filter is removed.

In an alternative embodiment, the removing the loaded filter effect may include:

In this alternative embodiment, in the image special effect processing system, a rendering chain table is first established each time the special effect processing is performed on the image, and then the image is rendered according to the rendering chain table, so as to implement the special effect processing. The rendering chain table comprises operations to be executed when the images are sequentially rendered, and each item in the rendering chain table comprises the operations to be executed and the execution sequence. And when the rendering is executed, performing rendering operation on the images according to the execution sequence in the rendering chain table. Because the loaded filter special effects are already contained in the established rendering chain table, when the special effect data packet is loaded, the item corresponding to the loaded filter special effects is removed from the rendering chain table, the filter special effects and other special effect elements in the special effect data packet are supplemented, and then the image is rendered according to the rendering chain table.

In an optional embodiment, step S3, that is, when the special effect data packet includes the special effect of the filter to be loaded, the step of performing special effect processing on the image according to the special effect data packet and the special effect of the loaded filter on the image may further include:

In this alternative embodiment, the image needs to be re-rendered once when the special effects data packet is loaded. The rendering chain table is also required to be updated according to the content in the special effect data packet, and the image is processed according to each item in the rendering chain table after updating. If the special effects of the filter in the special effect data packet to be loaded conflict with the special effects of the loaded filter, when updating the rendering chain table, the item corresponding to the special effect filter to be loaded can be removed, and the items corresponding to the special effects of the filter to be loaded and other special effect elements in the special effect data packet can be supplemented. If the filter effect in the special effect data packet to be loaded does not conflict with the loaded filter effect, the items corresponding to the filter effect to be loaded and other special effect elements in the special effect data packet can be directly added to the rendering chain table when the rendering chain table is updated.

In the alternative embodiment, if the special effects of the loaded filter and the special effects of the filter to be loaded do not conflict, the special effects of the loaded filter and the special effects of the filter to be loaded can be overlapped and loaded on the image without removing, so that resources can be saved, the special effects of the two non-conflicting filters can be simultaneously applied to one image, an unexpected effect can be generated, and the user experience effect is improved.

In an alternative embodiment, the loaded filter effect is a locally saved filter effect; the special effect data packet is a special effect data packet downloaded by a cloud.

In this alternative embodiment, a common application scenario is that the user has preloaded a local filter special effect, such as skin care, when opening the camera to obtain an image. After or before the image is acquired, the user selects a complex special effect (usually, special effect data packets corresponding to the special effects for saving resources are stored in the cloud), for example, beards are added to the face of the image. And after receiving the selected event of the complex special effect selected by the user, the image special effect processing system downloads a corresponding special effect data packet from the cloud. In this case, the image special effect processing method provided by the embodiment of the disclosure can be executed before the special effect data packet is loaded, so as to solve the problem that the loaded special effect of the filter and the special effect of the filter in the special effect data packet may have conflict, and improve the user experience effect.

In the foregoing, although the steps in the embodiment of the image special effect processing method are described in the above order, it should be clear to those skilled in the art that the steps in the embodiment of the disclosure are not necessarily performed in the above order, but may be performed in reverse order, parallel, cross, etc., and other steps may be further added by those skilled in the art on the basis of the above steps, and these obvious modifications or equivalent alternatives should also be included in the protection scope of the disclosure and are not repeated herein.

The following is an embodiment of the disclosed apparatus, which may be used to perform steps implemented by an embodiment of the disclosed method, and for convenience of explanation, only those portions relevant to the embodiment of the disclosed method are shown, and specific technical details are not disclosed, referring to the embodiment of the disclosed method.

In order to solve the technical problem of how to improve the user experience effect, the embodiment of the disclosure provides an image special effect processing device. The apparatus may perform the steps described in the embodiments of the image special effect processing method described above. As shown in fig. 4, the apparatus mainly includes: an acquisition module 41, a determination module 42 and a processing module 43. Wherein, the obtaining module 41 is configured to obtain a special effect data packet; the determining module 42 is configured to determine whether the special effect data packet includes a special effect of the filter to be loaded; the processing module 43 is configured to perform special effect processing on the image according to the special effect data packet and the loaded special effect of the filter on the image when the special effect data packet includes the special effect of the filter to be loaded.

The determining module 42 may check whether the special effect data packet includes the special effect of the filter to be loaded by parsing the special effect data packet. Different elements in the special effect data packet can be described by different fields, so that whether the special effect data packet comprises the filter can be determined by matching the fields corresponding to the filter.

The filter to be loaded and the filter to be loaded are both filters, possibly of the same type, even the same filter, and possibly different types of filters. The loaded filter is a filter that has been loaded onto the image, i.e. the image has been subjected to special effects processing by the loaded filter, and the filter to be loaded is a filter to be loaded onto the image.

In this embodiment, the image special effect processing device may be applied to smart phones, smart cameras, palm computers, tablet computers, electronic books, portable computers, computers and other smart terminals with photographing and image processing functions and touch screens, so as to implement special effect processing of images.

In this embodiment, after the obtaining module 41 obtains the special effect data packet, the determining module 42 may analyze the code corresponding to the special effect data packet, and match and check whether the code includes a filter field, if so, it is considered that the code includes the special effect of the filter to be loaded, and if not, it does not include the filter to be loaded. The special effect data packet may include only the special effect of the filter or only other special effects such as a sticker, or may be a data packet formed by combining the special effect of the filter with other special effects such as a sticker.

In this embodiment, when determining that the special effect data packet includes the special effect of the filter to be loaded, the processing module 43 may perform special effect processing on the image according to the special effect of the filter already loaded on the image and the special effect of the filter to be loaded in the special effect data packet. Of course, it can be understood that, in the case where the special effect data packet does not include the special effect of the filter to be loaded, special effect processing can be performed according to the normal processing flow, which is not limited in the disclosure.

In an alternative embodiment, the acquiring module includes:

In this alternative embodiment, in order to save resources, the special effects data packet may be stored in the special effects database in the cloud in the initial case, the user may select the special effects that want to be added through the page provided by the image special effects processing system, and the download sub-module may download the corresponding special effects data packet from the cloud according to the selection of the user, and store in the local special effects database. If the special effect data packet corresponding to the special effect selected by the user exists in the local special effect database, the special effect data packet can be directly obtained from the local special effect database.

In an alternative embodiment, the determining module may include:

the analysis submodule is used for analyzing the special effect data packet;

In this alternative embodiment, from the application level, the special effect data packet may include other special effect elements such as a filter special effect and a sticker, and from the specific data layer, the special effect data packet may include a code portion, a picture, etc. for implementing the special effect corresponding to the special effect data packet, where the code portion may include fields of the filter special effect and/or other special effect elements and corresponding parameters, etc., before the special effect processing is performed on the image, the parsing sub-module may parse the special effect data packet, and the first determining sub-module may determine, according to the field corresponding to the special effect element in the code portion in the special effect data packet, a special effect processing manner on the image, and determine, according to a value following the field, a processing parameter when the special effect processing manner is performed on the image.

In an alternative embodiment, the processing module 43 may include:

In this optional embodiment, if the special effect data packet includes the special effect of the filter to be loaded, and if the special effect of the filter is already loaded in the image, it may also be determined whether there is a conflict between the special effect of the filter to be loaded and the special effect of the filter to be loaded, and if there is a conflict, the first removing submodule removes the special effect of the filter to be loaded, that is, recovers the influence of the special effect of the filter to be loaded on the image.

In an alternative embodiment, the first removing sub-module may include:

In an alternative embodiment, the second removing sub-module may include:

In this alternative embodiment, since the filter effects of the same type will not generally collide, in order to optimize the effect of the filter effect to be loaded, whether the filter effect to be loaded and the loaded filter effect collide may be determined by determining whether the types of the filter effect to be loaded and the filter effect to be loaded are the same. If the types of the two types are different, the loaded filter special effects are directly removed, so that the loaded filter special effects are prevented from affecting the representing effect of the filter special effects to be loaded. The optional embodiment can be applied to some predefined scenes, such as the conditions that the special effects of the filters provided by the image special effect processing system and the combined special effects in the special effect data packet are independent, that is, in some scenes that the special effects of the two filters cannot be overlapped to realize the ultra-expected special effect, the optional embodiment can be directly operated, and the operation mode is simple and easy to implement, does not consume too much resources for implementation, and can improve the real-time performance of real-time image special effect processing.

In an alternative embodiment, the second removing sub-module may include:

In this optional embodiment, in the actual application process, the first matching submodule may determine whether the type of the loaded filter effect conflicts with the type of the filter effect to be loaded by matching the filter effect type having a conflict correspondence with the type of the filter effect to be loaded, and when the conflict exists, the fourth removing submodule removes the loaded filter effect.

In an alternative embodiment, the second removing sub-module may include:

In this optional embodiment, in the actual application process, the second matching submodule may determine whether the type of the loaded filter effect conflicts with the type of the filter effect to be loaded by matching the filter effect type having no conflict correspondence with the type of the filter effect to be loaded, and when there is a conflict, the fifth removing submodule removes the loaded filter effect.

In an alternative embodiment, any one of the first removing sub-module, the second removing sub-module, the third removing sub-module, the fourth removing sub-module, and the fifth removing sub-module may include:

In this alternative embodiment, since the loaded filter effect is already included in the established rendering chain table, when the special effect data packet is loaded, the update sub-module removes the item corresponding to the loaded filter effect from the rendering chain table, supplements the filter effect and other special effect elements in the special effect data packet, and then renders the image according to the rendering chain table.

In an alternative embodiment, the processing module 43 may further include:

In this alternative embodiment, the image needs to be re-rendered once when the special effects data packet is loaded. The rendering chain table is also required to be updated according to the content in the special effect data packet, and the processing sub-module processes the image according to each item in the rendering chain table after updating.

In an alternative embodiment, the processing module 43 may further include:

In the alternative embodiment, if the special effects of the loaded filter and the special effects of the filter to be loaded do not conflict, the special effects of the loaded filter can not be removed, and the superposition sub-module superposes and loads the special effects of the loaded filter and the special effects of the filter to be loaded on the image, so that resources can be saved, the special effects of the two non-conflicting filters are simultaneously applied to one image, an unexpected effect can be generated, and the user experience effect is improved.

The detailed description of the working principle, the realized technical effects, etc. of the embodiment of the image special effect processing device can refer to the related description in the embodiment of the image special effect processing method, and will not be repeated here.

Fig. 5 is a hardware block diagram illustrating an image special effects processing hardware apparatus according to an embodiment of the present disclosure. As shown in fig. 5, the image special effects processing hardware apparatus 50 according to the embodiment of the present disclosure includes a memory 51 and a processor 52.

The memory 51 is used to store non-transitory computer readable instructions. In particular, the memory 51 may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory. The volatile memory may include, for example, random Access Memory (RAM) and/or cache memory (cache), and the like. The non-volatile memory may include, for example, read Only Memory (ROM), hard disk, flash memory, and the like.

The processor 52 may be a Central Processing Unit (CPU) or other form of processing unit having data processing and/or instruction execution capabilities, and may control other components in the image special effects processing hardware apparatus 50 to perform desired functions. In one embodiment of the present disclosure, the processor 52 is configured to execute the computer readable instructions stored in the memory 51 to cause the image special effects processing hardware apparatus 50 to perform all or part of the steps of the image special effects processing method of the embodiments of the present disclosure as described above.

It should be understood by those skilled in the art that, in order to solve the technical problem of how to obtain a good user experience effect, the present embodiment may also include well-known structures such as a communication bus, an interface, and the like, and these well-known structures are also included in the protection scope of the present disclosure.

The detailed description of the present embodiment may refer to the corresponding description in the foregoing embodiments, and will not be repeated herein.

Fig. 6 is a schematic diagram illustrating a computer-readable storage medium according to an embodiment of the present disclosure. As shown in fig. 6, a computer-readable storage medium 60 according to an embodiment of the present disclosure has stored thereon non-transitory computer-readable instructions 61. When the non-transitory computer readable instructions 61 are executed by the processor, all or part of the steps of the image special effects processing method of the embodiments of the present disclosure described above are performed.

The computer-readable storage media 60 described above include, but are not limited to: optical storage media (e.g., CD-ROM and DVD), magneto-optical storage media (e.g., MO), magnetic storage media (e.g., magnetic tape or removable hard disk), media with built-in rewritable non-volatile memory (e.g., memory card), and media with built-in ROM (e.g., ROM cartridge).

Fig. 7 is a schematic diagram illustrating a hardware structure of a terminal device according to an embodiment of the present disclosure. As shown in fig. 7, the image special effects processing terminal 70 includes the above-described image special effects processing apparatus embodiment.

The terminal device may be implemented in various forms, and the terminal device in the present disclosure may include, but is not limited to, a mobile terminal device such as a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a navigation device, an in-vehicle terminal device, an in-vehicle display terminal, an in-vehicle electronic rear view mirror, and the like, and a fixed terminal device such as a digital TV, a desktop computer, and the like.

As an equivalent alternative, the terminal may also include other components. As shown in fig. 7, the image special effect processing terminal 70 may include a power supply unit 71, a wireless communication unit 72, an a/V (audio/video) input unit 73, a user input unit 74, a sensing unit 75, an interface unit 76, a controller 77, an output unit 78, a storage unit 79, and the like. Fig. 7 shows a terminal having various components, but it should be understood that not all of the illustrated components are required to be implemented, and that more or fewer components may alternatively be implemented.

Wherein the wireless communication unit 72 allows radio communication between the terminal 70 and a wireless communication system or network. The a/V input unit 73 is for receiving an audio or video signal. The user input unit 74 may generate key input data according to a command input by a user to control various operations of the terminal device. The sensing unit 75 detects the current state of the terminal 70, the position of the terminal 70, the presence or absence of a touch input by the user to the terminal 70, the orientation of the terminal 70, the acceleration or deceleration movement and direction of the terminal 70, and the like, and generates commands or signals for controlling the operation of the terminal 70. The interface unit 76 serves as an interface through which at least one external device is connected to the terminal 70. The output unit 78 is configured to provide output signals in a visual, audio and/or tactile manner. The storage unit 79 may store a software program or the like of processing and control operations performed by the controller 77, or may temporarily store data that has been output or is to be output. The storage unit 79 may include at least one type of storage medium. Also, the terminal 70 may cooperate with a network storage device that performs the storage function of the storage unit 79 through a network connection. The controller 77 generally controls the overall operation of the terminal device. In addition, the controller 77 may include a multimedia module for reproducing or playing back multimedia data. The controller 77 may perform a pattern recognition process to recognize handwriting input or picture drawing input performed on the touch screen as characters or images. The power supply unit 71 receives external power or internal power and supplies appropriate power required for operating the respective elements and components under the control of the controller 77.

Various embodiments of the image special effects processing methods presented in this disclosure may be implemented in a computer readable medium using, for example, computer software, hardware, or any combination thereof. For hardware implementation, various embodiments of the image special effects processing methods proposed by the present disclosure may be implemented using at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a processor, a controller, a microcontroller, a microprocessor, and an electronic unit designed to perform the functions described herein, and in some cases, various embodiments of the image special effects processing methods proposed by the present disclosure may be implemented in the controller 77. For software implementation, various embodiments of the image special effects processing methods presented in this disclosure may be implemented with a separate software module that allows for performing at least one function or operation. The software codes may be implemented by a software application (or program) written in any suitable programming language, which may be stored in the memory unit 79 and executed by the controller 77.

The basic principles of the present disclosure have been described above in connection with specific embodiments, however, it should be noted that the advantages, benefits, effects, etc. mentioned in the present disclosure are merely examples and not limiting, and these advantages, benefits, effects, etc. are not to be considered as necessarily possessed by the various embodiments of the present disclosure. Furthermore, the specific details disclosed herein are for purposes of illustration and understanding only, and are not intended to be limiting, since the disclosure is not necessarily limited to practice with the specific details described.

The block diagrams of the devices, apparatuses, devices, systems referred to in this disclosure are merely illustrative examples and are not intended to require or imply that the connections, arrangements, configurations must be made in the manner shown in the block diagrams. As will be appreciated by one of skill in the art, the devices, apparatuses, devices, systems may be connected, arranged, configured in any manner. Words such as "including," "comprising," "having," and the like are words of openness and mean "including but not limited to," and are used interchangeably therewith. The terms "or" and "as used herein refer to and are used interchangeably with the term" and/or "unless the context clearly indicates otherwise. The term "such as" as used herein refers to, and is used interchangeably with, the phrase "such as, but not limited to.

In addition, as used herein, the use of "or" in the recitation of items beginning with "at least one" indicates a separate recitation, such that recitation of "at least one of A, B or C" for example means a or B or C, or AB or AC or BC, or ABC (i.e., a and B and C). Furthermore, the term "exemplary" does not mean that the described example is preferred or better than other examples.

It is also noted that in the systems and methods of the present disclosure, components or steps may be disassembled and/or assembled. Such decomposition and/or recombination should be considered equivalent to the present disclosure.

Various changes, substitutions, and alterations are possible to the techniques described herein without departing from the teachings of the techniques defined by the appended claims. Furthermore, the scope of the claims of the present disclosure is not limited to the particular aspects of the process, machine, manufacture, composition of matter, means, methods and acts described above. The processes, machines, manufacture, compositions of matter, means, methods, or acts, presently existing or later to be developed that perform substantially the same function or achieve substantially the same result as the corresponding aspects described herein may be utilized. Accordingly, the appended claims are intended to include within their scope such processes, machines, manufacture, compositions of matter, means, methods, or acts.

The previous description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to these aspects will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other aspects without departing from the scope of the disclosure. Thus, the present disclosure is not intended to be limited to the aspects shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

The foregoing description has been presented for purposes of illustration and description. Furthermore, this description is not intended to limit the embodiments of the disclosure to the form disclosed herein. Although a number of example aspects and embodiments have been discussed above, a person of ordinary skill in the art will recognize certain variations, modifications, alterations, additions, and subcombinations thereof.

Claims

1. An image special effect processing method, characterized by comprising the following steps:

acquiring a special effect data packet;

when the special effect data packet contains the special effect of the filter to be loaded, carrying out special effect processing on the image according to the special effect data packet and the special effect of the loaded filter on the image; wherein the method comprises the steps of

When the special effect data packet contains the special effect of the filter to be loaded, carrying out special effect processing on the image according to the special effect data packet and the special effect of the loaded filter on the image, wherein the special effect processing comprises the following steps:

2. The method of claim 1, wherein obtaining the special effects data packet comprises:

3. The method of claim 1, wherein determining whether the special effects data packet includes a special effect of a filter to be loaded comprises:

analyzing the special effect data packet;

4. The method of claim 1, wherein removing the loaded filter effect when there is a conflict between the filter effect to be loaded and the loaded filter effect comprises:

determining the type of the special effect of the filter to be loaded;

5. The method of claim 4, wherein removing the loaded filter effect when the type of filter effect to be loaded conflicts with the type of loaded filter effect comprises:

6. The method of claim 4, wherein removing the loaded filter effect when the type of filter effect to be loaded conflicts with the type of loaded filter effect comprises:

7. The method of claim 4, wherein removing the loaded filter effect when the type of filter effect to be loaded conflicts with the type of loaded filter effect comprises:

8. The method of any one of claims 1-7, wherein said removing the loaded filter effect comprises:

updating a rendering chain table to remove items corresponding to the loaded filter special effects from the rendering chain table;

when the special effect data packet contains the special effect of the filter to be loaded, carrying out special effect processing on the image according to the special effect data packet and the special effect of the loaded filter on the image, and further comprising:

9. An image special effect processing apparatus, characterized by comprising:

the acquisition module is used for acquiring the special effect data packet;

the processing module is used for carrying out special effect processing on the image according to the special effect data packet and the special effect of the loaded filter on the image when the special effect data packet contains the special effect of the filter to be loaded;

10. The apparatus of claim 9, wherein the acquisition module comprises:

11. The apparatus of claim 9, wherein the determining module comprises:

the analysis submodule is used for analyzing the special effect data packet;

12. The apparatus of claim 9, wherein the first removal sub-module comprises:

13. The apparatus of claim 12, wherein the second removal sub-module comprises:

14. The apparatus of claim 12, wherein the second removal sub-module comprises: the first matching sub-module is used for matching the type of the special effect of the loaded filter with a preset type set; the preset type set comprises at least one preset type which conflicts with the type of the special effect of the filter to be loaded;

15. The apparatus of claim 12, wherein the second removal sub-module comprises:

16. The apparatus of any of claims 9-15, wherein any of the first, second, third, fourth, and fifth removal sub-modules comprises:

the updating sub-module is used for updating a rendering chain table so as to remove items corresponding to the loaded filter special effects from the rendering chain table;

The processing module comprises:

17. An image special effects processing hardware apparatus, comprising:

a memory for storing non-transitory computer readable instructions; and

a processor for executing the computer readable instructions such that the processor, when executed, implements the image special effect processing method according to any one of claims 1-8.

18. A computer readable storage medium storing non-transitory computer readable instructions which, when executed by a computer, cause the computer to perform the image special effects processing method of any one of claims 1-8.