CN115914721A

CN115914721A - Live broadcast picture processing method and device, electronic equipment and storage medium

Info

Publication number: CN115914721A
Application number: CN202211509760.6A
Authority: CN
Inventors: 蒋羽
Original assignee: Beijing Dajia Internet Information Technology Co Ltd
Current assignee: Beijing Dajia Internet Information Technology Co Ltd
Priority date: 2022-11-29
Filing date: 2022-11-29
Publication date: 2023-04-04

Abstract

The present disclosure relates to a live broadcast picture processing method, apparatus, electronic device and storage medium, the method comprising: responding to the starting operation of the target object for the live broadcast object protection function, and displaying a shielding special effect setting page; responding to the shielding special effect setting operation implemented on the shielding special effect setting page, and obtaining a target face shielding special effect associated with the target object; the target face shielding special effect is used for covering a face area of the target object in the real-time live broadcast picture under the condition that the special effect loading effect of the target object in the real-time live broadcast picture is in a failure state. By adopting the method and the device, the utilization rate of the live streaming transmission resource can be improved.

Description

Live broadcast picture processing method and device, electronic equipment and storage medium

Technical Field

The present disclosure relates to the field of computer image technologies, and in particular, to a live view processing method and apparatus, an electronic device, and a storage medium.

Background

With the development of internet live broadcast technology, more and more people live broadcast activities through the live broadcast function provided by using the live broadcast platform.

However, in the live broadcast pictures in the related art, the special effect of beautifying the face of the target object often disappears due to some unexpected situations, so that the target object with personal face protection needs to immediately take measures such as pausing or closing a live broadcast room, but these measures often make the target object unable to send the live broadcast picture meeting the sharing requirement to the client where the audience account of the target object is located, and further make the live broadcast transmission resources provided by the live broadcast platform not be effectively utilized.

Disclosure of Invention

The present disclosure provides a live frame processing method, apparatus, electronic device, and storage medium, so as to at least solve a problem that a live transmission resource provided by a live platform in the related art is not effectively utilized. The technical scheme of the disclosure is as follows:

according to a first aspect of an embodiment of the present disclosure, a live view processing method is provided, where the method includes:

responding to the starting operation of the target object aiming at the live broadcast object protection function, and displaying a shielding special effect setting page;

responding to the shielding special effect setting operation implemented on the shielding special effect setting page, and obtaining a target face shielding special effect associated with the target object;

the target face shielding special effect is used for covering a face area of the target object in the real-time live broadcast picture under the condition that the special effect loading effect of the target object in the real-time live broadcast picture is in a failure state.

In one possible implementation manner, the obtaining a target face occlusion special effect associated with the target object in response to the occlusion special effect setting operation performed on the occlusion special effect setting page includes:

in response to the occlusion effect style setting operation, determining a target occlusion effect style set by the occlusion effect style setting operation;

and taking the face shielding special effect matched with the target shielding effect pattern as the target face shielding special effect.

In one possible implementation manner, the determining, in response to the occlusion effect style setting operation, a target occlusion effect style set by the occlusion effect style setting operation includes:

responding to the triggering operation of the occlusion effect style setting control, and displaying at least two candidate occlusion effect styles;

in response to a selection operation on the candidate occlusion effect pattern, taking the candidate occlusion effect pattern selected by the selection operation as the target occlusion effect pattern.

In one possible implementation manner, the blocking special effect setting page further includes a blocking effect pattern uploading entry, and the determining, in response to the blocking effect pattern setting operation, the target blocking effect pattern set by the blocking effect pattern setting operation includes:

responding to a picture uploading operation of the shielding effect style uploading inlet, and determining a target shielding image uploaded by the picture uploading operation;

and taking the target occlusion image as the target occlusion effect pattern.

In one possible implementation manner, the obtaining a target face occlusion special effect associated with the target object in response to the occlusion special effect setting operation performed on the occlusion special effect setting page further includes:

responding to the shielding effect intensity setting operation, and determining the target shielding effect intensity set by the shielding effect intensity setting operation; the target shielding effect strength is used for representing the shielding degree of the face shielding special effect on the face area of the target object in the real-time live broadcast picture;

and taking the face shielding special effect matched with the target shielding effect strength as the target face shielding special effect.

In one possible implementation manner, the blocking special effect setting page further includes a blocking effect intensity adjusting control, and the determining, in response to the blocking effect intensity setting operation, the target blocking effect intensity set by the blocking effect intensity setting operation includes:

responding to the adjustment operation of the shielding effect strength adjustment control, and determining a target adjustment numerical value corresponding to the adjustment operation;

and taking the shielding effect strength represented by the target adjusting value as the target shielding effect strength.

According to a second aspect of the embodiments of the present disclosure, there is provided a live view processing method, including:

detecting a special effect loading effect of a target object in a real-time live broadcast picture under the condition that a live broadcast object protection function is in an open state;

determining a target face shielding special effect associated with the target object under the condition that the special effect loading effect is in a failure state; the target face shielding special effect is determined according to shielding special effect setting operation implemented in advance by the target object;

adding the target face shielding special effect in the real-time live broadcast picture; the target face shielding special effect is used for covering the face area of the target object in the real-time live broadcast picture.

In one possible implementation, the method further comprises:

displaying an interactive game interface in the real-time live broadcast picture under the condition that the target object does not exist in the real-time live broadcast picture;

the interactive game interface is used for implementing interactive operation for the target user account; and the target user account is an audience account in a virtual space corresponding to the real-time live broadcast picture.

According to a third aspect of the embodiments of the present disclosure, there is provided a live view processing apparatus including:

the display unit is configured to execute starting operation of responding to the target object aiming at the live object protection function and display a shielding special effect setting page;

a setting unit configured to execute an occlusion special effect setting operation performed in the occlusion special effect setting page to obtain a target face occlusion special effect associated with the target object;

In one possible implementation, the occlusion special effect setting operation includes an occlusion effect pattern setting operation, and the setting unit is specifically configured to execute, in response to the occlusion effect pattern setting operation, determining a target occlusion effect pattern set by the occlusion effect pattern setting operation; and taking the face shielding special effect matched with the target shielding effect pattern as the target face shielding special effect.

In one possible implementation manner, the occlusion special effect setting page includes an occlusion effect style setting control, and the setting unit is specifically configured to execute a trigger operation in response to the occlusion effect style setting control, and display at least two candidate occlusion effect styles; and in response to the selection operation of the candidate occlusion effect style, taking the candidate occlusion effect style selected by the selection operation as the target occlusion effect style.

In one possible implementation manner, the occlusion special effect setting page further includes an occlusion effect pattern uploading entry, and the setting unit is specifically configured to execute a picture uploading operation in response to the occlusion effect pattern uploading entry, and determine a target occlusion image uploaded by the picture uploading operation; and taking the target occlusion image as the target occlusion effect pattern.

In one possible implementation manner, the occlusion special effect setting operation further includes an occlusion effect strength setting operation, and the setting unit is specifically configured to execute, in response to the occlusion effect strength setting operation, determining a target occlusion effect strength set by the occlusion effect strength setting operation; the target shielding effect strength is used for representing the shielding degree of the face shielding special effect on the face area of the target object in the real-time live broadcast picture; and taking the face shielding special effect matched with the target shielding effect strength as the target face shielding special effect.

In a possible implementation manner, the occlusion special effect setting page further includes an occlusion effect strength adjustment control, and the setting unit is specifically configured to execute an adjustment operation in response to the occlusion effect strength adjustment control, and determine a target adjustment value corresponding to the adjustment operation; and taking the shielding effect strength represented by the target adjusting value as the target shielding effect strength.

According to a fourth aspect of the embodiments of the present disclosure, there is provided a live view processing apparatus including:

the detection unit is configured to detect a special effect loading effect of a target object in a real-time live broadcast picture under the condition that the live broadcast object protection function is in an open state;

a determination unit configured to perform determining a target face occlusion special effect associated with the target object if the special effect loading effect is in a failure state; the target face shielding special effect is determined according to shielding special effect setting operation implemented in advance by the target object;

an occlusion unit configured to perform addition of the target face occlusion special effect in the live broadcast screen; the target face shielding special effect is used for covering the face area of the target object in the real-time live broadcast picture.

In one possible implementation, the apparatus is further configured to perform, in a case where it is detected that the target object does not exist in the live view, displaying an interactive game interface in the live view; the interactive game interface is used for a target user account to implement interactive operation; and the target user account is an audience account in a virtual space corresponding to the real-time live broadcast picture.

According to a third aspect of the embodiments of the present disclosure, there is provided an electronic device, including a memory and a processor, where the memory stores a computer program, and the processor implements a live view processing method according to the above aspect or any one of the possible implementations of the above aspect when executing the computer program.

According to a fourth aspect of the embodiments of the present disclosure, there is provided a storage medium having stored thereon a computer program which, when executed by a processor, implements a live view processing method as set forth in the above aspect or any one of the above possible implementations.

According to a fifth aspect of the embodiments of the present disclosure, there is provided a computer program product, the program product comprising a computer program, the computer program being stored in a readable storage medium, from which at least one processor of a device reads and executes the computer program, so that the device performs the live view processing method of the above aspect or any one of the possible implementations of the above aspect.

The technical scheme provided by the embodiment of the disclosure at least brings the following beneficial effects: the method comprises the steps that a shielding special effect setting page is displayed by responding to the starting operation of a target object for the protection function of a live broadcast object, and a target face shielding special effect associated with the target object is obtained by responding to the shielding special effect setting operation implemented on the shielding special effect setting page, wherein the target face shielding special effect is used for covering a face area of the target object in a real-time live broadcast picture under the condition that the special effect loading effect of the target object in the real-time live broadcast picture is in a failure state; therefore, under the condition that the special effect loading effect of the real-time live broadcast picture of the target object in the live broadcast activity process disappears due to some unexpected conditions, the electronic equipment can add the target face shielding special effect matched with the shielding special effect setting operation pre-implemented by the target object in the real-time live broadcast picture in time so as to cover the face area of the target object in the real-time live broadcast picture in a personalized manner, so that the target object does not need to take measures such as pausing or closing a live broadcast room immediately, the target object can continuously send the live broadcast picture meeting the sharing requirement to the client side where the audience account of the target object is located, and the live broadcast transmission resource provided by the live broadcast platform can be effectively utilized.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure and are not to be construed as limiting the disclosure.

Fig. 1 is a flowchart illustrating a live picture processing method according to an exemplary embodiment.

Fig. 2 (a) is a schematic diagram illustrating a live picture processing method according to an exemplary embodiment.

Fig. 2 (b) is a schematic diagram illustrating another live picture processing method according to an exemplary embodiment.

Fig. 3 is an information protection flowchart illustrating a live screen processing method according to an exemplary embodiment.

Fig. 4 is a flow diagram illustrating another live view processing method according to an example embodiment.

Fig. 5 is a flowchart illustrating still another live screen processing method according to another exemplary embodiment.

Fig. 6 is a flowchart illustrating a live picture processing method according to another exemplary embodiment.

Fig. 7 is a timing diagram illustrating a live picture processing method according to an exemplary embodiment.

Fig. 8 is a block diagram illustrating a live screen processing apparatus according to an exemplary embodiment.

Fig. 9 is a block diagram illustrating another live screen processing apparatus according to an exemplary embodiment.

FIG. 10 is a block diagram illustrating an electronic device in accordance with an example embodiment.

Detailed Description

In order to make the technical solutions of the present disclosure better understood by those of ordinary skill in the art, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.

It should be noted that the terms "first," "second," and the like in the description and claims of the present disclosure and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein are capable of operation in sequences other than those illustrated or otherwise described herein. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure.

It should also be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for presentation, analyzed data, etc.) referred to in the present disclosure are both information and data that are authorized by the user or sufficiently authorized by various parties.

Fig. 1 is a flowchart illustrating a live view processing method according to an exemplary embodiment, and as shown in fig. 1, the image processing method is used in an electronic device, where the electronic device may be, but is not limited to, various personal computers, laptops, smartphones, tablet computers, internet of things devices, and portable wearable devices, and the internet of things devices may be smart speakers, smart televisions, smart air conditioners, smart car-mounted devices, and the like. The portable wearable device can be a smart watch, a smart bracelet, a head-mounted device, and the like. The live view processing method may include the following steps.

In step S102, in response to the start operation of the target object on the live object protection function, a blocking special effect setting page is displayed.

The target object may refer to a person, an animal, or the like. In practical applications, the target object may refer to a main broadcast in a live event.

The live broadcast object protection function may be a function of protecting target face information of a face area of a target object in a live broadcast process. In practical applications, the live object protection function may refer to a face information protection function. The target face information may refer to face information of a target object that is not required to be displayed on a real-time live interface by the electronic device.

The occlusion special effect setting page may be an interface for the target object to perform occlusion special effect setting operation.

The occlusion special effect setting operation may be a style setting operation on a face occlusion special effect. In practical applications, the occlusion special effect setting operation may include at least one of an occlusion effect style setting operation and an occlusion effect strength setting operation.

The face shielding special effect can be a special effect which is displayed in a real-time live broadcast picture and can shield a target object in a face area of the real-time live broadcast picture. For example, the facial occlusion special effects may include, but are not limited to, pictures, color blocks, mosaics, dynamic expressions, magic watches, blurring, warping, barrage, and the like.

The real-time live video may refer to a video in which a target object is live. For example, when the target object is a main broadcast of a live broadcast platform, the real-time live broadcast picture may be a picture formed by a real-time live broadcast video stream acquired by a client where the main broadcast is located.

In specific implementation, before the live broadcast of the target object is started, a live broadcast object protection function can be started for the target object; specifically, a user account (e.g., a live broadcast account) may input an opening operation for a live broadcast object protection function to the electronic device, and the electronic device displays an occlusion special effect setting page in response to the opening operation for the live broadcast object protection function.

To facilitate understanding for those skilled in the art, please refer to fig. 2 (a), and fig. 2 (a) exemplarily shows an interface diagram of a live view processing method. As shown in fig. 2 (a), the application interface 210 includes a selection item 220 for opening the stealth protection for beautification; the option 220 is used for enabling or closing the live object protection function for the target object by the user account; the user can input the opening operation of the live object protection function to the electronic equipment by checking the selection item 220; the electronic device displays the occlusion special effect setting page 230 in response to the on operation of the live object protection function.

In step S104, a target face occlusion special effect associated with the target object is obtained in response to an occlusion special effect setting operation performed on the occlusion special effect setting page.

The special effect loading effect can be a loading result of a face beautifying special effect adopted by the target object in a real-time live broadcast picture.

The face beautifying special effect may be an effect obtained by performing beautifying processing on a face area of the target object.

For example, the face beautification special effect may refer to an effect that the target object enables a face beautification function in the target screen, an effect that the target object performs a makeup operation on the face, and the like.

The face beautifying function can be used for carrying out face adjustment processing on a face area of the target object in the target picture. The face adjustment process may include a face deformation process (e.g., a face thinning process) and/or a face makeup process (e.g., a skin polishing process, a makeup process, etc.).

In a specific implementation, please refer to fig. 2 (b), fig. 2 (b) exemplarily shows a schematic diagram of another live view processing method; the user may input a face occlusion effect setting operation applied to the occlusion effect setting page 230 to the electronic device; the user can set the operations such as shielding effect style and shielding effect strength through the face shielding special effect setting page; the electronic equipment responds to the face shielding special effect setting operation carried out on the face shielding special effect setting page, and obtains a target face shielding special effect set by the face shielding special effect setting operation; and finally, the electronic equipment establishes an incidence relation between the target face shielding special effect and the target object. Specifically, the electronic device may obtain face occlusion setting data for characterizing a face occlusion manner in response to a face occlusion special effect setting operation performed on the face occlusion special effect setting page 430; then, the electronic device records a mapping relation between a user account of the target object and the face shielding setting data, and stores the face shielding setting data corresponding to the user account into a preset storage module.

The electronic equipment can detect the special effect loading effect of the target object in the real-time live broadcast picture; under the condition that the special effect loading effect of the target object in the real-time live broadcast picture is in a failure state, face shielding setting data which has the mapping relation with a user account of the target object can be inquired; and the electronic equipment adds the target face shielding special effect represented by the face shielding setting data to the real-time live broadcast picture to cover the face area of the target object in the real-time live broadcast picture.

For example, referring to fig. 3, fig. 3 exemplarily provides an information protection flow chart of a live view processing method; when a target object is subjected to live broadcast by the electronic equipment, the electronic equipment can detect whether the target object starts a face beautifying function or not; under the condition that the target object starts a face beautifying function, the electronic equipment carries out face beautifying processing on the face area of the target object in a real-time live broadcast picture in real time; under the condition that the target object does not start the face beautifying function, the target object needs to display the facial information of the target object in a real-time live broadcast picture, the electronic equipment does not need to protect the information of the facial area in the live broadcast process, and the electronic equipment does not need to execute the step of detecting whether the target object starts the live broadcast object protection function or not.

The electronic equipment can detect whether the target object starts a live broadcast object protection function or not under the condition that the target object starts a face beautifying function; when the electronic equipment detects that the target object does not enable the live object protection function, the target object can allow the face information of the target object to be displayed in a real-time live broadcast picture, and the electronic equipment does not need to protect the face area information in the live broadcast process.

Under the condition that the electronic equipment detects that the target object starts a live object protection function, the electronic equipment detects the face beautifying effect of the target object in a real-time live interface in real time; when the electronic equipment detects that the face beautifying effect of the target object in the real-time live broadcast interface is lost or invalid, the electronic equipment determines that the special effect loading effect of the target object in the real-time live broadcast image is in an invalid state.

Under the condition that the target object simultaneously starts a face beautifying function and a live broadcast object protection function, when the electronic equipment determines that the preset face shielding mode of the target object is a face shielding style 'distortion' based on the face shielding setting parameter; face shielding strength is "50%"; the electronic equipment can cover the face shielding special effect in the face area of the target object in the real-time live broadcast picture so as to cover the face area of the target object in the real-time live broadcast picture. The face shielding special effect is a result obtained by performing image distortion processing with a distortion degree of 50% on an image area corresponding to a face area of a target object in a real-time live broadcast picture.

To facilitate understanding by those skilled in the art, fig. 4 also illustratively provides a flow chart of another live view processing method; step 1: the target object may be a anchor in a live platform; before the anchor starts the live broadcast function, the anchor can set the electronic equipment to start the live broadcast object protection function. Step 2: after the anchor starts the live broadcast function, the electronic equipment can detect the face beautifying effect of the target object in a real-time live broadcast interface in real time; and 3, step 3: when the electronic equipment detects that the face beautifying effect of the target object in the real-time live broadcast interface is lost or invalid, the electronic equipment judges that the special effect loading effect is not in the invalid state. And 4, step 4: the electronic equipment triggers face information protection, namely the electronic equipment adds a target face shielding special effect in a real-time live broadcast interface; and 4, step 4: the facial information effect is displayed in the viewer side and the anchor side. Specifically, the electronic device can add a special effect of blocking the target face in the real-time live broadcast picture, so that the target face blocking special effect is adopted to cover the face area of the target object in the real-time live broadcast picture, and the face information of the target object is protected.

In the live broadcast picture processing method, a shielding special effect setting page is displayed by responding to the starting operation of a target object for the protection function of the live broadcast object, and a target face shielding special effect associated with the target object is obtained by responding to the shielding special effect setting operation implemented on the shielding special effect setting page, wherein the target face shielding special effect is used for covering a face area of the target object in a real-time live broadcast picture under the condition that the special effect loading effect of the target object in the real-time live broadcast picture is in a failure state; therefore, under the condition that the special effect loading effect of the real-time live broadcast picture of the target object in the live broadcast activity process disappears due to some unexpected conditions, the electronic equipment can add the target face shielding special effect matched with the shielding special effect setting operation pre-implemented by the target object in the real-time live broadcast picture in time so as to cover the face area of the target object in the real-time live broadcast picture in a personalized manner, so that the target object does not need to take measures such as pausing or closing a live broadcast room immediately, the target object can continuously send the live broadcast picture meeting the sharing requirement to the client side where the audience account of the target object is located, and the live broadcast transmission resource provided by the live broadcast platform can be effectively utilized.

In an exemplary embodiment, the occlusion special effect setting operation includes an occlusion effect style setting operation, and the obtaining of the target face occlusion special effect associated with the target object in response to the occlusion special effect setting operation performed on the occlusion special effect setting page includes: in response to the occlusion effect style setting operation, determining a target occlusion effect style set by the occlusion effect style setting operation; and taking the face shielding special effect matched with the target shielding effect pattern as a target face shielding special effect.

Wherein the shielding special effect setting operation comprises a shielding effect style setting operation.

In specific implementation, in the process that the electronic device obtains the target face shielding special effect associated with the target object in response to the shielding special effect setting operation implemented on the shielding special effect setting page, the electronic device can receive the shielding effect style setting operation in response to the user input; specifically, the occlusion effect style setting operation may refer to an operation of selecting a target occlusion effect style from a plurality of candidate occlusion effect styles; and the electronic equipment responds to the setting operation of the shielding effect style, and takes the face shielding special effect matched with the target shielding effect style set by the setting operation of the shielding effect style as the target face shielding special effect.

The electronic equipment can store an occlusion effect style parameter representing the target occlusion effect style; therefore, the electronic equipment can quickly determine the preset target face shielding special effect of the target object based on the shielding effect style parameter.

According to the technical scheme, the target shielding effect style set by the shielding effect style setting operation is determined in response to the shielding effect style setting operation, so that the target object can set the face shielding special effect style in advance in a personalized manner, and the face shielding special effect matched with the face shielding special effect style preset by the target object can be used for shielding the face area of the target object in the real-time live broadcast picture in a personalized manner in the follow-up process.

In an exemplary embodiment, the occlusion special effect setting page includes an occlusion effect style setting control, and in response to the occlusion effect style setting operation, determining a target occlusion effect style set by the occlusion effect style setting operation includes: responding to the triggering operation of the occlusion effect style setting control, and displaying at least two candidate occlusion effect styles; and in response to the selection operation of the candidate occlusion effect style, taking the candidate occlusion effect style selected by the selection operation as a target occlusion effect style.

The shielding special effect setting page comprises a shielding effect style setting control. In practical applications, the occlusion effect style setting control may be a pull-down menu.

The candidate occlusion effect style may include, but is not limited to, mosaic, blurring, warping, barrage, and the like.

In a specific implementation, please refer to fig. 2 (b), the occlusion special effect setting page 230 includes an occlusion effect style setting control 270; in the process that the electronic device determines the target occlusion effect style set by the occlusion effect style setting operation in response to the occlusion effect style setting operation, a user may input a trigger operation on the occlusion effect style setting control 270 to the electronic device by clicking the occlusion effect style setting control 270 in the occlusion special effect setting page 230; the electronic equipment receives and responds to the triggering operation of the occlusion effect style setting control 270, and displays at least two candidate occlusion effect styles; at this time, the user can select at least one target occlusion effect style from the candidate occlusion effect styles in a click mode to realize the selection operation of inputting the candidate occlusion effect styles to the electronic equipment; the electronic device responds to the selection operation of the candidate occlusion effect style, and takes the candidate occlusion effect style selected by the selection operation as a target occlusion effect style.

According to the technical scheme, the target object can select the target shielding effect style meeting the requirement from the multiple candidate shielding effect styles, so that the target face shielding special effect matched with the target shielding effect style can be adopted to effectively and individually shield the face area of the target object in the real-time live broadcast picture.

In an exemplary embodiment, the blocking special effect setting page further includes a blocking effect pattern uploading entry, and in response to the blocking effect pattern setting operation, determines a target blocking effect pattern set by the blocking effect pattern setting operation, including: responding to a picture uploading operation of an occlusion effect style uploading inlet, and determining a target occlusion image uploaded by the picture uploading operation; and taking the target occlusion image as a target occlusion effect pattern.

In specific implementation, please refer to fig. 2 (b), the face-shielding special effect setting page further includes a shielding effect pattern uploading entry 260, and when the electronic device determines a target shielding effect pattern set by the shielding effect pattern setting operation in response to the shielding effect pattern setting operation, and a user needs to add a target shielding image as a face shielding special effect to the live broadcast screen, the user can click the shielding effect pattern uploading entry 260 and select at least one target image as a target shielding image from the candidate image set, and perform uploading operation, thereby implementing an operation of uploading a picture of the shielding effect pattern uploading entry 260, which is input to the electronic device. And the electronic equipment responds to the picture uploading operation and takes the target shielding image uploaded by the user as a target shielding effect style. Therefore, when the electronic equipment detects that the face beautifying effect of the target object in the real-time live broadcast picture is lost, the electronic equipment can add the target shielding image into the real-time live broadcast picture so that the target shielding image covers the face area of the target object in the real-time live broadcast picture, and the face information of the target object is protected.

According to the technical scheme, the target object can set the face shielding special effect style in advance in a personalized manner, the target object can be shielded in the face area of the real-time live broadcast picture by adopting the target shielding image, and the difficulty of leakage of personal target information of the target object is improved.

In an exemplary embodiment, the setting operation of the face occlusion special effect further includes an occlusion effect strength setting operation, and the obtaining of the target face occlusion special effect associated with the target object in response to the occlusion special effect setting operation performed on the occlusion special effect setting page includes: responding to the setting operation of the shielding effect strength, and determining the target shielding effect strength set by the setting operation of the shielding effect strength; the target shielding effect strength is used for representing the shielding degree of the face shielding special effect on the face area of the target object in the real-time live broadcast picture; and taking the face shielding special effect matched with the target shielding effect strength as the target face shielding special effect.

The target shielding effect strength is used for representing the shielding degree of the face shielding special effect on the face area of the target object in the real-time live broadcast picture.

In practical application, the adjustment of the shielding effect strength supports transparency adjustment, strength adjustment and the like of the applied effect style according to types of different styles.

For example, if the occlusion effect pattern is blurred, the intensity of the occlusion effect corresponds to the degree of blurring; for another example, if the pattern of the blocking effect corresponds to a pop-up screen (or a similar covering effect of the blocking object), the intensity of the blocking effect corresponds to the transparency of the blocking object.

In the specific implementation, the electronic equipment sets the face shielding special effect setting operation in response to the face shielding special effect setting page, obtains the face shielding mode set by the face shielding special effect setting operation, can receive the shielding effect intensity setting operation input by a user, and determines the face shielding special effect matched with the target shielding effect intensity set by the shielding effect intensity setting operation as the target face shielding special effect by responding to the shielding effect intensity setting operation. Specifically, the electronic device may save the target occlusion effect strength as face occlusion special effect setting data. Therefore, the electronic equipment can quickly determine the preset target face shielding special effect of the target object based on the face shielding special effect setting data.

According to the technical scheme, the target shielding effect strength set by the shielding effect strength setting operation is determined by responding to the shielding effect strength setting operation, so that the shielding degree of the face shielding special effect can be set individually by the target object in advance, the shielding degree matched with the target shielding effect strength can be adopted to shield the face area of the target object in the real-time live broadcast picture in the follow-up face shielding special effect, and the difficulty of information leakage of the personal face of the target object is improved.

In an exemplary embodiment, the setting page of the face shielding special effect further includes a shielding effect intensity adjusting control, and in response to the setting operation of the shielding effect intensity, determining the target shielding effect intensity set by the setting operation of the shielding effect intensity includes: responding to the adjustment operation of the shielding effect strength adjustment control, and determining a target adjustment value corresponding to the adjustment operation; and taking the shielding effect strength represented by the target adjusting value as the target shielding effect strength.

In a specific implementation, please refer to fig. 2 (b), the face shielding special effect setting page further includes a shielding effect intensity adjusting control; the occlusion effect strength adjustment control may be an occlusion effect strength adjustment bar 240; the user can input the adjustment operation of the shielding effect intensity adjustment control to the electronic device by dragging the slider 250 in the shielding effect intensity adjustment bar 240; the electronic device can determine a target adjustment value corresponding to the adjustment operation according to the position of the sliding block 250; and finally, the electronic equipment takes the shielding effect strength represented by the target adjusting value as the target shielding effect strength.

For example, when the face occlusion style is "distorted," and the user drags the slider 250 in the occlusion effect strength adjustment bar 240 to 45%, and when the electronic device detects that the face beautification effect of the target object in the live broadcast frame is lost, the electronic device performs image distortion processing with a distortion degree of 25% on the face area of the target object in the live broadcast frame, so that the overlay image distortion processing effect covers the face area of the target object in the live broadcast frame.

According to the technical scheme, the target shielding effect intensity set by the shielding effect intensity setting operation is determined by responding to the shielding effect intensity setting operation, so that the user can quickly condition the shielding degree of the special shielding effect of the face part, and the operation efficiency of the user is improved.

Fig. 5 is a flowchart illustrating another live picture processing method according to an exemplary embodiment, as shown in fig. 5,

in step S502, in a case that the live object protection function is in an on state, a special effect loading effect of the target object in the real-time live frame is detected.

In specific implementation, after the electronic device acquires a real-time live broadcast picture, the electronic device recognizes a special effect loading effect of a target object in the real-time live broadcast picture. And the electronic equipment determines whether the special effect loading effect of the target object in the real-time live broadcast picture is in a failure state or not according to the detection result of the special effect loading effect.

In step S504, in a case where the effect of loading the special effect is in a failure state, determining a target face occlusion special effect associated with the target object; the target face shielding special effect is determined according to shielding special effect setting operation implemented in advance by the target object.

Specifically, when the electronic device determines that the special effect loading effect of the target object in the real-time live broadcast picture is in a failure state, the electronic device queries a face shielding setting parameter having an association relationship with the target object, and quickly determines a target face shielding special effect preset by the target object based on the face shielding setting parameter.

In step S506, adding a target face occlusion special effect to the live broadcast picture; the target face shielding special effect is used for covering the face area of the target object in the real-time live broadcast picture.

In the specific implementation, after the electronic device determines a preset target face shielding special effect of the target object, the electronic device adds the target face shielding special effect to the real-time live broadcast picture so that the target face shielding special effect covers the face area of the target object in the real-time live broadcast picture.

For example, when the electronic device determines that the target face-shielding special effect preset by the target object is that the face-shielding style is "distorted" based on the face-shielding setting parameter; face mask intensity is "50%"; the electronic device may add the face occlusion pattern as "distortion" in the live view; and the target face shielding special effect with the face shielding strength of 50% enables the target face shielding special effect to cover the face area of the target object in the real-time live broadcast picture.

According to the live broadcast picture processing method, under the condition that the special effect loading effect of the real-time live broadcast picture of the target object in the live broadcast activity process disappears due to some unexpected conditions, the electronic equipment can timely add the target face shielding special effect matched with the shielding special effect setting operation pre-implemented by the target object in the real-time live broadcast picture so as to cover the face area of the target object in the real-time live broadcast picture in a personalized manner, so that the target object does not need to take measures such as immediately pausing or closing a live broadcast room and the like, the target object can continuously send the live broadcast picture meeting the sharing requirement of the target object to the client side where the audience account of the target object is located, and therefore live broadcast transmission resources provided by a live broadcast platform can be effectively utilized.

In an exemplary embodiment, after the step of detecting the face processing effect of the target object in the real-time live screen, the method further comprises: under the condition that a target object does not exist in the real-time live broadcast picture, displaying an interactive game interface in the real-time live broadcast picture; the interactive game interface is used for implementing interactive operation for the target user account; the target user account is an audience account in a virtual space corresponding to the real-time live broadcast picture.

In specific implementation, after the step of detecting the face processing effect of the target object in the real-time live broadcast picture, the electronic device can also detect whether the target object exists in the real-time live broadcast picture in real time; when the electronic equipment detects that the target object does not exist in the real-time live broadcast picture, the target object is indicated to temporarily leave the live broadcast room, and at the moment, the electronic equipment can display an interactive game interface in the real-time live broadcast picture. And carrying out game interaction operation on audience accounts in the virtual space corresponding to the real-time live broadcast picture through the interactive game interface.

In practical application, the interactive game interface has a corresponding game type. The game content may be determined according to the live theme of the virtual space, and of course, the game content may also be determined in advance according to the interactive game setting operation of the target object.

According to the technical scheme, when the situation that the target object does not exist in the real-time live broadcast picture is detected, the interactive game interface is displayed in the real-time live broadcast picture, so that the situation that the target object temporarily leaves the live broadcast room can be realized, the audience account of the live broadcast room can continue to perform interactive operation in the live broadcast room, the audience account is prevented from leaving the live broadcast room, and the resource utilization rate of the live broadcast room is favorably improved.

Fig. 6 is a flowchart illustrating another live screen processing method, as used in an electronic device, according to an exemplary embodiment, and as shown in fig. 6, includes the following steps.

In step S602, in response to an opening operation of a target object for a live object protection function, displaying a blocking special effect setting page; the shielding special effect setting page comprises a shielding effect style setting control and a shielding effect strength adjusting control.

In step S604, at least two candidate occlusion effect styles are displayed in response to a trigger operation on the occlusion effect style setting control.

In step S606, in response to the selection operation of the candidate occlusion effect style, the candidate occlusion effect style selected by the selection operation is taken as the target occlusion effect style.

In step S608, in response to the adjustment operation on the adjustment control of the shielding effect intensity, a target adjustment value corresponding to the adjustment operation is determined, and the shielding effect intensity represented by the target adjustment value is used as the target shielding effect intensity.

In step S610, the face occlusion special effect matching the target occlusion effect pattern and the target occlusion effect pattern is used as the target face occlusion special effect associated with the target object.

In step S612, a special effect loading effect of the target object in the live broadcast screen is detected.

In step S614, in the case where the effect of loading the special effect is in the failure state, it is determined that the target face associated with the target object blocks the special effect.

In step S616, a target face occlusion special effect is added to the live broadcast frame; the target face shielding special effect is used for covering the face area of the target object in the real-time live broadcast picture.

In step S618, in a case that it is detected that the target object does not exist in the live view, displaying an interactive game interface in the live view; the interactive game interface is used for implementing interactive operation for the target user account; the target user account is an audience account in a virtual space corresponding to the real-time live broadcast picture.

It should be noted that, for the specific limitations of the above steps, reference may be made to the above specific limitations of a live view processing method, and details are not described herein again.

To facilitate understanding by those skilled in the art, fig. 7 also exemplarily provides a timing diagram of a live picture processing method; referring to fig. 7, including the anchor side, the processing side and the viewer side; the processing end at least comprises a business logic unit, a storage unit and a beautifying unit.

The anchor terminal can be a client terminal for enabling an anchor user account to open a live broadcast room; the target object can start the live broadcast object protection function through the live broadcast end setting; the target object can be provided with a face beautifying function through the live broadcast end; the live broadcast end is used for displaying a face beautifying effect in the current virtual space.

And the service logic unit is used for processing service interaction logic, can respond to the setting operation of the anchor terminal, and is connected with the storage unit and the beautifying unit.

The storage unit is used for storing the setting configuration data (namely the face shielding effect data) generated by the face shielding special effect setting operation of the target object.

And the beautifying unit is used for detecting the target object in the real-time live broadcast picture. And under the condition that the target object in the real-time live broadcast picture is successfully detected, the beautifying unit performs face beautifying processing on the target object in the real-time live broadcast picture. And under the condition that the special effect loading effect of the target object in the real-time live broadcast picture is detected to be in a failure state, the beautifying unit adds the target face shielding special effect to the real-time live broadcast picture based on the face shielding effect data so as to protect the face information of the target object.

The audience may refer to a client where an audience account associated with the anchor account is located. The viewer end can display the real-time live broadcast picture.

It should be noted that, for the specific limitations of the above steps, reference may be made to the above specific limitations of a live view processing method, which is not described herein again.

It should be understood that although the steps in the flowcharts of fig. 1, 5 and 6 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 1, 5 and 6 may include multiple steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, which are not necessarily performed in sequence, but may be performed alternately or alternately with other steps or at least some of the other steps.

It is understood that the same/similar parts between the embodiments of the method described above in this specification can be referred to each other, and each embodiment focuses on the differences from the other embodiments, and it is sufficient that the relevant points are referred to the descriptions of the other method embodiments.

Fig. 8 is a block diagram illustrating a live screen processing apparatus according to an exemplary embodiment. Referring to fig. 8, the apparatus includes:

a display unit 810 configured to perform an opening operation for a live object protection function in response to a target object, and display an occlusion special effect setting page;

a setting unit 820 configured to perform an occlusion special effect setting operation in response to the occlusion special effect setting page, to obtain a target face occlusion special effect associated with the target object;

In one possible implementation, the occlusion special effect setting operation comprises an occlusion effect pattern setting operation, and the setting unit 820 is specifically configured to execute determining a target occlusion effect pattern set by the occlusion effect pattern setting operation in response to the occlusion effect pattern setting operation; and taking the face shielding special effect matched with the target shielding effect pattern as the target face shielding special effect.

In a possible implementation manner, the occlusion special effect setting page includes an occlusion effect style setting control, and the setting unit 820 is specifically configured to execute a trigger operation performed in response to the occlusion effect style setting control, and display at least two candidate occlusion effect styles; in response to a selection operation on the candidate occlusion effect pattern, taking the candidate occlusion effect pattern selected by the selection operation as the target occlusion effect pattern.

In a possible implementation manner, the occlusion special effect setting page further includes an occlusion effect pattern uploading entry, and the setting unit 820 is specifically configured to execute, in response to a picture uploading operation on the occlusion effect pattern uploading entry, determining a target occlusion image uploaded by the picture uploading operation; and taking the target occlusion image as the target occlusion effect pattern.

In a possible implementation manner, the occlusion special effect setting operation further includes an occlusion effect strength setting operation, and the setting unit 820 is specifically configured to execute, in response to the occlusion effect strength setting operation, determining a target occlusion effect strength set by the occlusion effect strength setting operation; the target shielding effect strength is used for representing the shielding degree of the face shielding special effect on the face area of the target object in the real-time live broadcast picture; and taking the face shielding special effect matched with the target shielding effect strength as the target face shielding special effect.

In a possible implementation manner, the occlusion special effect setting page further includes an occlusion effect strength adjustment control, and the setting unit 820 is specifically configured to execute an adjustment operation in response to the occlusion effect strength adjustment control, and determine a target adjustment value corresponding to the adjustment operation; and taking the shielding effect strength represented by the target adjusting value as the target shielding effect strength.

Fig. 9 is a block diagram illustrating a live screen processing apparatus according to an exemplary embodiment. Referring to fig. 9, the apparatus includes:

a detecting unit 910 configured to detect a special effect loading effect of a target object in a live broadcast screen in a case that a live broadcast object protection function is in an on state;

a determining unit 920 configured to determine a target face occlusion special effect associated with the target object if the special effect loading effect is in a failure state; the target face shielding special effect is determined according to shielding special effect setting operation implemented in advance by the target object;

an occlusion unit 930 configured to perform adding the target face occlusion special effect in the live view; the target face shielding special effect is used for covering a face area of the target object in the real-time live broadcast picture.

In one possible implementation, the apparatus is further configured to perform, in a case where it is detected that the target object does not exist in the live view, displaying an interactive game interface in the live view; the interactive game interface is used for implementing interactive operation for the target user account; and the target user account is an audience account in a virtual space corresponding to the real-time live broadcast picture.

With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.

Fig. 10 is a block diagram illustrating an electronic device 1000 for performing a live screen processing method according to an exemplary embodiment. For example, the electronic device 1000 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a gaming console, a tablet device, a medical device, a fitness device, a personal digital assistant, and so forth.

Referring to fig. 10, electronic device 1000 may include one or more of the following components: processing component 1002, memory 1004, power component 1006, multimedia component 1008, audio component 1010, interface to input/output (I/O) 1012, sensor component 1014, and communications component 1016.

The processing component 1002 generally controls the overall operation of the electronic device 1000, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 1002 may include one or more processors 1020 to execute instructions to perform all or a portion of the steps of the methods described above. Further, processing component 1002 may include one or more modules that facilitate interaction between processing component 1002 and other components. For example, the processing component 1002 may include a multimedia module to facilitate interaction between the multimedia component 1008 and the processing component 1002.

The memory 1004 is configured to store various types of data to support operations at the electronic device 1000. Examples of such data include instructions for any application or method operating on the electronic device 1000, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 1004 may be implemented by any type or combination of volatile or non-volatile storage devices, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, optical disk, or graphene memory.

The power supply component 1006 provides power to the various components of the electronic device 1000. The power components 1006 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the electronic device 1000.

The multimedia component 1008 includes a screen that provides an output interface between the electronic device 1000 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 1008 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the electronic device 1000 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

The audio component 1010 is configured to output and/or input audio signals. For example, the audio component 1010 includes a Microphone (MIC) configured to receive external audio signals when the electronic device 1000 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal may further be stored in the memory 1004 or transmitted via the communication component 1016. In some embodiments, audio component 1010 also includes a speaker for outputting audio signals.

I/O interface 1012 provides an interface between processing component 1002 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.

The sensor assembly 1014 includes one or more sensors for providing various aspects of status assessment for the electronic device 1000. For example, the sensor assembly 1014 may detect an open/closed state of the electronic device 1000, the relative positioning of components, such as a display and keypad of the electronic device 1000, the sensor assembly 1014 may also detect a change in the position of the electronic device 1000 or components of the electronic device 1000, the presence or absence of user contact with the electronic device 1000, orientation or acceleration/deceleration of the device 1000, and a change in the temperature of the electronic device 1000. The sensor assembly 1014 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 1014 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 1014 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 1016 is configured to facilitate wired or wireless communication between the electronic device 1000 and other devices. The electronic device 1000 may access a wireless network based on a communication standard, such as WiFi, an operator network (such as 2G, 3G, 4G, or 5G), or a combination thereof. In an exemplary embodiment, the communication component 1016 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communications component 1016 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the electronic device 1000 may be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors, or other electronic components for performing the above-described methods.

In an exemplary embodiment, a computer-readable storage medium comprising instructions, such as the memory 1004 comprising instructions, executable by the processor 1020 of the electronic device 1000 to perform the above-described method is also provided. For example, the computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

In an exemplary embodiment, a computer program product is also provided, which includes instructions executable by the processor 1020 of the electronic device 1000 to perform the above-described method.

It should be noted that the descriptions of the above apparatus, the electronic device, the computer-readable storage medium, the computer program product, and the like according to the method embodiments may also include other embodiments, and specific implementation manners may refer to the descriptions of the related method embodiments, which are not described in detail herein.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It will be understood that the present disclosure is not limited to the precise arrangements that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A live broadcast picture processing method is characterized by comprising the following steps:

responding to the starting operation of the target object for the live broadcast object protection function, and displaying a shielding special effect setting page;

2. The live view processing method according to claim 1, wherein the occlusion special effect setting operation includes an occlusion effect style setting operation, and the obtaining of the target face occlusion special effect associated with the target object in response to the occlusion special effect setting operation performed on the occlusion special effect setting page includes:

3. The live view processing method according to claim 2, wherein the occlusion special effect setting page includes an occlusion effect style setting control, and the determining, in response to the occlusion effect style setting operation, a target occlusion effect style set by the occlusion effect style setting operation includes:

4. The live view processing method according to claim 2, wherein the occlusion effect setting page further includes an occlusion effect pattern upload entry, and the determining, in response to the occlusion effect pattern setting operation, the target occlusion effect pattern set by the occlusion effect pattern setting operation includes:

and taking the target occlusion image as the target occlusion effect pattern.

5. The live view processing method according to claim 1, wherein the occlusion effect setting operation further includes an occlusion effect strength setting operation, and the obtaining of the target face occlusion effect associated with the target object in response to the occlusion effect setting operation performed on the occlusion effect setting page includes:

6. The live view processing method according to claim 5, wherein the occlusion special effect setting page further includes an occlusion effect strength adjustment control, and the determining the target occlusion effect strength set by the occlusion effect strength setting operation in response to the occlusion effect strength setting operation includes:

responding to the adjustment operation of the shielding effect intensity adjustment control, and determining a target adjustment value corresponding to the adjustment operation;

7. A live broadcast picture processing method is characterized by comprising the following steps:

8. The method for processing a live view of claim 7, further comprising:

9. A live-view picture processing apparatus, comprising:

10. A live view processing apparatus, comprising:

an occlusion unit configured to perform addition of the target face occlusion special effect in the live broadcast screen; the target face shielding special effect is used for covering a face area of the target object in the real-time live broadcast picture.

11. An electronic device, comprising:

a processor;

a memory for storing the processor-executable instructions;

wherein the processor is configured to execute the instructions to implement the live-view processing method of any of claims 1 to 8.

12. A computer-readable storage medium, wherein instructions in the computer-readable storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the live view processing method of any of claims 1-8.