CN108712273B

CN108712273B - Picture publishing method based on anchor client triggering

Info

Publication number: CN108712273B
Application number: CN201810551339.9A
Authority: CN
Inventors: 向敏明
Original assignee: Xi'an Yule Cultural Technology Co ltd
Current assignee: XI'AN YULE CULTURAL TECHNOLOGY Co.,Ltd.
Priority date: 2018-05-31
Filing date: 2018-05-31
Publication date: 2021-01-01
Anticipated expiration: 2038-05-31
Also published as: CN108712273A

Abstract

A picture publishing method based on anchor client triggering comprises the following steps: the method comprises the steps that a live broadcast server obtains a privacy picture and a non-privacy picture reported by a anchor client, the non-privacy picture is pushed to all audience client sides in a channel to be displayed, a first preset mark is loaded beside the position where the non-privacy picture is displayed by each high-level audience client side in the channel, if the first preset mark loaded by a target high-level audience client side is selected, an audience user authentication sound signal reported by the target high-level audience client side and an anchor user sound signal pre-configured for an anchor user privacy picture service by an anchor user are synthesized to obtain a synthesized sound signal, when the synthesized sound signal is matched with a verification sound signal synthesized by the live broadcast server for the target high-level audience client side when the anchor user privacy picture service is signed by the target high-level audience client side, the privacy picture is pushed to the target high-level audience client side to cover the non-privacy picture, the viewing range of the privacy pictures is effectively controlled.

Description

Picture publishing method based on anchor client triggering

Technical Field

The invention relates to the technical field of internet, in particular to a picture publishing method based on anchor client triggering.

Background

When the anchor user performs live broadcast to each audience client in the channel where the anchor client is located through the anchor client, the anchor user can also issue pictures to each audience client in the channel where the anchor client is located through the anchor client. In practice, it has been found that when an anchor user issues pictures to each viewer client in a channel where the anchor client is located through the anchor client, the pictures issued by the anchor user are watched by the viewer user belonging to each viewer client in the channel. However, in some scenarios, the anchor user may want the picture published by the anchor user to be viewed only by the audience users belonging to a part of audience clients in the channel, for example, when the picture published by the anchor user is a private picture, the anchor user typically wants the private picture to be viewed only by the audience users belonging to a part of audience clients in the channel, and the audience users belonging to the rest of audience clients cannot view the private picture, so as to control the viewing range of the private picture.

Disclosure of Invention

The embodiment of the invention discloses a picture publishing method based on anchor client triggering, which can effectively control the viewing range of private pictures.

The picture publishing method based on the trigger of the anchor client comprises the following steps:

the anchor client acquires a privacy picture and a non-privacy picture which need to be issued by an anchor user to which the anchor client belongs, and reports the privacy picture and the non-privacy picture to a live broadcast server;

the live broadcast server identifies a first client set and a second client set from a channel where the anchor client is located; the first client set comprises all low-level audience clients which are not signed with the anchor user privacy picture service in the channel; the second client set comprises all high-level audience clients which have signed up the private picture service of the anchor user in the channel;

after synchronously pushing the non-privacy pictures to the low-level audience clients included in the first client set and the high-level audience clients included in the second client set by the live broadcast server for display, respectively loading first preset marks beside the positions where the non-privacy pictures are displayed by the high-level audience clients; the first preset mark is used for triggering to watch the privacy picture to be published;

the live broadcast server acquires a privacy picture watching request reported by any one target high-level audience client in the high-level audience clients, wherein the privacy picture watching request is reported to the live broadcast server by the target high-level audience client when detecting that the first preset mark loaded beside the position of the target high-level audience client for displaying the non-privacy picture is selected;

the live broadcast server pushes prompt information to the target high-level audience client, wherein the prompt information is used for prompting the target high-level audience client to collect and report audience user authentication sound signals sent by audience users to which the target high-level audience client belongs;

the live broadcast server synthesizes the audience user authentication sound signal and a anchor user sound signal pre-configured by the anchor user for the anchor user privacy picture service to obtain a synthesized sound signal;

the live broadcast server judges whether the synthesized sound signal is matched with a verification sound signal synthesized by the live broadcast server for the target high-level audience client when the target high-level audience client signs the anchor user privacy picture service, and if the synthesized sound signal is matched with the verification sound signal, the privacy picture is pushed to the target high-level audience client so that the target high-level audience client covers the non-privacy picture by using the privacy picture;

and after the target high-level audience client covers the non-privacy picture by using the privacy picture, the live broadcast server changes the loaded first preset mark beside the position where the target high-level audience client displays the privacy picture into a second preset mark, wherein the second preset mark is used for triggering and hiding the privacy picture.

As an optional implementation manner, in an embodiment of the present invention, the method further includes:

after changing the first preset mark loaded beside the position of the target high-level audience client for displaying the privacy picture into a second preset mark, the live broadcast server detects and acquires a privacy picture hiding request reported by the target high-level audience client, wherein the privacy picture hiding request is reported to the live broadcast server by the target high-level audience client when detecting that the second preset mark loaded beside the position of the target high-level audience client for displaying the privacy picture is selected;

the live broadcast server pushes a privacy picture removing instruction to the target high-level audience client so that the target high-level audience client removes the privacy pictures covering the non-privacy pictures according to the privacy picture removing instruction to redisplay the non-privacy pictures;

and after the target high-level audience client redisplays the non-privacy picture, the live broadcast server changes the second preset mark loaded beside the position where the target high-level audience client displays the non-privacy picture back to the first preset mark.

after the live broadcast server changes the second preset mark loaded beside the position of the target high-grade audience client side for displaying the non-privacy picture back to the first preset mark, the live broadcast server acquires a single virtual asset consumption value pre-configured for the privacy picture service of the anchor user by the anchor user; the single virtual asset consumption value is a virtual asset consumption value consumed by a spectator user belonging to any high-level spectator client when watching a primary user privacy picture;

and the live broadcast server deducts the single virtual asset consumption value from the audience virtual account corresponding to the target high-level audience client, and adds the deducted single virtual asset consumption value to the anchor virtual account of the anchor client.

As an optional implementation manner, in an embodiment of the present invention, after the live broadcast server obtains a private picture viewing request reported by any one target high-level viewer client in the high-level viewer clients, and before the live broadcast server pushes prompt information to the target high-level viewer client, the method further includes:

the live broadcast server pushes first inquiry information and the single virtual asset consumption value pre-configured by the anchor user for the anchor user privacy picture service to the target high-level audience client; the first inquiry information is used for inquiring whether the audience user to which the target high-level audience client belongs still needs to watch the privacy picture of the anchor user;

and if the live broadcast server receives response information which is reported by the target high-level audience client and confirms that the user still needs to watch the privacy picture of the anchor user, the live broadcast server executes the step of pushing the prompt information to the target high-level audience client.

As an optional implementation manner, in an embodiment of the present invention, before the live broadcast server obtains the private picture viewing request reported by any one target high-level viewer client in each high-level viewer client, the method further includes:

the live broadcast server acquires a service signing request which is reported by the target high-level audience client and is used for signing the private picture service of the anchor user;

the live broadcast server pushes indication information to the target high-level audience client according to the service signing request, wherein the indication information is used for indicating the target high-level audience client to collect and report audience user registration sound signals sent by audience users to which the target high-level audience client belongs;

the live broadcast server synthesizes the audience user registration sound signal and a anchor user sound signal which is pre-configured by the anchor user for the anchor user privacy picture service to obtain a verification sound signal; the verification sound signal is a verification sound signal synthesized by the live broadcast server for the target high-level audience client when the target high-level audience client signs the anchor user privacy picture service;

and the live broadcast server records the signing relation between the target high-grade audience client and the business of watching the private pictures of the anchor user so as to finish the signing of the business of watching the private pictures of the anchor user.

As an optional implementation manner, in an embodiment of the present invention, the service subscription request further includes a client level of the target high-level viewer client, and before the live broadcast server pushes indication information to the target high-level viewer client according to the service subscription request, the method further includes:

the live broadcast server reads the client grade of the target high-grade audience client from the service signing request;

and the live broadcast server judges whether the client grade of the target high-grade audience client is higher than a specified grade, and if so, executes the step of pushing the indication information to the target high-grade audience client according to the service signing request.

As an optional implementation manner, in an embodiment of the present invention, after the live broadcast server records a subscription relationship between the target high-level viewer client and the anchor user private picture service, the method further includes:

the live broadcast server determines a service virtual asset value corresponding to the client grade of the target high-grade audience client based on the client grade of the target high-grade audience client; wherein, the higher the client grade of the target high-grade audience client is, the smaller the service virtual asset value is; conversely, the lower the client level of the target high-level viewer client, the greater the service virtual asset value;

and the live broadcast server deducts the service virtual asset value from the audience virtual account corresponding to the target high-level audience client, and adds the deducted service virtual asset value to the service virtual account corresponding to the live broadcast server.

As an optional implementation manner, in an embodiment of the present invention, after the live broadcast server obtains a service subscription request for subscribing the private picture service of the anchor user, which is reported by the target high-level viewer client, and before the live broadcast server pushes indication information to the target high-level viewer client according to the service subscription request, the method further includes:

the live broadcast server pushes second inquiry information and the service virtual asset value to the target high-level audience client; the service virtual asset value is a service virtual asset value which needs to be received when the live broadcast server executes subscription for watching the anchor user privacy picture service each time, and the second inquiry information is used for inquiring whether a viewer user belonging to the target high-level viewer client still needs to subscribe the anchor user privacy picture service;

and if the live broadcast server receives the confirmation that the anchor user privacy picture service still needs to be signed, which is reported by the target high-level audience client, the live broadcast server executes the step of pushing the indication information to the target high-level audience client according to the service signing request.

As an optional implementation manner, in an embodiment of the present invention, the synthesizing, by the live broadcast server, the audience user registration sound signal and a anchor user sound signal pre-configured by the anchor user for the anchor user privacy picture service to obtain a verification sound signal includes:

the live broadcast server determines an alignment point between the audience user registration sound signal and a anchor user sound signal pre-configured by the anchor user for the anchor user privacy picture service; wherein, the alignment point refers to the starting position of the synthesis of the audience user registration voice signal and the anchor user voice signal;

and the live broadcast server synthesizes the audience user registration sound signal and the anchor user sound signal into a verification sound signal according to the alignment point.

As an optional implementation manner, in an embodiment of the present invention, the determining, by the live broadcast server, whether the synthesized sound signal matches a verification sound signal synthesized by the live broadcast server for the target high-level viewer client when the target high-level viewer client subscribes to the anchor user privacy picture service includes:

the live broadcast server judges whether the alignment points between the synthesized sound signals and verification sound signals synthesized by the live broadcast server for the target high-level audience client are the same when the target high-level audience client signs the anchor user privacy picture service;

if the two multi-dimensional vectors are the same, the live broadcast server judges whether a first multi-dimensional vector corresponding to the voiceprint feature of the synthesized voice signal is matched with a second multi-dimensional vector corresponding to the voiceprint feature of the verified voice signal, and if the two multi-dimensional vectors are matched, the synthesized voice signal is matched with the verified voice signal; if not, determining that the synthesized voice signal does not match the verification voice signal;

the first multi-dimensional vector corresponding to the voiceprint feature of the synthetic sound signal is composed of a mel-frequency cepstrum coefficient, a linear prediction cepstrum coefficient, a first order difference of the mel-frequency cepstrum coefficient, a first order difference of the linear prediction cepstrum coefficient, energy, a first order difference of the energy and a Gammatone filter cepstrum coefficient.

In the embodiment of the invention, the anchor client can report the private picture and the non-private picture to the live broadcast server together, the live broadcast server synchronously pushes the non-private picture to all the audience clients in the channel to be displayed, then, a first preset mark is further loaded beside the position where each high-level audience client in the channel displays the non-private picture, when the first preset mark loaded beside the position where any one target high-level audience client in each high-level audience client displays the non-private picture is selected, the live broadcast server synthesizes an audience user authentication sound signal sent by an audience user belonging to the target high-level audience client and an anchor user sound signal which is configured by the anchor user for the anchor user private picture service and is collected and reported by the target high-level audience client, so as to obtain a synthesized sound signal, when the synthesized sound signal is matched with a verification sound signal synthesized by the live broadcast server for the target high-level audience client when the target high-level audience client signs the anchor user privacy picture service, the privacy picture is pushed to the target high-level audience client, so that the target high-level audience client covers the non-privacy picture by using the privacy picture, and the viewing range of the privacy picture is effectively controlled.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without creative efforts.

Fig. 1 is a schematic diagram of a network architecture according to an embodiment of the present invention;

fig. 2 is a schematic flowchart of a picture publishing method triggered by a anchor client according to an embodiment of the present invention;

fig. 3 is a schematic flowchart of another method for publishing pictures based on anchor client triggering according to an embodiment of the present invention;

fig. 4 is a schematic flowchart of another picture publishing method based on anchor client triggering according to an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

It should be noted that the terms "comprises" and "comprising," and any variations thereof, of embodiments of the present invention are intended to cover non-exclusive inclusions, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

The embodiment of the invention discloses a picture publishing method based on anchor client triggering, which can effectively control the viewing range of private pictures. The following detailed description is made with reference to the accompanying drawings.

In order to better understand the picture publishing method triggered by the anchor client disclosed in the embodiment of the present invention, a network architecture suitable for the embodiment of the present invention is described below. Referring to fig. 1, fig. 1 is a schematic diagram of a network architecture according to an embodiment of the present invention. As shown in fig. 1, the network architecture may include a live server and a plurality of clients, where the live server is also referred to as a background server, a group anchor server, a component server, and the like, and the live server may be in communication connection with the plurality of clients through the internet. In the network architecture shown in fig. 1, one of the clients may serve as a main broadcasting client, and the rest of the clients may serve as viewer clients accessing the channel on which the main broadcasting client is located. In the embodiment of the present invention, a channel is simply a virtual space (or virtual room) created by the anchor client or created for the anchor client by the channel management platform, and the audience client located in the virtual space can not only watch the live content of the anchor client, but also interact with the anchor client in a voice or text manner. The master control client has access and kicking control right for the audience client accessing the channel, and also has a direct broadcast initiative right. In the network architecture shown in fig. 1, the audience clients in the channel where the anchor client is located may be divided into a low-level audience client and a high-level audience client, for example, the low-level audience client may be an audience client that does not subscribe to the anchor user privacy picture service, and the high-level audience client may be an audience client that has subscribed to the anchor user privacy picture service; alternatively, the low-level viewer client may be a non-member viewer client in the channel where the anchor client is located, and the high-level viewer client may be a member viewer client in the channel where the anchor client is located; or, the low-level audience client can be an audience client temporarily accessed in the channel where the anchor client is located, and the high-level audience client can be an audience client which is accessed in the channel where the anchor client is located for a long time; or, the low-level audience client may be an audience client whose number of gifts given to the anchor user is less than the specified number in the channel where the anchor client is located, and the high-level audience client may be an audience client whose number of gifts given to the anchor user is greater than the specified number in the channel where the anchor client is located, which is not limited in the embodiment of the present invention. In the network architecture shown in fig. 1, the anchor client and the viewer client may run on user devices including, but not limited to, a mobile phone, a mobile computer, a tablet computer, a Personal Digital Assistant (PDA), a media player, a smart television, a smart watch, smart glasses, a smart bracelet, and the like.

Referring to fig. 2, fig. 2 is a schematic flow chart illustrating a picture publishing method based on anchor client triggering according to an embodiment of the present invention. As shown in fig. 2, the method for publishing pictures based on the trigger of the anchor client may include the following steps:

201. the anchor client acquires the privacy pictures and the non-privacy pictures which need to be issued by the anchor user to which the anchor client belongs.

In the embodiment of the invention, an anchor user to which an anchor client belongs can click a picture publishing button on an interactive interface of the anchor client to input a picture publishing instruction to the anchor client, and correspondingly, the anchor client can respond to the picture publishing instruction to pop up a picture importing interface, wherein the picture importing interface can comprise a privacy picture importing port and a non-privacy picture importing port; further, the anchor client may detect a private picture imported by the anchor user through the private picture import, and detect a non-private picture imported by the anchor user through the non-private picture import.

As an optional implementation manner, after an anchor user to which an anchor client belongs may click a picture publishing button on an interactive interface of the anchor client to input a picture publishing instruction to the anchor client, and before the anchor client pops up a picture importing interface in response to the picture publishing instruction, the method may further include:

the anchor client captures a first portrait corresponding to an anchor user through a camera device;

the anchor client judges whether a face image contained in a first person image corresponding to an anchor user is matched with a face image contained in a second person image corresponding to a specified anchor pre-configured by the anchor client;

if the face image contained in the first portrait corresponding to the anchor user is matched with the face image contained in the second portrait corresponding to the appointed anchor and configured in advance by the anchor client, the anchor client performs forward calculation on the first portrait by using a portrait attribute algorithm to obtain attribute information of the first portrait;

the anchor client judges whether the attribute information of the first portrait is matched with the attribute information of a second portrait corresponding to a designated anchor pre-configured by the anchor client;

and if the attribute information of the first portrait is matched with the attribute information of a second portrait corresponding to the appointed anchor preset by the anchor client, the anchor client responds to the picture issuing instruction to pop up a picture importing interface.

The portrait attribute algorithm is obtained by training recognition results of a plurality of attribute information based on a plurality of sample portrait images and a plurality of sample portrait images according to different types of the attribute information; wherein the attribute information includes age, sex and height

In the embodiment of the invention, the portrait attribute algorithm is obtained by training in the following way:

the anchor client reads pre-recorded sample portrait data, wherein each sample portrait data comprises a sample portrait image and a plurality of attribute information of the sample portrait image;

the anchor client extracts portrait characteristics from a pre-recorded sample portrait image;

the anchor client calculates the portrait characteristics of each sample portrait image forward according to the submodels corresponding to different attribute information in the initial model to obtain the predicted values of a plurality of attribute information of each sample portrait image;

the anchor client calculates the loss of a plurality of attribute information according to the predicted values and the values of the attribute information and different types of the attribute information;

the anchor client sums the losses of the attribute information to obtain the total loss of the attribute information;

the anchor client adjusts parameters of the submodels corresponding to different attribute information in the initial model until the adjusted parameters enable the total loss of the attribute information to be smaller than or equal to a preset threshold value, and the adjustment is stopped to obtain a portrait attribute algorithm;

the method for calculating the loss of the attribute information by the anchor client according to the predicted value and the value of the attribute information and different types of the attribute information comprises the following steps:

for each attribute information in the attribute information, if the attribute information is a regression attribute, the anchor client calculates the predicted value of the attribute information and the value of the attribute information according to the following formula to obtain the loss of the attribute information:

wherein s represents the number of the attribute information in the plurality of attribute information,

representing the predicted values calculated by the initial model,

and L represents a loss corresponding to the attribute information.

Or, the anchor client calculates the loss of the plurality of attribute information according to the predicted values and the values of the attribute information and different types of the attribute information, and the method comprises the following steps:

for each attribute information in the attribute information, if the attribute information is not a regression attribute, the anchor client calculates a prediction vector and an attribute information vector of the attribute information according to the following formula to obtain the loss of the attribute information:

wherein s represents the number of the attribute information in the plurality of attribute information, x represents the value of the attribute information, q represents the predicted value calculated by the initial model, d represents the number of the identification results of the attribute information, h represents the identifier of the identification result of the attribute information, and L represents the loss corresponding to the attribute information.

By implementing the embodiment, the anchor client can pop up the picture importing interface when accurately judging that the anchor user who inputs the picture publishing instruction to the anchor client is the appointed anchor preset by the anchor client, so as to import the privacy picture and the non-privacy picture which need to be published, thereby preventing other non-appointed anchors from maliciously publishing the privacy picture and the non-privacy picture.

202. And the anchor client reports the private pictures and the non-private pictures to the live broadcast server.

In the embodiment of the invention, before the anchor client reports the private picture and the non-private picture to the live broadcast server, the anchor client can traverse each pixel of the private picture and detect whether the color of the pixel is the skin color; the anchor client can classify the adjacent skin color pixels into a skin area to obtain a plurality of skin areas; and the anchor client can judge whether the ratio of the area of the maximum skin area in the skin areas to the total skin area exceeds a specified threshold value, if not, the privacy picture is not a pornographic picture, and at the moment, the anchor client can report the privacy picture and the non-privacy picture to the live broadcast server.

203. The method comprises the steps that a live broadcast server identifies a first client set and a second client set from a channel where a main broadcast client is located; the first client set comprises all low-level audience clients which are not signed with the anchor user privacy picture service in the channel; the second set of clients includes high-level viewer clients in the channel that have subscribed to the anchor user privacy picture service.

204. And the live broadcast server synchronously pushes the non-privacy pictures to all the low-level audience clients included in the first client set and all the high-level audience clients included in the second client set for display.

205. And the live broadcast server loads a first preset mark beside the position where the non-privacy pictures are displayed by each high-level audience client respectively, wherein the first preset mark is used for triggering the watching of the privacy pictures.

206. The method comprises the steps that a live broadcast server obtains a privacy picture watching request reported by any one target high-grade audience client in all high-grade audience clients, wherein the privacy picture watching request is reported to the live broadcast server when the target high-grade audience client detects that a first preset mark loaded beside a position where the target high-grade audience client displays a non-privacy picture is selected.

207. And the live broadcast server pushes prompt information to the target high-level audience client, wherein the prompt information is used for prompting the target high-level audience client to acquire and report audience user authentication sound signals sent by audience users to which the target high-level audience client belongs.

208. And the live broadcast server synthesizes the audience user authentication sound signal and the anchor user sound signal pre-configured by the anchor user for the anchor user privacy picture service to obtain a synthesized sound signal.

209. And the live broadcast server judges whether the synthesized sound signal is matched with a verification sound signal synthesized by the live broadcast server for the target high-grade audience client when the target high-grade audience client signs the anchor user privacy picture service, and if so, the privacy picture is pushed to the target high-grade audience client so that the target high-grade audience client covers the non-privacy picture by using the privacy picture.

If the synthesized sound signal is judged not to be matched with the verification sound signal synthesized by the live broadcast server for the target high-level audience client when the target high-level audience client signs the anchor user privacy picture service, the process is ended.

Wherein the matching of the synthesized sound signal to the verification sound signal may include matching the synthesized sound signal to the verification sound signal at the same alignment point, and matching a first multi-dimensional vector corresponding to the voiceprint feature of the synthesized sound signal to a second multi-dimensional vector corresponding to the voiceprint feature of the verification sound signal.

The first multi-dimensional vector corresponding to the voiceprint features of the synthesized sound signal is composed of a Mel frequency cepstrum coefficient, a linear prediction cepstrum coefficient, a first order difference of the Mel frequency cepstrum coefficient, a first order difference of the linear prediction cepstrum coefficient, a first order difference of energy and a Gammatone filter cepstrum coefficient.

210. And after the target high-level audience client side covers the non-privacy picture by using the privacy picture, the live broadcast server changes the loaded first preset mark beside the position where the target high-level audience client side displays the privacy picture into a second preset mark, wherein the second preset mark is used for triggering and hiding the privacy picture.

Therefore, the method described in fig. 2 can be implemented to effectively control the viewing range of the private picture; moreover, other non-designated anchor can be prevented from maliciously publishing the private pictures and the non-private pictures.

Referring to fig. 3, fig. 3 is a schematic flow chart of another picture publishing method based on anchor client triggering according to an embodiment of the present invention. As shown in fig. 3, the method for publishing pictures based on the trigger of the anchor client may include the following steps:

301. the anchor client acquires the privacy pictures and the non-privacy pictures which need to be issued by the anchor user to which the anchor client belongs.

302. And the anchor client reports the private pictures and the non-private pictures to the live broadcast server.

303. The method comprises the steps that a live broadcast server identifies a first client set and a second client set from a channel where a main broadcast client is located; the first client set comprises all low-level audience clients which are not signed with the anchor user privacy picture service in the channel; the second set of clients includes high-level viewer clients in the channel that have subscribed to the anchor user privacy picture service.

304. And the live broadcast server synchronously pushes the non-privacy pictures to all the low-level audience clients included in the first client set and all the high-level audience clients included in the second client set for display.

305. And the live broadcast server loads a first preset mark beside the position where the non-privacy pictures are displayed by each high-level audience client respectively, wherein the first preset mark is used for triggering the watching of the privacy pictures.

306. The method comprises the steps that a live broadcast server obtains a privacy picture watching request reported by any one target high-grade audience client in all high-grade audience clients, wherein the privacy picture watching request is reported to the live broadcast server when the target high-grade audience client detects that a first preset mark loaded beside a position where the target high-grade audience client displays a non-privacy picture is selected.

307. And the live broadcast server pushes prompt information to the target high-level audience client, wherein the prompt information is used for prompting the target high-level audience client to acquire and report audience user authentication sound signals sent by audience users to which the target high-level audience client belongs.

308. And the live broadcast server synthesizes the audience user authentication sound signal and the anchor user sound signal pre-configured by the anchor user for the anchor user privacy picture service to obtain a synthesized sound signal.

309. And the live broadcast server judges whether the synthesized sound signal is matched with a verification sound signal synthesized by the live broadcast server for the target high-grade audience client when the target high-grade audience client signs the anchor user privacy picture service, and if so, the privacy picture is pushed to the target high-grade audience client so that the target high-grade audience client covers the non-privacy picture by using the privacy picture.

310. And after the target high-level audience client side covers the non-privacy picture by using the privacy picture, the live broadcast server changes the loaded first preset mark beside the position where the target high-level audience client side displays the privacy picture into a second preset mark, wherein the second preset mark is used for triggering and hiding the privacy picture.

311. The method comprises the steps that a live broadcast server obtains a privacy picture hiding request reported by a target high-grade audience client, wherein the privacy picture hiding request is reported to the live broadcast server by the target high-grade audience client when the target high-grade audience client detects that a second preset mark loaded beside a position where the target high-grade audience client displays a privacy picture is selected.

312. And the live broadcast server pushes a privacy picture removing instruction to the target high-level audience client so that the target high-level audience client removes the privacy pictures covered by the non-privacy pictures according to the privacy picture removing instruction to redisplay the non-privacy pictures.

313. And after the target high-level audience client-side redisplays the non-privacy picture, the live broadcast server changes the loaded second preset mark next to the position where the target high-level audience client-side displays the non-privacy picture back to the first preset mark.

314. The method comprises the steps that a live broadcast server obtains a single virtual asset consumption value which is pre-configured for a private picture service of a main broadcast user by the main broadcast user; the single virtual asset consumption value is a virtual asset consumption value consumed by a viewer user belonging to any high-level viewer client when the viewer user watches the main user privacy picture once.

315. And the live broadcast server deducts the single virtual asset consumption value from the audience virtual account corresponding to the target high-level audience client, and adds the deducted single virtual asset consumption value to the anchor virtual account of the anchor client.

The implementation of the steps 314 to 315 is beneficial to stimulating the anchor user to issue more privacy pictures so as to improve the popularity of the channel where the anchor client is located.

Therefore, by implementing the method described in fig. 3, the viewing range of the privacy pictures can be effectively controlled, which is beneficial to stimulating the anchor user to issue more privacy pictures, so as to improve the popularity of the channel where the anchor client is located.

Referring to fig. 4, fig. 4 is a schematic flowchart illustrating another picture publishing method based on anchor client triggering according to an embodiment of the present invention. As shown in fig. 4, the method for publishing pictures based on the trigger of the anchor client may include the following steps:

401. the anchor client acquires the privacy pictures and the non-privacy pictures which need to be issued by the anchor user to which the anchor client belongs.

402. And the anchor client reports the private pictures and the non-private pictures to the live broadcast server.

403. The method comprises the steps that a live broadcast server identifies a first client set and a second client set from a channel where a main broadcast client is located; the first client set comprises all low-level audience clients which are not signed with the anchor user privacy picture service in the channel; the second set of clients includes high-level viewer clients in the channel that have subscribed to the anchor user privacy picture service.

404. And the live broadcast server synchronously pushes the non-privacy pictures to all the low-level audience clients included in the first client set and all the high-level audience clients included in the second client set for display.

405. And the live broadcast server loads a first preset mark beside the position where the non-privacy pictures are displayed by each high-level audience client respectively, wherein the first preset mark is used for triggering the watching of the privacy pictures.

406. The method comprises the steps that a live broadcast server obtains a privacy picture watching request reported by any one target high-grade audience client in all high-grade audience clients, wherein the privacy picture watching request is reported to the live broadcast server when the target high-grade audience client detects that a first preset mark loaded beside a position where the target high-grade audience client displays a non-privacy picture is selected.

407. The live broadcast server pushes first inquiry information and a single virtual asset consumption value which is pre-configured for the privacy picture service of the anchor user by the anchor user to a target high-level audience client; the first inquiry information is used for inquiring whether a spectator user belonging to the target high-level spectator client still needs to watch the privacy picture of the anchor user; the single virtual asset consumption value is a virtual asset consumption value consumed by a viewer user belonging to any high-level viewer client when the viewer user watches the main user privacy picture once.

408. And if the live broadcast server receives response information which is reported by the target high-grade audience client and confirms that the private picture of the anchor user still needs to be watched, the live broadcast server pushes prompt information to the target high-grade audience client, and the prompt information is used for prompting the target high-grade audience client to collect and report an audience user authentication sound signal sent by an audience user to which the target high-grade audience client belongs.

409. And the live broadcast server synthesizes the audience user authentication sound signal and the anchor user sound signal pre-configured by the anchor user for the anchor user privacy picture service to obtain a synthesized sound signal.

410. And the live broadcast server judges whether the synthesized sound signal is matched with a verification sound signal synthesized by the live broadcast server for the target high-grade audience client when the target high-grade audience client signs the anchor user privacy picture service, and if so, the privacy picture is pushed to the target high-grade audience client so that the target high-grade audience client covers the non-privacy picture by using the privacy picture.

411. And after the target high-level audience client side covers the non-privacy picture by using the privacy picture, the live broadcast server changes the loaded first preset mark beside the position where the target high-level audience client side displays the privacy picture into a second preset mark, wherein the second preset mark is used for triggering and hiding the privacy picture.

412. The method comprises the steps that a live broadcast server obtains a privacy picture hiding request reported by a target high-grade audience client, wherein the privacy picture hiding request is reported to the live broadcast server by the target high-grade audience client when the target high-grade audience client detects that a second preset mark loaded beside a position where the target high-grade audience client displays a privacy picture is selected.

413. And the live broadcast server pushes a privacy picture removing instruction to the target high-level audience client so that the target high-level audience client removes the privacy pictures covered by the non-privacy pictures according to the privacy picture removing instruction to redisplay the non-privacy pictures.

414. And after the target high-level audience client-side redisplays the non-privacy picture, the live broadcast server changes the loaded second preset mark next to the position where the target high-level audience client-side displays the non-privacy picture back to the first preset mark.

415. The method comprises the steps that a live broadcast server obtains a single virtual asset consumption value which is pre-configured for a private picture service of a main broadcast user by the main broadcast user; the single virtual asset consumption value is a virtual asset consumption value consumed by a viewer user belonging to any high-level viewer client when the viewer user watches the main user privacy picture once.

416. And the live broadcast server deducts the single virtual asset consumption value from the audience virtual account corresponding to the target high-level audience client, and adds the deducted single virtual asset consumption value to the anchor virtual account of the anchor client.

As an optional implementation manner, in the embodiment of the present invention, before the live broadcast server obtains the private picture viewing request reported by any one target high-level viewer client in each high-level viewer client, the method further includes the following steps:

a live broadcast server acquires a service signing request which is reported by a target high-level audience client and is used for signing the private picture service of an anchor user;

the live broadcast server pushes indication information to the target high-grade audience client according to the service signing request, wherein the indication information is used for indicating the target high-grade audience client to collect and report audience user registration sound signals sent by audience users belonging to the target high-grade audience client;

the live broadcast server synthesizes the audience user registration sound signal and the anchor user sound signal pre-configured by the anchor user for the anchor user privacy picture service to obtain a verification sound signal; the verification sound signal is a verification sound signal synthesized by the live broadcast server for the target high-level audience client when the target high-level audience client signs the anchor user privacy picture service;

and the live broadcast server records the signing relation between the target high-grade audience client and the business for watching the private pictures of the anchor user so as to complete the signing of the business for watching the private pictures of the anchor user.

As an optional implementation manner, in an embodiment of the present invention, the service subscription request further includes a client level of the target high-level viewer client, and accordingly, before the live broadcast server pushes the indication information to the target high-level viewer client according to the service subscription request, the method further includes:

the live broadcast server judges whether the client grade of the target high-grade audience client is higher than the specified grade, if so, the step of pushing the indication information to the target high-grade audience client according to the service signing request is executed; otherwise, if the value is lower than the predetermined value, the process is ended.

As an optional implementation manner, in an embodiment of the present invention, after the live broadcast server records a subscription relationship between a target high-ranking viewer client and a service of viewing a private picture of an anchor user, the method further includes:

the live broadcast server determines a service virtual asset value corresponding to the client grade of the target high-grade audience client based on the client grade of the target high-grade audience client; the higher the client grade of the target high-grade audience client is, the smaller the service virtual asset value is; conversely, the lower the client level of the target high-level viewer client, the larger the service virtual asset value;

As an optional implementation manner, in the embodiment of the present invention, after the live broadcast server obtains a service subscription request for signing a private picture service of an anchor user, which is reported by a target high-level viewer client, and before the live broadcast server pushes indication information to the target high-level viewer client according to the service subscription request, the method further includes:

the live broadcast server pushes second inquiry information and the service virtual asset value to a target high-level audience client; the service virtual asset value is a service virtual asset value which needs to be received when the live broadcast server executes the subscription of the private picture service of the anchor user each time, and the second inquiry information is used for inquiring whether the audience user belonging to the target high-level audience client still needs to subscribe the private picture service of the anchor user;

and if the live broadcast server receives the confirmation reported by the target high-level audience client and still needs to sign the anchor user privacy picture service, the live broadcast server executes the step of pushing the indication information to the target high-level audience client according to the service signing request.

As an optional implementation manner, in an embodiment of the present invention, a live broadcast server synthesizes a registration sound signal of a viewer user and a sound signal of a anchor user, which is pre-configured by the anchor user for an anchor user privacy picture service, to obtain a verification sound signal, where the method includes:

the method comprises the steps that a live broadcast server determines an alignment point between a registration sound signal of a viewer user and a sound signal of a anchor user pre-configured by the anchor user for an anchor user privacy picture service; the method comprises the steps that a sound signal of a anchor user, which is pre-configured for an anchor user privacy picture service by the anchor user, is fixed and invariable, and a registration sound signal of a viewer user has personalized characteristics; the alignment point refers to the starting position of the synthesis of the audience user registration sound signal and the anchor user sound signal, in other words, if the audience user registration sound signal and the anchor user sound signal are to be synthesized, it is required to find out from which audio frame the synthesis starts, and the audio frame can be understood as the alignment point;

and the live broadcast server synthesizes the audience user registration voice signal and the anchor user voice signal into a verification voice signal according to the alignment point.

As an optional implementation manner, in an embodiment of the present invention, the determining, by the live server, an alignment point between the audience user registration sound signal and a main user sound signal pre-configured by the main user for the main user privacy picture service includes determining, by the live server, an alignment point between the audience user registration sound signal and the main user sound signal, where the main user sound signal is pre-configured for the main user privacy picture service

The live broadcast server calculates a first time length of a registration sound signal of a viewer user and a second time length of a sound signal of a anchor user, which is pre-configured for an anchor user privacy picture service by the anchor user; wherein the first duration represents a duration of time during which the audience user registers the sound of the sound signal; the second duration represents a duration of sound of the anchor user sound signal;

the live broadcast server calculates the difference between the first time length and the second time length;

and the live broadcast server judges whether the difference value is less than or equal to a preset value, if so, any sound signal in the audience user registration sound signal and the anchor user sound signal is subjected to periodic scaling so as to obtain the audience user registration sound signal and the anchor user sound signal with the same final duration, and then the first audio frame of the audience user registration sound signal and the anchor user sound signal with the same final duration is used as an alignment point.

In the embodiment of the present invention, if the difference is smaller than or equal to the preset value, it indicates that the difference between the two sound signals (i.e., the audience user registration sound signal and the anchor user sound signal) is small during input, and at this time, one of the sound signals (e.g., the audience user registration sound signal) may be scaled periodically, for example, periodically compressing the sound signal with a longer duration (i.e., colloquially called fast forwarding) and/or periodically amplifying the sound signal with a shorter duration (i.e., colloquially called slow forwarding), so that the final durations of the two sound signals are the same, and then the first audio frames of the two sound signals are used as an alignment point for alignment.

Wherein, the value range of the preset value can be 0 to 0.1 second.

In the embodiment of the present invention, the periodically scaling, by the live broadcast server, any one of the audience user registration sound signal and the anchor user sound signal includes:

if the first time length of the audience user registration sound signal is shorter than the second time length of the anchor user sound signal, determining a proportion X of the difference value in the first time length of the audience user registration sound signal according to the difference value;

calculating the audio frame number Y of the registered sound signals of the audience users;

calculating a magnification factor Z, which is X (Y/(Y-1));

and according to the amplification factor, performing equal-scale amplification on other audio frames except the first audio frame in the audience user registration sound signal, so that the final duration of the amplified audience user registration sound signal is the same as the second duration of the anchor user sound signal.

For example, if the audience user registration sound signal is 1 second, and there are 100 audio frames, each audio frame is 0.01 second, and the anchor user sound signal is 1.1 second, it is necessary to amplify the audience user registration sound signal to 1.1 second. The first frame is not moved, the subsequent 99 frames are amplified, and the amplification factor Z is firstly determined to be 0.1 (100/(100-1)) -0.101, namely 10.1%; at this time, in the subsequent 99 frames, 10.1% of each frame needs to be amplified, and each amplified frame is 0.01 × 0.01101 (1+ 10.1%), and the length of the 99 frames after amplification is 1.09 seconds, and is 1.1 seconds by adding 0.01 seconds of the first frame without movement, that is, the final duration of the amplified audience user registration sound signal is the same as the second duration of the anchor user sound signal.

In the embodiment of the present invention, if the difference is greater than the preset value, it indicates that the difference between the two sound signals (i.e., the audience user registration sound signal and the anchor user sound signal) during input is large, and if one of the sound signals is periodically scaled at this time, then severe distortion may be caused after scaling, and subsequent verification may cause problems, so a cross-correlation algorithm may be used to determine the alignment point. That is, when the difference is greater than the preset value, the method further includes:

the method comprises the steps that a live broadcast server respectively samples audience user registration sound signals and anchor user sound signals by using the same default sampling frequency to obtain a first sampling group and a second sampling group;

the live broadcast server generates a cross-correlation group according to the default sampling frequency (for example, 8000Hz to 10000Hz), the first sampling group, the second sampling group and the cross-correlation weight; wherein, the cross-correlation weight is positively correlated with the difference (for example, the cross-correlation weight may be 1.5 times of the difference), and the cross-correlation group includes a plurality of values;

the live broadcast server compares a plurality of values in the cross-correlation group to find out the maximum value;

the live broadcast server uses the audio frame position corresponding to the maximum value as an alignment point.

Wherein, the live broadcast server generates a cross-correlation group according to the default sampling frequency, the first sampling group, the second sampling group and the cross-correlation weight, and comprises:

wherein S is_n[t]Representing a set of cross-correlations, x [ m ]]Representing the mth sample data in the first sample group, y m-t]Represents the (m-t) th sampling data in the second sampling group, t represents the offset of time, t is an integer and takes the value from 0 to m, W_tAnd expressing a window function, wherein n is l and f, l is a cross-correlation weight, and f is a default sampling frequency.

The live broadcast server may use the audio frame position corresponding to the maximum numerical value as an alignment point:

after finding the maximum value, the live server can deduce what m is, i.e. which sample data, according to the above formula (1), and then determine which audio frame the sample data is in, and use the audio frame as the alignment point.

As an optional implementation manner, in an embodiment of the present invention, the determining, by the live broadcast server, whether the synthesized sound signal matches a verification sound signal synthesized by the live broadcast server for the target high-level viewer client when the target high-level viewer client signs up the anchor user privacy picture service includes:

if the first multi-dimensional vector is the same as the second multi-dimensional vector, the live broadcast server judges whether the first multi-dimensional vector corresponding to the voiceprint feature of the synthesized voice signal is matched with the second multi-dimensional vector corresponding to the voiceprint feature of the verified voice signal, and if the first multi-dimensional vector is matched with the second multi-dimensional vector, the synthesized voice signal is matched with the verified voice signal; if not, determining that the synthesized voice signal is not matched with the verification voice signal;

In the embodiment of the invention, after acquiring the voice signal registered by the audience user and the voice signal of the anchor user, the live broadcast server synthesizes the two voice signals to obtain the verification voice signal, and then matches the synthesized voice signal with the verification voice signal, and after the voice signals are synthesized, more verifiable parameters (such as whether the alignment points are the same, whether multidimensional vectors corresponding to voiceprint characteristics are matched and the like) can be generated, so that the safety of verification can be improved.

In the embodiment of the present invention, in the step 409, the synthesis manner of the synthesized voice signal and the synthesis manner of the verified voice signal may be similar, and details of the embodiment of the present invention are not described herein.

Therefore, by implementing the method described in fig. 4, the viewing range of the privacy pictures can be effectively controlled, which is beneficial to stimulating the anchor user to issue more privacy pictures, so as to improve the popularity of the channel where the anchor client is located. In addition, after acquiring the audience user authentication sound signal and the anchor user sound signal pre-configured for the anchor user privacy picture service by the anchor user, the live broadcast server does not verify the two sound signals one by one, but synthesizes the two sound signals to obtain a synthesized sound signal, then matches the synthesized sound signal with the verification sound signal, and generates more verifiable parameters (for example, whether the alignment points are the same or not, whether multidimensional vectors corresponding to voiceprint features are matched or not and the like) after the sound signals are synthesized.

It will be understood by those skilled in the art that all or part of the steps in the methods of the embodiments described above may be implemented by hardware instructions of a program, and the program may be stored in a computer-readable storage medium, where the storage medium includes Read-Only Memory (ROM), Random Access Memory (RAM), Programmable Read-Only Memory (PROM), Erasable Programmable Read-Only Memory (EPROM), One-time Programmable Read-Only Memory (OTPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Compact Disc Read-Only Memory (CD-ROM), or other Memory, such as a magnetic disk, or a combination thereof, A tape memory, or any other medium readable by a computer that can be used to carry or store data.

The picture publishing method triggered by the anchor client disclosed by the embodiment of the invention is described in detail, a specific example is applied in the method to explain the principle and the implementation mode of the invention, and the description of the embodiment is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims

1. A picture publishing method based on anchor client triggering is characterized by comprising the following steps:

2. The anchor client trigger-based picture publishing method according to claim 1, further comprising:

the live broadcast server obtains a privacy picture hiding request reported by the target high-level audience client after changing the first preset mark loaded beside the position of the target high-level audience client for displaying the privacy picture into a second preset mark, wherein the privacy picture hiding request is reported to the live broadcast server by the target high-level audience client when detecting that the second preset mark loaded beside the position of the target high-level audience client for displaying the privacy picture is selected;

3. The anchor client trigger-based picture publishing method according to claim 2, further comprising:

4. The anchor client-triggered picture publishing method according to claim 3, wherein after the live streaming server obtains the private picture viewing request reported by any one of the high-level viewer clients and before the live streaming server pushes the prompt message to the target high-level viewer client, the method further comprises:

5. The anchor client-triggered picture publishing method according to claim 4, wherein before the live server obtains the private picture viewing request reported by any one target high-level viewer client in the high-level viewer clients, the method further comprises:

and the live broadcast server records the signing relation between the target high-grade audience client and the anchor user privacy picture service so as to complete the signing of the anchor user privacy picture service.

6. The anchor client trigger-based picture publishing method according to claim 5, wherein the service subscription request further includes a client level of the target high-level viewer client, and before the live broadcast server pushes indication information to the target high-level viewer client according to the service subscription request, the method further comprises:

7. The anchor-client-triggered picture publishing method according to claim 6, wherein after said live server records the subscription relationship between said target high-level viewer client and said anchor user private picture service, said method further comprises:

8. The anchor-client-triggered-picture-publishing method according to claim 7, wherein after the live broadcast server obtains a service subscription request for subscribing to the anchor user private picture service, which is reported by the target high-level viewer client, and before the live broadcast server pushes indication information to the target high-level viewer client according to the service subscription request, the method further comprises:

the live broadcast server pushes second inquiry information and the service virtual asset value to the target high-level audience client; the service virtual asset value is a service virtual asset value which needs to be received each time the live broadcast server executes the subscription of the anchor user privacy picture service, and the second inquiry information is used for inquiring whether a viewer user belonging to the target high-level viewer client still needs to subscribe the anchor user privacy picture service;

9. The anchor client-triggered picture distribution method according to any one of claims 5-8, wherein said live server synthesizing said audience user registration voice signal and an anchor user voice signal pre-configured by said anchor user for said anchor user private picture service to obtain a verification voice signal comprises:

10. The anchor client-triggered picture publishing method as recited in claim 9, wherein the live streaming server determining whether the synthesized voice signal matches a verification voice signal synthesized by the live streaming server for the target high-level viewer client when the anchor user privacy picture service is signed up by the target high-level viewer client comprises: