CN108768681B - Method for displaying real-time image of anchor user caused by virtual resource presentation - Google Patents

Method for displaying real-time image of anchor user caused by virtual resource presentation Download PDF

Info

Publication number
CN108768681B
CN108768681B CN201810551338.4A CN201810551338A CN108768681B CN 108768681 B CN108768681 B CN 108768681B CN 201810551338 A CN201810551338 A CN 201810551338A CN 108768681 B CN108768681 B CN 108768681B
Authority
CN
China
Prior art keywords
client
live broadcast
anchor
target audience
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810551338.4A
Other languages
Chinese (zh)
Other versions
CN108768681A (en
Inventor
向敏明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Dongguan Huarui Electronic Technology Co ltd
Original Assignee
Dongguan Huarui Electronic Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dongguan Huarui Electronic Technology Co ltd filed Critical Dongguan Huarui Electronic Technology Co ltd
Priority to CN201810551338.4A priority Critical patent/CN108768681B/en
Publication of CN108768681A publication Critical patent/CN108768681A/en
Application granted granted Critical
Publication of CN108768681B publication Critical patent/CN108768681B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/02—Details
    • H04L12/16—Arrangements for providing special services to substations
    • H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/185—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast with management of multicast group membership
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/02—Details
    • H04L12/16—Arrangements for providing special services to substations
    • H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/1859—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast adapted to provide push services, e.g. data channels
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/07—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail characterised by the inclusion of specific contents
    • H04L51/10—Multimedia information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/21—Monitoring or handling of messages
    • H04L51/214—Monitoring or handling of messages using selective forwarding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00—Network architectures or network communication protocols for network security
    • H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
    • H04L63/0861—Network architectures or network communication protocols for network security for authentication of entities using biometrical features, e.g. fingerprint, retina-scan
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/50—Network services
    • H04L67/55—Push-based network services
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Multimedia (AREA)
  • Computer Hardware Design (AREA)
  • General Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Computer Security & Cryptography (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Databases & Information Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The embodiment of the invention discloses a method for displaying an instant image of a main broadcasting user caused by giving a virtual resource, which comprises the following steps: when the live broadcast server judges that the value of the virtual resource presented to the anchor client by the target audience client in the channel of the anchor client is equal to or exceeds the value of the appointed resource pre-configured for the instant image service of the anchor user by the anchor client, a preset first prompt icon is superposed to a first designated position on a live event picture which is displayed by a target audience client and reported by a main broadcasting client, reporting the instant image watching request of the anchor user to a live broadcast server when a first prompt icon superposed at a first designated position on a live broadcast picture of the event displayed by a target audience client is selected, and the live broadcast server can superimpose the live image of the anchor user reported by the anchor client to a second appointed position on the live broadcast picture of the event displayed by the target audience client, so that the selective accurate pushing of the live image of the anchor user can be realized.

Description

Method for displaying real-time image of anchor user caused by virtual resource presentation
Technical Field
The invention relates to the technical field of Internet, in particular to a method for displaying an instant image of an anchor user caused by giving a virtual resource.
Background
With the wide popularization of the internet, audience users can watch live events pictures and instant images of the audience users, which are released by a main broadcast client, through the audience client accessing a channel where the main broadcast client is located. The live images of the anchor users released by the anchor client are usually superimposed at the designated positions of the live events displayed by each audience client accessing the channel where the anchor client is located. As shown in fig. 1, the live images of the anchor user published by the anchor client are typically superimposed on the lower right corner of the live event view displayed by each viewer client accessing the channel on which the anchor client is located.
In the prior art, the anchor user instant image is superimposed on a specified position of a live event image displayed by each viewer client accessing to a channel where the anchor client is located in a broadcast manner, so that selective and accurate pushing of the anchor user instant image cannot be realized, for example, the anchor user instant image cannot be selectively and accurately pushed to VIP viewer clients (for example, a certain value of virtual resources are given to the viewer clients of the anchor client).
Disclosure of Invention
The embodiment of the invention discloses a method for displaying an instant image of a anchor user caused by giving a virtual resource, which can realize selective and accurate push of the instant image of the anchor user.
The method for displaying the instant image of the anchor user caused by virtual resource presentation comprises the following steps:
the method comprises the steps that a live broadcast server identifies the value of virtual resources donated to a main broadcast client side by a target audience client side in each audience client side in the process of pushing an event live broadcast picture reported by the main broadcast client side to each audience client side in a channel where the main broadcast client side is located to display;
the live broadcast server judges whether the value of the virtual resource is equal to or exceeds the value of a specified resource pre-configured for the live broadcast user instant image service by the anchor client;
if yes, the live broadcast server superimposes a preset first prompt icon to a first designated position on the event live broadcast picture displayed by the target audience client; the first prompt icon is used for triggering and watching the instant image of the anchor user;
the live broadcast server acquires an instant image watching request of a main broadcast user reported by the target audience client, wherein the instant image watching request of the main broadcast user is reported to the live broadcast server when the target audience client detects that the first prompt icon superposed at the first designated position on the event live broadcast picture displayed by the target audience client is selected;
and the live broadcast server superimposes the live image of the anchor user reported by the anchor client to a second appointed position on the event live broadcast picture displayed by the target audience client.
As an optional implementation manner, in an embodiment of the present invention, after the live broadcast server obtains an instant image watching request of a anchor user reported by the target audience client, and before the live broadcast server superimposes an instant image of the anchor user reported by the anchor client on a second designated position on the live event image displayed by the target audience client, the method further includes:
the live broadcast server pushes prompt information to the target audience client, wherein the prompt information is used for prompting the target audience client to collect and report audience user authentication sound signals sent by audience users to which the target audience client belongs;
the live broadcast server synthesizes the audience user authentication sound signal and a anchor user sound signal pre-configured by the anchor client for the anchor user instant image service to obtain a synthesized sound signal;
and the live broadcast server judges whether the synthesized sound signal is matched with a verification sound signal synthesized by the live broadcast server for the target audience client when the target audience client signs the live image service of the anchor user, and if the synthesized sound signal is matched with the verification sound signal, the step of superposing the instant image of the anchor user reported by the anchor client to a second designated position on the live competition picture displayed by the target audience client is executed.
As an optional implementation manner, in an embodiment of the present invention, after the live broadcast server superimposes the live image of the anchor user reported by the anchor client to a second designated position on the live broadcast picture of the event displayed by the target audience client, the method further includes:
the live broadcast server changes the first prompt icon superposed at the first designated position on the event live broadcast picture displayed by the target audience client into a preset second prompt icon, and the second preset mark is used for triggering and hiding the instant image of the anchor user;
the live broadcast server acquires an anchor user instant image hiding request reported by the target audience client, wherein the anchor user instant image hiding request is reported to the live broadcast server when the target audience client detects that the second prompt icon superposed at the first designated position on the event live broadcast picture displayed by the target audience client is selected;
the live broadcast server controls the live broadcast user instant image which is superimposed to a second appointed position on the event live broadcast picture displayed by the target audience client to be hidden according to the live broadcast user instant image hiding request;
and after the live broadcast server controls the live broadcast user instant image which is superimposed to a second appointed position on the event live broadcast picture displayed by the target audience client to be hidden, the live broadcast server changes the second prompt icon superimposed to the first appointed position on the event live broadcast picture displayed by the target audience client back to the first prompt icon.
As an optional implementation manner, in an embodiment of the present invention, after the live broadcast server changes the second prompt icon superimposed at the first designated position on the event live broadcast screen displayed by the target viewer client back to the first prompt icon, the method further includes:
the live broadcast server acquires a single virtual asset consumption value pre-configured by the anchor client for the live image service of the anchor user; the single virtual asset consumption value is a virtual asset consumption value consumed by any client when any client watches the real-time image of the anchor user once;
and the live broadcast server deducts the single virtual asset consumption value from the audience virtual account corresponding to the target audience client, and adds the deducted single virtual asset consumption value to the anchor virtual account of the anchor client.
As an optional implementation manner, in an embodiment of the present invention, after the live broadcast server obtains an instant image viewing request of an anchor user reported by the target audience client, and before the live broadcast server pushes prompt information to the target audience client, the method further includes:
the live broadcast server pushes first inquiry information and the single virtual asset consumption value pre-configured by the anchor client for the anchor user instant image service to the target audience client; the first inquiry information is used for inquiring whether the audience user to which the target audience client belongs still needs to watch the live image of the anchor user;
and if the live broadcast server receives response information which is reported by the target audience client and confirms that the live image of the anchor user still needs to be watched, the live broadcast server executes the step of pushing the prompt information to the target audience client.
As an optional implementation manner, in an embodiment of the present invention, before the live broadcast server obtains an instant image viewing request of an anchor user reported by the target audience client, the method further includes:
the live broadcast server acquires a service signing request which is reported by the target audience client and is used for signing the instant image service of the anchor user; the service signing request also comprises the client grade of the target audience client;
the live broadcast server reads the client grade of the target audience client from the service signing request;
the live broadcast server judges whether the client grade of the target audience client is higher than the grade designated by the anchor client;
if the client level of the target audience client is higher than the level designated by the anchor client, the live broadcast server pushes indication information to the target audience client according to the service signing request, wherein the indication information is used for indicating the target audience client to collect and report an audience user registration sound signal sent by an audience user to which the target audience client belongs;
the live broadcast server synthesizes the audience user registration sound signal and a anchor user sound signal which is pre-configured by the anchor client for an anchor user instant image service to obtain a verification sound signal; wherein the verification sound signal is a verification sound signal synthesized by the live broadcast server for the target audience client when the target audience client signs the anchor user instant image service;
and the live broadcast server records the signing relation between the target audience client and the anchor user instant image service so as to complete the signing of the anchor user instant image service.
As an optional implementation manner, in an embodiment of the present invention, after the live broadcast server records a subscription relationship between the target audience client and the anchor user instant image service, so as to complete the subscription of the anchor user instant image service, the method further includes:
the live broadcast server determines a service virtual asset value corresponding to the client grade of the target audience client based on the client grade of the target audience client; wherein the higher the client level of the target viewer client, the smaller the service virtual asset value; conversely, the lower the client level of the target viewer client, the greater the service virtual asset value;
and the live broadcast server deducts the service virtual asset value from the audience virtual account corresponding to the target audience client and adds the deducted service virtual asset value to the service virtual account corresponding to the live broadcast server.
As an optional implementation manner, in an embodiment of the present invention, after the live broadcast server determines that the client level of the target viewer client is higher than the level specified by the anchor client, and before the live broadcast server pushes indication information to the target viewer client according to the service subscription request, the method further includes:
the live broadcast server pushes second inquiry information and the service virtual asset value to the target audience client; the service virtual asset value is a service virtual asset value which needs to be received by the live broadcast server each time the anchor user instant image service is signed, and the second query information is used for querying whether a viewer user to which the target viewer client belongs still needs to sign the anchor user instant image service;
and if the live broadcast server receives the confirmation reported by the target audience client and still needs to sign the instant image service of the anchor user, the live broadcast server executes the step of pushing the indication information to the target audience client according to the service signing request.
As an optional implementation manner, in an embodiment of the present invention, the synthesizing, by the live broadcast server, the audience user registration sound signal and a anchor user sound signal pre-configured by the anchor client for an anchor user instant image service to obtain a verification sound signal includes:
the live broadcast server determines an alignment point between the audience user registration sound signal and a anchor user sound signal pre-configured by the anchor client for an anchor user instant image service; wherein, the alignment point refers to the starting position of the synthesis of the audience user registration voice signal and the anchor user voice signal;
and the live broadcast server synthesizes the audience user registration sound signal and the anchor user sound signal into a verification sound signal according to the alignment point.
As an optional implementation manner, in an embodiment of the present invention, the determining, by the live broadcast server, whether the synthesized sound signal matches a verification sound signal synthesized by the live broadcast server for the target audience client when the target audience client signs up the anchor user instant image service includes:
the live broadcast server judges whether the alignment points between the synthesized sound signals and the verification sound signals synthesized by the live broadcast server for the target audience client are the same when the target audience client signs the live image service of the anchor user;
if the two multi-dimensional vectors are the same, the live broadcast server judges whether a first multi-dimensional vector corresponding to the voiceprint feature of the synthesized voice signal is matched with a second multi-dimensional vector corresponding to the voiceprint feature of the verified voice signal, and if the two multi-dimensional vectors are matched, the synthesized voice signal is matched with the verified voice signal; if not, determining that the synthesized voice signal does not match the verification voice signal;
the first multi-dimensional vector corresponding to the voiceprint feature of the synthetic sound signal is composed of a mel-frequency cepstrum coefficient, a linear prediction cepstrum coefficient, a first order difference of the mel-frequency cepstrum coefficient, a first order difference of the linear prediction cepstrum coefficient, energy, a first order difference of the energy and a Gammatone filter cepstrum coefficient.
In the embodiment of the invention, a live broadcast server identifies the value of virtual resources donated to a main broadcast client by a target audience client in each audience client in the process of pushing an event live broadcast picture reported by the main broadcast client to each audience client in a channel where the main broadcast client is located for displaying; when the value of the virtual resource presented to the anchor client by the target audience client is judged to be equal to or exceed the value of the appointed resource preset by the anchor client for the instant image service of the anchor user, the preset first prompt icon is superposed to a first appointed position on a live event picture displayed by the target audience client, when the first prompt icon superposed on the first appointed position on the live event picture displayed by the target audience client is selected, the instant image viewing request of the anchor user is reported to a live broadcast server, and the live broadcast server can superpose the instant image of the anchor user reported by the anchor client to a second appointed position on the live event picture displayed by the target audience client, so that the selective accurate pushing of the instant image of the anchor user can be realized.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without creative efforts.
FIG. 1 is a diagram illustrating a live event display displayed by a spectator client and an overlay of an instant image of a anchor user in the prior art;
FIG. 2 is a diagram of a network architecture according to an embodiment of the present invention;
FIG. 3 is a flowchart illustrating a method for displaying an instant image of an anchor user caused by virtual resource donation according to an embodiment of the present invention;
FIG. 4 is a flowchart illustrating another method for displaying an instant image of an anchor user caused by virtual resource donation according to an embodiment of the present invention;
FIG. 5 is a flowchart illustrating another method for displaying an instant image of an anchor user caused by virtual resource donation according to an embodiment of the present invention;
fig. 6 is a flowchart illustrating another method for displaying an instant image of an anchor user caused by virtual resource donation according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "comprises" and "comprising," and any variations thereof, of embodiments of the present invention are intended to cover non-exclusive inclusions, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
The embodiment of the invention discloses a method for displaying an instant image of a anchor user caused by giving a virtual resource, which can realize selective and accurate push of the instant image of the anchor user. The following detailed description is made with reference to the accompanying drawings.
In order to better understand the method for displaying the live image of the anchor user caused by the donation of the virtual resource disclosed in the embodiment of the present invention, a network architecture suitable for the embodiment of the present invention is described below. Referring to fig. 2, fig. 2 is a schematic diagram of a network architecture according to an embodiment of the present invention. As shown in fig. 2, the network architecture may include a live server and a plurality of clients, where the live server is also referred to as a background server, a group anchor server, a component server, and the like, and the live server may be in communication connection with the plurality of clients through the internet. In the network architecture shown in fig. 2, one of the clients may serve as a main broadcasting client, and the rest of the clients may serve as viewer clients accessing the channel on which the main broadcasting client is located. Wherein, the user to which the anchor client belongs is called the anchor user, and the user to which the viewer client belongs is called the viewer user. In the embodiment of the present invention, a channel is simply a virtual space (or virtual room) created by the anchor client or created for the anchor client by the channel management platform, and the audience client located in the virtual space can not only watch the live content of the anchor client, but also interact with the anchor client in a voice or text manner. The master control client has access and kicking control right for the audience client accessing the channel, and also has a direct broadcast initiative right. In the network architecture shown in fig. 2, the anchor client, the viewer client, etc. may run on user equipment including, but not limited to, a personal computer, a tablet computer, a smart television, etc.
Referring to fig. 3, fig. 3 is a flowchart illustrating a method for displaying an instant image of an anchor user caused by virtual resource donation according to an embodiment of the present invention. As shown in fig. 3, the method for displaying the live image of the anchor user caused by the virtual resource donation may include the steps of:
301. and the live broadcast server identifies the value of the virtual resource presented to the anchor client by the target audience client in each audience client in the process of pushing the event live broadcast picture reported by the anchor client to each audience client in the channel where the anchor client is positioned for displaying.
In the embodiment of the present invention, the virtual resources given by the target audience client to the anchor client may include virtual gifts, virtual items, and the like, which is not limited in the embodiment of the present invention. Where each virtual resource pair has its own value (e.g., price).
302. The live broadcast server judges whether the value of the virtual resource is equal to or exceeds the value of a specified resource pre-configured for the live broadcast user instant image service by the live broadcast client, if so, the step 303-step 305 are executed; if not, the flow is ended.
303. The live broadcast server superimposes a preset first prompt icon to a first designated position on an event live broadcast picture displayed by a target audience client; the first prompt icon is used for triggering the watching of the instant image of the anchor user.
The first designated position may be an upper left corner, a lower left corner, an upper right corner, or a lower right corner, and the embodiment of the present invention is not limited.
304. The live broadcast server acquires an instant image watching request of a main broadcast user reported by a target audience client, wherein the instant image watching request of the main broadcast user is reported to the live broadcast server when the target audience client detects that a first prompt icon superposed at a first designated position on an event live broadcast picture displayed by the target audience client is selected.
305. And the live broadcast server superposes the live image of the anchor user reported by the anchor client to a second appointed position on the event live broadcast picture displayed by the target audience client.
As an optional implementation manner, in an embodiment of the present invention, a live broadcast server superimposes an instant image of an anchor user, which is reported by an anchor client, to a second designated position on a live broadcast picture of an event displayed by a target audience client, where the superimposing includes:
the live broadcast server triggers a main broadcast client to capture a first portrait corresponding to a main broadcast user through a camera device;
the live broadcast server judges whether a face image contained in a first person image corresponding to an anchor user is matched with a face image contained in a second person image corresponding to a specified anchor pre-configured by an anchor client;
if the face image contained in the first portrait corresponding to the anchor user is matched with the face image contained in the second portrait corresponding to the appointed anchor and pre-configured by the anchor client, the live broadcast server performs forward calculation on the first portrait by utilizing a portrait attribute algorithm to obtain attribute information of the first portrait;
the live broadcast server judges whether the attribute information of the first portrait is matched with the attribute information of a second portrait corresponding to a designated anchor pre-configured by the anchor client;
and if the attribute information of the first portrait is matched with the attribute information of a second portrait corresponding to a designated anchor preset by the anchor client, the live broadcast server superimposes the instant image of the anchor user reported by the anchor client to a second designated position on a live broadcast picture of the event displayed by the target audience client.
The portrait attribute algorithm is obtained by training recognition results of a plurality of attribute information based on a plurality of sample portrait images and a plurality of sample portrait images according to different types of the attribute information; wherein the attribute information includes age, sex and height
In the embodiment of the invention, the portrait attribute algorithm is obtained by training in the following way:
the method comprises the steps that a live broadcast server reads pre-recorded sample portrait data, wherein each sample portrait data comprises a sample portrait image and a plurality of attribute information of the sample portrait image;
the live broadcast server extracts portrait characteristics from a pre-recorded sample portrait image;
the live broadcast server carries out forward calculation on the portrait characteristics of each sample portrait image according to the submodels corresponding to different attribute information in the initial model to obtain the predicted values of a plurality of attribute information of each sample portrait image;
the live broadcast server calculates the loss of a plurality of attribute information according to the predicted values and the values of the attribute information and different types of the attribute information;
the live broadcast server sums the losses of the attribute information to obtain the total loss of the attribute information;
the live broadcast server adjusts parameters of the sub-models corresponding to different attribute information in the initial model, and when the adjusted parameters enable the total loss of the attribute information to be smaller than or equal to a preset threshold value, the adjustment is stopped to obtain a portrait attribute algorithm;
the live broadcast server calculates loss of a plurality of attribute information according to the predicted values and the values of the attribute information and different types of the attribute information, and the method comprises the following steps:
for each attribute information in the attribute information, if the attribute information is a regression attribute, the live broadcast server calculates a predicted value of the attribute information and a value of the attribute information according to the following formula to obtain the loss of the attribute information:
Figure RE-GDA0001716269360000111
wherein s represents the number of the attribute information in the plurality of attribute information,
Figure RE-GDA0001716269360000112
representing the predicted values calculated by the initial model,
Figure RE-GDA0001716269360000113
and L represents a loss corresponding to the attribute information.
Or, the live broadcast server calculates the loss of the plurality of attribute information according to the predicted values and the values of the attribute information and different types of the attribute information, and the method comprises the following steps:
for each attribute information in the attribute information, if the attribute information is not a regression attribute, the live broadcast server calculates a prediction vector and an attribute information vector of the attribute information according to the following formula to obtain the loss of the attribute information:
Figure RE-GDA0001716269360000114
wherein s represents the number of the attribute information in the plurality of attribute information, x represents the value of the attribute information, q represents the predicted value calculated by the initial model, d represents the number of the identification results of the attribute information, h represents the identifier of the identification result of the attribute information, and L represents the loss corresponding to the attribute information.
By implementing the embodiment, the live broadcast server can superimpose the live broadcast user instant image reported by the anchor client to a second designated position on the event live broadcast image displayed by the target audience client when the accurate anchor user is the designated anchor broadcast configured by the anchor client in advance, so that the live broadcast user instant image can be prevented from being maliciously shared by other non-designated anchor users.
It can be seen that implementing the method described in fig. 3 enables selective accurate push of the anchor user's live image; moreover, other non-designated anchor viciously can be prevented from sharing the instant image of the anchor user.
Referring to fig. 4, fig. 4 is a flowchart illustrating another method for displaying an instant image of an anchor user caused by virtual resource donation according to an embodiment of the present invention. As shown in fig. 4, the method for displaying the live image of the anchor user caused by the virtual resource donation may include the steps of:
401. and the live broadcast server identifies the value of the virtual resource presented to the anchor client by the target audience client in each audience client in the process of pushing the event live broadcast picture reported by the anchor client to each audience client in the channel where the anchor client is positioned for displaying.
402. The live broadcast server judges whether the value of the virtual resource is equal to or exceeds the value of a specified resource pre-configured for the live broadcast user instant image service by the live broadcast client, if so, the steps 403 to 407 are executed; if not, the flow is ended.
403. The live broadcast server superimposes a preset first prompt icon to a first designated position on an event live broadcast picture displayed by a target audience client; the first prompt icon is used for triggering the watching of the instant image of the anchor user.
404. The live broadcast server acquires an instant image watching request of a main broadcast user reported by a target audience client, wherein the instant image watching request of the main broadcast user is reported to the live broadcast server when the target audience client detects that a first prompt icon superposed at a first designated position on an event live broadcast picture displayed by the target audience client is selected.
405. The live broadcast server pushes prompt information to the target audience client, and the prompt information is used for prompting the target audience client to collect and report audience user authentication sound signals sent by audience users to which the target audience client belongs.
406. And the live broadcast server synthesizes the audience user authentication sound signal and the anchor user sound signal pre-configured by the anchor client for the anchor user instant image service to obtain a synthesized sound signal.
407. The live broadcast server judges whether the synthesized sound signal is matched with a verification sound signal synthesized by the live broadcast server for the target audience client when the target audience client signs the real-time image service of the anchor user, if so, the step 408 is executed; if not, the process is ended.
Wherein the matching of the synthesized sound signal to the verification sound signal may include matching the synthesized sound signal to the verification sound signal at the same alignment point, and matching a first multi-dimensional vector corresponding to the voiceprint feature of the synthesized sound signal to a second multi-dimensional vector corresponding to the voiceprint feature of the verification sound signal.
The first multi-dimensional vector corresponding to the voiceprint features of the synthesized sound signal is composed of a Mel frequency cepstrum coefficient, a linear prediction cepstrum coefficient, a first order difference of the Mel frequency cepstrum coefficient, a first order difference of the linear prediction cepstrum coefficient, a first order difference of energy and a Gammatone filter cepstrum coefficient.
408. And the live broadcast server superposes the live image of the anchor user reported by the anchor client to a second appointed position on the event live broadcast picture displayed by the target audience client.
In the embodiment of the present invention, by implementing the steps 405 to 408, selective, reliable, safe and accurate pushing of the live image of the anchor user can be realized.
Therefore, the method described in fig. 4 can be implemented to realize selective, reliable, safe and accurate push of the instant image of the anchor user; moreover, other non-designated anchor viciously can be prevented from sharing the instant image of the anchor user.
Referring to fig. 5, fig. 5 is a flowchart illustrating another method for displaying an instant image of an anchor user caused by virtual resource donation according to an embodiment of the present invention. As shown in fig. 5, the method for displaying the live image of the anchor user caused by the virtual resource donation may include the steps of:
501. and the live broadcast server identifies the value of the virtual resource presented to the anchor client by the target audience client in each audience client in the process of pushing the event live broadcast picture reported by the anchor client to each audience client in the channel where the anchor client is positioned for displaying.
502. The live broadcast server judges whether the value of the virtual resource is equal to or exceeds the value of the appointed resource pre-configured for the live broadcast user instant image service by the live broadcast client, if so, the steps 503-507 are executed; if not, the flow is ended.
503. The live broadcast server superimposes a preset first prompt icon to a first designated position on an event live broadcast picture displayed by a target audience client; the first prompt icon is used for triggering the watching of the instant image of the anchor user.
504. The live broadcast server acquires an instant image watching request of a main broadcast user reported by a target audience client, wherein the instant image watching request of the main broadcast user is reported to the live broadcast server when the target audience client detects that a first prompt icon superposed at a first designated position on an event live broadcast picture displayed by the target audience client is selected.
505. The live broadcast server pushes prompt information to the target audience client, and the prompt information is used for prompting the target audience client to collect and report audience user authentication sound signals sent by audience users to which the target audience client belongs.
506. And the live broadcast server synthesizes the audience user authentication sound signal and the anchor user sound signal pre-configured by the anchor client for the anchor user instant image service to obtain a synthesized sound signal.
507. The live broadcast server judges whether the synthesized sound signal is matched with a verification sound signal synthesized by the live broadcast server for the target audience client when the target audience client signs the real-time image service of the anchor user, if so, the step 508 is executed; if not, the process is ended.
Wherein the matching of the synthesized sound signal to the verification sound signal may include matching the synthesized sound signal to the verification sound signal at the same alignment point, and matching a first multi-dimensional vector corresponding to the voiceprint feature of the synthesized sound signal to a second multi-dimensional vector corresponding to the voiceprint feature of the verification sound signal.
The first multi-dimensional vector corresponding to the voiceprint features of the synthesized sound signal is composed of a Mel frequency cepstrum coefficient, a linear prediction cepstrum coefficient, a first order difference of the Mel frequency cepstrum coefficient, a first order difference of the linear prediction cepstrum coefficient, a first order difference of energy and a Gammatone filter cepstrum coefficient.
508. And the live broadcast server superposes the live image of the anchor user reported by the anchor client to a second appointed position on the event live broadcast picture displayed by the target audience client.
In the embodiment of the present invention, by implementing steps 505 to 508, selective, reliable, safe and accurate pushing of the live image of the anchor user can be realized.
509. And after the live broadcast server superposes the live image of the anchor user reported by the anchor client to a second appointed position on the live event picture displayed by the target audience client, changing a first prompt icon superposed at the first appointed position on the live event picture displayed by the target audience client into a preset second prompt icon, wherein the second preset mark is used for triggering and hiding the live image of the anchor user.
510. The live broadcast server acquires an anchor user instant image hiding request reported by a target audience client, wherein the anchor user instant image hiding request is reported to the live broadcast server when the target audience client detects that a second prompt icon superposed at a first specified position on an event live broadcast picture displayed by the target audience client is selected.
511. And the live broadcast server controls the live broadcast user instant image at a second appointed position which is superimposed on the event live broadcast picture displayed by the target audience client to be hidden according to the live broadcast user instant image hiding request.
512. And after the live broadcast server controls the live broadcast user instant image which is superimposed to the second appointed position on the event live broadcast picture displayed by the target audience client to be hidden, the second prompt icon superimposed on the first appointed position on the event live broadcast picture displayed by the target audience client is changed back to the first prompt icon.
513. The method comprises the steps that a live broadcast server obtains a single virtual asset consumption value which is pre-configured by a main broadcast client for an instant image service of a main broadcast user; the single virtual asset consumption value is a virtual asset consumption value consumed by any client when any client watches the real-time image of the anchor user once.
514. And the live broadcast server deducts the single virtual asset consumption value from the audience virtual account corresponding to the target audience client, and adds the deducted single virtual asset consumption value to the anchor virtual account of the anchor client.
In addition, the implementation of the steps 512 to 413 is beneficial to stimulating the anchor user to share more anchor user instant images, so as to improve the popularity of the channel where the anchor client is located.
Therefore, the method described in fig. 5 can be implemented to realize selective, reliable, safe and accurate push of the instant image of the anchor user; moreover, the method and the system are beneficial to stimulating the anchor user to share more instant images of the anchor user so as to improve the popularity of the channel where the anchor client is located.
Referring to fig. 6, fig. 6 is a flowchart illustrating another method for displaying an instant image of an anchor user caused by virtual resource donation according to an embodiment of the present invention. As shown in fig. 6, the method for displaying the live image of the anchor user caused by the virtual resource donation may include the steps of:
601. and the live broadcast server identifies the value of the virtual resource presented to the anchor client by the target audience client in each audience client in the process of pushing the event live broadcast picture reported by the anchor client to each audience client in the channel where the anchor client is positioned for displaying.
602. The live broadcast server judges whether the value of the virtual resource is equal to or exceeds the value of the appointed resource pre-configured for the live broadcast user instant image service by the live broadcast client, if so, the steps 603 to 608 are executed; if not, the flow is ended.
603. The live broadcast server superimposes a preset first prompt icon to a first designated position on an event live broadcast picture displayed by a target audience client; the first prompt icon is used for triggering the watching of the instant image of the anchor user.
604. The live broadcast server acquires an instant image watching request of a main broadcast user reported by a target audience client, wherein the instant image watching request of the main broadcast user is reported to the live broadcast server when the target audience client detects that a first prompt icon superposed at a first designated position on an event live broadcast picture displayed by the target audience client is selected.
605. The live broadcast server pushes first inquiry information and a single virtual asset consumption value which is pre-configured for the live broadcast user instant image service by the anchor client to a target audience client; the first inquiry information is used for inquiring whether an audience user to which the target audience client belongs still needs to watch the instant image of the anchor user; the single virtual asset consumption value is a virtual asset consumption value consumed by any client when any client watches the real-time image of the anchor user once.
606. And if the live broadcast server receives response information which is reported by the target audience client and confirms that the live image of the anchor user still needs to be watched, the live broadcast server pushes prompt information to the target audience client, and the prompt information is used for prompting the target audience client to collect and report audience user authentication sound signals sent by audience users to which the target audience client belongs.
607. And the live broadcast server synthesizes the audience user authentication sound signal and the anchor user sound signal pre-configured by the anchor client for the anchor user instant image service to obtain a synthesized sound signal.
608. The live broadcast server judges whether the synthesized sound signal is matched with a verification sound signal synthesized by the live broadcast server for the target audience client when the target audience client signs the live image service of the anchor user, and if the synthesized sound signal is matched with the verification sound signal, the steps 609 to 615 are executed; if not, the process is ended.
Wherein the matching of the synthesized sound signal to the verification sound signal may include matching the synthesized sound signal to the verification sound signal at the same alignment point, and matching a first multi-dimensional vector corresponding to the voiceprint feature of the synthesized sound signal to a second multi-dimensional vector corresponding to the voiceprint feature of the verification sound signal.
The first multi-dimensional vector corresponding to the voiceprint features of the synthesized sound signal is composed of a Mel frequency cepstrum coefficient, a linear prediction cepstrum coefficient, a first order difference of the Mel frequency cepstrum coefficient, a first order difference of the linear prediction cepstrum coefficient, a first order difference of energy and a Gammatone filter cepstrum coefficient.
609. And the live broadcast server superposes the live image of the anchor user reported by the anchor client to a second appointed position on the event live broadcast picture displayed by the target audience client.
In the embodiment of the invention, the steps 606 to 609 are implemented, so that the selective, reliable, safe and accurate push of the instant image of the anchor user can be realized.
610. And after the live broadcast server superposes the live image of the anchor user reported by the anchor client to a second appointed position on the live event picture displayed by the target audience client, changing a first prompt icon superposed at the first appointed position on the live event picture displayed by the target audience client into a preset second prompt icon, wherein the second preset mark is used for triggering and hiding the live image of the anchor user.
611. The live broadcast server acquires an anchor user instant image hiding request reported by a target audience client, wherein the anchor user instant image hiding request is reported to the live broadcast server when the target audience client detects that a second prompt icon superposed at a first specified position on an event live broadcast picture displayed by the target audience client is selected.
612. And the live broadcast server controls the live broadcast user instant image at a second appointed position which is superimposed on the event live broadcast picture displayed by the target audience client to be hidden according to the live broadcast user instant image hiding request.
613. And after the live broadcast server controls the live broadcast user instant image which is superimposed to the second appointed position on the event live broadcast picture displayed by the target audience client to be hidden, the second prompt icon superimposed on the first appointed position on the event live broadcast picture displayed by the target audience client is changed back to the first prompt icon.
614. The method comprises the steps that a live broadcast server obtains a single virtual asset consumption value which is pre-configured by a main broadcast client for an instant image service of a main broadcast user; the single virtual asset consumption value is a virtual asset consumption value consumed by any client when any client watches the real-time image of the anchor user once.
615. And the live broadcast server deducts the single virtual asset consumption value from the audience virtual account corresponding to the target audience client, and adds the deducted single virtual asset consumption value to the anchor virtual account of the anchor client.
The implementation of steps 614 to 615 is beneficial to stimulate the anchor user to share more anchor user instant images, so as to improve the popularity of the channel where the anchor client is located.
As an optional implementation manner, in an embodiment of the present invention, before the live broadcast server obtains an instant image viewing request of the anchor user reported by the target audience client, the method further includes the following steps:
a live broadcast server acquires a service signing request which is reported by a target audience client and is used for signing an instant image service of an anchor user;
the live broadcast server pushes indication information to the target audience client according to the service signing request, wherein the indication information is used for indicating the target audience client to collect and report audience user registration sound signals sent by audience users belonging to the target audience client;
the live broadcast server synthesizes the audience user registration sound signal and the anchor user sound signal pre-configured by the anchor client for the anchor user instant image service to obtain a verification sound signal; the verification sound signal is a verification sound signal synthesized by the live broadcast server for the target audience client when the target audience client signs the real-time image service of the anchor user;
and the live broadcast server records the signing relation between the target audience client and the anchor user instant image service so as to complete the signing of the anchor user instant image service.
As an optional implementation manner, in an embodiment of the present invention, the service subscription request further includes a client level of the target viewer client, and accordingly, before the live broadcast server pushes the indication information to the target viewer client according to the service subscription request, the method further includes:
the live broadcast server reads the client grade of the target audience client from the service signing request;
the live broadcast server judges whether the client end grade of the target audience client end is higher than the grade appointed by the anchor client end, if so, the step of pushing the indication information to the target audience client end according to the service signing request is executed; otherwise, if the value is lower than the predetermined value, the process is ended.
As an optional implementation manner, in an embodiment of the present invention, after the live broadcast server records a subscription relationship between the target audience client and the anchor user instant image service to complete the subscription of the anchor user instant image service, the method further includes:
the live broadcast server determines a service virtual asset value corresponding to the client grade of the target audience client based on the client grade of the target audience client; the higher the client grade of the target audience client is, the smaller the service virtual asset value is; on the contrary, the lower the client grade of the target audience client, the larger the service virtual asset value;
and the live broadcast server deducts the service virtual asset value from the audience virtual account corresponding to the target audience client and adds the deducted service virtual asset value to the service virtual account corresponding to the live broadcast server.
As an optional implementation manner, in an embodiment of the present invention, after the live broadcast server obtains a service subscription request, which is reported by a target audience client and used for signing an instant image service of an anchor user, and before the live broadcast server pushes indication information to the target audience client according to the service subscription request, the method further includes:
the live broadcast server pushes second inquiry information and the service virtual asset value to the target audience client; the second inquiry information is used for inquiring whether a spectator user belonging to the target spectator client side still needs to sign the instant image service of the anchor user;
and if the live broadcast server receives the confirmation reported by the target audience client and still needs to sign the instant image service of the anchor user, the live broadcast server executes the step of pushing the indication information to the target audience client according to the service signing request.
As an optional implementation manner, in an embodiment of the present invention, a live broadcast server synthesizes a registration sound signal of a viewer user and a live broadcast user sound signal pre-configured by a live broadcast client for an instant image service of a live broadcast user, to obtain a verification sound signal, where the method includes:
the method comprises the steps that a live broadcast server determines an alignment point between a registration sound signal of a viewer user and a sound signal of a anchor user pre-configured by an anchor client for an instant image service of the anchor user; the anchor client pre-configures anchor user sound signals for the instant image service of the anchor user, wherein the anchor user sound signals are fixed and invariable, and the audience user registration sound signals have personalized characteristics; the alignment point refers to the starting position of the synthesis of the audience user registration sound signal and the anchor user sound signal, in other words, if the audience user registration sound signal and the anchor user sound signal are to be synthesized, it is required to find out from which audio frame the synthesis starts, and the audio frame can be understood as the alignment point;
and the live broadcast server synthesizes the audience user registration voice signal and the anchor user voice signal into a verification voice signal according to the alignment point.
As an optional implementation manner, in the embodiment of the present invention, the determining, by the live broadcast server, an alignment point between the audience user registration audio signal and the anchor user audio signal pre-configured by the anchor client for the anchor user instant image service includes determining, by the live broadcast server, an alignment point between the audience user registration audio signal and the anchor user audio signal pre-configured by the anchor client for the anchor user instant image service, where the
The live broadcast server calculates a first time length of a registration sound signal of a viewer user and a second time length of a sound signal of a anchor user, which is pre-configured for an instant image service of the anchor user by an anchor client; wherein the first duration represents a duration of time during which the audience user registers the sound of the sound signal; the second duration represents a duration of sound of the anchor user sound signal;
the live broadcast server calculates the difference between the first time length and the second time length;
and the live broadcast server judges whether the difference value is less than or equal to a preset value, if so, any sound signal in the audience user registration sound signal and the anchor user sound signal is subjected to periodic scaling so as to obtain the audience user registration sound signal and the anchor user sound signal with the same final duration, and then the first audio frame of the audience user registration sound signal and the anchor user sound signal with the same final duration is used as an alignment point.
In the embodiment of the present invention, if the difference is smaller than or equal to the preset value, it indicates that the difference between the two sound signals (i.e., the audience user registration sound signal and the anchor user sound signal) is small during input, and at this time, one of the sound signals (e.g., the audience user registration sound signal) may be scaled periodically, for example, periodically compressing the sound signal with a longer duration (i.e., colloquially called fast forwarding) and/or periodically amplifying the sound signal with a shorter duration (i.e., colloquially called slow forwarding), so that the final durations of the two sound signals are the same, and then the first audio frames of the two sound signals are used as an alignment point for alignment.
Wherein, the value range of the preset value can be 0 to 0.1 second.
In the embodiment of the present invention, the periodically scaling, by the live broadcast server, any one of the audience user registration sound signal and the anchor user sound signal includes:
if the first time length of the audience user registration sound signal is shorter than the second time length of the anchor user sound signal, determining a proportion X of the difference value in the first time length of the audience user registration sound signal according to the difference value;
calculating the audio frame number Y of the registered sound signals of the audience users;
calculating a magnification factor Z, which is X (Y/(Y-1));
and according to the amplification factor, performing equal-scale amplification on other audio frames except the first audio frame in the audience user registration sound signal, so that the final duration of the amplified audience user registration sound signal is the same as the second duration of the anchor user sound signal.
For example, if the audience user registration sound signal is 1 second, and there are 100 audio frames, each audio frame is 0.01 second, and the anchor user sound signal is 1.1 second, it is necessary to amplify the audience user registration sound signal to 1.1 second. The first frame is not moved, the subsequent 99 frames are amplified, and the amplification factor Z is firstly determined to be 0.1 (100/(100-1)) -0.101, namely 10.1%; at this time, in the subsequent 99 frames, 10.1% of each frame needs to be amplified, and each amplified frame is 0.01 × 0.01101 (1+ 10.1%), and the length of the 99 frames after amplification is 1.09 seconds, and is 1.1 seconds by adding 0.01 seconds of the first frame without movement, that is, the final duration of the amplified audience user registration sound signal is the same as the second duration of the anchor user sound signal.
In the embodiment of the present invention, if the difference is greater than the preset value, it indicates that the difference between the two sound signals (i.e., the audience user registration sound signal and the anchor user sound signal) during input is large, and if one of the sound signals is periodically scaled at this time, then severe distortion may be caused after scaling, and subsequent verification may cause problems, so a cross-correlation algorithm may be used to determine the alignment point. That is, when the difference is greater than the preset value, the method further includes:
the method comprises the steps that a live broadcast server respectively samples audience user registration sound signals and anchor user sound signals by using the same default sampling frequency to obtain a first sampling group and a second sampling group;
the live broadcast server generates a cross-correlation group according to the default sampling frequency (for example, 8000Hz to 10000Hz), the first sampling group, the second sampling group and the cross-correlation weight; wherein, the cross-correlation weight is positively correlated with the difference (for example, the cross-correlation weight may be 1.5 times of the difference), and the cross-correlation group includes a plurality of values;
the live broadcast server compares a plurality of values in the cross-correlation group to find out the maximum value;
the live broadcast server uses the audio frame position corresponding to the maximum value as an alignment point.
Wherein, the live broadcast server generates a cross-correlation group according to the default sampling frequency, the first sampling group, the second sampling group and the cross-correlation weight, and comprises:
Figure RE-GDA0001716269360000211
wherein S isn[t]Representing a set of cross-correlations, x [ m ]]Representing the mth sample data in the first sample group, y m-t]Represents the (m-t) th sampling data in the second sampling group, t represents the offset of time, t is an integer and takes the value from 0 to m, WtAnd expressing a window function, wherein n is l and f, l is a cross-correlation weight, and f is a default sampling frequency.
The live broadcast server may use the audio frame position corresponding to the maximum numerical value as an alignment point:
after finding the maximum value, the live server can deduce what m is, i.e. which sample data, according to the above formula (1), and then determine which audio frame the sample data is in, and use the audio frame as the alignment point.
As an optional implementation manner, in an embodiment of the present invention, the determining, by the live broadcast server, whether the synthesized sound signal matches a verification sound signal synthesized by the live broadcast server for the target audience client when the target audience client signs up the live image service of the anchor user includes:
the live broadcast server judges whether the alignment points between the synthesized sound signals and the verification sound signals synthesized by the live broadcast server for the target audience client when the target audience client signs the real-time image service of the anchor user are the same;
if the first multi-dimensional vector is the same as the second multi-dimensional vector, the live broadcast server judges whether the first multi-dimensional vector corresponding to the voiceprint feature of the synthesized voice signal is matched with the second multi-dimensional vector corresponding to the voiceprint feature of the verified voice signal, and if the first multi-dimensional vector is matched with the second multi-dimensional vector, the synthesized voice signal is matched with the verified voice signal; if not, determining that the synthesized voice signal is not matched with the verification voice signal;
the first multi-dimensional vector corresponding to the voiceprint features of the synthesized sound signal is composed of a Mel frequency cepstrum coefficient, a linear prediction cepstrum coefficient, a first order difference of the Mel frequency cepstrum coefficient, a first order difference of the linear prediction cepstrum coefficient, a first order difference of energy and a Gammatone filter cepstrum coefficient.
In the embodiment of the invention, after acquiring the voice signal registered by the audience user and the voice signal of the anchor user, the live broadcast server synthesizes the two voice signals to obtain the verification voice signal, and then matches the synthesized voice signal with the verification voice signal, and after the voice signals are synthesized, more verifiable parameters (such as whether the alignment points are the same, whether multidimensional vectors corresponding to voiceprint characteristics are matched and the like) can be generated, so that the safety of verification can be improved.
In the embodiment of the present invention, in the step 607, the synthesis manner of the synthesized voice signal and the synthesis manner of the verified voice signal may be similar, and details of the embodiment of the present invention are not described herein.
Therefore, the method described in fig. 6 can be implemented to realize selective, reliable, safe and accurate push of the instant image of the anchor user; moreover, the method and the system are beneficial to stimulating the anchor user to share more instant images of the anchor user so as to improve the popularity of the channel where the anchor client is located. In addition, after acquiring the audience user authentication sound signal and the anchor user sound signal pre-configured by the anchor client for the anchor user instant image service, the live broadcast server does not verify the two sound signals one by one, but synthesizes the two sound signals to obtain a synthesized sound signal, then matches the synthesized sound signal with the verification sound signal, and generates more verifiable parameters (such as whether the alignment points are the same or not, whether multidimensional vectors corresponding to voiceprint characteristics are matched or not and the like) after the sound signals are synthesized.
It will be understood by those skilled in the art that all or part of the steps in the methods of the embodiments described above may be implemented by hardware instructions of a program, and the program may be stored in a computer-readable storage medium, where the storage medium includes Read-Only Memory (ROM), Random Access Memory (RAM), Programmable Read-Only Memory (PROM), Erasable Programmable Read-Only Memory (EPROM), One-time Programmable Read-Only Memory (OTPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Compact Disc Read-Only Memory (CD-ROM), or other Memory, such as a magnetic disk, or a combination thereof, A tape memory, or any other medium readable by a computer that can be used to carry or store data.
The method for displaying the real-time image of the anchor user caused by giving away the virtual resource disclosed by the embodiment of the invention is described in detail, a specific example is applied in the text to explain the principle and the implementation mode of the invention, and the description of the embodiment is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims (9)

1. A method for displaying an instant image of an anchor user resulting from a virtual resource donation, the method comprising:
the method comprises the steps that a live broadcast server identifies the value of virtual resources donated to a main broadcast client side by a target audience client side in each audience client side in the process of pushing an event live broadcast picture reported by the main broadcast client side to each audience client side in a channel where the main broadcast client side is located to display;
the live broadcast server judges whether the value of the virtual resource is equal to or exceeds the value of a specified resource pre-configured for the live broadcast user instant image service by the anchor client;
if yes, the live broadcast server superimposes a preset first prompt icon to a first designated position on the event live broadcast picture displayed by the target audience client; the first prompt icon is used for triggering and watching the instant image of the anchor user;
the live broadcast server acquires an instant image watching request of a main broadcast user reported by the target audience client, wherein the instant image watching request of the main broadcast user is reported to the live broadcast server when the target audience client detects that the first prompt icon superposed at the first designated position on the event live broadcast picture displayed by the target audience client is selected;
the live broadcast server superimposes the live image of the anchor user reported by the anchor client to a second appointed position on the event live broadcast picture displayed by the target audience client;
after the live broadcast server obtains the viewing request of the live broadcast user instant image reported by the target audience client, and before the live broadcast server superimposes the live broadcast user instant image reported by the live broadcast client to a second designated position on the event live broadcast picture displayed by the target audience client, the method further comprises the following steps:
the live broadcast server pushes prompt information to the target audience client, wherein the prompt information is used for prompting the target audience client to collect and report audience user authentication sound signals sent by audience users to which the target audience client belongs;
the live broadcast server synthesizes the audience user authentication sound signal and a anchor user sound signal pre-configured by the anchor client for the anchor user instant image service to obtain a synthesized sound signal;
and the live broadcast server judges whether the synthesized sound signal is matched with a verification sound signal synthesized by the live broadcast server for the target audience client when the target audience client signs the live image service of the anchor user, and if the synthesized sound signal is matched with the verification sound signal, the step of superposing the instant image of the anchor user reported by the anchor client to a second designated position on the live competition picture displayed by the target audience client is executed.
2. The method as claimed in claim 1, wherein the live broadcasting server superimposes the live image of the anchor user reported by the anchor client on the live event display screen displayed by the target audience client after the second designated position, and the method further comprises:
the live broadcast server changes the first prompt icon superposed at the first designated position on the event live broadcast picture displayed by the target audience client into a preset second prompt icon, and the second prompt icon is used for triggering and hiding the instant image of the anchor user;
the live broadcast server acquires an anchor user instant image hiding request reported by the target audience client, wherein the anchor user instant image hiding request is reported to the live broadcast server when the target audience client detects that the second prompt icon superposed at the first designated position on the event live broadcast picture displayed by the target audience client is selected;
the live broadcast server controls the live broadcast user instant image which is superimposed to a second appointed position on the event live broadcast picture displayed by the target audience client to be hidden according to the live broadcast user instant image hiding request;
and after the live broadcast server controls the live broadcast user instant image which is superimposed to a second appointed position on the event live broadcast picture displayed by the target audience client to be hidden, the live broadcast server changes the second prompt icon superimposed to the first appointed position on the event live broadcast picture displayed by the target audience client back to the first prompt icon.
3. The method for displaying an instant image of a host user by virtual resource gifting as claimed in claim 2, wherein the live broadcast server changes the second prompt icon overlaid at the first designated position on the live event display screen displayed by the target viewer client back to the first prompt icon, and further comprising:
the live broadcast server acquires a single virtual asset consumption value pre-configured by the anchor client for the live image service of the anchor user; the single virtual asset consumption value is a virtual asset consumption value consumed by any client when any client watches the real-time image of the anchor user once;
and the live broadcast server deducts the single virtual asset consumption value from the audience virtual account corresponding to the target audience client, and adds the deducted single virtual asset consumption value to the anchor virtual account of the anchor client.
4. The method as claimed in claim 3, wherein after the live broadcast server obtains the live broadcast user instant image viewing request reported by the target audience client, and before the live broadcast server pushes the prompt message to the target audience client, the method further comprises:
the live broadcast server pushes first inquiry information and the single virtual asset consumption value pre-configured by the anchor client for the anchor user instant image service to the target audience client; the first inquiry information is used for inquiring whether the audience user to which the target audience client belongs still needs to watch the live image of the anchor user;
and if the live broadcast server receives response information which is reported by the target audience client and confirms that the live image of the anchor user still needs to be watched, the live broadcast server executes the step of pushing the prompt information to the target audience client.
5. The method of claim 4, wherein before the live server obtains the live user live image viewing request reported by the target viewer client, the method further comprises:
the live broadcast server acquires a service signing request which is reported by the target audience client and is used for signing the instant image service of the anchor user; the service signing request also comprises the client grade of the target audience client;
the live broadcast server reads the client grade of the target audience client from the service signing request;
the live broadcast server judges whether the client grade of the target audience client is higher than the grade designated by the anchor client;
if the client level of the target audience client is higher than the level designated by the anchor client, the live broadcast server pushes indication information to the target audience client according to the service signing request, wherein the indication information is used for indicating the target audience client to collect and report an audience user registration sound signal sent by an audience user to which the target audience client belongs;
the live broadcast server synthesizes the audience user registration sound signal and a anchor user sound signal which is pre-configured by the anchor client for an anchor user instant image service to obtain a verification sound signal; wherein the verification sound signal is a verification sound signal synthesized by the live broadcast server for the target audience client when the target audience client signs the anchor user instant image service;
and the live broadcast server records the signing relation between the target audience client and the anchor user instant image service so as to complete the signing of the anchor user instant image service.
6. The method of claim 5, wherein the live server records the subscription relationship between the target viewer client and the anchor user instant image service, so that after the subscription of the anchor user instant image service is completed, the method further comprises:
the live broadcast server determines a service virtual asset value corresponding to the client grade of the target audience client based on the client grade of the target audience client; wherein the higher the client level of the target viewer client, the smaller the service virtual asset value; conversely, the lower the client level of the target viewer client, the greater the service virtual asset value;
and the live broadcast server deducts the service virtual asset value from the audience virtual account corresponding to the target audience client and adds the deducted service virtual asset value to the service virtual account corresponding to the live broadcast server.
7. The method as claimed in claim 6, wherein after the live server determines that the client level of the target audience client is higher than the level specified by the anchor client, and before the live server pushes indication information to the target audience client according to the service subscription request, the method further comprises:
the live broadcast server pushes second inquiry information and the service virtual asset value to the target audience client; the service virtual asset value is a service virtual asset value which needs to be received by the live broadcast server each time the anchor user instant image service is signed, and the second query information is used for querying whether a viewer user to which the target viewer client belongs still needs to sign the anchor user instant image service;
and if the live broadcast server receives the confirmation reported by the target audience client and still needs to sign the instant image service of the anchor user, the live broadcast server executes the step of pushing the indication information to the target audience client according to the service signing request.
8. The method as claimed in any one of claims 5-7, wherein the step of the live server synthesizing the audience user registration audio signal and the anchor user audio signal pre-configured by the anchor client for the anchor user instant image service to obtain the verification audio signal comprises:
the live broadcast server determines an alignment point between the audience user registration sound signal and a anchor user sound signal pre-configured by the anchor client for an anchor user instant image service; wherein, the alignment point refers to the starting position of the synthesis of the audience user registration voice signal and the anchor user voice signal;
and the live broadcast server synthesizes the audience user registration sound signal and the anchor user sound signal into a verification sound signal according to the alignment point.
9. The method as claimed in claim 8, wherein the step of the live server determining whether the synthesized audio signal matches the verification audio signal synthesized by the live server for the target audience client when the target audience client subscribes to the anchor user instant image service comprises:
the live broadcast server judges whether the alignment points between the synthesized sound signals and the verification sound signals synthesized by the live broadcast server for the target audience client are the same when the target audience client signs the live image service of the anchor user;
if the two multi-dimensional vectors are the same, the live broadcast server judges whether a first multi-dimensional vector corresponding to the voiceprint feature of the synthesized voice signal is matched with a second multi-dimensional vector corresponding to the voiceprint feature of the verified voice signal, and if the two multi-dimensional vectors are matched, the synthesized voice signal is matched with the verified voice signal; if not, determining that the synthesized voice signal does not match the verification voice signal;
the first multi-dimensional vector corresponding to the voiceprint feature of the synthetic sound signal is composed of a mel-frequency cepstrum coefficient, a linear prediction cepstrum coefficient, a first order difference of the mel-frequency cepstrum coefficient, a first order difference of the linear prediction cepstrum coefficient, energy, a first order difference of the energy and a Gammatone filter cepstrum coefficient.
CN201810551338.4A 2018-05-31 2018-05-31 Method for displaying real-time image of anchor user caused by virtual resource presentation Active CN108768681B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810551338.4A CN108768681B (en) 2018-05-31 2018-05-31 Method for displaying real-time image of anchor user caused by virtual resource presentation

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810551338.4A CN108768681B (en) 2018-05-31 2018-05-31 Method for displaying real-time image of anchor user caused by virtual resource presentation

Publications (2)

Publication Number Publication Date
CN108768681A CN108768681A (en) 2018-11-06
CN108768681B true CN108768681B (en) 2021-01-01

Family

ID=64001298

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810551338.4A Active CN108768681B (en) 2018-05-31 2018-05-31 Method for displaying real-time image of anchor user caused by virtual resource presentation

Country Status (1)

Country Link
CN (1) CN108768681B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109819308B (en) * 2019-02-18 2021-08-10 广州酷狗计算机科技有限公司 Virtual resource acquisition method, device, terminal, server and storage medium
CN111405300A (en) * 2020-02-28 2020-07-10 北京达佳互联信息技术有限公司 Pendant display method and device, electronic equipment and computer readable storage medium

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1808567A (en) * 2006-01-26 2006-07-26 覃文华 Voice-print authentication device and method of authenticating people presence
CN104408362A (en) * 2014-10-29 2015-03-11 深圳市东信时代信息技术有限公司 Permission management system and method
JP5724139B2 (en) * 2008-10-30 2015-05-27 カムセ、インコーポレーテッド P2P Internet live broadcast service system and method for forming a P2P tree structure according to the number of sessions
CN106101808A (en) * 2016-07-13 2016-11-09 乐视控股（北京）有限公司 A kind of net cast method and device
CN106203000A (en) * 2016-07-13 2016-12-07 乐视控股（北京）有限公司 A kind of offer method of live content, it is provided that device and electronic equipment thereof
CN106534876A (en) * 2016-10-11 2017-03-22 北京小米移动软件有限公司 Target user determining method and target user determining device
CN107295354A (en) * 2017-05-15 2017-10-24 武汉斗鱼网络科技有限公司 Connect the live method for building up of wheat and device in a kind of network direct broadcasting

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1808567A (en) * 2006-01-26 2006-07-26 覃文华 Voice-print authentication device and method of authenticating people presence
JP5724139B2 (en) * 2008-10-30 2015-05-27 カムセ、インコーポレーテッド P2P Internet live broadcast service system and method for forming a P2P tree structure according to the number of sessions
CN104408362A (en) * 2014-10-29 2015-03-11 深圳市东信时代信息技术有限公司 Permission management system and method
CN106101808A (en) * 2016-07-13 2016-11-09 乐视控股（北京）有限公司 A kind of net cast method and device
CN106203000A (en) * 2016-07-13 2016-12-07 乐视控股（北京）有限公司 A kind of offer method of live content, it is provided that device and electronic equipment thereof
CN106534876A (en) * 2016-10-11 2017-03-22 北京小米移动软件有限公司 Target user determining method and target user determining device
CN107295354A (en) * 2017-05-15 2017-10-24 武汉斗鱼网络科技有限公司 Connect the live method for building up of wheat and device in a kind of network direct broadcasting

Also Published As

Publication number Publication date
CN108768681A (en) 2018-11-06

Similar Documents

Publication Publication Date Title
CN110662083B (en) Data processing method and device, electronic equipment and storage medium
CN112714330B (en) Gift presenting method and device based on live broadcast with wheat and electronic equipment
CN109089154A (en) A kind of video extraction method, apparatus, equipment and medium
CN106534994B (en) Live broadcast interaction method and device
CN112218103A (en) Live broadcast room interaction method and device, electronic equipment and storage medium
CN109089127A (en) A kind of video-splicing method, apparatus, equipment and medium
US20140059577A1 (en) Method and apparatus for generating meta data of content
CN111182318B (en) Contribution score generation method and device in live broadcast, electronic equipment and storage medium
CN109089128A (en) A kind of method for processing video frequency, device, equipment and medium
CN110472099B (en) Interactive video generation method and device and storage medium
CN111464819B (en) Live image detection method, device, equipment and storage medium
CN112653902B (en) Speaker recognition method and device and electronic equipment
CN103702226A (en) Displaying method and device of direct broadcasting client end channel information
CN108768681B (en) Method for displaying real-time image of anchor user caused by virtual resource presentation
CN114025189B (en) Virtual object generation method, device, equipment and storage medium
CN110121082B (en) Method, device, equipment and readable storage medium for displaying live broadcast room ranking information
WO2017166472A1 (en) Advertisement data matching method, device, and system
CN108174227B (en) Virtual article display method and device and storage medium
CN112383809A (en) Subtitle display method, device and storage medium
CN110337041B (en) Video playing method and device, computer equipment and storage medium
CN108768680B (en) Method for pushing instant images of anchor user during event live broadcast
CN111083504B (en) Interaction method, device and equipment
CN110958463A (en) Method, device and equipment for detecting and synthesizing virtual gift display position
CN111698261B (en) Video playing method, device, equipment and storage medium based on streaming media
CN113099311B (en) Method for playing data, electronic device and computer storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant