CN114640864A - Method, device, computer equipment and medium for playing small video in live broadcast room - Google Patents

Method, device, computer equipment and medium for playing small video in live broadcast room Download PDF

Info

Publication number
CN114640864A
CN114640864A CN202210226220.0A CN202210226220A CN114640864A CN 114640864 A CN114640864 A CN 114640864A CN 202210226220 A CN202210226220 A CN 202210226220A CN 114640864 A CN114640864 A CN 114640864A
Authority
CN
China
Prior art keywords
small video
live broadcast
video
small
live
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210226220.0A
Other languages
Chinese (zh)
Inventor
陈涛
袁小明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Cubesili Information Technology Co Ltd
Original Assignee
Guangzhou Cubesili Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Cubesili Information Technology Co Ltd filed Critical Guangzhou Cubesili Information Technology Co Ltd
Priority to CN202210226220.0A priority Critical patent/CN114640864A/en
Publication of CN114640864A publication Critical patent/CN114640864A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/23418—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/044—Recurrent networks, e.g. Hopfield networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/233—Processing of audio elementary streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/239—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
    • H04N21/2393—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25866—Management of end-user data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/262—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/437—Interfacing the upstream path of the transmission network, e.g. for transmitting client requests to a VOD server
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213—Monitoring of end-user related data
    • H04N21/44218—Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/4508—Management of client data or end-user data

Abstract

The application relates to the technical field of network live broadcast, and provides a method and a device for playing a small video in a live broadcast room, computer equipment and a storage medium, wherein the method comprises the following steps: a live streaming server acquires a live data stream of a target live broadcasting room; when the frequency values of a plurality of groups of audio data in the live broadcast data stream are all within a preset threshold range, no human face exists in a plurality of frames of video pictures, and no picture change exists in a plurality of frames of video pictures, a live broadcast stream server sends a small video playing instruction to a spectator client side which is added into a target live broadcast room; the audience client receives the small video playing instruction; sending the small video acquisition request to a small video server; the small video server receives the small video acquisition request; sending the small video data to the viewer client; and the audience client receives the small video data and plays the small video on the interface of the live broadcast room, so that the situation that the audience leaves the live broadcast room when feeling boring is avoided, and the audience retention rate of the live broadcast room is improved.

Description

Method, device, computer equipment and medium for playing small video in live broadcast room
Technical Field
The embodiment of the application relates to the technical field of network live broadcast, in particular to a method and a device for playing a small video in a live broadcast room, computer equipment and a storage medium.
Background
With the rapid development of internet technology, live webcasting is more and more popular, and because live webcasting has the advantages of wide audience, simple and various acquisition modes, strong interactivity, strong space-time adaptability and the like, live webcasting is more and more popular with people. The audience can install the live broadcast application program on the terminal equipment, the live broadcast application program is used for entering live broadcast rooms of different anchor broadcasts to watch the anchor broadcast, and the audience can interact with the anchor broadcast or other audiences in the process of watching the anchor broadcast.
However, when the viewer enters the live broadcast room to watch the anchor live broadcast, the anchor does not always have live interaction with the viewer in front of the scenes, and the anchor may temporarily leave the live broadcast due to temporary events, such as going to a toilet, changing people, etc. When the anchor is temporarily away from the live room, this period of meaningless live pictures, which is several tens of seconds as long as several minutes, can result in poor viewing experience of the viewer, and thus, low retention rate of the viewer.
Disclosure of Invention
The embodiment of the application provides a method, a device, computer equipment and a storage medium for playing a small video in a live broadcast room, which can improve the retention rate of audiences, and the technical scheme is as follows:
in a first aspect, an embodiment of the present application provides a method for playing a small video in a live broadcast room, including the steps of:
a live streaming server acquires a live data stream of a target live broadcasting room; the live broadcast data stream comprises a plurality of frames of video pictures and a plurality of groups of corresponding audio data, and each frame of the video pictures corresponds to one group of the audio data;
when the frequency values of a plurality of groups of audio data are all within a preset threshold range, no human face exists in a plurality of frames of video pictures, and no picture change exists in the plurality of frames of video pictures, the live streaming server sends a small video playing instruction to a spectator client side which joins in the target live broadcasting room;
the audience client receives the small video playing instruction; acquiring a main broadcasting identifier of the target live broadcasting room according to the small video playing instruction; generating a small video acquisition request according to the anchor identifier, and sending the small video acquisition request to a small video server;
the small video server receives the small video acquisition request; acquiring the anchor identification according to the small video acquisition request; acquiring corresponding small video data according to the anchor identification; sending the small video data to the viewer client;
the viewer client receiving the small video data; and playing the small video on the interface of the live broadcast room according to the small video data.
In a second aspect, an embodiment of the present application provides an apparatus for playing a small video in a live broadcast room, including:
the live broadcast data stream acquisition module is used for the live broadcast stream server to acquire a live broadcast data stream of a target live broadcast room; the live broadcast data stream comprises a plurality of frames of video pictures and a plurality of groups of corresponding audio data, and each frame of the video pictures corresponds to one group of the audio data;
the playing instruction sending module is used for sending a small video playing instruction to a spectator client side which joins the target live broadcast room by the live broadcast streaming server when the frequency values of a plurality of groups of audio data are all within a preset threshold range, no human face exists in a plurality of frames of video pictures, and no picture change exists in the plurality of frames of video pictures;
a playing instruction receiving module, configured to receive the small video playing instruction by the viewer client; acquiring a main broadcasting identifier of the target live broadcasting room according to the small video playing instruction; generating a small video acquisition request according to the anchor identifier, and sending the small video acquisition request to a small video server;
the small video sending module is used for receiving the small video obtaining request by the small video server; acquiring the anchor identification according to the small video acquisition request; acquiring corresponding small video data according to the anchor identification; sending the small video data to the viewer client;
the small video playing module is used for receiving the small video data by the audience client; and playing the small video on the interface of the live broadcast room according to the small video data.
In a third aspect, embodiments of the present application provide a computer device, a processor, a memory, and a computer program stored in the memory and executable on the processor, where the processor implements the steps of the method according to the first aspect when executing the computer program.
In a fourth aspect, embodiments of the present application provide a computer-readable storage medium storing a computer program, which when executed by a processor, performs the steps of the method according to the first aspect.
The method comprises the steps that a live broadcast data stream of a target live broadcast room is obtained through a live broadcast stream server; the live broadcast data stream comprises a plurality of frames of video pictures and a plurality of groups of corresponding audio data, and each frame of the video pictures corresponds to one group of the audio data; when the frequency values of a plurality of groups of audio data are all within a preset threshold range, no human face exists in a plurality of frames of video pictures, and no picture change exists in the plurality of frames of video pictures, the live streaming server sends a small video playing instruction to a spectator client side which joins in the target live broadcasting room; the audience client receives the small video playing instruction; acquiring a main broadcasting identifier of the target live broadcasting room according to the small video playing instruction; generating a small video acquisition request according to the anchor identifier, and sending the small video acquisition request to a small video server; the small video server receives the small video acquisition request; acquiring the anchor identification according to the small video acquisition request; acquiring corresponding small video data according to the anchor identification; sending the small video data to the viewer client; the viewer client receiving the small video data; and playing the small video on the interface of the live broadcast room according to the small video data. This application carries out audio data and video picture's real-time detection through the live stream to the live broadcast of target live broadcast room, confirms when the live broadcast stream is meaningless live broadcast stream, control joining the spectator's customer end broadcast small video of target live broadcast room to avoid spectator to feel bored and leave the live broadcast room, improved the spectator retention rate of live broadcast room, simultaneously, also improved the broadcast flow of small video.
For a better understanding and implementation, the technical solutions of the present application are described in detail below with reference to the accompanying drawings.
Drawings
Fig. 1 is a schematic view of an application scenario of a method for playing a small video in a live broadcast room according to an embodiment of the present application;
fig. 2 is a schematic flowchart of a method for playing a small video in a live broadcast room according to an embodiment of the present application;
fig. 2a is a schematic display diagram of playing a small video in a live broadcast room according to an embodiment of the present application;
fig. 2b is a schematic full-screen display diagram of a small video played in a live broadcast room according to an embodiment of the present application;
fig. 3 is a schematic flowchart of S21-S24 in the method for playing a small video in a live broadcast room according to the embodiment of the present application;
fig. 4 is a schematic flowchart of S201 to S202 in a method for playing a small video in a live broadcast room according to an embodiment of the present application;
fig. 5 is a schematic flowchart of S31 to S32 in the method for playing a small video in a live broadcast room according to the embodiment of the present application;
fig. 6 is a schematic flowchart of S41-S42 in the method for playing a small video in a live broadcast room according to the embodiment of the present application;
fig. 7 is a schematic flowchart of S421 to S422 in the method for playing a small video in a live broadcast room according to the embodiment of the present application;
fig. 8 is a schematic flowchart of S51-S53 in the method for playing a small video in a live broadcast room according to the embodiment of the present application;
fig. 9 is a schematic flowchart of S621 to S622 in the method for playing a small video in a live broadcast room according to the embodiment of the present application;
fig. 10 is a schematic structural diagram of an apparatus for playing a small video in a live broadcast room according to an embodiment of the present application;
fig. 11 is a schematic structural diagram of a computer device according to an embodiment of the present application.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. The following description refers to the accompanying drawings in which the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in this application and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.
It is to be understood that although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present application. The word "if/if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context.
Referring to fig. 1, fig. 1 is a schematic view of an application scenario of a method for playing a small video in a live broadcast room according to an embodiment of the present application, where the application scenario includes an anchor client 101, a server 102, and a viewer client 103, and the anchor client 101 and the viewer client 103 interact with each other through the server 102.
The proposed clients of the embodiment of the present application include the anchor client 101 and the viewer client 103.
It is noted that there are many understandings of the concept of "client" in the prior art, such as: it may be understood as an application program installed in a computer device, or may be understood as a hardware device corresponding to a server.
In the embodiments of the present application, the term "client" refers to a hardware device corresponding to a server, and more specifically, refers to a computer device, such as: smart phones, smart interactive tablets, personal computers, and the like.
When the client is a mobile device such as a smart phone and an intelligent interactive tablet, a user can install a matched mobile application program on the client and can also access a Web application program on the client.
When the client is a non-mobile device such as a Personal Computer (PC), the user can install a matching PC application on the client, and can also access a Web application on the client.
The mobile application refers to an application program that can be installed in the mobile device, the PC application refers to an application program that can be installed in the non-mobile device, and the Web application refers to an application program that needs to be accessed through a browser.
Specifically, the Web application program may be divided into a mobile version and a PC version according to the difference of the client types, and the page layout modes and the available server support of the two versions may be different.
In the embodiment of the application, the types of live application programs provided to the user are divided into a mobile end live application program, a PC end live application program and a Web end live application program. The user can autonomously select a mode of participating in the live webcasting according to different types of the client adopted by the user.
The present application can divide the clients into a main broadcasting client 101 and a spectator client 103, depending on the identity of the user using the clients. It should be noted that the viewer client 103 and the anchor client 101 are only divided according to the user identity, and in practical applications, the functions of the viewer client 103 and the anchor client 101 may be executed by the same client at different times. Therefore, the same client can be used as the viewer client 103 when watching the network live broadcast, and can be used as the anchor client 101 when publishing the live video.
The anchor client 101 is a client that transmits a live video, and is generally a client used by an anchor (i.e., a live anchor user) in live streaming.
The viewer client 103 refers to an end that receives and views webcast video, and is typically a client employed by a viewer viewing video in webcast (i.e., a live viewer user).
The hardware at which the anchor client 101 and viewer client 103 are directed is essentially a computer device, and in particular, as shown in fig. 1, it may be a type of computer device such as a smart phone, smart interactive tablet, and personal computer. Both the anchor client 101 and the viewer client 103 may access the internet via known network access means to establish a data communication link with the server 102.
Server 102 acts as a business server and may be responsible for further connecting related live streaming servers, small video servers, and other servers providing related support, etc. to form a logically associated server cluster to serve related end devices, such as anchor client 101 and viewer client 103 shown in fig. 1.
In the embodiment of the present application, the anchor client 101 and the audience client 103 may join in the same live broadcast room (i.e., a live broadcast channel), where the live broadcast room is a chat room implemented by means of an internet technology, and generally has an audio/video broadcast control function. The anchor user is live in the live room through the anchor client 101, and the audience of the audience client 103 can log in the server 102 to enter the live room to watch the live.
In the live broadcast room, interaction between the anchor and the audience can be realized through known online interaction modes such as voice, video, characters and the like, generally, the anchor user performs programs for the audience in the form of audio and video streams, and economic transaction behaviors can also be generated in the interaction process. Of course, the application form of the live broadcast room is not limited to online entertainment, and can also be popularized to other relevant scenes, such as: user pairing interaction scenarios, video conference scenarios, product recommendation sales scenarios, and any other scenario requiring similar interaction.
Specifically, the process of the viewer watching the live broadcast is as follows: the viewer can click to access a live application (e.g., YY) installed on the viewer client 103 and choose to enter any one of the live rooms, and the viewer client 103 is triggered to load a live room interface for the viewer, wherein the live room interface includes a plurality of interactive components, and the viewer can watch live in the live room by loading the interactive components and perform various online interactions.
When the audience enters the live broadcasting room of the anchor to watch the live broadcasting, the anchor does not always carry out live broadcasting interaction with the audience in front of the shot, and the anchor can temporarily leave the live broadcasting due to temporary events, such as going to a toilet, changing people and the like. In a period of time when the anchor leaves the live broadcast room temporarily, the video picture in the live broadcast stream data sent by the anchor client to the server has no anchor portrait, the audio data has no anchor voice, the audience client acquires the live broadcast stream data from the server to watch or listen, the live broadcast room interface of the audience client does not display the anchor portrait any more and does not listen to the anchor voice, and therefore the audience watching live broadcast experience is poor, and the audience retention rate is low.
Therefore, the embodiment of the application provides a method for playing a small video in a live broadcast room, wherein a server and a spectator client are used as execution subjects, and the server comprises a live broadcast streaming server and a small video server.
Referring to fig. 2, fig. 2 is a schematic flowchart illustrating a method for playing a small video in a live broadcast room according to a first embodiment of the present application, where the method includes the following steps:
s10: a live streaming server acquires a live data stream of a target live broadcasting room; the live broadcast data stream comprises a plurality of frames of video pictures and a plurality of groups of corresponding audio data, and each frame of the video pictures corresponds to one group of the audio data.
In the embodiment of the application, the target live broadcasting room is a live broadcasting room allowing the small video of the anchor to be played on the live broadcasting room interface when the anchor temporarily leaves the live broadcasting.
Specifically, when the anchor creates the live broadcast room, the pop window prompts whether the anchor temporarily leaves the live broadcast, the information of the small video of the anchor is played on the interface of the live broadcast room, if the anchor allows, after the anchor creates the live broadcast room, the live broadcast room is used as a target live broadcast room, and meanwhile, the identification of the target live broadcast room is sent to the live broadcast stream server, so that the live broadcast stream server obtains the live broadcast data stream of the target live broadcast room. The video pictures are live pictures collected through a camera of the anchor terminal equipment, and the audio data are anchor voice obtained by a microphone of the anchor terminal equipment and background music and special sound obtained by a sound card of the anchor terminal equipment.
S20: and when the frequency values of a plurality of groups of audio data are all within a preset threshold range, no human face exists in a plurality of frames of the video pictures, and no picture change exists in the plurality of frames of the video pictures, the live streaming server sends a small video playing instruction to a spectator client side which joins the target live broadcasting room.
In this embodiment of the application, the preset threshold range may be 20Hz to 300Hz, frequency values of a plurality of sets of the audio data are detected, and if the frequency value of each set of the audio data is within the preset threshold range, the audio data may be regarded as background noise, that is, monotonous and unchangeable audio data. And after the monotonous and unchangeable audio data is detected, carrying out face detection and still picture detection on a plurality of frames of video pictures, if no face exists in each frame of video picture and each frame of video picture is a still picture, sending a small video playing instruction to a spectator client side added into the target live broadcast room by the live broadcast stream server, wherein the small video playing instruction is used for instructing the spectator client side to play a small video of the anchor broadcast of the target live broadcast room.
S30: the audience client receives the small video playing instruction; acquiring a main broadcasting identifier of the target live broadcasting room according to the small video playing instruction; and generating a small video acquisition request according to the anchor mark, and sending the small video acquisition request to a small video server.
In the embodiment of the application, the anchor identification is an ID of the anchor, and the small video server stores one or more small videos associated with the ID of the anchor in advance. For example, the anchor can record a small video with a certain duration through a video software APP, and upload the small video to the small video server.
S40: the small video server receives the small video acquisition request; acquiring the anchor identification according to the small video acquisition request; acquiring corresponding small video data according to the anchor identification; and sending the small video data to the audience client.
In the embodiment of the application, the anchor can clip the live highlight in the live broadcast process to form a small video, and the small video is uploaded to a small video server. The live broadcast wonderful segment can be a killing segment in the live broadcast process of games, a goal scoring segment in the live broadcast process of sports, an atmosphere activity and fun segment in the live broadcast process of entertainment and the like. The anchor can also record the small video by using a camera or a camera of the terminal equipment, and upload the recorded small video to a small video server. And the small video server inquires corresponding small video data according to the anchor identification, and if the inquiry is successful, the small video data is sent to the audience client. The small video data may include a video identification of the small video, a video address of the small video, a video length of the small video, and the like. And if the query fails, sending a failure result to the audience client, wherein the failure result is used for indicating that no small video corresponding to the anchor identification exists on the small video server, and the audience client cannot receive the small video data.
S50: the viewer client receiving the small video data; and playing the small video on the interface of the live broadcast room according to the small video data.
In the embodiment of the present application, please refer to fig. 2a, which is a schematic diagram illustrating a display of a small video played on a live broadcasting interface. And the audience client pulls the corresponding small video from the small video server according to the video identification of the small video, the video address of the small video and the video length of the small video, and displays and plays the small video on a live broadcast interface.
The method comprises the steps that a live broadcast data stream of a target live broadcast room is obtained through a live broadcast stream server; the live broadcast data stream comprises a plurality of frames of video pictures and a plurality of groups of corresponding audio data, and each frame of the video pictures corresponds to one group of the audio data; when the frequency values of a plurality of groups of audio data are all within a preset threshold range, no human face exists in a plurality of frames of video pictures, and no picture change exists in the plurality of frames of video pictures, the live streaming server sends a small video playing instruction to a spectator client side which joins in the target live broadcasting room; the audience client receives the small video playing instruction; acquiring a main broadcasting identifier of the target live broadcasting room according to the small video playing instruction; generating a small video acquisition request according to the anchor identifier, and sending the small video acquisition request to a small video server; the small video server receives the small video acquisition request; acquiring the anchor identification according to the small video acquisition request; obtaining corresponding small video data according to the anchor identification; sending the small video data to the audience client; the viewer client receives the small video data; and playing the small video on the interface of the live broadcast room according to the small video data. This application carries out audio data and video picture's real-time detection through the live stream to the live broadcast of target live broadcast room, confirms when the live broadcast stream is meaningless live broadcast stream, control joining the spectator's customer end broadcast small video of target live broadcast room to avoid spectator to feel bored and leave the live broadcast room, improved the spectator retention rate of live broadcast room, simultaneously, also improved the broadcast flow of small video.
In an alternative embodiment, referring to fig. 3, the step S20 includes steps S21 to S24, which are as follows:
s21: the live streaming server acquires the frequency value of each audio signal in each group of audio data and judges whether the frequency value of each audio signal is within a preset threshold range;
s22: the live streaming server respectively inputs each frame of the video image into a face detection model for face detection, and a face detection result of a corresponding frame is obtained; the face detection result is used for indicating whether a face exists in the video picture;
s23: for each frame of video picture, the live streaming server acquires a color difference value between the live streaming server and a corresponding pixel point of the video picture of an adjacent frame; counting the number of pixel points with the color difference value smaller than a preset color difference value threshold; if the number of the pixel points is larger than a preset pixel point number threshold value, determining that the video picture of the corresponding frame is a static picture;
s24: and when the frequency values of the groups of audio data are all within a preset threshold range, no human face exists in the frames of video pictures, and no picture change exists in the frames of video pictures, the live streaming server sends a small video playing instruction to the audience client side which joins the target live broadcasting room.
In this embodiment of the application, the live streaming server may perform fast fourier transform on each audio signal in each group of audio data to obtain an amplitude spectrum corresponding to each audio signal, and may obtain a frequency value of each audio signal according to the amplitude spectrum, thereby determining whether the frequency value of each audio signal is within a preset threshold range. The live streaming server can input each frame of video picture into the face detection model respectively for face detection, and a face detection result is obtained. The face detection model is a face detection model based on a deep neural network, and a specific network structure of the deep neural network can be selected as required according to a calculation task, for example, the specific network structure of the deep neural network can be a BP neural network or a UNET neural network, which is not limited in the present application. The live streaming server may obtain a color difference value of a corresponding pixel in a current frame video picture and a previous frame video picture, for example, the color difference value may be R, G, B color difference values of the corresponding pixel. Counting the number of pixel points with the color difference value smaller than a preset color difference value threshold, and if the number of the pixel points is larger than a preset pixel point number threshold, determining that the video picture of the corresponding frame is a static picture. The anchor live broadcast state of the target live broadcast room can be quickly identified through frequency detection of audio data, face detection of video pictures and static picture detection.
In an optional embodiment, the live data stream is a data stream within a preset unit time. Referring to fig. 4, step S20 includes steps S201 to S202, which are as follows:
s201: when the frequency values of a plurality of groups of audio data are all within a preset threshold value range, no human face exists in a plurality of frames of video pictures, and no picture change exists in the plurality of frames of video pictures, the live streaming server marks the live streaming as a meaningless data stream;
s202: and starting timing from the time of receiving the live broadcast data stream, and if the live broadcast data streams received within the preset time are all meaningless data streams, the live broadcast stream server sends a small video playing instruction to the audience client terminal added in the target live broadcast room.
In this application embodiment, live broadcast stream server acquires live broadcast data stream in real time, from receiving the time of live broadcast data stream begins timing, for example, acquires the live broadcast data stream in 1s earlier, to in 1s audio data and video frame picture in the live broadcast data stream detect, work as in 1s a plurality of groups in the live broadcast data stream audio data's frequency value all is in predetermineeing threshold value within range, a plurality of frame video frame does not all have people's face and a plurality of frame when video frame all does not have the picture change, with in 1s live broadcast data stream mark is meaningless data stream, and the anchor broadcast is in meaningless live broadcast state promptly, and for example the anchor broadcast temporarily leaves the live broadcast room. And then, acquiring the live broadcast data stream in the next 1s, if the live broadcast data streams in the continuous 10s are all meaningless data streams, sending a small video playing instruction to a viewer client side added in the target live broadcast room by the live broadcast stream server, and avoiding the misidentification of the main broadcast live broadcast state caused by the over-short detection time by detecting the meaningless data streams in the preset time.
In an alternative embodiment, referring to fig. 5, the step S30 includes steps S31 to S32, which are as follows:
s31: the audience client side obtains a stream identification of a live broadcast data stream of a live broadcast room and/or monitors a trigger operation of a live broadcast room interface; wherein, a path of live data stream corresponds to the unique stream identifier, and the path of live data stream is a live data stream generated by a main broadcast client received by the audience client;
s32: and if the live broadcast data stream is determined to be a single-channel live broadcast stream according to the stream identification and/or no trigger operation of a gift sending key in the live broadcast room interface is monitored, the audience client side obtains an anchor broadcast identification of the target live broadcast room, generates a small video obtaining request according to the anchor broadcast identification, and sends the small video obtaining request to a small video server.
In the embodiment of the application, the audience client judges whether the live broadcast stream of the target live broadcast room is a single-channel live broadcast stream or a double-channel or multi-channel live broadcast stream after receiving the small video play instruction sent by the live broadcast server. Specifically, the one-way anchor stream corresponds to an anchor one-man live broadcast, that is, the viewer client receives only a live broadcast data stream generated by one anchor client. The two-way live stream can correspond to two anchor lines, a happy bucket PK and the like, namely, the audience client can receive the live data streams generated by the anchor client A and the anchor client B. The multi-channel live broadcast stream can be used for playing methods such as group battles and the like corresponding to a plurality of anchor broadcasters, namely, the audience client can receive the live broadcast data streams generated by the plurality of anchor broadcasters. When receiving live broadcast stream data, the audience client generates a stream identifier of the live broadcast data stream, and different live broadcast data streams are distinguished according to the stream identifier.
And after receiving the small video playing instruction sent by the live broadcast server, the audience client judges whether the audience is in a gift sending state. Specifically, whether a trigger operation of a gift sending button exists in the live broadcast room interface or not may be monitored, the gift sending button may be a combo button, and a gift may be presented on the live broadcast room interface by clicking or long-pressing the combo button by a user. If the audience client determines that the live broadcast data stream is a single-channel live broadcast stream and/or monitors that no trigger operation of a gift sending key is performed in a live broadcast room interface, namely a main broadcast is in a single live broadcast state and audiences are in a non-gift sending state, a main broadcast identification of a target live broadcast room is obtained, a small video obtaining request is generated according to the main broadcast identification, and the small video obtaining request is sent to a small video server, so that user experience is improved.
In an alternative embodiment, referring to fig. 6, the step S42 includes steps S421 to S422, which are as follows:
s41: the audience client stops receiving the audio data of the target live broadcast room according to the small video data;
s42: and the audience client establishes a small video player in a preset area of a live broadcast room interface, and the small video is played through the small video player.
In the embodiment of the application, the small video player can be displayed in the preset area of the live broadcast interface in the form of a video playing window, and the preset area can be the lower right corner area of the live broadcast interface or other position areas of the live broadcast interface, which is not limited to this. And after receiving the small video data, the audience client stops receiving the audio data of the target live broadcast room, so that the audio data of the target live broadcast room is prevented from interfering the playing of the small video, and the experience of the audience for watching the small video is improved.
In an alternative embodiment, referring to fig. 7, the step S42 includes steps S421 to S422, which are as follows:
s421: the audience client responds to the triggering operation of a full-screen control on the small video player, displays the small video player on the interface of the live broadcast in a full screen mode, and sends an acquisition request of small video page data to the small video server; the small video page data comprise small video comment data, small video praise data and small video forwarding data;
s422: the audience client receives the small video page data returned by the small video server, and synthesizes the small video page data and the small video data to obtain synthesized video data; rendering the synthesized video data to the small video player to play the small video and display a small video comment control, a small video comment control and a small video forwarding control.
In the embodiment of the present application, as shown in fig. 2A, the small video player is provided with a full screen control 200, and a viewer clicks or touches the full screen control, so that a playing interface of the small video player can be enlarged to an entire live broadcasting room interface. Please refer to fig. 2B, which is a diagram illustrating a full screen display of a small video played in a live broadcast room. The small video comment data comprise page layout data of the small video comment control, such as the display position, the display style and the display size of the small video comment control; the data of the small video point praise comprises page layout data of the control of the small video point praise, such as the display position, the display style and the display size of the control of the small video point praise; the small video forwarding data comprise page layout data of the small video point forwarding control, such as the display position, the display style and the display size of the small video point forwarding control; and rendering the small video comment data, the small video praise data and the small video forwarding data on the playing interface, so that a small video comment control 210, a small video praise control 220 and a small video forwarding control 230 are displayed on the playing interface. Specifically, the audience can comment on the small video by clicking the small video comment control, and comments of other audiences on the small video can also be displayed.
And the small video page data is loaded through the playing interface of the small video player, so that the viewers can comment, like and forward the currently watched small video on the playing interface, and the flow data of the small video is improved.
In an alternative embodiment, referring to fig. 8, the step S50 includes steps S51 to S53, which are as follows:
s51: the live streaming server continuously acquires a live data stream of a target live broadcasting room;
s52: if the frequency value of at least one group of audio data in the live broadcast data stream is not within the preset threshold range, or a human face exists in at least one frame of video picture, or at least one frame of video picture is not a still picture, the live broadcast stream server sends a small video playing stopping instruction to a spectator client side added into the target live broadcast room;
s53: and the audience client receives the small video playing stopping instruction, deletes the small video player and receives the audio data of the target live broadcast room again.
In the embodiment of the application, when a viewer watches a small video, the live streaming server continues to acquire a live data stream of a target live broadcasting room, if the frequency value of at least one group of audio data in the live data stream is not within a preset threshold range, or a face exists in at least one frame of video picture, or at least one frame of video picture is not a static picture, namely, the anchor broadcast returns to the live broadcasting room again, the live streaming server sends a small video playing stopping instruction to a viewer client side added into the target live broadcasting room, the small video playing stopping instruction is used for indicating the viewer client side to stop playing the small video, a small video player in a live broadcasting room interface of the viewer client side disappears, a live broadcasting picture of the anchor broadcast is displayed, and anchor broadcast voice is received again, so that the live broadcast is quickly recovered when the anchor broadcast is in a live broadcasting state.
In an alternative embodiment, referring to fig. 9, the step S62 includes steps S621 to S622, which are as follows:
s621: the audience client receives the small video playing stopping instruction and displays a small video playing control popup on a playing interface of a small video player; the play control popup comprises a play small video control and a play live data control;
s622: and responding to the triggering operation of the live broadcast data playing control, and switching the playing interface of the small video player to the live broadcast interface so as to play audio data on the live broadcast interface.
Considering that the viewer client receives the small video stop instruction and the viewer is watching the small video, the viewer may be interested in the content of the small video and does not want to immediately quit the small video, for example, the viewer wants to watch the small video and then return to the live interface to watch the live video. Therefore, in the embodiment of the application, in the process of watching the small video, if a small video playing stop instruction is received, the playing interface of the small video player can display a small video playing control popup, the playing control popup comprises a playing small video control and a playing live broadcast data control, and the audience can click the playing small video control to continue playing the small video and also click the playing live broadcast data control to exit the small video to watch the main broadcast live broadcast. The small video playing control popup is displayed on the playing interface of the small video player to inquire whether the audience exits the small video or not, but the audience is forced to exit the small video immediately, so that the experience of the audience is improved.
Referring to fig. 10, fig. 10 is a schematic structural diagram of an apparatus for playing a small video in a live broadcast room according to the present application. The device 7 of broadcast small video in the live broadcast room that this application embodiment provided includes:
a live streaming data acquiring module 71, configured to acquire a live streaming data stream of a target live broadcast room by a live streaming server; the live broadcast data stream comprises a plurality of frames of video pictures and a plurality of groups of corresponding audio data, and each frame of video picture corresponds to one group of audio data;
a playing instruction sending module 72, configured to send a small video playing instruction to a viewer client joining the target live broadcast room by the live broadcast streaming server when frequency values of a plurality of groups of audio data are within a preset threshold range, no human face exists in a plurality of frames of the video image, and no image change exists in the plurality of frames of the video image;
a playing instruction receiving module 73, configured to receive the small video playing instruction by the viewer client; acquiring a main broadcast identification of the target live broadcast room according to the small video playing instruction; generating a small video acquisition request according to the anchor identification, and sending the small video acquisition request to a small video server;
a small video sending module 74, configured to receive the small video obtaining request by the small video server; acquiring the anchor identification according to the small video acquisition request; acquiring corresponding small video data according to the anchor identification; sending the small video data to the viewer client;
a small video playing module 75, configured to receive the small video data by the viewer client; and playing the small video on the interface of the live broadcast room according to the small video data.
It should be noted that, when the apparatus for playing a small video in a live broadcast room provided in the foregoing embodiment executes the method for playing a small video in a live broadcast room, only the division of the functional modules is used for illustration, and in practical applications, the functions may be allocated to different functional modules according to needs, that is, the internal structure of the device may be divided into different functional modules, so as to complete all or part of the functions described above. In addition, the apparatus for playing the small video in the live broadcast room and the method for playing the small video in the live broadcast room provided by the above embodiments belong to the same concept, and details of implementation processes are found in the method embodiments and are not described herein again.
Please refer to fig. 11, which is a schematic structural diagram of a computer device provided in the present application. As shown in fig. 11, the computer device 21 may include: a processor 210, a memory 211, and a computer program 212 stored in the memory 211 and operable on the processor 210, such as: playing a small video program in the live broadcast room; the steps in the above embodiments are implemented when the processor 210 executes the computer program 212.
The processor 210 may include one or more processing cores, among other things. The processor 210 is connected to various parts in the computer device 21 by various interfaces and lines, executes various functions of the computer device 21 and processes data by executing or executing instructions, programs, code sets or instruction sets stored in the memory 211 and calling data in the memory 211, and optionally, the processor 210 may be implemented in at least one hardware form of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), Programmable Logic Array (PLA). The processor 210 may integrate one or a combination of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a modem, and the like. Wherein, the CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing contents required to be displayed by the touch display screen; the modem is used to handle wireless communications. It is understood that the modem may not be integrated into the processor 210, but may be implemented by a single chip.
The Memory 211 may include a Random Access Memory (RAM) or a Read-Only Memory (Read-Only Memory). Optionally, the memory 211 includes a non-transitory computer-readable medium. The memory 211 may be used to store instructions, programs, code sets, or instruction sets. The memory 211 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as touch instructions, etc.), instructions for implementing the above-mentioned method embodiments, and the like; the storage data area may store data and the like referred to in the above respective method embodiments. The memory 211 may optionally be at least one memory device located remotely from the processor 210.
The embodiment of the present application further provides a computer storage medium, where the computer storage medium may store a plurality of instructions, where the instructions are suitable for being loaded by a processor and executing the method steps of the foregoing embodiment, and a specific execution process may refer to specific descriptions of the foregoing embodiment, which is not described herein again.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-mentioned division of the functional units and modules is illustrated, and in practical applications, the above-mentioned function distribution may be performed by different functional units and modules according to needs, that is, the internal structure of the apparatus is divided into different functional units or modules, so as to perform all or part of the functions described above. Each functional unit and module in the embodiments may be integrated in one processing unit, or each unit may exist alone physically, or two or more units are integrated in one unit, and the integrated unit may be implemented in a form of hardware, or in a form of software functional unit. In addition, specific names of the functional units and modules are only used for distinguishing one functional unit from another, and are not used for limiting the protection scope of the present application. The specific working processes of the units and modules in the system may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or illustrated in a certain embodiment.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
In the embodiments provided in the present invention, it should be understood that the disclosed apparatus/terminal device and method may be implemented in other ways. For example, the above-described embodiments of the apparatus/terminal device are merely illustrative, and for example, a module or a unit may be divided into only one logical function, and may be implemented in other ways, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one position, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated modules/units, if implemented in the form of software functional units and sold or used as separate products, may be stored in a computer readable storage medium. Based on such understanding, all or part of the flow in the method according to the embodiments of the present invention may also be implemented by a computer program, which may be stored in a computer-readable storage medium and used by a processor to implement the steps of the above-described embodiments of the method. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc.
The present invention is not limited to the above-described embodiments, and various modifications and variations of the present invention are intended to be included within the scope of the claims and the equivalent technology of the present invention if they do not depart from the spirit and scope of the present invention.

Claims (11)

1. A method for playing small videos in a live broadcast room is characterized by comprising the following steps:
a live streaming server acquires a live data stream of a target live broadcasting room; the live broadcast data stream comprises a plurality of frames of video pictures and a plurality of groups of corresponding audio data, and each frame of the video pictures corresponds to one group of the audio data;
when the frequency values of a plurality of groups of audio data are all within a preset threshold range, no human face exists in a plurality of frames of video pictures, and no picture change exists in the plurality of frames of video pictures, the live streaming server sends a small video playing instruction to a spectator client side which joins in the target live broadcasting room;
the audience client receives the small video playing instruction; acquiring a main broadcasting identifier of the target live broadcasting room according to the small video playing instruction; generating a small video acquisition request according to the anchor identifier, and sending the small video acquisition request to a small video server;
the small video server receives the small video acquisition request; acquiring the anchor identification according to the small video acquisition request; acquiring corresponding small video data according to the anchor identification; sending the small video data to the viewer client;
the viewer client receiving the small video data; and playing the small video on the interface of the live broadcast room according to the small video data.
2. The method of playing small videos in a live broadcast room of claim 1, wherein:
when the frequency values of a plurality of groups of audio data are all within a preset threshold range, no human face exists in a plurality of frames of video pictures, and no picture change exists in the plurality of frames of video pictures, the step that the live broadcast streaming server sends a small video playing instruction to a spectator client side which is added into the target live broadcast room comprises the following steps:
the live streaming server acquires the frequency value of each audio signal in each group of audio data and judges whether the frequency value of each audio signal is within a preset threshold range;
the live streaming server respectively inputs each frame of the video picture into a face detection model for face detection to obtain a face detection result of a corresponding frame; the face detection result is used for indicating whether a face exists in the video picture or not;
for each frame of video picture, the live streaming server acquires a color difference value between the live streaming server and a corresponding pixel point of the video picture of an adjacent frame; counting the number of pixel points with the color difference value smaller than a preset color difference value threshold; if the number of the pixel points is larger than a preset pixel point number threshold value, determining that the video picture of the corresponding frame has no picture change;
and when the frequency values of the groups of audio data are all within a preset threshold range, no human face exists in the frames of video pictures, and no picture change exists in the frames of video pictures, the live streaming server sends a small video playing instruction to the audience client side which joins the target live broadcasting room.
3. The method of playing small videos in a live broadcast room of claim 1, wherein:
the live broadcast data stream is a data stream in a preset unit time; when the frequency values of a plurality of groups of audio data are all within a preset threshold range, no human face exists in a plurality of frames of video pictures, and no picture change exists in the plurality of frames of video pictures, the step of sending a small video playing instruction to a spectator client terminal joining the target live broadcast room by the live broadcast streaming server comprises the following steps:
when the frequency values of a plurality of groups of audio data are all within a preset threshold value range, no human face exists in a plurality of frames of video pictures, and no picture change exists in the plurality of frames of video pictures, the live streaming server marks the live streaming as meaningless data stream;
and starting timing from the time of receiving the live broadcast data stream, and if the live broadcast data stream received within the preset time is a meaningless data stream, the live broadcast stream server sends a small video playing instruction to the audience client end which is added into the target live broadcast room.
4. The method of playing small videos in a live broadcast room of claim 1, wherein:
the audience client receives the small video playing instruction and acquires a main broadcasting identifier of the target live broadcasting room; generating a small video acquisition request according to the anchor identifier, and sending the small video acquisition request to a small video server, wherein the steps comprise:
the audience client side obtains a stream identification of a live broadcast data stream of a live broadcast room and/or monitors a trigger operation of a live broadcast room interface; a live broadcast data stream corresponds to the unique stream identifier, and the live broadcast data stream is generated by receiving a live broadcast data stream generated by an anchor client by the audience client;
and if the live broadcast data stream is determined to be a single-channel live broadcast stream according to the stream identification and/or no trigger operation of a gift sending button in the live broadcast room interface is monitored, the audience client side acquires an anchor broadcast identification of the target live broadcast room, generates a small video acquisition request according to the anchor broadcast identification, and sends the small video acquisition request to a small video server.
5. A method of playing small videos in a live room according to any of the claims 1 to 4, characterized by:
the step that the audience client plays the small video on the interface of the live broadcast room according to the small video data comprises the following steps:
the audience client stops receiving the audio data of the target live broadcast room according to the small video data;
and the audience client side establishes a small video player in a preset area of a live broadcast room interface, and the small video is played through the small video player.
6. The method of playing small videos in a live broadcast room of claim 5, wherein:
the method comprises the following steps that a small video player is established in a preset area of a live broadcast room interface by the audience client, and the small video is played through the small video player, and comprises the following steps:
the audience client responds to the triggering operation of a full-screen control on the small video player, displays the small video player in a full screen mode on the live broadcast interface, and sends an acquisition request of small video page data to the small video server; the small video page data comprise small video comment data, small video praise data and small video forwarding data;
the audience client receives the small video page data returned by the small video server, and synthesizes the small video page data and the small video data to obtain synthesized video data; rendering the synthesized video data to the small video player so as to play a small video and display a small video comment control, a small video comment control and a small video forward control.
7. The method of playing small videos in a live broadcast room of claim 6, wherein:
the viewer client receiving the small video data; according to the small video data, after the step of playing the small video on the live streaming server at the interface of the live broadcasting room, the method further comprises the following steps:
the live streaming server continuously acquires a live data stream of a target live broadcasting room;
if the frequency value of at least one group of audio data in the live broadcast data stream is not within the preset threshold range, or a human face exists in at least one frame of video picture, or at least one frame of video picture is not a still picture, the live broadcast stream server sends a small video playing stopping instruction to a spectator client side added into the target live broadcast room;
and the audience client receives the small video playing stopping instruction, deletes the small video player and receives the audio data of the target live broadcast room again.
8. The method of playing small videos in a live broadcast room of claim 7, wherein:
the steps that the audience client receives the small video playing stopping instruction, deletes the small video player and receives the audio data of the target live broadcast room again comprise:
the audience client receives the small video playing stopping instruction and displays a small video playing control popup on a playing interface of a small video player; the play control popup comprises a play small video control and a play live data control;
and responding to the triggering operation of the live broadcast data playing control, and switching the playing interface of the small video player to the live broadcast room interface so as to play audio data on the live broadcast room interface.
9. An apparatus for playing a small video in a live broadcast room, comprising:
the live broadcast data stream acquisition module is used for the live broadcast stream server to acquire a live broadcast data stream of a target live broadcast room; the live broadcast data stream comprises a plurality of frames of video pictures and a plurality of groups of corresponding audio data, and each frame of the video pictures corresponds to one group of the audio data;
the playing instruction sending module is used for sending a small video playing instruction to a spectator client side which joins the target live broadcast room by the live broadcast streaming server when the frequency values of a plurality of groups of audio data are all within a preset threshold range, no human face exists in a plurality of frames of video pictures, and no picture change exists in the plurality of frames of video pictures;
a playing instruction receiving module, configured to receive the small video playing instruction by the viewer client; acquiring a main broadcasting identifier of the target live broadcasting room according to the small video playing instruction; generating a small video acquisition request according to the anchor identifier, and sending the small video acquisition request to a small video server;
the small video sending module is used for receiving the small video obtaining request by the small video server; acquiring the anchor identification according to the small video acquisition request; obtaining corresponding small video data according to the anchor identification; sending the small video data to the viewer client;
the small video playing module is used for receiving the small video data by the audience client; and playing the small video on the interface of the live broadcast room according to the small video data.
10. A computer device, comprising: processor, memory and computer program stored in the memory and executable on the processor, characterized in that the steps of the method according to any of claims 1 to 8 are implemented when the processor executes the computer program.
11. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 8.
CN202210226220.0A 2022-03-08 2022-03-08 Method, device, computer equipment and medium for playing small video in live broadcast room Pending CN114640864A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210226220.0A CN114640864A (en) 2022-03-08 2022-03-08 Method, device, computer equipment and medium for playing small video in live broadcast room

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210226220.0A CN114640864A (en) 2022-03-08 2022-03-08 Method, device, computer equipment and medium for playing small video in live broadcast room

Publications (1)

Publication Number Publication Date
CN114640864A true CN114640864A (en) 2022-06-17

Family

ID=81947847

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210226220.0A Pending CN114640864A (en) 2022-03-08 2022-03-08 Method, device, computer equipment and medium for playing small video in live broadcast room

Country Status (1)

Country Link
CN (1) CN114640864A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115175001A (en) * 2022-07-07 2022-10-11 广州方硅信息技术有限公司 Playing processing method for live playback, computer equipment and storage medium
CN115499673A (en) * 2022-08-30 2022-12-20 深圳市思为软件技术有限公司 Live broadcast method and device
CN117319758A (en) * 2023-10-13 2023-12-29 南京霍巴信息科技有限公司 Live broadcast method and live broadcast system based on cloud platform

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106792089A (en) * 2016-12-15 2017-05-31 腾讯科技（深圳）有限公司 Video broadcasting method and device
CN107197360A (en) * 2017-06-14 2017-09-22 杭州当虹科技有限公司 A kind of method and system of live signal safe broadcast
CN107743244A (en) * 2017-10-27 2018-02-27 北京小米移动软件有限公司 Net cast method and device
CN109274982A (en) * 2018-09-30 2019-01-25 武汉斗鱼网络科技有限公司 Video carousel method, device, computer equipment and storage medium
CN109803166A (en) * 2019-02-22 2019-05-24 上海连尚网络科技有限公司 For showing the method and apparatus of small video in the locking screen interface of user equipment
CN111385591A (en) * 2018-12-28 2020-07-07 阿里巴巴集团控股有限公司 Network live broadcast method, live broadcast processing method and device, live broadcast server and terminal equipment
CN112188221A (en) * 2020-09-24 2021-01-05 广州虎牙科技有限公司 Play control method and device, computer equipment and storage medium
CN112437326A (en) * 2020-11-23 2021-03-02 广州虎牙科技有限公司 Video display method and device, electronic equipment and computer readable storage medium
CN113014946A (en) * 2021-03-05 2021-06-22 广州市网星信息技术有限公司 Emergency processing method and emergency processing device for live broadcast drop of live broadcast platform
CN113126839A (en) * 2021-03-16 2021-07-16 北京达佳互联信息技术有限公司 Object playing method and device, electronic equipment and storage medium
CN113613053A (en) * 2021-07-26 2021-11-05 北京达佳互联信息技术有限公司 Video recommendation method and device, electronic equipment and storage medium
CN114040243A (en) * 2021-11-04 2022-02-11 上海哔哩哔哩科技有限公司 Live broadcast room video playing method and device

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106792089A (en) * 2016-12-15 2017-05-31 腾讯科技（深圳）有限公司 Video broadcasting method and device
CN107197360A (en) * 2017-06-14 2017-09-22 杭州当虹科技有限公司 A kind of method and system of live signal safe broadcast
CN107743244A (en) * 2017-10-27 2018-02-27 北京小米移动软件有限公司 Net cast method and device
CN109274982A (en) * 2018-09-30 2019-01-25 武汉斗鱼网络科技有限公司 Video carousel method, device, computer equipment and storage medium
CN111385591A (en) * 2018-12-28 2020-07-07 阿里巴巴集团控股有限公司 Network live broadcast method, live broadcast processing method and device, live broadcast server and terminal equipment
CN109803166A (en) * 2019-02-22 2019-05-24 上海连尚网络科技有限公司 For showing the method and apparatus of small video in the locking screen interface of user equipment
CN112188221A (en) * 2020-09-24 2021-01-05 广州虎牙科技有限公司 Play control method and device, computer equipment and storage medium
CN112437326A (en) * 2020-11-23 2021-03-02 广州虎牙科技有限公司 Video display method and device, electronic equipment and computer readable storage medium
CN113014946A (en) * 2021-03-05 2021-06-22 广州市网星信息技术有限公司 Emergency processing method and emergency processing device for live broadcast drop of live broadcast platform
CN113126839A (en) * 2021-03-16 2021-07-16 北京达佳互联信息技术有限公司 Object playing method and device, electronic equipment and storage medium
CN113613053A (en) * 2021-07-26 2021-11-05 北京达佳互联信息技术有限公司 Video recommendation method and device, electronic equipment and storage medium
CN114040243A (en) * 2021-11-04 2022-02-11 上海哔哩哔哩科技有限公司 Live broadcast room video playing method and device

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115175001A (en) * 2022-07-07 2022-10-11 广州方硅信息技术有限公司 Playing processing method for live playback, computer equipment and storage medium
CN115499673A (en) * 2022-08-30 2022-12-20 深圳市思为软件技术有限公司 Live broadcast method and device
CN115499673B (en) * 2022-08-30 2023-10-20 深圳市思为软件技术有限公司 Live broadcast method and device
CN117319758A (en) * 2023-10-13 2023-12-29 南京霍巴信息科技有限公司 Live broadcast method and live broadcast system based on cloud platform
CN117319758B (en) * 2023-10-13 2024-03-12 南京霍巴信息科技有限公司 Live broadcast method and live broadcast system based on cloud platform

Similar Documents

Publication Publication Date Title
CN114640864A (en) Method, device, computer equipment and medium for playing small video in live broadcast room
CN106105246B (en) Display methods, apparatus and system is broadcast live
US8582565B1 (en) System for streaming audio to a mobile device using voice over internet protocol
US9167312B2 (en) Pause-based advertising methods and systems
CN113766340B (en) Dance music interaction method, system and device under live connected wheat broadcast and computer equipment
US9352228B2 (en) Methods and systems for processing gaming data
CN111954020A (en) Live broadcast information processing method, device, equipment and computer readable storage medium
CN105100918A (en) Method and device for displaying interaction result
CN113271472B (en) Game live broadcast method and device, electronic equipment and readable storage medium
US20210306680A1 (en) System, method, user equipment and computer-readable recording medium for live streaming activity
CN114025245A (en) Live broadcast room recommendation method and system based on task interaction and computer equipment
CN105208410A (en) Method and apparatus for displaying voting interactive interface
CN105451039B (en) A kind of interaction of multimedia information method and system
CN114666671B (en) Live broadcast praise interaction method, device, equipment and storage medium
CN110324653B (en) Game interactive interaction method and system, electronic equipment and device with storage function
CN113727125B (en) Live broadcast room screenshot method, device, system, medium and computer equipment
CN114885191A (en) Interaction method, system, device and equipment based on exclusive nickname of live broadcast room
CN114760520A (en) Live small and medium video shooting interaction method, device, equipment and storage medium
CN115134621A (en) Live broadcast fight interaction method and device based on main and auxiliary picture display and electronic equipment
CN105100940A (en) Method and device for displaying interactive results
US20150043891A1 (en) Second screen device and system
CN113542776B (en) Active live broadcast system and method, user device and computer readable storage medium
US11135520B2 (en) Methods and systems for processing gaming data
CN114513679B (en) Live broadcast room recommendation method, system and computer equipment based on audio pre-playing
CN111190518B (en) Interaction method and device between first screen and second screen, terminal and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination