WO2018192415A1 - 数据的直播方法、相关设备及系统 - Google Patents

数据的直播方法、相关设备及系统 Download PDF

Info

Publication number
WO2018192415A1
WO2018192415A1 PCT/CN2018/082909 CN2018082909W WO2018192415A1 WO 2018192415 A1 WO2018192415 A1 WO 2018192415A1 CN 2018082909 W CN2018082909 W CN 2018082909W WO 2018192415 A1 WO2018192415 A1 WO 2018192415A1
Authority
WO
WIPO (PCT)
Prior art keywords
client
data
server
mobile terminal
frame data
Prior art date
Application number
PCT/CN2018/082909
Other languages
English (en)
French (fr)
Inventor
吴双
吴彬
Original Assignee
腾讯科技(深圳)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 腾讯科技(深圳)有限公司 filed Critical 腾讯科技(深圳)有限公司
Publication of WO2018192415A1 publication Critical patent/WO2018192415A1/zh
Priority to US16/438,701 priority Critical patent/US11122307B2/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2385Channel allocation; Bandwidth allocation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/2187Live feed
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/30Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
    • A63F13/35Details of game servers
    • A63F13/355Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/24Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
    • H04N21/2401Monitoring of the client buffer
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4126The peripheral being portable, e.g. PDAs or mobile phones
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/414Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41407Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/475End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4781Games
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/816Monomedia components thereof involving special video data, e.g 3D video

Definitions

  • the present invention relates to the field of communications, and more particularly to live data broadcasting.
  • the e-sports live broadcast is based on e-sports content and relies on live broadcast. It has become a mainstream form of live broadcast.
  • e-sports has many similarities with the traditional sports industry, it is the deepest sports segmentation industry combined with the Internet, so the audience is wide, and more and more people prefer not to play games, but to watch games, electronics.
  • the audience of the competitive live broadcast industry is across different age groups.
  • the e-sports industry can also spawn many sub-sectors, and the scale is still growing. It can be seen that the e-sports live broadcast industry has broad prospects for future development.
  • the current e-sports live broadcast is mainly realized by screen recording live broadcast technology.
  • the video data is encoded through screen recording, and then broadcasted through a streaming media server or a peer-to-peer (abbreviation: P2P) network.
  • P2P peer-to-peer
  • the data transmission after video encoding has a relatively large bandwidth requirement.
  • the bandwidth requirement of the current e-sports live broadcast is not applicable to the current mobile network situation. If the user wants to watch the e-sport live broadcast, it will be limited by the network conditions, for example, In the case of WIreless-Fidelity (abbreviation: WiFi), the live broadcast can be viewed, while in the general packet radio service (abbreviation: GPRS) network state, the live broadcast cannot be viewed.
  • WIreless-Fidelity abbreviation: WiFi
  • GPRS general packet radio service
  • the embodiment of the present invention provides a live broadcast method, a related device, and a system, which are used to reduce the bandwidth of data transmitted during a live broadcast, save network traffic, and enhance the adaptability of the live broadcast to the network environment.
  • an embodiment of the present invention provides a live broadcast method of data, including:
  • the mobile terminal Broadcasting the frame data within a range of the client set, and transmitting the frame data to the mobile terminal synchronously, so that each client in the client set receives the frame data for data interaction,
  • the mobile terminal generates live data corresponding to the target application according to the frame data and the data corresponding to the target application stored in advance.
  • an embodiment of the present invention provides a live broadcast method of data, including:
  • the live broadcast data is displayed on the display screen.
  • an embodiment of the present invention provides a live broadcast method of data, including:
  • the server receives frame data sent by each client in the client set, and each client in the client set is a client that synchronously runs the target application;
  • the server broadcasts the frame data in a range of the client set, and synchronously sends the frame data to a mobile terminal, so that each client in the client set receives the frame data for data interaction.
  • the mobile terminal generates live data corresponding to the target application according to the frame data and data corresponding to the target application stored in advance.
  • an embodiment of the present invention provides a live broadcast method of data, including:
  • the mobile terminal receives frame data sent by the server, where the frame data includes frame data sent by each client in the client set to the server, and each client in the client set is a client that synchronously runs the target application. end;
  • the mobile terminal generates live data corresponding to the target application according to the frame data and data corresponding to the target application stored in advance;
  • the mobile terminal displays the live broadcast data on a display screen.
  • an embodiment of the present invention provides a server, including:
  • a first receiving module configured to receive frame data sent by each client in the client set, where each client in the client set is a client that synchronously runs the target application;
  • a sending module configured to broadcast the frame data received by the first receiving module within a range of the client set, and send the frame data to a mobile terminal synchronously, so that each of the client sets
  • the client receives the frame data for data interaction, and the mobile terminal generates live data corresponding to the target application according to the frame data and the data corresponding to the target application stored in advance.
  • an embodiment of the present invention provides a mobile terminal, including:
  • a first receiving module configured to receive frame data sent by the server, where the frame data includes frame data sent by each client in the client set to the server, where each client in the client set is synchronized The client running the target application;
  • a generating module configured to generate live data corresponding to the target application according to the frame data received by the first receiving module and the data corresponding to the target application stored in advance;
  • a display module configured to display live data generated by the generating module.
  • an embodiment of the present invention provides a data live broadcast system, including:
  • the frame synchronization server is configured to receive frame data sent by each client in the client set, and broadcast the frame data within a range of the client set, where each client in the client set is Synchronize the client running the target application;
  • Each client in the client set is configured to receive frame data sent by the frame synchronization server for data interaction;
  • the frame synchronization server is further configured to synchronously send the frame data to the mobile terminal;
  • the mobile terminal is configured to generate live data corresponding to the target application according to the frame data and data corresponding to the target application stored in advance; and display the live broadcast data on a display screen.
  • an embodiment of the present invention provides a server, where the server includes:
  • the memory is configured to store program code and transmit the program code to the processor
  • the processor is configured to invoke a live broadcast method in the memory that instructs the data provided by the first aspect.
  • a ninth aspect, the embodiment of the present invention provides a mobile terminal, where the mobile terminal includes:
  • the memory is configured to store program code and transmit the program code to the processor
  • the processor is configured to invoke a command in the memory to perform a live broadcast method of the data provided by the second aspect.
  • an embodiment of the present invention provides a storage medium, where the storage medium is used to store program code, and the program code is used to execute a live broadcast method of data provided by the foregoing first aspect.
  • an embodiment of the present invention provides a storage medium, where the storage medium is used to store program code, and the program code is used to execute a live broadcast method of data provided by the second aspect.
  • the server receives the frame data sent by each client in the client set, and each client in the client set is a client that synchronously runs the target application, for example, each client in the client set can run a certain Playing the game and receiving the operation data input by the user in the game; the server broadcasts the frame data within the scope of the client set, so that each client in the client set receives the frame data for data interaction, and sends the frame data
  • the mobile terminal can be understood as a device used by the viewer of the e-sports live broadcast, and the mobile terminal generates the live broadcast data corresponding to the target application according to the frame data and the data corresponding to the target application stored in advance, in the embodiment of the present invention,
  • the mobile terminal receives the operation frame data sent by the server for the target application, and then renders the live broadcast data according to the received frame data and the pre-stored data of the 3D model of the game, so it is occupied by the conventional received video stream.
  • the bandwidth is much lower, which greatly reduces the bandwidth of the transmitted data.
  • FIG. 1 is a schematic structural diagram of a live broadcast system of data according to an embodiment of the present invention.
  • FIG. 2 is a schematic diagram of steps of an embodiment of a method for broadcasting live data according to an embodiment of the present invention
  • FIG. 3 is a schematic structural diagram of another embodiment of a data live broadcast system according to an embodiment of the present invention.
  • FIG. 4 is a timing diagram of performing functions of each device in the system according to an embodiment of the present invention.
  • FIG. 5 is a schematic structural diagram of an embodiment of a server according to an embodiment of the present disclosure.
  • FIG. 6 is a schematic structural diagram of another embodiment of a server according to an embodiment of the present invention.
  • FIG. 7 is a schematic structural diagram of another embodiment of a server according to an embodiment of the present invention.
  • FIG. 8 is a schematic structural diagram of another embodiment of a server according to an embodiment of the present invention.
  • FIG. 9 is a schematic structural diagram of an embodiment of a mobile terminal according to an embodiment of the present invention.
  • FIG. 10 is a schematic structural diagram of another embodiment of a mobile terminal according to an embodiment of the present disclosure.
  • FIG. 11 is a schematic structural diagram of another embodiment of a mobile terminal according to an embodiment of the present invention.
  • FIG. 12 is a schematic structural diagram of another embodiment of a mobile terminal according to an embodiment of the present invention.
  • FIG. 13 is a schematic structural diagram of an embodiment of a data live broadcast system according to an embodiment of the present invention.
  • the embodiment of the present invention provides a live broadcast method, a related device, and a system, which are used to reduce the bandwidth of data transmitted during a live broadcast, save network traffic, and enhance the adaptability of the live broadcast to the network environment.
  • FIG. 1 is a schematic diagram of a live broadcast system of the data.
  • the system includes a client set 110, a server 120 and a mobile terminal 130, wherein each client in the client set 110 is configured to send frame data to the server, wherein the frame data is not video data, and can be understood as a client.
  • the operation data input by the player received at a time slice (for example, 40 ms) is taken as an example.
  • the operation data may be data generated by a control character performing a shooting action, moving, taking a ball, and the like.
  • Each client in the set of clients is a client that synchronously runs the target application; the server 120 is configured to receive frame data sent by each client in the client set, and broadcast in the range of the client set. Receiving the frame data, so that each client in the client set performs data interaction through the server; at the same time, the server 120 synchronously transmits the frame data to the mobile terminal 130, and the mobile terminal 130 may use the frame data according to the frame data. And the pre-stored data corresponding to the target application generates live data of the target application running. The mobile terminal 130 displays the live broadcast data on the display screen.
  • the function of the server 120 may be implemented by a server. In actual applications, the function of the server may also be implemented by several servers. In actual applications, the present invention does not implement the specific implementation mode of the server. limited.
  • the target application is described as an example of a competitive game "the strongest professional basketball".
  • the client set may include 10 clients, each of which runs synchronously with the game, and each client controls a character, and the game has 10 characters, and the 10 characters are divided into 10 characters.
  • each team has 5 characters, and the two teams compete in the competition.
  • the server synchronously sends the frame data of the received client to the mobile terminal, and the mobile terminal is configured to display the real-time game status of the “strongest professional basketball game”, and the mobile terminal has pre-loaded the “strongest professional basketball game” corresponding to the mobile terminal.
  • the related data includes scenes of the game, 3D character models, actions, and the like.
  • the mobile terminal can render the live data of the “strongest professional basketball basket” according to the received frame data and the related data.
  • the user views the game situation of the basketball game through the mobile terminal.
  • the mobile terminal may be a mobile phone, a tablet computer, a personal digital assistant (PDA), or the like.
  • the mobile terminal may be a mobile phone as an example for description.
  • live broadcast method of data provided in the embodiment of the present invention is described in detail below.
  • One embodiment of the live broadcast method of the data includes:
  • Step 201 The server creates a storage space, where the storage space is used to store frame data sent by each client in the client set, where the storage space has a space identifier.
  • the server creates a storage space, which has a space identifier, which is used to find and index the storage space.
  • the storage space can be understood as a live room, and the live room has a corresponding space identifier, and the space identifier is used for Find and index the live room.
  • the server can create multiple storage spaces, each of which is a live room, and the server can create a list of identifiers of the storage space, and the identifiers included in the identifier list are mapped to the storage space. Since a live room corresponds to the same game, the server broadcasts frame data in a live room, so that each client in the client set can receive the frame data.
  • the space identifier of the storage space may be a serial number (such as "5"), or may be a live content (such as "the strongest professional basketball"), or a combination of labels (eg, athletic-basketball). Etc.
  • the specific form is not limited.
  • Step 202 The mobile terminal sends a request for requesting to acquire frame data to the server, where the request includes the space identifier.
  • the mobile terminal views the viewing end of the game for the user.
  • the mobile terminal needs to obtain the right to view the game, and the mobile terminal sends a request to the server, where the request includes a space identifier (such as "5").
  • the request includes a space identifier (such as "5").
  • the user wants to watch the live broadcast of the "strongest professional basketball game", and finds that the live room number of the game game is "5" in the live broadcast platform, and the terminal sends a request for carrying the space identifier to the server.
  • This request is used to request to join a live event that watches the game.
  • Step 203 The server receives the request, and the response that is fed back to the mobile terminal is used to indicate that the mobile terminal establishes a correspondence relationship with the space identifier.
  • the server After receiving the request, the server feeds back a response to the mobile terminal, and establishes a correspondence between the space identifier and the mobile terminal, where the response is used to notify the mobile terminal that the user has the right to view the event of the live room.
  • Step 204 Each client in the client set sends frame data to the server, and each client in the client set is a client that synchronously runs the target application.
  • the frame data sent by each client in the client set to the server is not video data. It can be understood that the client receives the operation data input by the player in a time slice (such as 40ms).
  • the operational data is data generated by operations such as shooting, moving, taking the ball, and the like.
  • Step 205 The server receives the frame data, and the server broadcasts the frame data within a range of the client set.
  • the client set includes at least a first client and a second client, the first client receives the control command of the player A to control the character A, and the second client receives the control command of the player B to control the character B.
  • the server receives the first frame data of the role A "shooting" sent by the first client, and the server receives the second frame data of the second client "moving to the left"
  • the server will first frame the data and the first frame data.
  • the two frames of data are broadcasted within the scope of the client set, and the 10 clients in the client set can receive the first frame data and the second frame data, and each client has preloaded the game correspondingly.
  • Related data including scene data, 3D model data, and the like.
  • each client performs calculation based on the received first frame data and second frame data and related data corresponding to the game, and then displays the actions of each character on the client. That is to say, each client in the client set performs data interaction by receiving frame data broadcast by the server.
  • Step 206 The server synchronously sends the frame data to the mobile terminal.
  • the server When the server receives the frame data sent by each client in the client set, the frame data is synchronously sent to the mobile terminal, for example, when the server receives the first frame data of the character A shooting and the character B moves to the left.
  • the server When the second frame data is received, the server synchronously transmits the first frame data and the second frame data to the mobile terminal.
  • Step 207 The mobile terminal receives the frame data sent by the server, and the mobile terminal generates live data corresponding to the target application according to the frame data and the data corresponding to the target application stored in advance.
  • Corresponding data corresponding to the game is pre-stored in the mobile terminal, the related data includes scene data of the game, 3D model data, and the like, for example, the mobile terminal according to the received first frame data and the second frame data and the game The relevant data is calculated to generate live data of the game.
  • the mobile terminal after receiving the frame data, the mobile terminal performs the calculation of the synchronized animation image locally. This requires unified computing logic for all clients in all live client collections, ensuring that all mobile terminals display the same picture.
  • Step 208 The terminal displays the live broadcast data on the display screen.
  • the mobile terminal displays the live broadcast data as the display end of the game event, and the user can watch the live broadcast data of the game through the mobile terminal.
  • the frame data is input data
  • playback at the mobile terminal must be started from the first frame.
  • the server needs to buffer the complete data of the most recent paragraph.
  • the basketball game is divided into different sections, and the duration of each section may be about 2 minutes.
  • the mobile terminal can receive a control command input by the user for fast forwarding. For example, the live broadcast reaches the viewing game in the 20th s, but the mobile terminal plays from the 0th second, and the user can select fast forward until the current game. The process is fully synchronized. In another implementation manner, although the mobile terminal starts playing at the 0th second, it can automatically jump to the current playback position (such as the 20th second position) to synchronize with the current game progress.
  • the current playback position such as the 20th second position
  • the method provided in the embodiment of the present invention has a significant advantage in the high-live game live broadcast.
  • the bandwidth required to support a live broadcast of millions of people online is about 20,000 Mbps (Million bits per second, Megabits per second). If you use a normal Gigabit NIC server, the required server is about 24 (for example, 800 Mbps per traffic, each server can support about 4 to 50,000 people online), while the traffic on the client is only 20 kbps. For example, NBA sports sports games live. Since the bandwidth required by a single user is very low, the requirements for the mobile phone network are not high, and it can be applied to various network environments.
  • the live broadcast can be performed very well, which greatly facilitates the user's e-sports. Live watching.
  • the bandwidth of the server and the server cost can be greatly saved.
  • a server with a single Gigabit NIC can take up to 40,000 simultaneous online live events.
  • the million-level live broadcast service also requires only 30 server clusters.
  • the mobile terminal displays the live broadcast data, so that the user can watch the live broadcast data.
  • the mobile terminal can also receive the interactive information input by the user, where the interactive information is performed for the live broadcast data played by the current mobile terminal.
  • Interactive information can be textual information, such as refueling utterances, comments, and the like.
  • the interactive information may also be a preset interactive scene included in the related information of the game, and the mobile terminal may receive a selection instruction of the interactive scene input by the user, and the mobile terminal determines the interactive scene according to the selection instruction, for example, the interactive scene may be
  • the mobile terminal receives the control command input by the user to control the action of the audience under the competition table.
  • the interactive scene may be “person wave”, “applause”, “song: remember the name”, etc., and the interactive information can be used to highlight the game field. atmosphere of.
  • the mobile terminal then sends the interactive information to the server.
  • the interactive information can be verified.
  • the verification determines whether the interactive information is the interactive information that conforms to the rule. For example, when the interactive information is text information, the server verifies whether the keywords in the text information have words that do not conform to the rules, avoids input of non-positive energy text information, and the like, and verifies the interactive information.
  • Purpose First of all: it can be determined whether the interactive information is interactive information sent by the server authorized mobile terminal. Then, through the verification and filtering of some non-compliant information, try to ensure the cleanliness of the network, so that the e-sports live broadcast can become a network activity that stimulates the user's enthusiasm and is full of positive energy.
  • the server broadcasts the interactive information within the scope of the client set according to the spatial identifier associated with the mobile terminal.
  • the client in the client collection displays the interactive information, cheering on the participating clients, and setting off the atmosphere of the game.
  • the server receives frame data sent by each client in the client set, and each client in the client set is a client that synchronously runs the target application, for example, in the client set.
  • Each client can run a game and receive operational data entered by the user in the game; the server broadcasts frame data within the scope of the client set such that each client in the client set receives frame data for data interaction And transmitting the frame data to the mobile terminal, the mobile terminal can be understood as a device used by the viewer of the electronic competitive live broadcast, and the mobile terminal generates the live broadcast data corresponding to the target application according to the frame data and the data corresponding to the target application stored in advance.
  • the mobile terminal since the mobile terminal receives the operation frame data sent by the server for the target application, and then renders the live broadcast data according to the received frame data and the pre-stored data of the 3D model of the game, etc.,
  • the received video stream occupies much less bandwidth, greatly reducing the transmission Data bandwidth can be applied to current mobile network environment end, save network traffic, enhance the adaptability of the network environment.
  • FIG. 3 is a schematic structural diagram of another embodiment of a data live broadcast system.
  • the live broadcast system of the data includes a client set 310, a frame synchronization server 320, a relay server 330, a storage space server 340, and a mobile terminal 350.
  • the storage space server 340 creates a storage space for storing frame data sent by each client in the client set, where the storage space has a space identifier; in an actual application, the storage space can be understood as a live room.
  • the storage space server 340 creates a storage space on the frame synchronization server 320 and the relay server 330 at the same time. The following describes the storage space as a live room.
  • the relay server 330 receives the request sent by the mobile terminal. It can be understood that the request is used to register to the live room to obtain frame data of the live room.
  • the storage space server 340 establishes a correspondence between the space identifier and the mobile terminal.
  • the frame synchronization server 320 receives frame data sent by each client in the client set, and each client in the client set 310 is a client that synchronously runs the target application, and the client set is a collection of clients that receive input operation data. .
  • Each client in the client set performs data interaction through frame data broadcast of the frame synchronization server; the frame synchronization server 320 broadcasts frame data in the range of the client set, and synchronously transmits the frame data to the relay server 330; the relay server The mobile terminal 350 forwards the frame data to the mobile terminal 350, so that the mobile terminal 350 generates the live broadcast data corresponding to the target application according to the frame data and the data corresponding to the target application stored in advance; the mobile terminal 350 displays the live broadcast data on the display screen.
  • the relay server 330 may also be a server group in actual applications.
  • a client participating in a live broadcast creates a live broadcast on the storage server.
  • the storage space server synchronizes live broadcast data to the frame synchronization server and relay server.
  • the client participates in the game to generate input frame data (such as controlling the character shooting, moving to the left and other operational data), and reporting the frame data to the frame synchronization server, and the frame synchronization server broadcasts the frame data in the live broadcast room (between the game client sets) Synchronization of frame data) and synchronization of frame data to the relay server.
  • input frame data such as controlling the character shooting, moving to the left and other operational data
  • the frame synchronization server broadcasts the frame data in the live broadcast room (between the game client sets) Synchronization of frame data) and synchronization of frame data to the relay server.
  • the viewer mobile terminal views the list of the current game through the storage space server, and finds the corresponding live room identifier. Then, the frame data corresponding to the live broadcast identifier sent by the relay server is received, and the entire game process is reproduced in the local calculation.
  • FIG. 5 is an embodiment of a server provided in the embodiment of the present invention. include:
  • the first receiving module 501 is configured to receive frame data sent by each client in the client set, where each client in the client set is a client that synchronously runs the target application;
  • the sending module 502 is configured to broadcast the frame data received by the first receiving module 501 in the range of the client set, and send the frame data to the mobile terminal synchronously, so that each client in the client set receives the data frame for data interaction.
  • the mobile terminal generates live data corresponding to the target application according to the frame data and the data corresponding to the target application stored in advance.
  • FIG. 6 another embodiment of the server 600 is further provided by the embodiment of the present invention, including:
  • the storage space creation module 503 is configured to create a storage space, where the storage space is used to store frame data sent by each client in the client set, and the storage space has a space identifier;
  • the relationship determining module 504 is configured to establish a correspondence between the space identifier and the mobile terminal.
  • FIG. 7 another embodiment of the server 700 is further provided by the embodiment of the present invention, including:
  • the second receiving module 505 is configured to receive the interaction information sent by the mobile terminal.
  • the verification module 507 is configured to check the interaction information received by the second receiving module 505.
  • the broadcast module 508 is configured to: when the interactive information passes the verification, broadcast the interactive information within a range of the client set according to the spatial identifier associated with the mobile terminal.
  • FIGS. 5 to 7 are presented in the form of functional modules.
  • a “module” herein may refer to an application-specific integrated circuit (ASIC), circuitry, a processor and memory that executes one or more software or firmware programs, integrated logic circuitry, and/or other functions that provide the functionality described above.
  • ASIC application-specific integrated circuit
  • the servers of Figures 5 through 7 may take the form shown in Figure 8.
  • FIG. 8 is a schematic structural diagram of a server according to an embodiment of the present invention.
  • the server 800 may generate a large difference due to different configurations or performances, and may include one or more central processing units (CPUs) 822 (for example, One or more processors) and memory 832, one or more storage media 830 storing application 842 or data 844 (eg, one or one storage device in Shanghai).
  • the memory 832 and the storage medium 830 may be short-term storage or persistent storage.
  • the program stored on storage medium 830 may include one or more modules (not shown), each of which may include a series of instruction operations in the server.
  • central processor 822 can be configured to communicate with storage medium 830, executing a series of instruction operations in storage medium 830 on server 800.
  • Server 800 may also include one or more power supplies 826, one or more wired or wireless network interfaces 850, one or more input and output interfaces 858, and/or one or more operating systems 841, such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM and more.
  • operating systems 841 such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM and more.
  • the central processing unit causes the server to perform the live broadcast method of the following data:
  • Receiving frame data sent by each client in the client set, and each client in the client set is a client running the target application synchronously;
  • the data generates the live data corresponding to the target application.
  • the method before the frame data is sent to the mobile terminal, the method further includes:
  • the method further includes:
  • the interactive information passes the verification, the interactive information is broadcasted within the scope of the client set according to the spatial identifier associated with the mobile terminal.
  • an embodiment of the present invention further provides an embodiment of a mobile terminal 900, including:
  • the first receiving module 901 is configured to receive frame data sent by the server, where the frame data includes frame data sent by each client in the client set to the server, and each client in the client set is a client that synchronously runs the target application. end;
  • the generating module 902 is configured to generate live data corresponding to the target application according to the frame data received by the first receiving module 901 and the data corresponding to the target application stored in advance;
  • the display module 903 is configured to display live broadcast data.
  • FIG. 10 another embodiment of the mobile terminal 1000 is provided by the embodiment of the present invention, including:
  • a first sending module 905 configured to send, to the server, a request for acquiring frame data, where the frame data is stored in a storage space created by the server, where the storage space has a corresponding space identifier;
  • the second receiving module 904 is configured to receive a response that is sent by the server, where the response includes a spatial identifier, where the spatial identifier is used to instruct the server to establish a correspondence between the mobile terminal and the spatial identifier.
  • FIG. 11 another embodiment of the mobile terminal 1100 is provided by the embodiment of the present invention, including:
  • the third receiving module 906 is configured to receive interaction information input by the user
  • the second sending module 907 is configured to send the interaction information received by the third receiving module 906 to the server, so that the server broadcasts the interaction information within the scope of the client set according to the space identifier.
  • FIGS. 9 to 11 is presented in the form of a functional module.
  • a “module” herein may refer to an application-specific integrated circuit (ASIC), circuitry, a processor and memory that executes one or more software or firmware programs, integrated logic circuitry, and/or other functions that provide the functionality described above.
  • ASIC application-specific integrated circuit
  • Device In a simple embodiment, the mobile terminal of Figures 9 through 11 can take the form shown in Figure 12.
  • the terminal may be any terminal device including a mobile phone, a tablet computer, a PDA (Personal Digital Assistant), a POS (Point of Sales), an in-vehicle computer, and the terminal is a mobile phone as an example:
  • FIG. 12 is a block diagram showing a partial structure of a mobile phone related to a terminal provided by an embodiment of the present invention.
  • the mobile phone includes: a radio frequency (RF) circuit 1210, a memory 1220, an input unit 1230, a display unit 1240, a sensor 1250, an audio circuit 1260, a wireless fidelity (WiFi) module 1270, and a processor 1280. And power supply 1290 and other components.
  • RF radio frequency
  • the RF circuit 1210 can be used for receiving and transmitting signals during the transmission or reception of information or during a call. Specifically, after receiving the downlink information of the base station, the processor 1280 processes the data; and, in addition, transmits the designed uplink data to the base station.
  • RF circuit 1210 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like.
  • LNA Low Noise Amplifier
  • RF circuitry 1210 can also communicate with the network and other devices via wireless communication.
  • the above wireless communication may use any communication standard or protocol, including but not limited to Global System of Mobile communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (Code Division). Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), E-mail, Short Messaging Service (SMS), and the like.
  • GSM Global System of Mobile communication
  • the memory 1220 can be used to store software programs and modules, and the processor 1280 executes various functional applications and data processing of the mobile phone by running software programs and modules stored in the memory 1220.
  • the memory 1220 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may be stored according to Data created by the use of the mobile phone (such as audio data, phone book, etc.).
  • memory 1220 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
  • the input unit 1230 can be configured to receive input numeric or character information and to generate key signal inputs related to user settings and function controls of the handset.
  • the input unit 1230 may include a touch panel 1231 and other input devices 1232.
  • the touch panel 1231 also referred to as a touch screen, can collect touch operations on or near the user (such as the user using a finger, a stylus, or the like on the touch panel 1231 or near the touch panel 1231. Operation), and drive the corresponding connecting device according to a preset program.
  • the touch panel 1231 may include two parts: a touch detection device and a touch controller.
  • the touch detection device detects the touch orientation of the user, and detects a signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts the touch information into contact coordinates, and sends the touch information.
  • the processor 1280 is provided and can receive commands from the processor 1280 and execute them.
  • the touch panel 1231 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves.
  • the input unit 1230 may also include other input devices 1232.
  • other input devices 1232 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, joysticks, and the like.
  • the display unit 1240 can be used to display information input by the user or information provided to the user as well as various menus of the mobile phone.
  • the display unit 1240 can include a display panel 1241.
  • the display panel 1241 can be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.
  • the touch panel 1231 may cover the display panel 1241. After the touch panel 1231 detects a touch operation on or near the touch panel 1231, the touch panel 1231 transmits to the processor 1280 to determine the type of the touch event, and then the processor 1280 according to the touch event. The type provides a corresponding visual output on display panel 1241.
  • the touch panel 1231 and the display panel 1241 are used as two independent components to implement the input and input functions of the mobile phone, in some embodiments, the touch panel 1231 and the display panel 1241 may be integrated. Realize the input and output functions of the phone.
  • the handset can also include at least one type of sensor 1250, such as a light sensor, motion sensor, and other sensors.
  • the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 1241 according to the brightness of the ambient light, and the proximity sensor may close the display panel 1241 and/or when the mobile phone moves to the ear. Or backlight.
  • the accelerometer sensor can detect the magnitude of acceleration in all directions (usually three axes). When it is stationary, it can detect the magnitude and direction of gravity.
  • the mobile phone can be used to identify the gesture of the mobile phone (such as horizontal and vertical screen switching, related Game, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for the mobile phone can also be configured with gyroscopes, barometers, hygrometers, thermometers, infrared sensors and other sensors, no longer Narration.
  • the gesture of the mobile phone such as horizontal and vertical screen switching, related Game, magnetometer attitude calibration
  • vibration recognition related functions such as pedometer, tapping
  • the mobile phone can also be configured with gyroscopes, barometers, hygrometers, thermometers, infrared sensors and other sensors, no longer Narration.
  • Audio circuit 1260, speaker 1261, and microphone 1262 provide an audio interface between the user and the handset.
  • the audio circuit 1260 can transmit the converted electrical data of the received audio data to the speaker 1261, and convert it into a sound signal output by the speaker 1261; on the other hand, the microphone 1262 converts the collected sound signal into an electrical signal, by the audio circuit 1260. After receiving, it is converted into audio data, and then processed by the audio data output processor 1280, transmitted to the mobile phone 1210 via the RF circuit 1210, or outputted to the memory 1220 for further processing.
  • WiFi is a short-range wireless transmission technology.
  • the mobile phone through the WiFi module 1270 can help users to send and receive e-mail, browse the web and access streaming media, etc. It provides users with wireless broadband Internet access.
  • FIG. 12 shows the WiFi module 1270, it can be understood that it does not belong to the essential configuration of the mobile phone, and may be omitted as needed within the scope of not changing the essence of the invention.
  • the processor 1280 is a control center for the handset that connects various portions of the entire handset using various interfaces and lines, by executing or executing software programs and/or modules stored in the memory 1220, and invoking data stored in the memory 1220, The phone's various functions and processing data, so that the overall monitoring of the phone.
  • the processor 1280 may include one or more processing units; preferably, the processor 1280 may integrate an application processor and a modem processor, where the application processor mainly processes an operating system, a user interface, an application, and the like.
  • the modem processor primarily handles wireless communications. It will be appreciated that the above described modem processor may also not be integrated into the processor 1280.
  • the handset also includes a power source 1290 (such as a battery) that supplies power to the various components.
  • a power source 1290 such as a battery
  • the power source can be logically coupled to the processor 1280 via a power management system to manage functions such as charging, discharging, and power management through the power management system.
  • the mobile phone may further include a camera, a Bluetooth module, and the like, and details are not described herein again.
  • the processor 1280 included in the terminal is further configured to enable the mobile terminal to perform a live broadcast method of the following data:
  • the frame data includes frame data sent by each client in the client set to the server, and each client in the client set is a client running the target application synchronously;
  • the method further includes:
  • the response is used to instruct the server to establish a correspondence between the mobile terminal and the space identifier.
  • the method further includes:
  • the interactive information is sent to the server so that the server broadcasts the interactive information within the scope of the client collection based on the spatial identifier.
  • an embodiment of the present invention provides an embodiment of a data live broadcast system, which may include:
  • the frame synchronization server 1302 is configured to receive frame data sent by each client in the client set, and broadcast frame data in a range of the client set, and each client in the client set is a client that synchronously runs the target application. ;
  • Each client in the client set 1301 is configured to receive frame data sent by the frame synchronization server for data interaction;
  • the frame synchronization server 1302 is further configured to synchronously send the frame data to the mobile terminal;
  • the mobile terminal 1303 is configured to generate live data corresponding to the target application according to the frame data and the data corresponding to the target application stored in advance; and display the live broadcast data on the display screen.
  • a relay server is also included;
  • the frame synchronization server forwards the frame data to the mobile terminal through the relay server.
  • a storage space server is also included;
  • the storage space server is configured to create a storage space, where the storage space is used to store frame data sent by each client in the client set, and the storage space has a space identifier; and the corresponding relationship between the space identifier and the mobile terminal is established.
  • the disclosed systems, devices, and methods may be implemented in other ways.
  • the device embodiments described above are merely illustrative.
  • the division of cells is only a logical function division. In actual implementation, there may be another division manner. For example, multiple units or components may be combined or integrated. Go to another system, or some features can be ignored or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
  • the units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.
  • An integrated unit if implemented in the form of a software functional unit and sold or used as a standalone product, can be stored in a computer readable storage medium.
  • the technical solution of the present invention which is essential or contributes to the prior art, or all or part of the technical solution, may be embodied in the form of a software product stored in a storage medium.
  • a number of instructions are included to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the various embodiments of the present invention.
  • the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like. .

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Human Computer Interaction (AREA)
  • Databases & Information Systems (AREA)
  • Mobile Radio Communication Systems (AREA)
  • Information Transfer Between Computers (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本发明实施例公开了一种数据的直播方法,包括:接收客户端集合中的每一个客户端发送的帧数据,客户端集合中的每一个客户端为同步运行目标应用的客户端;在客户端集合的范围内广播帧数据,并将帧数据同步发送给移动终端,以使得客户端集合中的各客户端接收数据帧进行数据交互,移动终端根据帧数据及预先存储的目标应用对应的数据生成目标应用对应的直播数据。本发明实施例中还提供了一种服务器、移动终端及数据的直播系统,本发明实施例中,可以降低直播过程中传输数据的带宽,节省网络流量,增强直播对于网络环境的适应性。

Description

数据的直播方法、相关设备及系统
本申请要求于2017年4月18日提交中国专利局、申请号为201710255354.4、发明名称为“一种数据的直播方法、相关设备及系统”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本发明涉及通信领域,尤其涉及数据直播。
背景技术
随着计算机和通信技术的不断发展,“全民直播”大时代已然来临,其中电子竞技直播以电子竞技内容为核心,以直播方式为依托,已经成为直播的一种主流形式。
由于电子竞技与传统的体育行业具有很多相似之处,是与互联网结合最深的体育细分行业,因此受众广泛,而且当前有越来越多的人偏好于不打游戏,而是看游戏,电子竞技直播行业的受众人群更是跨越不同年龄段。电子竞技行业又可以催生很多副产业,而且规模还在不断增长,由此可见,电子竞技直播行业未来发展前景广阔。
当前的电子竞技直播主要是通过录屏直播技术来实现的,通过屏幕录像,将视频数据编码,然后通过流媒体服务器或者对等(peer-to-peer,缩写:P2P)网络进行广播。
但是,视频编码后的数据传输对带宽的要求比较大,当前的电子竞技直播的带宽要求并不适用于当前的移动端的网络情况,用户若要观看电子竞技直播会受到网络情况的限制,例如,无线保真(WIreless-Fidelity,缩写:WiFi)的状态下可以观看直播,而通用分组无线服务(General Packet Radio Service,缩写:GPRS)网络状态下则无法观看直播。
发明内容
本发明实施例提供了一种数据的直播方法、相关设备及系统,用于降低直播过程中传输数据的带宽,节省网络流量,增强直播对于网络环境的适应 性。
第一方面,本发明实施例提供了一种数据的直播方法,包括:
接收客户端集合中的每一个客户端发送的帧数据,所述客户端集合中的每一个客户端为同步运行目标应用的客户端;
在所述客户端集合的范围内广播所述帧数据,并将所述帧数据同步发送给移动终端,以使得所述客户端集合中的各客户端接收所述帧数据进行数据交互,所述移动终端根据所述帧数据及预先存储的所述目标应用对应的数据生成所述目标应用对应的直播数据。
第二方面,本发明实施例提供了一种数据的直播方法,包括:
接收服务器发送的帧数据,所述帧数据包括客户端集合中的每一个客户端向所述服务器发送的帧数据,所述客户端集合中的每一个客户端为同步运行目标应用的客户端;
根据所述帧数据及预先存储的所述目标应用对应的数据生成所述目标应用对应的直播数据;
在显示屏幕上显示所述直播数据。
第三方面,本发明实施例提供了一种数据的直播方法,包括:
服务器接收客户端集合中的每一个客户端发送的帧数据,所述客户端集合中的每一个客户端为同步运行目标应用的客户端;
所述服务器在所述客户端集合的范围内广播所述帧数据,并将所述帧数据同步发送给移动终端,以使得所述客户端集合中的各客户端接收所述帧数据进行数据交互,所述移动终端根据所述帧数据及预先存储的所述目标应用对应的数据生成所述目标应用对应的直播数据。
第四方面,本发明实施例提供了一种数据的直播方法,包括:
移动终端接收服务器发送的帧数据,所述帧数据包括客户端集合中的每一个客户端向所述服务器发送的帧数据,所述客户端集合中的每一个客户端为同步运行目标应用的客户端;
所述移动终端根据所述帧数据及预先存储的所述目标应用对应的数据生成所述目标应用对应的直播数据;
所述移动终端在显示屏幕上显示所述直播数据。
第五方面,本发明实施例提供了一种服务器,包括:
第一接收模块,用于接收客户端集合中的每一个客户端发送的帧数据,所述客户端集合中的每一个客户端为同步运行目标应用的客户端;
发送模块,用于在所述客户端集合的范围内广播所述第一接收模块接收的所述帧数据,并将所述帧数据同步发送给移动终端,以使所述客户端集合中的各客户端接收所述帧数据进行数据交互,所述移动终端根据所述帧数据及预先存储的所述目标应用对应的数据生成所述目标应用对应的直播数据。
第六方面,本发明实施例提供了一种移动终端,包括:
第一接收模块,用于接收服务器发送的帧数据,所述帧数据包括客户端集合中的每一个客户端向所述服务器发送的帧数据,所述客户端集合中的每一个客户端为同步运行目标应用的客户端;
生成模块,用于根据所述第一接收模块接收的帧数据及预先存储的所述目标应用对应的数据生成所述目标应用对应的直播数据;
显示模块,用于显示所述生成模块生成的直播数据。
第七方面,本发明实施例提供了一种数据的直播系统,包括:
客户端集合、帧同步服务器和移动终端;
所述帧同步服务器,用于接收客户端集合中的每一个客户端发送的帧数据,在所述客户端集合的范围内广播所述帧数据,所述客户端集合中的每一个客户端为同步运行目标应用的客户端;
所述客户端集合中的各客户端,用于接收所述帧同步服务器发送的帧数据进行数据交互;
所述帧同步服务器,还用于将所述帧数据同步发送给所述移动终端;
所述移动终端,用于根据所述帧数据及预先存储的所述目标应用对应的数据生成所述目标应用对应的直播数据;在显示屏上显示所述直播数据。
第八方面,本发明实施例提供了一种服务器,所述服务器包括:
处理器以及存储器;
所述存储器,用于存储程序代码,并将所述程序代码传输给所述处理器;
所述处理器,用于调用存储器中的指令上述第一方面提供的数据的直播方法。
第九方面,本发明实施例提供了一种移动终端,所述移动终端包括:
处理器以及存储器;
所述存储器,用于存储程序代码,并将所述程序代码传输给所述处理器;
所述处理器,用于调用存储器中的指令执行上述第二方面提供的数据的直播方法。
第十方面,本发明实施例提供了一种存储介质,所述存储介质用于存储程序代码,所述程序代码用于执行上述第一方面提供的数据的直播方法。
第十一方面,本发明实施例提供了一种存储介质,所述存储介质用于存储程序代码,所述程序代码用于执行上述第二方面提供的数据的直播方法。
从以上技术方案可以看出,本发明实施例具有以下优点:
服务器接收客户端集合中的每一个客户端发送的帧数据,该客户端集合中的每一个客户端为同步运行目标应用的客户端,例如,该客户端集合中的每一客户端可以运行某游戏,并在游戏中接收用户输入的操作数据;该服务器在客户端集合的范围内广播帧数据,以使得客户端集合中的各客户端接收帧数据以进行数据交互,并将该帧数据发送给移动终端,该移动终端可以理解为电子竞技直播的观看方所使用的设备,移动终端根据帧数据及预先存储的目标应用对应的数据生成目标应用对应的直播数据,本发明实施例中,由于移动终端接收服务器发送的对于该目标应用的操作帧数据,然后根据接收到的帧数据和预先存储的该游戏的3D模型等数据渲染得到该直播数据,所以相对于传统的接收视频流所占用的带宽要低的多,极大的降低了传输数据的带宽,可以适用于当前的移动端的网络环境,节省网络流量,增强对于网络环境的适应性。
附图说明
为了更清楚地说明本发明实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域技术人员来讲,还可以根据这些附图获得其他的附图。
图1为本发明实施例中数据的直播系统的架构示意图;
图2为本发明实施例中一种数据的直播方法的一个实施例的步骤示意图;
图3为本发明实施例中一种数据的直播系统的另一个实施例的架构示意图;
图4为本发明实施例中系统中各设备执行功能的时序示意图;
图5为本发明实施例中一种服务器的一个实施例的结构示意图;
图6为本发明实施例中一种服务器的另一个实施例的结构示意图;
图7为本发明实施例中一种服务器的另一个实施例的结构示意图;
图8为本发明实施例中一种服务器的另一个实施例的结构示意图;
图9为本发明实施例中一种移动终端的一个实施例的结构示意图;
图10为本发明实施例中一种移动终端的另一个实施例的结构示意图;
图11为本发明实施例中一种移动终端的另一个实施例的结构示意图;
图12为本发明实施例中一种移动终端的另一个实施例的结构示意图;
图13为本发明实施例中一种数据的直播系统的一个实施例的结构示意图。
具体实施方式
本发明实施例提供了一种数据的直播方法、相关设备及系统,用于降低直播过程中传输数据的带宽,节省网络流量,增强直播对于网络环境的适应性。
为了使本技术领域的人员更好地理解本发明方案,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分的实施例,而不是全部的实施例。基于本发明中的实施例所获得的所有其他实施例,都应当属于本发明保护的范围。
本发明的说明书和权利要求书及上述附图中的术语“第一”、“第二”、“第三”“第四”等(如果存在)是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换,以便这里描述的实施例能够以除了在这里图示或描述的内容以外的顺序实施。此外,术语“包括”和“具有”以及他们的任何变形,意图在于覆盖不排他的包含,例如,包含了一系列步骤或单元的过程、方法、系统、产品或设备不必限于清楚地列出的那些步骤或单元,而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。
本发明实施例中提供了一种数据的直播方法,该数据的直播方法可以应用 于一种数据的直播系统,请结合图1进行理解,图1为该数据的直播系统的架构示意图,该直播系统包括客户端集合110,服务器120和移动终端130,其中,客户端集合110中的每个客户端用于向该服务器发送帧数据,其中该帧数据,并不是视频数据,可以理解为客户端在一个时间片(如40ms)接收的玩家输入的操作数据,以场景为例,该操作数据可以为控制角色进行投篮动作,移动,带球过人等等操作产生的数据。所述客户端集合中的每一个客户端为同步运行目标应用的客户端;服务器120用于接收客户端集合中的每一个客户端发送的帧数据,并在所述客户端集合的范围内广播接收到的所述帧数据,以使客户端集合中的各客户端通过该服务器进行数据交互;同时该服务器120将所述帧数据同步发送给移动终端130,移动终端130可以根据所述帧数据及预先存储的所述目标应用对应的数据生成所述目标应用运行的直播数据。移动终端130在显示屏上显示该直播数据。
需要说明的是,服务器120的功能可以由一个服务器来实现,在实际应用中,该服务器的功能也可以有几个服务器分别来实现,在实际应用中,对于该服务器的具体实现形态本发明不限定。
可以在如下场景中进行理解:该目标应用以一款竞技游戏“最强美职篮”为例进行说明。例如,该客户端集合中可以包括10个客户端,每个客户端上都同步运行有该游戏,在每个客户端由玩家控制一个角色,该游戏中共有10个角色,这10个角色分为两个队,每个队有5个角色,两个队进行竞技比赛,这和现实的篮球比赛近似,也就是说该客户端集合中的客户端为该游戏的竞技端。该服务器将接收到客户端的帧数据同步发送给移动终端,该移动终端用于显示该“最强美职篮”的实时赛况,该移动终端中已经预先加载了该“最强美职篮”对应的相关数据。例如,该相关数据包括该游戏的场景及3D人物模型,动作等数据。这样移动终端就可以根据接收到的帧数据和该相关数据进行渲染生成该“最强美职篮”的直播数据。用户通过该移动终端观看该篮球比赛的赛况。其中,该移动终端可以为手机、平板电脑、个人数字助理(Personal Digital Assistant,PDA)等,本发明实施例中,该移动终端可以为手机为例进行说明。
请参阅图2所示,下面对本发明实施例中提供的一种数据的直播方法进行详细说明,该数据的直播方法的一个实施例包括:
步骤201、服务器创建一个存储空间,该存储空间用于存储客户端集合中每一个客户端发送的帧数据,该存储空间具有空间标识。
服务器创建一个存储空间,该存储空间具有空间标识,该空间标识用于查找和索引该存储空间,例如该存储空间可以理解为一个直播房间,该直播房间具有对应的空间标识,该空间标识用于查找和索引该直播房间。
在实际应用中,服务器可以创建多个存储空间,每个存储空间均为一个直播房间,并且服务器可以创建存储空间的标识列表,该标识列表中包括的标识与存储空间具有映射关系。由于一个直播房间对应同一款游戏,服务器在一个直播房间内进行广播帧数据,可以使得客户端集合中的每个客户端都能接收到该帧数据。
例如,该存储空间的空间标识可以为一个序列号(如“5”),也可以为直播的内容(如“最强美职篮”),还可以为标签的组合(如,竞技-篮球)等,在实际应用中,具体的形式不限定。
步骤202、移动终端向服务器发送用于申请获取帧数据的请求,请求中包括该空间标识。
移动终端为用户观看比赛的观看端,首先,移动终端需要获取到观看该比赛的权限,移动终端向该服务器发送请求,该请求中包括空间标识(如“5”)。在如下场景中,用户想要观看“最强美职篮”的比赛直播,在直播平台中查找该游戏比赛的直播房间号为“5”,则终端向服务器发送携带有该空间标识的请求,该请求用于请求加入观看该游戏的直播赛事。
步骤203、服务器接收该请求,向移动终端反馈的响应,响应用于指示移动终端与空间标识建立对应关系。
服务器接收到该请求后,向该移动终端反馈一个响应,并将该空间标识与该移动终端建立对应关系,该响应用于通知该移动终端具有观看该直播房间的赛事的权限。
步骤204、客户端集合中的每一个客户端向服务器发送帧数据,客户端集合中的每一个客户端为同步运行目标应用的客户端。
客户端集合中的每一个客户端向服务器发送的帧数据,并不是视频数据,可以理解的是,客户端在一个时间片(如40ms)接收的玩家输入的操作数据。 例如,该操作数据为控制角色进行投篮动作,移动,带球过人等等操作产生的数据。
步骤205、服务器接收该帧数据,并服务器在客户端集合的范围内广播帧数据。
例如,该客户端集合中至少包括第一客户端和第二客户端,第一客户端接收玩家A的控制指令控制角色A,第二客户端接收玩家B的控制指令控制角色B。当服务器接收到第一客户端发送的角色A“投篮”的第一帧数据时,同时服务器接收到第二客户端“向左移动”的第二帧数据时,服务器将第一帧数据和第二帧数据在客户端集合的范围内广播,则在客户端集合中的10个客户端均能接收到该第一帧数据和该第二帧数据,每个客户端已经预先加载了该游戏对应的相关数据,该相关数据包括场景数据,3D模型数据等等。因此,每个客户端都会根据接收到的第一帧数据和第二帧数据和该游戏对应的相关数据进行计算,然后在客户端显示每个角色的动作。也就是说在客户端集合内的每个客户端通过接收到服务器广播的帧数据进行数据交互。
步骤206、服务器将该帧数据同步发送给移动终端。
服务器将接收到的客户端集合中的每个客户端发送的帧数据时,都会将该帧数据同步发送给移动终端,例如当服务器接收到角色A投篮的第一帧数据和角色B向左移动的第二帧数据时,服务器将该第一帧数据和第二帧数据同步发送给移动终端。
步骤207、移动终端接收服务器发送的帧数据,移动终端根据帧数据及预先存储的目标应用对应的数据生成目标应用对应的直播数据。
该移动终端中预先存储了该游戏对应的相关数据,该相关数据包括该游戏的场景数据,3D模型数据等等,例如移动终端根据接收到的第一帧数据和第二帧数据及该游戏的相关数据进行计算,生成该游戏的直播数据。
可以理解的是,本实施例中,移动终端接收到帧数据后,在本地进行演算播放同步的动画图像。这要求所有直播客户端集合中的所有客户端统一的计算逻辑,保证所有的移动终端显示的画面是相同的。
步骤208、终端在显示屏幕上显示直播数据。
可以理解的是,移动终端作为显示该游戏赛事的显示端,移动终端显示该 直播数据,用户就可以通过该移动终端观看该游戏的直播数据。
需要说明的是,由于帧数据是输入数据,在移动终端进行播放必须从第一帧开始计算。服务器需要缓冲最近一个段落的完整数据,例如对于篮球比赛分为不同的节,每节的时长可能为2分钟左右。
移动终端可以接收用户输入的是否进行快进的控制指令,例如,该直播到第20s该用户进入观看比赛,但是移动终端播放从第0秒开始播放,用户可以选择快进,直到跟当前的比赛进程完全同步。在另一种实现方式中,移动终端虽然还是第0秒开始播放,但是可以自动跳转到当前播放位置(如第20秒的位置),与当前的比赛进程同步。
本发明实施例中,在高在线的游戏直播中本发明实施例中的提供的方法优势显著,在本方案中支持百万人在线的直播活动所需的带宽大概是20000Mbps(Million bits per second,兆比特每秒)左右。如果使用普通的千兆网卡服务器,所需的服务器大概是24台左右(如,每台流量800Mbps,每台服务器可以支持在线人数大约为4-5万人),而用户端的流量仅仅20kbps。比如NBA类的体育竞技游戏直播。由于单用户所需要的带宽很低,对于手机网络的要求性不高,可以适用于各种网络环境,即使在GPRS网络下,也能很好的进行直播,极大的方便了用户对于电子竞技直播的观看。对于直播方,可以极大的节约服务器的带宽以及服务器成本。例如,对于单台千兆网卡的服务器可以承担4万人同时在线的直播活动。百万级别的直播服务也只需要30台服务器的群集。
在上述实施例的基础上,移动终端显示直播数据,可以使得用户观看直播数据,可选的,移动终端还可以接收用户输入的互动信息,该互动信息是为与当前移动终端播放的直播数据进行互动的信息。例如,该互动信息可以是文本信息,例如,加油的话语,评论等。该互动信息还可以为该游戏的相关信息中包括的预置的互动场景,移动终端可以接收用户输入的互动场景的选择指令,移动终端根据该选择指令确定该互动场景,例如,该互动场景可以移动终端接收用户输入的控制指令来控制比赛台下观众的动作,例如,该互动场景可以为“人浪”,“鼓掌”,“歌曲:remember the name”等,通过这些互动信息可以烘托比赛场的气氛。
然后,移动终端将互动信息发送给服务器。当服务器接收到该互动信息, 可以对互动信息进行校验。通过校验确定该互动信息中是否为符合规则的互动信息。例如,当该互动信息为文本信息时,服务器会校验该文本信息中的关键词是否有不符合规则的词语,避免一些非正能量的文本信息的输入等等,对互动信息进行校验的目的:首先:可以确定该互动信息是否为服务器已授权的移动终端发送的互动信息。然后,可以通过校验过滤一些不符合规定的信息,尽量保证网络的洁净,使电子竞技直播可以成为激发用户热情,充满正能量的网络活动。
若互动信息通过校验,则服务器根据移动终端关联的空间标识,将互动信息在客户端集合的范围内进行广播。客户端集合中的客户端显示该互动信息,为参赛客户端加油,烘托比赛气氛。
在本发明实施例中,服务器接收客户端集合中的每一个客户端发送的帧数据,该客户端集合中的每一个客户端为同步运行目标应用的客户端,例如,该客户端集合中的每一客户端可以运行某游戏,并在游戏中接收用户输入的操作数据;该服务器在客户端集合的范围内广播帧数据,以使得客户端集合中的各客户端接收帧数据以进行数据交互,并将该帧数据发送给移动终端,该移动终端可以理解为电子竞技直播的观看方所使用的设备,移动终端根据帧数据及预先存储的目标应用对应的数据生成目标应用对应的直播数据,本发明实施例中,由于移动终端接收服务器发送的对于该目标应用的操作帧数据,然后根据接收到的帧数据和预先存储的该游戏的3D模型等数据渲染得到该直播数据,所以相对于传统的接收视频流所占用的带宽要低的多,极大的降低了传输数据的带宽,可以适用于当前的移动端的网络环境,节省网络流量,增强对于网络环境的适应性。
需要说明的是,上述图1对应的数据的直播系统的架构示意图所示出的系统架构中,服务器的功能可以由帧同步服务器、中继服务器和存储空间服务器来功能执行。本发明实施例中还提供了一种数据的直播系统的另一个实施例,请结合图3进行理解,图3为一种数据的直播系统的另一个实施例的架构示意图。该数据的直播系统包括客户端集合310、帧同步服务器320、中继服务器330、存储空间服务器340和移动终端350。
请结合图4进行理解,图4为该数据的直播系统的各设备执行功能的时序 示意图。存储空间服务器340创建一个存储空间,该存储空间用于存储客户端集合中每一个客户端发送的帧数据,该存储空间具有空间标识;在实际应用中,该存储空间可以理解为一个直播房间,存储空间服务器340同时在帧同步服务器320和中继服务器330上创建一个存储空间,以下均以存储空间为直播房间为例进行说明。
该中继服务器330接收移动终端发送的请求,可以理解的是,该请求用于注册到该直播房间,以获取到该直播房间的帧数据。
存储空间服务器340建立空间标识和移动终端的对应关系。帧同步服务器320接收客户端集合中的每一个客户端发送的帧数据,客户端集合310中的每一个客户端为同步运行目标应用的客户端,客户端集合为接收输入操作数据的客户端的集合。
客户端集合中的各客户端通过帧同步服务器的帧数据广播进行数据交互;帧同步服务器320在客户端集合的范围内广播帧数据,并将帧数据同步发送给中继服务器330;中继服务器330将帧数据转发给移动终端350,以使得移动终端350根据帧数据及预先存储的目标应用对应的数据生成目标应用对应的直播数据;移动终端350在显示屏上显示直播数据。需要说明的是,中继服务器330在实际应用中也可以为一个服务器组群。
在一个应用场景中:参加直播比赛的客户端在存储空间服务器上创建一个直播间。存储空间服务器会同步直播间数据到帧同步服务器和中继服务器上。
客户端参与比赛产生输入帧数据(如控制角色投篮,向左移动等操作数据),将帧数据上报到帧同步服务器,帧同步服务器将帧数据进行直播间内的广播(比赛客户端集合之间帧数据的同步),并且将帧数据同步到中继服务器上。
观看方移动终端通过存储空间服务器查看到当前比赛的列表,查找到相应的直播间标识。然后,接收中继服务器发送的该直播间标识对应的帧数据,在本地演算重现整个比赛过程。
本发明实施例中,在高在线的游戏直播过程中只需要少量服务器,极大的节约了服务器的设备成本以及带宽成本。如,由于传输的是帧数据,传输的数据量较小,几乎不需要缓冲,直播的实时性也得到了很大的提高。
上面对一种数据的直播方法进行了描述,下面对该数据的直播方法所应用的服务器进行描述,请参阅图5所示,图5为本发明实施例中提供的服务器的一个实施例包括:
第一接收模块501,用于接收客户端集合中的每一个客户端发送的帧数据,客户端集合中的每一个客户端为同步运行目标应用的客户端;
发送模块502,用于在客户端集合的范围内广播第一接收模块501接收的帧数据,并将帧数据同步发送给移动终端,以使得客户端集合中的各客户端接收数据帧进行数据交互,移动终端根据帧数据及预先存储的目标应用对应的数据生成目标应用对应的直播数据。
在图5对应的实施例的基础上,请参阅图6所示,本发明实施例还提供了一种服务器600的另一个实施例包括:
还包括存储空间创建模块503和关系确定模块504;
存储空间创建模块503,用于创建一个存储空间,存储空间用于存储客户端集合中每一个客户端发送的帧数据,存储空间具有空间标识;
关系确定模块504,用于建立空间标识和移动终端的对应关系。
在图6对应的实施例的基础上,请参阅图7所示,本发明实施例还提供了一种服务器700的另一个实施例包括:
还包括第二接收模块505,校验模块507和广播模块508;
第二接收模块505,用于接收移动终端发送的互动信息;
校验模块507,用于对第二接收模块505接收的互动信息进行校验;
广播模块508,用于当互动信息通过校验时,根据移动终端关联的空间标识,将互动信息在客户端集合的范围内进行广播。
进一步的,图5至图7中的服务器是以功能模块的形式来呈现。这里的“模块”可以指特定应用集成电路(application-specific integrated circuit,ASIC),电路,执行一个或多个软件或固件程序的处理器和存储器,集成逻辑电路,和/或其他可以提供上述功能的器件。在一个简单的实施例中,图5至图7中的服务器可以采用图8所示的形式。
图8是本发明实施例提供的一种服务器结构示意图,该服务器800可因配置或性能不同而产生比较大的差异,可以包括一个或一个以上中央处理器 (central processing units,CPU)822(例如,一个或一个以上处理器)和存储器832,一个或一个以上存储应用程序842或数据844的存储介质830(例如一个或一个以上海量存储设备)。其中,存储器832和存储介质830可以是短暂存储或持久存储。存储在存储介质830的程序可以包括一个或一个以上模块(图示没标出),每个模块可以包括对服务器中的一系列指令操作。更进一步地,中央处理器822可以设置为与存储介质830通信,在服务器800上执行存储介质830中的一系列指令操作。
服务器800还可以包括一个或一个以上电源826,一个或一个以上有线或无线网络接口850,一个或一个以上输入输出接口858,和/或,一个或一个以上操作系统841,例如Windows ServerTM,Mac OS XTM,UnixTM,LinuxTM,FreeBSDTM等等。
上述实施例中中央处理器使服务器执行以下数据的直播方法:
接收客户端集合中的每一个客户端发送的帧数据,客户端集合中的每一个客户端为同步运行目标应用的客户端;
在客户端集合的范围内广播帧数据,并将帧数据同步发送给移动终端,以使得客户端集合中的各客户端接收帧数据进行数据交互,移动终端根据帧数据及预先存储的目标应用对应的数据生成目标应用对应的直播数据。
在一种可能的实现方式中,将帧数据发送给移动终端之前,还包括:
创建一个存储空间,存储空间用于存储客户端集合中每一个客户端发送的帧数据,存储空间具有空间标识;
建立空间标识和移动终端的对应关系。
在一种可能的实现方式中,还包括:
接收移动终端发送的互动信息;
对互动信息进行校验;
若互动信息通过校验,则根据移动终端关联的空间标识,将互动信息在客户端集合的范围内进行广播。
请参阅图9所示,本发明实施例还提供了一种移动终端900的一个实施例包括:
第一接收模块901,用于接收服务器发送的帧数据,帧数据包括客户端集 合中的每一个客户端向服务器发送的帧数据,客户端集合中的每一个客户端为同步运行目标应用的客户端;
生成模块902,用于根据第一接收模块901接收的帧数据及预先存储的目标应用对应的数据生成目标应用对应的直播数据;
显示模块903,用于显示直播数据。
在图9对应的实施例的基础上,请参阅图10所示,本发明实施例还提供了一种移动终端1000的另一个实施例包括:
还包括第一发送模块905和第二接收模块904;
第一发送模块905,用于向服务器发送用于申请获取帧数据的请求,帧数据被存储在服务器创建的存储空间,存储空间具有对应的空间标识;
第二接收模块904,用于接收服务器反馈的响应,响应中包括空间标识,空间标识用于指示服务器建立移动终端与空间标识的对应关系。
在图10对应的实施例的基础上,请参阅图11所示,本发明实施例还提供了一种移动终端1100的另一个实施例包括:
还包括第三接收模块906和第二发送模块907;
第三接收模块906,用于接收用户输入的互动信息;
第二发送模块907,用于将第三接收模块906接收的互动信息发送给服务器,以使服务器根据空间标识将互动信息在客户端集合的范围内进行广播。
进一步的,图9至图11中的移动终端是以功能模块的形式来呈现。这里的“模块”可以指特定应用集成电路(application-specific integrated circuit,ASIC),电路,执行一个或多个软件或固件程序的处理器和存储器,集成逻辑电路,和/或其他可以提供上述功能的器件。在一个简单的实施例中,图9至图11中的移动终端可以采用图12所示的形式。
如图12所示,为了便于说明,仅示出了与本发明实施例相关的部分,具体技术细节未揭示的,请参照本发明实施例方法部分。该终端可以为包括手机、平板电脑、PDA(Personal Digital Assistant,个人数字助理)、POS(Point of Sales,销售终端)、车载电脑等任意终端设备,以终端为手机为例:
图12示出的是与本发明实施例提供的终端相关的手机的部分结构的框图。参考图12,手机包括:射频(Radio Frequency,RF)电路1210、存储器 1220、输入单元1230、显示单元1240、传感器1250、音频电路1260、无线保真(wireless fidelity,WiFi)模块1270、处理器1280、以及电源1290等部件。本领域技术人员可以理解,图12中示出的手机结构并不构成对手机的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。
下面结合图12对手机的各个构成部件进行具体的介绍:
RF电路1210可用于收发信息或通话过程中,信号的接收和发送,特别地,将基站的下行信息接收后,给处理器1280处理;另外,将设计上行的数据发送给基站。通常,RF电路1210包括但不限于天线、至少一个放大器、收发信机、耦合器、低噪声放大器(Low Noise Amplifier,LNA)、双工器等。此外,RF电路1210还可以通过无线通信与网络和其他设备通信。上述无线通信可以使用任一通信标准或协议,包括但不限于全球移动通讯系统(Global System of Mobile communication,GSM)、通用分组无线服务(General Packet Radio Service,GPRS)、码分多址(Code Division Multiple Access,CDMA)、宽带码分多址(Wideband Code Division Multiple Access,WCDMA)、长期演进(Long Term Evolution,LTE)、电子邮件、短消息服务(Short Messaging Service,SMS)等。
存储器1220可用于存储软件程序以及模块,处理器1280通过运行存储在存储器1220的软件程序以及模块,从而执行手机的各种功能应用以及数据处理。存储器1220可主要包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需的应用程序(比如声音播放功能、图像播放功能等)等;存储数据区可存储根据手机的使用所创建的数据(比如音频数据、电话本等)等。此外,存储器1220可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。
输入单元1230可用于接收输入的数字或字符信息,以及产生与手机的用户设置以及功能控制有关的键信号输入。具体地,输入单元1230可包括触控面板1231以及其他输入设备1232。触控面板1231,也称为触摸屏,可收集用户在其上或附近的触摸操作(比如用户使用手指、触笔等任何适合的物体或附件在触控面板1231上或在触控面板1231附近的操作),并根据预先设定的程 式驱动相应的连接装置。可选的,触控面板1231可包括触摸检测装置和触摸控制器两个部分。其中,触摸检测装置检测用户的触摸方位,并检测触摸操作带来的信号,将信号传送给触摸控制器;触摸控制器从触摸检测装置上接收触摸信息,并将它转换成触点坐标,再送给处理器1280,并能接收处理器1280发来的命令并加以执行。此外,可以采用电阻式、电容式、红外线以及表面声波等多种类型实现触控面板1231。除了触控面板1231,输入单元1230还可以包括其他输入设备1232。具体地,其他输入设备1232可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆等中的一种或多种。
显示单元1240可用于显示由用户输入的信息或提供给用户的信息以及手机的各种菜单。显示单元1240可包括显示面板1241,可选的,可以采用液晶显示器(Liquid Crystal Display,LCD)、有机发光二极管(Organic Light-Emitting Diode,OLED)等形式来配置显示面板1241。进一步的,触控面板1231可覆盖显示面板1241,当触控面板1231检测到在其上或附近的触摸操作后,传送给处理器1280以确定触摸事件的类型,随后处理器1280根据触摸事件的类型在显示面板1241上提供相应的视觉输出。虽然在图12中,触控面板1231与显示面板1241是作为两个独立的部件来实现手机的输入和输入功能,但是在某些实施例中,可以将触控面板1231与显示面板1241集成而实现手机的输入和输出功能。
手机还可包括至少一种传感器1250,比如光传感器、运动传感器以及其他传感器。具体地,光传感器可包括环境光传感器及接近传感器,其中,环境光传感器可根据环境光线的明暗来调节显示面板1241的亮度,接近传感器可在手机移动到耳边时,关闭显示面板1241和/或背光。作为运动传感器的一种,加速计传感器可检测各个方向上(一般为三轴)加速度的大小,静止时可检测出重力的大小及方向,可用于识别手机姿态的应用(比如横竖屏切换、相关游戏、磁力计姿态校准)、振动识别相关功能(比如计步器、敲击)等;至于手机还可配置的陀螺仪、气压计、湿度计、温度计、红外线传感器等其他传感器,在此不再赘述。
音频电路1260、扬声器1261,传声器1262可提供用户与手机之间的音频 接口。音频电路1260可将接收到的音频数据转换后的电信号,传输到扬声器1261,由扬声器1261转换为声音信号输出;另一方面,传声器1262将收集的声音信号转换为电信号,由音频电路1260接收后转换为音频数据,再将音频数据输出处理器1280处理后,经RF电路1210以发送给比如另一手机,或者将音频数据输出至存储器1220以便进一步处理。
WiFi属于短距离无线传输技术,手机通过WiFi模块1270可以帮助用户收发电子邮件、浏览网页和访问流式媒体等,它为用户提供了无线的宽带互联网访问。虽然图12示出了WiFi模块1270,但是可以理解的是,其并不属于手机的必须构成,完全可以根据需要在不改变发明的本质的范围内而省略。
处理器1280是手机的控制中心,利用各种接口和线路连接整个手机的各个部分,通过运行或执行存储在存储器1220内的软件程序和/或模块,以及调用存储在存储器1220内的数据,执行手机的各种功能和处理数据,从而对手机进行整体监控。可选的,处理器1280可包括一个或多个处理单元;优选的,处理器1280可集成应用处理器和调制解调处理器,其中,应用处理器主要处理操作系统、用户界面和应用程序等,调制解调处理器主要处理无线通信。可以理解的是,上述调制解调处理器也可以不集成到处理器1280中。
手机还包括给各个部件供电的电源1290(比如电池),优选的,电源可以通过电源管理系统与处理器1280逻辑相连,从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。
尽管未示出,手机还可以包括摄像头、蓝牙模块等,在此不再赘述。
在本发明实施例中,该终端所包括的处理器1280还用于使该移动终端执行以下数据的直播方法:。
接收服务器发送的帧数据,帧数据包括客户端集合中的每一个客户端向服务器发送的帧数据,客户端集合中的每一个客户端为同步运行目标应用的客户端;
根据帧数据及预先存储的目标应用对应的数据生成目标应用对应的直播数据;
在显示屏幕上显示直播数据。
在一种可能的实现方式中,还包括:
向服务器发送用于申请获取帧数据的请求,请求中包括空间标识,帧数据被存储在服务器创建的存储空间,存储空间具有对应的空间标识;
接收服务器反馈的响应,响应用于指示服务器建立移动终端与空间标识的对应关系。
在一种可能的实现方式中,还包括:
接收用户输入的互动信息;
将互动信息发送给服务器,以使服务器根据空间标识将互动信息在客户端集合的范围内进行广播。
请参阅图13所示,本发明实施例还提供了一种数据的直播系统的一个实施例,可以包括:
客户端集合1301、帧同步服务器1302和移动终端1303;
帧同步服务器1302,用于接收客户端集合中的每一个客户端发送的帧数据,在客户端集合的范围内广播帧数据,客户端集合中的每一个客户端为同步运行目标应用的客户端;
客户端集合1301中的各客户端,用于接收帧同步服务器发送的帧数据进行数据交互;
帧同步服务器1302,还用于将帧数据同步发送给移动终端;
移动终端1303,用于根据帧数据及预先存储的目标应用对应的数据生成目标应用对应的直播数据;在显示屏上显示直播数据。
在一些可能的实现方式中,还包括中继服务器;
帧同步服务器通过中继服务器将帧数据转发给移动终端。
在一些可能的实现方式中,还包括存储空间服务器;
存储空间服务器,用于创建一个存储空间,存储空间用于存储客户端集合中每一个客户端发送的帧数据,存储空间具有空间标识;建立空间标识和移动终端的对应关系。
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的系统,装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。
在本申请所提供的几个实施例中,应该理解到,所揭露的系统,装置和方 法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。
作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外,在本发明各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。
集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本发明各个实施例方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。
以上,以上实施例仅用以说明本发明的技术方案,而非对其限制;尽管参照前述实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本发明各实施例技术方案的精神和范围。

Claims (25)

  1. 一种数据的直播方法,包括:
    接收客户端集合中的每一个客户端发送的帧数据,所述客户端集合中的每一个客户端为同步运行目标应用的客户端;
    在所述客户端集合的范围内广播所述帧数据,并将所述帧数据同步发送给移动终端,以使得所述客户端集合中的各客户端接收所述帧数据进行数据交互,所述移动终端根据所述帧数据及预先存储的所述目标应用对应的数据生成所述目标应用对应的直播数据。
  2. 根据权利要求1所述的数据的直播方法,所述将所述帧数据发送给移动终端之前,所述方法还包括:
    创建一个存储空间,所述存储空间用于存储所述客户端集合中每一个客户端发送的帧数据,所述存储空间具有空间标识;
    建立所述空间标识和所述移动终端的对应关系。
  3. 根据权利要求2所述的数据的直播方法,所述方法还包括:
    接收所述移动终端发送的互动信息;
    对所述互动信息进行校验;
    若所述互动信息通过校验,则根据所述移动终端关联的空间标识,将所述互动信息在所述客户端集合的范围内进行广播。
  4. 一种数据的直播方法,包括:
    接收服务器发送的帧数据,所述帧数据包括客户端集合中的每一个客户端向所述服务器发送的帧数据,所述客户端集合中的每一个客户端为同步运行目标应用的客户端;
    根据所述帧数据及预先存储的所述目标应用对应的数据生成所述目标应用对应的直播数据;
    在显示屏幕上显示所述直播数据。
  5. 根据权利要求4所述的数据的直播方法,所述方法还包括:
    向所述服务器发送用于申请获取帧数据的请求,所述请求中包括空间标识,所述帧数据被存储在所述服务器创建的存储空间,所述存储空间具有对应的空间标识;
    接收所述服务器反馈的响应,所述响应用于指示所述服务器建立所述移动终端与所述空间标识的对应关系。
  6. 根据权利要求5所述的数据的直播方法,所述方法还包括:
    接收用户输入的互动信息;
    将所述互动信息发送给所述服务器,以使所述服务器根据所述空间标识将所述互动信息在所述客户端集合的范围内进行广播。
  7. 一种数据的直播方法,包括:
    服务器接收客户端集合中的每一个客户端发送的帧数据,所述客户端集合中的每一个客户端为同步运行目标应用的客户端;
    所述服务器在所述客户端集合的范围内广播所述帧数据,并将所述帧数据同步发送给移动终端,以使得所述客户端集合中的各客户端接收所述帧数据进行数据交互,所述移动终端根据所述帧数据及预先存储的所述目标应用对应的数据生成所述目标应用对应的直播数据。
  8. 根据权利要求7所述的数据的直播方法,所述将所述帧数据发送给移动终端之前,所述方法还包括:
    所述服务器创建一个存储空间,所述存储空间用于存储所述客户端集合中每一个客户端发送的帧数据,所述存储空间具有空间标识;
    所述服务器建立所述空间标识和所述移动终端的对应关系。
  9. 根据权利要求8所述的数据的直播方法,所述方法还包括:
    所述服务器接收所述移动终端发送的互动信息;
    所述服务器对所述互动信息进行校验;
    若所述互动信息通过校验,则所述服务器根据所述移动终端关联的空间标识,将所述互动信息在所述客户端集合的范围内进行广播。
  10. 一种数据的直播方法,包括:
    移动终端接收服务器发送的帧数据,所述帧数据包括客户端集合中的每一个客户端向所述服务器发送的帧数据,所述客户端集合中的每一个客户端为同步运行目标应用的客户端;
    所述移动终端根据所述帧数据及预先存储的所述目标应用对应的数据生成所述目标应用对应的直播数据;
    所述移动终端在显示屏幕上显示所述直播数据。
  11. 根据权利要求10所述的数据的直播方法,所述方法还包括:
    所述移动终端向所述服务器发送用于申请获取帧数据的请求,所述请求中包括空间标识,所述帧数据被存储在所述服务器创建的存储空间,所述存储空间具有对应的空间标识;
    所述移动终端接收所述服务器反馈的响应,所述响应用于指示所述服务器建立所述移动终端与所述空间标识的对应关系。
  12. 根据权利要求11所述的数据的直播方法,所述方法还包括:
    所述移动终端接收用户输入的互动信息;
    所述移动终端将所述互动信息发送给所述服务器,以使所述服务器根据所述空间标识将所述互动信息在所述客户端集合的范围内进行广播。
  13. 一种服务器,包括:
    第一接收模块,用于接收客户端集合中的每一个客户端发送的帧数据,所述客户端集合中的每一个客户端为同步运行目标应用的客户端;
    发送模块,用于在所述客户端集合的范围内广播所述第一接收模块接收的所述帧数据,并将所述帧数据同步发送给移动终端,以使所述客户端集合中的各客户端接收所述帧数据进行数据交互,所述移动终端根据所述帧数据及预先存储的所述目标应用对应的数据生成所述目标应用对应的直播数据。
  14. 根据权利要求13所述的服务器,还包括存储空间创建模块和关系确定模块;
    所述存储空间创建模块,用于创建一个存储空间,所述存储空间用于存储所述客户端集合中每一个客户端发送的帧数据,所述存储空间具有对应的空间标识;
    所述关系确定模块,用于建立所述空间标识和所述移动终端的对应关系。
  15. 根据权利要求14所述的服务器,还包括第二接收模块,校验模块和广播模块;
    所述第二接收模块,用于接收所述移动终端发送的互动信息;
    所述校验模块,用于对所述第二接收模块接收的所述互动信息进行校验;
    所述广播模块,用于当所述互动信息通过校验时,根据所述移动终端关联 的空间标识,将所述互动信息在所述客户端集合的范围内进行广播。
  16. 一种移动终端,包括:
    第一接收模块,用于接收服务器发送的帧数据,所述帧数据包括客户端集合中的每一个客户端向所述服务器发送的帧数据,所述客户端集合中的每一个客户端为同步运行目标应用的客户端;
    生成模块,用于根据所述第一接收模块接收的帧数据及预先存储的所述目标应用对应的数据生成所述目标应用对应的直播数据;
    显示模块,用于显示所述生成模块生成的直播数据。
  17. 根据权利要求16所述的移动终端,还包括第二发送模块和第二接收模块;
    所述第二发送模块,用于向所述服务器发送用于申请获取帧数据的请求,所述请求包括空间标识,所述帧数据被存储在所述服务器创建的存储空间,所述存储空间具有对应的空间标识;
    所述第二接收模块,用于接收所述服务器反馈的响应,所述响应用于指示所述服务器建立所述移动终端与所述空间标识的对应关系。
  18. 根据权利要求17所述的移动终端,还包括第三接收模块和第二发送模块;
    所述第三接收模块,用于接收用户输入的互动信息;
    所述第二发送模块,用于将所述第三接收模块接收的所述互动信息发送给所述服务器,以使所述服务器根据所述空间标识将所述互动信息在所述客户端集合的范围内进行广播。
  19. 一种数据的直播系统,包括客户端集合、帧同步服务器和移动终端;
    所述帧同步服务器,用于接收客户端集合中的每一个客户端发送的帧数据,在所述客户端集合的范围内广播所述帧数据,所述客户端集合中的每一个客户端为同步运行目标应用的客户端;
    所述客户端集合中的各客户端,用于接收所述帧同步服务器发送的帧数据进行数据交互;
    所述帧同步服务器,还用于将所述帧数据同步发送给所述移动终端;
    所述移动终端,用于根据所述帧数据及预先存储的所述目标应用对应的数 据生成所述目标应用对应的直播数据;在显示屏上显示所述直播数据。
  20. 根据权利要求19的数据的直播系统,还包括中继服务器;
    所述帧同步服务器通过所述中继服务器将所述帧数据转发给移动终端。
  21. 根据权利19或20所述的数据的直播系统,还包括存储空间服务器;
    所述存储空间服务器,用于创建一个存储空间,所述存储空间用于存储所述客户端集合中每一个客户端发送的帧数据,所述存储空间具有空间标识;建立所述空间标识和所述移动终端的对应关系。
  22. 一种服务器,所述服务器包括:
    处理器以及存储器;
    所述存储器,用于存储程序代码,并将所述程序代码传输给所述处理器;
    所述处理器,用于调用存储器中的指令执行权利要求1-3任一项所述的数据的直播方法。
  23. 一种移动终端,所述移动终端包括:
    处理器以及存储器;
    所述存储器,用于存储程序代码,并将所述程序代码传输给所述处理器;
    所述处理器,用于调用存储器中的指令执行权利要求4-6任一项所述的数据的直播方法。
  24. 一种存储介质,所述存储介质用于存储程序代码,所述程序代码用于执行权利要求1-3任一项所述的数据的直播方法。
  25. 一种存储介质,所述存储介质用于存储程序代码,所述程序代码用于执行权利要求4-6任一项所述的数据的直播方法。
PCT/CN2018/082909 2017-04-18 2018-04-13 数据的直播方法、相关设备及系统 WO2018192415A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US16/438,701 US11122307B2 (en) 2017-04-18 2019-06-12 Data live streaming method, and related device and system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710255354.4 2017-04-18
CN201710255354.4A CN106993200B (zh) 2017-04-18 2017-04-18 一种数据的直播方法、相关设备及系统

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US16/438,701 Continuation US11122307B2 (en) 2017-04-18 2019-06-12 Data live streaming method, and related device and system

Publications (1)

Publication Number Publication Date
WO2018192415A1 true WO2018192415A1 (zh) 2018-10-25

Family

ID=59415671

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/082909 WO2018192415A1 (zh) 2017-04-18 2018-04-13 数据的直播方法、相关设备及系统

Country Status (3)

Country Link
US (1) US11122307B2 (zh)
CN (1) CN106993200B (zh)
WO (1) WO2018192415A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110113256A (zh) * 2019-05-14 2019-08-09 北京达佳互联信息技术有限公司 信息互动方法、装置、服务器、用户终端及可读存储介质

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11372889B2 (en) * 2015-04-22 2022-06-28 The Bank Of New York Mellon Multi-modal-based generation of data synchronization instructions
CN106993200B (zh) * 2017-04-18 2019-05-31 腾讯科技(深圳)有限公司 一种数据的直播方法、相关设备及系统
CN108057241A (zh) * 2017-12-12 2018-05-22 苏州蜗牛数字科技股份有限公司 一种竞技类型游戏服务器系统及其交互方法
CN110120931B (zh) * 2018-02-06 2021-10-08 腾讯科技(深圳)有限公司 一种信息交互方法、装置及存储介质
CN110213628B (zh) * 2018-05-14 2022-02-18 腾讯科技(深圳)有限公司 直播间分配方法和服务器
CN110069536A (zh) * 2018-08-14 2019-07-30 深圳开黑科技有限公司 基于游戏陪玩平台的车队搜索方法、设备及系统
CN109598777B (zh) * 2018-12-07 2022-12-23 腾讯科技(深圳)有限公司 图像渲染方法、装置、设备及存储介质
CN110392104B (zh) * 2019-07-18 2022-06-10 腾讯科技(深圳)有限公司 数据同步方法、系统、服务器及存储介质
CN110971506B (zh) * 2019-11-06 2021-12-28 厦门亿联网络技术股份有限公司 一种去中心化实时集群通讯方法、装置、设备及系统
CN113473160B (zh) * 2020-03-31 2023-05-02 北京达佳互联信息技术有限公司 一种直播间的匹配方法、装置、设备及存储介质
CN111580724B (zh) * 2020-06-28 2021-12-10 腾讯科技(深圳)有限公司 一种信息互动方法、设备及存储介质
CN111726650B (zh) * 2020-06-30 2022-10-18 广州繁星互娱信息科技有限公司 视频直播方法及装置、计算机存储介质
CN111917866B (zh) * 2020-07-29 2021-08-31 腾讯科技(深圳)有限公司 一种数据同步的方法、装置、设备及存储介质
CN113032160B (zh) * 2021-03-11 2024-01-30 腾讯科技(深圳)有限公司 一种数据同步的管理方法以及相关装置
CN113286159B (zh) * 2021-05-14 2022-05-31 北京字跳网络技术有限公司 应用程序的页面显示方法、装置和设备

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150018094A1 (en) * 2013-07-10 2015-01-15 Sony Computer Entertainment Inc. Content providing method, content providing server, and content providing system
CN105306468A (zh) * 2015-10-30 2016-02-03 广州华多网络科技有限公司 一种合成视频数据实时共享的方法及其主播客户端
CN106210753A (zh) * 2016-05-24 2016-12-07 北京畅游天下网络技术有限公司 一种视频直播方法及装置
CN106993200A (zh) * 2017-04-18 2017-07-28 腾讯科技(深圳)有限公司 一种数据的直播方法、相关设备及系统

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9352222B2 (en) * 2002-12-10 2016-05-31 Sony Interactive Entertainment America Llc System and method for capturing text for an online application
US9032465B2 (en) * 2002-12-10 2015-05-12 Ol2, Inc. Method for multicasting views of real-time streaming interactive video
US20090118019A1 (en) * 2002-12-10 2009-05-07 Onlive, Inc. System for streaming databases serving real-time applications used through streaming interactive video
US8875208B1 (en) * 2007-11-21 2014-10-28 Skype High quality multimedia transmission from a mobile device for live and on-demand viewing
US8167724B2 (en) * 2007-12-10 2012-05-01 Gary Stephen Shuster Guest management in an online multi-player virtual reality game
US9266017B1 (en) * 2008-12-03 2016-02-23 Electronic Arts Inc. Virtual playbook with user controls
CN102647398B (zh) * 2011-02-16 2014-11-26 腾讯科技(深圳)有限公司 基于移动终端实现游戏的方法及装置
JP5982111B2 (ja) * 2011-11-08 2016-08-31 株式会社タイトー ゲームサーバ、ゲーム装置、ゲームプログラム
EP2713609B1 (en) * 2012-09-28 2015-05-06 Stockholms Universitet Holding AB Dynamic delay handling in mobile live video production systems
DE102012224321B4 (de) * 2012-12-21 2022-12-15 Applejack 199 L.P. Messvorrichtung zum Erfassen einer Schlagbewegung eines Schlägers, Trainingsvorrichtung und Verfahren zum Training einer Schlagbewegung
US9942622B2 (en) * 2014-01-24 2018-04-10 Hiperwall, Inc. Methods and systems for synchronizing media stream presentations
CN106034129B (zh) * 2015-03-18 2019-04-12 广州四三九九信息科技有限公司 一种用于游戏同步的fbsg方法
US10163245B2 (en) * 2016-03-25 2018-12-25 Microsoft Technology Licensing, Llc Multi-mode animation system
US10112110B1 (en) * 2016-03-30 2018-10-30 Amazon Technologies, Inc. Initiating a game session with broadcast subscribers
JP6643191B2 (ja) * 2016-06-07 2020-02-12 任天堂株式会社 ゲーム装置、ゲームプログラム、ゲームシステム、およびゲーム処理方法
US10193944B2 (en) * 2016-06-17 2019-01-29 Q Technologies Inc. Systems and methods for multi-device media broadcasting or recording with active control
WO2018095366A1 (zh) * 2016-11-24 2018-05-31 腾讯科技(深圳)有限公司 视频推荐确定、信息显示、基于帧同步的数据处理方法
US10489967B2 (en) * 2017-02-22 2019-11-26 Microsoft Technology Licensing, Llc Indexed value blending for use in image rendering
US10200768B2 (en) * 2017-03-30 2019-02-05 Microsoft Technology Licensing, Llc Low-latency mobile device audiovisual streaming

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150018094A1 (en) * 2013-07-10 2015-01-15 Sony Computer Entertainment Inc. Content providing method, content providing server, and content providing system
CN105306468A (zh) * 2015-10-30 2016-02-03 广州华多网络科技有限公司 一种合成视频数据实时共享的方法及其主播客户端
CN106210753A (zh) * 2016-05-24 2016-12-07 北京畅游天下网络技术有限公司 一种视频直播方法及装置
CN106993200A (zh) * 2017-04-18 2017-07-28 腾讯科技(深圳)有限公司 一种数据的直播方法、相关设备及系统

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110113256A (zh) * 2019-05-14 2019-08-09 北京达佳互联信息技术有限公司 信息互动方法、装置、服务器、用户终端及可读存储介质

Also Published As

Publication number Publication date
CN106993200A (zh) 2017-07-28
US20190297360A1 (en) 2019-09-26
US11122307B2 (en) 2021-09-14
CN106993200B (zh) 2019-05-31

Similar Documents

Publication Publication Date Title
WO2018192415A1 (zh) 数据的直播方法、相关设备及系统
US9924205B2 (en) Video remote-commentary synchronization method and system, and terminal device
WO2018126885A1 (zh) 一种游戏数据处理的方法
WO2019149049A1 (zh) 一种业务处理方法、终端、服务器及相关产品
CN106686396B (zh) 一种切换直播间的方法和系统
WO2017008627A1 (zh) 多媒体直播方法、装置和系统
CN111491197B (zh) 一种直播内容展示的方法、装置及存储介质
WO2016180135A1 (zh) 直播互动系统、信息发送方法、信息接收方法及设备
CN107454416B (zh) 视频流发送方法和装置
WO2017020663A1 (zh) 弹幕视频直播方法、装置、视频源设备及网络接入设备
CN107438200A (zh) 直播间礼物展示的方法和装置
CN106303733B (zh) 播放直播特效信息的方法和装置
CN107333162B (zh) 一种播放直播视频的方法和装置
WO2018137524A1 (zh) 一种在客户端显示数据的处理方法及相关设备
WO2017215661A1 (zh) 一种场景音效的控制方法、及电子设备
WO2017215652A1 (zh) 音效参数的调节方法及移动终端
WO2018205786A1 (zh) 分享录屏视频的方法、装置及设备
CN112312144B (zh) 一种直播方法、装置、设备和存储介质
CN107908765B (zh) 一种游戏资源处理方法、移动终端及服务器
CN110087149A (zh) 一种视频图像分享方法、装置及移动终端
CN110465080A (zh) 控制振动的方法、装置、移动终端及计算机可读存储介质
WO2017215511A1 (zh) 一种场景音效的控制方法、及相关产品
CN110248245A (zh) 一种视频定位方法、装置、移动终端及存储介质
WO2022037261A1 (zh) 音频播放、设备管理方法及装置
CN110166848A (zh) 一种直播互动的方法、相关装置及系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18787039

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18787039

Country of ref document: EP

Kind code of ref document: A1