TW202239211A - System and method for data communication - Google Patents

Abstract

The subject application relates to a data communication system and data communication method. The data communication includes a receiving unit, determining unit and a transferring unit. The receiving unit is configured to receive an action performed by an user terminal. The determining unit is connected to the receiving unit and configured to determine a communication protocol toward the user terminal according to the action. The communication protocol is transferred to the user terminal, and the user terminal requests real-time data via the communication protocol. According to the subject application, the satisfaction for the user to watch the live streaming is improved and the user experience is also optimized.

Description

System and method for data communication

The present disclosure relates to information and communication technologies, and in particular, to a system and method for data communication.

Techniques for enabling users to communicate with each other on-line are known. Communication protocols are necessary for users to transmit and receive data over the Internet. With the vigorous development of communication technology, there is a great demand for instant messaging such as video calling and live streaming.

There are a large number of protocols for instant messaging. For different communication protocols, the advantages and disadvantages are all different. Certain communication protocols are suitable for real-time interaction with low latency, and some communication protocols guarantee smoothness of streaming.

Different protocols are requested in different contexts. For example, for users who want to interact in real time, such as playing interactive games, protocols with low latency are necessary. If the communication protocol is not appropriate, it can cause user dissatisfaction of any kind. Therefore, it is a very important issue to communicate via appropriate communication protocols in response to different scenarios.

An embodiment of the present application relates to a data communication system, which includes: a receiving unit configured to receive an action performed by a user terminal; and a determination unit connected to the receiving unit and configured to determine a protocol for the user terminal based on the action. The communication protocol is sent to the user terminal for the user terminal to request real-time data via the communication protocol.

Another embodiment of the present application relates to a data communication method, which includes: receiving an action performed by a user terminal; and determining a communication protocol for the user terminal according to the action. The communication protocol is sent to the user terminal for the user terminal to request real-time data via the communication protocol.

The present invention switches between different communication protocols while the user terminal takes different actions in different scenarios. Therefore, the satisfaction of the user watching the live streaming is improved and the user experience is also optimized.

Fig. 1 shows a schematic configuration of a communication system 1 according to some embodiments of the present application. The communication system 1 provides a live streaming service through a content utilization interaction. Here, the term "content" refers to a digital content that can be played on a computer device. In other words, the communication system 1 enables a user to conduct an instant interaction with other users online. The communication system 1 includes a plurality of user terminals 10 , an interactive server 30 , and a streaming server 40 . The user terminal 10, the interactive server 30 and the streaming server 40 are connected via a network 90, which is the Internet (for example). The interactive server 30 is a server for synchronizing interactive feedback. In some embodiments, the interactive server 30 can be called an APP backend server. The streaming server 40 is a server for providing live streaming. In some embodiments, the streaming server 40 may be referred to as a CDN provider. In some embodiments, the interactive server 30 and the streaming server 40 can be integrated into one server. The user terminal 10 is a client device for live streaming. In some embodiments, the user terminal 10 may be referred to as a viewer, a live broadcast host, a podcaster, a listener, a listener, or the like. Each of the user terminal 10, the interactive server 30, and the streaming server 40 is an example of an information processing device.

FIG. 2 is a schematic block diagram of a data communication system 100 according to some embodiments of the present application. The data communication system 100 includes a receiving unit 110 , a determining unit 120 and a transmitting unit 130 . The receiving unit 110 is configured to receive an action A performed by a user terminal 10 . In some embodiments, the receiving unit 110 may include a storage element. The storage element is configured to store actions A collected from the user terminal 10 . The determining unit 120 is connected to the receiving unit 110 and is configured to determine a protocol P for the user terminal 10 according to the action A. The transmission unit 130 is connected to the evaluation unit 120 and configured to transmit the protocol P to the interaction server 30 and/or the streaming server 40 . In some embodiments, the interactive server 30 and/or the streaming server 40 can receive and/or transmit real-time data for the user terminal 10 via the communication protocol P in response to the action A.

As shown in FIG. 2 , the user terminal 10 performs an action A and the receiving unit 110 receives the action A performed by the user terminal 10 . In some embodiments, action A may include requesting to receive real-time data from a server and/or transmit real-time data to the server. Then, the receiving unit 110 transmits the action A to the determining unit 120 , and the determining unit 120 determines a communication protocol P for the user terminal 10 according to the action A. Then, the transmitting unit 130 receives the communication protocol P determined by the determining unit 120 and transmits the communication protocol P to the interaction server 30 . The interactive server 30 transmits the communication protocol P to the user terminal 10 for the user terminal 10 to request streaming data. In some embodiments, the data communication system 100 can be integrated into the interaction server 30 . More specifically, the receiving unit 110 , the determining unit 120 and the transmitting unit 130 can be integrated into the interactive server 30 . The interaction server 30 may include a storage device for storing the action A performed by the user terminal 10 . In some embodiments, the storage device can be configured to store the historical actions A performed by the user terminal 10 . For the user terminal 10 accessing the interaction server 30 for the first time, the determination unit 120 can determine the communication protocol P used for the user terminal 10 according to the history action A. For the user terminal 10 participating in the interactive server 30 for a specific time, the determination unit 120 can determine the communication protocol P used for the user terminal 10 according to the instant action A.

Action A may refer to an operation performed by the user terminal 10 in an APP. Action A may include click, send, interact, swipe, mute, mute, expand, minimize, or other operations that the user 10 can perform, and combinations thereof. In some embodiments, action A may be achieved by clicking a graphical object (such as a button) or audio input or the like. For example, the user terminal 10 can click on a gift to send the gift to the live broadcast host. The user terminal 10 can minimize the live streaming screen or display the live streaming room in a picture-in-picture mode, while performing multitasking with other APPs or other live streaming at the same time. The user terminal 10 can mute or mute the live streaming when watching the live streaming in a quiet place. The user terminal 10 can click a button to conduct an audio and/or video communication with the viewer or the live broadcast host. The user terminal 10 can play interactive games with the viewers or live broadcast hosts in the APP.

There are a large number of protocols for instant data communication (such as HLS, RTP (WebRTC), RTMP, RTSP, DASH, MirrorOP, etc.), and each protocol P has its advantages and disadvantages for instant data communication. In the present invention, the communication protocols of HLS, RTC (WebRTC) and RTMP are used as examples for discussion. Table 1 shows an exemplary protocol P along with advantages and disadvantages for reference. communication protocol video delay buffer first presentation HLS recommend recommend RTMP recommend highly recommended WebRTC highly recommended Table 1

As far as real-time interaction is concerned, video latency can be one of the most important metrics to consider. Here, the indicator "video latency" may refer to the degree of delay between the time when streaming data is transmitted from one user terminal and the time when the first frame of the streaming data is presented at another user terminal. WebRTC provides near-instant latency of less than 0.5 seconds, so WebRTC is highly recommended for instant interaction. Similarly, the delay of RTMP is usually 5 seconds to 8 seconds, so RTMP is also recommended for real-time data communication. However, compared with WebRTC and RTMP, HLS has relatively high latency, so HLS is not recommended for real-time interaction.

Low buffering can be one of the most important metrics to consider in terms of smoothness of live streaming. The indicator "buffer" can be further classified into "buffer ratio" and "buffer count". The indicator "buffer ratio" refers to the ratio of buffer time to total viewing time. The indicator "buffer count" refers to the number of buffer occurrences. HLS (HTTP Live Streaming) is an adaptive bitrate streaming protocol based on HTTP. HLS measures the internet speed available for each viewer and varies the quality accordingly to ensure the smoothness of the streaming data. Therefore, HLS is recommended for smoothness of live streaming.

RTMP is based on the Transmission Control Protocol (TCP), and it allows data communication in a given sequence and order with delivery guarantees. One of the advantages of RTMP is that the time to first render is relatively short compared to WebRTC and HLS. Here, the indicator "first presentation" (which may also be referred to as "watch time") refers to the time from requesting the streaming data to presenting the first frame of the streaming data. Therefore, RTMP is recommended for action A that requests a short time for the first presentation.

In an embodiment, real-time data may include streaming data and interactive data. Streaming data refers to audio content and/or video content. Audio content and video content can be collected from a microphone or camera from the user terminal 10 . The interaction data refers to the data showing the interaction with one of the user terminals 10 . For example, the interaction data may refer to the operations performed by the user terminal 10 to interact with other user terminals 10 . For example, the user terminal 10 can click on a gift to send the gift to the live broadcast host. The user terminal 10 can click the input button to send a message to the live broadcast host. The terminal 10 can click the game button to play an interactive game with the live broadcaster.

3 to 7 are exemplary functional configurations of action A. In FIGS. 3 to 7 , a user terminal 10 , an interactive server 30 and a streaming server 40 are shown. The interactive server 30 transmits and receives interactive data and the streaming server 40 transmits and receives streaming data. The user terminal 10 includes an interactive unit 11 , a decoder 12 , a display 13 , a stream input 14 and an encoder 15 . The interaction unit 11 receives the interaction data from the interaction server 30 and/or transmits the interaction data to the interaction server 30 . The decoder 12 decodes the streaming data from the streaming server 40 and the display 13 displays the streaming data. The stream input 14 collects stream data from the user terminal 10 . The encoder 15 encodes the stream data collected from the stream input 14 and transmits the stream data to the stream server 40 . In some embodiments, the streaming input 14 can be a microphone or a camera for collecting audio content and video content from the user terminal 10 .

In some embodiments, the action A may further include an interactive action Ai and a non-interactive action Ani. The determination unit 120 can determine the communication protocol P for the user terminal 10 according to the interaction action Ai and the non-interaction action Ani.

In some embodiments, the interaction action Ai may refer to the action A of transmitting and/or receiving interaction data. For example, if the user terminal 10 clicks the gift button to send a gift to the live broadcast host, the user terminal 10 transmits an interaction data to the live broadcast host. In this case, the action A of sending a gift can be called an interaction action Ai. If the user terminal 10 clicks the game button to play an interactive game (such as shooting monsters together) with the live broadcaster, the user terminal 10 transmits the interaction data to the live broadcaster and receives the interaction data from the live broadcaster. In this case, the action A of playing the interactive game can be referred to as an interactive action Ai.

In some embodiments, the interaction action Ai may also refer to the action of transmitting and receiving streaming data. For example, the viewer can click the voice call button or the video call button to invite the live broadcast host to conduct a voice chat or video chat. In this case, the action A of inviting the live broadcaster to conduct a voice chat or video chat may be called an interactive action Ai.

The non-interactive action Ani may refer to the action A of receiving but not transmitting streaming data or transmitting but not receiving streaming data. For example, if the user terminal 10 watches the live broadcaster without doing anything, the user terminal 10 receives the streaming data from the live broadcaster but does not transmit the streaming data or interaction data to the live broadcaster. In this case, the action A of watching the live broadcast host can be called a non-interactive action Ani. If the user terminal 10 is broadcasting live without interacting with other user terminals 10, the user terminal 10 transmits streaming data without receiving any streaming data or interactive data. In this case, the action A of the live broadcast can be called a non-interactive action Ani.

FIG. 3 shows an exemplary functional configuration of the non-interactive action Ani. In some embodiments, the user terminal 10 may be referred to as a viewer, listener, listener, or the like. The user terminal 10 requests to receive streaming data from the streaming server 40 . Streaming data can include audio and video content from the live broadcast host. As shown in FIG. 3 , the user terminal 10 receives streaming data from the streaming server 40 and the decoder 12 decodes the streaming data to display the streaming data on the display 13 .

According to action A, the user terminal 10 requests to receive streaming data, so it shows that the user terminal 10 wants to watch a live broadcast. Therefore, action A can be called a non-interactive action Ani. In response to the non-interactive action Ani, buffering and first rendering of streaming data will be the first priority to achieve user satisfaction. Therefore, the determination unit 120 can determine HLS or RTMP as the communication protocol P for the user terminal 10 according to the action A. In some embodiments, when the user terminal 10 clicks on a live host and enters a streaming room, a short first presentation is preferred. Therefore, the communication protocol P of RTMP is recommended. In certain embodiments, a low buffer is preferred after entering the flow-through chamber. Therefore, the communication protocol P of HLS can be recommended.

In some embodiments, the determining unit 120 may further determine the communication protocol P for the user terminal 10 according to the quality of the Internet of the user terminal 10 . For example, if the Internet quality of the user terminal 10 is good, then the communication protocol P of RTMP is recommended. On the other hand, if the Internet quality of the user terminal 10 is poor, then the communication protocol P of HLS is recommended. In some embodiments, good and bad internet quality can be assessed based on latency, buffering, first render, or the like. For example, if the buffering is high, it indicates that the Internet quality of the user terminal is poor. On the other hand, if the buffering is low, it indicates that the Internet quality of the user terminal is good. The determination unit 120 can further determine the communication protocol P according to the quality of the Internet network of the user terminal 10 .

In some embodiments, the streaming data may be audio content only. The determination unit 120 can determine the communication protocol P used for the user terminal 10 for receiving the streaming data with only audio content. For example, the user terminal 10 can minimize the live streaming to only listen to the voice of the live host, or the user terminal 10 can click on a podcast to listen to the live podcast broadcast. In response to the action A of extracting streaming data with only audio content, a protocol P of RTMP may, for example, be recommended. Therefore, the determination unit 120 determines RTMP as the communication protocol P for the user terminal 10 . The communication protocol P of RTMP can extract streaming data with only audio content to reduce network traffic, so that audio content can be played smoothly.

In some embodiments, the streaming data may only be video content. The determination unit 120 can determine the communication protocol P used for the user terminal 10 for receiving the streaming data with only video content. For example, when the user terminal 10 is in a quiet place (such as a library), the user terminal 10 can mute or mute the live streaming to only watch the video of the live broadcaster. In response to action A of extracting streaming data with only video content, protocol P of RTMP and HLS can be recommended. Therefore, the determination unit 120 determines such as RTMP or HLS as the communication protocol P for the user terminal 10 .

In some embodiments, the user terminal 10 can perform the action A of continuously receiving streaming data from different user terminals 10 within a short period of time. Here, "short time" means that the user terminal 10 receives streaming data from a first live broadcast host and once presents the stream data from the first live broadcast host on the display for viewing from a second live broadcast host. Time to receive another streaming data. The determining unit 120 can determine the communication protocol P according to the action A. For example, the user terminal 10 can quickly swipe the live streaming room to check whether there is a live broadcast host that the user terminal 10 is interested in. In other words, the user terminal 10 requests to receive streaming data from different user terminals 10 quickly, such as 1 second to 3 seconds for each request. In this case, the length of time for the first presentation of the video should be as short as possible in order to check different broadcasters as quickly as possible. In response to action A, protocol P of RTMP can be recommended. Therefore, the determining unit 120 can determine RTMP as the communication protocol P for the user terminal 10 .

In some embodiments, the user terminal 10 can perform an action A of simultaneously receiving streaming data from different live broadcast hosts. The determination unit 120 can determine different communication protocols P for the user terminal 10 for each stream data from each live host according to the action A. For example, the user terminal 10 can use different windows to watch different live broadcasters at the same time. In other words, the user terminal 10 requests to receive streaming data from different user terminals 10 at the same time. In this case, a different protocol P is recommended for each streaming data. For example, the user terminal 10 can watch a large number of live broadcast hosts at the same time. The user terminal 10 interacts with his or her favorite live streamers while keeping broadcasting other streams without interaction. In this case, the real-time interaction with his or her favorite streamer will be the first priority, and the rest of the streamers' streams can be recommended to focus on the smoothness of the video. Therefore, the communication protocol P of WebRTC can be recommended for the user terminal 10 to interact with the live broadcast host. Protocol P for HLS with low-resolution streaming data is recommended for smooth broadcasting of the rest of the live stream.

FIG. 4 shows another exemplary functional configuration of the non-interactive action Ani. In some embodiments, the user terminal 10 may be called a live broadcast host, podcaster or the like. The user terminal 10 requests to transmit the streaming data to the streaming server 40 . The streaming data may also include audio and video content from the user terminal 10 . As shown in FIG. 4 , the user terminal 10 collects streaming data from a streaming input 14 , such as a microphone or a camera, and an encoder 15 encodes the streaming data to transmit the streaming data to a streaming server 40 .

In some embodiments, the streaming data may also include audio content and/or video content. The determination unit 120 can determine the communication protocol P used for the user terminal 10 for transmitting streaming data with audio content and/or video content. For example, a broadcaster can transmit a video, short video, live stream, podcast broadcast, and the like. In response to the above action A, the determining unit 120 can determine the communication protocol P used for the user terminal 10 .

FIG. 5 shows an exemplary functional configuration of an interaction action Ai. In some embodiments, the user terminal 10 may be called a viewer, broadcast host, listener, listener, podcaster, or the like. The user terminal 10 requests to transmit the streaming data to the streaming server 40 and to receive the streaming data from the streaming server 40 . As shown in FIG. 5 , the user terminal 10 receives streaming data from the streaming server 40 and the decoder 12 decodes the streaming data to display the streaming data on the display 13 . Meanwhile, the user terminal 10 collects streaming data from the streaming input 14 and the encoder 15 encodes the streaming data to transmit the streaming data to the streaming server 40 . Similarly, streaming data may include audio content and/or video content. For example, the viewer can click the voice call button or the video call button to invite the live broadcast host to conduct a voice chat or video chat. Live stream hosts can click a button to accept voice chat or video chat. The action A of inviting or accepting voice chat or video chat can be called an interaction action Ai. Therefore, for example, the communication protocol P of WebRTC can be recommended.

FIG. 6 shows another exemplary functional configuration of the interaction action Ai. In some embodiments, the user terminal 10 can also be called a viewer, live broadcast host, listener, listener, podcaster or the like. The user terminal 10 requests to receive streaming data from the streaming server 40 and transmit the interactive data to the interactive server 30 . As shown in FIG. 6 , the user terminal 10 receives streaming data from the streaming server 40 and the decoder 12 decodes the streaming data to display the streaming data on the display 13 . At the same time, the user terminal 10 transmits an interaction data to the interaction server 30 . For example, a viewer can click on a gift button to send a gift to the live broadcaster while watching or listening to the live broadcaster or podcast. The interactive data can trigger a dynamic label on the screen of the live broadcast host, and the live broadcast host can respond to the interactive data from the user terminal 10 by voice or gesture to express thanks. Therefore, for example, the communication protocol P of WebRTC can be recommended.

FIG. 7 shows another exemplary functional configuration of the interaction action Ai. In some embodiments, the user terminal 10 can also be called a viewer, live broadcast host, listener, listener, podcaster or the like. The user terminal 10 requests to transmit the interaction data to the interaction server and receives the interaction data from the interaction server 30 . In some embodiments, the user terminal 10 can further transmit the streaming data to the streaming server 40 and receive the streaming data from the streaming server 40 . As shown in FIG. 7 , the user terminal 10 simultaneously transmits and receives interaction data to and from the interaction server 30 . The user terminal 10 can further simultaneously receive the streaming data from the streaming server 40 and/or transmit the streaming data to the streaming server. For example, viewers can click on the interactive button to play an interactive game with the streamer. Therefore, for example, the communication protocol P of WebRTC can be recommended.

FIG. 8 shows an exemplary sequence diagram illustrating an operation of the communication system 1 and the data communication system 100 . In step S101, in response to an instruction from the user terminal 10' (not shown in the figure) (such as a live broadcast host), the client application program APP in the user terminal 10' uploads live streaming data to the serial streaming server 40 . Here, live streaming includes streaming data collected from microphones and/or cameras. In many cases, the streaming data includes the audio and video content of the broadcaster.

In step S102, the client application program APP in the user terminal 10 executes an action A in an APP or platform. In some embodiments, action A can be to log into the APP and click on the live broadcaster to watch the live stream. In step S103 , the user terminal 10 sends a request for live streaming data information to the interactive server 30 in response to action A. In step S104 , the receiving unit 110 receives the action A executed by the user terminal 10 . In some embodiments, the receiving unit 110 stores the action A in a storage element. In step S105 , the receiving unit 110 transmits the action A performed by the user terminal 10 to the determining unit 120 . In step S106 , the determination unit 120 determines a communication protocol P for the user terminal 10 according to the action A. In step S107 , the determination unit 120 transmits the communication protocol P to the interaction server 30 . In step S108 , the interactive server 30 transmits the communication protocol P to the user terminal 10 . In step S109 , the user 10 requests streaming data via the protocol P. In step S110 , the streaming server 40 transmits the streaming data via the protocol P in response to the request from the user terminal 10 .

In some embodiments, the receiving unit 110 , the determining unit 120 and the transmitting unit 130 can be integrated into one server. In some embodiments, the receiving unit 110 , the determining unit 120 and the transmitting unit 130 can be integrated into the interaction server 30 . In some embodiments, the receiving unit 110 and the transmitting unit 130 may be replaced by the receiving means and the transmitting means of the interaction server 30 .

In some embodiments, the action A performed by the user terminal 10 in step S102 may be an interactive action Ai. More specifically, in step S102, the user terminal 10 may perform an action A. For example, action A may include watching a live broadcaster and clicking a gift button to send a gift to the live broadcaster. In step S103 , in response to action A, the user terminal 10 requests to transmit the interactive data to the interactive server 30 and to receive the streaming data from the streaming server 40 . In step S104 , the receiving unit 110 receives the action A executed by the user terminal 10 . In step S105 , the receiving unit 110 transmits the action A performed by the user terminal 10 to the determining unit 120 . In step S106 , the determination unit 120 determines a communication protocol P for the user terminal 10 according to the action A. More specifically, the user terminal 10 requests transmission of interactive data and reception of streaming data according to action A, so it shows that the user terminal 10 wants to watch the live broadcaster and communicates with the live broadcaster by sending a gift to the live broadcaster. to interact. Therefore, action A can be called an interactive action Ai. In response to the interaction action Ai, instant interaction will be the first priority to achieve user satisfaction. Therefore, the determination unit 120 determines such as WebRTC or RTMP as the communication protocol P for the user terminal 10 according to the action A.

In some embodiments, action A may include watching the live broadcaster and clicking an interactive game button to play an interactive game with the live broadcaster. In step S103 , in response to the action A, the user terminal 10 requests to transmit the interaction data to the interaction server 30 and receive the interaction data from the interaction server 30 . In step S106 , the determination unit 120 determines a communication protocol P for the user terminal 10 according to the action A. According to action A, the user terminal 10 requests to transmit and receive interaction data, so it shows that the user terminal 10 wants to interact with the live broadcaster by playing an interactive game such as shooting monsters together. Therefore, action A can be called an interactive action Ai. In response to action A, immediate interaction, especially short latency, will be the first priority to achieve user satisfaction. Therefore, the determining unit 120 determines such as WebRTC as the communication protocol P for the user terminal 10 .

In some embodiments, the determination unit may further include a prediction element. The prediction element is configured to predict a subsequent action A based on the action A. The predictive element analyzes action A to identify related actions and predicts subsequent actions A based on the related actions. For example, the user terminal 10 clicks on the input box, which implies that the user terminal 10 wants to start a chat with the live broadcaster. If the user terminal 10 clicks on the gift box, it can be predicted that the user terminal 10 will send a gift to the live broadcast host. In some embodiments, the prediction component can further analyze the message left by the user terminal 10 and predict the subsequent action A according to the message. The message left by the user terminal 10 may include text, audio, emoticon and so on. For example, the user terminal 10 can input a text to request the live broadcast host to play an interactive game, so it can be predicted that the user terminal 10 will play an interactive game with the live broadcast host. In response to the interactive game request from the user terminal 10, if the live broadcast host answers OK through an audio message (such as a microphone), it may also imply that the user terminal 10 and the live broadcast host will play an interactive game. Therefore, the prediction component can analyze the message left by the user terminal 10 and the audio message spoken by the live broadcast host and predict that the user terminal 10 will play an interactive game with the live broadcast host. In some embodiments, the determination unit 120 may further determine the communication protocol P according to the subsequent action A.

In some embodiments, the prediction component can collect a plurality of historical data from the user terminal 10 . The historical data may include historical actions A and historical subsequent actions A from the user terminal 10 . The prediction component can predict the subsequent action A according to the historical action A and the historical subsequent action A. For example, the user terminal 10 is accustomed to video chatting and audio chatting with the live broadcaster after entering the live streaming of a specific live broadcaster, which can be predicted that once the user terminal 10 enters the room of the live broadcaster, the user terminal Machine 10 just can carry out video and audio chat with live host.

In some embodiments, the receiving unit 110 further receives available communication protocols from the user terminal 10 . The available communication protocol refers to the communication protocol P mutually applicable to the user terminal 10 and the server 30/40. In some embodiments, the determination unit 120 can select the communication protocol P from the available communication protocols and further determine the communication protocol P according to the action A.

In some embodiments, the data communication system 100 may further include a feedback collection unit. The feedback collection unit is configured to collect feedback from the user terminal 10 and transmit the feedback to the determination unit 120 . In some embodiments, the determining unit 120 determines the protocol P according to the feedback. For example, the user terminal 10 may have feedback for instant data communication. The feedback may be satisfaction or dissatisfaction with the communication. The determining unit 120 can use the feedback as a reference to determine the protocol P.

In some embodiments, the receiving unit 110 can receive the Internet quality of the user terminal 10 . The determination unit 120 can determine a communication protocol P for the user terminal 10 according to the quality of the Internet. Internet quality can be assessed based on metrics such as first render (watch time), video latency, buffer ratio or buffer count.

In some embodiments, the determining unit 120 can evaluate the four indicators and determine the protocol P according to the four indicators. More specifically, the determination unit 120 analyzes one of these indicators (such as video delay), checks which protocol P has the shortest video delay, and determines which protocol P to use according to the Internet quality of the user terminal 10. Or the communication protocol P with the shortest video delay of the terminal machine 10. For example, if the user terminal 10 sends a request to the interaction server 30 , the receiving unit 110 can receive the Internet quality of the user terminal 10 . The judging unit 120 may evaluate the buffer while communicating via each protocol P and judge the protocol P with the lowest buffer for the user terminal 10 .

In some embodiments, the user terminal 10 can receive and transmit real-time data from different streaming servers 40 . The judging unit 120 can judge a streaming server 40 for the user terminal 10 according to the quality of the Internet. In some embodiments, the streaming server 40 may be referred to as a CDN (Content Delivery Network) provider. As shown in FIG. 8 , the determination unit 120 may further determine a streaming server 40 for the user terminal 10 according to the Internet quality in step S106 . More specifically, the determination unit 120 can evaluate the Internet quality of the user terminal 10 through different streaming servers 40 . For example, the judging unit 120 evaluates the buffering of streaming data while the user terminal 10 communicates with different streaming servers 40 and determines the streaming server 40 with the shortest buffering for the user terminal 10 . In step S108 , the interactive server 30 transmits the information of the streaming server 40 to the user terminal 10 . In some embodiments, the information of the streaming server 40 may be a URL of the streaming server 40 . In step S109 , the user 10 requests to stream data via the streaming server 40 . In step S110 , the streaming server 40 transmits streaming data in response to the request from the user terminal 10 . Therefore, the data communication system 100 can enable the user terminal 10 to access a suitable streaming server 40 to obtain better user experience.

In some embodiments, the receiving unit 110 can further receive historical data from the user terminal 10 . The historical data may further include historical Internet quality, geographical location and time information of the user terminal 10 . The determination unit 120 can evaluate the historical data and pre-determine the streaming server 40 for the user terminal 10 . For example, it shows that according to historical data, a user in a specific location during a specific time has the shortest video delay through a specific streaming server 40, and the determining unit 120 may pre-determine the user from the specified time during the specific time. The streaming server 40 of the user at the specific location.

In addition, the systems and methods described in the above embodiments may include a computer-readable non-transitory storage device, such as a solid-state memory device, an optical disk storage device or a magnetic disk storage device. Alternatively, the program can be downloaded from a server via the Internet.

Although the technical content and features of the present invention are described above, those skilled in the art can still make many changes and modifications without violating the teaching and disclosure of the present invention. Accordingly, the scope of the invention is not limited to the disclosed embodiments, but includes other changes and modifications which do not depart from the invention and which are covered by the scope of the appended patent application.

1: Communication system 10: User Terminal/User/Terminal 11: Interactive unit 12: Decoder 13: Display 14: Stream input 15: Encoder 30: Interactive Server/Server 40: Streaming Server/Server 90: Internet 100:Data communication system 110: receiving unit 120: Judgment unit/evaluation unit 130: Transmission unit A: action Ai: interactive action Ani: non-interactive action P: communication protocol S101: step S102: step S103: step S104: step S105: step S106: step S107: step S108: step S109: step S110: step

Fig. 1 is a schematic configuration of a communication system 1 according to some embodiments of the present application; FIG. 2 is a schematic block diagram of a data communication system 100 according to some embodiments of the present application; Fig. 3 is one exemplary functional configuration of action A; Fig. 4 is an exemplary functional configuration of one of action A; Fig. 5 is an exemplary functional configuration of one of action A; Fig. 6 is an exemplary functional configuration of one of action A; Fig. 7 is an exemplary functional configuration of one of action A; FIG. 8 is an exemplary sequence diagram illustrating an operation of the communication system 1 and the data communication system 100 .

1: Communication system

10: User Terminal/User/Terminal

30: Interactive Server/Server

100:Data communication system

110: receiving unit

120: Judgment unit/evaluation unit

130: Transmission unit

Claims (20)

A data communication system comprising: a receiving unit configured to receive an action performed by a user terminal; and a determining unit connected to the receiving unit and configured to determine a communication protocol for the user terminal according to the action; wherein The communication protocol is sent to the user terminal for the user terminal to request real-time data via the communication protocol. The data communication system of claim item 1, wherein the receiving unit further receives available communication protocols mutually applicable to the user terminal and the server, and the determination unit selects the communication protocol from the available communication protocols and further according to the Action to determine the protocol. The data communication system according to claim 1, wherein the determination unit further includes a prediction element configured to predict a subsequent action according to the action, and the determination unit determines the communication protocol according to the subsequent action. The data communication system according to claim 3, wherein the prediction component collects a plurality of historical data from the user terminal to predict the subsequent action. The data communication system according to claim 1, wherein the action further includes an interactive action, the interactive action transmits and/or receives interactive data, or transmits and receives stream data, and the determining unit determines the communication protocol based on the interactive action . The data communication system according to claim 1, wherein the action further includes a non-interactive action, the non-interactive action receives but does not transmit streaming data or transmits but does not receive streaming data, and the determination unit determines the communication based on the non-interactive action agreement. The data communication system according to claim 1, wherein the determining unit determines that the communication protocol is used by the user terminal to receive streaming data with only audio content. The data communication system according to claim 1, wherein the determination unit determines that the communication protocol is used by the user terminal to receive streaming data with only video content. The data communication system according to claim 1, wherein the determining unit determines the communication protocol for the user terminal to transmit streaming data having audio content and/or video content. The data communication system according to claim 1, wherein the determining unit determines that the communication protocol is used by the user terminal to receive or transmit interactive data. The data communication system according to claim 1, wherein the determination unit determines that the communication protocol is used by the user terminal to receive and transmit interactive data. The data communication system according to claim 1, wherein the determination unit determines that the communication protocol is used by the user terminal to continuously receive stream data from different user terminals within a short period of time. The data communication system according to claim 1, wherein the determination unit determines the communication protocol for the user terminal to receive stream data from different user terminals at the same time. The data communication system according to claim 1, which further includes a feedback collection unit, which collects feedback from the user terminal and transmits the feedback to the determination unit; wherein the determination unit determines the communication based on the feedback agreement. As for the data communication system of claim 1, the judging unit judges the communication protocol based on an Internet quality, and the Internet quality is evaluated by an index of first presentation, video delay, buffer ratio or buffer count . A data communication method, comprising: receiving an action performed by a user terminal; and A communication protocol for the user terminal determined according to the action; wherein The communication protocol is sent to the user terminal for the user terminal to request real-time data via the communication protocol. The data communication method of claim 16, wherein the action further includes an interactive action, the interactive action transmits and/or receives interactive data, or transmits and receives stream data, and the determination unit determines the communication protocol according to the interactive action . The data communication method of claim 16, wherein the action further includes a non-interactive action, the non-interactive action receives but does not transmit streaming data or transmits but does not receive streaming data, and the determination unit determines the communication based on the non-interactive action agreement. The data communication method according to claim 16, wherein the determination unit determines that the communication protocol is used by the user terminal to continuously receive streaming data from different user terminals within a short period of time. The data communication method according to claim 16, wherein the determination unit determines the communication protocol for the user terminal to receive stream data from different user terminals at the same time.

Images