CN117041228A

CN117041228A - Data transmission method, system, equipment and medium

Info

Publication number: CN117041228A
Application number: CN202311109562.5A
Authority: CN
Inventors: 张昂; 王辉明
Original assignee: Beijing Zitiao Network Technology Co Ltd
Current assignee: Beijing Zitiao Network Technology Co Ltd
Priority date: 2023-08-30
Filing date: 2023-08-30
Publication date: 2023-11-10

Abstract

The application provides a data transmission method, a system, equipment and a medium, wherein the method is applied to a server, and the server is used for transmitting message data to a client, and the method comprises the following steps: acquiring first data and second data, wherein the first data and the second data are represented by a tree structure; comparing the tree structure of the first data with the tree structure of the second data to determine incremental data corresponding to the first data; and transmitting the incremental data corresponding to the first data to the client as message data so that the client presents the message corresponding to the first data. The method realizes streaming by representing message data in a tree structure and outputting in increment, thereby reducing transmission cost and reducing the flow consumed by data transmission.

Description

Data transmission method, system, equipment and medium

Technical Field

The present application relates to the field of communications technologies, and in particular, to a data transmission method, a system, an electronic device, and a computer readable storage medium.

Background

Streaming refers to a transmission mode in which a server transmits data to a client in real time. With the continued development of natural language processing technology, streaming may be applied to the transmission of text messages. For example, in a man-machine conversation scenario, a server (e.g., chat robot) may send message data in a target message (e.g., reply text) to a client in a streaming manner, thereby avoiding long waiting times for the user.

In general, the server may implement streaming of the target message by using a full-output method. Specifically, for a target message, the message data transmitted to the client by the server each time includes the full data, and the client loads the message data according to the full data, so as to present the target message. For example, the target message to be generated by the server is "12345", the target message is generated to "12" in the first transmission, the server transmits "12" to the client, the target message is generated to "123" in the second transmission, the server transmits "123" to the client, and the target message is generated to "12345" in the third transmission, and the server transmits "12345" to the client. In this way, during each transmission, the server transmits all the generated message data to the client, thereby realizing streaming.

However, the above-mentioned method of total output consumes a larger transmission flow, which is very easy to cause the blocking of the client, and the data transmission effect is not good.

Disclosure of Invention

The application provides a data transmission method. The method realizes the streaming based on incremental output and reduces the data transmission cost. The application also provides a system, electronic equipment, a computer readable storage medium and a computer program product corresponding to the method.

In a first aspect, the present application provides a data transmission method, applied to a server, where the server is configured to transmit message data to a client, the method includes:

acquiring first data and second data, wherein the first data comprises message data generated at a first moment, the second data comprises message data generated at a second moment, the second moment is positioned before the first moment, the client presents a message corresponding to the second data, and the first data and the second data are represented by adopting a tree structure;

comparing the tree structure of the first data with the tree structure of the second data to determine incremental data corresponding to the first data;

and transmitting the incremental data corresponding to the first data to the client as message data so that the client presents the message corresponding to the first data.

In a second aspect, the present application provides a data transmission method, applied to a client, where the client is configured to receive message data transmitted by a server, and the method includes:

presenting a message corresponding to second data, the second data including message data that has been generated at a second time;

Receiving incremental data corresponding to first data transmitted by the server, wherein the first data comprises message data generated at a first moment, the first moment is positioned after the second moment, and the first data and the second data are represented by adopting a tree structure;

and presenting the message corresponding to the first data according to the increment data corresponding to the first data.

In a third aspect, the present application provides a data transmission system, the system comprising:

the system comprises an acquisition module, a data processing module and a data processing module, wherein the acquisition module is used for acquiring first data and second data, the first data comprises message data which are generated at a first moment, the second data comprises message data which are generated at a second moment, the second moment is positioned before the first moment, a client presents a message corresponding to the second data, and the first data and the second data are represented by adopting a tree structure;

the determining module is used for comparing the tree structure of the first data with the tree structure of the second data and determining incremental data corresponding to the first data;

and the transmission module is used for transmitting the incremental data corresponding to the first data to the client as message data so as to enable the client to present the message corresponding to the first data.

In a fourth aspect, the present application provides an electronic device comprising a processor and a memory. The processor and the memory communicate with each other. The processor is configured to execute instructions stored in the memory to cause the electronic device to perform the data transmission method as in the first aspect or any implementation of the first aspect.

In a fifth aspect, the present application provides a computer readable storage medium having stored therein instructions for instructing an electronic device to execute the data transmission method according to the first aspect or any implementation manner of the first aspect.

In a sixth aspect, the present application provides a computer program product comprising instructions which, when run on an electronic device, cause the electronic device to perform the data transmission method of the first aspect or any implementation of the first aspect.

Further combinations of the present application may be made to provide further implementations based on the implementations provided in the above aspects.

From the above technical scheme, the application has the following advantages:

the application provides a data transmission method. The method is applied to a server side, and the server side is used for transmitting message data to a client side. The method comprises the steps that a server side firstly obtains first data and second data, wherein the first data comprises message data which are generated at a first moment, the second data comprises message data which are generated at a second moment, the second moment is located before the first moment, a client side presents a message corresponding to the second data, the first data and the second data are represented by a tree structure, then the server side compares the tree structure of the first data with the tree structure of the second data, determines incremental data corresponding to the first data, and transmits the incremental data corresponding to the first data to the client side as message data so that the client side presents the message corresponding to the first data.

The method adopts the tree structure to represent the message data, obtains the incremental data by comparing the tree structures of the message data generated at different moments, and enables the client to update the presented message by transmitting the incremental data, thus realizing streaming by incremental output, reducing the transmission cost and reducing the flow consumed by data transmission.

Drawings

In order to more clearly illustrate the technical method of the embodiments of the present application, the drawings used in the embodiments will be briefly described below.

Fig. 1 is a schematic diagram of a data transmission system according to an embodiment of the present application;

fig. 2 is a schematic flow chart of a data transmission method according to an embodiment of the present application;

FIG. 3 is a schematic diagram of a tree structure of first data according to an embodiment of the present application;

FIG. 4 is a schematic diagram of a process for updating data according to an embodiment of the present application;

fig. 5 is a schematic diagram of a data transmission flow provided in an embodiment of the present application;

fig. 6 is a schematic flow chart of a data transmission method according to an embodiment of the present application;

fig. 7 is a schematic structural diagram of a data transmission system according to an embodiment of the present application;

fig. 8 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

The terms "first", "second" in embodiments of the application are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature.

Some technical terms related to the embodiments of the present application will be described first.

Streaming refers to a transmission mode in which a server transmits data to a client in real time by delivering a small amount of data at a time. Streaming is commonly applied to the transmission of video data or audio data, and specifically, a server transmits video data or audio data for several seconds on the internet at a time, so that a client does not need to download the whole video or audio before starting playing, and realizes "play while loading" of the video or audio.

Natural language processing (natural language processing, NLP) is a machine learning technique for enabling computing devices to interpret, process, and understand human language. Computing devices are capable of performing a variety of tasks based on natural language processing, including but not limited to part-of-speech tagging, word sense disambiguation, speech recognition, machine translation, emotion analysis, and the like.

With the continued development of natural language processing technology, streaming may also be applied to the transmission of messages. The following will describe in connection with a specific scenario.

In a man-machine conversation scenario, the message may be provided by a server with text response function, for example, the server with text response function may be a chat robot, an online customer service robot, or the like. Specifically, for a question text input by a user through a client, the server may generate a corresponding answer text, and present the answer text at the client, where the answer text may be referred to as a target message. The server may transmit the target message to the client in a streaming manner, considering that the target message may be longer. For example, when the question text is "please write a 2000 word article entitled" where in spring "and" where in spring ", the server may need a period of time to generate all the target messages, so as to avoid excessively long waiting time of the user, the server may transmit the message data to the client multiple times, that is, transmit the generated message data to the client after generating a part of the message data, so that the client presents the message corresponding to the generated message data.

In the voice recognition scenario, the message may be provided by a server having a voice recognition function, for example, the server having a voice recognition function may be a vehicle-mounted voice platform or the like. Specifically, for the voice input by the user, the server may perform voice recognition and present the recognition text at the client, where the recognition text may be referred to as a target message. Considering that the voice input by the user can be longer, the server can transmit the target message to the client in a streaming manner. For example, when the voice input by the user is "help me open window", the server may transmit the message data to the client multiple times, that is, perform voice recognition after receiving a part of the voice, and transmit the recognized message data to the client, so that the client presents a message corresponding to the recognized message data.

In streaming applications to message transmission, modifications to the message are often required. For example, in the man-machine conversation scenario, when the message data is transmitted for the first time, the server side only generates the first 10 words of the first sentence in the target message, when the message data is transmitted for the second time, the server side generates the whole content of the first sentence in the target message, and the complete first sentence generated when the message data is transmitted for the second time is not necessarily to add words on the basis of the first 10 words of the first sentence generated when the message data is transmitted for the first time. For example, the first 10 words of the first sentence generated during the first transmission of the message data are "days of continuous rain and shade", and the complete first sentence generated during the second transmission of the message data is "days of continuous rain and shade outside the window, and it can be found that the complete first sentence generated during the second transmission of the message data has a change in the word order from the first 10 words of the first sentence generated during the first transmission of the message data.

For another example, in the voice recognition scenario, the server recognizes only the first 2 words in the voice input by the user, that is, only the first 2 words of the target message are generated, and the server generates the first 4 words of the target message when transmitting the message data for the second time, and the first 4 words generated when transmitting the message data for the second time are not necessarily added words based on the first 2 words generated when transmitting the message data for the first time. For example, when message data is transmitted for the first time, the voice input by the user is "help me", the message data obtained by voice recognition by the server is "help me", when message data is transmitted for the second time, the voice input by the user is "help me open", and the message data obtained by voice recognition by the server is "help me open", it can be found that the first 4 words generated when message data is transmitted for the second time and the first 2 words generated when message data is transmitted for the first time have a change of word content.

In view of the above-described need for modifications to message data, the industry typically employs a full-scale output approach to streaming messages. The full-quantity output refers to that the message data transmitted to the client by the server each time comprises full-quantity data aiming at a label message. For example, the target message is "12345", the first message data transmitted by the server to the client is "12", the second message data is "1234", and the third message data is "12345", that is, the message data transmitted each time is the full amount of the message data currently generated.

In some examples, the client may establish a long connection with the server through a full duplex communication protocol (e.g., webSocket) based on a transmission control protocol (transmission control protocol, TCP), and the server may transmit the full amount of the message data to the client multiple times to enable streaming. In other examples, the server may transmit the full amount of data in the message data to the client multiple times in response to one data transmission request of the client through a server-send event (SSE) technique in a hypertext transfer protocol (hypertext transfer protocol, HTTP) to effect streaming.

However, in the process of transmitting a target message, the method for outputting the full amount needs to transmit the full amount of data in the process of transmitting the message data for many times, the consumed transmission flow can reach the square level of the target message, the consumed flow is larger, the blocking of the client is easy to be caused, and the data transmission effect is poor.

In view of this, the present application provides a data transmission method. The method is applied to a server side, and the server side is used for transmitting message data to a client side. The method comprises the steps that a server side firstly obtains first data and second data, wherein the first data comprises message data which are generated at a first moment, the second data comprises message data which are generated at a second moment, the second moment is located before the first moment, a client side presents a message corresponding to the second data, the first data and the second data are represented by a tree structure, then the server side compares the tree structure of the first data with the tree structure of the second data, determines incremental data corresponding to the first data, and transmits the incremental data corresponding to the first data to the client side as message data so that the client side presents the message corresponding to the first data.

In order to make the technical solution of the present application clearer and easier to understand, the architecture of the data transmission system of the present application is described below with reference to the accompanying drawings.

Referring to the architecture diagram of a data transmission system shown in fig. 1, the data transmission system 10 includes a server 101, a client 102, and a message generation system 103. The server 101 may include a plurality of servers, which may be cloud servers, for example, a central server in a central cloud computing cluster, or an edge server in an edge cloud computing cluster. The plurality of servers may be servers in a local data center. The local data center refers to a data center directly controlled by a user. The client 102 may be deployed in a terminal including, but not limited to, a smart phone, tablet, notebook, personal digital assistant (personal digital assistant, PDA), or smart wearable device, among others.

The server 101 is configured to transmit message data to the client 102, wherein the message data may be generated by the message generation system 103. For example, the message generation system 103 may be a chat robot, an online customer service robot, an in-vehicle voice platform, or the like. In some embodiments, the message generation system 103 may be independent of the server 101, e.g., a system independent of the server 101. In other embodiments, the message generation system 103 may also be deployed in the server 101, i.e. the server 101 includes a server for generating message data.

Specifically, the server 101 is configured to obtain the first data and the second data. Wherein the first data comprises message data that has been generated by the message generating system 103 at a first time, and the second data comprises message data that has been generated by the message generating system 103 at a second time, the second time being before the first time, the client 102 presents a message corresponding to the second data. For example, from the time when the message generation system 103 starts generating the message data, the first data may include message data that the message generation system 103 has generated at the current time (e.g., 10 th second), and the second data may include message data that the message generation system 103 has generated at the time of the last data transmission (e.g., 8 th second), and the client 102 presents a message corresponding to the message data that the message generation system 103 has generated at the 8 th second at the current time (e.g., 10 th second).

Further, the server 101 is configured to compare the tree structure of the first data with the tree structure of the second data, and determine incremental data corresponding to the first data. The first data and the second data are represented by tree structures, for example, different types of message data are represented by different nodes, and association relations among the different types of message data are represented by connection relations among the nodes.

Further, the server 101 is configured to transmit the incremental data corresponding to the first data as message data to the client 102, so that the client 102 presents a message corresponding to the first data. By transmitting the incremental data corresponding to the first data to the client 102, the client 102 may present the message corresponding to the first data, thereby presenting the message to the user in real time.

In order to facilitate understanding of the technical solution provided by the embodiments of the present application, the following description will be given with reference to the accompanying drawings.

Referring to fig. 2, a flowchart of a data transmission method provided by an embodiment of the present application is shown, where the data transmission method may be executed by a server 101, and the server 101 is configured to transmit message data to a client 102. The method specifically comprises the following steps:

s201: the server 101 acquires the first data and the second data.

Wherein the first data includes message data that has been generated at a first time, the second data includes message data that has been generated at a second time, the second time being before the first time, and the client 102 presents a message corresponding to the second data. For example, the first data may comprise message data that has been generated by the message generation system 103 at a first time, and the second data may comprise message data that has been generated by the message generation system 103 at a second time.

In different scenarios, the message generation system 103 generates different message data. For example, in a man-machine conversation scenario, the message generation system 103 may include a text answer model that may generate a corresponding answer text for a question text entered by a user, where the message data is the answer text generated by the text answer model. For another example, in a speech recognition scenario, the message generation system 103 may include a speech recognition model that may generate a corresponding recognition text for speech input by the user, where the message data is the recognition text generated by the speech recognition model.

The message data that has been generated at the nth time point means all message data generated from the start of generation of the message data to the nth time point. In other words, the data amount of the first data is larger than the data amount of the second data.

In the process of generating the message data, the server 101 may perform transmission of the message data multiple times, so that the message data is presented in real time in the client 102. For example, after the transmission of the first message data, the client 102 presents the message corresponding to the second data, and after the transmission of the second message data, the client 102 may present the message corresponding to the first data, so that real-time presentation of the message is achieved.

In some possible implementations, the server 101 may identify a status for a transmission process of message data, e.g., a status of message transmission may be defined as unsent, in preparation, in transmission, end, interrupt, and exception. In this way, the server 101 may first perform a status query, and when the message transmission status is "in transmission", the server 101 may perform a related operation of acquiring the first data, so as to avoid a data transmission failure.

In the embodiment of the application, the first data and the second data can be represented by adopting a tree structure, namely, the arrangement relation of the elements is expressed by adopting the tree structure. Taking the first data as an example for illustration, in a specific implementation, the server 101 may acquire the message data that has been generated at the first moment, then parse the message data that has been generated at the first moment, and obtain at least one type of message data and an association relationship between at least one type of message data in the message data that has been generated at the first moment, so as to determine a tree structure of the first data according to the at least one type of message data and the association relationship between at least one type of message data.

In some embodiments, the first data and the second data may be rich text data. Wherein rich text data, which may also be referred to as multi-text data, refers to message data consisting of a plurality of different types (or different styles, different formats) of data. In other words, the first data and the second data include multiple types of data, including but not limited to data for expressing text, links, pictures, videos, expressions, ordered lists, unordered lists, list elements, reference content, code blocks, and the like, and the embodiment of the present application can obtain the types of the message data and the relationship between different types of the message data by analyzing the message data by the server 101, so that a tree structure of the first data and the second data is formed.

In some possible implementations, the message data that has been generated at the first time may be in a lightweight markup language format (e.g., a markdown format). At this time, the server 101 may parse the message data generated at the first time to obtain a parse tree, and then determine at least one type of message data and an association relationship between at least one type of message data in the message data generated at the first time according to the parse tree, thereby forming a tree structure of the first data.

Referring to the schematic diagram of the tree structure of the first data shown in fig. 3, the message data generated AT the first moment is data in a markdown format, and by parsing the data, a parse tree may be obtained, where the parse tree may include a root node, a paragraph node, a text node, a hypertext markup language (hyper text markup language, HTML) node, a link node, a list node, a code block node, a reference node, and the like (not all shown in fig. 3), and then the server 101 may traverse the parse tree (e.g., traverse the nodes in the parse tree in depth) to determine an association relationship between AT least one type of message data and AT least one type of message data, for example, the root node may correspond to a root container, the paragraph node may correspond to a paragraph container, the text node may correspond to a text element, and the HTML node may correspond to an @ (AT) element, other custom elements, thereby forming the tree structure of the first data.

S202: the server 101 compares the tree structure of the first data with the tree structure of the second data, and determines incremental data corresponding to the first data.

The incremental data refers to the difference between the data that has been generated in the current data transmission process and the data that has been generated in the last data transmission process, i.e. the difference between the message data that has been generated at the first time and the message data that has been generated at the second time, and may specifically include the newly generated message data and the message data that has been updated.

Since the first data and the second data are represented by the tree structure in the embodiment of the application, the incremental data can be determined by comparing the tree structures. In a specific implementation, the server 101 may traverse the node of the first data and the node of the second data, obtain a difference between the tree structure of the first data and the tree structure of the second data, and determine the difference as incremental data corresponding to the first data.

The server 101 may obtain newly generated message data and generate updated message data by traversing the nodes of the first data and the nodes of the second data, and may specifically include the newly added node, a connection relationship between the newly added node and an existing node (i.e. determining a parent node of the newly added node), newly adding message data in the existing node, overlaying message data in the existing node, and so on, so as to determine incremental data corresponding to the first data.

In some embodiments, the tree structure of the first data and the tree structure of the second data have a large difference, and in this case, if the data transmission is still performed in an incremental output manner, data transmission errors are very easy to generate. Therefore, when the difference between the tree structure of the first data and the tree structure of the second data meets the set total output condition, for example, the similarity between the tree structure of the first data and the tree structure of the second data is smaller than the set threshold, the server 101 may transmit the total first data to the client 102, so that the client 102 presents the message corresponding to the first data, that is, performs data transmission in a total output manner.

S203: the server 101 transmits the incremental data corresponding to the first data as message data to the client 102, so that the client 102 presents the message corresponding to the first data.

In a specific implementation, the server 101 may transmit the incremental data corresponding to the first data to the client 102, and after the client 102 receives the incremental data corresponding to the first data, the client may modify the second data into the first data according to the incremental data corresponding to the first data, so as to present a message corresponding to the first data.

It can be understood that the client 102 currently presents a message corresponding to the second data, and the client 102 is caused to present the message corresponding to the first data by modifying the second data according to the incremental data corresponding to the first data by the client 102, so as to present the message data in real time.

Considering that in the embodiment of the present application, the first data and the second data are represented by using a tree structure, the client 102 may determine a node to be modified and a modification content according to incremental data corresponding to the first data, and modify the second data into the first data according to the node to be modified and the modification content, so as to present a message corresponding to the first data.

The node to be modified may include a node of a child node to be added and a node of a text to be modified, and the modification content may include newly added message data, modified message data for existing message data, and the like. In this way, by modifying the nodes in the tree structure of the second data by the client 102, updating the second data to the first data and presenting the message corresponding to the first data can be implemented.

In some possible implementations, the client 102 may have a plurality of incremental data to be processed, and in order to improve efficiency of processing the incremental data by the client 102, the incremental data corresponding to the first data may include an incremental identifier, where the incremental identifier is used to indicate a processing sequence of the incremental data. In this manner, the client 102 may process the delta data corresponding to the first data according to the delta identification, thereby presenting the message corresponding to the first data.

For example, the delta identification may be a sequence number, and the client 102 may process delta data according to the sequence number order. If the sequence number of the incremental data corresponding to the first data is 5, the client 102 may first determine whether the incremental data with sequence numbers 1 to 4 has been successfully processed, and when the incremental data with sequence numbers 1 to 4 has been successfully processed, the client 102 may process the incremental data corresponding to the first data, so as to present a message corresponding to the first data. Therefore, the integrity of data transmission is ensured, and the time sequence problem and the data loss problem possibly occurring in the data processing are avoided.

Further, when the incremental data corresponding to the third data is not successfully transmitted to the client 102, the server 101 may transmit the incremental data corresponding to the third data to the client 102 in response to the request of the client 102 for obtaining the incremental data corresponding to the third data. The increment identifier included in the increment data corresponding to the third data indicates that the processing sequence of the increment data corresponding to the third data is located before the processing sequence of the increment data corresponding to the first data.

In other words, if the client 102 receives the incremental data corresponding to the first data, but when the incremental data with the earlier processing order is missing, the client 102 may send an incremental data acquisition request to the server 101, for example, the client 102 may acquire the incremental data corresponding to the third data by calling a pull interface of the server 101, so as to implement successful processing of the incremental data corresponding to the first data.

The pull interface may also be used to provide full data, and the client 102 may also obtain full data by calling the pull interface, so as to optimize data processing in a scenario such as long-time offline.

In some possible implementations, the first data may also include target field data, which may be message data that is not generated by the message generation system 103, such as status field data that may be used to identify whether the first data transmission was successful. The server 101 determines update delta data corresponding to the first data in response to an update request for the target field data in the first data, so as to transmit the update delta data corresponding to the first data to the client 102.

Specifically, referring to a flowchart of updating data shown in fig. 4, in response to an update request for target field data in first data, the server side 101 may first obtain a message transmission state, and when the message transmission state is a transmitting state, may determine update delta data corresponding to the first data, transmit the update delta data, and update the message transmission state.

In other words, when there is a need for actively updating data, the server 101 may assemble the data that needs to be updated into update incremental data, and implement active update of local data by transmitting the update incremental data.

In some embodiments, when the message transmission state is the end state, that is, the message transmission has ended, at this time, if there is a need for updating data, the server 101 may implement updating the message by outputting the message data in full quantity, and push the message.

Based on the above description, the embodiment of the application provides a data transmission method. The method is applied to a server side, and the server side is used for transmitting message data to a client side. The method comprises the steps that a server side firstly obtains first data and second data, wherein the first data comprises message data which are generated at a first moment, the second data comprises message data which are generated at a second moment, the second moment is located before the first moment, a client side presents a message corresponding to the second data, the first data and the second data are represented by a tree structure, then the server side analyzes the tree structure of the first data and the tree structure of the second data, determines incremental data corresponding to the first data, and transmits the incremental data corresponding to the first data to the client side as message data so that the client side presents the message corresponding to the first data.

Considering that the server 101 may include multiple servers, multiple data transmissions for one message may be performed by multiple servers, a distributed lock is provided in embodiments of the present application to solve the concurrent update problem. Specifically, the server 101 may obtain the distributed lock according to a globally unique identifier (identity, ID) for identifying the message, so as to ensure that only one task is processing the message at the same time, and avoid data inconsistency caused by concurrent modification.

Referring to the schematic diagram of a data transmission flow shown in fig. 5, when there is a message data transmission request, for example, when generating message data is started, the server 101 may first acquire a distributed lock, determine a tree structure of first data, then acquire a message transmission state, and when there is no message transmission state, that is, when the current transmission process is the first transmission of the message, the server 101 may create the message, thereby implementing pushing the message, and save the message transmission state. When the message transmission state exists, the server 101 can determine whether the message transmission state is an end state, and when the message transmission state is the end state, the message can be updated in a mode of outputting the message data in full quantity, so that message pushing is realized, and the message transmission state is saved. When the state is not the ending state, the incremental data corresponding to the first data can be determined, the incremental data corresponding to the first data is transmitted to the client 102 as message data, and the message transmission state is saved, so that the streaming of the message is realized.

In addition, in consideration of the possible abnormal state of the server 101, various abnormal processing manners are provided in the embodiment of the present application. For example, when the transmission of the first data to the client 102 fails, the server 101 may perform retransmission of the first data through a retry mechanism. For another example, when the first data fails to be transmitted to the client 102 multiple times, the server 101 may transmit spam data to the client 102, so that the client 102 presents the spam data, and long waiting of the user is avoided. For another example, when the client 102 obtains data by calling the pull interface, a data transfer status check may be performed to determine data that is abnormal. Also for example, the client 102 may set a spam policy, and by presenting spam to the user when message data is not received for a long period of time, a state that is not friendly to the user experience may be avoided.

The data transmission method applied to the server provided by the embodiment of the application is described above, and another data transmission method provided by the embodiment of the application is described below.

Referring to a flow chart of a data transmission method shown in fig. 6, the method may be performed by a client 102, where the client 102 is configured to receive message data transmitted by a server 101, and the method includes:

S601: and presenting the message corresponding to the second data.

S602: incremental data corresponding to the first data transmitted by the server 101 is received.

S603: and presenting the message corresponding to the first data according to the increment data corresponding to the first data.

The first data comprises message data which are generated at a first moment, the second data comprises message data which are generated at a second moment, the first moment is located after the second moment, and the first data and the second data are represented in a tree structure.

In some embodiments, the client 102 may receive the first data transmitted by the server 101 in full, and present a message corresponding to the first data according to the first data.

In some embodiments, the client 102 may modify the second data into the first data according to the incremental data corresponding to the first data, and present the message corresponding to the first data.

In some embodiments, the client 102 may determine the node to be modified and the modification content according to the incremental data corresponding to the first data, modify the second data into the first data according to the node to be modified and the modification content, and present the message corresponding to the first data.

In some embodiments, the delta data corresponding to the first data includes a delta identifier, where the delta identifier is used to indicate a processing order of the delta data, and the client 102 may process the delta data corresponding to the first data according to the delta identifier, and present a message corresponding to the first data.

In some embodiments, the client 102 may send an acquisition request for the delta data corresponding to the third data to the server 101, where the delta identifier included in the delta data corresponding to the third data indicates that the processing order of the delta data corresponding to the third data is located before the processing order of the delta data corresponding to the first data, and the client 102 may further receive the delta data corresponding to the third data transmitted by the server 101.

In some embodiments, the first data further includes target field data, and the client 102 may send an update request for the target field data in the first data to the server 101, and receive update delta data corresponding to the first data transmitted by the server 101.

The above is similar to that in the foregoing S201 to S203, and will not be described here again.

The data transmission method provided by the embodiment of the present application is described in detail above with reference to fig. 1 to 6, and the system and the device provided by the embodiment of the present application are described below with reference to the accompanying drawings.

Referring to the schematic structure of the data transmission system shown in fig. 7, the system 70 includes:

an obtaining module 701, configured to obtain first data and second data, where the first data includes message data that has been generated at a first time, the second data includes message data that has been generated at a second time, and the second time is located before the first time, and the client presents a message corresponding to the second data, and the first data and the second data are represented by a tree structure;

A determining module 702, configured to compare the tree structure of the first data with the tree structure of the second data, and determine incremental data corresponding to the first data;

and the transmission module 703 is configured to transmit the incremental data corresponding to the first data as message data to the client, so that the client presents the message corresponding to the first data.

In some possible implementations, the obtaining module 701 is specifically configured to:

acquiring message data generated at a first moment;

analyzing the message data generated at the first moment to obtain at least one type of message data in the message data generated at the first moment and the association relation between the at least one type of message data;

and determining the tree structure of the first data according to the at least one type of message data and the association relation between the at least one type of message data.

In some possible implementations, the message data generated at the first moment is in a lightweight markup language format, and the acquiring module is specifically configured to:

analyzing the message data generated at the first moment to obtain a grammar analysis tree;

And determining at least one type of message data in the message data generated at the first moment and the association relation between the at least one type of message data according to the syntax analysis tree.

In some possible implementations, the determining module 702 is specifically configured to:

traversing the nodes of the first data and the nodes of the second data to obtain differences between the tree structure of the first data and the tree structure of the second data;

and determining the difference as incremental data corresponding to the first data.

In some possible implementations, the transmission module 703 is further configured to:

and when the difference meets a set total output condition, transmitting the first data total to the client so that the client presents the message corresponding to the first data.

In some possible implementations, the transmission module 703 is specifically configured to:

and transmitting the increment data corresponding to the first data to the client as message data, so that the client modifies the second data into the first data according to the increment data corresponding to the first data and presents the message corresponding to the first data.

and transmitting the incremental data corresponding to the first data to the client as message data, so that the client determines a node to be modified and modification content according to the incremental data corresponding to the first data, modifies the second data into the first data according to the node to be modified and the modification content, and presents the message corresponding to the first data.

In some possible implementations, the incremental data corresponding to the first data includes an incremental identifier, where the incremental identifier is used to indicate a processing sequence of the incremental data, and the transmission module 703 is specifically configured to:

and transmitting the incremental data corresponding to the first data as message data to the client so that the client processes the incremental data corresponding to the first data according to the incremental identification and presents the message corresponding to the first data.

when the incremental data corresponding to the third data are not successfully transmitted to the client, responding to an acquisition request of the client for the incremental data corresponding to the third data, and transmitting the incremental data corresponding to the third data to the client, wherein an incremental identifier included in the incremental data corresponding to the third data indicates that the processing sequence of the incremental data corresponding to the third data is located before the processing sequence of the incremental data corresponding to the first data.

In some possible implementations, the first data further includes target field data, and the transmission module 703 is further configured to:

determining update incremental data corresponding to the first data in response to an update request for target field data in the first data;

and transmitting the update incremental data corresponding to the first data to the client.

The data transmission system 70 according to the embodiment of the present application may correspond to performing the method described in the embodiment of the present application, and the above and other operations and/or functions of the respective modules/units of the data transmission system 70 are respectively for implementing the respective flows of the respective methods in the embodiment shown in fig. 2, which are not described herein for brevity.

The embodiment of the application also provides electronic equipment. The electronic device is specifically configured to implement the functionality of the data transmission system 70 in the embodiment shown in fig. 7.

Fig. 8 provides a schematic structural diagram of an electronic device 800, and as shown in fig. 8, the electronic device 800 includes a bus 801, a processor 802, a communication interface 803, and a memory 804. Communication between the processor 802, the memory 804 and the communication interface 803 is via the bus 801.

Bus 801 may be a peripheral component interconnect standard (peripheral component interconnect, PCI) bus or an extended industry standard architecture (extended industry standard architecture, EISA) bus, among others. The buses may be divided into address buses, data buses, control buses, etc. For ease of illustration, only one thick line is shown in fig. 8, but not only one bus or one type of bus.

The processor 802 may be any one or more of a central processing unit (central processing unit, CPU), a graphics processor (graphics processing unit, GPU), a Microprocessor (MP), or a digital signal processor (digital signal processor, DSP).

The communication interface 803 is used for communication with the outside. For example, communication interface 803 may be used to communicate with a terminal.

The memory 804 may include volatile memory (RAM), such as random access memory (random access memory). The memory 804 may also include non-volatile memory (ROM), such as read-only memory (ROM), flash memory, hard Disk Drive (HDD), or solid state drive (solid state drive, SSD).

The memory 804 has stored therein executable code that the processor 802 executes to perform the aforementioned data transmission methods.

In particular, in the case where the embodiment shown in fig. 7 is implemented, and where each module or unit of the data transmission system 70 described in the embodiment of fig. 7 is implemented by software, software or program code required to perform the functions of each module/unit in fig. 7 may be partially or entirely stored in the memory 804. The processor 802 executes the program codes corresponding to the respective units stored in the memory 804, and performs the aforementioned data transmission method.

The embodiment of the application also provides a computer readable storage medium. The computer readable storage medium may be any available medium that can be stored by a computing device or a data storage device such as a data center containing one or more available media. The usable medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid state disk), etc. The computer readable storage medium includes instructions that instruct a computing device to perform the data transmission method described above as being applied to the data transmission system 70.

Embodiments of the present application also provide a computer program product comprising one or more computer instructions. When the computer instructions are loaded and executed on a computing device, the processes or functions in accordance with embodiments of the present application are fully or partially developed.

The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from one website, computer, or data center to another website, computer, or data center by a wired (e.g., coaxial cable, fiber optic, digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.).

The computer program product, when executed by a computer, performs any of the aforementioned methods of data transmission. The computer program product may be a software installation package, which may be downloaded and executed on a computer in case any of the aforementioned information identification methods is required.

The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The units involved in the embodiments of the present application may be implemented in software or in hardware. Where the names of the units/modules do not constitute a limitation of the units themselves in some cases.

The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: a Field Programmable Gate Array (FPGA), an Application Specific Integrated Circuit (ASIC), an Application Specific Standard Product (ASSP), a system on a chip (SOC), a Complex Programmable Logic Device (CPLD), and the like.

In the context of embodiments of the present application, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

It should be noted that, in the present description, each embodiment is described in a progressive manner, and each embodiment is mainly described in a different manner from other embodiments, and identical and similar parts between the embodiments are all enough to refer to each other. For the system or device disclosed in the embodiments, since it corresponds to the method disclosed in the embodiments, the description is relatively simple, and the relevant points refer to the description of the method section.

It should be understood that in the present application, "at least one (item)" means one or more, and "a plurality" means two or more. "and/or" for describing the association relationship of the association object, the representation may have three relationships, for example, "a and/or B" may represent: only a, only B and both a and B are present, wherein a, B may be singular or plural. The character "/" generally indicates that the context-dependent object is an "or" relationship. "at least one of" or the like means any combination of these items, including any combination of single item(s) or plural items(s). For example, at least one (one) of a, b or c may represent: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", wherein a, b, c may be single or plural.

It is further noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. The software modules may be disposed in Random Access Memory (RAM), memory, read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A data transmission method, applied to a server, the server being configured to transmit message data to a client, the method comprising:

2. The method of claim 1, wherein the acquiring the first data comprises:

acquiring message data generated at a first moment;

3. The method according to claim 2, wherein the message data generated at the first time is in a lightweight markup language format, and wherein the parsing the message data generated at the first time to obtain at least one type of message data and an association between the at least one type of message data in the message data generated at the first time comprises:

4. The method of claim 1, wherein the comparing the tree structure of the first data with the tree structure of the second data to determine incremental data corresponding to the first data comprises:

5. The method of claim 4, wherein after the traversing the nodes of the first data and the nodes of the second data, obtaining a difference in the tree structure of the first data and the tree structure of the second data, the method further comprises:

6. The method of claim 1, wherein transmitting the incremental data corresponding to the first data as message data to the client to cause the client to present the message corresponding to the first data comprises:

7. The method according to claim 6, wherein transmitting the incremental data corresponding to the first data as message data to the client, so that the client modifies the second data into the first data according to the incremental data corresponding to the first data, and presents the message corresponding to the first data, includes:

8. The method of claim 1, wherein the delta data corresponding to the first data includes a delta identifier, the delta identifier being used to indicate a processing sequence of the delta data, and wherein transmitting the delta data corresponding to the first data as message data to the client, so that the client presents the message corresponding to the first data, includes:

9. The method of claim 8, wherein after the transmitting the delta data corresponding to the first data to the client as message data, the method further comprises:

10. The method of claim 1, wherein the first data further comprises target field data, the method further comprising:

11. A data transmission method, applied to a client, where the client is configured to receive message data transmitted by a server, the method comprising:

12. The method of claim 11, wherein the method further comprises:

receiving the first data of the server-side full transmission;

and according to the first data, presenting the message corresponding to the first data.

13. The method of claim 11, wherein presenting the message corresponding to the first data according to the delta data corresponding to the first data comprises:

And modifying the second data into the first data according to the incremental data corresponding to the first data, and presenting the message corresponding to the first data.

14. The method of claim 13, wherein modifying the second data to the first data according to the incremental data corresponding to the first data, and presenting the message corresponding to the first data, comprises:

determining nodes to be modified and modification contents according to the incremental data corresponding to the first data;

and modifying the second data into the first data according to the node to be modified and the modification content, and presenting the message corresponding to the first data.

15. The method of claim 11, wherein the delta data corresponding to the first data includes a delta identifier, the delta identifier being used to indicate a processing sequence of the delta data, and wherein presenting the message corresponding to the first data according to the delta data corresponding to the first data includes:

and processing the increment data corresponding to the first data according to the increment identification, and presenting the message corresponding to the first data.

16. The method of claim 15, wherein the method further comprises:

Sending an acquisition request for incremental data corresponding to third data to the server, wherein an incremental identifier included in the incremental data corresponding to the third data indicates that the processing sequence of the incremental data corresponding to the third data is located before the processing sequence of the incremental data corresponding to the first data;

and receiving incremental data corresponding to the third data transmitted by the server.

17. The method of claim 11, wherein the first data further comprises target field data, the method further comprising:

sending an update request for target field data in the first data to the server;

and receiving the update incremental data corresponding to the first data transmitted by the server.

18. A data transmission system, the system comprising:

19. An electronic device comprising a processor and a memory;

the processor is configured to execute instructions stored in the memory, causing the electronic device to perform the method of any one of claims 1 to 10.

20. A computer readable storage medium comprising instructions that instruct an electronic device to perform the method of any one of claims 1 to 10.