WO2022062347A1 - Data transmission method and apparatus, and electronic device and storage medium - Google Patents

Abstract

The present invention relates to the technical field of data transmission, and in particular to a data transmission method and apparatus, and an electronic device and a storage medium. The method comprises providing a resource type that is locally opened, wherein the resource type corresponds to a resource source; receiving a resource registration request for at least one target resource type, wherein the resource registration request corresponds to a resource receiving port; determining, on the basis of the resource registration request, a target resource source corresponding to the target resource type; extracting real-time data from the target resource source; and pushing the real-time data to at least one resource receiving port. The same real-time push mechanism is shared by using a resource type, and for the outside, only the resource type is known, whereas the specific resource source is not known, such that the provision of a plurality of data interfaces for the outside is avoided, and the increase in the pressure of a server caused by excessive external requests is avoided by means of reverse pushing, thereby improving the real-time performance of data transmission.

Description

Data transmission method, device, electronic device and storage medium technical field

The present invention relates to the technical field of data transmission, in particular to a data transmission method, device, electronic device and storage medium.

Background technique

An open platform means that a software system exposes its application programming interface or functions so that external programs can increase the functions of the software system or use the resources of the software system without changing the source code of the software system. When an external program wants to obtain the real-time changing data inside the software system, the existing data transmission method is that the software system will provide the corresponding interface open data through the open platform, and the external system will obtain the data regularly through the open data interface.

However, in the above data transmission method, if the number of external systems increases and the real-time requirements are high, the external systems will continuously request the interface at regular intervals, which will increase the pressure on the internal server, thereby reducing the real-time performance and affecting the efficiency of real-time data transmission. .

SUMMARY OF THE INVENTION

In view of this, embodiments of the present invention provide a data transmission method, apparatus, electronic device, and storage medium, so as to solve the problem of low transmission efficiency of real-time data.

According to a first aspect, an embodiment of the present invention provides a data transmission method, including:

Provide a locally open resource type, the resource type corresponds to the source of the resource;

receiving a resource registration request for at least one target resource type, where the resource registration request corresponds to a resource receiving port;

determining a target resource source corresponding to the target resource type based on the resource registration request;

extracting real-time data from the target resource source;

Pushing the real-time data to at least one of the resource receiving ports.

In the data transmission method provided by the embodiment of the present invention, the corresponding relationship between resource types and resource sources is used to determine the target resource source corresponding to the target resource type, and real-time data can be extracted from the target resource source and pushed to the resource receiving port, thereby achieving The purpose of real-time data push, and use the resource type to share the same real-time push mechanism. For the outside, it only knows the resource type but not the specific resource source, so it is easy to switch the internal data source and avoid providing multiple data interfaces to the outside. , the reverse push is used to avoid excessive external requests and increase the pressure on the server, which improves the real-time performance of data transmission.

With reference to the first aspect, in a first implementation manner of the first aspect, the pushing the real-time data to at least one of the resource receiving ports includes:

determining, based on the resource registration request, status information of the at least one resource receiving port, where the status information includes one of normal, retry, abnormal, and recovery;

The real-time data is pushed to the at least one resource receiving port according to the state information of the at least one resource receiving port.

The data transmission method provided by the embodiment of the present invention can ensure the reliability of real-time data push by pushing real-time data based on the state information of at least one resource receiving port.

With reference to the first embodiment of the first aspect, in the second embodiment of the first aspect, the pushing the real-time data to at least one of the resource receiving ports according to the state information of at least one of the resource receiving ports includes:

The state information of the collected resource receiving port is the resource receiving port in the normal state;

Utilize at least one thread to push the real-time data to the normal resource receiving port in parallel;

Determine whether the push of the preset thread is abnormal;

When the push of the preset thread is abnormal, stop the real-time data push of the preset thread and set the status information of the resource receiving port corresponding to the preset thread to retry;

The resource receiving port based on the retry state performs data push corresponding to the retry mode;

or,

The pushing the real-time data to at least one of the resource receiving ports according to the state information of the at least one resource receiving port includes:

Collecting the status information of the resource receiving port is the resource receiving port in the retry state;

Stop pushing real-time data to the resource receiving port in the retry state and set the state information of the resource receiving port to retry;

The resource receiving port in the retry state performs data push corresponding to the retry mode.

The data transmission method provided by the embodiment of the present invention can improve the efficiency of data transmission by pushing data to the resource receiving port in a normal state in parallel; and when the preset thread push is abnormal, the state information of the resource receiving port is set to retry , and push the data in the retry mode to realize the normal to retry state flow to ensure the normal push of the data.

With reference to the second embodiment of the first aspect, in the third embodiment of the first aspect, the resource receiving port based on the retry state performs data push corresponding to the retry mode, including:

Open another thread to push the currently failed data to the resource receiving port in the retry state again;

judging whether the data of the current push failure is successfully pushed to the resource receiving port in the retry state within a preset condition;

When successfully pushing the currently failed data to the resource receiving port in the retry state within the preset condition, setting the state information of the resource receiving port in the retry state as recovering;

Perform data push corresponding to the mode in recovery based on the resource receiving port in recovery;

or,

When the currently failed data is not pushed successfully to the resource receiving port in the retry state within the preset condition, setting the state of the resource receiving port in the retry state as abnormal;

The resource receiving port based on the abnormal state performs data push corresponding to the abnormal mode.

In the data transmission method provided by the embodiment of the present invention, if the data push is successful in the retry mode, the state information of the resource receiving port is set to be in recovery, so as to realize the state flow from retry to recovery, which provides guarantee for data push Or, when the resource receiving port in the retry state does not successfully push the data that fails to push the current push within the preset conditions, the flow of the resource receiving port from the retry state to the abnormal state is realized, which provides a guarantee for the normal push of the data.

With reference to the first embodiment of the first aspect, in the fourth embodiment of the first aspect, the pushing the real-time data to at least one of the resource receiving ports according to the state information of at least one of the resource receiving ports includes:

Collecting the status information of the resource receiving port is the resource receiving port being restored;

Data push corresponding to the mode in recovery is performed based on the resource receiving port in recovery.

With reference to the third embodiment or the fourth embodiment of the first aspect, in the fifth embodiment of the first aspect, the resource registration request further carries configuration information, and the corresponding resource receiving port is based on the restoration. Data push in recovery mode, including:

extracting the configuration information of the resource receiving port in the restoration;

Determine whether the interrupted data needs to be pushed based on the configuration information;

When the interrupted data needs to be pushed, read the historical data from the interrupted position to the current position;

Pushing the historical data to the resource receiving port in the restoration, and judging whether the push fails during the pushing process;

When there is no push failure, set the status information of the resource receiving port in the recovery to normal;

The data push corresponding to the normal mode is performed based on the resource receiving port in the normal state.

In the data transmission method provided by the embodiment of the present invention, in the recovery mode, the interrupted and resumed transmission can be performed from the interrupted position to ensure that the data is not lost; and when the historical data push does not fail, the state of the resource receiving port can be changed from recovery to normal. The flow of data provides a guarantee for the recovery of interrupted push data.

With reference to the fifth implementation manner of the first aspect, in the sixth implementation manner of the first aspect, the performing data push corresponding to the recovering mode based on the resource receiving port under recovery includes:

When a push failure occurs, the state information of the resource receiving port in the restoration is set to be abnormal, and the resource receiving port based on the abnormal state performs data push corresponding to the abnormal mode.

In the data transmission method provided by the embodiment of the present invention, in the recovery mode, if the data push fails, the state of the resource receiving port is directly set to be abnormal, and no retry is performed, so as to avoid multiple retries of data transmission. , which improves the real-time performance of data transmission.

With reference to the first embodiment of the first aspect, in the seventh embodiment of the first aspect, the pushing the real-time data to at least one of the resource receiving ports according to the state information of at least one of the resource receiving ports includes:

The state information of the collected resource receiving port is the resource receiving port in an abnormal state;

The resource receiving port based on the abnormal state performs data push corresponding to the abnormal mode.

With reference to the third embodiment, or the sixth embodiment or the seventh embodiment of the first aspect, in the eighth embodiment of the first aspect, the abnormal state-based resource receiving port performs data push corresponding to the abnormal mode, including:

The state of the resource receiving port receiving the abnormal state is updated to normal information;

Determine whether the state of the set resource receiving port of the abnormal state is abnormal;

When the set state of the resource receiving port in the abnormal state is abnormal, setting the state information of the resource receiving port in the abnormal state as recovering;

Data push corresponding to the mode in recovery is performed based on the resource receiving port in recovery.

In the data transmission method provided by the embodiment of the present invention, when the state of the resource receiving port in the abnormal state is updated to normal externally, the local does not directly set the state of the resource receiving port to normal, but first sets it to recovering , and enter the state flow from abnormal to recovery, which provides a guarantee for the normal transmission of data.

With reference to the first embodiment of the first aspect, in the ninth embodiment of the first aspect, the resource registration request carries configuration information, and the configuration information includes data filtering conditions. information, and push the real-time data to at least one of the resource receiving ports, including:

Filter the real-time data by using the data filter condition;

Based on the state information of the at least one resource receiving port, the filtered real-time data is pushed to the at least one resource receiving port.

In the data transmission method provided by the embodiment of the present invention, the real-time data is filtered before the real-time data is transmitted, so that the transmitted real-time data can meet external requirements.

According to a second aspect, an embodiment of the present invention further provides a data transmission device, including:

providing a module for providing a locally open resource type, the resource type corresponding to the resource source;

a receiving module, configured to receive a resource registration request for at least one target resource type, where the resource registration request carries configuration information of a corresponding resource receiving port;

a determining module, configured to determine the target resource source corresponding to the target resource type based on the resource registration request;

an extraction module, for extracting real-time data from the target resource source;

A push module, configured to push the real-time data to at least one of the resource receiving ports.

The data transmission device provided by the embodiment of the present invention utilizes the corresponding relationship between resource types and resource sources to determine the target resource source corresponding to the target resource type, so that real-time data can be extracted from the target resource source and pushed to the resource receiving port, thereby achieving The purpose of real-time data push, and use the resource type to share the same real-time push mechanism to avoid providing multiple data interfaces to the outside, and reverse the push to avoid excessive external requests and increase the pressure on the server, which improves data transmission. real-time.

According to a third aspect, an embodiment of the present invention provides an electronic device, including: a memory and a processor, the memory and the processor are connected in communication with each other, the memory stores computer instructions, and the processor By executing the computer instructions, the data transmission method described in the first aspect or any one of the implementation manners of the first aspect is executed.

According to a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, where the computer-readable storage medium stores computer instructions, and the computer instructions are used to cause the computer to execute the first aspect or any one of the first aspect. A data transmission method described in an embodiment.

Description of drawings

In order to illustrate the specific embodiments of the present invention or the technical solutions in the prior art more clearly, the following briefly introduces the accompanying drawings that need to be used in the description of the specific embodiments or the prior art. Obviously, the accompanying drawings in the following description The drawings are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can also be obtained based on these drawings without creative efforts.

FIG. 1 shows an optional application scenario of the data transmission method according to the embodiment of the present invention;

2 is a flowchart of a data transmission method according to an embodiment of the present invention;

3 is a flowchart of a data transmission method according to an embodiment of the present invention;

4 is a schematic diagram of an internal data flow mechanism according to an embodiment of the present invention;

5 is a flowchart of a data transmission method according to an embodiment of the present invention;

6 is an architectural diagram of a data transmission method according to an embodiment of the present invention;

7 is a structural block diagram of a data transmission apparatus according to an embodiment of the present invention;

FIG. 8 is a schematic diagram of a hardware structure of an electronic device provided by an embodiment of the present invention.

detailed description

In order to make the purposes, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments These are some embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative efforts shall fall within the protection scope of the present invention.

FIG. 1 is an optional application scenario of the data transmission method provided by the embodiment of the present invention. As shown in FIG. 1 , the data transmission system includes an electronic device (that is, it may also be referred to as a local device hereinafter) and at least one external system (which may also be referred to as an external program).

Among them, the electronic device establishes the corresponding relationship between the resource type and the resource source, and then provides the resource type to the outside world. The external device selects the target resource type it needs from the resource types provided by the electronic device, and sends the resource registration to the electronic device. ask.

After receiving the resource registration request sent by the external system, the electronic device uses the corresponding relationship between the resource type and the resource source to determine the target resource source corresponding to the target resource type, extracts real-time data from the target resource source, and separates it according to the requirements of each external system. The status information of the resource receiving port is pushed.

For the external system, it does not need to request data regularly. It only needs to provide a resource receiving port, and then it can receive the corresponding data when there is data, so that it only needs to focus on business processing, and does not need to repeatedly process the corresponding docking work. Easy function extension.

In the data transmission system, since different types of open data sources have been abstracted into resource types in the electronic device, the external system only knows the resource type but does not know the specific internal data source, so it is easy to switch the internal data source without having to use the electronic device. Provide an open interface to the outside world, the external system cannot perceive the change of the data source, and the internal migration and expansion are convenient. The content of the data transmission method will be described in detail below.

According to an embodiment of the present invention, an embodiment of a data transmission method is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings may be executed in a computer system such as a set of computer-executable instructions, and, although in the A logical order is shown in the flowcharts, but in some cases steps shown or described may be performed in an order different from that herein.

In this embodiment, a data transmission method is provided, which can be used for the above-mentioned electronic devices, such as servers, computers, tablet computers, etc. FIG. 2 is a flowchart of the data transmission method according to an embodiment of the present invention, as shown in FIG. 2 , the process includes the following steps:

S11, providing a locally open resource type.

The resource type corresponds to the resource source.

The resource type is a serial number description of a message to be opened locally, wherein a message subscription push system is maintained locally. The format of the specific number of the resource type can be set according to the actual situation, and it is only necessary to ensure that the outside world can know the corresponding resource through the resource type. For example, it can consist of the resource type name, the resource type description, and the external format of the resource message. The electronic device provides it to the external system to know, and the external system can know the data usage of the external representative of the resource type according to the resource type, so that in the subsequent steps, it can send a resource registration request to the electronic device to request that it wants to obtain The real-time data corresponding to the resource type of .

When the electronic device acquires a new resource source, it only needs to update the corresponding relationship between the resource type and the resource source based on the new resource source and its corresponding resource type in the electronic device, without additional external settings. Interface. The resource source may be a third-party data system, database, data engine or data warehouse, etc. The specific form of the resource source is not limited here, as long as it can provide data.

S12: Receive a resource registration request for at least one target resource type.

The resource registration request corresponds to a resource receiving port.

The electronic device provides the local resource type to the external system to know, then the external system can request to obtain real-time data corresponding to the target resource type by sending a resource registration request to the electronic device based on its own needs. Each resource registration request corresponds to the information of the resource receiving port, and the resource receiving port is used for receiving real-time data corresponding to the target resource type.

As shown in Figure 1, the resource registration request received by the electronic device may be a resource registration request for the same target resource type sent by at least one external system, then the electronic device can perform the same processing on the same target resource type, Then send them to different external systems respectively.

For example, the external system 1 corresponds to the resource receiving port a, the external system 2 corresponds to the resource receiving port b, and the external system 3 corresponds to the resource receiving port c. If the electronic device receives a resource registration request for the same target resource type sent by the external system 1, the external system 2, and the external system 3, the electronic device can determine the resource receiving port and target corresponding to each external system by using the resource registration request. The target resource receiving port corresponding to the resource type. After the real-time data is extracted, the real-time data can be pushed to the corresponding resource receiving ports, so that it can be received by each external system.

Optionally, the resource registration request received by the electronic device may also be a resource registration request for at least one target resource type sent by at least one external system, and the electronic device may perform the same processing for the resource registration request of the same target resource type. Then, send them to the corresponding resource receiving ports respectively.

For example, continuing to use the above-mentioned embodiment, the external system 1 requests the target resource type c2, the external system 2 requests the target resource type c1, and the external system 3 requests the target resource type c2. Since the external system 1 and the external system 3 request the same target resource type, the electronic device can perform the same operation on the external system 1 and the external system 3. After the real-time data 1 is subsequently extracted, it is pushed to the corresponding The resource receiving port a and the resource receiving port c of the electronic device can extract the real-time data 2 for the external system 2, and push the real-time data 2 to the corresponding resource receiving port b.

There is no restriction on the resource registration request received by the electronic device, and specific settings can be made according to the actual situation. In the following description, the electronic device receives at least one resource registration request for the same target resource type as an example for detailed description.

S13, based on the resource registration request, determine the target resource source corresponding to the target resource type.

As described above, after receiving the resource registration request sent by each external system, the electronic device can determine the target resource source corresponding to the target resource type by querying the correspondence between the target resource type and the resource source.

For example, one runner and at least one main listener are maintained in the electronic device. After the electronic device receives the resource registration request, the runner uses the target resource type corresponding to the resource registration request to determine the main listener to be activated. After the target resource type is determined, the main listener corresponding to the target resource type is started to extract real-time data from the target resource source corresponding to the target resource type. Among them, the timing of starting the main listener is that when at least one external system has registered its corresponding resource type, the listener will be triggered to start, so as to avoid wasting resources by running the listener vacantly.

Wherein, a general master listener can be created in the electronic device, and the externally provided interfaces of the master listener include a monitoring source interface and a real-time data push interface, wherein the monitoring source interface is used to extract real-time data from resource sources. Data, the real-time data push interface is used to push the extracted real-time data to the corresponding resource receiving port. When the resource sources are of multiple types, adapters corresponding to the resource sources of each type can also be set in the general master listener for performing corresponding data conversion and the like.

Of course, master listeners corresponding to resource sources may also be created in the electronic device, and each resource source corresponds to a master listener. For example, if resource sources include databases, data warehouses, and digital engines, corresponding master listeners can be created for databases, data warehouses, and digital engines respectively. There is no restriction on the specific setting method of the main listener here. The specific setting can be made according to the actual situation. It only needs to ensure that it can extract real-time data from the determined resource source, and will extract the real-time data. Just push it to the corresponding resource receiving port.

Specifically, as mentioned above, a message subscription and push system is maintained in the electronic device. After the electronic device receives the resource registration request, the new resource source is added to the message subscription and push system according to the different resource sources. , only need to update the corresponding relationship between the resource type and the resource source, the update of the message subscription push system can be realized, so that the resource type in the electronic device can be known by the external system in time, and the system will select the corresponding The processing method acquires data, processes it according to a series of filtering processing functions, and sends it to the resource receiving port provided by the external system.

S14, extracting real-time data from the target resource source.

As described above, the electronic device can extract real-time data from the target resource source using the master listener determined by the target resource source.

S15, push real-time data to at least one resource receiving port.

The external system knows the data usage of the external representation of the resource type according to the description of the resource type, registers the resource type corresponding to the data it wants to acquire through the interface provided by the internal program in the external open platform, and provides the relevant resource receiving port. After extracting the real-time data, the electronic device pushes the real-time data to it by using the status information of each resource receiving port.

Optionally, the resource registration request may also carry data filtering rules, as well as configuration information such as the frequency of data push and whether the data needs to be resumed at a breakpoint. These configuration information will be stored by the internal message subscription push system, and then after the internal resource type is registered by the external system, after obtaining the data according to the processing method of the resource type, the configuration information of the external system is used to filter the rules and decide whether to send the external system to the external system. The system pushes data. When it is determined that data needs to be pushed to the external system, the state information of each resource receiving port is used to push real-time data to it.

In the data transmission method provided in this embodiment, the corresponding relationship between resource types and resource sources is used to determine the target resource source corresponding to the target resource type, and real-time data can be extracted from the target resource source and pushed to the resource receiving port, so as to achieve data The purpose of real-time push is to use resource types to share the same real-time push mechanism. For the outside world, it only knows the resource type but not the specific resource source, so it is easy to switch internal data sources and avoid providing multiple data interfaces to the outside world. Reverse push is used to avoid excessive external requests and increase the pressure on the server, which improves the real-time performance of data transmission.

In this embodiment, a data transmission method is provided, which can be used for the above-mentioned electronic devices, such as servers, computers, tablet computers, etc. FIG. 3 is a flowchart of the data transmission method according to an embodiment of the present invention, as shown in FIG. 3 , the process includes the following steps:

S21, providing a locally open resource type.

The resource type corresponds to the resource source.

For details, please refer to S11 of the embodiment shown in FIG. 2 , which will not be repeated here.

S22: Receive a resource registration request for at least one target resource type.

The resource registration request corresponds to a resource receiving port.

For details, please refer to S12 of the embodiment shown in FIG. 2 , which will not be repeated here.

S23, based on the resource registration request, determine the target resource source corresponding to the target resource type.

For details, please refer to S13 of the embodiment shown in FIG. 2 , which will not be repeated here.

S24, extracting real-time data from the target resource source.

For details, please refer to S14 of the embodiment shown in FIG. 2 , which will not be repeated here.

S25, push real-time data to at least one resource receiving port.

The electronic device further determines state information of at least one resource receiving port based on the resource registration request, and pushes real-time data to at least one resource receiving port according to the state information of at least one resource receiving port. Wherein, the state information includes one of normal, retry, abnormal and recovery.

As mentioned above, the electronic device pushes real-time data to each resource receiving port according to the status information. Specifically, it can be divided into the following processing methods:

(1) Resource receiving port in normal state

The state information of the resource receiving port collected by the electronic device is the resource receiving port in the normal state, and data push corresponding to the normal mode is performed based on the normal resource receiving port. For the data push in the normal mode, reference may be made to the related description of S252 and its subsequent steps below.

(2) Resource receiving port in retry state

The state information of the resource receiving port collected by the electronic device is the resource receiving port in the retry state, and data push corresponding to the retry mode is performed based on the retrying resource receiving port. The data push in the retry mode may refer to the related description of S256 below.

(3) Resource receiving port in abnormal state

The state information of the resource receiving port collected by the electronic device is the resource receiving port in the abnormal state, and the data push corresponding to the abnormal mode is performed based on the abnormal resource receiving port. For the data push in the abnormal mode, reference may be made to the relevant description of step (6) in S255 below.

(4) Resource receiving port in recovery state

The state information of the resource receiving port collected by the electronic device is the resource receiving port in the recovering state, and data push corresponding to the recovering mode is performed based on the resource receiving port in the recovering state. The data push in the recovery mode may refer to the relevant description of step (4) in S256 below.

It can be seen from the above that the electronic device pushes data in different modes based on the status of each resource receiving port. Among them, it should be noted that during the data push process, the status information of the same resource receiving port may change. For example, it can change from a normal state to a retry state, from a retry state to an abnormal state, from an abnormal state to a recovering state, and so on. In the following description, taking the state information of the resource receiving port as the normal state as an example, the state change after the resource is received and the processing mode corresponding to each state will be described in detail.

Specifically, the above S25 includes the following steps:

S251 , based on the resource registration request, determine the status information of at least one resource receiving port.

Since the resource registration request corresponds to the resource receiving interface, and real-time status information of each resource receiving interface is stored in the electronic device, the electronic device can use the resource registration request to determine the state information of at least one resource receiving interface.

S252, the state information of the collected resource receiving ports is the resource receiving ports in the normal state.

The electronic device utilizes the state information of each resource receiving port, and collects the resource receiving port whose state information is the normal state, so as to push the data in the normal mode.

S253, using at least one thread to push the real-time data to the resource receiving port in the normal state in parallel.

The electronic device may create a corresponding number of threads according to the number of resource receiving ports in the normal state, that is, the created threads correspond to the resource receiving ports in the normal state one-to-one. After the thread is created, the electronic device uses the corresponding thread to push the real-time data to the resource receiving port in the normal state, so as to realize the parallel push of the real-time data.

S254, determine whether the push of the preset thread is abnormal.

During the data push process of each thread, the electronic device judges in real time whether the push of each thread is abnormal. Taking the preset thread as an example, the electronic device judges in real time whether the push of the preset thread is abnormal, and the abnormality may be whether the real-time data is pushed successfully. During the process, S254 is executed to determine whether a push exception occurs.

S255, stop the real-time data push of the preset thread and set the state information of the resource receiving port corresponding to the preset thread to retry.

When the electronic device determines that the real-time data push of the preset thread is abnormal, the data push of the preset thread is stopped, and the status information of the resource receiving port corresponding to the preset thread is set to retry.

The resource receiving port a of the external system 1 and the resource receiving port b of the external system 2 are resource receiving ports in the normal state, then the electronic device creates two threads, such as thread 1 and thread 2, and uses thread 1 and thread 2 to send resources to the resource. Receiving ports a and b send real-time data. If during the real-time data sending process, the electronic device determines that the data push of thread 1 is abnormal and the data push of thread 2 is normal, then the electronic device will set the status information of the resource receiving port a corresponding to thread 1 to retry, and Stop the data push of thread 1. The thread 2 still pushes real-time data to the resource receiving port b normally.

S256, push data corresponding to the retry mode based on the resource receiving port in the retry state.

After the electronic device sets the state information of the resource receiving port corresponding to the preset thread to retry, it can push the data corresponding to the retry mode.

By pushing data to the resource receiving port in the normal state in parallel, the efficiency of data transmission can be improved; and when the preset thread pushes abnormality, the state information of the resource receiving port is set to retry, and the data in the retry mode is performed. Push, to achieve normal to retry state flow to ensure the normal push of data.

Specifically, the above S256 may be the following steps, and it may also be understood that the data push in the retry mode may include the following steps:

(1) Open another thread to push the currently failed data to the resource receiving port in the retry state again.

Continuing to use the above-mentioned embodiment, for the resource receiving port a, the electronic device opens another thread to push the currently failed data to it again.

(2) Judging whether the data that is currently failed to be pushed is successfully pushed to the resource receiving port in the retry state within the preset condition.

Wherein, the preset condition may be a preset number of times, or within a preset time interval, etc., and may be specifically set according to the actual situation, which is not limited herein.

When the currently failed data is successfully pushed to the resource receiving port in the retry state within the condition, step (3) is performed; otherwise, step (5) is performed. For example, the electronic device can use a separate thread to push the data that has failed to be pushed up to three times to the resource receiving port in the retry state. If all three pushes fail, step (5) is performed; otherwise, step (3) is performed.

(3) The state information of the resource receiving port in the retry state is set as recovering.

During the retry process of the electronic device, if the currently failed data is successfully pushed, the state information of the resource receiving port in the retry state is set as recovering.

In the retry mode, if the data push is successful, the state information of the resource receiving port is set to recovering to realize the state flow from retry to recovery, which provides guarantee for data push.

(4) Push data corresponding to the mode in recovery based on the resource receiving port in recovery.

Specifically, the above step (4) may include the following steps, and it can also be understood that the data push mode of the recovery mode includes the following steps:

4.1) Extract the configuration information of the resource receiving port in recovery.

The configuration information may include a flag for pushing interrupted data at the resource receiving port. When the flag for pushing interrupted data is 1, it means that the resource receiving port needs to push the interrupted data, and then it needs to push the interrupted data from the interrupted position to the current position. The historical data is pushed to the resource receiving port in recovery; when the flag bit of the interrupted data is pushed to 0, it means that the resource receiving port does not need to push the interrupted data.

4.2) Determine whether the interrupted data needs to be pushed based on the configuration information.

When the interrupted data needs to be pushed, execute 4.3); otherwise, directly push the real-time data to the resource receiving port in recovery.

4.3) Read the historical data from the interrupted position to the current position.

Electronic devices can create sub-listeners when breakpoint teleportation is required. The sub-listener is created according to the configuration information of the resource registration request of the external system and needs to be created when the state is recovering to obtain historical data when the breakpoint is returned. Wherein, the sub-listener is a method for obtaining historical data between the interruption point of the resource source and the latest real-time point.

4.4) Push the historical data to the recovering resource receiving port, and judge whether the push fails during the push process.

When there is no push failure, go to step 4.5); otherwise, go to step 4.7).

4.5) Set the status information of the resource receiving port in recovery to normal.

When the electronic device successfully pushes historical data to the resource receiving port in recovery, the state information of the resource receiving port in recovery is set to normal.

4.6) Push data corresponding to the normal mode based on the resource receiving port in the normal state.

In the recovering mode, the interrupted and resumed transmission can be performed from the interrupted position to ensure that the data is not lost; and when the historical data push does not fail, the state of the resource receiving port can be transferred from the recovery to the normal flow, which provides the recovery of the interrupted push data. guaranteed.

For details, please refer to the relevant descriptions of the above S252 and subsequent steps, which will not be repeated here.

4.7) Set the status information of the resource receiving port in recovery as abnormal, and push the data corresponding to the abnormal mode based on the resource receiving port of the abnormal state.

When an abnormality occurs when the electronic device pushes historical data to the resource receiving port being restored, the state information of the resource receiving port being restored is set as abnormal, and then data push corresponding to the abnormal mode is performed based on the resource receiving port of the abnormal state.

In the recovering mode, if the data push fails, the state of the resource receiving port is set to be abnormal directly, and no retry is performed, so as to avoid multiple retries of data transmission and improve the real-time performance of data transmission.

(5) The state of the resource receiving port in the retry state is set to be abnormal.

When the electronic device fails to push the currently failed data to the resource receiving port in the retry state, the state of the resource receiving port in the retry state is set as abnormal. When the resource receiving port in the retry state does not successfully push the data that fails to push the current push within the preset conditions, the resource receiving port is realized from the retry to the abnormal state flow, which provides a guarantee for the normal push of the data.

(6) Push data corresponding to the abnormal mode based on the resource receiving port of the abnormal state.

Specifically, the above step (6) may include steps, and it may also be understood that the data push of the abnormal mode includes the following steps:

6.1) The state of the resource receiving port receiving the abnormal state is updated to normal information.

When the electronic device determines that the resource receiving port is abnormal, it can send alarm information to the external system, so that the external system can perform corresponding processing on the resource receiving port. After the external system finishes processing the resource receiving port, it may send status update information to the electronic device to request to update the state of the resource receiving port in the abnormal state to a normal state.

6.2) Determine whether the state of the resource receiving port of the set abnormal state is abnormal.

After receiving the information sent by the external system to update the state of the resource receiving port in the abnormal state to normal, the electronic device first determines whether the state of the resource receiving port in the abnormal state stored locally is abnormal. When the state of the resource receiving port of the set abnormal state is abnormal, step 6.3) is performed; otherwise, step 4.6) is performed.

6.3) Set the status information of the resource receiving port in the abnormal state to recovering.

When the electronic device determines that the state of the resource receiving port of the abnormal state stored locally is still abnormal, the electronic device first sets its state information as recovering.

6.4) Based on the resource receiving port in recovery, perform data push corresponding to the mode in recovery.

For details, please refer to the description of the above step (4), which will not be repeated here.

In the data transmission method provided by this embodiment, when the state of the resource receiving port in the abnormal state is updated to normal externally, the local does not directly set the state of the resource receiving port to normal, but first sets it to recovering, The state flow from abnormal to recovery provides a guarantee for the normal transmission of data.

The internal state flow mechanism is shown in Figure 4, and the specific state transition rules are as follows:

(1) Normal state to retry state

a) Multiple external systems can register the same resource type. After the internal listener obtains the data, it starts multiple main processes in parallel to push the data.

b) When an exception occurs in the data push, change the status of the external system resource receiving port of the data push exception to retry.

c) The main process stops pushing new real-time data to the resource receiving port of the current external system.

d) Start the sub-process to retry the push, and go to step (2).

(2) Retry state to abnormal state

a) The retry of the resource receiving ports of multiple external systems can be performed in parallel by multiple sub-processes.

b) Retry three times to push data to the resource receiving port of the current external system.

c) When an exception still occurs after three retries, change the status of the resource receiving port to anomaly.

d) Close the retry subprocess.

(3) Retry state to recovering state

a) Three retries to push data to the resource receiving interface of the current external system.

b) When any push data is successful, stop retrying, and change the status of the resource receiving interface to restoring.

c) Close the retry subprocess.

(4) Abnormal state to recovery state

a) After the external system is started, it should update the information that the status of the resource receiving port is normal by sending to the electronic device

b) When the electronic device receives that the state of the resource receiving port is to be changed to normal, first check whether the state of the resource receiving port in the current database is normal.

c) If the resource receiving port in the database is in a normal state, do nothing.

d) If the resource receiving port in the database is in an abnormal state, it is not updated to a normal state first, but is updated to a restoring state first.

e) Start the recovery process and go to steps (5) and (6).

(5) Restoring state to retry state

a) Read the configuration information of all resource receiving ports whose state is restoring (restoring).

b) Start the recovery sub-process to push the interrupted data according to whether it is necessary to restore the interrupted data.

c) An exception occurs when the interrupted data is pushed, no retry is required, the state of the resource receiving port is immediately changed to anomaly, and the interrupted data recovery sub-process is closed, and the sub-process includes a sub-listener.

d) Repeat step (5).

(6) Restoring state to normal state

a) Read the configuration information of all resource receiving ports whose state is restoring (restoring).

b) Push the interrupted data as needed.

c) All interrupted data are pushed and there is no abnormality, then the change state is normal.

d) Close the recovery process.

In this embodiment, a data transmission method is provided, which can be used for the above-mentioned electronic devices, such as servers, computers, tablet computers, etc. FIG. 5 is a flowchart of the data transmission method according to an embodiment of the present invention, as shown in FIG. 5 . , the process includes the following steps:

S31, providing a locally open resource type.

The resource type corresponds to the resource source.

For details, please refer to S21 of the embodiment shown in FIG. 3 , which will not be repeated here.

S32: Receive at least one resource registration request for the target resource type.

The resource registration request corresponds to the resource receiving port, wherein the resource registration request carries configuration information, and the configuration information includes data filtering conditions of the resource receiving port.

For details, please refer to S22 of the embodiment shown in FIG. 3 , which will not be repeated here.

S33, based on the resource registration request, determine the target resource source corresponding to the target resource type.

For details, please refer to S23 of the embodiment shown in FIG. 3 , which will not be repeated here.

S34, extracting real-time data from the target resource source.

For details, please refer to S24 of the embodiment shown in FIG. 3 , which will not be repeated here.

S35, push real-time data to at least one resource receiving port.

Specifically, the above S35 includes the following steps:

S351 , filtering the real-time data by using the data filtering condition.

The electronic device filters the extracted real-time data based on the data filtering conditions in the configuration information of each resource registration request.

S352: Push the filtered real-time data to at least one resource receiving port.

For the filtered real-time data, the electronic device can push real-time data to it according to the status information of each resource receiving port. For details, please refer to S25 of the embodiment shown in FIG. 3 , which will not be repeated here.

Among them, if the filtered real-time data is empty, it is not necessary to push the data to the corresponding resource receiving port; if the filtered real-time data is not empty, it is necessary to push the filtered data to the corresponding resource receiving port according to the status information of each resource receiving port. Real-time data.

In the data transmission method provided in this embodiment, the real-time data is filtered before the real-time data is transmitted, so that the transmitted real-time data can meet external requirements.

As a specific implementation of the embodiment of the present invention, as shown in FIG. 6 , the data transmission method includes the following processing flow:

(1) Resource mapping: Map resource sources to resource types.

a) The electronic device needs to open data to the outside world, and it will call the interface to bind the resource source with the resource type.

b) The resource mapping component will be responsible for creating the corresponding relationship between the two.

(2) Resource type announcement: Tell the external system which resource types are currently available for use during registration.

(3) Required resource registration and status update: The external system performs registration and status update operations according to the required resource type.

a) Permissions for external systems to obtain electronic devices.

b) The external system calls the registration interface opened by the electronic device, and provides the registered resource type, resource receiving port information, and the status of the resource receiving port (the status of the receiving address will be updated immediately every time the external system is restarted), push type Name (it can be pushed in the form of HTTP, and can be extended), whether it is necessary to re-push interrupted data, the number of interrupted messages per re-push, and data filter conditions. c) After the external system restarts, the state update interface opened by the open platform needs to be called to update the state of the resource receiving port. The resource registration request sent by the external system will be stored in the database and cache for use by the internal state flow mechanism.

(4) Resource listener: monitor the data source of the mapping according to the resource type registered by the external system, obtain the required data from the resource source in real time, and send it to the filter for processing.

a) Use a round-robin approach to detect the type of resources that need to be processed in the cache.

b) Create respective listeners for the resource types specified by the external system, and the listeners monitor the data sources mapped by the resource types.

c) Once any new real-time data is monitored, the real-time data is sent to the filter for processing.

(5) Filter: Filter unnecessary real-time data according to the needs of external systems.

a) Get the configuration information of the external system from the cache.

b) Filter the real-time data according to the filter conditions configured by the external system.

c) If the real-time data needs to be pushed after filtering, it will be handed over to the data distribution process.

d) If the real-time data does not need to be pushed after filtering, it will be discarded and not pushed.

(6) Data distribution processing: encapsulate the data to be sent into a fixed structure and send it to the internal state flow mechanism for processing.

a) Encapsulate the real-time data into a fixed-format message, which can be JSON, provided that the format of the communication data is negotiated with the external system. Messages are hashed or encrypted as needed to prevent tampering or pushed using the https protocol, which also needs to be negotiated with external systems.

b) Obtain the resource receiving port information of all external systems that need data of the current resource type from the cache.

c) Classify and assemble all the real-time data to be processed into transmission data according to the resource receiving port, and hand it over to the internal state transfer mechanism for processing.

(7) Internal state transfer mechanism: It is used for state transition in three cases: normal push, abnormal retry, and abnormal recovery. Conversion rules: normal->retry->anomaly->restoring.

a) The data after data distribution and processing will carry the specified resource receiving port information, and filter the status of the resource receiving port.

b) If the state of the resource receiving port is normal, and collecting the interface information that the state of the resource receiving port is normal (normal), the process proceeds to step (8).

c) If the status of the resource receiving port is abnormal (anomaly), it will be discarded and not processed.

d) If the state of the resource receiving port is restoring, go to step (11).

(8) Data push: push data to the resource receiving port designated by the external system.

a) Using multi-threads to send messages to the corresponding resource receiving ports of each external system in parallel.

b) If an exception occurs in any thread push, go to step (9).

c) If there is no abnormality, the current processing ends, and the step (4) is entered again.

(9) Abnormal retry: Push the information again for the abnormal push, and try 3 times.

a) Push the data to the resource receiving port with an exception and set the state of the resource receiving port to retry (retry). When the resource receiving port is set to retry, the real-time data push of the main line will be stopped.

b) Open another thread and try to push the currently failed data to the resource receiving port of the external system again, and try 3 times.

c) If successful, set the state of the resource receiving port as restoring, and then go to step (11).

d) If it still fails after the attempt, set the state of the resource receiving port to abnormal (anomaly), and record the data location of the abnormal interruption, then interrupt the processing, and wait for the external system call state update to restore the state.

(10) Abnormal information: The administrator can view all abnormal push information through the interface.

(11) Abnormal recovery: recover the state of the abnormal resource receiving port.

a) Read the configuration information of all resource receiving ports whose status is restoring

b) Whether the interrupted data needs to be pushed according to the configuration, if necessary, go to step (12).

c) If there is no need to push the interrupted data, the current real-time data is pushed, the push is successful, and the state of the resource receiving port changes from restoring to normal.

d) Destroy the current sub-line resource listener so that the shared main-line resource listener can continue to monitor real-time data.

(12) Breakpoint resume: Interrupt and resume the interrupted data on demand.

a) Create a sub-line resource listener;

b) Read the corresponding data from the position of the abnormal interruption;

c) Push data to the resource receiving port of the external system according to the specified amount of data pushed each time, and record the position of each successful push until it catches up with the latest real-time data;

d) If an exception occurs in the process of pushing the interrupted data, go to step (9);

e) If the data from the interrupted position to the latest real-time position has been pushed and no exception occurs, change the state of the resource receiving port from restoring to normal.

The beneficial effects of the data transmission method provided by this embodiment are:

(1) Different types of open data sources are abstracted into resource types. The external system only knows the resource type but does not know the specific internal data source, so it is easy to switch the internal data source. It is not necessary to provide an open interface on the open platform, and the external system cannot perceive it. Changes in data sources, internal migration and expansion are convenient.

(2) The electronic device resource monitor monitors data in real time, provides the function of filtering data, distributes and pushes data to multiple external systems in parallel, thereby reducing the request pressure of external systems on internal servers, and data can be pushed in real time unless the interface is abnormal. Interrupted push, there are also options for data interrupted and resumed transmission, to ensure that data is not lost.

(3) The electronic device will record the abnormal information when the real-time push data is abnormal, which is convenient for the administrator to quickly check the abnormal problem and guide the external system and electronic device to repair related problems.

(4) The internal state transfer mechanism provides a guarantee for abnormal retry and recovery of interrupted push data.

(5) This solution is not bundled with any software, so it is easy to expand software functions. To add an abstract resource type, you only need to configure the mapping between data sources and resource types without paying attention to the processing related to real-time push. If the current listener cannot handle the resource type, you can implement a listener that meets the requirements by extension.

In this embodiment, a data transmission apparatus is also provided, and the apparatus is used to implement the above-mentioned embodiments and preferred implementations, and what has been described will not be repeated. As used below, the term "module" may be a combination of software and/or hardware that implements a predetermined function. Although the apparatus described in the following embodiments is preferably implemented in software, implementations in hardware, or a combination of software and hardware, are also possible and contemplated.

This embodiment provides a data transmission device, as shown in FIG. 7 , including:

a providing module 41, configured to provide a locally open resource type, the resource type corresponding to the source of the resource;

a receiving module 42, configured to receive at least one resource registration request for the target resource type, the resource registration request corresponding to the resource receiving port;

Determining module 43, for determining the target resource source corresponding to the target resource type based on the resource registration request;

Extraction module 44, for extracting real-time data from the target resource source;

The push module 45 is configured to push the real-time data to at least one of the resource receiving ports.

The data transmission device provided in this embodiment uses the corresponding relationship between resource types and resource sources to determine the target resource source corresponding to the target resource type, so that real-time data can be extracted from the target resource source and pushed to the resource receiving port, so as to achieve data The purpose of real-time push is to use resource types to share the same real-time push mechanism to avoid providing multiple data interfaces to the outside world. Reverse push is used to avoid excessive external requests and increase the pressure on the server, which improves the efficiency of data transmission. real-time.

The data transmission apparatus in this embodiment is presented in the form of functional units, where units refer to ASIC circuits, processors and memories that execute one or more software or fixed programs, and/or other devices that can provide the above functions .

Further functional descriptions of the above-mentioned modules are the same as those of the above-mentioned corresponding embodiments, and are not repeated here.

An embodiment of the present invention further provides an electronic device having the data transmission device shown in FIG. 7 .

Please refer to FIG. 8. FIG. 8 is a schematic structural diagram of an electronic device provided by an optional embodiment of the present invention. As shown in FIG. 8, the electronic device may include: at least one processor 51, such as a CPU (Central Processing Unit, central processing unit). processor), at least one communication interface 53, memory 54, at least one communication bus 52. Among them, the communication bus 52 is used to realize the connection and communication between these components. The communication interface 53 may include a display screen (Display) and a keyboard (Keyboard), and the optional communication interface 53 may also include a standard wired interface and a wireless interface. The memory 54 may be a high-speed RAM memory (Random Access Memory, volatile random access memory), or may be a non-volatile memory (non-volatile memory), such as at least one disk memory. The memory 54 can optionally also be at least one storage device located away from the aforementioned processor 51 . The processor 51 may be combined with the device described in FIG. 7 , the memory 54 stores application programs, and the processor 51 calls the program codes stored in the memory 54 for executing any of the above method steps.

The communication bus 52 may be a peripheral component interconnect (PCI for short) bus or an extended industry standard architecture (EISA for short) bus or the like. The communication bus 52 can be divided into an address bus, a data bus, a control bus, and the like. For ease of presentation, only one thick line is used in FIG. 8, but it does not mean that there is only one bus or one type of bus.

The memory 54 may include volatile memory (English: volatile memory), such as random-access memory (English: random-access memory, abbreviation: RAM); the memory may also include non-volatile memory (English: non-volatile memory) memory), such as flash memory (English: flash memory), hard disk (English: hard disk drive, abbreviation: HDD) or solid-state hard disk (English: solid-state drive, abbreviation: SSD); the memory 54 may also include the above types of combination of memory.

The processor 51 may be a central processing unit (English: central processing unit, abbreviation: CPU), a network processor (English: network processor, abbreviation: NP), or a combination of CPU and NP.

The processor 51 may further include a hardware chip. The above-mentioned hardware chip may be an application-specific integrated circuit (English: application-specific integrated circuit, abbreviation: ASIC), a programmable logic device (English: programmable logic device, abbreviation: PLD) or a combination thereof. The above-mentioned PLD can be a complex programmable logic device (English: complex programmable logic device, abbreviation: CPLD), field programmable logic gate array (English: field-programmable gate array, abbreviation: FPGA), general array logic (English: generic array logic, abbreviation: GAL) or any combination thereof.

Optionally, memory 54 is also used to store program instructions. The processor 51 may invoke program instructions to implement the data transmission methods shown in the embodiments of FIGS. 2 , 3 and 5 of the present application.

An embodiment of the present invention further provides a non-transitory computer storage medium, where the computer storage medium stores computer-executable instructions, and the computer-executable instructions can execute the data transmission method in any of the foregoing method embodiments. Wherein, the storage medium may be a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM), a random access memory (Random Access Memory, RAM), a flash memory (Flash Memory), a hard disk (Hard) Disk Drive, abbreviation: HDD) or solid-state drive (Solid-State Drive, SSD), etc.; the storage medium may also include a combination of the above-mentioned types of memories.

Although the embodiments of the present invention have been described with reference to the accompanying drawings, various modifications and variations can be made by those skilled in the art without departing from the spirit and scope of the present invention, and such modifications and variations fall within the scope of the appended claims within the limits of the requirements.

Claims (13)

1. A data transmission method, comprising:

   Provide a locally open resource type, the resource type corresponds to the source of the resource;

   receiving a resource registration request for at least one target resource type, where the resource registration request corresponds to a resource receiving port;

   determining a target resource source corresponding to the target resource type based on the resource registration request;

   extracting real-time data from the target resource source;

   Pushing the real-time data to at least one of the resource receiving ports.
2. The method according to claim 1, wherein the pushing the real-time data to at least one of the resource receiving ports comprises:

   determining, based on the resource registration request, status information of the at least one resource receiving port, where the status information includes one of normal, retry, abnormal, and recovery;

   The real-time data is pushed to the at least one resource receiving port according to the state information of the at least one resource receiving port.
3. The method according to claim 2, wherein the pushing the real-time data to at least one of the resource receiving ports according to the state information of the at least one resource receiving port comprises:

   The state information of the collected resource receiving port is the resource receiving port in the normal state;

   Utilize at least one thread to push the real-time data to the normal resource receiving port in parallel;

   Determine whether the push of the preset thread is abnormal;

   When the push of the preset thread is abnormal, stop the real-time data push of the preset thread and set the status information of the resource receiving port corresponding to the preset thread to retry;

   The resource receiving port based on the retry state performs data push corresponding to the retry mode;

   or,

   The pushing the real-time data to at least one of the resource receiving ports according to the state information of the at least one resource receiving port includes:

   Collecting the status information of the resource receiving port is the resource receiving port in the retry state;

   Stop pushing real-time data to the resource receiving port in the retry state and set the state information of the resource receiving port to retry;

   The resource receiving port in the retry state performs data push corresponding to the retry mode.
4. The method according to claim 3, wherein the data push corresponding to the retry mode is performed by the resource receiving port based on the retry state, comprising:

   Open another thread to push the currently failed data to the resource receiving port in the retry state again;

   judging whether the data of the current push failure is successfully pushed to the resource receiving port in the retry state within a preset condition;

   When successfully pushing the currently failed data to the resource receiving port in the retry state within the preset condition, setting the state information of the resource receiving port in the retry state as recovering;

   Perform data push corresponding to the mode in recovery based on the resource receiving port in recovery;

   or,

   When the data of the current push failure is not successfully pushed to the resource receiving port in the retry state within the preset condition, setting the state of the resource receiving port in the retry state as abnormal;

   The resource receiving port based on the abnormal state performs data push corresponding to the abnormal mode.
5. The method according to claim 2, wherein the pushing the real-time data to at least one of the resource receiving ports according to the state information of the at least one resource receiving port comprises:

   Collecting the status information of the resource receiving port is the resource receiving port being restored;

   Data push corresponding to the mode in recovery is performed based on the resource receiving port in recovery.
6. The method according to claim 4 or 5, wherein the resource registration request also carries configuration information, and the data push corresponding to the mode in recovery is performed based on the resource receiving port in the recovery, including:

   extracting the configuration information of the resource receiving port in the restoration;

   Determine whether the interrupted data needs to be pushed based on the configuration information;

   When the interrupted data needs to be pushed, read the historical data from the interrupted position to the current position;

   Pushing the historical data to the resource receiving port in the restoration, and judging whether the push fails during the pushing process;

   When there is no push failure, set the status information of the resource receiving port in the recovery to normal;

   The data push corresponding to the normal mode is performed based on the resource receiving port in the normal state.
7. The method according to claim 6, wherein the performing data push corresponding to the mode in recovery based on the resource receiving port in recovery comprises:

   When a push failure occurs, the state information of the resource receiving port in the restoration is set to be abnormal, and the resource receiving port based on the abnormal state performs data push corresponding to the abnormal mode.
8. The method according to claim 2, wherein the pushing the real-time data to at least one of the resource receiving ports according to the state information of the at least one resource receiving port comprises:

   The state information of the collected resource receiving port is the resource receiving port in an abnormal state;

   The resource receiving port based on the abnormal state performs data push corresponding to the abnormal mode.
9. The method according to claim 4, 7 or 8, wherein the abnormal state-based resource receiving port performs data push corresponding to the abnormal mode, comprising:

   The state of the resource receiving port receiving the abnormal state is updated to normal information;

   Determine whether the state of the set resource receiving port of the abnormal state is abnormal;

   When the set state of the resource receiving port in the abnormal state is abnormal, setting the state information of the resource receiving port in the abnormal state as recovering;

   Data push corresponding to the mode in recovery is performed based on the resource receiving port in recovery.
10. The method according to claim 2, wherein the resource registration request carries configuration information, and the configuration information includes data filtering conditions, and the request is sent to at least one of the resource receiving ports according to status information of at least one of the resource receiving ports. The resource receiving port pushes the real-time data, including:

    Filter the real-time data by using the data filter condition;

    Based on the state information of the at least one resource receiving port, the filtered real-time data is pushed to the at least one resource receiving port.
11. A data transmission device, comprising:

    providing a module for providing a locally open resource type, the resource type corresponding to the resource source;

    a receiving module, configured to receive a resource registration request for at least one target resource type, where the resource registration request corresponds to a resource receiving port;

    a determining module, configured to determine the target resource source corresponding to the target resource type based on the resource registration request;

    an extraction module, for extracting real-time data from the target resource source;

    A push module, configured to push the real-time data to at least one of the resource receiving ports.
12. An electronic device, comprising:

    A memory and a processor, the memory and the processor are connected in communication with each other, the memory stores computer instructions, and the processor executes any one of claims 1-10 by executing the computer instructions the described data transmission method.
13. A computer-readable storage medium, characterized in that, the computer-readable storage medium stores computer instructions, and the computer instructions are used to cause a computer to execute the data transmission method according to any one of claims 1-10.

Images