CN112994934B - Data interaction method, device and system - Google Patents

Data interaction method, device and system Download PDF

Info

Publication number
CN112994934B
CN112994934B CN202110168080.1A CN202110168080A CN112994934B CN 112994934 B CN112994934 B CN 112994934B CN 202110168080 A CN202110168080 A CN 202110168080A CN 112994934 B CN112994934 B CN 112994934B
Authority
CN
China
Prior art keywords
platform
data
sending
state information
sent
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110168080.1A
Other languages
Chinese (zh)
Other versions
CN112994934A (en
Inventor
李�杰
王涛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou DPTech Technologies Co Ltd
Original Assignee
Hangzhou DPTech Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou DPTech Technologies Co Ltd filed Critical Hangzhou DPTech Technologies Co Ltd
Priority to CN202110168080.1A priority Critical patent/CN112994934B/en
Publication of CN112994934A publication Critical patent/CN112994934A/en
Application granted granted Critical
Publication of CN112994934B publication Critical patent/CN112994934B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/50Network service management, e.g. ensuring proper service fulfilment according to agreements
    • H04L41/5003Managing SLA; Interaction between SLA and QoS
    • H04L41/5019Ensuring fulfilment of SLA
    • H04L41/5022Ensuring fulfilment of SLA by giving priorities, e.g. assigning classes of service
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/08Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0876Network utilisation, e.g. volume of load or congestion level
    • H04L43/0882Utilisation of link capacity
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/10Active monitoring, e.g. heartbeat, ping or trace-route

Abstract

The disclosure relates to a data interaction method, device, system, electronic device and computer readable medium based on platform cascade. The method can be applied to a lower platform and comprises the following steps: sending the heartbeat message to a superior platform at regular time; determining state information of the superior platform based on a return message of the heartbeat message; when the state information is normal, acquiring the priority and the sending quantity corresponding to the data to be sent and the data type; extracting target data from the data to be sent according to the priority and the sending quantity; and sending the target data to the superior platform. The data interaction method, the device, the system, the electronic equipment and the computer readable medium based on the platform cascade can solve the problems of data loss, bandwidth utilization and data transmission during data interaction between an upper platform and a lower platform, and optimize data transmission.

Description

Data interaction method, device and system
Technical Field
The present disclosure relates to the field of computer information processing, and in particular, to a method, an apparatus, a system, an electronic device, and a computer-readable medium for data interaction based on platform cascade.
Background
With the development and popularization of big data in IT technology, more and more software platforms start to adopt big data architecture for storing and analyzing various data and logs. However, with the increase of the large data platform and the increase of the service complexity, the data interaction between different platforms is more and more frequent, and in the large service system, a higher-level platform needs to receive the data of a plurality of lower-level platforms at the same time. Along with this, problems due to data interaction are increasing and troublesome.
In a current larger business system, a scheme generally adopted is a data interaction scheme using a syslog mode. The method comprises the steps that firstly, a white list of a lower platform allowed to be received is configured on an upper platform, the lower platform is configured as a receiver, and then the lower platform adopts a syslog mode to send data to be transmitted to the upper platform in a timing or real-time or pseudo-real-time mode. After receiving the data, the superior platform preferably determines whether the sender is in the white list, and performs operations such as receiving processing and the like on the data sent by the sender in the white list.
The main disadvantages with the above solution are as follows: 1. the lower platform cannot know the data receiving state of the upper platform, which may result in data loss. 2. The superior platform cannot control the data transmission of the subordinate platform, and cannot better utilize the network bandwidth. 3. The lower platform cannot decide the data which needs to be sent preferentially.
Therefore, a new method, apparatus, system, electronic device and computer readable medium for data interaction based on platform cascading are needed.
The above information disclosed in this background section is only for enhancement of understanding of the background of the disclosure and therefore it may contain information that does not constitute prior art that is already known to a person of ordinary skill in the art.
Disclosure of Invention
In view of this, the present disclosure provides a data interaction method, device, system, electronic device and computer readable medium based on platform cascade, which can solve the problems of data loss, bandwidth utilization and data transmission during data interaction between an upper platform and a lower platform, and optimize data transmission.
Additional features and advantages of the disclosure will be set forth in the detailed description which follows, or in part will be obvious from the description, or may be learned by practice of the disclosure.
According to an aspect of the present disclosure, a data interaction method based on platform cascade is provided, where the method is applicable to a lower platform, and includes: sending the heartbeat message to a superior platform at regular time; determining state information of the superior platform based on a return message of the heartbeat message; when the state information is normal, acquiring the priority and the sending quantity corresponding to the data to be sent and the data type; extracting target data from the data to be sent according to the priority and the sending quantity; and sending the target data to the superior platform.
In an exemplary embodiment of the present disclosure, further comprising: configuring the priority corresponding to the data type of the data to be sent; and configuring the sending quantity according to the instruction of the superior platform.
In an exemplary embodiment of the present disclosure, further comprising: and when the state information is abnormal, stopping sending the target data.
In an exemplary embodiment of the present disclosure, further comprising: acquiring a configuration instruction by the superior platform; and adjusting the sending number according to the configuration instruction.
According to an aspect of the present disclosure, a data interaction method based on platform cascade is provided, where the method is applicable to an upper platform, and includes: acquiring the current bandwidth utilization rate; generating current state information according to the bandwidth utilization rate; when the state information is normal, receiving a heartbeat message sent by a lower platform; sending the state information to the lower platform as the return information of the heartbeat message; and starting a data receiving function to receive the target data sent by the lower platform.
In an exemplary embodiment of the present disclosure, further comprising: and when the state information is abnormal, closing the data receiving function.
In an exemplary embodiment of the present disclosure, further comprising: configuring a priority for the lower level platform.
In an exemplary embodiment of the present disclosure, further comprising: when the state information is normal and semi-active, determining a target lower platform according to the priority of the lower platform and the data sending record of the lower platform; and sending a data increase instruction for the target lower-level platform.
In an exemplary embodiment of the present disclosure, further comprising: when the state information is normal and overloaded, determining a target lower platform according to the priority of the lower platform and the data sending record of the lower platform; and sending a data reduction instruction for the target lower-level platform.
According to an aspect of the present disclosure, a data interaction apparatus based on platform cascade is provided, and the apparatus is applicable to a lower platform, and includes: the heartbeat module is used for sending heartbeat messages to a superior platform at regular time; the state module is used for determining the state information of the superior platform based on the return message of the heartbeat message; the normal module is used for acquiring the priority and the sending quantity corresponding to the data to be sent and the data type when the state information is normal; the target module is used for extracting target data from the data to be sent according to the priority and the sending quantity; and the sending module is used for sending the target data to the superior platform.
According to an aspect of the present disclosure, a data interaction device based on platform cascade is provided, where the device is applicable to an upper platform, and includes: the bandwidth module is used for acquiring the current bandwidth utilization rate; the information module is used for generating current state information according to the bandwidth utilization rate; the receiving module is used for receiving the heartbeat message sent by the lower platform when the state information is normal; the response module is used for sending the state information to the subordinate platform as the return information of the heartbeat message; and the starting module is used for starting the data receiving function so as to receive the target data sent by the lower platform.
According to an aspect of the present disclosure, a data interaction system based on platform cascade is provided, the system including: the lower platform is used for sending the heartbeat message to the upper platform at regular time; determining state information of the superior platform based on a return message of the heartbeat message; when the state information is normal, acquiring the priority and the sending quantity corresponding to the data to be sent and the data type; extracting target data from the data to be sent according to the priority and the sending quantity; sending the target data to the superior platform; the superior platform is used for acquiring the current bandwidth utilization rate; generating current state information according to the bandwidth utilization rate; when the state information is normal, receiving heartbeat messages sent by a lower platform, and sending the state information to the lower platform as return information of the heartbeat messages; and starting a data receiving function to receive the target data sent by the lower platform.
According to an aspect of the present disclosure, an electronic device is provided, the electronic device including: one or more processors; storage means for storing one or more programs; when executed by one or more processors, cause the one or more processors to implement a method as above.
According to an aspect of the disclosure, a computer-readable medium is proposed, on which a computer program is stored, which program, when being executed by a processor, carries out the method as above.
According to the platform cascade-based data interaction method, device, system, electronic equipment and computer readable medium, the heartbeat message is sent to the superior platform at regular time; determining state information of the superior platform based on a return message of the heartbeat message; when the state information is normal, acquiring the priority and the sending quantity corresponding to the data to be sent and the data type; extracting target data from the data to be sent according to the priority and the sending quantity; the mode of sending the target data to the superior platform can solve the problems of data loss, bandwidth utilization and data sending during data interaction between the superior platform and the subordinate platform, and optimize data transmission.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The above and other objects, features and advantages of the present disclosure will become more apparent by describing in detail exemplary embodiments thereof with reference to the attached drawings. The drawings described below are merely some embodiments of the present disclosure, and other drawings may be derived from those drawings by those of ordinary skill in the art without inventive effort.
FIG. 1 is a schematic diagram illustrating a platform cascade-based data interaction system in accordance with an exemplary embodiment.
FIG. 2 is a flow diagram illustrating a method for platform cascade-based data interaction in accordance with an exemplary embodiment.
FIG. 3 is a flowchart illustrating a method of platform cascade-based data interaction, according to another example embodiment.
FIG. 4 is a flowchart illustrating a method of platform cascade-based data interaction, according to another example embodiment.
FIG. 5 is a block diagram illustrating a platform cascade-based data interaction device in accordance with an exemplary embodiment.
FIG. 6 is a block diagram illustrating a platform cascade-based data interaction device, according to another example embodiment.
FIG. 7 is a block diagram illustrating an electronic device in accordance with an example embodiment.
FIG. 8 is a block diagram illustrating a computer-readable medium in accordance with an example embodiment.
Detailed Description
Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The same reference numerals denote the same or similar parts in the drawings, and thus, a repetitive description thereof will be omitted.
Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a thorough understanding of embodiments of the disclosure. One skilled in the relevant art will recognize, however, that the subject matter of the present disclosure can be practiced without one or more of the specific details, or with other methods, components, devices, steps, and so forth. In other instances, well-known methods, devices, system implementations, or operations have not been shown or described in detail to avoid obscuring aspects of the disclosure.
The block diagrams shown in the figures are functional entities only and do not necessarily correspond to physically separate entities. I.e. these functional entities may be implemented in the form of software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor means and/or microcontroller means.
The flow charts shown in the drawings are merely illustrative and do not necessarily include all of the contents and operations/steps, nor do they necessarily have to be performed in the order described. For example, some operations/steps may be decomposed, and some operations/steps may be combined or partially combined, so that the actual execution sequence may be changed according to the actual situation.
It will be understood that, although the terms first, second, third, etc. may be used herein to describe various components, these components should not be limited by these terms. These terms are used to distinguish one element from another. Thus, a first component discussed below may be termed a second component without departing from the teachings of the disclosed concept. As used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items.
It is to be understood by those skilled in the art that the drawings are merely schematic representations of exemplary embodiments, and that the blocks or processes shown in the drawings are not necessarily required to practice the present disclosure and are, therefore, not intended to limit the scope of the present disclosure.
The technical abbreviations involved in the present disclosure are explained as follows:
big data: the IT industry term refers to a data set which cannot be captured, managed and processed by a conventional software tool within a certain time range, and is a massive, high-growth-rate and diversified information asset which needs a new processing mode to have stronger decision-making power, insight discovery power and process optimization capacity.
Platform integration: the platform set connection refers to a connection mode of a plurality of platforms according to the hierarchical relationship between an upper level and a lower level, the platforms forming the set connection relationship can carry out operations such as data interaction, command interaction and the like, and the platform set connection is divided into the upper level platform and the lower level platform and has a certain master-slave relationship.
Platform data interaction: platform data interaction in the IT industry refers to a way of sending data of the platform to other platforms among different platforms, and the sent data can be: asset information, system logs, work order information, attack information, traffic information, and the like.
Syslog: often referred to as a system log or system record, is a standard for communicating record messages over internet protocol (TCP/IP) networks. This vocabulary is often used to refer to the actual syslog protocol, or applications or databases that submit syslog messages.
Syslog protocol: belonging to a master-slave mode protocol, a syslog sending end sends a small text message (less than 1024 bytes) to a syslog receiving end. The system log message may be sent in the UDP protocol or the TCP protocol.
In view of various defects in the prior art, the present disclosure provides a data interaction method, device, and system based on platform cascade, which are mainly used to solve the problems of data loss, bandwidth utilization, and data transmission priority during data interaction between an upper platform and a lower platform. The following is a detailed description with the aid of specific examples.
FIG. 1 is a schematic diagram of a platform cascade-based data interaction system shown in accordance with an exemplary embodiment.
As shown in fig. 1, the system architecture 10 may include lower level platform devices 101, 102, 103, a network 104, and an upper level platform server 105. Network 104 is the medium used to provide communication links between lower level platform devices 101, 102, 103 and upper level platform server 105. Network 104 may include various connection types, such as wired, wireless communication links, or fiber optic cables, to name a few.
A user may use the lower level platform devices 101, 102, 103 to interact with the upper level platform server 105 over the network 104 to receive or send messages or the like. The lower platform devices 101, 102, 103 may have various communication client applications installed thereon, such as a shopping application, a web browser application, a search application, an instant messaging tool, a mailbox client, social platform software, and the like.
The lower platform devices 101, 102, 103 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smart phones, tablet computers, laptop portable computers, desktop computers, and the like.
The upper platform server 105 may be a server that provides various services, such as a background server that processes data provided by users using the lower platform devices 101, 102, 103. The background server can analyze and process the received data.
Before data processing, the lower platform device 101, 102, 103 may send heartbeat messages to the upper platform, for example, periodically; the lower level platform device 101, 102, 103 may determine status information of said upper level platform server 105, e.g. based on a return message of said heartbeat message; the lower platform devices 101, 102, and 103 may, for example, acquire the priority and the transmission number corresponding to the data to be transmitted and the data type when the status information is normal; the lower platform devices 101, 102, 103 may extract target data from the data to be transmitted, for example, according to the priority and the transmission number; the lower level platform devices 101, 102, 103 may for example send said target data to said upper level platform server 105;
upper level platform server 105 may, for example, obtain current bandwidth usage; upper level platform server 105 may generate current state information, for example, based on the bandwidth usage; the upper platform server 105 may receive, for example, when the status information is normal, a heartbeat message sent by the lower platform device 101 (or 102, 103); the upper level platform server 105 may for example send said status information as a return message of said heartbeat message to said lower level platform device 101 (or 102, 103); the upper level platform server 105 may, for example, turn on a data reception function to receive target data transmitted by the lower level platform device 101 (or 102, 103).
The lower platform devices 101, 102, and 103 and the upper platform server 105 may be a single entity server, and may also be composed of a plurality of servers, for example, it should be noted that the data interaction method based on platform cascade provided in the embodiment of the present disclosure may be executed by the upper platform server 105 and the lower platform devices 101, 102, and 103 together, and accordingly, the data interaction apparatus based on platform cascade may be disposed in the upper platform server 105 and the lower platform devices 101, 102, and 103.
FIG. 2 is a flow diagram illustrating a method for platform cascade-based data interaction in accordance with an exemplary embodiment. The data interaction method 20 based on platform cascade is applicable to a lower platform, and includes at least steps S202 to S210.
As shown in fig. 2, in S202, a heartbeat message is sent to the upper platform at regular intervals. A Heartbeat Message (Heartbeat Message) is a Message that a sending source sends to a recipient that allows the recipient to determine if and when the sending source has failed or terminated.
In S204, status information of the upper platform is determined based on a return message of the heartbeat message. Generally, heartbeat messages are sent from the time the sender is started until the sender is turned off, during which the sender sends messages periodically or repeatedly without interruption. When the recipient does not receive a message within a certain message reception period, the recipient may consider the sending source to have been shut down, to have failed, or to be currently unavailable.
In S206, when the status information is normal, the priority and the transmission number corresponding to the data to be transmitted and the data type are obtained. The information to be sent may be assigned a data category according to its type or attribute, for example, a system log alarm class message may be taken as one data category and defined to have a high priority, or, for example, a system log prompt message may be taken as one data category and defined to have a medium priority.
In one embodiment, further comprising: configuring the priority corresponding to the data type of the data to be sent; and configuring the sending quantity according to the instruction of the superior platform. Different priorities can be allocated to different types of data in advance, and the priorities of different types of data can be dynamically adjusted in real time, which is not limited by the disclosure.
The transmission number may be configured in advance according to the instruction, for example, the transmission number of data with high priority at each time is configured to be 5, the transmission data of data with medium priority is configured to be 3, and the like, and the number of transmission categories with each priority may be configured in advance, for example, the data types may correspond to 5 priorities in total, and only the data in the data category corresponding to the first 3 priorities is transmitted each time.
In one embodiment, further comprising: acquiring a configuration instruction by the superior platform; and adjusting the sending number according to the configuration instruction. The method can receive the instructions for increasing or decreasing the sending number sent by the superior platform in real time, and adjust the number of the sent data according to the instructions.
In S208, target data is extracted from the data to be transmitted according to the priority and the transmission number. The data to be transmitted may be 100 pieces of data with 5 priorities, the number of acquired preset priorities is 2, and the number of transmissions is 5. Then, the data corresponding to the first two priorities can be extracted from the data to be transmitted, and 5 pieces of data can be extracted from each type of data.
In S210, the target data is sent to the upper platform.
In one embodiment, further comprising: and when the state information is abnormal, stopping sending the target data.
According to the data interaction method based on the platform cascade, the heartbeat message is sent to the superior platform at regular time; determining state information of the superior platform based on a return message of the heartbeat message; when the state information is normal, acquiring the priority and the sending quantity corresponding to the data to be sent and the data type; extracting target data from the data to be sent according to the priority and the sending quantity; the mode of sending the target data to the superior platform can solve the problems of data loss, bandwidth utilization and data sending during data interaction between the superior platform and the subordinate platform, and optimize data transmission.
It should be clearly understood that this disclosure describes how to make and use particular examples, but the principles of this disclosure are not limited to any details of these examples. Rather, these principles can be applied to many other embodiments based on the teachings of the present disclosure.
FIG. 3 is a flowchart illustrating a method of platform cascade-based data interaction, according to another example embodiment. The process 30 shown in fig. 3 can be applied to an upper platform, and at least includes steps S302 to S310.
As shown in fig. 3, in S302, the current bandwidth usage is acquired. The network bandwidth utilization rate is as follows: bandwidth efficiency in receiving and sending information per second. The bandwidth allocation is to ensure the transmission of real-time services within a limited bandwidth, so that the phenomena of mosaic of video or discontinuity of audio due to network blocking caused by too large traffic are avoided.
In S304, current status information is generated according to the bandwidth utilization. Different usage thresholds may be set, for example, when the usage is less than 80%, the current state is determined to be a normal state, and when the usage is greater than 80%, the current state may be considered to be an abnormal state.
In S306, when the status information is normal, a heartbeat message sent by the lower platform is received. The semi-active, saturated and overload state threshold values of the bandwidth utilization rate can be configured, when the bandwidth utilization rate is in a semi-active state, the lower-level platform can be controlled to increase data transmission amount, when the bandwidth utilization rate is in a saturated state, processing is not performed, and when the bandwidth utilization rate is in an overload state, the lower-level platform can be controlled to reduce the data transmission amount;
in S308, the state information is sent to the lower platform as the return information of the heartbeat message. And returning the current state to the lower platform.
In S310, the data reception function is turned on to receive the target data transmitted by the lower platform. In one embodiment, further comprising: and when the state information is abnormal, closing the data receiving function.
In one embodiment, further comprising: when the state information is normal and semi-active, determining a target lower platform according to the priority of the lower platform and the data sending record of the lower platform; and sending a data increase instruction for the target lower-level platform. More specifically, the bandwidth utilization rate is in a semi-active state between 50% and 70%, when the bandwidth utilization rate is in the semi-active state, according to the priority of the lower platform and the record of the lower platform which has issued the data transmission increasing instruction, the unadjusted lower platform with the same priority or lower priority is found, and the data transmission increasing instruction is transmitted to the lower platform through the communication module;
in one embodiment, further comprising: when the state information is normal and overloaded, determining a target subordinate platform according to the priority of the subordinate platform and the data sending record of the subordinate platform; and sending a data reduction instruction for the target lower-level platform. More specifically, the bandwidth utilization rate is in an overload state between 70% and 80%, when the bandwidth utilization rate is in the overload state, according to the priority of the lower platform and the record of the lower platform which has issued the command for increasing data transmission, the unadjusted lower platform with the same priority or higher priority is found, and the command for reducing data transmission is transmitted to the lower platform through the communication module;
in one embodiment, further comprising: and configuring a priority for the lower platform. When one upper platform corresponds to a plurality of lower platforms, priorities can be allocated to different lower platforms.
FIG. 4 is a flowchart illustrating a method of platform cascade-based data interaction, according to another example embodiment. The flow 40 shown in fig. 4 is a detailed description of a data interaction process between an upper platform and a lower platform.
As shown in fig. 4, in S401, the lower stage is internally configured.
In S402, the upper platform performs internal configuration.
In S403, a heartbeat message is sent.
In S404, status information is returned.
In S405, target data is extracted.
In S406, it is sent to the upper stage platform.
In S407, the current state is monitored.
In S408, the data alignment is transmitted to the lower platform.
In S409, the configuration is adjusted according to the instruction.
The lower platform firstly reports the priority of data and other related configurations;
then, starting a communication module, sending heartbeat packets at regular time, and judging the state of a superior platform:
when the state of the upper platform is normal, starting data transmission, and according to the data priority, firstly transmitting data 3 before the priority;
if the state of the superior platform is abnormal, stopping data transmission, and transmitting after the state of the superior platform is normal;
the communication module can also monitor the instruction issued by the superior platform: if data transmission needs to be increased, transmitting the data with the corresponding number of priorities after the priorities are increased according to the priorities of the currently transmitted data and configuration; if the data transmission needs to be reduced, transmitting the data with the corresponding number of priorities after the priorities are reduced according to the priorities of the currently transmitted data and the configuration;
the superior platform firstly carries out the priority, bandwidth utilization rate threshold and other related configurations of the inferior platform, and starts data receiving;
then, starting a communication module and a bandwidth timing training detection module to detect the bandwidth state,
if the state is a semi-active state, finding unadjusted lower platforms with the same priority or lower priority according to the priority of the lower platforms and the record of the lower platforms which have issued the data transmission increasing instructions, and transmitting the data transmission increasing instructions to the lower platforms through the communication module;
if the state is an overload state, finding unadjusted subordinate platforms with the same priority or higher priority according to the subordinate platform priority and the subordinate platform record issued with the data transmission increasing instruction, and transmitting the data transmission decreasing instruction to the subordinate platforms through the communication module
If the state is a saturated state, no operation is performed.
According to the data interaction method based on platform cascade, the lower platform is enabled to preferentially send high-weight data by configuring the data weight of the lower platform; the lower platform ensures effective data receiving through the sending instruction of the upper platform; and the superior platform dynamically controls the data reporting action of the subordinate platform through the timing round training bandwidth.
According to the data interaction method based on platform cascade, the superior platform controls the data transmission of the subordinate platform, and data are ensured not to be lost; dynamic data transmission control is realized, and network bandwidth is better utilized; and flexible data transmission coordination is realized, so that data transmission is in sequence.
Those skilled in the art will appreciate that all or part of the steps to implement the above embodiments are implemented as a computer program executed by a CPU. When executed by the CPU, performs the functions defined by the above-described methods provided by the present disclosure. The program may be stored in a computer readable storage medium, which may be a read-only memory, a magnetic or optical disk, or the like.
Furthermore, it should be noted that the above-mentioned figures are only schematic illustrations of the processes involved in the methods according to exemplary embodiments of the present disclosure, and are not intended to be limiting. It will be readily understood that the processes shown in the above figures are not intended to indicate or limit the chronological order of the processes. In addition, it is also readily understood that these processes may be performed synchronously or asynchronously, e.g., in multiple modules.
The following are embodiments of the disclosed apparatus that may be used to perform embodiments of the disclosed methods. For details not disclosed in the embodiments of the apparatus of the present disclosure, refer to the embodiments of the method of the present disclosure.
FIG. 5 is a block diagram illustrating a platform cascade-based data interaction device in accordance with an exemplary embodiment. As shown in fig. 5, the data interaction apparatus 50 based on platform cascade may be applied to a lower platform, and includes: a heartbeat module 502, a status module 504, a normal module 506, a goal module 508, and a send module 510.
The heartbeat module 502 is configured to send a heartbeat message to a superior platform at regular time;
the status module 504 is configured to determine status information of the upper platform based on a return message of the heartbeat message;
the normal module 506 is configured to obtain the priority and the sending number corresponding to the data to be sent and the data type when the status information is normal;
the target module 508 is configured to extract target data from the data to be sent according to the priority and the sending number;
the sending module 510 is configured to send the target data to the upper platform.
FIG. 6 is a block diagram illustrating a platform cascade-based data interaction apparatus in accordance with another example embodiment. As shown in fig. 6, the data interaction device 60 based on platform cascade may be applied to an upper platform, and includes: a bandwidth module 602, an information module 604, a receiving module 606, a response module 608, and a start module 610.
The bandwidth module 602 is configured to obtain a current bandwidth utilization rate;
the information module 604 is configured to generate current state information according to the bandwidth utilization;
the receiving module 606 is configured to receive a heartbeat message sent by a lower platform when the state information is normal;
the response module 608 is configured to send the status information to the lower platform as a return information of the heartbeat message;
the enabling module 610 is configured to enable a data receiving function to receive target data sent by the lower platform.
According to the data interaction device based on the platform cascade connection, the heartbeat message is sent to the superior platform at regular time; determining state information of the superior platform based on a return message of the heartbeat message; when the state information is normal, acquiring the priority and the sending quantity corresponding to the data to be sent and the data type; extracting target data from the data to be sent according to the priority and the sending quantity; the mode of sending the target data to the superior platform can solve the problems of data loss, bandwidth utilization and data sending during data interaction between the superior platform and the subordinate platform, and optimize data transmission.
FIG. 7 is a block diagram illustrating an electronic device in accordance with an example embodiment.
An electronic device 700 according to this embodiment of the disclosure is described below with reference to fig. 7. The electronic device 700 shown in fig. 7 is only an example and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.
As shown in fig. 7, electronic device 700 is embodied in the form of a general purpose computing device. The components of the electronic device 700 may include, but are not limited to: at least one processing unit 710, at least one memory unit 720, a bus 730 that connects the various system components (including the memory unit 720 and the processing unit 710), a display unit 740, and the like.
Wherein the storage unit stores program code that can be executed by the processing unit 710 to cause the processing unit 710 to perform the steps according to various exemplary embodiments of the present disclosure described in this specification. For example, the processing unit 710 may perform the steps as shown in fig. 2, 3, 4.
The memory unit 720 may include readable media in the form of volatile memory units, such as a random access memory unit (RAM) 7201 and/or a cache memory unit 7202, and may further include a read only memory unit (ROM) 7203.
The memory unit 720 may also include a program/utility 7204 having a set (at least one) of program modules 7205, such program modules 7205 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may comprise an implementation of a network environment.
Bus 730 may be any representation of one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.
The electronic device 700 can also communicate with one or more external devices 700' (e.g., keyboard, pointing device, bluetooth device, etc.) such that a user can communicate with the devices with which the electronic device 700 interacts, and/or any device (e.g., router, modem, etc.) with which the electronic device 700 can communicate with one or more other computing devices. Such communication may occur via an input/output (I/O) interface 750. Also, the electronic device 700 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network such as the internet) via the network adapter 760. The network adapter 760 may communicate with other modules of the electronic device 700 via the bus 730. It should be appreciated that although not shown in the figures, other hardware and/or software modules may be used in conjunction with the electronic device 700, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.
Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein may be implemented by software, or by software in combination with necessary hardware. Therefore, as shown in fig. 8, the technical solution according to the embodiment of the present disclosure may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (which may be a CD-ROM, a usb disk, a removable hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which may be a personal computer, a server, or a network device, etc.) to execute the above method according to the embodiment of the present disclosure.
The software product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
The computer readable storage medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable storage medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a readable storage medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Program code for carrying out operations for the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).
The computer readable medium carries one or more programs which, when executed by a device, cause the computer readable medium to perform the functions of: sending the heartbeat message to a superior platform at regular time; determining state information of the superior platform based on a return message of the heartbeat message; when the state information is normal, acquiring the priority and the sending quantity corresponding to the data to be sent and the data type; extracting target data from the data to be sent according to the priority and the sending quantity; and sending the target data to the superior platform.
Those skilled in the art will appreciate that the modules described above may be distributed in the apparatus according to the description of the embodiments, or may be modified accordingly in one or more apparatuses unique from the embodiments. The modules of the above embodiments may be combined into one module, or further split into multiple sub-modules.
Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein may be implemented by software, or by software in combination with necessary hardware. Therefore, the technical solution according to the embodiments of the present disclosure may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (which may be a CD-ROM, a usb disk, a removable hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which may be a personal computer, a server, a mobile terminal, or a network device, etc.) to execute the method according to the embodiments of the present disclosure.
Exemplary embodiments of the present disclosure are specifically illustrated and described above. It is to be understood that the present disclosure is not limited to the precise arrangements, instrumentalities, or instrumentalities described herein; on the contrary, the disclosure is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims.

Claims (9)

1. A data interaction method based on platform cascade, which can be used for a lower-level platform, is characterized by comprising the following steps:
sending the heartbeat message to a superior platform at regular time;
determining state information of the superior platform based on a return message of the heartbeat message;
when the state information is normal, acquiring the priority and the sending quantity corresponding to the data to be sent and the data type;
extracting target data from the data to be sent according to the priority and the sending quantity;
sending the target data to the superior platform;
configuring the priority corresponding to the data type of the data to be sent;
configuring the sending quantity according to the instruction of the superior platform;
acquiring a configuration instruction by the superior platform;
and adjusting the sending number according to the configuration instruction.
2. The method of claim 1, further comprising:
and when the state information is abnormal, stopping sending the target data.
3. A data interaction method based on platform cascade, which can be used for an upper platform, is characterized by comprising the following steps:
acquiring the current bandwidth utilization rate;
generating current state information according to the bandwidth utilization rate;
when the state information is normal, receiving heartbeat messages sent by a lower-level platform;
sending the state information to the lower platform as the return information of the heartbeat message;
starting a data receiving function to receive target data transmitted by a lower platform; and
and the configuration instruction is sent to the lower platform so that the lower platform can adjust the sending quantity according to the configuration instruction.
4. The method of claim 3, further comprising:
and when the state information is abnormal, closing the data receiving function.
5. The method of claim 3, further comprising:
when the state information is normal and semi-active, determining a target lower platform according to the priority of the lower platform and the data sending record of the lower platform;
and sending a data adding configuration instruction for the target lower-level platform.
6. The method of claim 3, further comprising:
when the state information is normal and overloaded, determining a target lower platform according to the priority of the lower platform and the data sending record of the lower platform;
and sending a data reduction configuration instruction for the target lower-level platform.
7. A data interaction device based on platform cascade, which can be used for a lower platform, comprising:
the heartbeat module is used for sending heartbeat messages to a superior platform at regular time;
the state module is used for determining the state information of the superior platform based on the return message of the heartbeat message;
a normal module, configured to configure a priority corresponding to a data type of data to be sent, configure the sending number according to an instruction of the upper-level platform, adjust the sending number according to a configuration instruction obtained from the upper-level platform, and obtain the priority and the sending number corresponding to the data to be sent and the data type when the state information is normal;
the target module is used for extracting target data from the data to be sent according to the priority and the sending quantity;
and the sending module is used for sending the target data to the superior platform.
8. A data interaction device based on platform cascade, which can be used for an upper platform, is characterized by comprising:
the bandwidth module is used for acquiring the current bandwidth utilization rate;
the information module is used for generating current state information according to the bandwidth utilization rate;
the receiving module is used for receiving the heartbeat message sent by the lower platform when the state information is normal;
the response module is used for sending the state information to the lower platform as the return information of the heartbeat message;
and the starting module is used for sending the configuration instruction to the lower platform so that the lower platform can adjust the sending quantity according to the configuration instruction, and starting the data receiving function to receive the target data sent by the lower platform.
9. A data interaction system based on platform cascade is characterized by comprising:
the lower platform is used for sending the heartbeat message to the upper platform at regular time; determining state information of the superior platform based on a return message of the heartbeat message; when the state information is normal, acquiring the priority and the sending number corresponding to the data to be sent and the data type; extracting target data from the data to be sent according to the priority and the sending quantity; sending the target data to the superior platform; configuring the priority corresponding to the data type of the data to be sent; configuring the sending quantity according to the instruction of the superior platform; acquiring a configuration instruction by the superior platform; adjusting the sending number according to the configuration instruction;
the superior platform is used for acquiring the current bandwidth utilization rate; generating current state information according to the bandwidth utilization rate; when the state information is normal, receiving heartbeat messages sent by a lower platform, and sending the state information to the lower platform as return information of the heartbeat messages; a configuration instruction is sent to the lower platform so that the lower platform can adjust the sending quantity according to the configuration instruction, and a data receiving function is started to receive the target data sent by the lower platform.
CN202110168080.1A 2021-02-07 2021-02-07 Data interaction method, device and system Active CN112994934B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110168080.1A CN112994934B (en) 2021-02-07 2021-02-07 Data interaction method, device and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110168080.1A CN112994934B (en) 2021-02-07 2021-02-07 Data interaction method, device and system

Publications (2)

Publication Number Publication Date
CN112994934A CN112994934A (en) 2021-06-18
CN112994934B true CN112994934B (en) 2023-02-10

Family

ID=76348871

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110168080.1A Active CN112994934B (en) 2021-02-07 2021-02-07 Data interaction method, device and system

Country Status (1)

Country Link
CN (1) CN112994934B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113626519A (en) * 2021-07-07 2021-11-09 江苏云从曦和人工智能有限公司 Data cascade system

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102647314A (en) * 2012-05-16 2012-08-22 深圳市乐唯科技开发有限公司 Client side on-line state judgment method and system
CN107040415A (en) * 2017-04-06 2017-08-11 青岛海信宽带多媒体技术有限公司 A kind of terminal and data reporting method, server and data receiver method
CN107171885A (en) * 2017-03-31 2017-09-15 北京奇艺世纪科技有限公司 A kind of methods, devices and systems of detection service device running status
CN110445683A (en) * 2019-08-05 2019-11-12 深圳市大拿科技有限公司 Server, equipment, the method and system of monitoring server existing state
CN110875953A (en) * 2018-09-04 2020-03-10 中兴通讯股份有限公司 Overload control method, device, equipment and readable storage medium
CN111064639A (en) * 2019-12-19 2020-04-24 广东小天才科技有限公司 Service state announcement method, device, equipment and storage medium
CN111211936A (en) * 2019-12-27 2020-05-29 视联动力信息技术股份有限公司 Data processing method and device based on network state
CN112199174A (en) * 2020-09-30 2021-01-08 北京字节跳动网络技术有限公司 Message sending control method and device, electronic equipment and computer readable storage medium

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8949380B2 (en) * 2003-09-29 2015-02-03 Eqapez Foundation, L.L.C. Method and system for distributing images to client systems
WO2011160696A1 (en) * 2010-06-25 2011-12-29 Siemens Aktiengesellschaft Prioritized transfer of data telegrams
CN111935310A (en) * 2020-09-18 2020-11-13 翱捷科技(深圳)有限公司 Data reporting system and data reporting method applied to terminal of Internet of things

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102647314A (en) * 2012-05-16 2012-08-22 深圳市乐唯科技开发有限公司 Client side on-line state judgment method and system
CN107171885A (en) * 2017-03-31 2017-09-15 北京奇艺世纪科技有限公司 A kind of methods, devices and systems of detection service device running status
CN107040415A (en) * 2017-04-06 2017-08-11 青岛海信宽带多媒体技术有限公司 A kind of terminal and data reporting method, server and data receiver method
CN110875953A (en) * 2018-09-04 2020-03-10 中兴通讯股份有限公司 Overload control method, device, equipment and readable storage medium
CN110445683A (en) * 2019-08-05 2019-11-12 深圳市大拿科技有限公司 Server, equipment, the method and system of monitoring server existing state
CN111064639A (en) * 2019-12-19 2020-04-24 广东小天才科技有限公司 Service state announcement method, device, equipment and storage medium
CN111211936A (en) * 2019-12-27 2020-05-29 视联动力信息技术股份有限公司 Data processing method and device based on network state
CN112199174A (en) * 2020-09-30 2021-01-08 北京字节跳动网络技术有限公司 Message sending control method and device, electronic equipment and computer readable storage medium

Also Published As

Publication number Publication date
CN112994934A (en) 2021-06-18

Similar Documents

Publication Publication Date Title
US10210036B2 (en) Time series metric data modeling and prediction
US10891560B2 (en) Supervised learning system training using chatbot interaction
CN108173938B (en) Server load distribution method and device
CN111124819A (en) Method and device for monitoring full link
CN112020024B (en) Short message sending management method, system and electronic equipment
CN108427619B (en) Log management method and device, computing equipment and storage medium
CN113517985B (en) File data processing method and device, electronic equipment and computer readable medium
CN111954240A (en) Network fault processing method and device and electronic equipment
CN115277566B (en) Load balancing method and device for data access, computer equipment and medium
CN114911598A (en) Task scheduling method, device, equipment and storage medium
CN112994934B (en) Data interaction method, device and system
CN108011779A (en) The test method of Cloud Server task throughput under limited resources supplIes
CN113905091A (en) Method and device for processing access request
CN111885190A (en) Service request processing method and system
WO2024040794A1 (en) Abnormal traffic detection method and apparatus, electronic device, and storage medium
CN112260903B (en) Link monitoring method and device
CN114827157A (en) Cluster task processing method, device and system, electronic equipment and readable medium
CN112152915A (en) Message forwarding network system and message forwarding method
CN113761433A (en) Service processing method and device
CN115277506B (en) Load balancing equipment testing method and system
CN113079055A (en) Method and device for dynamically acquiring AGV (automatic guided vehicle) running data
CN113691462B (en) Response method and device of Internet group management protocol
CN115277477B (en) Flow detection method and device based on simple object access protocol
CN113141403B (en) Log transmission method and device
CN108234665B (en) Jump processing method and equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant