CN113839892A - Stream data transmission control system and method thereof - Google Patents
Stream data transmission control system and method thereof Download PDFInfo
- Publication number
- CN113839892A CN113839892A CN202111427322.0A CN202111427322A CN113839892A CN 113839892 A CN113839892 A CN 113839892A CN 202111427322 A CN202111427322 A CN 202111427322A CN 113839892 A CN113839892 A CN 113839892A
- Authority
- CN
- China
- Prior art keywords
- transmission
- stream data
- priority
- waiting
- data set
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/24—Traffic characterised by specific attributes, e.g. priority or QoS
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/24—Traffic characterised by specific attributes, e.g. priority or QoS
- H04L47/2441—Traffic characterised by specific attributes, e.g. priority or QoS relying on flow classification, e.g. using integrated services [IntServ]
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The embodiment of the invention relates to the technical field of data transmission control, and particularly discloses a stream data transmission control system and a stream data transmission control method. The embodiment of the invention divides a plurality of stream data into a priority stream data set and a waiting stream data set by analyzing the transmission addresses; cutting off the priority stream data set to generate a plurality of stream data segments, arranging the priority, and preferentially transmitting the stream data segments with high priority; and when the real-time transmission rate is lower than the preset regulation transmission rate, starting the data transmission of the waiting transmission channel. The method can divide the stream data into a priority stream data set and a waiting stream data set according to the transmission address of the stream data, perform truncation processing and priority ranking on the priority stream data set, preferentially transmit a stream data section with high priority in the priority stream data set, and transmit the waiting stream data set when the transmission rate of the priority stream data set is low, thereby realizing the sequencing transmission of the stream data, avoiding the situation of data transmission congestion and ensuring the rapid transmission of important data.
Description
Technical Field
The invention belongs to the technical field of data transmission control, and particularly relates to a stream data transmission control system and a stream data transmission control method.
Background
Stream data is a set of sequential, large, fast, continuous arriving data sequences, which can be generally viewed as a dynamic collection of data that grows indefinitely over time. The method is applied to the fields of network monitoring, sensor networks, aerospace, meteorological measurement and control, financial services and the like.
In the intelligent processing process, machines are adopted to replace workers to work in many links, so that more stream data can be generated to transmit processing information. For the stream data transmission control of intelligent processing, the existing technology generally transmits a large amount of stream data which arrives in an unordered and continuous manner directly, and does not transmit and sequence the stream data, because the data transmission rate is limited, the situation of data transmission congestion is easy to occur, so that important data cannot be transmitted quickly.
Disclosure of Invention
Embodiments of the present invention provide a system and a method for controlling streaming data transmission, which are used to solve the problems in the background art.
In order to achieve the above purpose, the embodiments of the present invention provide the following technical solutions:
a stream data transmission control method specifically comprises the following steps:
acquiring a plurality of stream data in real time;
analyzing transmission addresses of the plurality of streaming data, and dividing the plurality of streaming data into a priority streaming data set and a waiting streaming data set;
switching the priority flow data set to a priority transmission channel and switching the waiting flow data set to a waiting transmission channel;
cutting off the priority stream data set in the priority transmission channel to generate a plurality of stream data segments, and carrying out priority arrangement according to the working state to preferentially transmit the stream data segments with high priority;
and acquiring the real-time transmission rate of the priority transmission channel, and starting the data transmission of the waiting transmission channel when the real-time transmission rate is lower than the preset regulation transmission rate.
As a further limitation of the technical solution of the embodiment of the present invention, the analyzing the transmission addresses of the plurality of pieces of stream data, and dividing the plurality of pieces of stream data into a priority stream data set and a waiting stream data set specifically includes the following steps:
performing transmission analysis on the plurality of stream data to obtain transmission addresses corresponding to the plurality of stream data respectively;
carrying out priority sequencing on the transmission addresses to obtain the priority levels corresponding to the transmission addresses;
dividing the plurality of stream data into a priority stream data set and a waiting stream data set according to the priority level.
As a further limitation of the technical solution of the embodiment of the present invention, the dividing the plurality of stream data into a priority stream data set and a waiting stream data set according to the priority level specifically includes the following steps:
performing classification marking on the plurality of streaming data according to the priority levels, wherein the classification marking comprises a priority marking and a waiting marking;
dividing a plurality of stream data having priority marks into priority stream data sets;
the plurality of stream data with the wait flag is divided into a wait stream data set.
As a further limitation of the technical solution of the embodiment of the present invention, the intercepting processing is performed on the priority stream data set in the priority transmission channel to generate a plurality of stream data segments, and the stream data segments are prioritized according to the operating state, where the stream data segment with a high priority for transmission specifically includes the following steps:
cutting off the priority stream data set to generate a plurality of stream data segments;
matching a priority model according to the working state;
according to the priority arrangement model, carrying out priority arrangement on the plurality of stream data segments to obtain the transmission grades corresponding to the plurality of stream data segments;
and transmitting a plurality of stream data segments in the priority transmission channel according to the transmission grade.
As a further limitation of the technical solution of the embodiment of the present invention, the intercepting a priority stream data set to generate a plurality of stream data segments specifically includes the following steps:
according to the transmission address, acquiring truncation factors of a plurality of stream data in the priority stream data set;
and truncating the plurality of stream data according to the corresponding truncation factors to generate a plurality of stream data segments.
As a further limitation of the technical solution of the embodiment of the present invention, the acquiring the real-time transmission rate of the priority transmission channel, and starting the data transmission of the waiting transmission channel when the real-time transmission rate is lower than the preset regulation transmission rate specifically includes the following steps:
acquiring the real-time transmission rate of the priority transmission channel;
judging whether the real-time transmission rate is lower than a preset regulation transmission rate or not;
if the real-time transmission rate is lower than a preset regulation transmission rate, starting data transmission of the waiting transmission channel;
and if the real-time transmission rate is not lower than the preset regulation transmission rate, closing the data transmission of the waiting transmission channel.
As a further limitation of the technical solution of the embodiment of the present invention, the data transmission for opening the transmission waiting channel specifically includes the following steps:
calculating a synchronous transmission rate according to the real-time transmission rate and a preset standard transmission rate;
and starting the data transmission of the waiting transmission channel according to the synchronous transmission rate.
A stream data transmission control system comprising a stream data acquisition unit, a data division unit, a data set transfer-in unit, a truncation arrangement unit, and a data transmission unit, wherein:
a stream data acquisition unit for acquiring a plurality of stream data in real time;
the data dividing unit is used for analyzing the transmission addresses of the plurality of streaming data and dividing the plurality of streaming data into a priority streaming data set and a waiting streaming data set;
a data set transfer unit for transferring the priority flow data set to a priority transmission channel and transferring the waiting flow data set to a waiting transmission channel;
the arrangement transmission unit is used for carrying out truncation processing on the priority stream data set in the priority transmission channel to generate a plurality of stream data segments, carrying out priority arrangement according to the working state and preferentially transmitting the stream data segments with high priority;
and the data transmission unit is used for acquiring the real-time transmission rate of the priority transmission channel and starting the data transmission of the waiting transmission channel when the real-time transmission rate is lower than the preset regulation transmission rate.
As a further limitation of the technical solution of the embodiment of the present invention, the data dividing unit specifically includes:
the transmission analysis module is used for carrying out transmission analysis on the plurality of stream data to obtain transmission addresses corresponding to the plurality of stream data respectively;
the priority ordering module is used for carrying out priority ordering on the transmission addresses to obtain the priority levels corresponding to the transmission addresses;
and the data dividing module is used for dividing the plurality of stream data into a priority stream data set and a waiting stream data set according to the priority level.
As a further limitation of the technical solution of the embodiment of the present invention, the data transmission unit specifically includes:
the rate acquisition module is used for acquiring the real-time transmission rate of the priority transmission channel;
the speed comparison module is used for judging whether the real-time transmission speed is lower than a preset regulation transmission speed or not;
the waiting starting module is used for starting data transmission of the waiting transmission channel if the real-time transmission rate is lower than a preset adjusting transmission rate;
and the waiting closing module is used for closing the data transmission of the waiting transmission channel if the real-time transmission rate is not lower than the preset transmission rate.
Compared with the prior art, the invention has the beneficial effects that:
the embodiment of the invention divides a plurality of stream data into a priority stream data set and a waiting stream data set by analyzing the transmission addresses; cutting off the priority stream data set to generate a plurality of stream data segments, arranging the priority, and preferentially transmitting the stream data segments with high priority; and when the real-time transmission rate is lower than the preset regulation transmission rate, starting the data transmission of the waiting transmission channel. The method can divide the stream data into a priority stream data set and a waiting stream data set according to the transmission address of the stream data, perform truncation processing and priority ranking on the priority stream data set, preferentially transmit a stream data section with high priority in the priority stream data set, and transmit the waiting stream data set when the transmission rate of the priority stream data set is low, thereby realizing the sequencing transmission of the stream data, avoiding the situation of data transmission congestion and ensuring the rapid transmission of important data.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention.
Fig. 1 shows a flow chart of a method provided by an embodiment of the invention.
Fig. 2 is a flowchart illustrating a transport address analysis in the method according to the embodiment of the present invention.
Fig. 3 shows a flowchart of stream data partitioning in the method provided by the embodiment of the present invention.
Fig. 4 shows a flowchart of the transmission of the interception processing in the method provided by the embodiment of the present invention.
Fig. 5 shows a flowchart of data truncation processing in the method provided by the embodiment of the present invention.
Fig. 6 shows a flowchart of waiting for the transmission channel to open and determine in the method according to the embodiment of the present invention.
Fig. 7 shows a flowchart of waiting for transmission channel data transmission in the method according to the embodiment of the present invention.
Fig. 8 shows an application architecture diagram of a system provided by an embodiment of the invention.
Fig. 9 shows a block diagram of a data partitioning unit in the system according to the embodiment of the present invention.
Fig. 10 is a block diagram illustrating a structure of a data transmission unit in the system according to the embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
It can be understood that, in the prior art, for the stream data transmission control of intelligent processing, a large amount of stream data arriving out of order and continuously are generally transmitted directly, and the stream data is not subjected to transmission sequencing, because the data transmission rate is limited, the situation of data transmission congestion is easy to occur, so that important data cannot be transmitted quickly.
In order to solve the above problem, the embodiment of the present invention performs transport address analysis on a plurality of stream data, and divides the stream data into a priority stream data set and a waiting stream data set; cutting off the priority stream data set to generate a plurality of stream data segments, arranging the priority, and preferentially transmitting the stream data segments with high priority; and when the real-time transmission rate is lower than the preset regulation transmission rate, starting the data transmission of the waiting transmission channel. The method can divide the stream data into a priority stream data set and a waiting stream data set according to the transmission address of the stream data, perform truncation processing and priority ranking on the priority stream data set, preferentially transmit a stream data section with high priority in the priority stream data set, and transmit the waiting stream data set when the transmission rate of the priority stream data set is low, thereby realizing the sequencing transmission of the stream data, avoiding the situation of data transmission congestion and ensuring the rapid transmission of important data.
Fig. 1 shows a flow chart of a method provided by an embodiment of the invention.
Specifically, a method for controlling streaming data transmission includes the following steps:
step S101, a plurality of stream data are acquired in real time.
In the embodiment of the invention, in the intelligent processing process, a plurality of stream data of the processing environment, the processing process and the detection process are acquired in real time.
It can be understood that, in the intelligent processing process, the real-time monitoring is needed for the processing environment, the real-time monitoring is needed for the working states of a plurality of processing devices in the production workshop, and the quality detection is needed for the processed products, so that in the intelligent processing process, the whole production workshop can generate a large amount of disordered and continuously arriving stream data, the important levels of the stream data are different, and for the obtained large amount of stream data, if disordered transmission is carried out by the stream data, the condition of data transmission congestion is easily caused, and the important data cannot be rapidly transmitted.
Step S102, carrying out transmission address analysis on the plurality of stream data, and dividing the plurality of stream data into a priority stream data set and a waiting stream data set.
In the embodiment of the invention, the transmission address corresponding to each stream data is obtained by analyzing the transmission address of the stream data, the stream data is subjected to priority classification according to the priority level of the transmission address, and a plurality of stream data are classified into a priority stream data set and a waiting stream data set. For example: in the intelligent processing process of the camera module, the streaming data sent by the environment monitoring equipment, the processing equipment state monitoring equipment and the quality detection equipment is divided into a priority streaming data set, and the streaming data sent by the piece counting equipment and the information backup equipment is divided into a waiting streaming data set.
Specifically, fig. 2 shows a flowchart of transport address analysis in the method provided by the embodiment of the present invention.
In a preferred embodiment provided by the present invention, the analyzing the transport addresses of the plurality of pieces of stream data, and dividing the plurality of pieces of stream data into a priority stream data set and a waiting stream data set specifically includes the following steps:
step S1021, performing transmission analysis on the plurality of stream data, and acquiring transmission addresses corresponding to the plurality of stream data.
In the embodiment of the invention, a plurality of log files of stream data are obtained, and transmission addresses corresponding to the stream data are obtained according to the log files of the stream data. The transmission address may be data of a number, a model, etc. of the device generating the corresponding stream data.
Step S1022, perform priority ranking on the multiple transport addresses, and obtain priority levels corresponding to the multiple transport addresses.
In the embodiment of the invention, the priority ranking is carried out on the plurality of transmission addresses, and the priority corresponding to each transmission address is obtained. For example: in the intelligent quality inspection process of the camera module, the priority level of the quality detection equipment is higher than that of the processing equipment state monitoring equipment, the priority level of the processing equipment state monitoring equipment is higher than that of the environment monitoring equipment, the priority level of the environment monitoring equipment is higher than that of the piece counting equipment, and the priority level of the piece counting equipment is higher than that of the information backup equipment.
Step S1023, dividing the plurality of stream data into a priority stream data set and a waiting stream data set according to the priority level.
In the embodiment of the present invention, the stream data is prioritized according to the priority of the transport address, and the plurality of stream data is divided into the priority stream data set and the waiting stream data set.
Specifically, fig. 3 shows a flowchart of stream data partitioning in the method provided by the embodiment of the present invention.
In a preferred embodiment of the present invention, the dividing the plurality of stream data into a priority stream data set and a waiting stream data set according to the priority level specifically includes the following steps:
step S10231, performing classification marking on the plurality of pieces of streaming data according to the priority levels, wherein the classification marking includes a priority marking and a waiting marking.
In the embodiment of the invention, the stream data is subjected to priority sequencing according to the priority of the transmission address, the plurality of stream data are divided into two types according to the priority sequencing result of the plurality of stream data, and the two types of stream data are classified and marked, specifically comprising a priority mark and a waiting mark.
In step S10232, the plurality of pieces of stream data having priority flags are divided into priority stream data sets.
In step S10233, the plurality of pieces of stream data having the waiting flag are divided into waiting stream data sets.
In the embodiment of the present invention, a plurality of pieces of stream data marked with priority marks are divided into a set of priority stream data, and a plurality of pieces of stream data marked with waiting marks are divided into a set of waiting stream data.
Further, the streaming data transmission control method further includes the steps of:
and step S103, transferring the priority stream data set to a priority transmission channel, and transferring the waiting stream data set to a waiting transmission channel.
In the embodiment of the invention, the priority of the priority flow data set is higher than that of the waiting flow data set, the priority flow data set is switched to the priority transmission channel for priority transmission, and the waiting flow data set is switched to the waiting transmission channel for waiting transmission.
And step S104, carrying out truncation processing on the priority stream data set in the priority transmission channel to generate a plurality of stream data segments, carrying out priority arrangement according to the working state, and preferentially transmitting the stream data segments with high priority.
In the embodiment of the present invention, for a plurality of pieces of stream data in a priority stream data set, the plurality of pieces of stream data have different priority levels in different production processing states, the plurality of pieces of stream data in the priority stream data set are cut off to generate a plurality of pieces of stream data, the plurality of pieces of stream data are prioritized according to the production processing states, and the pieces of stream data having a higher priority level are preferentially transmitted in a priority transmission channel.
It will be appreciated that in an intelligent process, there are different levels of priority delivery at different stages of the production process for a plurality of stream data that need to be delivered quickly. For example: in the intelligent quality inspection process of the camera module, the environment monitoring flow data, the processing equipment state monitoring flow data and the quality detection flow data are all flow data with concentrated priority flow data, but in order to quickly check the quality inspection result of the camera module, the priority of the quality detection flow data in the priority flow data set is higher than that of the processing equipment state monitoring flow data, and the priority of the processing equipment state monitoring flow data is higher than that of the environment monitoring flow data.
Specifically, fig. 4 shows a flowchart of the transmission of the truncation process in the method provided by the embodiment of the present invention.
In a preferred embodiment of the present invention, the intercepting processing is performed on the priority stream data set in the priority transmission channel to generate a plurality of stream data segments, and the stream data segments are prioritized according to an operating state, where the preferentially transmitting the stream data segment with a high priority specifically includes the following steps:
in step S1041, a priority stream data set is truncated to generate a plurality of stream data segments.
In the embodiment of the invention, as the stream data is continuously arriving data, the plurality of stream data in the priority stream data set are cut off to generate a plurality of stream data segments, so that the stream data segments of different stream data can be conveniently transmitted according to the priority transmission level of the stream data segments.
Specifically, fig. 5 shows a flowchart of data truncation processing in the method provided by the embodiment of the present invention.
In a preferred embodiment of the present invention, the generating the plurality of stream data segments by truncating the priority stream data set specifically includes the following steps:
step S10411, obtaining truncation factors of the plurality of stream data in the priority stream data set according to the transmission address.
In the embodiment of the invention, the truncation factors of a plurality of stream data in the priority stream data set are obtained according to the transmission addresses of the stream data. For example: in the intelligent course of working at the camera module, the truncation factor of environmental monitoring streaming data can be time, and the truncation factor of processing equipment state monitoring streaming data can be time, and the truncation factor of quality testing streaming data can be the piece number.
Step S10412, truncating the plurality of stream data according to the corresponding truncation factor, and generating a plurality of stream data segments.
In the embodiment of the invention, the stream data is subjected to truncation processing according to the truncation factor corresponding to each stream data, and a plurality of stream data segments are generated. For example: in the intelligent course of working of camera module, cut off quality testing stream data into a plurality of quality testing stream data sections according to the number of pieces.
Further, the intercepting processing is performed on the priority stream data set in the priority transmission channel to generate a plurality of stream data segments, and the stream data segments are prioritized according to the working state, and the preferentially transmitting the stream data segments with high priority further includes the following steps:
and step S1042, matching the priority model according to the working state.
In the embodiment of the invention, the priority levels of the flow data in the priority flow data set are different for different production and processing stages, and the priority ranking model is matched according to the current working state.
And step S1043, performing priority arrangement on the plurality of stream data segments according to the priority arrangement model, and acquiring transmission grades corresponding to the plurality of stream data segments.
In the embodiment of the invention, according to the priority arrangement model, a plurality of stream data segments in the current working state are subjected to priority arrangement to generate the transmission grade of the stream data segments. For example: in the intelligent course of working of camera module, the transmission grade of processing equipment state monitoring stream data section is higher than environment monitoring stream data section, and the transmission grade of environment monitoring stream data section is higher than quality control stream data section.
Step S1044 is to transmit the plurality of stream data segments in the priority transmission channel according to the transmission rank.
In the embodiment of the invention, the data transmission is carried out on the plurality of stream data segments in the priority transmission channel according to the transmission rank arrangement of the plurality of stream data segments.
Further, the streaming data transmission control method further includes the steps of:
step S105, acquiring the real-time transmission rate of the priority transmission channel, and starting the data transmission of the waiting transmission channel when the real-time transmission rate is lower than the preset regulation transmission rate.
In the embodiment of the invention, when the priority transmission channel transmits the priority stream data set, the real-time transmission rate of the priority transmission channel is obtained, the real-time transmission rate is compared with the preset regulation transmission rate, and when the real-time transmission rate is lower than the preset regulation transmission rate, the waiting transmission channel transmits the waiting stream data set.
It is understood that in the intelligent processing process, the data transmission rate is limited, and in order to avoid the accumulation of the waiting stream data set, the waiting stream data set can be transmitted in the waiting transmission channel while the priority transmission channel is idle. For example: in the intelligent course of working at the camera module, at the in-process of changing the processing product, each equipment of processing and monitoring all keeps standby state, can transmit backup stream data and meter piece stream data this moment.
Specifically, fig. 6 shows a flowchart of waiting for the transmission channel to open and determine in the method provided in the embodiment of the present invention.
In an embodiment of the present invention, the acquiring the real-time transmission rate of the priority transmission channel, and starting the data transmission of the waiting transmission channel when the real-time transmission rate is lower than a preset adjustment transmission rate specifically includes the following steps:
step S1051, acquiring the real-time transmission rate of the priority transmission channel.
In the embodiment of the invention, the transmission rate of the priority transmission channel is monitored in real time, and the real-time transmission rate of the priority transmission channel is obtained.
Step S1052, determining whether the real-time transmission rate is lower than a preset adjusted transmission rate.
In the embodiment of the invention, the real-time transmission rate is compared with the preset regulation transmission rate, and whether the real-time transmission rate is lower than the regulation transmission rate is judged.
Step S1053, if the real-time transmission rate is lower than the preset regulation transmission rate, the data transmission of the waiting transmission channel is started.
In the embodiment of the present invention, when the real-time transmission rate is lower than the preset adjustment transmission rate, it indicates that the priority stream data set is less, and at this time, the waiting transmission channel is started to transmit the waiting stream data set.
Specifically, fig. 7 shows a flowchart of waiting for transmission channel data transmission in the method according to the embodiment of the present invention.
In an embodiment of the present invention, the data transmission for starting the waiting transmission channel specifically includes the following steps:
step S10531, calculating a synchronous transmission rate according to the real-time transmission rate and a preset standard transmission rate.
In the embodiment of the invention, a = a1-a2, where a is the synchronous transmission rate, a1 is the standard transmission rate, and a2 is the real-time transmission rate.
Step S10532, starting the data transmission of the waiting transmission channel according to the synchronous transmission rate.
In the embodiment of the invention, data transmission is carried out on the waiting stream data set in the peer-to-peer transmission channel according to the synchronous transmission rate.
Further, the step of obtaining the real-time transmission rate of the priority transmission channel and starting the data transmission of the waiting transmission channel when the real-time transmission rate is lower than a preset regulation transmission rate further comprises the following steps:
step S1054, if the real-time transmission rate is not lower than the preset regulation transmission rate, closing the data transmission of the waiting transmission channel.
In the embodiment of the invention, when the real-time transmission rate is not lower than the preset regulation transmission rate, the priority stream data set is more, and the data transmission of the waiting transmission channel is closed, so that the condition that the data transmission of the priority stream data set is congested is avoided.
Further, fig. 8 is a diagram illustrating an application architecture of the system according to the embodiment of the present invention.
In another preferred embodiment, the present invention provides a stream data transmission control system, including:
a stream data acquisition unit 101 for acquiring a plurality of stream data in real time.
In the embodiment of the present invention, in the intelligent processing, the stream data acquisition unit 101 acquires a plurality of stream data of the processing environment, the processing, and the detection in real time.
A data dividing unit 102, configured to perform transport address analysis on the plurality of stream data, and divide the plurality of stream data into a priority stream data set and a waiting stream data set.
In this embodiment of the present invention, the data dividing unit 102 analyzes the transmission address of the stream data to obtain the transmission address corresponding to each stream data, performs priority division on the stream data according to the priority level of the transmission address, and divides a plurality of stream data into a priority stream data set and a waiting stream data set.
Specifically, fig. 9 shows a block diagram of a structure of the data dividing unit 102 in the system according to the embodiment of the present invention.
In a preferred embodiment provided by the present invention, the data dividing unit 102 specifically includes:
a transmission analysis module 1021, configured to perform transmission analysis on the multiple pieces of stream data, and obtain transmission addresses corresponding to the multiple pieces of stream data.
In this embodiment of the present invention, the transmission analysis module 1021 obtains log files of a plurality of stream data, and obtains transmission addresses corresponding to the plurality of stream data according to the log files of the stream data. The transmission address may be data of a number, a model, etc. of the device generating the corresponding stream data.
The prioritizing module 1022 is configured to prioritize the multiple transmission addresses, and obtain priority levels corresponding to the multiple transmission addresses.
In this embodiment of the present invention, the prioritization module 1022 prioritizes the multiple transmission addresses, and obtains the priority corresponding to each transmission address.
A data dividing module 1023, configured to divide the plurality of stream data into a priority stream data set and a waiting stream data set according to the priority level.
In the embodiment of the present invention, the data dividing module 1023 prioritizes the stream data according to the priority of the transmission address, and divides the plurality of stream data into a priority stream data set and a waiting stream data set.
Further, the stream data transmission control system further includes:
a data set transfer unit 103, configured to transfer the priority stream data set to a priority transmission channel, and transfer the waiting stream data set to a waiting transmission channel.
In the embodiment of the present invention, the priority of the priority stream data set is higher than that of the waiting stream data set, and the data set forwarding unit 103 forwards the priority stream data set to the priority transmission channel for priority transmission and forwards the waiting stream data set to the waiting transmission channel for waiting transmission.
The arrangement transmission unit 104 is configured to perform truncation processing on the priority stream data set in the priority transmission channel to generate a plurality of stream data segments, perform priority arrangement according to the operating state, and preferentially transmit the stream data segment with a high priority.
In the embodiment of the present invention, the plurality of pieces of stream data in the priority stream data set have different priority levels in different production processing states, the arranging and transmitting unit 104 performs a truncation process on the plurality of pieces of stream data in the priority stream data set to generate a plurality of pieces of stream data, and performs a priority arrangement on the plurality of pieces of stream data according to the production processing states to preferentially transmit the pieces of stream data having a high priority level in the priority transmission channel.
And the data transmission unit 105 is configured to acquire a real-time transmission rate of the priority transmission channel, and start data transmission of the waiting transmission channel when the real-time transmission rate is lower than a preset adjustment transmission rate.
In the embodiment of the present invention, when the priority transmission channel transmits the priority stream data set, the data transmission unit 105 obtains the real-time transmission rate of the priority transmission channel, compares the real-time transmission rate with the preset adjustment transmission rate, and when the real-time transmission rate is lower than the preset adjustment transmission rate, waits for the transmission channel to transmit the waiting stream data set.
Specifically, fig. 10 shows a block diagram of a data transmission unit 105 in the system according to the embodiment of the present invention.
In a preferred embodiment provided by the present invention, the data transmission unit 105 specifically includes:
a rate obtaining module 1051, configured to obtain a real-time transmission rate of the priority transmission channel.
In the embodiment of the present invention, the rate obtaining module 1051 performs real-time monitoring on the transmission rate of the priority transmission channel, and obtains the real-time transmission rate of the priority transmission channel.
A rate comparing module 1052, configured to determine whether the real-time transmission rate is lower than a preset adjusted transmission rate.
In the embodiment of the present invention, the rate comparing module 1052 compares the real-time transmission rate with a preset adjusted transmission rate to determine whether the real-time transmission rate is lower than the adjusted transmission rate.
A wait starting module 1053, configured to start data transmission of the wait transmission channel if the real-time transmission rate is lower than a preset adjustment transmission rate.
In the embodiment of the present invention, when the real-time transmission rate is lower than the preset adjustment transmission rate, it indicates that the priority stream data set is less, and at this time, the waiting-to-start module 1053 starts the waiting transmission channel to transmit the waiting stream data set.
A wait closing module 1054, configured to close the data transmission of the wait transmission channel if the real-time transmission rate is not lower than a preset adjusted transmission rate.
In the embodiment of the present invention, when the real-time transmission rate is not lower than the preset adjustment transmission rate, it indicates that there are more priority stream data sets, and at this time, the wait closing module 1054 closes the data transmission of the wait transmission channel, so as to avoid a congestion situation in the data transmission of the priority stream data sets.
In summary, the embodiment of the present invention can divide the stream data into the priority stream data set and the waiting stream data set according to the transmission address of the stream data, perform truncation processing and priority ranking on the priority stream data set, preferentially transmit the stream data segment with a high priority in the priority stream data set, and transmit the waiting stream data set when the transmission rate of the priority stream data set is low, thereby implementing the sequenced transmission of the stream data, avoiding the occurrence of data transmission congestion, and ensuring the fast transmission of important data.
It should be understood that, although the steps in the flowcharts of the embodiments of the present invention are shown in sequence as indicated by the arrows, the steps are not necessarily performed in sequence as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least a portion of the steps in various embodiments may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performance of the sub-steps or stages is not necessarily sequential, but may be performed in turn or alternately with other steps or at least a portion of the sub-steps or stages of other steps.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a non-volatile computer-readable storage medium, and can include the processes of the embodiments of the methods described above when the program is executed. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents and improvements made within the spirit and principle of the present invention are intended to be included within the scope of the present invention.
Claims (10)
1. A stream data transmission control method is characterized by specifically comprising the following steps:
acquiring a plurality of stream data in real time;
analyzing transmission addresses of the plurality of streaming data, and dividing the plurality of streaming data into a priority streaming data set and a waiting streaming data set;
switching the priority flow data set to a priority transmission channel and switching the waiting flow data set to a waiting transmission channel;
cutting off the priority stream data set in the priority transmission channel to generate a plurality of stream data segments, and carrying out priority arrangement according to the working state to preferentially transmit the stream data segments with high priority;
and acquiring the real-time transmission rate of the priority transmission channel, and starting the data transmission of the waiting transmission channel when the real-time transmission rate is lower than the preset regulation transmission rate.
2. The method for controlling stream data transmission according to claim 1, wherein the analyzing the transmission addresses of the plurality of stream data, and the dividing the plurality of stream data into a priority stream data set and a waiting stream data set specifically includes the steps of:
performing transmission analysis on the plurality of stream data to obtain transmission addresses corresponding to the plurality of stream data respectively;
carrying out priority sequencing on the transmission addresses to obtain the priority levels corresponding to the transmission addresses;
dividing the plurality of stream data into a priority stream data set and a waiting stream data set according to the priority level.
3. The method for controlling streaming data transmission according to claim 2, wherein the dividing of the plurality of streaming data into a priority streaming data set and a waiting streaming data set according to the priority level specifically comprises the steps of:
performing classification marking on the plurality of streaming data according to the priority levels, wherein the classification marking comprises a priority marking and a waiting marking;
dividing a plurality of stream data having priority marks into priority stream data sets;
the plurality of stream data with the wait flag is divided into a wait stream data set.
4. The method for controlling stream data transmission according to claim 2, wherein the step of performing truncation processing on the priority stream data set in the priority transmission channel to generate a plurality of stream data segments and performing priority ranking according to the operating status includes the following steps:
cutting off the priority stream data set to generate a plurality of stream data segments;
matching a priority model according to the working state;
according to the priority arrangement model, carrying out priority arrangement on the plurality of stream data segments to obtain the transmission grades corresponding to the plurality of stream data segments;
and transmitting a plurality of stream data segments in the priority transmission channel according to the transmission grade.
5. The method for controlling streaming data transmission according to claim 4, wherein the step of truncating the priority streaming data set to generate the plurality of streaming data segments specifically comprises the steps of:
according to the transmission address, acquiring truncation factors of a plurality of stream data in the priority stream data set;
and truncating the plurality of stream data according to the corresponding truncation factors to generate a plurality of stream data segments.
6. The method for controlling streaming data transmission according to claim 1, wherein the step of acquiring the real-time transmission rate of the priority transmission channel and starting the data transmission of the waiting transmission channel when the real-time transmission rate is lower than a preset regulation transmission rate specifically comprises the following steps:
acquiring the real-time transmission rate of the priority transmission channel;
judging whether the real-time transmission rate is lower than a preset regulation transmission rate or not;
if the real-time transmission rate is lower than a preset regulation transmission rate, starting data transmission of the waiting transmission channel;
and if the real-time transmission rate is not lower than the preset regulation transmission rate, closing the data transmission of the waiting transmission channel.
7. The method for controlling streaming data transmission according to claim 6, wherein the step of turning on the data transmission of the waiting transmission channel specifically comprises the steps of:
calculating a synchronous transmission rate according to the real-time transmission rate and a preset standard transmission rate;
and starting the data transmission of the waiting transmission channel according to the synchronous transmission rate.
8. A stream data transmission control system, characterized in that the system comprises a stream data acquisition unit, a data dividing unit, a data set transfer-in unit, a truncation arrangement unit, and a data transmission unit, wherein:
a stream data acquisition unit for acquiring a plurality of stream data in real time;
the data dividing unit is used for analyzing the transmission addresses of the plurality of streaming data and dividing the plurality of streaming data into a priority streaming data set and a waiting streaming data set;
a data set transfer unit for transferring the priority flow data set to a priority transmission channel and transferring the waiting flow data set to a waiting transmission channel;
the arrangement transmission unit is used for carrying out truncation processing on the priority stream data set in the priority transmission channel to generate a plurality of stream data segments, carrying out priority arrangement according to the working state and preferentially transmitting the stream data segments with high priority;
and the data transmission unit is used for acquiring the real-time transmission rate of the priority transmission channel and starting the data transmission of the waiting transmission channel when the real-time transmission rate is lower than the preset regulation transmission rate.
9. The system according to claim 8, wherein the data dividing unit specifically includes:
the transmission analysis module is used for carrying out transmission analysis on the plurality of stream data to obtain transmission addresses corresponding to the plurality of stream data respectively;
the priority ordering module is used for carrying out priority ordering on the transmission addresses to obtain the priority levels corresponding to the transmission addresses;
and the data dividing module is used for dividing the plurality of stream data into a priority stream data set and a waiting stream data set according to the priority level.
10. The stream data transmission control system according to claim 9, wherein the data transmission unit specifically includes:
the rate acquisition module is used for acquiring the real-time transmission rate of the priority transmission channel;
the speed comparison module is used for judging whether the real-time transmission speed is lower than a preset regulation transmission speed or not;
the waiting starting module is used for starting data transmission of the waiting transmission channel if the real-time transmission rate is lower than a preset adjusting transmission rate;
and the waiting closing module is used for closing the data transmission of the waiting transmission channel if the real-time transmission rate is not lower than the preset transmission rate.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111427322.0A CN113839892A (en) | 2021-11-26 | 2021-11-26 | Stream data transmission control system and method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111427322.0A CN113839892A (en) | 2021-11-26 | 2021-11-26 | Stream data transmission control system and method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113839892A true CN113839892A (en) | 2021-12-24 |
Family
ID=78971795
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111427322.0A Pending CN113839892A (en) | 2021-11-26 | 2021-11-26 | Stream data transmission control system and method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113839892A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114884937A (en) * | 2022-05-27 | 2022-08-09 | 宁夏中宁县京能新能源有限公司 | Data breakpoint continuous transmission method of new energy centralized control system |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6633835B1 (en) * | 2002-01-10 | 2003-10-14 | Networks Associates Technology, Inc. | Prioritized data capture, classification and filtering in a network monitoring environment |
| CN101150496A (en) * | 2006-09-22 | 2008-03-26 | 中兴通讯股份有限公司 | Method for improving important information network transmission quality |
-
2021
- 2021-11-26 CN CN202111427322.0A patent/CN113839892A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6633835B1 (en) * | 2002-01-10 | 2003-10-14 | Networks Associates Technology, Inc. | Prioritized data capture, classification and filtering in a network monitoring environment |
| CN101150496A (en) * | 2006-09-22 | 2008-03-26 | 中兴通讯股份有限公司 | Method for improving important information network transmission quality |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114884937A (en) * | 2022-05-27 | 2022-08-09 | 宁夏中宁县京能新能源有限公司 | Data breakpoint continuous transmission method of new energy centralized control system |
| CN114884937B (en) * | 2022-05-27 | 2024-01-09 | 宁夏中宁县京能新能源有限公司 | New energy centralized control system data breakpoint continuous transmission method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108933993B (en) | Short message cache queue selection method and device, computer equipment and storage medium | |
| CN105871574B (en) | A kind of method, apparatus and system based on Software Development Kit monitoring log | |
| US9813351B2 (en) | Method and apparatus for adaptive packet aggregation | |
| CN112511325B (en) | Network congestion control method, node, system and storage medium | |
| CN110177054B (en) | Port queue scheduling method, device, network controller and storage medium | |
| CN113839892A (en) | Stream data transmission control system and method thereof | |
| CN111193608B (en) | Network quality detection monitoring method, device and system and computer equipment | |
| CN108370333B (en) | System, method and node for performance measurement in a segmented routing network | |
| CN110955226B (en) | Equipment failure prediction method and device, computer equipment and storage medium | |
| CN112511457B (en) | Data stream type identification method and related equipment | |
| CN108924057B (en) | Port flow intelligent control system of on-cloud system | |
| CN111523683B (en) | Method and system for predicting technological parameters in tobacco processing | |
| WO2023273837A1 (en) | Model training method and apparatus, traffic prediction method and apparatus, traffic load balancing method and apparatus, and storage medium | |
| CN116319777A (en) | Intelligent gateway service processing method based on edge calculation | |
| CN114630352A (en) | Fault monitoring method and device of access equipment | |
| CN115623040A (en) | Data transmission method and system of industrial Internet of things | |
| CN112714040A (en) | Holographic message detection method, device, equipment and storage medium | |
| CN109409780B (en) | Change processing method, device, computer equipment and storage medium | |
| CN112486104A (en) | Method and device for analyzing equipment abnormity based on real-time acquisition of sensing data | |
| CN115988037B (en) | Method, system and storage medium for acquiring and processing data of automobile industrial equipment | |
| US10439947B2 (en) | Method and apparatus for providing deadline-based segmentation for video traffic | |
| CN117149746A (en) | Data warehouse management system based on cloud primordial and memory calculation separation | |
| CN115134403B (en) | Internet of things communication assembly control method supporting multi-protocol access | |
| CN114422213B (en) | INT-based abnormal flow detection method and device | |
| CN114554521A (en) | Method and device for detecting sub-stream shared bandwidth bottleneck of multi-path transmission protocol |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20211224 |
|
| RJ01 | Rejection of invention patent application after publication |