CN116866953A - Data transmission system and method - Google Patents

Data transmission system and method Download PDF

Info

Publication number
CN116866953A
CN116866953A CN202310936734.XA CN202310936734A CN116866953A CN 116866953 A CN116866953 A CN 116866953A CN 202310936734 A CN202310936734 A CN 202310936734A CN 116866953 A CN116866953 A CN 116866953A
Authority
CN
China
Prior art keywords
data
unit
transmitted
network
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310936734.XA
Other languages
Chinese (zh)
Inventor
田政鳞
黄富
吴旦
袁路路
韩利群
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Southern Power Grid Digital Grid Technology Guangdong Co ltd
Original Assignee
China Southern Power Grid Digital Grid Technology Guangdong Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Southern Power Grid Digital Grid Technology Guangdong Co ltd filed Critical China Southern Power Grid Digital Grid Technology Guangdong Co ltd
Priority to CN202310936734.XA priority Critical patent/CN116866953A/en
Publication of CN116866953A publication Critical patent/CN116866953A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W24/00Supervisory, monitoring or testing arrangements
    • H04W24/02Arrangements for optimising operational condition
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W28/00Network traffic management; Network resource management
    • H04W28/02Traffic management, e.g. flow control or congestion control
    • H04W28/06Optimizing the usage of the radio link, e.g. header compression, information sizing, discarding information
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W84/00Network topologies
    • H04W84/18Self-organising networks, e.g. ad-hoc networks or sensor networks
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/70Reducing energy consumption in communication networks in wireless communication networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

The invention discloses a data transmission system and a data transmission method. Wherein, the system includes: an ad hoc network establishing module and a data transmission module; the self-organizing network building module is used for building a self-organizing network by taking each power transmission and transformation device as a node according to the distance and the signal intensity between the power transmission and transformation devices; the data transmission module is used for compressing and optimizing the data based on a preset optimization strategy to obtain data to be transmitted; distributing and managing data to be transmitted by adopting a preset distribution strategy, and determining a target node corresponding to the data to be transmitted; and transmitting the data to be transmitted to the target node based on the ad hoc network. The problem of current data transmission efficiency lower is solved, data transmission efficiency has been improved, and reliability and stability of data transmission system are provided the guarantee.

Description

Data transmission system and method
Technical Field
The present invention relates to the field of ad hoc networks, and in particular, to a data transmission system and method.
Background
In recent years, the industry of the internet of things develops rapidly, and along with the gradual construction of an intelligent distribution network, the traditional communication technology cannot meet the requirements of communication characteristics, long distance, low power consumption and large-scale connection of node equipment of the internet of things. The wireless ad hoc network has the characteristics of simplicity, easiness in use and low power consumption, and is increasingly widely applied to the network distribution end. However, the bandwidth limitation of the distribution network end is limited, and a large amount of data cannot be timely transmitted due to the data transmission method based on the wireless ad hoc network.
Disclosure of Invention
The invention provides a data transmission system and a data transmission method so as to improve the efficiency of data transmission.
According to an aspect of the present invention, there is provided a data transmission system comprising:
an ad hoc network establishing module and a data transmission module;
the self-organizing network building module is used for building a self-organizing network by taking each power transmission and transformation device as a node according to the distance and the signal intensity between the power transmission and transformation devices;
the data transmission module is used for compressing and optimizing the data based on a preset optimization strategy to obtain data to be transmitted; distributing and managing data to be transmitted by adopting a preset distribution strategy, and determining a target node corresponding to the data to be transmitted; and transmitting the data to be transmitted to the target node based on the ad hoc network.
According to another aspect of the present invention, there is provided a data transmission method applied to the data transmission system of any one of the embodiments of the present invention, the method including:
according to the distance and signal intensity between the power transmission and transformation devices, each power transmission and transformation device is used as a node, and an ad hoc network is established;
compressing and optimizing the data based on a preset optimization strategy to obtain data to be transmitted; distributing and managing data to be transmitted by adopting a preset distribution strategy, and determining a target node corresponding to the data to be transmitted; and transmitting the data to be transmitted to the target node based on the ad hoc network.
According to the technical scheme of the embodiment of the invention, the self-networking building module is used for building the self-networking by taking each power transmission and transformation device as a node according to the distance and the signal intensity between the power transmission and transformation devices, so that a plurality of power transmission and transformation devices can form the self-networking, data is transmitted between the nodes, and the whole network coverage and the high-efficiency transmission of the data are realized. The data transmission module is used for compressing and optimizing the data based on a preset optimization strategy to obtain data to be transmitted, reorganizing the data, reducing the storage space and improving the efficiency of data transmission, storage and processing. Distributing and managing data to be transmitted by adopting a preset distribution strategy, and determining a target node corresponding to the data to be transmitted; and transmitting the data to be transmitted to the target node based on the ad hoc network. The problem of current data transmission efficiency lower is solved, the efficiency and the performance of data processing are improved, the data transmission efficiency is improved, the load of the system is reduced, and the reliability and the stability of the data transmission system are ensured.
It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the invention or to delineate the scope of the invention. Other features of the present invention will become apparent from the description that follows.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for the description of the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a block diagram of a data transmission system according to an embodiment of the present invention;
fig. 2 is a block diagram of still another data transmission system according to an embodiment of the present invention;
fig. 3 is a block diagram of a specific data transmission system according to an embodiment of the present invention;
fig. 4 is a block diagram of another data transmission system according to an embodiment of the present invention;
fig. 5 is a flowchart of a data transmission method according to an embodiment of the present invention.
Detailed Description
In order that those skilled in the art will better understand the present invention, a technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in which it is apparent that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present invention without making any inventive effort, shall fall within the scope of the present invention.
It should be noted that the terms "first" and "second" and the like in the description and the claims of the present invention and the above drawings are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the invention described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Fig. 1 is a block diagram of a data transmission system according to an embodiment of the present invention, where the embodiment is applicable to a scenario of data transmission based on an ad hoc network, and as shown in fig. 1, the data transmission system includes: an ad hoc network establishment module 110 and a data transmission module 120.
The ad hoc network establishing module 110 is configured to establish an ad hoc network by taking each power transmission and transformation device as a node according to the distance and the signal strength between the power transmission and transformation devices. The data transmission module 120 is configured to compress and optimize data based on a preset optimization policy to obtain data to be transmitted; distributing and managing data to be transmitted by adopting a preset distribution strategy, and determining a target node corresponding to the data to be transmitted; and transmitting the data to be transmitted to the target node based on the ad hoc network.
The ad hoc network is a peer-to-peer network, nodes can join and leave the network at any time, the positions of all the nodes are equal, the fault of any node can not influence the operation of the whole network, and the ad hoc network has strong survivability. However, because the transmission power and coverage area of the power transmission and transformation equipment are limited, when the power transmission and transformation equipment is to communicate with equipment outside the coverage area, the communication is not completed based on a certain routing equipment, but a plurality of nodes are needed to cooperate together, and data forwarding is performed by using an intermediate node, so that data transmission is realized.
Specifically, the ad hoc network establishing module 110 determines the position of each power transmission and transformation device in the power transmission and transformation system; according to the distance between power transmission and transformation equipment, selecting a wireless sensor network technology, and based on the signal strength and/or coverage range of the wireless sensor network technology, carrying out data transmission between nodes; and each power transmission and transformation device is used as a node, communication connection between the nodes is established based on the wireless sensor network technology, and the ad hoc network is obtained. The method has the advantages that based on the ad hoc network, data transmission can be performed among power transmission and transformation equipment, and full network coverage and efficient transmission of data are realized.
The data transmission module 120 compresses and optimizes the data without losing useful information to obtain data to be transmitted. Specifically, the data is reorganized by reducing the data volume, compression algorithm or compression technology, etc., so that the redundancy and storage space of the data are reduced. Meanwhile, the data transmission module 120 determines the data amount and the data type of the data to be transmitted, and determines the storage space required by the data to be transmitted; if the remaining storage space of the node is larger than the storage space required by the data to be transmitted, taking the node as a target node corresponding to the data to be transmitted; and finally, based on the nodes in the ad hoc network, sending the data to be transmitted to the target node. The method has the advantages that the data to be transmitted can be distributed and managed based on the residual storage space and the storage space required by the data to be transmitted, so that the data transmission is faster, more accurate and more efficient.
Optionally, the Compression algorithm includes an LZW/LZ4 algorithm, a Zlib algorithm, and Huffman coding (Huffman Code), and the Compression technique includes space Compression (Null Compression), run-length Compression (Run-Length Compression), key-word encoding (Key-word encoding), and Huffman statistical method (Huffman statistical method), which is not limited in this embodiment.
In a specific embodiment, fig. 2 is a block diagram of still another data transmission system according to an embodiment of the present invention, and as shown in fig. 2, the ad hoc network establishing module 110 includes an ad hoc network protocol determining unit 130 and an ad hoc network constructing unit 140.
The ad hoc network protocol determining unit 130 is configured to determine a target ad hoc network protocol according to a distance between power transmission and transformation devices and a signal strength, where the target ad hoc network protocol includes at least one of AODV, DSR, ZRPHE and Bluetooth Mesh. An ad hoc network constructing unit 140, configured to establish an ad hoc network between nodes based on a wireless communication technology according to a target ad hoc network protocol.
It can be understood that each power transmission and transformation device in the ad hoc network has two functions of a router and a host. As a host, the power transmission and transformation device needs to run various user-oriented application programs; as a router, the power transmission and transformation device needs to operate a corresponding routing protocol, and completes the forwarding and routing maintenance work of the data packet according to the routing policy and the routing table. Therefore, due to the limitation of the signal propagation range of the wireless communication technology, a proper routing protocol needs to be selected for the nodes according to the distance between the power transmission and transformation equipment and the signal strength of the wireless communication, so that the accurate available routing information can be found in the shortest time possible, and the rapid change of the network topology can be adapted. The method has the advantages that the routing protocol can be determined quickly, accurately and efficiently, the introduced extra time delay and the control information for maintaining the routing are reduced, and the cost of the routing protocol is reduced, so that the limitation of the power transmission and transformation equipment in the aspects of computing capacity, storage space, power supply and the like is met.
Specifically, the ad hoc network protocol determining unit 130 selects an appropriate routing protocol for the node according to the distance and the signal strength between the power transmission and transformation devices, so as to obtain a target ad hoc network protocol; the ad hoc network construction unit 140 establishes an ad hoc network between nodes according to a target ad hoc network protocol and signal strength of a wireless communication technology.
Optionally, the target Ad hoc network protocols include routing protocols for determining the arrival path, the routing protocols including routing information protocol (Routing Information Protocol, RIP), interior gateway routing protocol (Interior Gateway Routing Protocol, IGRP), enhanced interior gateway routing protocol (Enhanced Interior Gateway Routing Protocol, EIGRP), open shortest path first (Open Shortest Path First, OSPF), intermediate system-to-intermediate system (Intermediate system to intermediate system, IS-IS), border gateway protocol (border gateway protocol, BGP), wireless Ad hoc network On-demand planar distance vector routing protocol (Ad-hoc On-Demand Distance Vector, AODV), dynamic source routing protocol (Dynamic Source Routing, DSR), regional routing protocol (Zone Routing Protocol, ZRP), and Bluetooth device networking standard (Bluetooth Mesh).
Among other things, AODV is a distance vector based routing protocol for dynamically establishing routes between mobile nodes. When the first node needs to send data, it will broadcast a route request message, then the node that receives the route request message will send a route reply message to the data transmission module 120, and the data transmission module 120 determines the route closest to the route reply message.
DSR is a source routing-based protocol that allows a source node to specify a complete routing path. Specifically, by configuring a routing protocol on each node, the routing protocol is used to exchange routing information to generate a routing table according to the interface configuration (such as the configuration of the IP address) of the node and the state of the node connection link. Each node can store the related information of the route in a routing table, and when the topology structure of the ad hoc network is changed, the routing table can be automatically updated, and the data transmission path between the nodes is determined. When a node sends data, it is only necessary for the node to send a route request message to a neighboring node to obtain a route to the target node.
ZRP is a region and source routing based approach that uses two different protocols to handle global routing and local routing. ZRP divides a network into many overlapping areas, each of which is served as an area leader by a node. When a node needs to send data, it will use the local routing protocol to find the area leader of the target node and then use the global routing protocol to find the route to the target node. When the topology updating process is only carried out in a small range, the system consumption can be effectively reduced, meanwhile, the route discovery process is accelerated, and the response speed of the data transmission system is improved.
Bluetooth Mesh is a Bluetooth technology based node ad hoc protocol that uses a mechanism called "publish/subscribe" that allows nodes to communicate according to the desired service or data flow. Each node may act as a router and end node to communicate data in the network.
For wireless ad hoc networks, due to various limitations of the network, the periodic broadcast of control information packets consumes a large amount of network bandwidth, and the rapid change of the topology structure can cause a large amount of routing information to fail quickly, so that resources are wasted. When establishing an ad hoc network, a routing protocol is selected according to a specific application scene to obtain a target ad hoc network protocol; an ad hoc network is then established between the nodes based on the target ad hoc protocol and the wireless communication technology.
Optionally, fig. 3 is a block diagram of a specific data transmission system according to an embodiment of the present invention, and as shown in fig. 3, the data transmission module 120 includes a data acquisition unit 150, a data processing unit 160, and a data sending unit 170, where the data acquisition unit 150 is configured to acquire, for each node, association data of the node; a data processing unit 160, configured to calculate the associated data to obtain a target data index; the data sending unit 170 is configured to send the target data indicator to the target node.
Specifically, the data acquisition unit 150 acquires data of the power transmission and transformation device at each node, obtains associated data of the node, and sends the associated data to the data processing unit 160; the data processing unit 160 determines a target data index and associated data related to the target data index according to a specific application scene, and calculates the associated data to obtain the target data index; the data transmission unit 170 transmits the target data index to the target node based on the ad hoc network. Illustratively, the data acquisition unit 150 acquires parameters such as temperature and/or voltage of the power transmission and transformation device at each node every time a set time interval passes, obtains associated data, and sends the associated data to the data processing unit 160; the data processing unit 160 analyzes and models various parameters in the received associated data to obtain data indexes such as load data, load curve and/or electric energy consumption; the data transmission unit 170 transmits the processed data index to the target node, and the target node further predicts the power demand based on the data index, and adjusts the power generation plan according to the demand to support the operation and management of the power system.
Optionally, the data processing unit 160 is further configured to perform data cleansing on the associated data. Specifically, the collected data may have problems of noise, abnormal values and the like, and related data needs to be cleaned and processed through operations such as removing weight, denoising and/or filling missing values.
Optionally, the system further comprises a data storage module; and the data storage module is used for acquiring target storage data of one or more nodes in the ad hoc network and storing the target storage data.
Specifically, the data storage module obtains target storage data of one or more nodes in the ad hoc network, and in the data storage process, the target storage data is stored into a corresponding partition by adopting a data partition. Further, the method for partitioning data comprises the following steps: hash partitioning of keys, range partitioning of keys, creation of secondary indexes (e.g., creation of secondary indexes according to documents or keywords, filtering/querying of data), partition rebalancing, etc., which has the advantage that large data sets are divided into smaller subsets, evenly distributing data and query load across the ad hoc network, avoiding hot spots (disproportionate load nodes).
Illustratively, a plurality of databases are preset for storing target storage data of different data types. The data storage module obtains data to be stored sent by one or more nodes in the networking to obtain target storage data, and stores the target storage data into a database corresponding to the data type according to the data type of the target storage data. According to the data type, the data to be stored is stored in a data type database, and the data is stored and managed, so that the storage space can be fully utilized, the data can be more conveniently maintained, the data can be more tightly controlled, and the data can be more effectively utilized.
Optionally, the system further comprises a visualization unit, wherein the visualization unit is used for converting the data into a graph for visual display. Specifically, the visualization unit determines associated data, target data indexes and/or data to be transmitted of the node requested by the user according to the interactive operation of the user, converts one or more of the data into a graph, and performs visual display. By way of example, the data analysis result can be visualized by drawing a graph or a map, etc., and the data result is displayed, so that the user can understand and use the data conveniently.
In one embodiment, the data transmission module 120 further includes an alarm prompting unit, which is configured to determine, according to the association data of the node, an abnormal event corresponding to the association data, and generate and display a prompting message corresponding to the abnormal event. Specifically, some data (such as voltage, current and temperature) in the associated data can reflect whether the power transmission and transformation equipment is in a normal working state to a certain extent, so that whether the node is abnormal or not can be determined according to the associated data. It can be understood that the nodes in different abnormal states may have different changes in the associated data, so when the alarm prompting unit detects that the associated data is abnormal, the corresponding abnormal event of the associated data is determined according to the corresponding relationship in advance according to the corresponding relationship of the set abnormal event type and the associated data. Furthermore, the processing modes of different abnormal events are different, so that prompt information corresponding to the abnormal events is set, and a user can directly formulate countermeasures according to the prompt information, so that the management efficiency is further improved.
It can be appreciated that, since the types of the power transmission and transformation devices are different, the associated data may also be different, and thus the correspondence between the abnormal event types of different nodes and the associated data may be different. For different associated data, a numerical range corresponding to the associated data is preset, and when at least one associated data is detected to exceed a corresponding first numerical range, a system generates first prompt information and displays the first prompt information to a worker; when at least one kind of associated data is detected to be out of the corresponding second numerical range, the system generates second prompt information and displays the second prompt information to staff. Further, considering that in some scenes, the dangerous degrees of different abnormal events may be different, the priority of the abnormal event may be set, when different abnormal times occur simultaneously, firstly, the prompt information with high priority of the abnormal event is generated and displayed, and after the event is preset, the prompt information with low priority of the abnormal event is generated and displayed. The power transmission and transformation equipment management method has the advantages that the user can intervene in time according to different risks, the management efficiency of the power transmission and transformation equipment is improved, and the safety is enhanced.
In one embodiment, an alarm device is arranged, and corresponding thresholds are preset for parameters such as temperature, current, voltage, resistance and capacitance of power transmission and transformation equipment in the associated data; if at least one parameter of the temperature, the current, the voltage, the resistance and the capacitance of the power transmission and transformation equipment in the associated data exceeds a corresponding preset threshold value; the control alarm device sends out an alarm signal.
Optionally, the data transmission module 120 further includes a remote control unit, which is configured to control the power transmission and transformation device in response to an interactive operation of the user input for the power transmission and transformation device.
Specifically, the system further comprises a mobile terminal or a web terminal, a user can input corresponding interactive operation for the power transmission and transformation equipment through an interactive interface of the mobile terminal or the web terminal, the remote control unit generates a corresponding control instruction based on the interactive operation, and the power transmission and transformation equipment is controlled to execute corresponding operation/realize corresponding functions according to the control instruction.
When the power transmission and transformation equipment is abnormal, corresponding interactive operation is input through an interactive interface of the mobile terminal or the web end, the remote control unit generates a corresponding control instruction based on the interactive operation, and the remote control unit controls the power transmission and transformation equipment according to the control instruction. The method has the advantages that the controllability and the reliability of the power transmission and transformation equipment are improved, the user experience and the management efficiency of the power transmission and transformation equipment are improved, and the power transmission and transformation equipment can be better operated and managed.
According to the technical scheme of the embodiment of the invention, the self-organizing network building module is used for building the self-organizing network by taking each power transmission and transformation device as a node according to the distance and the signal intensity between the power transmission and transformation devices, and forming a self-organizing network by a plurality of power transmission and transformation devices, so that data can be transmitted between the nodes, and the whole network coverage and the high-efficiency transmission of the data are realized. The data transmission module is used for compressing and optimizing the data based on a preset optimization strategy to obtain data to be transmitted, reorganizing the data, reducing the storage space and improving the efficiency of data transmission, storage and processing. Distributing and managing data to be transmitted by adopting a preset distribution strategy, and determining a target node corresponding to the data to be transmitted; and transmitting the data to be transmitted to the target node based on the ad hoc network. The problem of current data transmission efficiency lower is solved, the efficiency and the performance of data processing are improved, the data transmission efficiency is improved, the load of the system is reduced, and the reliability and the stability of the data transmission system are ensured.
Fig. 4 is a block diagram of another data transmission system according to an embodiment of the present invention, where the data transmission system in the embodiment and the data transmission system in the embodiment described above belong to the same inventive concept, and a bandwidth optimization sub-module is added based on the embodiment described above.
As shown in fig. 4, the data transmission module 120 further includes a bandwidth optimization sub-module 180, and the bandwidth optimization sub-module 180 includes at least one of a flow control unit, a data compression unit, a data buffering unit, a domain name system optimization unit, a bandwidth control unit, and a network optimization unit.
Wherein the flow control unit is used for performing flow control based on a quality of service (Quality of Service, QOS) technology. Specifically, the quality of service of data transmission is evaluated based on indexes such as transmission speed, response time, transmission sequence, accuracy and the like, and the flow in the network is controlled based on the quality of service, so that network congestion and load are reduced. This has the advantage that the network performance and user experience can be improved.
And the data compression unit is used for carrying out data compression on the data based on a preset compression algorithm, wherein the preset compression algorithm comprises a GNUzip (GZIP) algorithm and/or a Brotli algorithm. Specifically, before data transmission is performed between nodes, data is compressed through a preset compression algorithm, so that the data transmission quantity is reduced, the consumption of network bandwidth is reduced, and the data transmission efficiency is further improved. The GNUzip (GZIP) algorithm is used for improving the performance of the WEB application program, and the compression ratio is usually about 3 to 10 times, so that the network bandwidth of the server can be greatly reduced. The Brotli algorithm compresses a data stream by a specific combination of a general LZ77 lossless compression algorithm, huffman coding, and second order context modeling for compression when transmitting data over a network connection. Further, the Brotli algorithm uses a predefined 120 kbyte dictionary that can promote the compression density of smaller files.
The data caching unit is used for caching data to a preset caching space based on a preset network, and the preset network comprises a content distribution network. Specifically, the common data is cached to each node in advance based on a preset network, so that access to remote nodes and data transmission are reduced, and bandwidth is saved. Illustratively, a content delivery network (Content Delivery Network, CDN) is used to efficiently deliver rich multimedia content over the internet, optimize information flow in the internet, implement data caching and acceleration, and improve network usage efficiency.
A domain name system (Domain Name System, DNS) optimizing unit for optimizing the domain name system by enabling domain name system caching and/or domain name system load balancing techniques. Specifically, the domain name system optimization technology is used to accelerate the domain name resolution speed, so that the speed of a user accessing a website is increased. The network service provider with the intelligent DNS function is found by using the intelligent DNS function, and the address of the nearest DNS server can be quickly selected, so that the network request delay is minimized, and the whole DNS analysis process is quick and stable. Further, searching for a DNS service provider with intelligent DNS pointing or directing features may result in higher quality of service and better user experience. Wherein the DNS caching technique is used to store DNS records prior to the next layer resolution update period. The cached DNS records are accessed quickly in the future, without waiting for DNS server responses, which can increase resolution speed. Optionally, a high speed DNS server is used to eliminate network delays. By way of example, using Google's public DNS server or domain name resolution service provider OpenDNS for selecting the best DNS server in optimizing DNS resolution according to geographic location and number of destination devices, the data transmission speed can be further improved. Optionally, DNS definitions can also be minimized, minimizing the hierarchy of the DNS system, saving significant amounts of time and resources, and minimizing the communications required for network requests.
And the bandwidth control unit is used for limiting the use of the bandwidth in the ad hoc network based on a preset bandwidth control mode, wherein the preset bandwidth control mode comprises a bandwidth limiting mode and/or a bandwidth allocation mode. Specifically, the service template of the user or service in the Radius database controls the selection service of the maximum rate of the user connection or service connection. By limiting bandwidth usage in a network using bandwidth control techniques, network congestion and bandwidth waste can be avoided.
The network optimization unit is used for optimizing target parameters of the network, wherein the target parameters comprise at least one of a routing protocol, a topological structure and a network protocol.
Wherein the routing protocol is used to transfer data from a source address to a destination address, which determines how paths are selected and how data is forwarded between networks. The routing protocol mainly includes static routing and dynamic routing. Static routing is simple and easy to use, but is difficult to accommodate for large-scale network variations. The dynamic route is used for adaptively generating a route table according to the network topology structure and the link state, so that the change can be better dealt with. By way of example, network performance may be optimized using border gateway protocol (Border Gateway Protocol, BGP), open shortest path first (Open Shortest Path First, OSPF) protocol, routing information protocol (Routing Information Protocol, RIP), and virtual private network (Virtual Private Network, VPN) technologies, among others.
The topology structure of the network comprises a centralized structure, a distributed structure and a mixed structure, and the topology structure can be optimized by setting a network mirror image or a backup router, so that the network fault tolerance can be improved, the probability of single-point faults is reduced, and the reliability is improved: the network scale can be enlarged based on link aggregation or switch introduction, and the expansibility is improved; the topology structure of the network is adjusted through load balancing or priority scheduling, so that the network performance can be improved; firewall or access control means (e.g., VPN technology) are employed to improve network security.
Network protocols include transmission control protocol (Transmission Control Protocol, TCP), user datagram protocol (User Datagram Protocol, UDP), internet protocol (Internet Protocol, IP), internet control message protocol (Internet Control Message Protocol, ICMP), address resolution protocol (Address Resolution Protocol, ARP), and the like. By way of example, the TCP protocol may be optimized by accelerating the process of establishing and releasing the TCP connection, optimizing the TCP sliding window algorithm, optimizing the TCP timestamp, selecting the acknowledgement algorithm, and the like, so as to reduce the number of retransmissions, improve the network congestion condition, and increase the TCP transmission rate.
In a specific embodiment, the data transmission module 120 includes at least one of a Hash (Hash) allocation unit, a range allocation unit, a random allocation unit, and a prefix allocation unit.
The hash distribution unit is used for determining a hash distribution result of the data to be transmitted based on the hash function and distributing the data to be transmitted to the target node according to the hash distribution result. The hash allocation unit is specifically configured to allocate data to be transmitted based on a hash algorithm/consistent hash algorithm. The hash algorithm is based on the number of the nodes, performs residual taking operation on the hash value of the nodes, and performs residual taking partition of the nodes. This has the advantage that it can be ensured that the same data is evenly distributed in different nodes at different times, thereby reducing skew and load imbalance of the data. The consistent hash algorithm organizes the whole hash value space into a virtual circular ring in a clockwise direction; hashing each node by using a hash function, for example (the IP or host name of the power transmission and transformation device can be selected as a key to perform hashing), so as to determine the position of each power transmission and transformation device on the hash ring; finally, using algorithm to locate data access to corresponding nodes; the data key is hashed using the same hash function and the position of the data on the ring is determined, from which the server that was first encountered is the server it should be located on, looking clockwise along the ring. The advantage of this is that the balance and stability of the nodes can be guaranteed, but the mapping table of the node positions needs to be maintained, and the complexity of the system is increased.
The range distribution unit is used for obtaining a data aggregation result based on the attribute of the data to be transmitted and distributing the data to be transmitted to the target node according to the data aggregation result. Specifically, the range allocation unit is used for inquiring or aggregating according to the attribute value of the data to be transmitted to obtain a data aggregation result; according to the data aggregation result, the data to be transmitted are distributed to different nodes or partitions, so that the data transmission quantity and network load between the nodes can be reduced.
The random distribution unit is used for randomly distributing the data to be transmitted to the target node, so that inclination and unbalanced load of the data can be avoided, and the transmission quantity and network load of the data can be increased.
And the prefix distribution unit is used for determining the prefix of the key of the data to be transmitted and distributing the data to be transmitted to the target node. The method is suitable for the condition that the prefix of the key has good distribution characteristics, and can reduce the inclination and the load imbalance of data.
According to the technical scheme, bandwidth utilization in the network is limited by using the bandwidth control technology, network congestion and bandwidth waste can be avoided, and the utilization efficiency of the network is improved; meanwhile, the data to be transmitted is distributed and managed by adopting a preset distribution strategy, so that the efficiency and performance of data processing are improved, and the data transmission efficiency is further improved.
Fig. 5 is a flowchart of a data transmission method according to an embodiment of the present invention, where the embodiment is applicable to a scenario of data transmission based on an ad hoc network, and the data transmission method is applied to a data transmission system according to any embodiment of the present invention, as shown in fig. 5, and includes:
s210, establishing an ad hoc network by taking each power transmission and transformation device as a node according to the distance and the signal intensity between the power transmission and transformation devices.
Firstly, determining the position of each power transmission and transformation device in a power transmission and transformation system; then, according to the distance between the power transmission and transformation equipment, selecting a wireless sensor network technology, and based on the signal strength and/or coverage area of the wireless sensor network technology, carrying out data transmission between nodes; and finally, taking each power transmission and transformation device as a node, and establishing communication connection between the nodes based on the wireless sensor network technology to obtain the ad hoc network.
Communication connection between nodes is established based on wireless sensor network technology, communication environment and network load of the self-organizing network need to be adapted, and signal interference and transmission interruption can occur when the network topology structure changes. Therefore, aiming at the relation change between the nodes, path calculation needs to be carried out according to the topological structure between the nodes, and the communication environment and the network load of the self-organizing network can be quickly adapted.
In a specific embodiment, according to the distance and the signal strength between the power transmission and transformation devices, each power transmission and transformation device is used as a node, and the method for establishing the ad hoc network comprises the following steps: determining a target ad hoc network protocol according to the distance between power transmission and transformation equipment and the signal strength, wherein the target ad hoc network protocol comprises at least one of AODV, DSR, ZRPHE and Bluetooth Mesh; an ad hoc network is established between nodes based on a wireless communication technology according to a target ad hoc network protocol.
S220, compressing and optimizing the data based on a preset optimization strategy to obtain the data to be transmitted.
Specifically, the data is compressed and optimized on the premise of not losing useful information, and the data to be transmitted is obtained. In one embodiment, data is compressed by reducing the amount of data, a compression algorithm or a compression technology, and the data is optimized by bandwidth allocation, flow scheduling and the like, so that the redundancy and storage space of the data are reduced, and the total energy consumption of the system is reduced.
In one embodiment, the data is optimized based on bandwidth optimization to obtain the data to be transmitted. Wherein bandwidth optimization includes at least one of flow control, data compression, data caching, domain name system optimization, bandwidth control, and network optimization. Specifically, flow control is performed based on quality of service techniques. And carrying out data compression on the data based on a preset compression algorithm, wherein the preset compression algorithm comprises a GZIP algorithm and/or a Brotli algorithm. Caching data to a preset cache space based on a preset network, wherein the preset network comprises a content distribution network. The domain name system is optimized by enabling domain name system caching and/or domain name system load balancing techniques. And limiting the use of the bandwidth in the ad hoc network based on a preset bandwidth control mode, wherein the preset bandwidth control mode comprises a bandwidth limiting mode and/or a bandwidth allocation mode. The method comprises optimizing target parameters of the network, wherein the target parameters comprise at least one of a routing protocol, a topology and a network protocol.
S230, distributing and managing the data to be transmitted by adopting a preset distribution strategy, and determining a target node corresponding to the data to be transmitted.
The preset allocation strategy is used for allocating data to be transmitted to the corresponding target node, and comprises strategies such as sequential partition, polling partition algorithm, time slice rotation partition algorithm, data block partition algorithm, business topic partition and the like.
In a specific embodiment, the preset allocation policy further includes at least one of hash allocation, range allocation, random allocation, and prefix allocation; the hash allocation comprises the steps of determining a hash allocation result of data to be transmitted based on a hash function, and allocating the data to be transmitted to a target node according to the hash allocation result; the range allocation comprises the steps of obtaining a data aggregation result based on the attribute of the data to be transmitted, and allocating the data to be transmitted to a target node according to the data aggregation result; the random allocation comprises the steps of randomly allocating data to be transmitted to a target node; prefix assignment requires determining the prefix of the key of the data to be transmitted, and assigning the data to be transmitted to the target node.
And S240, sending the data to be transmitted to the target node based on the ad hoc network.
In a specific embodiment, the sending the data to be transmitted to the target node based on the ad hoc network includes: aiming at each node, acquiring the associated data of the node; calculating the associated data to obtain target data indexes; and sending the target data index to the target node.
Acquiring data of power transmission and transformation equipment at each node based on an ad hoc network to obtain associated data of the node; determining a target data index and associated data related to the target data index according to a specific application scene, and screening the associated data to obtain associated data corresponding to the target data index; calculating a target data index according to the associated data; and transmitting the target data index to the target node based on the ad hoc network. In the scene of preparing a power generation plan, for each node, acquiring parameters such as temperature and/or voltage of power transmission and transformation equipment every time a set time interval passes, and obtaining associated data; analyzing and modeling various parameters in the associated data to obtain data indexes such as load data, load curves and/or electric energy consumption; and transmitting the data index to a target node, predicting the power demand by the target node according to the data index, and making and/or adjusting a power generation plan according to the demand so as to support the operation and management of the power system.
Optionally, according to the association data of the nodes, determining the abnormal event corresponding to the association data, and generating and displaying the prompt information corresponding to the abnormal event.
Since the abnormal events corresponding to the different changes of the associated data may be different, when the change of the associated data is detected, whether the node is abnormal or not is determined according to the associated data, and the abnormal event corresponding to the associated data is determined. Further, the corresponding relation between the type of the abnormal event and the associated data is preset, and when the alarm prompting unit detects that the associated data is abnormal (for example, not in a set numerical range), the abnormal event corresponding to the associated data is determined according to the corresponding relation. Furthermore, the processing modes of different abnormal events are different, so that prompt information corresponding to the abnormal events is set, and a user can directly formulate countermeasures according to the prompt information, so that the management efficiency is further improved.
Optionally, the method further comprises: and controlling the power transmission and transformation equipment in response to the interactive operation input by the user for the power transmission and transformation equipment. Specifically, the user can input corresponding interactive operation for the power transmission and transformation equipment through the interactive interface of the mobile terminal or the network terminal, the remote control unit generates a corresponding control instruction based on the interactive operation, and the power transmission and transformation equipment is controlled to execute corresponding operation/realize corresponding functions according to the control instruction. For example, firstly, the method can be configured in an APP of a mobile terminal, and a user inputs corresponding interactive operation for power transmission and transformation equipment through an interactive interface of the APP; then, generating a corresponding control instruction based on the interaction operation, and sending the control instruction to a node corresponding to the interaction operation; and finally, controlling the power transmission and transformation equipment to execute corresponding operation/realize corresponding functions according to the control instruction by the node.
In a specific embodiment, the method further comprises: and obtaining target storage data of one or more nodes in the networking, and storing the target storage data.
Specifically, target storage data obtained from one or more nodes in the network are stored in corresponding partitions by adopting data partitioning methods such as hash partition of keys, range partition of keys, secondary index establishment (for example, secondary index establishment according to documents or keywords, data filtering/inquiring) and partition rebalancing in the data storage process.
Illustratively, a plurality of databases are preset for storing target storage data of different data types. The method comprises the steps of obtaining data to be stored sent by one or more nodes in a self-organizing network, obtaining target storage data, and storing the target storage data into a database corresponding to a data type according to the data type of the target storage data. According to the data type, the data to be stored is stored in a data type database, and the data is stored and managed, so that the storage space can be fully utilized, the data can be more conveniently maintained, the data can be more tightly controlled, and the data can be more effectively utilized.
Further, the method further comprises: and converting the data into a graph for visual display. Specifically, according to the interactive operation of the user, the associated data, the target data index and the data to be transmitted of the node requested by the user are determined, one or more of the data are converted into graphics, and visual display is performed.
According to the technical scheme of the embodiment of the invention, each power transmission and transformation device is used as a node according to the distance and the signal intensity between the power transmission and transformation devices, an ad hoc network is established, a plurality of power transmission and transformation devices form an ad hoc network, and data can be transmitted between the nodes, so that the whole network coverage and high-efficiency transmission of the data are realized. And compressing and optimizing the data based on a preset optimization strategy to obtain data to be transmitted, reorganizing the data, reducing the storage space and improving the efficiency of data transmission, storage and processing. Distributing and managing data to be transmitted by adopting a preset distribution strategy, and determining a target node corresponding to the data to be transmitted; and transmitting the data to be transmitted to the target node based on the ad hoc network. The problem of current data transmission efficiency lower is solved, the efficiency and the performance of data processing are improved, the data transmission efficiency is improved, the load of the system is reduced, and the reliability and the stability of the data transmission system are ensured.
It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps described in the present invention may be performed in parallel, sequentially, or in a different order, so long as the desired results of the technical solution of the present invention are achieved, and the present invention is not limited herein.
The above embodiments do not limit the scope of the present invention. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives are possible, depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the scope of the present invention.

Claims (10)

1. A data transmission system, comprising: an ad hoc network establishing module and a data transmission module;
the self-organizing network building module is used for building a self-organizing network by taking each power transmission and transformation device as a node according to the distance and the signal intensity between the power transmission and transformation devices;
the data transmission module is used for compressing and optimizing data based on a preset optimization strategy to obtain data to be transmitted; distributing and managing the data to be transmitted by adopting a preset distribution strategy, and determining a target node corresponding to the data to be transmitted; and sending the data to be transmitted to the target node based on the ad hoc network.
2. The system according to claim 1, wherein the ad hoc network establishing module comprises an ad hoc network protocol determining unit and an ad hoc network constructing unit; wherein, the liquid crystal display device comprises a liquid crystal display device,
the self-networking protocol determining unit is used for determining a target self-networking protocol according to the distance and the signal strength between the power transmission and transformation equipment, wherein the target self-networking protocol comprises at least one of AODV, DSR, ZRPHE and Bluetooth Mesh;
the ad hoc network construction unit is used for establishing an ad hoc network between the nodes based on a wireless communication technology according to the target ad hoc network protocol.
3. The system of claim 1, wherein the data transmission module further comprises a bandwidth optimization sub-module comprising at least one of a flow control unit, a data compression unit, a data caching unit, a domain name system optimization unit, a bandwidth control unit, and a network optimization unit; wherein, the liquid crystal display device comprises a liquid crystal display device,
the flow control unit is used for controlling the flow based on the service quality technology;
the data compression unit is used for performing data compression on the data based on a preset compression algorithm, wherein the preset compression algorithm comprises a GZIP algorithm and/or a Brotli algorithm;
The data caching unit is used for caching the data into a preset caching space based on a preset network, and the preset network comprises a content distribution network;
the domain name system optimizing unit is used for optimizing the domain name system by enabling domain name system caching and/or domain name system load balancing technology;
the bandwidth control unit is configured to limit use of bandwidth in the ad hoc network based on a preset bandwidth control manner, where the preset bandwidth control manner includes a bandwidth limiting manner and/or a bandwidth allocation manner;
and the network optimization unit is used for optimizing target parameters of the network, wherein the target parameters comprise at least one of a routing protocol, a topological structure and a network protocol.
4. The system of claim 1, wherein the data transmission module comprises at least one of a hash allocation unit, a range allocation unit, a random allocation unit, and a prefix allocation unit; wherein, the liquid crystal display device comprises a liquid crystal display device,
the hash distribution unit is used for determining a hash distribution result of the data to be transmitted based on a hash function and distributing the data to be transmitted to the target node according to the hash distribution result;
The range allocation unit is used for obtaining a data aggregation result based on the attribute of the data to be transmitted, and allocating the data to be transmitted to the target node according to the data aggregation result;
the random distribution unit is used for randomly distributing the data to be transmitted to the target node;
the prefix allocation unit is configured to determine a prefix of a key of the data to be transmitted, and allocate the data to be transmitted to the target node.
5. The system of claim 1, wherein the data transmission module comprises a data acquisition unit, a data processing unit, and a data transmission unit,
the data acquisition unit is used for acquiring the associated data of each node;
the data processing unit is used for calculating the associated data to obtain target data indexes;
the data sending unit is used for sending the target data index to the target node.
6. The system of claim 1, further comprising a data storage module; wherein, the liquid crystal display device comprises a liquid crystal display device,
the data storage module is used for acquiring target storage data of one or more nodes in the ad hoc network and storing the target storage data.
7. The system of claim 1, further comprising a visualization unit, wherein,
and the visualization unit is used for converting the data into a graph for visual display.
8. The system of claim 1, wherein the data transmission module further comprises an alarm prompting unit,
the alarm prompting unit is used for determining an abnormal event corresponding to the associated data according to the associated data of the node, generating prompting information corresponding to the abnormal event and displaying the prompting information.
9. The system of claim 1, wherein the data transmission module further comprises a remote control unit,
and the remote control unit is used for responding to the interactive operation input by the user on the power transmission and transformation equipment and controlling the power transmission and transformation equipment.
10. A data transmission method, characterized by being applied to the data transmission system according to any one of claims 1 to 9, the method comprising:
according to the distance and signal intensity between power transmission and transformation equipment, establishing an ad hoc network by taking each power transmission and transformation equipment as a node;
compressing and optimizing the data based on a preset optimization strategy to obtain data to be transmitted;
Distributing and managing the data to be transmitted by adopting a preset distribution strategy, and determining a target node corresponding to the data to be transmitted;
and sending the data to be transmitted to the target node based on the ad hoc network.
CN202310936734.XA 2023-07-27 2023-07-27 Data transmission system and method Pending CN116866953A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310936734.XA CN116866953A (en) 2023-07-27 2023-07-27 Data transmission system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310936734.XA CN116866953A (en) 2023-07-27 2023-07-27 Data transmission system and method

Publications (1)

Publication Number Publication Date
CN116866953A true CN116866953A (en) 2023-10-10

Family

ID=88226862

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310936734.XA Pending CN116866953A (en) 2023-07-27 2023-07-27 Data transmission system and method

Country Status (1)

Country Link
CN (1) CN116866953A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117560718A (en) * 2024-01-11 2024-02-13 广东广宇科技发展有限公司 Fire control Internet of things remote monitoring method based on crowd sensing

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117560718A (en) * 2024-01-11 2024-02-13 广东广宇科技发展有限公司 Fire control Internet of things remote monitoring method based on crowd sensing
CN117560718B (en) * 2024-01-11 2024-04-09 广东广宇科技发展有限公司 Fire control Internet of things remote monitoring method based on crowd sensing

Similar Documents

Publication Publication Date Title
Hail et al. Caching in named data networking for the wireless internet of things
US8677011B2 (en) Load distribution system, load distribution method, apparatuses constituting load distribution system, and program
JP4652435B2 (en) Optimal operation of hierarchical peer-to-peer networks
Key et al. Path selection and multipath congestion control
JP5944537B2 (en) Communication path management method
Jiang et al. Orchestrating massively distributed CDNs
US20110047272A1 (en) Dissemination of Network Management Tasks in a Distributed Communication Network
CN102469015B (en) Realize method and device, the system of relay selection
Hail Iot-ndn: An iot architecture via named data netwoking (ndn)
KR20160040091A (en) Mobile Application Specific Networks
Cao et al. A geographic multicopy routing scheme for DTNs with heterogeneous mobility
CN116866953A (en) Data transmission system and method
CN113726907B (en) Routing processing method, network element equipment, device and readable storage medium
US10536368B2 (en) Network-aware routing in information centric networking
US20150026333A1 (en) Network system, network management apparatus and application management apparatus
CN105634964B (en) A kind of mobile ad-hoc network and its multicast route method
Viana et al. Twins: a dual addressing space representation for self-organizing networks
KR101310769B1 (en) Smart router and controlling method thereof, and network service system and method using thereof
Shukla et al. Towards software defined low maintenance structured peer-to-peer overlays
Zhao et al. Network resource scheduling for cloud/edge data centers
Lin et al. Proactive multipath routing with a predictive mechanism in software‐defined networks
CN114650296B (en) Information center network copy selection method
Fekih et al. Secure SDN-based in-network caching scheme for CCN
Ruan et al. Scalable and efficient routing protocol for internet of things by clustering cache and diverse paths
CN114338414B (en) Backbone network topology discovery method, device and control equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination