CN114422022A - Air-space-ground integrated network system supporting immersive media and data transmission method - Google Patents
Air-space-ground integrated network system supporting immersive media and data transmission method Download PDFInfo
- Publication number
- CN114422022A CN114422022A CN202210236286.8A CN202210236286A CN114422022A CN 114422022 A CN114422022 A CN 114422022A CN 202210236286 A CN202210236286 A CN 202210236286A CN 114422022 A CN114422022 A CN 114422022A
- Authority
- CN
- China
- Prior art keywords
- network
- module
- satellite
- immersive media
- air
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B7/00—Radio transmission systems, i.e. using radiation field
- H04B7/14—Relay systems
- H04B7/15—Active relay systems
- H04B7/185—Space-based or airborne stations; Stations for satellite systems
- H04B7/18502—Airborne stations
- H04B7/18504—Aircraft used as relay or high altitude atmospheric platform
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B7/00—Radio transmission systems, i.e. using radiation field
- H04B7/14—Relay systems
- H04B7/15—Active relay systems
- H04B7/185—Space-based or airborne stations; Stations for satellite systems
- H04B7/18502—Airborne stations
- H04B7/18506—Communications with or from aircraft, i.e. aeronautical mobile service
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B7/00—Radio transmission systems, i.e. using radiation field
- H04B7/14—Relay systems
- H04B7/15—Active relay systems
- H04B7/185—Space-based or airborne stations; Stations for satellite systems
- H04B7/18502—Airborne stations
- H04B7/18506—Communications with or from aircraft, i.e. aeronautical mobile service
- H04B7/18508—Communications with or from aircraft, i.e. aeronautical mobile service with satellite system used as relay, i.e. aeronautical mobile satellite service
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B7/00—Radio transmission systems, i.e. using radiation field
- H04B7/14—Relay systems
- H04B7/15—Active relay systems
- H04B7/185—Space-based or airborne stations; Stations for satellite systems
- H04B7/1851—Systems using a satellite or space-based relay
- H04B7/18513—Transmission in a satellite or space-based system
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W84/00—Network topologies
- H04W84/02—Hierarchically pre-organised networks, e.g. paging networks, cellular networks, WLAN [Wireless Local Area Network] or WLL [Wireless Local Loop]
- H04W84/04—Large scale networks; Deep hierarchical networks
- H04W84/06—Airborne or Satellite Networks
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Astronomy & Astrophysics (AREA)
- Aviation & Aerospace Engineering (AREA)
- General Physics & Mathematics (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Radio Relay Systems (AREA)
Abstract
The invention discloses an air-space-ground integrated network system supporting immersive media and a data transmission method, wherein the system comprises: the air-space-ground integrated network construction module is used for constructing an air-space-ground integrated network supporting the immersive media according to the satellite network module, the air platform module and the ground network module; the network management module is used for managing the air-space-ground integrated network based on the control cluster module and the deep reinforcement learning module; an edge server for processing and forwarding interactive data of the immersive media for the plurality of users on the LEO satellite. The system can meet the requirement of the real-time property of the immersive media by controlling the cluster module and the deep reinforcement learning module, and can meet the requirement of the interactive property of the immersive media by processing interactive data through the edge server on the satellite, so that the aerospace-ground integrated network system can provide high-quality immersive media service.
Description
Technical Field
The invention relates to the technical field of internet, in particular to an air-space-ground integrated network system supporting immersive media and a data transmission method.
Background
Immersive media has received widespread attention as a new business form. Due to the characteristics of virtual type, immersive type and the like of the immersive media, the immersive media can be applied to the fields of entertainment, medical treatment, education and the like. In the future, the widespread popularity of immersive media will present challenges to network coverage and transmission, among others. In recent years, the concept of air-space-ground integrated network has been proposed, which is considered as an important method for providing wide coverage of future networks and can provide wide access capability for different services. However, the air-space-ground integrated network has limitations in supporting the immersive media service with the characteristics of interactivity, real-time performance and the like.
Thus, there is still a need for improvement and development of the prior art.
Disclosure of Invention
The technical problem to be solved by the present invention is to provide an air-space-ground integrated network system and a data transmission method supporting immersive media, aiming at solving the problem that the air-space-ground integrated network in the prior art has limitations in supporting immersive media services with characteristics of interactivity, real-time performance, etc.
The technical scheme adopted by the invention for solving the problems is as follows:
in a first aspect, an embodiment of the present invention provides an air-space-ground integrated network system supporting immersive media, where the system includes:
the air-space-ground integrated network construction module is used for constructing an air-space-ground integrated network supporting the immersive media according to the satellite network module, the air platform module and the ground network module;
the network management module is used for managing the air-space-ground integrated network based on the control cluster module and the deep reinforcement learning module;
an edge server for processing and forwarding interactive data of the immersive media for the plurality of users on the LEO satellite.
In one implementation, the space-ground integrated network construction module includes:
the satellite network module is used for interstellar link connection and data transmission among satellites;
the aerial platform module is used for providing network connection and transmitting immersive media services for the user according to the high-altitude platform module and the low-altitude platform module;
and the ground network module is used for providing network access service for the user.
In one implementation, the aerial platform module includes:
the high-altitude platform module is used for providing network connection for users in remote areas or rural areas;
and the low-altitude platform module is used for transmitting the immersive media service.
In one implementation, the network management module includes:
the control cluster module is used for managing the air-space-ground integrated network;
the deep reinforcement learning module is used for inputting the network state information and the user experience quality value into a target transmission path of the neural network output immersive media based on the control cluster module; wherein the network state information includes bandwidth and throughput.
In one implementation, the control cluster module includes:
the local controller is used for acquiring first network state information of the aerial platform module and transmitting the first network state information to the central main controller;
the satellite controller is used for transmitting the second network state information of the satellite network module to the central master controller;
and the central master controller is used for receiving the first network state information and the second network state information and integrally controlling the air-space-ground integrated network.
In one implementation, the edge server is further configured to determine a target LEO satellite according to the geographic location of the service request user and the motion trajectory of the satellite.
In a second aspect, an embodiment of the present invention further provides a data transmission method for an air-space-ground integrated network system supporting immersive media, where the method includes: collecting interactive service request information of the immersive media and network information of the immersive media sent by the ground network module through the local controller;
sending the network information and the interactive service request information to a central master controller through a satellite controller;
and receiving the network information and the interactive service request information through the central master controller, and processing and calculating the network information and the interactive service request information so as to realize the integral management and control of the air-space-ground integrated network.
In one implementation, the sending the network information and the interactive service request information to a central general controller by a satellite controller includes:
determining a target transmission path through a deep reinforcement learning module;
processing and calculating the interactive service request information through an edge server to obtain interactive service processing data;
and forwarding the network information and the interactive service processing data to a central main controller on the target transmission path through a satellite controller.
In one implementation, the determining, by the deep reinforcement learning module, a target transmission path includes:
inputting the network state information into a neural network, and monitoring the feedback of the user terminal on the service quality of the output immersive media content in real time to obtain a feedback result; wherein the network state information is used to characterize the bandwidth and throughput of the network;
calculating a user experience quality value of the feedback result;
and inputting the user experience quality value into the neural network, and adjusting parameters of the neural network based on the user experience quality value to obtain a target transmission path output by the neural network.
In one implementation, the processing and calculating the interactive service request information by the edge server to obtain the interactive service processing data includes:
acquiring connection duration and distance between a satellite and a user;
determining a target satellite according to the connection duration and the distance;
and processing and calculating the interactive service request information through an edge server on the target satellite to obtain interactive service processing data.
In one implementation, the determining a target satellite according to the connection duration and the distance includes:
selecting satellites with connection duration meeting a preset threshold value in the air-space-ground integrated network as candidate satellites;
and selecting a satellite with the shortest distance to a current satellite connected with the user from the candidate satellites as a target satellite, wherein the current satellite is a satellite connected with the user before the target satellite is determined.
In one implementation, the processing and calculating the interactive service request information by the edge server on the target satellite to obtain interactive service processing data includes:
decompressing the interactive service request information on an edge server on the target satellite to obtain decompressed data;
and analyzing the type of the decompressed data to obtain interactive service processing data, wherein the interactive service processing data comprises data packet capacity, service type and forwarding equipment.
In a third aspect, an embodiment of the present invention further provides a data transmission device of an air-space-ground integrated network system supporting immersive media, where the device includes:
the data transmission module is used for collecting interactive service request information of the immersive media and network information of the immersive media transmitted by the ground network module through the local controller;
the data forwarding module is used for sending the network information and the interactive service request information to a central master controller through a satellite controller;
and the data receiving module is used for receiving the network information and the interactive service request information by the central master controller and integrally controlling the air-space-ground integrated network.
In a fourth aspect, an embodiment of the present invention further provides a server, including a memory, and one or more programs, where the one or more programs are stored in the memory, and configured to be executed by one or more processors, where the one or more programs include a data transmission method for executing the space-time-integrated network system supporting immersive media according to any of the above.
In a fifth aspect, the present invention further provides a non-transitory computer-readable storage medium, wherein when executed by a processor of an electronic device, the instructions enable the electronic device to execute the data transmission method of the air-space-ground integrated network system supporting immersive media described in any one of the above.
The invention has the beneficial effects that: the system of the embodiment of the invention comprises: the air-space-ground integrated network construction module is used for constructing an air-space-ground integrated network supporting the immersive media according to the satellite network module, the air platform module and the ground network module; the network management module is used for managing the air-space-ground integrated network based on the control cluster module and the deep reinforcement learning module; an edge server for processing and forwarding interactive data of the immersive media for the plurality of users on the LEO satellite. Therefore, the system in the embodiment of the invention can meet the requirement of the immersive media real-time performance by controlling the cluster module and the deep reinforcement learning module, and can meet the requirement of the immersive media interactive performance by processing the interactive data through the edge server on the satellite, so that the air-space-ground integrated network system can provide high-quality immersive media service.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments described in the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a structural diagram of an aerospace-geostationary integrated network system supporting immersive media according to an embodiment of the present invention.
Fig. 2 is a schematic flowchart of a data transmission method of an air-space-ground integrated network system supporting immersive media according to an embodiment of the present invention.
Fig. 3 is a schematic block diagram of a data transmission device of an air-space-ground integrated network system supporting immersive media according to an embodiment of the present invention.
Fig. 4 is a schematic block diagram of an internal structure of a server according to an embodiment of the present invention.
Detailed Description
The invention discloses an air-space-ground integrated network system supporting immersive media and a data transmission method, and in order to make the purposes, technical schemes and effects of the invention clearer and clearer, the invention is further described in detail by referring to the attached drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
As used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may also be present. Further, "connected" or "coupled" as used herein may include wirelessly connected or wirelessly coupled. As used herein, the term "and/or" includes all or any element and all combinations of one or more of the associated listed items.
It will be understood by those skilled in the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
Although the concept of space-ground integrated network is proposed in the prior art, it is considered as an important method for providing wide coverage of future network and providing wide access capability for different services, but the space-ground integrated network has limitations in supporting immersive media services with characteristics of interactivity, real-time performance and the like. In response to the demands of users for immersive media services, such as 4K/8K video, virtual reality services, and telereal-time medical services, customized web services for immersive media services cannot be provided for users in space-time-earth integrated networks.
In order to solve the problems in the prior art, the embodiment provides an air-space-ground integrated network system and a data transmission method supporting immersive media, the system can meet the requirement of the immersive media on real-time performance by controlling a cluster module and a deep reinforcement learning module, and the requirement of the immersive media on interactive performance can be met by processing interactive data through an edge server on a satellite, so that the air-space-ground integrated network system can provide high-quality immersive media services. The system comprises the following components: the air-space-ground integrated network construction module is used for constructing an air-space-ground integrated network supporting the immersive media according to the satellite network module, the air platform module and the ground network module; the network management module is used for managing the air-space-ground integrated network based on the control cluster module and the deep reinforcement learning module; an edge server for processing and forwarding interactive data of the immersive media for the plurality of users on the LEO satellite.
Exemplary device
As shown in fig. 1, an embodiment of the present invention provides an aerospace-ground integrated network system supporting immersive media, the system including: the air-space-ground integrated network construction module is used for constructing an air-space-ground integrated network supporting the immersive media according to the satellite network module, the air platform module and the ground network module; the network management module is used for managing the air-space-ground integrated network based on the control cluster module and the deep reinforcement learning module; an edge server for processing and forwarding interactive data of the immersive media for the plurality of users on the LEO satellite.
Specifically, the satellite network module represents the sky in the air-ground integrated network, the air platform module represents the air in the air-ground integrated network, and the ground network module represents the ground in the air-ground integrated network, so that the satellite network module, the air platform module and the ground network module can form the air-ground integrated network, wherein the satellite network module provides network coverage and immersive media service forwarding capability, the air platform module serves as an auxiliary mode for transmitting immersive media services, and the ground network module provides high-speed network access services for immersive media terminal users. Because the existing air-space-ground integrated network only supports a common network with weak real-time performance and interactivity, the method needs to support an immersive media with stronger real-time performance and interactivity, a network management module is added on the basis of the air-space-ground integrated network, management of the air-space-ground integrated network is realized through a control cluster module and a deep reinforcement learning module in the network management module, specifically, network state information is collected through the control cluster module, then the network state information is input into the deep reinforcement learning module, and routing optimization is performed through the deep reinforcement learning module to obtain a routing strategy; in addition, the control cluster module can manage the space-air-ground integrated network, so that the network management module can realize real-time immersive multimedia services. To meet the interactive needs of immersive media, the design of edge servers is considered. A powerful computing-capable edge server may serve immersive media services with low latency, high computing load characteristics. The edge server is arranged on the LEO satellite in the satellite network module, data processing can be accelerated through the edge server, interactive data of immersive media of a plurality of users can be forwarded, and therefore the edge server can meet interactive requirements of immersive media services. The route optimization thought based on deep reinforcement learning is considered in the controller of the satellite network, the immersive media service can be forwarded and processed in time, and the transmission of the immersive media service with high definition and high frame rate is realized. LEO satellites in the satellite network carry edge servers and can process interactive data in an orbit. Compared with the traditional interactive request processing on the ground, the processing speed is increased, and the requirements of the immersive media service on instantaneity, interactivity and the like are met.
In one implementation, the space-ground integrated network construction module includes: the satellite network module is used for interstellar link connection and data transmission among satellites; the aerial platform module is used for providing network connection and transmitting immersive media services for the user according to the high-altitude platform module and the low-altitude platform module; and the ground network module is used for providing network access service for the user. The satellite network module comprises a GEO satellite and an LEO satellite, the satellites are connected through an interstellar link such as microwave or laser, the GEO satellite is a key for realizing global network coverage, and the low-delay characteristic of the LEO satellite can provide forwarding and transmission capacity of services for media services. The aerial platform module includes: the high-altitude platform module is used for providing stable network connection for users in remote areas or rural areas and mainly comprises hot air balloons; the low-altitude platform module is used for transmitting immersive media services, consists of an airplane and an unmanned aerial vehicle, and has the characteristics of easiness in deployment, low cost and the like. In another implementation, deploying wireless access terminals on some low-altitude platforms with high mobility and low latency may be used as an aid in the delivery of immersive media services. The collected immersive media flow data can be transmitted to a ground management center through a ground base station through a wireless signal. The ground network module is used as a main mode for providing the immersive media service, has the characteristics of low time delay, low power consumption and the like, and provides high-speed network access service for users. Diversified immersive media service requirements and various media terminals can be interconnected and intercommunicated through a ground network. The data center of the ground network is used as the key of data storage and information exchange and is the core for realizing data processing and network control in the air-space-ground integrated network.
In one implementation, the network management module includes: the control cluster module is used for managing the air-space-ground integrated network; the deep reinforcement learning module is used for inputting the network state information and the user experience quality value into a target transmission path of the neural network output immersive media based on the control cluster module; wherein the network state information includes bandwidth and throughput. In practice, in order to improve the efficient management capability of the air-space-ground network, a concept that a control plane is separated from a data plane by a multi-layer SDN controller is introduced, a control cluster module is designed in an air-space-ground integrated architecture and used for improving the self-control capability of the network, each satellite in the network is provided with a control unit, and the SDN controllers are respectively placed in a satellite network module, an air platform module and a ground network module. The control cluster module is an SDN controller cluster and is used for managing an air-space-ground integrated network. In this embodiment, the control cluster module includes: the local controller is used for acquiring first network state information of the aerial platform module and transmitting the first network state information to the central main controller; the satellite controller is used for transmitting the second network state information of the satellite network module to the central master controller; and the central master controller is used for receiving the first network state information and the second network state information and integrally controlling the air-space-ground integrated network. The local controller is also an SDN controller which is arranged in the aerial platform module and can acquire first network state information of the aerial platform module in real time and send the first network state information to the central master controller, the satellite controller is also an SDN controller which is arranged in the satellite network module and can acquire second network state information of the satellite network module in real time and send the second network state information to the central master controller, the central master controller is deployed in the ground network module, and the central master controller receives the first network state information and the second network state information and integrally controls the aerial-ground integrated network. In addition, when the immersive media service is transmitted, a plurality of transmission paths from a source node (immersive media content) to a destination node (user terminal) exist in the air-ground integrated network, which network is more suitable for the current network environment needs to be determined according to the domain controller (transmitted through a ground network or a satellite network), and the satellite network is in a dynamic change process, and is subjected to frequent switching processes, so that the switching causes transmission delay, jamming and other phenomena. Therefore, the network state information is collected through a satellite controller deployed on the LEO satellite network, a deep reinforcement learning module is utilized to make a path selection strategy in real time, and the path selection strategy is issued to the source node. In the deep learning module, initial network state information (network state information including bandwidth, throughput, etc.) and user experience quality values are taken as input data of the neural network. A deep reinforcement learning method is utilized, a path selection strategy is made for transmitting media services in real time, the next network state is learned and adjusted according to the previous network state of the neural network, the initial state of input data is in a matrix form, and values in each matrix represent information such as link bandwidth and throughput. The method comprises the steps of monitoring quality of service (QoS) feedback of a user terminal for current transmission immersive media content in real time, calculating a current user quality of experience (QoE) value according to the QoS, wherein the user QoE feedback refers to scoring of the current media quality when a user receives multimedia content, the QoE feedback is fed back to an SDN controller on an LEO satellite to carry out routing decision, when the quality of service of immersive media service received by the user terminal reaches an expected user quality of experience, an immersive media content transmission path is distributed, and otherwise, path selection is carried out through a deep reinforcement learning module. The user QoE also adjusts the "bandwidth and throughput" allocated next (increases or decreases the bandwidth and throughput), because the network transmission process may pass through different nodes, called links between nodes, and end-to-end called paths. The different links form a path, and the adjustment of the bandwidth and the throughput is the adjustment of the bandwidth and the throughput on each link. In addition, the user QoE feedback also changes the routing path, so that the path selection strategy of the network can be adjusted in real time through the QoE. The transmission link can be adjusted in time through the deep reinforcement learning module, and the purpose of providing high-quality media content is achieved. And according to the feedback of the deep reinforcement learning network, the routing strategy of the network is timely adjusted, and the immersive media content is distributed to a proper link for transmission. In this embodiment, a source node sends media content (e.g., video) to a user side (destination node), an initial bandwidth, a path, and the like are already allocated in advance, the bandwidth of a network is adjusted in time through QoE feedback of the user side, and after QoE is input to a neural network, a next node of a target path is selected (i.e., a routing table is updated) through a deep reinforcement learning module, and a transmission path of the media content is updated in time. Because the control cluster module and the deep reinforcement learning module are arranged on the LEO satellite, the LEO satellite can provide low-delay network access service for immersive media service.
In another implementation, the edge server is further configured to determine a target LEO satellite according to the geographic location of the service request user and the motion trajectory of the satellite. The problem of switching of edge servers is involved because the interactive service does not end in a short time, but frequent switching causes delay caused by server migration. Therefore, the selection strategy at the edge server can predict the target LEO satellite to be switched because the LEO satellite is doing regular motion. The edge server is arranged on an LEO satellite of the satellite network module, when a ground user initiates an interactive service request, such as a VR physical training request, the edge server on one LEO satellite is selected as the interactive server in the current network state through the distance of the ground user, then whether the interactive server is switched to the next satellite is judged, if yes, a target LEO satellite is determined according to the geographical position of the user with the immersive media service request and the motion track of the satellite, and if not, the LEO satellite is continuously selected as the interactive server in the current network state. In one implementation, the decision for the next target satellite to be switched is jointly performed according to the geographic position of the immersive media service request user and the motion trajectory of the LEO satellite, specifically, the connection duration of the LEO satellite in the air-space-ground integrated network is calculated, an online satellite with the connection duration being more than a preset length (such as 2 hours) is used as a candidate LEO satellite, then the distance between the satellite in the candidate LEO satellite and the current satellite connected with the user is calculated, and the LEO satellite closest to the connection duration is used as the next switching LEO satellite, that is, the target LEO satellite. An on-orbit processing edge server is deployed on the LEO satellite, and multi-user interactive immersive media data can be directly calculated, processed and issued on the satellite, so that the network bandwidth is saved, and meanwhile, the time delay of the network is reduced. The method comprises the steps that a request is sent to an LEO satellite, the LEO satellite forwards the request to a ground network, and the ground network executes a calculation process.
Exemplary method
The embodiment provides a data transmission method of an air-space-ground integrated network system supporting immersive media, and the method can be applied to a server of the Internet. As shown in fig. 2, the method includes the following steps:
s100, collecting interactive service request information of the immersive media and network information of the immersive media sent by a ground network module through a local controller;
specifically, the local controller is also an SDN controller, and is arranged in the aerial platform module, and is capable of acquiring, in real time, interactive service request information of the immersive media and network information of the immersive media, which are sent by the ground network module and collected by the aerial platform module, and sending the interactive service request information and the network information of the immersive media to the central master controller.
After the above steps are performed, the following steps as shown in fig. 2 can be performed:
s200, sending the network information and the interactive service request information to a central master controller through a satellite controller;
specifically, the satellite controller also adopts an SDN controller, which is arranged in the satellite network module, and can acquire the network information and the interactive service request information collected by the satellite network module in real time and send the network information and the interactive service request information to the central general controller. Correspondingly, the step of sending the network information and the interactive service request information to the central master controller through the satellite controller comprises the following steps: determining a target transmission path through a deep reinforcement learning module; in one implementation, the determining, by the deep reinforcement learning module, a target transmission path includes: inputting the network state information into a neural network, and monitoring the feedback of the user terminal on the service quality of the output immersive media content in real time to obtain a feedback result; wherein the network state information is used to characterize the bandwidth and throughput of the network; calculating a user experience quality value of the feedback result; and inputting the user experience quality value into the neural network, and adjusting parameters of the neural network based on the user experience quality value to obtain a target transmission path output by the neural network.
In practice, in the deep learning module, initial network state information (network state information is used for characterizing bandwidth, throughput and the like) and user experience quality values are used as input data of the neural network. A deep reinforcement learning method is utilized, a path selection strategy is made for transmitting media services in real time, the next network state is learned and adjusted according to the previous network state of the neural network, the initial state of input data is in a matrix form, and values in each matrix represent information such as link bandwidth and throughput. The method comprises the steps of monitoring quality of service (QoS) feedback of a user terminal for current transmission immersive media content in real time, calculating a current user quality of experience (QoE) value according to the QoS, wherein the user QoE feedback refers to scoring of the current media quality when a user receives multimedia content, and feeding the user QoE back to an SDN controller on an LEO satellite to perform routing decision so as to obtain a target transmission path and adjust the bandwidth and throughput allocated in the next step (so that the bandwidth and the throughput are increased or reduced).
After a target transmission path output by the neural network is obtained, processing calculation is carried out on the interactive service request information through an edge server to obtain interactive service processing data; correspondingly, the processing and calculation of the interactive service request information by the edge server to obtain the interactive service processing data comprises the following steps: acquiring connection duration and distance between a satellite and a user; determining a target satellite according to the connection duration and the distance; and processing and calculating the interactive service request information through an edge server on the target satellite to obtain interactive service processing data.
In this embodiment, the connection duration and distance between the satellite and the user are first obtained; then, determining a target satellite, wherein the step of determining the target satellite according to the connection duration and the distance comprises the following steps: selecting satellites with connection duration meeting a preset threshold value in the air-space-ground integrated network as candidate satellites; and selecting a satellite with the shortest distance to a current satellite connected with the user from the candidate satellites as a target satellite, wherein the current satellite is a satellite connected with the user before the target satellite is determined. For example: the method comprises the steps of taking an online satellite (a satellite in a connected state in the network) with the connection duration more than a preset length (such as 2 hours) in the air-space-ground integrated network as a candidate LEO satellite, then calculating the distance between the satellite in the candidate LEO satellite and a current satellite connected with a user, and taking the LEO satellite closest to the satellite as a next switching LEO satellite, namely a target LEO satellite.
After the target satellite is obtained, the step of processing and calculating the interactive service request information through the edge server on the target satellite to obtain interactive service processing data may be performed, and correspondingly, the step of processing and calculating the interactive service request information through the edge server on the target satellite to obtain the interactive service processing data includes the following steps: decompressing the interactive service request information on an edge server on the target satellite to obtain decompressed data; and analyzing the type of the decompressed data to obtain interactive service processing data, wherein the interactive service processing data comprises data packet capacity, service type and forwarding equipment.
Specifically, when a user initiates an immersive media service request, and the air-space-ground integrated system receives the request, the system does not know what information is received, and since the information is compressed and transmitted to save bandwidth, the information needs to be decompressed to obtain decompressed data, and then the decompressed data needs to be type-resolved to obtain interactive service processing data, where the interactive service processing data includes a data packet capacity, a service type, and a forwarding device. And finally, forwarding the network information and the interactive service processing data to a central main controller on the target transmission path through a satellite controller after the interactive service processing data and the target transmission path are obtained.
After obtaining the network information and the interactive service processing data, the following steps as shown in fig. 2 may be performed:
s300, receiving the network information and the interactive service request information through the central master controller, and processing and calculating the network information and the interactive service request information to realize the integral management and control of the air-space-ground integrated network.
Specifically, the network information includes first network state information and second network state information, a central general controller is deployed in a ground network module, the central general controller in the system receives the first network state information, the second network state information and interactive service request information, and processes and calculates the network information and the interactive service request information, for example, the network information and the interactive service request information are decompressed first to obtain decompressed data, and then the decompressed data is subjected to type analysis to obtain the quantity packet capacity, the type and forwarding equipment of the interactive services, so that the air-space-ground integrated network is integrally controlled.
An embodiment of the present invention further provides a data transmission apparatus of an air-space-ground integrated network system supporting immersive media, as shown in fig. 3, the apparatus includes a data sending module 401, a data forwarding module 402, and a data receiving module 403, where:
the data sending module 401 is used for collecting interactive service request information of the immersive media and network information of the immersive media sent by the ground network module through the local controller;
a data forwarding module 402, configured to send the network information and the interactive service request information to a central general controller through a satellite controller;
and a data receiving module 403, configured to receive the network information and the interactive service request information by the central general controller, and perform overall control on the air-space-ground integrated network.
Based on the above embodiments, the present invention further provides a server, and a schematic block diagram thereof may be as shown in fig. 4. The server comprises a processor, a memory, a network interface, a display screen and a temperature sensor which are connected through a system bus. Wherein the processor of the server is configured to provide computing and control capabilities. The memory of the server comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The network interface of the server is used for communicating with an external terminal through network connection. The computer program is executed by a processor to implement a data transmission method of an air-space-ground integrated network system supporting immersive media. The display screen of the server can be a liquid crystal display screen or an electronic ink display screen, and the temperature sensor of the server is arranged in the server in advance and used for detecting the operating temperature of internal equipment.
It will be appreciated by those skilled in the art that the schematic diagram of fig. 4 is only a block diagram of a portion of the structure associated with the inventive arrangements and does not constitute a limitation to the servers to which the inventive arrangements are applied, and that a particular server may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, a server is provided that includes a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by one or more processors the one or more programs include instructions for: collecting interactive service request information of the immersive media and network information of the immersive media sent by the ground network module through the local controller;
sending the network information and the interactive service request information to a central master controller through a satellite controller;
and the central master controller receives the network information and the interactive service request information and integrally controls the air-space-ground integrated network.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, databases, or other media used in embodiments provided herein may include non-volatile and/or volatile memory. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
In summary, the present invention discloses an air-space-ground integrated network system and a data transmission method supporting immersive media, wherein the system includes: the air-space-ground integrated network construction module is used for constructing an air-space-ground integrated network supporting the immersive media according to the satellite network module, the air platform module and the ground network module; the network management module is used for managing the air-space-ground integrated network based on the control cluster module and the deep reinforcement learning module; an edge server for processing and forwarding interactive data of the immersive media for the plurality of users on the LEO satellite. The system can meet the requirement of the real-time property of the immersive media by controlling the cluster module and the deep reinforcement learning module, and can meet the requirement of the interactive property of the immersive media by processing interactive data through the edge server on the satellite, so that the aerospace-ground integrated network system can provide high-quality immersive media service.
Based on the above embodiments, the present invention discloses an aerospace-ground integrated network system and a data transmission method supporting immersive media, it should be understood that the application of the present invention is not limited to the above examples, and it will be apparent to those skilled in the art that modifications and changes can be made in the light of the above description, and all such modifications and changes are intended to fall within the scope of the appended claims.
Claims (15)
1. An aerospace-geostationary network system supporting immersive media, the system comprising:
the air-space-ground integrated network construction module is used for constructing an air-space-ground integrated network supporting the immersive media according to the satellite network module, the air platform module and the ground network module;
the network management module is used for managing the air-space-ground integrated network based on the control cluster module and the deep reinforcement learning module;
an edge server for processing and forwarding interactive data of the immersive media for the plurality of users on the LEO satellite.
2. The integrated air-space-ground network system supporting immersive media of claim 1, wherein the integrated air-space-ground network construction module comprises:
the satellite network module is used for interstellar link connection and data transmission among satellites;
the aerial platform module is used for providing network connection and transmitting immersive media services for the user according to the high-altitude platform module and the low-altitude platform module;
and the ground network module is used for providing network access service for the user.
3. The integrated air-space-ground network system supporting immersive media of claim 2, wherein the aerial platform module comprises:
the high-altitude platform module is used for providing network connection for users in remote areas or rural areas;
and the low-altitude platform module is used for transmitting the immersive media service.
4. The integrated aerospace-terrestrial network system with immersive media support of claim 1, wherein the network management module comprises:
the control cluster module is used for managing the air-space-ground integrated network;
the deep reinforcement learning module is used for inputting the network state information and the user experience quality value into a target transmission path of the neural network output immersive media based on the control cluster module; wherein the network state information includes bandwidth and throughput.
5. The integrated aerospace-terrestrial network system with immersive media support of claim 4, wherein the control cluster module comprises:
the local controller is used for acquiring first network state information of the aerial platform module and transmitting the first network state information to the central main controller;
the satellite controller is used for transmitting the second network state information of the satellite network module to the central master controller;
and the central master controller is used for receiving the first network state information and the second network state information and integrally controlling the air-space-ground integrated network.
6. The integrated aerospace-geostationary network system with immersive media support of claim 1, wherein the edge server is further configured to determine a target LEO satellite based on a geographic location of a user requesting the service and a motion trajectory of the satellite.
7. A data transmission method of the air-space-ground integrated network system supporting immersive media according to any of claims 1 to 6, wherein the method comprises:
collecting interactive service request information of the immersive media and network information of the immersive media sent by the ground network module through the local controller;
sending the network information and the interactive service request information to a central master controller through a satellite controller;
and receiving the network information and the interactive service request information through the central master controller, and processing and calculating the network information and the interactive service request information so as to realize the integral management and control of the air-space-ground integrated network.
8. The data transmission method of the air-space-ground integrated network system supporting immersive media of claim 7, wherein the sending the network information and the interactive service request information to the central general controller through the satellite controller comprises:
determining a target transmission path through a deep reinforcement learning module;
processing and calculating the interactive service request information through an edge server to obtain interactive service processing data;
and forwarding the network information and the interactive service processing data to a central main controller on the target transmission path through a satellite controller.
9. The data transmission method of the aerospace-geostationary network system supporting immersive media of claim 8, wherein the determining, by the deep reinforcement learning module, a target transmission path comprises:
inputting the network state information into a neural network, and monitoring the feedback of the user terminal on the service quality of the output immersive media content in real time to obtain a feedback result; wherein the network state information is used to characterize the bandwidth and throughput of the network;
calculating a user experience quality value of the feedback result;
and inputting the user experience quality value into the neural network, and adjusting parameters of the neural network based on the user experience quality value to obtain a target transmission path output by the neural network.
10. The data transmission method of the air-space-ground integrated network system supporting immersive media of claim 8, wherein the processing and calculating the interactive service request information by the edge server to obtain interactive service processing data comprises:
acquiring connection duration and distance between a satellite and a user;
determining a target satellite according to the connection duration and the distance;
and processing and calculating the interactive service request information through an edge server on the target satellite to obtain interactive service processing data.
11. The method for data transmission of an integrated air-space-ground network system supporting immersive media of claim 10, wherein said determining a target satellite based on the connection duration and the distance comprises:
selecting satellites with connection duration meeting a preset threshold value in the air-space-ground integrated network as candidate satellites;
and selecting a satellite with the shortest distance to a current satellite connected with the user from the candidate satellites as a target satellite, wherein the current satellite is a satellite connected with the user before the target satellite is determined.
12. The data transmission method of the air-space-ground integrated network system supporting immersive media of claim 10, wherein the processing and calculating the interactive service request information by the edge server on the target satellite to obtain interactive service processing data comprises:
decompressing the interactive service request information on an edge server on the target satellite to obtain decompressed data;
and analyzing the type of the decompressed data to obtain interactive service processing data, wherein the interactive service processing data comprises data packet capacity, service type and forwarding equipment.
13. A data transmission apparatus of an air-space-ground integrated network system supporting immersive media, the apparatus comprising:
the data transmission module is used for collecting interactive service request information of the immersive media and network information of the immersive media transmitted by the ground network module through the local controller;
the data forwarding module is used for sending the network information and the interactive service request information to a central master controller through a satellite controller;
and the data receiving module is used for receiving the network information and the interactive service request information by the central master controller and integrally controlling the air-space-ground integrated network.
14. A server comprising a memory, and one or more programs, wherein the one or more programs are stored in the memory, and wherein the one or more programs being configured to be executed by the one or more processors comprises instructions for performing the method of any of claims 7-12.
15. A non-transitory computer-readable storage medium, wherein instructions in the storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the method of any of claims 7-12.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210236286.8A CN114422022B (en) | 2022-03-11 | 2022-03-11 | Air-space-ground integrated network system supporting immersive media and data transmission method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210236286.8A CN114422022B (en) | 2022-03-11 | 2022-03-11 | Air-space-ground integrated network system supporting immersive media and data transmission method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114422022A true CN114422022A (en) | 2022-04-29 |
| CN114422022B CN114422022B (en) | 2022-09-13 |
Family
ID=81263135
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210236286.8A Active CN114422022B (en) | 2022-03-11 | 2022-03-11 | Air-space-ground integrated network system supporting immersive media and data transmission method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114422022B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115514407A (en) * | 2022-07-28 | 2022-12-23 | 鹏城实验室 | Low earth orbit satellite network routing method, system and computer readable storage medium |
| CN116388840A (en) * | 2023-03-21 | 2023-07-04 | 广州爱浦路网络技术有限公司 | Satellite and ground communication split access method and device of user terminal and storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107294592A (en) * | 2017-06-16 | 2017-10-24 | 大连大学 | A kind of satellite network and its construction method based on distributed SDN |
| CN107846371A (en) * | 2017-10-31 | 2018-03-27 | 广东电网有限责任公司电力调度控制中心 | A kind of multimedia service QoE resource allocation methods |
| CN110868455A (en) * | 2019-10-29 | 2020-03-06 | 北京邮电大学 | Computing unloading method and system based on air-space-ground remote Internet of things |
| CN111342993A (en) * | 2020-02-03 | 2020-06-26 | 西安交通大学 | SDN-based air-space-ground controller deployment architecture and control method |
| US20210083763A1 (en) * | 2019-09-13 | 2021-03-18 | Loon Llc | Handover coordination for large area coverage |
| CN113316196A (en) * | 2021-05-10 | 2021-08-27 | 北京科技大学 | Resource allocation method and device in satellite-ground cooperative network based on edge cache |
| CN113346944A (en) * | 2021-06-28 | 2021-09-03 | 上海交通大学 | Time delay minimization calculation task unloading method and system in air-space-ground integrated network |
| CN114153572A (en) * | 2021-10-27 | 2022-03-08 | 中国电子科技集团公司第五十四研究所 | Calculation unloading method for distributed deep learning in satellite-ground cooperative network |
-
2022
- 2022-03-11 CN CN202210236286.8A patent/CN114422022B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107294592A (en) * | 2017-06-16 | 2017-10-24 | 大连大学 | A kind of satellite network and its construction method based on distributed SDN |
| CN107846371A (en) * | 2017-10-31 | 2018-03-27 | 广东电网有限责任公司电力调度控制中心 | A kind of multimedia service QoE resource allocation methods |
| US20210083763A1 (en) * | 2019-09-13 | 2021-03-18 | Loon Llc | Handover coordination for large area coverage |
| CN110868455A (en) * | 2019-10-29 | 2020-03-06 | 北京邮电大学 | Computing unloading method and system based on air-space-ground remote Internet of things |
| CN111342993A (en) * | 2020-02-03 | 2020-06-26 | 西安交通大学 | SDN-based air-space-ground controller deployment architecture and control method |
| CN113316196A (en) * | 2021-05-10 | 2021-08-27 | 北京科技大学 | Resource allocation method and device in satellite-ground cooperative network based on edge cache |
| CN113346944A (en) * | 2021-06-28 | 2021-09-03 | 上海交通大学 | Time delay minimization calculation task unloading method and system in air-space-ground integrated network |
| CN114153572A (en) * | 2021-10-27 | 2022-03-08 | 中国电子科技集团公司第五十四研究所 | Calculation unloading method for distributed deep learning in satellite-ground cooperative network |
Non-Patent Citations (4)
| Title |
|---|
| LINHUI WEI等: ""Service Customized Space-Air-Ground Integrated Network for Immersive Media:Architecture,Key Technologies,and Prospects"", 《IEEE CHINA COMMUNICATIONS》 * |
| LINHUI WEI等: ""Service Customized Space-Air-Ground Integrated Network for Immersive Media:Architecture,Key Technologies,and Prospects"", 《IEEE CHINA COMMUNICATIONS》, vol. 19, no. 1, 25 January 2022 (2022-01-25), pages 1 - 5, XP011898920, DOI: 10.23919/JCC.2022.01.001 * |
| 唐清清等: "面向空天地一体化网络的移动边缘计算技术", 《无线电通信技术》, vol. 47, no. 001, 31 December 2021 (2021-12-31), pages 27 - 34 * |
| 牛志升等: "面向沉浸式体验的空天地一体化车联网体系架构与关键技术", 《物联网学报》, vol. 1, no. 02, 30 September 2017 (2017-09-30), pages 17 - 26 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115514407A (en) * | 2022-07-28 | 2022-12-23 | 鹏城实验室 | Low earth orbit satellite network routing method, system and computer readable storage medium |
| CN116388840A (en) * | 2023-03-21 | 2023-07-04 | 广州爱浦路网络技术有限公司 | Satellite and ground communication split access method and device of user terminal and storage medium |
| CN116388840B (en) * | 2023-03-21 | 2023-10-03 | 广州爱浦路网络技术有限公司 | Satellite and ground communication split access method and device of user terminal and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114422022B (en) | 2022-09-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109391681B (en) | MEC-based V2X mobility prediction and content caching offloading scheme | |
| US11206082B2 (en) | Temporospatial software-defined networking for NGSO satellite networks | |
| CA3093368C (en) | Hybrid leo/haps constellation for fixed broadband | |
| JP7319495B2 (en) | Spatio-Temporal Software-Defined Networking for NGSO Satellite Networks | |
| CN112543357B (en) | Stream media data transmission method based on DASH protocol | |
| CN114422022B (en) | Air-space-ground integrated network system supporting immersive media and data transmission method | |
| Seo et al. | Combined time bound optimization of control, communication, and data processing for FSO‐based 6G UAV aerial networks | |
| WO2018200690A1 (en) | Temporospatial software-defined networking for ngso satellite networks | |
| JP2023544478A (en) | Hybrid software-defined networking and mobile ad-hoc networking routing in mesh networks | |
| Han et al. | Space edge cloud enabling service migration for on-orbit service | |
| Yang et al. | A synergic architecture for content distribution in integrated satellite and terrestrial networks | |
| CN114928395A (en) | BIER-based heaven-earth integrated multicast network communication method and system | |
| Liu et al. | User-Driven Cache Replacement Strategy for Satellite-Terrestrial Networks Based on SDN | |
| CN111555979B (en) | Route optimization method for aviation self-organizing network | |
| Tang et al. | Cooperative Caching in Satellite-Terrestrial Integrated Networks: A Region Features aware Approach | |
| Yang et al. | Dynamic Caching Routing Strategy for LEO Satellite Nodes Based on Gradient Boosting Regression Tree | |
| Zhang et al. | Adaptive Drones and Federated Learning: A New Paradigm for Multimedia IoT Networks | |
| Yang et al. | Multi-Agent Fingerprints-Enhanced Distributed Intelligent Handover Algorithm in LEO Satellite Networks | |
| Xu et al. | Distributed and multi‐layer hierarchical controller placement in software‐defined satellite‐terrestrial network | |
| Leng et al. | Caching-Aware Intelligent Handover Strategy for LEO Satellite Networks. Remote Sens. 2021, 13, 2230 | |
| CN116405088A (en) | Time slice-based on-board label forwarding method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |