WO2023059778A1 - Réseautage en nuage agrégé pour un réseau cellulaire hybride - Google Patents

Réseautage en nuage agrégé pour un réseau cellulaire hybride Download PDF

Info

Publication number
WO2023059778A1
WO2023059778A1 PCT/US2022/045863 US2022045863W WO2023059778A1 WO 2023059778 A1 WO2023059778 A1 WO 2023059778A1 US 2022045863 W US2022045863 W US 2022045863W WO 2023059778 A1 WO2023059778 A1 WO 2023059778A1
Authority
WO
WIPO (PCT)
Prior art keywords
cellular network
computing platform
cloud computing
function
subnets
Prior art date
Application number
PCT/US2022/045863
Other languages
English (en)
Inventor
Sourabh Gupta
Sundeep Goswami
Andrew Trujillo
Ash Khamas
Julio Armenta
Original Assignee
Dish Wireless L.L.C.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US17/960,664 external-priority patent/US20230106597A1/en
Application filed by Dish Wireless L.L.C. filed Critical Dish Wireless L.L.C.
Priority to EP22809548.5A priority Critical patent/EP4413714A1/fr
Publication of WO2023059778A1 publication Critical patent/WO2023059778A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00—Routing or path finding of packets in data switching networks
    • H04L45/58—Association of routers
    • H04L45/586—Association of routers of virtual routers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00—Routing or path finding of packets in data switching networks
    • H04L45/64—Routing or path finding of packets in data switching networks using an overlay routing layer

Definitions

  • a hybrid cellular network system may comprise a cellular radio access network (RAN) comprising a plurality of base stations (BSs). Each base station of the plurality of BSs may comprise an antenna, a physical router; a radio units (RU), and a distributed unit (DU).
  • the system may comprise a plurality of pass-through edge data centers (P-EDCs). Each P-EDC of the plurality of P-EDCs may be in communication with a different subset of BSs of the plurality of BSs.
  • the system may comprise an aggregation data center (ADC) in communication with the plurality of P-EDCs.
  • the ADC may comprise a physical router and a first transit gateway.
  • the system may comprise a virtual edge data center (EDC) executed at an EDC of a cloud computing platform.
  • the EDC may comprise a second transit gateway and a virtual router.
  • Embodiments of such a system may include one or more of the following features: the first transit gateway and the second transit gateway each may analyze cellular network traffic using a whitelist.
  • the first transit gateway and the second transit gateway may manage protocols to permit physical routers of the RAN to communicate with virtual routers executed on the cloud computing platform. Generic routing encapsulation may be used for routing with virtual routers on the cloud computing platform.
  • the system may further comprise a regional data center (RDC) executed on the cloud computing platform.
  • the virtual router of the breakout EDC (B-EDC) routes may traffic to a second virtual router present in the RDC on the cloud computing platform. Data transmitted by the first physical router may be routed by the virtual router of the B-EDC to the second virtual router of the RDC.
  • the system may further comprise a plurality of national data centers (NDCs) executed on the cloud computing platform that may communicate with the RDC via a third virtual router.
  • NDCs national data centers
  • the ADC and the EDC of the clouding computing platform may be co-located at the same facility.
  • the ADC and the EDC of the cloud computing platform may be located at different facilities with a fiber optic connection between the ADC and the EDC of the cloud computing platform.
  • a first P-EDC of the plurality of P-EDCs may be located in a geographic region at least 500 kilometers away from a second P-EDC of the plurality of P-EDCs.
  • the cellular RAN, the plurality of P-EDCs, the ADC, and the B-EDC are part of a 5GNew Radio (NR) cellular network.
  • NR 5GNew Radio
  • a method for using a hybrid cellular network may comprise routing upstream cellular network traffic from a set of base stations (BSs) of a plurality of BSs of a radio access network (RAN) of the hybrid cellular network to a pass-through edge data center (P-EDC) of a plurality of P-EDCs.
  • BSs base stations
  • RAN radio access network
  • P-EDC pass-through edge data center
  • Each BS of the plurality of BSs may comprise an antenna, a physical router; a radio unit (RU), and a distributed unit (DU).
  • Each P-EDC of the plurality of P-EDCs may be in communication with a different set of BSs of the plurality of BSs.
  • the method may comprise routing the upstream cellular network traffic from the P-EDCs to an aggregation data center (ADC) that may be in communication with the plurality of P-EDCs.
  • the ADC may comprise a physical router and a first transit gateway.
  • the method may comprise processing, by the first transit gateway at the ADC, the upstream cellular network traffic.
  • the method may comprise routing, by the ADC, the processed upstream cellular network traffic to a virtual edge data center (EDC) on a public cloud computing platform.
  • EDC virtual edge data center
  • the method may comprise processing, by the B-EDC on the public cloud computing platform, the processed upstream cellular network traffic using a second transit gateway.
  • the method may comprise processing, by a network function of a cellular network core executed on the public cloud computing platform, the processed upstream cellular network traffic received from the second transit gateway of the B-EDC.
  • Embodiments of such a method may include one or more of the following features: processing by the first transit gateway may comprise analyzing the upstream cellular network traffic using a first whitelist. Processing by the second transit gateway may comprise analyzing the processed upstream cellular network traffic using a second whitelist. Generic routing encapsulation (GRE) may be used for routing on the public cloud computing platform. Processing the processed upstream cellular network traffic may further comprise using a virtual router to route the processed upstream cellular network traffic. The method may further comprise routing, by the virtual router, the upstream cellular network traffic to a second virtual router present in a regional data center (RDC) executed on the public cloud computing platform.
  • RDC regional data center
  • the ADC and the B-EDC may be co-located a same facility.
  • the ADC and the B-EDC executed on the public cloud computing platform may be located at different facilities with a fiber optic connection between the ADC and the public cloud computing platform.
  • the cellular RAN, the plurality of P-EDCs, the ADC, and the B-EDC are part of a 5G New Radio (NR) cellular network.
  • NR 5G New Radio
  • a hybrid cloud cellular network system may comprise a cellular radio access network (RAN) comprising a plurality of base stations (BSs), each base station of the plurality of BSs comprising: one or more antennas, one or more radio units (RUs), and a distributed unit (DU).
  • the system may comprise a plurality of national data centers (NDCs).
  • NDCs national data centers
  • the plurality of NDCs may be executed on a public cloud computing platform.
  • the public cloud computing platform may be communicatively connected with the RAN at a plurality of locations.
  • the system may comprise a plurality of network functions (NFs).
  • NFs network functions
  • An instance of each NF may be executed within each NDC of the plurality of NDCs on the public cloud computing platform.
  • the system may comprise a cellular network database function.
  • An instance of the cellular network database function may be executed within each NDC of the plurality of NDCs on the public cloud computing platform.
  • Each instance of the cellular network database function may update each other instance of the cellular network database function across the plurality of NDCs.
  • Embodiments of such a system may include one or more of the following features: a first set of NDCs of the plurality of NDCs may be part of a first data center group region. A second set of NDCs of the plurality of NDCs may be part of a second data center group region. A third set of NDCs of the plurality of NDCs may be part of a third data center group region.
  • the plurality of NFs may comprise: a network slice selection function (NSSF), a network exposure function (NEF), a security edge protection proxy (SEPP), a binding support function (BSF), a policy control function (PCF), a charging function (CHF), a service communication proxy (SCP), and a short message service function (SMSF).
  • NSSF network slice selection function
  • NEF network exposure function
  • SEPP security edge protection proxy
  • BSF binding support function
  • PCF policy control function
  • CHF charging function
  • SCP service communication proxy
  • SMSF short message service function
  • the system may further comprise a plurality of regional data centers (RDCs). At least one RDC of the plurality of RDCs may be implemented at a same data center group at which an NDC of the plurality of NDCs may be implemented and at least one RDC of the plurality of RDCs may be implemented at different data center group at which no NDC of the plurality of NDCs may be executed.
  • Each RDC may implement a second plurality of NFs, comprising: an accessibility and mobility management function (AMF), a user plane function (UPF), and a session management function (SMF).
  • AMF accessibility and mobility management function
  • UPF user plane function
  • SMF session management function
  • Each NDC within a regional data center cluster may be communicatively coupled with each RDC within its data center group region.
  • a first instance of a NF at a first NDC within the first data center group region may provide geographic redundancy for a second instance of the NF at a second NDC within the second data center group region.
  • the system may further comprise plurality of edge data centers (EDC). Each EDC may be executed by a lower tier data center group than the plurality of NDCs and the plurality of RDCs.
  • the cellular network database function is a universal data repository (UDR) that stores data for the plurality of NFs.
  • the hybrid cloud cellular network system may be a 5GNew Radio (NR) cellular network and a cellular network core of the hybrid cloud cellular network system may be 5G.
  • NR 5GNew Radio
  • a method for establishing geographic redundancy and high availability for a hybrid cellular network may comprise establishing a plurality of national data centers (NDCs) on a public cloud computing platform.
  • the public cloud computing platform may be communicatively connected with a radio access network (RAN) of the hybrid cellular network at a plurality of locations.
  • the RAN may comprise a plurality of base stations (BSs), each BS of the plurality of BSs comprising: one or more antennas, one or more radio units (RUs), and a distributed unit (DU).
  • the method may comprise executing, within each NDC of the plurality of NDCs, a plurality of network functions (NFs).
  • NFs network functions
  • the method may comprise executing, within each NDC of the plurality of NDCs, an instance of a cellular network database function on the public cloud computing platform. Each instance of the cellular network database function updates each other instance of the cellular network database function across the plurality of NDCs.
  • the method may comprise processing cellular network core traffic for the RAN using the plurality of NDCs including the plurality of NFs and the cellular network database function.
  • Embodiments of such a method may include one or more of the following features: establishing the plurality of NDCs on the public cloud computing platform may comprise establishing a first set of NDCs of the plurality of NDCs as part of a first data center group region. Establishing the plurality of NDCs on the public cloud computing platform may comprise establishing a second set of NDCs of the plurality of NDCs as part of a second data center group region. Establishing the plurality of NDCs on the public cloud computing platform may comprise establishing a third set of NDCs of the plurality of NDCs as part of a third data center group region.
  • the plurality of NFs may comprise: a network slice selection function (NSSF), a network exposure function (NEF), a security edge protection proxy (SEPP), a binding support function (BSF), a policy control function (PCF), a charging function (CHF), a service communication proxy (SCP), and a short message service function (SMSF).
  • the method may further comprise establishing a plurality of regional data centers (RDCs) on the public cloud computing platform.
  • RDCs regional data centers
  • Establishing the plurality of RDCs may comprise establishing at least one RDC of the plurality of RDCs at a same data center group at which an NDC of the plurality of NDCs may be implemented and establishing at least one RDC of the plurality of RDCs at a different data center group at which no NDC of the plurality of NDCs may be established.
  • Each RDC may implement a second plurality of NFs, comprising: an accessibility and mobility management function (AMF), a user plane function (UPF), and a session management function (SMF).
  • AMF accessibility and mobility management function
  • UPF user plane function
  • SMF session management function
  • Each NDC within a regional data center cluster may be communicatively coupled with each RDC within its data center group region.
  • a first instance of a NF at a first NDC within the first data center group region may provide geographic redundancy for a second instance of the NF at a second NDC within the second data center group region.
  • the method may further comprise establishing a plurality of edge data centers (EDC) on the public cloud computing platform. Each EDC may be executed by a lower-tier data center group than the plurality of NDCs and the plurality of RDCs.
  • EDC edge data centers
  • a hybrid cellular network system may comprise a plurality of base stations. Each base station may comprise a radio unit, an antenna, and a distributed unit. The system may comprise a plurality of subnets within a region of a public cloud computing platform. Each subnet of the plurality of subnets may be executed at a different data center of the public cloud computing platform. The system may comprise a plurality of cellular network functions. Each network function of the plurality of network functions may be executed within multiple subnets of the plurality of subnets within the region of the public cloud computing platform. The system may comprise a plurality of virtual routers that manage routing of packets with the plurality of cellular network function in the plurality of subnets.
  • Embodiments of such a system may include one or more of the following features: the plurality of subnets within the region of the public cloud computing platform may collectively function as a national data center (NDC) for the plurality of base stations.
  • NDC national data center
  • the system may further comprise a second plurality of subnets within the region of the public cloud computing platform. Each subnet of the second plurality of subnets may be executed at a different data center of the public cloud computing platform.
  • the second plurality of subnets within the region of the public cloud computing platform may each function as regional data centers (RDCs) for the plurality of base stations.
  • the system may further comprise a second plurality of virtual routers executed on the public cloud computing platform.
  • a virtual router of the second plurality of virtual routers may be executed within each subnet of the second plurality of subnets. Load balancing may be performed among the plurality of cellular network functions executed across the plurality of subnets on the public cloud computing platform. Load balancing may be performed on packets using the plurality of virtual routers.
  • a subnet of the plurality of subnets may be reserved as a backup for failover of network functions from other subnets of the plurality of subnets.
  • a first network function of the plurality of cellular network functions may be executed in each of the plurality of the subnets and a second network function of the plurality of cellular network functions may be executed in each of the plurality of subnets except the subnet reserved as the backup for failover.
  • traffic to be processed by the network function may be partially re-routed to a second network function executed in a second subnet of the plurality of subnets and partially re-routed to a third network function executed in a third subnet of the plurality of subnets.
  • the first network function, the second network function, and the third network function may be separate instances of a same network function.
  • the hybrid cellular network system may operate using 5GNew Radio (NR).
  • a method for using a hybrid cellular network system may comprise establishing, a plurality of subnets within a region of a public cloud computing platform. Each subnet of the plurality of subnets may be executed at a different data center of the public cloud computing platform.
  • the hybrid cellular network system may comprise a plurality of base stations. Each base station may comprise a radio unit, an antenna, and a distributed unit.
  • the method may comprise instantiating a plurality of network functions of the hybrid cellular network system within the plurality of subnets within the region of the public cloud computing platform. Each network function of the plurality of network functions may be executed within multiple subnets of the plurality of subnets within the region of the public cloud computing platform.
  • the method may comprise instantiating a plurality of virtual routers within each subnet of the plurality of subnets.
  • the method may comprise routing packets between the plurality of subnets using the plurality of virtual routers.
  • the plurality of subnets within the region of the public cloud computing platform may collectively function as a national data center (NDC) for the plurality of base stations.
  • the method may further comprise instantiating a second plurality of subnets within the region of the public cloud computing platform. Each subnet of the second plurality of subnets may be executed at a different data center of the public cloud computing platform.
  • Each subnet of the second plurality of subnets within the region of the public cloud computing platform each may host a regional data center (RDC).
  • RDC regional data center
  • the method may further comprise instantiating a second plurality of virtual routers executed on the public cloud computing platform.
  • a virtual router of the second plurality of virtual routers may be executed within each subnet of the second plurality of subnets.
  • a first virtual router and a second virtual router of the plurality of virtual routers may perform routing for a network function of the plurality of network functions.
  • Load balancing may be performed among the plurality of cellular network functions executed across the plurality of subnets on the public cloud computing platform.
  • a subnet of the plurality of subnets may be reserved as a backup for failover of network functions from other subnets of the plurality of subnets.
  • the hybrid cellular network system may operate using 5G New Radio (NR).
  • NR 5G New Radio
  • FIG. 1 illustrates an embodiment of a hybrid cloud cellular network system.
  • FIG. 2 illustrates an embodiment of a cellular network core.
  • FIG. 3A illustrates an embodiment of the architecture for a cloud computing system interconnected with a cellular network radio access network (RAN).
  • RAN radio access network
  • FIG. 3B illustrates an embodiment of the architecture for cloud-implemented components of a hybrid cloud cellular network.
  • FIG. 4 illustrates an embodiment of a virtual router that can be implemented on a public cloud computing platform.
  • FIG. 5 illustrates an embodiment of a hybrid cellular network architecture that integrates virtual and physical routers.
  • FIG. 6 illustrates an embodiment of transit gateways incorporated as part of a hybrid cellular network architecture.
  • FIG. 7 illustrates an embodiment of a method for using a hybrid cellular network architecture that integrates virtual and physical routers via transit gateways.
  • FIG. 8 illustrates an embodiment of the architecture of the hybrid cellular network within a region on a public cloud computing platform.
  • FIG. 9 illustrates an embodiment of a method for establishing high availability within a region of a cloud computing platform for a hybrid cellular network.
  • FIG. 10 illustrates an embodiment of a method for establishing geographic redundancy and high availability for a cloud-implemented cellular network core.
  • a hybrid cellular network relies on a mixture of specialized hardware, general-purpose computing hardware combined with network functions (NFs) implemented as software, and one or more cloud computing platforms on which various cellular network functions are executed.
  • the radio access network (RAN) of the HCN is connected with a public cloud computing platform (PCCP).
  • a public cloud computing platform refers to a cloud computing platform on which many clients operate virtual private clouds (VPCs) on a hardware platform maintained by a separate entity, such as Amazon Web Services (AWS).
  • VPCs virtual private clouds
  • AWS Amazon Web Services
  • Some NFs are implemented locally at base stations (BSs) of the RAN, such as distributed units (DUs).
  • BSs base stations
  • DUs distributed units
  • Such an arrangement involving NFs being operated on hardware owned and operated by the cellular network provider can be referred to as a private cloud.
  • Other, higher level network functions which can logically be part of the RAN, such as centralized units (CUs) or logically part of the cellular network core (e.g., a national data center), such as user plane functions (UPFs), can be implemented on the PCCP.
  • the hardware for the PCCP can be operated and maintained by an entity separate from the HCN and can allow many clients (in addition to the client that operates the HCN) to reserve and use resources of the PCCP, but maintain separate VPCs, thus isolating each entity’s data from other entities.
  • NFs on the PCCP has significant advantages, including the ability to quickly scale implementations of NFs as needed by leveraging the large amounts of computing resources available on the PCCP. While in a conventional cellular network, redundant hardware systems may be implemented in a geographic region in order to provide geographic redundancy (GR) and high availability (HA), GR and HA may need to be achieved differently on a PCCP. Therefore, while a cellular network provider that is implementing an HCN still requires GR and HA, these requirements cannot be achieved using conventional arrangements.
  • GR geographic redundancy
  • HA high availability
  • Various embodiments detailed herein are directed to how to achieve GR and HA on a CCP for an HCN.
  • the structure of the PCCP can be leveraged to implement functions associated with instances of national data centers (NDCs) of the cellular network at one level of the CCP, while regional data centers (RDCs) are implemented at another level of the PCCP, with each level associated with a different class of data center (DC) of the PCCP.
  • NDCs national data centers
  • RDCs regional data centers
  • the HCN may require that data of the HCN be available over its entire geographic footprint to accommodate user equipment (UE) movement. Therefore, a database function may be maintained across the NDCs of the HCN that remains synchronized across each NDC.
  • each NDC may be in communication with RDCs in a particular region.
  • RDCs may implement additional NFs, such as UPFs.
  • one or more edge data centers may be present, that function as an additional layer to provide enhanced service in particular geographic regions, such as by hosting a UPF or other NFs for a particular geographic region.
  • EDCs edge data centers
  • NFs can serve as being in a standby state, such that if another NF within the region fails or experiences high load, cellular network core traffic can be diverted to the standby NF, with the standby NF having access to the same database NF as the NF experiencing the high load or failure.
  • NFs across multiple NDCs may both be active and load balancing may be performed among the NFs. Such arrangements help ensure GR and HA across NFs of the NDCs, RDCs, and the HCN as a whole.
  • Embodiments detailed herein are also directed to how to effectively aggregate RAN upstream and downstream traffic to BSs in order to accommodate a limited number of connections with the PCCP. Connections with the PCCP may only be available in particular locations. A cellular network, however, requires a large number of geographically scattered BSs irrespective of where the PCCP connections are available. Further, connecting individual BSs directly to the CCP, such as from a network architecture or cost perspective, may not be practical. Embodiments detailed herein pair physical hardware operated by the cellular network provider to aggregate connections with a large number of BSs. This architecture can be used to handle geographic regions where no connection with the PCCP is available.
  • While the physical RAN components of the hybrid cellular network can use physical routers, on the PCCP, virtual routers may be implemented. These virtual routers effectively function like the physical routers, but are implemented as software executed on the CCP.
  • multiple transit gateways TGs
  • a first transit gateway can be implemented at a DC operated by the hybrid cellular network operator and a second transit gateway can be implemented at the DC of the CCP with which the DC operated by the hybrid cellular network operator is physically connected.
  • These TGs can serve as firewalls to ensure that only whitelisted traffic is exchanged between the TGs and a protocol conversion may be performed to allow the physical routers of the RAN to communicate with the virtual routers present on the CCP.
  • PCCPs can also allow for multiple instances of a service, such as a network function, to be efficiently executed in different locations.
  • a PCCP can allow for subnets to be a defined.
  • a subnet can refer to a particular range of IP addresses for a client’s virtual private cloud (VPC) on the PCCP.
  • NFs of the HCN can be executed in a particular subnet, which causes the NF to be executed in a particular data center or group of data centers of the PCCP.
  • load balancing and failover at a packet level can be accomplished. Such an arrangement allows for HA within a region.
  • FIG. 1 illustrates a block diagram of a hybrid cellular network system (“system 100”).
  • system 100 Such a hybrid cellular network system is partially implemented using specialized hardware and partially implemented using virtualized cellular network components on a public and/or private cloud computing platform, such as AWS (public cloud) or VMWare (private cloud).
  • System 100 can include a 5G New Radio (NR) cellular network, but other types of cellular networks, such as 6G, 7G, etc., may also be possible.
  • NR 5G New Radio
  • System 100 can include: UE 110 (UE 110-1, UE 110-2, UE 110-3); structure 115; cellular network 120; radio units 125 (“RUs 125”); distributed units 127 (“DUs 127”); centralized unit 129 (“CU 129”); 5G core 139; and orchestrator 138.
  • FIG. 1 represents a component-level view.
  • O-RAN virtualized open radio access network
  • components can be implemented as specialized software executed on general-purpose hardware, except for components that need to receive and transmit RF, the functionality of the various components can be executed by general-purpose servers.
  • the hardware of the cloud-computing platform may be maintained by a separate cloud-service computing platform provider.
  • UE 110 can represent various types of end-user devices, such as cellular phones, smartphones, cellular modems, cellular-enabled computerized devices (e.g., laptop computers), sensor devices, robotic equipment, loT devices, gaming devices, access points (APs), or any computerized device capable of communicating via a cellular network.
  • end-user devices such as cellular phones, smartphones, cellular modems, cellular-enabled computerized devices (e.g., laptop computers), sensor devices, robotic equipment, loT devices, gaming devices, access points (APs), or any computerized device capable of communicating via a cellular network.
  • UE can represent any type of device that has an incorporated 5G interface, such as a 5G modem. Examples can include sensor devices, Internet of Things (loT) devices, manufacturing robots, unmanned aerial (or land-based) vehicles, network-connected vehicles, etc.
  • UE 110 may use RF to communicate with various BSs of cellular network 120.
  • BS 121-1 can include: structure 115-1, RU 125-1, and DU 127-E Structure 115-1 may be any structure to which one or more antennas (not illustrated) of the BS are mounted.
  • Structure 115-1 may be a dedicated cellular tower, a building, a water tower, or any other man-made or natural structure to which one or more antennas can reasonably be mounted to provide cellular coverage to a geographic area.
  • BS 121-2 can include: structure 115-2, RU 125-2, and DU 127-2.
  • Real-world implementations of system 100 can include many (e.g., thousands) of BSs and many CUs and 5G core 139.
  • BS 121-1 can include one or more antennas that allow RUs 125 to communicate wirelessly with UEs 110.
  • RUs 125 can represent an edge of cellular network 120 where data is transitioned to RF for wireless communication.
  • the radio access technology (RAT) used by RU 125 may be 5GNR, or some other RAT.
  • the remainder of cellular network 120 may be based on an exclusive 5G architecture, a hybrid 4G/5G architecture, or some other cellular network architecture that supports cellular network slices.
  • BS 121 may include an RU (e.g., RU 125-1) and a DU (e.g., DU 127-1).
  • One or more RUs may communicate with DU 127-1.
  • RU 125-1 may communicate with DU 127-1.
  • three RUs may be present, each connected with a DU.
  • Different RUs may be present for different portions of the spectrum. For instance, a first RU may operate on the spectrum in the citizens broadcast radio service (CBRS) band while a second RU may operate on a separate portion of the spectrum, such as, for example, band 71.
  • an RU can also operate on three bands.
  • One or more DUs, such as DU 127-1 may communicate with CU 129.
  • an RU, DU, and CU create a gNodeB, which serves as the radio access network (RAN) of cellular network 120.
  • DUs 127 and CU 129 can communicate with 5G core 139.
  • the specific architecture of cellular network 120 can vary by embodiment.
  • Edge cloud server systems (not illustrated) outside of cellular network 120 may communicate, either directly, via the Internet, or via some other network, with components of cellular network 120.
  • DU 127-1 may be able to communicate with an edge cloud server system without routing data through CU 129 or 5G core 139. Other DUs may or may not have this capability.
  • FIG. 1 illustrates various components of cellular network 120
  • other embodiments of cellular network 120 can vary the arrangement, communication paths, and specific components of cellular network 120.
  • RU 125 may include specialized radio access componentry to enable wireless communication with UE 110
  • other components of cellular network 120 may be implemented using either specialized hardware, specialized firmware, and/or specialized software executed on a general-purpose server system.
  • specialized software on general-purpose hardware may be used to perform the functions of components such as DU 127, CU 129, and 5G core 139. Functionality of such components can be co-located or located at disparate physical server systems. For example, certain components of 5G core 139 may be co-located with components of CU 129.
  • CU 129, 5G core 139, and/or orchestrator 138 can be implemented virtually as software being executed by general-purpose computing equipment on cloud-computing platform 128, as detailed herein. Therefore, depending on needs, the functionality of a CU, and/or NFs of the 5G core may be implemented locally to each other and/or specific functions of any given component can be performed by physically separated server systems (e.g., at different DCs). For example, some functions of a CU may be located at a same DC as where NFs of 5G core 139 are executed, while other NFs are executed at a separate DC or on a separate cloud computing system.
  • public cloud-computing platform 128 can execute CU 129, 5 G core 139, and orchestrator 138.
  • 5G core 139 can include NFs such as: a session management function (SMF), a network repository function (NRF), a charging function (CHF), a policy control function (PCF), a unified data management (UDM) function, an authentication server function (AUSF), and an accessibility and mobility management function (AMF).
  • the cloud-computing platform 128 can be a third-party cloud-based computing platform or a cloud-based computing platform operated by the same entity that operates the RAN.
  • Public cloud computing platform 128 may have the ability to devote additional hardware resources to cloud-based cellular network components or implement additional instances of such components when requested.
  • Kubemetes, Docker®, or some other container orchestration platform can be used to create and destroy the logical CU or 5G core NFs and subunits as needed for the cellular network 120 to function properly.
  • Kubemetes allows for container deployment, scaling, and management. As an example, if cellular traffic increases substantially in a region, an additional logical CU or components of a CU may be deployed in a data center near where the traffic is occurring without any new hardware being deployed. (Rather, processing and storage capabilities of the data center would be devoted to the needed functions.) When the need for the logical CU or subcomponents of the CU no longer exists, Kubemetes can allow for removal of the logical CU. Kubemetes can also be used to control the flow of data (e.g., messages) and inject a flow of data to various components. This arrangement can allow for the modification of nominal behavior of various layers.
  • data e.g., messages
  • Orchestrator 138 can represent various software processes executed by underlying computer hardware. Orchestrator 138 can monitor cellular network 120 and determine the amount and location at which cellular network functions should be deployed on the cloud computing platform to meet or attempt to meet service level agreements (SLAs) across slices of the cellular network.
  • SLAs service level agreements
  • Orchestrator 138 can allow for the instantiation of new cloud-based components of cellular network 120.
  • orchestrator 138 can perform a pipeline of calling the CU code from a software repository incorporated as part of, or separate from cellular network 120; pulling corresponding configuration files (e.g. helm charts); creating Kubemetes nodes/pods; loading CU containers; configuring the CU; and activating other support functions (e.g. Prometheus, instances/connections to test tools).
  • a cellular network slice functions as a virtual network operating on an underlying physical cellular network.
  • Operating on cellular network 120 is some number of cellular network slices, such as hundreds or thousands of network slices.
  • Communication bandwidth and computing resources of the underlying physical network can be reserved for individual network slices, thus allowing the individual network slices to reliably meet defined SLA requirements.
  • the QoS and QoE for UE can be varied on different slices.
  • a network slice can be configured to provide sufficient resources for a particular application to be properly executed and delivered (e.g., gaming services, video services, voice services, location services, sensor reporting services, data services, etc.).
  • a cost may be attached to cellular slices: the greater the amount of resources dedicated, the greater the cost to the user; thus optimization between performance and cost is desirable.
  • Particular parameters that can be set for a cellular network slice can include: uplink bandwidth per UE; downlink bandwidth per UE; aggregate uplink bandwidth for a client; aggregate downlink bandwidth for the client; maximum latency; access to particular services; and maximum permissible jitter.
  • Particular network slices may only be reserved in particular geographic regions.
  • a first set of network slices may be present at RU 125-1 and DU 127-1, and a second set of network slices, which may only partially overlap or may be wholly different from the first set, may be reserved at RU 125-2 and DU 127-2.
  • particular cellular network slices may include multiple defined slice layers. Each layer within a network slice may be used to define parameters and other network configurations for particular types of data. For instance, high-priority data sent by a UE may be mapped to a layer having relatively higher QoS parameters and network configurations than lower-priority data sent by the UE that is mapped to a second layer having relatively less stringent QoS parameters and different network configurations.
  • Components such as DUs 127, CU 129, orchestrator 138, and 5G core 139 may include various software components that are required to communicate with each other, handle large volumes of data traffic, and are able to properly respond to changes in the network. In order to ensure not only the functionality and interoperability of such components, but also the ability to respond to changing network conditions and the ability to meet or perform above vendor specifications, significant testing must be performed.
  • FIG. 2 illustrates a block diagram 200 of a cellular network core, which can represent 5G core 139.
  • 5G core 139 as a whole or individual NFs can be implemented on a PCCP.
  • 5G core 139 can be physically distributed across DCs and can perform various core functions of the cellular network.
  • 5G core 139 can include: network resource management components 150; policy management components 160; subscriber management components 170; and packet control components 180.
  • Individual NFs of a cellular network may communicate using a bus-based communication architecture, thus allowing various components of 5G core 139 to communicate with each other directly.
  • 5G core 139 is simplified to show some key NFs. Implementations can involve many additional or alternative NFs.
  • Network resource management components 150 can include: Network Repository Function (NRF) 152 and Network Slice Selection Function (NSSF) 154.
  • NRF 152 can allow 5G network functions (NFs) to register and discover each other via a standards-based application programming interface (API).
  • NSSF 154 can be used by AMF 182 to assist with the selection of a network slice that will serve a particular UE.
  • Policy management components 160 can include: Charging Function (CHF) 162 and Policy Control Function (PCF) 164.
  • CHF 162 allows charging services to be offered to authorized network functions. Converged online and offline charging can be supported.
  • PCF 164 allows for policy control functions and the related 5G signaling interfaces to be supported.
  • Subscriber management components 170 can include: Unified Data Management (UDM) 172 and Authentication Server Function (AUSF) 174.
  • UDM 172 can allow for generation of authentication vectors, user identification handling, NF registration management, and retrieval of UE individual subscription data for slice selection.
  • AUSF 174 performs authentication with UE.
  • Packet control components 180 can include: Access and Mobility Management Function (AMF) 182 and Session Management Function (SMF) 184.
  • AMF 182 can receive connection- and session-related information from UE and is responsible for handling connection and mobility management tasks.
  • SMF 184 is responsible for interacting with the decoupled data plane, creating updating, and removing Protocol Data Unit (PDU) sessions, and managing session context with the User Plane Function (UPF).
  • User plane function (UPF) 190 can be responsible for packet routing and forwarding, packet inspection, QoS handling, and external PDU sessions for interconnecting with a data network (DN) 195 (e.g., the Internet).
  • DN data network
  • Each of these NFs are logically part of a 5G core 139. However, multiple instances of various NFs may be present in order to handle a large amount of traffic across the hybrid cellular network and to provide GR and HA. While FIG. 2 illustrates the logical structure of 5G core 139, FIGS. 3A and 3B address how such NFs can be implemented on a PCCP in order to realize GR and HA.
  • a private cloud computing platform may be used as opposed to a public cloud computing platform.
  • a private cloud computing platform may be maintained by a single entity, such as the entity that operates the hybrid cellular network. Such a private cloud computing platform may be only used for the hybrid cellular network and/or for other uses by the entity that operates the hybrid cellular network (e.g., streaming content delivery).
  • FIG. 3A illustrates an embodiment of the architecture 300A for a PCCP interconnected with a hybrid cloud cellular network RAN.
  • Architecture 300A can include: DC group regions 301 (301-1, 301-2); mid-tier DC groups 302 (302-1, 302-2, 302-3, 302-4,
  • low-tier DC groups 303 (303-1, 303-2, 303-4, 303-5, 303-6, 303-7, 303-8,
  • DC group regions 301 represent atop of a hierarchy of DC groups through which lower-hierarchy DC groups are controlled and managed within a particular region.
  • a DC group region may be implemented for a large geographic region. For example, in a large country, such as the United States, only between 3 and 5 regions may be present, for each of which a DC group Region is present.
  • an administrator of the client e.g., the operator of the HCN
  • DC group regions may define groups of tiered DCs that are interconnected with each other.
  • region 305-1 and region 305-2 two regions are illustrated: region 305-1 and region 305-2.
  • DC group region 301-1 is present.
  • DC group region 301-1 includes mid-tier DC group 302-1, mid-tier DC group 302-2, and mid-tier DC group 302-3.
  • a mid-tier DC group can be referred to as an availability zone.
  • Mid-tier DC groups may have large amounts of bandwidth with other mid-tier DC groups within the same region and DC group region 301-1 itself if it has a distinct set of computing resources.
  • Each mid-tier DC group can be a single DC or a group of DC groups within a geographic area.
  • mid-tier DC groups may perform load balancing and redundancy within the mid-tier DC group.
  • a particular DC can only be part of a single midtier DC group.
  • Mid-tier DC groups whether they include a single DC or multiple DC groups, can be geographically separated from other mid-tier DC groups and, if present, computing resources of its DC group region. Therefore, mid-tier DC groups 302 may be expected to be between 10 and 100 miles away from other mid-tier DC groups.
  • mid-tier DC groups are the highest-tier DC groups on which a client can execute services; on such PCCPs, regions are made of clusters of mid-tier DC groups that have high bandwidth connections with each other.
  • a low-tier DC group can be referred to as a local zone.
  • a low-tier DC group can include one or more data centers. Such DCs may be relatively smaller in size than mid-tier DCs, may have their own internet connections, and may be able to provide their geographic region with low latency services. For example, in a metropolitan area that does not have a mid-tier DC group, a low-tier DC group may be present to provide low latency service.
  • a low-tier DC group may communicate directly with one or more mid-tier DC groups with the same region. DCs of a low-tier DC group are geographically separated from DCs of mid-tier DC groups and higher level DCs, if any are present. As illustrated in FIG. 3A, low-tier DC group 303-5 is connected with midtier DC group 302-3. For example, low-tier DC group 303-5 may provide low latency service to Boston and is connected with mid-tier DC group 302-3, located in Virginia, via a high bandwidth connection.
  • RAN connections 306 represent where a component of the RAN of system 100 connects with the PCCP. For example, in region 305-1, RAN connections may exist to low- tier DC groups 303 and mid-tier DC groups 302, as shown by RAN connections 306. Such connections can represent places where a network with which the RAN is connected connects with the PCCP. For example, a private fiber network may be connected to each BS of the HCN. This private fiber network may then connect with the PCCP at various RAN connections 306.
  • HCN For an HCN, communication among regions is necessary. For example, when a UE connected with the HCN moves from region 305-1 to region 305-2, the HCN must still continue to function seamlessly. Therefore, the ability to transfer data between regions 305 is needed.
  • the PCCP may manage data transfers among regions differently than within a region. Therefore, HA and GR may be typically performed within a single region, but other data necessary for functionality of the HCN can be shared across regions 305 as needed.
  • HCN data 304 is shared between DC group regions 301. In practice, this arrangement can involve mid-tier DC groups 302 transmitting data through a DC group region DC or directly among mid-tier DC groups in different regions. Further detail regarding HCN-data is provided in relation to FIG. 3B.
  • an HCN can be implemented across three regions or some greater number of regions. While the PCCP may provide for a large number of regions, it may not be necessary to have core functions of the HCN implemented in every region.
  • FIG. 3B illustrates an embodiment of the architecture 300B for cloud-implemented components of a hybrid cloud cellular network.
  • FIG. 3 A illustrates the physical architecture of a PCCP; architecture 300B illustrates how NFs of an HCN are implemented on CCP architecture 300A to achieve GR and HA.
  • Architecture 300B includes: DC group regions 310 (310-1, 310-2, 310-3); NDCs 320 (320-1, 320-2, 320-3, 320-4, 320-5, 320-6); RDCs 360 (360-1, 360-2, 360-3, 360-4, 360-5, 360-6, 360-7, 360-8, 360-9); and breakout EDCs 370 (370-1, 370-2, 370-3, 370-4, 370-5, 370-6, 370-7, 370-8, 370-9), which can be abbreviated as B-EDCs 370.
  • DC group regions 310 can each correspond to different regions, such as regions 305-1 and 305-2. Within each DC group region, two NDCs are implemented.
  • an NDC may be part of the cellular network core that performs high level functions.
  • Each NDC within a DC group region is implemented at a different midtier DC group.
  • mid-tier DC group 302-1 may host a first NDC
  • mid-tier DC group 302-2 may host a second NDC.
  • the HCN may only use two of these mid-tier DC groups to host active NDCs.
  • a third NDC that is kept in standby in case of the need for failover is hosted at a third mid-tier DC group within the region.
  • each mid-tier DC group can host an NDC of NDCs 320. (Logically, NDCs within a particular DC group region can function together as a single NDC.)
  • NFs 340 (340- 1, 340-2, 340-3, 340-5, 340-6) and NFs 350 (350-1, 350-2, 350-3, 350-5, 350-6) are present in each of NDCs 320.
  • NFs 340 (340- 1, 340-2, 340-3, 340-5, 340-6)
  • NFs 350 (350-1, 350-2, 350-3, 350-5, 350-6)
  • NRF Network Exposure Function
  • SEPP Security Edge Protection Proxy
  • BSF Binding Support Function
  • PCF PCF
  • CHF Service Communication Proxy
  • SCP Short Message Service Function
  • Load balancing and failover may be performed between instantiations of the same NF in different NDCs. This failover may remain within the same region. For example, if NF 340-1 fails, NF 340-2 may receive the traffic of NF 340-1 to prevent an outage. Additionally or alternatively, if a third inactive NDC is present within DC group region 310-1, the inactive NDC may be partially (e.g., only the failed NF) or wholly activated to allow for failover or load balancing from NF 340-1. In some embodiments, load balancing and failover are permitted across DC group regions 310 between NDCs.
  • each NDC may be a cellular network database function.
  • This database function allows for data to be synchronized across the entirety of the HCN regardless of region.
  • this database function is unified data repository (UDR) 330.
  • UDR 330 allows for unified storage of data across NFs for the cellular network core.
  • UDRs 330 (330-1, 330-2, 330-3, 330-4, 330-5, 330-6) can be used to store service authorization data, policy data, session binding data, subscription data, and application state information. Any NF in NDCs 320 that requires storage can use UDRs 330.
  • UDR 330 can be maintained as a separate repository in each of NDCs 320, each of these instances of UDRs 330 are synchronized. For example, a change made by NF 350-1 to UDR 330-1 for a particular UE is propagated to UDR 330-2, UDR 330-3, UDR 330- 4, UDR 330-5, and UDR 330-6. If additional standby NDCs are present within DC group regions 310, the UDRs of those NDCs can also be kept synchronized to allow for seamless failover. In some embodiments, more than one repository is kept synchronized across NDCs 320 across multiple DC group regions 310.
  • each DC group region of DC group regions 310 may be multiple RDCs.
  • Each RDC may be implemented at the mid-tier DC group at which a corresponding NDC is implemented. Therefore, a mid-tier DC group can host both an NDC and multiple RDCs, as shown by mid-tier function groups 380 (380-1, 380-2, 380-3).
  • RAN connection 306-8 is connected directly with mid-tier DC group 302-4.
  • the data from the RAN is processed through an RDC and passed to the NDC at mid-tier DC.
  • NDCs 320 may only be implemented at some of the mid-tier DC groups available within a DC group region.
  • a mid-tier DC group can host an RDC without hosting an NDC.
  • RDC 360-3 may be hosted by a mid-level DC group that does not host an NDC (or at least not an active instance of an NDC under normal operating conditions).
  • each mid-level DC group may host an NDC and an associated RDC.
  • Each RDC may host a same set ofNFs.
  • NFs hosted on an RDC of RDCs 360 can include: AMF, SMF, and packet gateway (e.g., PGW-C, PGW-U).
  • AMF Access Management Function
  • SMF Session Management Function
  • PGW-C Packet Control Function
  • PGW-U packet gateway
  • Each RDC of RDCs 360 may be able to communicate with each NDC within its DC group region. In some embodiments, flexibility is present for an RDC to communicate with an NDC of a different DC group region, such as for load balancing or failover purposes.
  • B-EDCs may reside on the CCP within DC group regions 310 on low-tier DC groups 303, as indicated by low-tier function groups 390 (390-1, 390-2, 390-3).
  • a B-EDC of B-EDC 370 may be used in a location where the CCP does not have a mid-tier DC group. For example, a minor metropolitan area may not be large enough for just the operator of the CCP installing a mid-tier DC group nearby. Therefore, in order to meet latency and/or bandwidth requirements, the CCP may implement a low-tier DC group, on which the HCN can create a B-EDC.
  • Each B-EDC of B-EDCs 370 may host a same set ofNFs. NFs hosted on a B-EDC of B-EDCs 370 can include NFs such as a PGW-U and UPF. Each B-EDC of B- EDCs 370 may be able to communicate with each RDC within its DC group region. A primary connection may exist between an B-EDC and its immediate parent RDC, such as from B- EDC 370-1 to RDC 360-1. The secondary connections with RDC 360-2 and RDC 360-3 can be used for load balancing and failover.
  • FIG. 4 illustrates an embodiment 400 of a virtual router for use as part of a hybrid cloud cellular overlay network.
  • virtual router 410 can be mapped to a particular network function or group of network functions within a VPC. Data output from this network function is routed to another destination via virtual router 410. Data address to this network function is received by virtual router 410 and provided to the network function.
  • Virtual router 410 can include: prioritization engines 420; routing engines 430; routing table 435; and translation engines 440.
  • Virtual router 410 is implemented as a software component that is executed on the public cloud computing platform within a VPC of the hybrid cellular network. Based on restrictions set on the cloud computing platform, a maximum amount of bandwidth may be used by an individual software component, such as 4 GB/s. In situations where this amount of bandwidth is insufficient, multiple instances of virtual routers may be implemented and may be mapped to a same network function (or group of network functions in a VPC), thus increasing the total available bandwidth, such as to 10 GB/s for two virtual routers.
  • Prioritization engine 420 may serve to prioritize particular data being transmitted or received over other data. If virtual router 410 has sufficient bandwidth and resources available that all data being received or transmitted can be handled, no prioritization may need to be performed and data may be processed in the order in which it was received. However, if virtual router 410 reaches its bandwidth limit, data that is tagged with a greater priority is prioritized over data that does not have such a tag. For example, if virtual router 410 is operating at its maximum permitted bandwidth and prioritization engine 420 identifies data with the higher priority, the higher priority data is prioritized for transmission over the data with the lesser priority. The data with the lesser priority may be rejected or, if multiple virtual routers are mapped to the network function, the data with the less priority may be passed to the second virtual router for routing.
  • Such a second virtual router may also prioritize any data it receives for routing that is labeled with the greater priority. Again here, this prioritization may not matter if the second virtual router is operating below its maximum bandwidth and all data may be routed in the order received. However, if it is operating at its maximum bandwidth, the data with the higher priority is routed first, with other data with the lower priority either being cached and delayed, rejected for routing, or provided to yet another virtual router for routing.
  • routing engine 430 may use routing table 435 to determine to where received data is to be routed and the path along which it should be routed (e.g., via other virtual routers and possibly physical routers). Routing table 435 may be maintained via a master account of the hybrid cloud cellular network on the public cloud computing platform. The master routing tables may be propagated to the appropriate instances of components instantiated on the public cloud computing system for the hybrid cellular network. Virtual router 410 may use multiprotocol label switching (MPLS) to perform routing. Therefore, virtual router 410 allows for data packets to be forwarded at level 2 of the open systems interconnection (OSI) model.
  • MPLS multiprotocol label switching
  • MPLS Rather than analyzing a destination IP address of a packet, MPLS allows for a first router that receives a data packet (which might be virtual router 410) to define the entirety of a path to a destination and indicate the path in a label stored as part of the packet header. (The same label may be used for indicating which packets are to be prioritized.)
  • Translation engine 440 may properly formulate the MPLS label, which can include the indication of the label-switched path and the priority.
  • the label at the “ingress” router which may be virtual router 410, can add a label that defines a path to a destination router mapped to a network function or component of the RAN.
  • the path can be a series of virtual and/or physical routers that are communicatively connected with each other in series.
  • One or more routers, which may be virtual routers, that are located along the path route the data packet according to the path defined in the label.
  • a destination router which can be referred to as an “egress” router (which also may be a virtual router) can receive the data packet and remove the label before the data packet is delivered to the destination network function or RAN component.
  • Box 401 illustrates how virtual router receives data from a mapped network function or group of network functions within a VPC and routes the data to another virtual router 450.
  • Box 402 illustrates the opposite scenario: data is received from another virtual router (e.g., virtual router 450), then prioritization engine 420 analyzes the priority of the received data packet such that the data packet is processed based on its priority as previously detailed.
  • Routing engine 430 may analyze the label of the MPLS header to determine if the data packet is to be routed to another virtual router or if virtual router 410 is the data packets egress router. If the data packet is to be routed on to another router, translation engine 440 may not modify the packet. If virtual router 410 is the egress router, translation engine 440 can remove the MPLS header and provide the data packet to the mapped network function or group of network functions within the VPC in which virtual router 410 resides.
  • FIG. 5 illustrates an embodiment of a hybrid cellular network architecture 500 that integrates virtual and physical routers. While FIG. 3B illustrates the logical architecture of the hybrid cellular network on the CCP, FIG. 5 illustrates how the RAN of the hybrid cellular network communicates with the CCP.
  • Architecture 500 includes DC group regions 310; NDCs 320; RDCs 360; B-EDCs 370; Aggregation Data Centers (ADCs) 510; pass-through edge data centers (P-EDCs) 520; and base stations 530.
  • Each base station may include: structure 535; one or more antennas; a physical router (e.g., router 550-3); one or more RUs; and computing hardware on which a DU is executed.
  • Routers 550 are physical pieces of equipment to which the RUs and DUs of a BS are connected. Routers 550 are connected with a fiber network.
  • the fiber network may be a private fiber network on which the BS is guaranteed an amount of uplink and downlink bandwidth. Alternatively, a direct fiber connection between each BS and its P-EDC may be present.
  • BSs 530-1, 530-2, 530-3, and 530-4 that are in communication with P-EDC 520-1 are illustrated.
  • the number of BSs connected with a P-EDC can vary from two to hundreds. Further, only BSs that are communicatively connected with P-EDC 520-1 are illustrated for simplicity. BSs may also be in communication with P-EDC 520-2 and P-EDC 520-3.
  • BSs 530 and P-EDCs 520 represent hardware that is operated by the cellular network operator. Therefore, a physical location is maintained by the cellular network operator for each of P-EDCs 520.
  • Each P-EDC can serve to aggregate upstream (from BS to CCP) traffic and distribute downstream (from CCP to BS) traffic.
  • each of those BSs can be communicatively connected to a local P- EDC.
  • the P-EDC may then have a highspeed connection (e.g., fiber connection) to an ADC.
  • ADCs 510 can serve as the RAN connections 306 of FIG. 3 A.
  • P-EDC 520-1 includes physical router 550-2.
  • Physical router 550-2 is a piece of hardware that manages routing between BSs 530-1 through 530-5 and ADC 510-2. Multiple P-EDCs communicate with an ADC.
  • ADCs also represent hardware that is operated by the cellular network operator and include a physical router, such as router 550-1.
  • ADC 510-2 is show in communication with P-EDCs 520.
  • ADCs 510-1, 510-3, and 510-4 are also in communication with various P-EDCs. While P-EDCs 520 may be located in general geographic proximity to its BSs; ADCs 510 are located in proximity to where connections to B-EDCs 370 of the CCP are present.
  • ADC 510-2 may be geographically proximate to B-EDC 370-5, as indicated by outline 570.
  • ADC 510-2 is located in a same physical facility (e.g., DC) as B-EDC 370-5, with a high-speed connection with low latency present between ADC 510-2 and B-EDC 370- 5.
  • ADC 510-2 may be located in a different data center than B-EDC 370-5, but a high-speed direct fiber link between ADC 510-2 and B-EDC 370-5 can be present. Therefore, despite many BSs communicating with P-EDCs 520, only a single connection to the CCP via ADC 510-2 is needed to connect the BSs to the CCP.
  • P-EDCs 520 may be geographically dispersed. As an example, if B-EDC 370-5 is located in Denver, ADC 510-2 may be located at the same facility or be in another facility located near Denver with a high-speed connection to B-EDC 370-5. P-EDC 520-1 may be located in Denver and may communicate with BSs in the metropolitan Denver area. P-EDC 520-2 may be located elsewhere, such as a hundred kilometers north to service BSs in southern Wyoming.
  • P-EDC 520-3 may be located in Salt Lake City to service BSs near Salt Lake City. Therefore, geographic location 521 may be hundreds of kilometers from geographic location 522. In this example, Salt Lake City may not have its own EDC of the CCP, and therefore an EDC available in another region is needed to be used to interface with the CCP. Each of these P- EDCs has a high-speed connection to ADC 510-2.
  • a single ADC may be present locally or multiple ADCs, such as when the EDC is used for a large number of P-EDCs.
  • B-EDC 370-6 is in direct communication with both ADC 510-3 and ADC 510-4.
  • ADCs 510-3 and 510-4 are both geographically proximate to B-EDC 370-6, such as in the same DC or at least in the same metropolitan area and connected with a high-speed fiber connection.
  • LDCs 525 each include one or more routers and serves to aggregate upstream traffic and distribute downstream traffic. Therefore, multiple BSs (such as BSs 530-5, 530-6, and 530-7) can be connected with LDC 525-1, which has a single high-speed connection with P-EDC 520-3. Such an arrangement can prevent some number of BSs from each needing to have a connection with P-EDC 520-3.
  • a virtual router is a piece of software that is executed on the CCP that performs the functions of a physical router.
  • a virtual router may be instantiated on the CCP such that it receives data from RAN or CCP cellular network components (e.g., network functions).
  • the virtual router then prioritizes and formats the data such that it is appropriate for transmission via the underlying native routing of the cloud computing platform.
  • the underlying native routing architecture of the cloud computing platform which includes physical routers, then performs the routing to the appropriate virtual router that is associated with another component of the hybrid cloud cellular network, which can be within the same sub-region, a different sub-region, or a different cloud-computing region altogether.
  • the receiving virtual router reformats the received data and transmits it to the appropriate local component for which the data was addressed or labeled, or forwards to another virtual router based on the address or label. From the perspective of the cellular network operator, the virtual routers function as physical routers, such that no consideration needs to be given to the virtual router’s underlying use of the cloud platform’s native routing.
  • Virtual routers rely on the CCP’s underlying native routing functionality; however, virtual routers can use multi -protocol label switching (MPLS) with generic routing encapsulation (GRE) to overcome limitations of the cloud service’s native routing.
  • MPLS multi -protocol label switching
  • GRE generic routing encapsulation
  • a labeling system can be used to direct traffic. For example, data received by virtual router 540-2 may be labeled as intended for NDC 320-3. Based on this label, virtual router 540-2 may route the data to virtual router 540-3.
  • Each virtual router can have some number, such as eight, GRE tunnels, per routing destination, which can be used to overcome a flow limit present on the CCP.
  • a virtual router can perform routing based on a stored routing table and can serve to route received data based upon characteristics of the received data (e.g., an indicated destination, such as a destination address, an indication of where the data originated, a priority indicated in the received data, a type of the received data). Since the virtual routers can use GRE tunnels, limitations of the underlying cloud computing platform routing architecture regarding prioritization, routing protocols, and IP addresses being reused in different DC group regions 310 can be worked around.
  • virtual routers can perform forwarding to other virtual routers if a direct route is not available. If a GRE tunnel does not exist directly for a particular route, one or more intermediary virtual routers can be used for forwarding.
  • a given layer in a sub-zone may have more than one virtual router.
  • each RDC of RDCs 360 may have multiple virtual routers. Having multiple virtual routers can help if large volumes of data need to be transmitted, such as to a lower layer in the cellular network hierarchy, not illustrated here.
  • virtual routers are indistinguishable from physical routers.
  • virtual routers 540 can route data to physical routers 550 as they would to other virtual routers. All necessary processing and/or conversion needed to allow virtual and physical routers to interact is performed using the arrangement detailed in relation to FIG. 6.
  • FIG. 6 illustrates an embodiment of transit gateways incorporated as part of a hybrid cellular network architecture 600.
  • architecture 600 details of communication between B-EDC 370-5 and ADC 510-2 are shown.
  • This pair of an ADC and EDC is exemplary: a similar or the same architecture can be present between other EDCs of the CCP and ADCs of the hybrid cellular network’s RAN.
  • Architecture 600 can include: B-EDC 370-5; NFs 620; virtual router 440-3; transit gateway 610-1; high-speed direction connection 601; ADC 510-2; physical router 450-4; and transit gateway 610-2.
  • B-EDC 370-5 and ADC 510-2 may be physically proximate, as indicated by outline 470, such as in the same DC.
  • Line 605 indicates the transition from the RAN of the hybrid cellular network to services executed on the CCP at the EDC on behalf of the cellular network operator.
  • B-EDC 370-5 and ADC 510-2 may each have a transit gateway 610.
  • a transit gateway allows for on-premise networks (e.g., ADC 410-2) to be connected with a virtual private cloud (VPC) on the PCCP of the hybrid cellular network.
  • VPC virtual private cloud
  • a transit gateway can enforce a firewall and manage security protocols.
  • Each transit gateway may include several subcomponents. Such subcomponents of transit gateway 610-1 are illustrated: firewall 612; whitelist datastore 614; and security protocol manager 616.
  • Whitelist datastore 614 includes the identities of devices with which transit gateway 610-1 is permitted to allow communication traffic through.
  • ADC 510-2 must be included in whitelist datastore 614 in order for its traffic to be permitted onto B-EDC 370-5 by transit gateway 610-1.
  • Firewall 612 blocks traffic of any external device that does not have its identity included on whitelist datastore 614.
  • a similar whitelist is maintained at transit gateway 610-2 such that an identity of B-EDC 370-5 (or transit gateway 610-1) is required to be maintained in the whitelist datastore of transit gateway 610-2 in order to prevent the firewall of transit gateway 610-2 from blocking received data from transit gateway 610-1.
  • Each transit gateway can include security protocol manager 616.
  • Security protocol manager 616 can serve to manage security-related transactions between virtual and physical routers, such as exchanges of security keys. For example, security protocol manager 616 can serve to ensure that data received from a physical router is encrypted using a proper encryption key.
  • All traffic between ADC 510-2 and B-EDC 370-5 can occur via transit gateways 610.
  • upstream data from a BS bound for NDC 320-3 may be received by physical router 550-4.
  • Router 550-4 can route the received data through transit gateways 610 to virtual router 540-3.
  • Virtual router 540-3 may analyze the received data, and relay the upstream data to the virtual router of RDC 360-5 (as seen in FIG. 5).
  • the virtual router of RDC 360-5 based on its routing table, may analyze the received data, and relay the upstream data to virtual router 540-3 of NDC 320-3.
  • NFs 620 represent that some network functions of the hybrid cellular network can be implemented directly at an EDC.
  • a user plane function for data can serve as the gateway to the Internet for UE.
  • UPF-D user plane function for data
  • Such an arrangement can allow for a low-latency connection for UE to the Internet by not requiring Internet traffic to be routed through the RDC or NDC of the cellular network core.
  • FIG. 7 illustrates an embodiment of a method 700 for using a hybrid cellular network architecture that integrates physical routers of a RAN with cloud-implemented cellular network core via transit gateways.
  • Embodiments of method 700 can be performed using hybrid cellular network architectures detailed herein.
  • upstream cellular network traffic (e.g., voice and/or data traffic) is routed from multiple BSs to a P-EDC operated as part of the RAN by the cellular network operator.
  • upstream cellular network traffic from multiple BSs may be routed through an LDC. This arrangement allows for a single P-EDC to receive data from many BSs.
  • One or more P-EDCs can route the upstream data to a designated ADC of the cellular network at block 720.
  • a high-speed connection can be present from a P-EDC to a particular ADC of the RAN of the cellular network.
  • the upstream traffic received by the ADC via the ADCs one or more physical routers is transmitted via a transit gateway to an EDC of the cloud computing platform.
  • the transit gateway may analyze the received upstream traffic to confirm that the traffic is received from a whitelisted source.
  • the upstream cellular network traffic is transmitted locally (e.g., via a direct fiber optic connection) to the EDC of the CCP.
  • the upstream cellular network traffic is processed by a transit gateway executed on the EDC of the CCP.
  • the transit gateway confirms that the upstream cellular network traffic was received from a whitelisted source (e.g., the ADC) and can perform any protocol conversion necessary to allow the data routed by the physical routers of the RAN (e.g., at BSs, P-EDCs, ADCs) to be routed to the appropriate virtual router on the CCP.
  • the upstream cellular network traffic is routed using a virtual router executed at the EDC to route the data to its appropriate destination, such as to an RDC or NDC executed on the CCP within the DC group region.
  • the upstream cellular network traffic is processed using the appropriate network functions at the component to which the upstream cellular network traffic was addressed. For instance, some of the upstream cellular network traffic may be processed at an RDC, while other data is labeled such that it would be routed to the NDC.
  • method 700 is focused on upstream cellular network traffic, method 700 can be performed in reverse such that downstream traffic is routed from NFs of the NDC or RDC of a DC group region to the appropriate BS for which the data is addressed or labeled.
  • FIG. 8 illustrates an embodiment of the architecture 800 of the hybrid cellular network within a region on a public cloud computing platform.
  • a DC group region such as DC group region 310-1
  • multiple subnets may be defined on the PCCP by the hybrid cellular network operator.
  • a subnet is a range of IP addresses that is mapped to a particular set of functions executed within the subnet.
  • the subnet is defined such that all of its functions are executed at a particular data center or group of data centers. For instance, referring to FIG. 3A, a defined subnet may be created at mid-tier DC group 302-1. Therefore, all NFs of the HCN executed within the subnet are executed at mid-tier DC group 302-1. By defining multiple subnets at different DC groups, the HCN operator can ensure that each set of NFs is executed at different DC groups.
  • a subnet may be defined as either a public subnet or a private subnet.
  • a public subnet allows traffic to be routed to the Internet via a gateway, while a private subnet requires the use of a network address translation device or component.
  • VPC virtual private cloud
  • a VPC is an isolated virtual network on a PCCP mapped to a particular client.
  • each VPC may be mapped to a parent account of the hybrid cellular network provider.
  • One or more child accounts may be mapped to a VPC to allow particular entities, such as particular employees or vendors, to access a particular VPC of the HCN, to the exclusion of other VPCs.
  • a first VPC may include NDC 320-1.
  • a second VPC may include NDC 320-2.
  • Each of RDCs 360 can be part of a separate VPC.
  • subnets 810 may be established, such as three, for NDCs 320.
  • Each subnet may be defined such that the corresponding NDC is executed at a different DC or DC group.
  • each subnet may be mapped to a different availability zone.
  • each subnet may be instantiated at a different mid-tier DC group within a region.
  • each subnet which are each mapped to particular IP address ranges, the same network functions may be executed.
  • the same NFs are executed. Since the data at UDRs 330 are kept synchronized, it may not matter whether network function 340-1 or network function 340-2 processes data (e.g., a packet) received from an RDC of RDCs 360. Therefore, for example, if NF 340-1 is overloaded, particular packets that were to be delivered to NF 340-1 can instead be delivered to NF 340-2 (which is an instance of the same NF) for processing instead.
  • data e.g., a packet
  • two subnets may be actively used while a third subnet is reserved as a backup. Accordingly, not all NFs may be replicated across all subnets 810 within DC group region 310-1.
  • FIG. 3B two NDCs are shown in each DC group region. While two NDCs may actively function, FIG. 8 shows that a third NDC 320-3 may be present that can function as a backup, such as for failover and load balancing. (although shown as separate NDCs, within a region, each of NDCs 320 can be logically understood to function in concert as a single NDC.)
  • NDC 320-3 may only have some NFs instantiated.
  • NF 350-3 can represent an NRF, NSSF, NEF, CHF, or PCF.
  • Other NFs may not be instantiated as part of NDC 320-3, such as a UDM, AUSF, or media resource function (MRF). If needed for failover or load-balancing, such NFs could be instantiated at NDC 320-3 within subnet 810-3.
  • MRF media resource function
  • NFs 340 while instantiated as part of different subnets, function in concert to perform their function. As needed for load-balancing and failover, a packet to be processed by NF 340-1 can instead be routed for processing to NF 340-2. If needed, such as due to a failure of NF 340-2, another instantiation of the NF may be created in NDC 320-3. As another example, load-balancing and failover can occur between all three instantiations of NF 350. When operating normally, only NF 350-1 and NF 350-2 may be active. However, as needed, load balancing may occur between NFs 350-1 and 350-2.
  • NF 350-1 could partially failover or have some traffic rerouted to NF 350-2 and partially failover or have some traffic routed to NF 350-3.
  • NF 350-2 could partially failover or have some traffic rerouted to NF 350-1 and partially failover or have some traffic rerouted to NF 350-3.
  • virtual routers may re-route data between different subnets 810. For example, data transmitted by RDC 360-1 via virtual router 820-4 that is labeled for delivery to NF 340-1 may be rerouted by virtual router 820-1 to virtual router 820-2 for delivery to NF 340-2 based on the status of NF 340-1.
  • the routing tables of virtual routers 820 may be altered as needed to handle instances of an NF failing or for load balancing.
  • RDCs 360 may reside in their own subnets 810-4 through 810-6.
  • Subnet 810-4 may be instantiated at the same DC or group of DCs as subnet 810-1, subnet 810-5 at the same DC or group of DCs as subnet 810-1, and subnet 810-6 at the same DC or group of DCs as subnet 810-3.
  • RDCs may be implemented within each of subnets 810.
  • each of subnets 810-4 through subnets 810-6 may be an RDC, which can function as detailed in relation to FIG. 3B. Each of these subnets may also have at least one virtual router. Load balancing and failover is available among RDCs 360.
  • Virtual routers 820-4, 820-5, and 820-6 allow for routing of data between RDCs 360 and also for the routing of data between NDCs 320 and RDCs 360.
  • virtual router 820-4 can route data on the PCCP to virtual router 820-1.
  • virtual routers 820 can be used to distribute traffic from RDCs 360 among NDCs 320. (although not illustrated, traffic can be routed between virtual routers 820-4 and 820-6 and similarly between virtual routers 820-1 and 820-3.)
  • RDC 360-1 could partially failover or have some traffic rerouted to RDC 360-2 and partially failover or have some traffic routed to RDC 360-3.
  • RDC 360-2 could partially failover or have some traffic rerouted to RDC 360-1 and partially failover or have some traffic rerouted to RDC 360-3.
  • RDC 360-3 could partially failover or have some traffic rerouted to RDC 360-1 and partially failover or have some traffic rerouted to RDC 360-1.
  • each RDC can exchange data via virtual routers with any of NDCs 320. While each of NDCs 320 is located in physically separate DCs or groups of DCs, the underlying physical networking is managed by the PCCP provider. Therefore, the HCN provider manages the virtual routers instantiated within the HCN’s VPCs, but the physical routing is managed by the PCCP. Such an arrangement allows the HCN provider to perform packet-level failover and load balancing as desired among different DCs or DC groups of the PCCP, such as by altering the routing tables of the virtual routers. [0119] Such an arrangement can be used to perform various methods.
  • FIG. 9 illustrates an embodiment of a method 900 for establishing high availability within a region of a cloud computing platform for a hybrid cellular network.
  • subnets are established within a region of a PCCP.
  • the subnets are established across multiple different data centers or different data center groups.
  • subnets may be established at three different DCs or DC groups, such as a mid-tier DC group 302-2.
  • NFs of an NDC are instantiated within the subnets.
  • the NFs may be the same across each subnet. Collectively these subnets may function together as an NDC for the region.
  • not all NFs are instantiated in a subnet. This subnet may be used as a backup within the region in case of failover or high loads within the other subnets.
  • the NFs instantiated across the subnets can include a UDR as detailed in relation to UDR 330 of FIG. 3B.
  • NFs of RDCs may be instantiated within separate subnets.
  • NFs for an RDC may be instantiated in its own subnet in DCs or DC groups that match the subnets of the NDCs.
  • subnet 410-1 and subnet 410-4 may be present at the same DC or DC group.
  • the NFs of RDCs can be implemented within the subnets instantiated for the NDCs.
  • RDC 360-1 could be implemented within subnet 410-1.
  • virtual routing is instantiated within each subnet to enable routing of data between the NFs of each RDC and the NFs of each NDC.
  • One or more services can be implemented within a subnet to allow packets of data to be transmitted between NFs.
  • failover and load balancing can be performed, such as via the virtual routers, between individual NFs of the NDCs, among the NDCs (e.g., traffic being routed to a different subnet hosting NDC NFs by NFs of an RDC), or among the RDCs (e.g., traffic being routed to a different subnet hosting RDC NFs by NFs of an NDC).
  • FIG. 10 illustrates an embodiment of a method 1000 for establishing geographic redundancy and high availability for a cloud-implemented cellular network core of a hybrid cellular network.
  • a threshold e.g., a defined amount of processing resources being used
  • traffic may be routed to an instance of the same NF residing in a different subnet (which is at a different DC or group of DCs) for processing. If that NF is also experiencing a high load, an instance of the same NF may be instantiated within the subnet functioning as a backup.
  • a threshold e.g., a defined amount of processing resources being used
  • Each block of method 1000 can be implemented by an HCN that has its core implemented on a PCCP.
  • the hardware for the PCCP can be operated and maintained by an entity separate from the HCN and can allow many clients to reserve and use resources of the PCCP.
  • multiple NDCs can be established for an HCN within multiple regional DC groups of a PCCP.
  • Each NDC may be instantiated with the same or similar parameters. For example, some number of clusters may be instantiated within each NDC. Each cluster can be used to execute one or more NFs. Clusters can have the same or different parameters.
  • a cluster can be defined to reserve processing, memory, and/or bandwidth resources for NFs executed within the cluster.
  • the NDCs of block 1010 can each be instantiated at different mid-tier DC groups (which, on some PCCPs, may be the highest- level DCs on which a client can instantiate services).
  • NFs are instantiated within clusters of each NDC at the mid-tier DC groups.
  • the NFs instantiated may be the same across each NDC; however, the number of instances of each NF in each NDC may vary based on load. (Further, as detailed in relation to FIG. 1, based on the slices and loads, an orchestrator can be permitted to instantiate and destroy NFs as needed.) In some embodiments, these multiple NDCs can be referred to logically as a single NDC.
  • a database function in each NDC may be instantiated.
  • This database function can allow cellular network data to be shared across all NDCs.
  • the database function can be a UDR that can be used by some or all NFs to store data, as previously detailed.
  • links can be established among the database functions such that the databases remain synchronized.
  • multiple RDCs can be instantiated at the same mid-tier DC groups as which the NDCs were instantiated.
  • at least one RDC is instantiated at a mid-tier DC group at which no NDC has be instantiated.
  • two active NDCs are instantiated in each DC group region, along with three RDCs per region (for a total of nine RDCs).
  • one RDC is instantiated at a midlevel DC group at which no NDC is present.
  • Each RDC may be primarily mapped to a particular NDC, but each RDC may be permitted to communicate with each NDC within the region as needed for GR and HA.
  • NFs are instantiated within clusters of each RDC at the mid-tier DC groups.
  • the NFs instantiated may be the same across each RDC; however, the number of instances of each NF in each RDC may vary based on load. (Further, as detailed in relation to FIG. 1, based on the slices and loads, an orchestrator can be permitted to instantiate and destroy NFs as needed.)
  • an EDC may be instantiated on a lower-tier DC group than on which the NDCs and RDCs were instantiated. (Therefore, for example, if the NDCs and RDCs were implemented on the highest-tier DC group of a PCCP available, the EDC may be implemented on the next-lower DC tier available.)
  • Each EDC may be primarily mapped to a particular RDC, but each EDC may be permitted to communicate with each RDC within the region as needed for GR and HA.
  • NFs are instantiated within clusters of each EDC at the low-tier DC groups.
  • the NFs instantiated may be the same across each EDC; however, the number of instances of each NF in each EDC may vary based on load. (Further, as detailed in relation to FIG. 1, based on the slices and loads, an orchestrator can be permitted to instantiate and destroy NFs as needed.)
  • the cellular network core implemented on the PCCP may be used to process RAN traffic.
  • the RAN may communicate with the cellular network on the PCCP using various access points between the RAN (or a network connected with the RAN) and the PCCP.
  • the database function across the multiple regions is kept synchronized across each NDC in each region. Therefore, by accessing a local copy of the database function (e.g., UDR) in an NDC, the same data that is available via the database function at other NDCs in the same and other region is available.
  • UDR database function
  • configurations may be described as a process which is depicted as a flow diagram or block diagram. Although each may describe the operations as a sequential process, many of the operations can be performed in parallel or concurrently. In addition, the order of the operations may be rearranged. A process may have additional steps not included in the figure.
  • examples of the methods may be implemented by hardware, software, firmware, middleware, microcode, hardware description languages, or any combination thereof. When implemented in software, firmware, middleware, or microcode, the program code or code segments to perform the necessary tasks may be stored in a non- transitory computer-readable medium such as a storage medium. Processors may perform the described tasks.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

Divers agencements d'un système de réseau cellulaire hybride sont détaillés dans la description. Le système peut comprendre un réseau d'accès radio (RAN) cellulaire comprenant une pluralité de stations de base (BS). Chaque BS peut comprendre une antenne, un routeur physique ; une unité radio (RU), et une unité distribuée (DU). Le système peut comprendre de multiples centres de données de bord de passage (P-EDC). Chaque P-EDC est en communication avec un sous-ensemble différent de BS. Le système peut comprendre un centre de données d'agrégation (ADC) en communication avec les P-EDC. Le système peut en outre comprendre un centre de données de bord (EDC) de décrochage exécuté au niveau d'un EDC d'une plate-forme informatique en nuage, le B-EDC comprenant une seconde passerelle de transit et un routeur virtuel.
PCT/US2022/045863 2021-10-06 2022-10-06 Réseautage en nuage agrégé pour un réseau cellulaire hybride WO2023059778A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP22809548.5A EP4413714A1 (fr) 2021-10-06 2022-10-06 Réseautage en nuage agrégé pour un réseau cellulaire hybride

Applications Claiming Priority (8)

Application Number Priority Date Filing Date Title
US202163252942P 2021-10-06 2021-10-06
US63/252,942 2021-10-06
US17/960,664 US20230106597A1 (en) 2021-10-06 2022-10-05 High Availability Network Function Architecture for a Hybrid Cellular Network
US17/960,664 2022-10-05
US17/960,670 2022-10-05
US17/960,672 US11877160B2 (en) 2021-10-06 2022-10-05 Geographically redundant and high availability system architecture for a hybrid cloud cellular network
US17/960,670 US20230104548A1 (en) 2021-10-06 2022-10-05 Aggregated Cloud Networking for a Hybrid Cellular Network
US17/960,672 2022-10-05

Publications (1)

Publication Number Publication Date
WO2023059778A1 true WO2023059778A1 (fr) 2023-04-13

Family

ID=84361217

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2022/045863 WO2023059778A1 (fr) 2021-10-06 2022-10-06 Réseautage en nuage agrégé pour un réseau cellulaire hybride

Country Status (1)

Country Link
WO (1) WO2023059778A1 (fr)

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20210135957A1 (en) * 2019-11-04 2021-05-06 Vmware, Inc. Intelligent distributed multi-site application placement across hybrid infrastructure

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20210135957A1 (en) * 2019-11-04 2021-05-06 Vmware, Inc. Intelligent distributed multi-site application placement across hybrid infrastructure

Similar Documents

Publication Publication Date Title
CN114073052B (zh) 用于基于切片的路由的系统、方法及计算机可读介质
US11558293B2 (en) Network controller subclusters for distributed compute deployments
US10778527B2 (en) Methods, systems, and computer readable media for providing a service proxy function in a telecommunications network core using a service-based architecture
AU2020437137B2 (en) Application workload routing and interworking for network defined edge routing
US10148554B2 (en) System and methods for load placement in data centers
US7609619B2 (en) Active-active data center using RHI, BGP, and IGP anycast for disaster recovery and load distribution
ES2614863T3 (es) Control de servicio en nube informática y arquitectura de gestión extendida para conectarse al estrato de red
US20040034702A1 (en) Method and apparatus for exchanging intra-domain routing information between VPN sites
US20210297891A1 (en) Application workload routing and interworking for network defined edge routing
EP4349074A1 (fr) Fonctions de plan utilisateur distribuées pour réseaux radio
US20240107333A1 (en) Geographically redundant and high availability system architecture for a hybrid cloud cellular network
EP3474504B1 (fr) Publicité de bande passante de liaison montante leaf-to-spine vers des serveurs connectés leaf
US11729091B2 (en) Highly available data-processing network functions for radio-based networks
US20140330973A1 (en) System and method for brokering and provisioning in high-speed networks
US20230284053A1 (en) Integration of physical test environments with a cloud-native cellular core
WO2023059778A1 (fr) Réseautage en nuage agrégé pour un réseau cellulaire hybride
EP4413714A1 (fr) Réseautage en nuage agrégé pour un réseau cellulaire hybride
US11558290B2 (en) Operation of a broadband access network of a telecommunications network comprising a plurality of central office points of delivery
US20230337022A1 (en) System and method for alerts collection from 5g network
CN117692458B (zh) 一种基于标签的分布式负载均衡实现方法及系统
EP4413712A1 (fr) Routage de réseau cellulaire en nuage hybride
WO2023167964A1 (fr) Intégration d'environnements de test physique à un noyau cellulaire natif en nuage

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22809548

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2022809548

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2022809548

Country of ref document: EP

Effective date: 20240506