WO2016164061A1 - Transfert de données volumineuses - Google Patents

Transfert de données volumineuses Download PDF

Info

Publication number
WO2016164061A1
WO2016164061A1 PCT/US2015/037802 US2015037802W WO2016164061A1 WO 2016164061 A1 WO2016164061 A1 WO 2016164061A1 US 2015037802 W US2015037802 W US 2015037802W WO 2016164061 A1 WO2016164061 A1 WO 2016164061A1
Authority
WO
WIPO (PCT)
Prior art keywords
network
network topology
data
template
big data
Prior art date
Application number
PCT/US2015/037802
Other languages
English (en)
Inventor
Yogesh DUJODWALA
Pramod Kumar RAMACHANDRA
Original Assignee
Hewlett Packard Enterprise Development Lp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hewlett Packard Enterprise Development Lp filed Critical Hewlett Packard Enterprise Development Lp
Publication of WO2016164061A1 publication Critical patent/WO2016164061A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00—Routing or path finding of packets in data switching networks
    • H04L45/02—Topology update or discovery
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/08—Configuration management of networks or network elements
    • H04L41/0803—Configuration setting
    • H04L41/084—Configuration by using pre-existing information, e.g. using templates or copying from other elements
    • H04L41/0843—Configuration by using pre-existing information, e.g. using templates or copying from other elements based on generic templates
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/08—Configuration management of networks or network elements
    • H04L41/0895—Configuration of virtualised networks or elements, e.g. virtualised network function or OpenFlow elements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/12—Discovery or management of network topologies
    • H04L41/122—Discovery or management of network topologies of virtualised topologies, e.g. software-defined networks [SDN] or network function virtualisation [NFV]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/40—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks using virtualisation of network functions or resources, e.g. SDN or NFV entities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/50—Network services
    • H04L67/60—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
    • H04L67/61—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources taking into account QoS or priority requirements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00—Routing or path finding of packets in data switching networks
    • H04L45/302—Route determination based on requested QoS
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00—Routing or path finding of packets in data switching networks
    • H04L45/64—Routing or path finding of packets in data switching networks using an overlay routing layer
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00—Routing or path finding of packets in data switching networks
    • H04L45/70—Routing based on monitoring results

Definitions

  • Cloud has become the natural choice for big data processing because any number of Virtual Machines can be created and destroyed on demand.
  • big data processing requires large amount of computing power, storage and network bandwidth which can be provided by a cloud environment.
  • An important aspect to take into consideration in big data processing is the network bandwidth for the transmission of the data.
  • FIG. 1 illustrates a network architecture of the Software Defined Networking
  • FIG. 2 illustrates a protocol diagram describing the SDN based routing for big data transfer in accordance with various examples of the disclosure.
  • FIG. 3 illustrates an example method for SDN based big data transfer in accordance with various examples of the disclosure
  • FIG. 4A-C illustrate the change of network topology when applying different network templates in accordance with various examples of the disclosure
  • FIG. 5 illustrates a SDN based big data transmission system in accordance with various examples of the disclosure.
  • FIG. 6 illustrates a network component for implementing various examples of the disclosure.
  • SDN Software Defined Networking: SDN is an emerging architecture purporting to be dynamic, manageable, cost-effective, and adaptable, seeking to be suitable for the high-bandwidth, dynamic nature of today's applications. SDN architectures decouple network control and forwarding functions, enabling network control to become directly programmable and the underlying infrastructure to be abstracted from applications and network services.
  • Network Quality Of Service In packet-switched networks, quality of service is affected by various factors, which can be divided into “human” and “technical” factors. Human factors include: stability of service, availability of service, delays, user information. Technical factors include: reliability, scalability, effectiveness, maintainability, etc. Low throughput due to varying load from disparate users sharing the same network resources and the bit rate (the maximum throughput) that can be provided to the big data to enable maximum efficiency are particularly concerned about here.
  • Virtual Renters Software Networking devices
  • Network Templates can be created for the network topology according to the data transmission requirement. These templates are configured by the network administrator which has the following characteristics:
  • Network templates consists of various routers and routing configuration (such as QoS) for the nodes to be used by the big data processing.
  • QoS routing configuration
  • the existing network infrastructure QoS can be changed with the configuration mentioned in the templates.
  • FIG. 1 a network architecture of the SDN based routing for big data transfer in accordance with various examples of the disclosure is described.
  • a SDN controller 100 is located between the big data deployment engine 102 (which is an example of an application) and the network topology 104.
  • the big data deployment engine 102 sends an API request for big data transfer to the SDN controller 100 which in turn performs discovery of the network topology 104 to identify various QoS parameters, activates a network template on the network topology based on the identified QoS parameters to generate a changed network topology.
  • the big data transfer is enabled from the big data deployment engine 102 to the changed network topology 104.
  • the SDN controller 100 and the big data deployment engine 102 communicates with the network topology 104 via a SDN router 108.
  • the SDN controller 100 may restore the network topology 104 into its original form.
  • the SDN controller 100 may not change the network topology 104 after the big date transfer is completed until it receives another API request for big data transfer and activates another network template on the network topology 104.
  • the big data deployment engine 102 identifies each node of a plurality of nodes to which data needs to be transferred and the amount of data that needs to be transferred, and at 202, it sends an API request for big data transfer to the SDN controller 100, in an example, the API request may contain amount of data that needs to be transferred and an identity of each node of a plurality of nodes to which the data is to be transferred such as IP address and/or hostname.
  • the SDN controller 100 upon receiving the API request from the data deployment engine 102, performs discovery of the network topology 104 to identity various QoS parameters, and the network topology 104 returns discovery results i.e. QoS parameters to the SDN controller 100.
  • the SDN controller 100 activates a network template on the network topology based on the identified QoS parameters to generate a changed network topology.
  • the big data transfer is enabled from the big data deployment engine 102 to the changed network topology 104.
  • the SDN controller 100 restores the network topology 104 into its original form.
  • the SDN controller 100 may not change the network topology 104 after the big data transfer is completed until it receives another API request for big data transfer and activates another network template on the network topology 104.
  • the network template may comprise routers and routing configuration for the nodes to which the data is to be transferred.
  • the network templates may further comprise virtual routers which can be created as a part of network topology and can be destroyed on demand.
  • the API request sent by the big data deployment engine 102 may comprise at least one QoS parameter requirement which should be satisfied for the big data transfer, and accordingly the selection of a network template by the SDN controller 100 at 204 may be based partly on the at least one QoS parameter requirement.
  • the QoS parameter may be throughput.
  • the QoS parameter may be selected from a group of QoS parameters comprising human factors which include stability of service, availability of service, delays, user information and technical factors which include reliability, scalability, effectiveness, maintainability, etc.
  • a SDN controller receives an API request for big data transfer from an application, wherein the API request contains amount of data that needs to be transferred and an identity of each node of a plurality of nodes to which the data is to be transferred such as IP address and/or hostname thereof.
  • the SDN controller performs discovery of the network topology to identify current QoS parameters.
  • the SDN controller activates a network template on the network topology to generate a changed network topology.
  • the SDN controller enables the data to be transferred over the changed network topology.
  • the method 300 may further comprise block 305 at which the SDN controller restores the network topology into its original form after data transfer is completed.
  • the SDN controller may not change the network topology after the date transfer is completed until it receives another API request for data transfer and activates another network template on the network topology,
  • the network template may comprise routers and routing configuration for the nodes to which the data is to be transferred.
  • the network template may further comprise virtual routers which can be created as a part of network topology and can be destroyed on demand, such as the SDN router 108 shown in FIG. 1.
  • the API request sent by the application may comprise at least one QoS parameter requirement which should be satisfied for the data transfer, , and the network template is created based on the at least one QoS parameter requirement.
  • the QoS parameter may be throughput.
  • the QoS parameter may be selected from a group of QoS parameters comprising human factors which include stability of service, availability of service, delays, user information and technical factors which include reliability, scalability, effectiveness, maintainability, etc.
  • the original network topology 400 as shown in FIG. 4A may comprise a plurality of big data nodes A, B and C as well as a plurality of routers Rl, R2 and R3.
  • the router R3 which is labeled by the dashed circle, is omitted when compared to the original network topology.
  • the network template applied in Fig. 4B is suitable for big data transfer which does not require high bandwidth.
  • virtual router R4 which is labeled by the thick circle, is added when compared to the original network topology.
  • the network template applied in Fig. 4C is suitable for big data transfer which requires high bandwidth.
  • the SDN based data transmission system 500 may comprise a detection module 501 , a discovery module 502, an activation module 503, and a transmission enable module 504.
  • the detection module 501 detects whether an API request for data transmission is arrived from an application, wherein the API request contains amount of data that needs to be transmitted and an identity of each node of a plurality of nodes to which the data is to be transmitted.
  • the discovery module 502. carries out discovery of the network topology to determine current QoS parameters upon detecting by the detection module 501 that an API request for data transmission is arrived from an application.
  • the activation module 503 activates a network template on the network topology according to the determined QoS parameters to generate a changed network topology.
  • the transmission enable module 504 enables the data transmission from the application to the changed network topology when the network template is activated on the network topology.
  • the SDN based data transmission system 500 may further comprise a recovery module 505 which recovers the network topology after data transmission is completed.
  • the network templates may comprise routers and routing configuration for the nodes to which the data is to be transmitted.
  • the network templates may further comprise virtual routers which can be created as a part of network topology and can be destroyed on demand, such as the SDN router 108 shown in FIG. 1.
  • the arrived API request may comprise at least one QoS parameter requirement which should be satisfied for the data transmission, and , and the network template is created based on the at least one QoS parameter requirement.
  • the QoS parameier may be throughput.
  • the QoS parameter may be selected from a group comprising human factors which include stability of service, availability of service, delays, user information and technical factors which include reliability, scalability, effectiveness, maintainability, etc.
  • FIG. 6 illustrates a network component 600 suitable for implementing various examples of the disclosure.
  • the network component 600 includes a processor 601 (which may be referred to as a central processor unit or CPU), an associated memory 602 (e.g., random access memory (RAM), cache memory, flash memory, etc.), a storage device 603, I/O devices 604 such as a keyboard, a mouse, a microphone (not shown) or a monitor and network connectivity devices 605, which couple with each other with a bits 606.
  • a processor 601 which may be referred to as a central processor unit or CPU
  • an associated memory 602 e.g., random access memory (RAM), cache memory, flash memory, etc.
  • I/O devices 604 such as a keyboard, a mouse, a microphone (not shown) or a monitor and network connectivity devices 605, which couple with each other with a bits 606.
  • the processor 601 may be implemented as a CPU chip, or may be part of an application specific integrated circuit (ASIC) and/or digital signal processor (DSP).
  • the storage device 603 is typically a hard disk, an optical drive such as a compact disk drive or digital video disk (DVD) drive, a flash memory stick, etc and is used for non-volatile storage of data.
  • the storage device 603 may be used to store programs that are loaded into memory 602 when such programs are selected for execution.
  • the memory 602 is used to store instructions and perhaps data that are read during program execution.
  • the memory 602 includes, among others, a data transfer module 607 storing machine readable instructions which, when executed by the processor 601, cause the processor to perform the following operations.
  • the operations include performing the method as explained with respect to Fig. 3,
  • the data transmission system 500 as shown in FIG, 5 may be implemented as the data transfer module 607.
  • Another example of the data transfer module 607 includes instructions that cause the processor 601 to realize the data transmission system 500 in FIG, 5 and the method illustrated in Fig. 3.
  • Time involved to transmit the data is reduced. 2.
  • the big data transmission doesn't cause any congestion on the network.
  • Data processing is performed efficiently. 4.
  • On demand change in the network topology for effective RoL 5. Packet loss is reduced, 6.
  • Dynamic network topology is realized to handle varying network load.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

Selon certains exemples, l'invention concerne des techniques pour un transfert de données volumineuses en fonction d'un réseau logiciel (SDN). Dans un exemple, un dispositif de commande de SDN reçoit une requête d'interface de programmation d'application (API) demandant un transfert de données volumineuses à partir d'une application, la requête d'API contenant une quantité de données à transférer et une identité de chaque nœud d'une pluralité de nœuds auquel les données doivent être transférées. Lors de la réception de la requête d'API demandant un transfert de données, le dispositif de commande de SDN effectue une découverte de la topologie de réseau pour identifier des paramètres de qualité de service (QoS). Puis, le dispositif de commande de SDN active un modèle de réseau sur la topologie de réseau sur la base des paramètres QoS identifiés pour générer une topologie de réseau changée. Ensuite, le dispositif de commande de SDN permet aux données d'être transférées sur la topologie de réseau changée.
PCT/US2015/037802 2015-04-08 2015-06-25 Transfert de données volumineuses WO2016164061A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
IN1853/CHE/2015 2015-04-08
IN1853CH2015 2015-04-08

Publications (1)

Publication Number Publication Date
WO2016164061A1 true WO2016164061A1 (fr) 2016-10-13

Family

ID=57072789

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2015/037802 WO2016164061A1 (fr) 2015-04-08 2015-06-25 Transfert de données volumineuses

Country Status (1)

Country Link
WO (1) WO2016164061A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150173103A1 (en) * 2012-08-08 2015-06-18 Nokia Corporation Method and apparatus for network assisted data transfer scheduling
CN107888520A (zh) * 2017-11-17 2018-04-06 新华三技术有限公司 拓扑收集方法和装置
CN109743751A (zh) * 2018-06-26 2019-05-10 国网江苏省电力有限公司南京供电分公司 无线接入网的资源分配方法及装置

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2009848A1 (fr) * 2007-06-29 2008-12-31 Alcatel Lucent Calcul d'un chemin dans un réseau à commutation d'étiquettes
US20140078936A1 (en) * 2012-09-17 2014-03-20 Electronics And Telecommunications Research Institute Apparatus for configuring overlay network and method thereof
KR20140050460A (ko) * 2012-10-19 2014-04-29 에스케이텔레콤 주식회사 오픈 플로우 스위치와 컨트롤러를 사용한 트래픽 제어 방법 및 그 장치
US20140376406A1 (en) * 2013-06-24 2014-12-25 Electronics & Telecommunications Research Institute Method for controlling software defined network and apparatus for the same
WO2015040624A1 (fr) * 2013-09-18 2015-03-26 Hewlett-Packard Development Company, L.P. Surveillance des caractéristiques de performance de réseau

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2009848A1 (fr) * 2007-06-29 2008-12-31 Alcatel Lucent Calcul d'un chemin dans un réseau à commutation d'étiquettes
US20140078936A1 (en) * 2012-09-17 2014-03-20 Electronics And Telecommunications Research Institute Apparatus for configuring overlay network and method thereof
KR20140050460A (ko) * 2012-10-19 2014-04-29 에스케이텔레콤 주식회사 오픈 플로우 스위치와 컨트롤러를 사용한 트래픽 제어 방법 및 그 장치
US20140376406A1 (en) * 2013-06-24 2014-12-25 Electronics & Telecommunications Research Institute Method for controlling software defined network and apparatus for the same
WO2015040624A1 (fr) * 2013-09-18 2015-03-26 Hewlett-Packard Development Company, L.P. Surveillance des caractéristiques de performance de réseau

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150173103A1 (en) * 2012-08-08 2015-06-18 Nokia Corporation Method and apparatus for network assisted data transfer scheduling
US9743428B2 (en) * 2012-08-08 2017-08-22 Nokia Technologies Oy Method and apparatus for network assisted data transfer scheduling
CN107888520A (zh) * 2017-11-17 2018-04-06 新华三技术有限公司 拓扑收集方法和装置
CN107888520B (zh) * 2017-11-17 2021-08-24 新华三技术有限公司 拓扑收集方法和装置
CN109743751A (zh) * 2018-06-26 2019-05-10 国网江苏省电力有限公司南京供电分公司 无线接入网的资源分配方法及装置
CN109743751B (zh) * 2018-06-26 2021-08-03 国网江苏省电力有限公司南京供电分公司 无线接入网的资源分配方法及装置

Similar Documents

Publication Publication Date Title
CN107078969B (zh) 实现负载均衡的计算机设备、系统和方法
US10949233B2 (en) Optimized virtual network function service chaining with hardware acceleration
KR101863024B1 (ko) 분산 로드 밸런서
JP6169251B2 (ja) 分散型ロードバランサにおける非対称パケットフロー
US7792148B2 (en) Virtual fibre channel over Ethernet switch
CN112470436A (zh) 使用srv6和bgp的多云连通性
US8165107B2 (en) Method and system for obtaining path information, path computation element
JP6162337B2 (ja) アプリケーションアウェアネットワーク管理
US9602406B2 (en) Data transfer control device and data transfer control method
CN109728962B (zh) 一种发送报文的方法和设备
JP2019502972A (ja) 中間デバイスを介してセッションを管理するためのシステムおよび方法
TWI577164B (zh) 可縮放位址解析之技術
US9942153B2 (en) Multiple persistant load balancer system
WO2019061169A1 (fr) Procédé et dispositif de sélection de route basés sur des ressources hybrides, et serveur
WO2012174444A1 (fr) Commande de service en nuage et architecture de gestion étendue pour se connecter à la strate de réseau
CN112166579A (zh) 提供虚拟化网络功能的多服务器架构集群
EP3203685A1 (fr) Procédé et appareil pour mise en oeuvre d'une fonction d'exploitation, d'administration et de maintenance
WO2016164061A1 (fr) Transfert de données volumineuses
CN108650337B (zh) 一种服务器探测方法、系统及存储介质
US11411802B2 (en) Determining the impact of network events on network applications
Bays et al. Flow based load balancing: Optimizing web servers resource utilization
US11212211B2 (en) Systems and methods for automatically detecting routing peers
WO2017161840A1 (fr) Procédé et dispositif de transmission de flux de données
JP2006243930A (ja) タスク割当方法、タスク割当装置、パス設定装置及びネットワーク情報収集装置
US10367725B2 (en) Network programming

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15888703

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15888703

Country of ref document: EP

Kind code of ref document: A1