WO2019018409A1 - Systems and methods for distributing partial data to subnetworks - Google Patents

Systems and methods for distributing partial data to subnetworks Download PDF

Info

Publication number
WO2019018409A1
WO2019018409A1 PCT/US2018/042508 US2018042508W WO2019018409A1 WO 2019018409 A1 WO2019018409 A1 WO 2019018409A1 US 2018042508 W US2018042508 W US 2018042508W WO 2019018409 A1 WO2019018409 A1 WO 2019018409A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
central repository
data set
subnetwork
node
Prior art date
Application number
PCT/US2018/042508
Other languages
French (fr)
Inventor
Brian R. KNOPF
Original Assignee
Knopf Brian R
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US15/652,089 external-priority patent/US10958725B2/en
Application filed by Knopf Brian R filed Critical Knopf Brian R
Priority to CA3070412A priority Critical patent/CA3070412A1/en
Priority to AU2018302104A priority patent/AU2018302104A1/en
Publication of WO2019018409A1 publication Critical patent/WO2019018409A1/en
Priority to AU2023203129A priority patent/AU2023203129B2/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor

Definitions

  • the present disclosure relates to computer systems and methods for replicating a portion of a data set to a local repository.
  • the present disclosure pertains to computer systems and methods for replicating a portion of a data set to a local repository associated with a subnetwork, the data set being stored on a central repository and associated with one or more subnetworks and the portion of the data set being associated with the subnetwork.
  • a device associated with a subnetwork may include one or more processors configured to obtain a portion of a data set from a central repository.
  • the data set may be associated with one or more subnetworks, and the portion of the data set may be associated with the subnetwork.
  • the one or more processors may be further configured to obtain a request for data originating from a node in the subnetwork.
  • the requested data may include at least one of (i) the portion of the data set, and (ii) data generated based on the portion of the data set, and the request may be destined for the central repository.
  • the one or more processors may be configured determine whether the central repository is unavailable to provide the requested data, and provide the requested data to the node after the central repository is determined as being unavailable.
  • FIG. 1 illustrates an example of a system in accordance with the disclosed embodiments.
  • FIG. 2 illustrates another example of a system in accordance with the disclosed embodiments.
  • FIG. 3 illustrates an example of a system deployed in an internet-of-things (loT) system in accordance with the disclosed embodiments.
  • LoT internet-of-things
  • FIG. 4 illustrates an example of a system deployed in an oil rig in accordance with the disclosed embodiments.
  • Embodiments are described more fully below with reference to the accompanying drawings, which form a part hereof, and which show specific exemplary embodiments. However, embodiments may be implemented in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope. Embodiments may be practiced as methods, systems or devices. Accordingly, embodiments may take the form of an entirely hardware implementation, an entirely software implementation or an implementation combining software and hardware aspects. The following detailed description is, therefore, not to be taken in a limiting sense.
  • First subnetwork 1 10 may include a first node 1 12, a second node 1 14, and a third node 1 16. First subnetwork 1 10 may further include a gateway 1 18 connecting first node 1 12, second node 1 14, and third node 1 16 to each other and to gateway 140.
  • Second subnetwork 120 may include a fourth node 122, a third subnetwork 150, and a gateway 128. Gateway 128 may connect fourth node 122 and third subnetwork 150 to each other and to gateway 140.
  • Third subnetwork 150 may include a fifth node 124 and a gateway 126 that connects fifth node 124 to gateway 128 (e.g., using a network link 146).
  • a "subnetwork" may be any logical grouping of nodes in a network.
  • a subnetwork may include nodes that are grouped based on the nodes' type, geographical location, ownership, performance, cost (e.g., cost of ownership/use), and/or whether the nodes implement certain communication protocols/standards.
  • a subnetwork may include nodes designated by a system administrator of system 100.
  • a subnetwork may include nodes selected by an algorithm.
  • a single node may be associated with a plurality of subnetworks.
  • a subnetwork may be a part of another subnetwork.
  • nodes in a subnetwork may communicate with each other using a first communication protocol and/or standard (e.g., Ethernet), and nodes in another subnetwork may communicate with each other using a second communication protocol and/or standard (e.g., Fiber-optic Communications).
  • nodes in the two subnetworks may communicate with each other via one or more gateways.
  • the gateways as a collective, may be capable of communicating using at least the first and second communication protocols and/or standards.
  • a "gateway" may be a node that connects nodes on a subnetwork to a node outside the subnetwork.
  • central repository 130 may have access to at least one data set 135.
  • a data set may be any collection of data.
  • a data set 135 may be a collection of data for a particular system or application.
  • a data set 135 may include a collection of identity data (e.g. , public keys associated with nodes and/or users) used for an authentication subsystem of system 100.
  • a data set 135 may include a collection of blacklists and whitelists (e.g. , identifying nodes that are prohibited/allowed to communicate) used for a distributed denial-of-service (DDOS) attack prevention subsystem of system 100.
  • DDOS distributed denial-of-service
  • at least a portion of data set 135 may be stored on central repository 130.
  • at least a portion of data set 135 may be stored on a data store external to, and accessible by, central repository 130.
  • the nodes may use the portions of data set 135 including identity data to authenticate nodes and/or users.
  • the nodes may use the portions of data set 135 including blacklists and whitelists to implement a network filter for preventing and mitigating a DDOS attack.
  • central repository 130 may also be considered a node.
  • central repository 130 may be, for example, a physical and/or software executing on a personal computer, an internet-of-things device/hub, virtual machine, server, printer, gateway, router, switch, smartphone/cellular phone, smart watch, or tablet.
  • central repository 130 may be implemented on gateway 140.
  • central repository 130 may include one or more database servers.
  • at least some functions of central repository 130 may be implemented on a cloud platform, such as Amazon Web Services (AWS), Google Cloud, and Microsoft Azure.
  • AWS Amazon Web Services
  • central repository 130 may include a server and a data store.
  • the server may obtain data from the data store and provide the obtained data to various nodes.
  • the server may obtain data from the data store, generate new data based on the obtained data, and provide the generated data to various nodes.
  • FIG. 2 illustrates another example of system 200 in accordance with the disclosed embodiments.
  • System 200 is similar to system 100 of FIG. 1 , except that FIG . 2 further illustrates data accessible by various nodes in system 200.
  • data set 135 of central repository 130 is shown to include data for various nodes in system 200.
  • data set 135 may include, for example, data for first node 1 12, data for second node 1 14, data for third node 1 16, data for fourth node 122, and data for fifth node 124.
  • data set 135 may include data for a plurality of nodes.
  • data set 135 may include data that is intended to be used by two or more nodes in system 200.
  • the phrase "data for a node” may refer to any data that may be used by the node.
  • first node 1 12 may obtain data for first node 1 12, and first node 1 12 may perform an action based on the obtained data for first node 1 12.
  • the phrase "data for a node” may refer to any data that may be used to generate new data that may be used by the node.
  • a node e.g. , central repository 130
  • first node 1 12 may obtain the generated data and perform an action based on the obtained data.
  • central repository 130 may be unavailable for some of the nodes in system 200 to access. More particularly, central repository 130 may be inaccessible and/or undesirable to be accessed by one or more nodes in system 200.
  • network link 142 may experience an outage during a scheduled maintenance of network equipment.
  • network link 144 may be a satellite communication link that may be expensive to use during peak hours.
  • network link 146 may be a wireless network link connecting a portable device (e.g. , fifth node 124 and gateway 126) located underground tunnel to gateway 128.
  • central repository 130 may cease to operate, for example, due to a malicious attack (e.g. , distributed denial-of- service attack) or other technical issues.
  • data set 135 on central repository 130 may be replicated to local repositories (e.g. , local repository 220, local repository 230, and local repository 232) when central repository 130 is available to be accessed by the local repositories (e.g. , during off peak hours or when central repository 130 is operating normally) .
  • the local repositories may be configured to perform at least some of the functions of central repository 130 for the nodes in the same subnetwork using the replicated version of data set 135 stored locally.
  • data on central repository 130 may be replicated local repository 220 on gateway 1 18.
  • local repository 220 may provide first node 1 12, second node 1 14, and third node 1 16 with the replicated data stored in local repository 220.
  • local repository 220 may generate new data based on local repository 220's replicated data and provide the newly generate data to first node 1 12, second node 1 14, and third node 1 16.
  • the process used by local repository 220 to generate the new data may be the same, or substantially the same, as the process that would have been used by central repository 130 to generate the new data based on central repository 130's data.
  • a local repository may store the replicated data internally or on a data store accessible by the local repository.
  • portions of data set 135 are selectively replicated to various local repositories.
  • a portion of data set 135 that is associated with a subnetwork may be replicated to a local repository associated with the same subnetwork.
  • a portion of data set 135 associated with first subnetwork 1 10 i.e. , data for first node 1 12, data for second node 1 14, and data for third node 1 16
  • a portion of data set 135 associated with second subnetwork 120 may be selectively replicated to local repository 230 on gateway 128, and a portion of data set 135 associated with third subnetwork 150 may be selectively replicated to local repository 232.
  • the gateways including the local repositories, or the local repositories themselves may perform the functions of central repository 130 using the replicated data stored in the local repositories, for example, after determining that central repository 130 is unavailable.
  • nodes with access to the local repositories may continue operating as if central repository 130 is continuously available to the nodes.
  • central repository 130 may initiate the process to replicate the portions of data set 135 to the local repositories. That is, the portions of data set 135 are "pushed" to the local repositories.
  • central repository 130 may dynamically assign nodes
  • data set 135 may be altered by one or more users, administrators, or other nodes.
  • data set 135 may include sensor readings from various nodes, and central repository 130 may receive an updated sensor reading from some of the nodes.
  • data set 135 may be changed by one or more users via a user interface connected to central repository 130.
  • an administrator may directly modify data set 135 stored on central repository 130.
  • central repository 130 may provide updated portions of data set
  • central repository 130 may initiate the process to provide the updated portions of data set 135 to the local repositories. That is, central repository 130 "push" the updated portions of data set 135 to local repositories.
  • portions of data set 135 may be provided to local repositories using one or more trusted communications.
  • a trusted communication is a communication where the recipient may verify the identity of the sender.
  • a portion of data set 135 may be signed (i.e., generate a signatures) using one or more private keys, and the generated signature may be provided to the local repository.
  • the local repository prior to accepting the provided portion of data set 135, may verify the signature using one or more corresponding public keys.
  • portions of data set 135 may be provided to local repositories using encrypted communications.
  • local repositories may provide the requested data to the nodes such that the nodes may process the data in the same, or substantially the same, manner as the data that was provided by central repository 130.
  • the data provided by local repositories may be indistinguishable from the data provided by central repository 130.
  • the data provided by the local repositories may be in the same format, or in a substantially the same format, as the data provided by central repository 130.
  • the data provided by local repositories may be signed using a private key associated with central repository 130.
  • the data provided by local repositories may be signed using a private key shared with central repository 130 or derived from a private key accessible by central repository 130.
  • local repositories after determining that central repository 130 is unavailable, may prevent the request from reaching central repository 130.
  • local repositories may be implemented on a plurality of nodes.
  • local repositories may be implemented on a plurality of gateway devices on the same subnetwork.
  • each node in the plurality of nodes may have its own copy of the replicated portion of data set 135.
  • the replicated portion of data set 135 may be distributed among the plurality of nodes.
  • local repositories may be implemented on edge nodes (e.g., first node 1 12, second node 1 14, and third node 1 16).
  • a local repository associated with a subnetwork may be made accessible and/or included in any node that can be accessed by nodes in the same subnetwork.
  • local repository 220 may be made accessible and/or included in third node 1 16.
  • local repository 232 may be made accessible and/or included in fourth node 122.
  • a local repository may also be accessible by, and/or included in, gateway 140.
  • Such a local repository may store, for example, data for nodes in first subnetwork 1 10, second subnetwork 120, and third subnetwork 150.
  • a portion of data set 135 may be stored in multiple local repositories.
  • replicated data for fifth node 124 may be included in both local repository 232 and local repository 230.
  • Storing a portion of data set 135 on multiple local repositories may provide additional redundancy, for example, when both central repository 130 and one of the local repository become unavailable.
  • replicating portions of data set 135 to local repositories may provide numerous benefits for various types of systems.
  • performance of a node may be improved because data needed by the node may be obtained from a local repository which may be accessed with less latency.
  • performance may be further improved by including a local repository close to an edge node (e.g., at a local gateway) and/or in the edge node itself.
  • FIG. 3 illustrates an example of a system 300 in accordance with the disclosed embodiments.
  • System 300 is similar to systems 100 and 200 of FIGS. 1 and 2, except system 300 is deployed as an Internet-of-Things (loT) system.
  • first subnetwork 1 10 includes all nodes in a home 310 and gateway 1 18.
  • first node 1 12 may be a smart refrigerator
  • second node 1 14 may be a smart thermometer
  • third node 1 16 may be a smartphone.
  • Gateway 1 18 may be located near or inside home 310.
  • gateway 1 18 may be a personal Wi-Fi hotspot installed in home 310.
  • FIG . 3 further illustrates second subnetwork 120 that includes all nodes in an office building 320, gateway 128, and gateway 126.
  • Nodes in office building 320 may include, for example, phone, printers, scanners, fax machine, computers, routers, switches, servers, and smartphones.
  • third subnetwork 150 is a part of second subnetwork 120.
  • Third subnetwork 130 may include all devices in a portion of office building 320 (e.g.
  • nodes may request various types of data from central repository
  • such data may include attributes of various nodes in system 300. Attributes may include, for example, capabilities of various nodes, such as whether a node has a certain type of sensor, and/or implements a protocol. In another example, attributes may include last-known status of various nodes (e.g. , last sensor reading by a node, whether a node is active, and/or the last-known user of a node). In yet another example, attributes may include identifier(s) associated with a node, such as the node's IP address or MAC address.
  • attributes of the nodes in a subnetwork may be selectively replicated to a local repository in the same subnetwork.
  • attributes of first node 1 12, second node 1 14, and third node 1 16 may be replicated to local repository 220 in gateway 1 18.
  • attributes for all nodes in office building 320 may be replicated to local repository 230
  • attributes for nodes in bottom half of office building 320 may be replicated to local repository 232.
  • local repository 230 may not store attributes for nodes in the bottom half of office building 320 to avoid redundancy. Accordingly, even when central repository 130 is unavailable to the nodes in a subnetwork, the nodes may still request attributes of the nodes in the same subnetwork from central repository 130, and subsequently receive the requested data from the local repository in the same subnetwork.
  • a node may request data generated based on the data stored in central repository 130, and after determining that central repository 130 is unavailable, a local repository may intercept the request, generate the requested data based on the replicated data stored in the local repository, and provide the generated data to the node.
  • a computer in office building 320 may request a list of printers with a particular set of attributes.
  • gateway 128 or local repository 230 may perform a query on the replicated data stored on local repository 230 to generate the requested list and provide the generated list to the requesting computer.
  • an administrator may add, change, or remove attributes for nodes in system 300 by changing the data stored on central repository 1 30.
  • an interface may be available to provide an administer with options to add, change, or remove the attribute data on central repository 130.
  • the attributes may change in response to changes alteration of a node's configuration and removal/addition of a node.
  • a node's network configuration may change causing the node's IP address to change.
  • a new node may be added or an existing node may be removed, requiring the attributes for the node to be added or removed.
  • first node 1 12 may be an internet-of-things
  • loT loT
  • second node 1 14 may be an loT hub for obtaining and processing the sensor readings from loT sensor 1 12.
  • Both loT sensor 1 12 and loT hub 1 14 may connected to an on-site gateway 1 18.
  • gateway 1 18 may be connected to a remote gateway 140 and a cloud platform 130 via a satellite 420 and satellite links 425.
  • system 400 may further include tens of thousands of nodes (e.g. , additional loT sensors and hubs) , some of which may be deployed on another oil rig and some of which may be deployed on oil rig 410.
  • central repository 130 contain data for tens of thousands of nodes.
  • verifying that the sensor readings are indeed from an authorized sensor may enable system 400 to prevent and/or mitigate malicious attacks on system 400 such as an attack spoofing loT sensor 1 12 in an attempt to inject false sensor readings to system 400.
  • loT hub 1 14 may attempt to verify loT sensor 1 12's signature before processing the received sensor readings.
  • loT hub 1 14 may verify loT sensor 1 12's signature by obtaining and using loT sensor 1 12's public key.
  • public keys associated with the nodes in system 400 are centrally stored on central repository 130.
  • system 400 may include tens of thousands of nodes, and thus, storing copies of all public keys locally (e.g., on each of the nodes or gateways) may not be feasible technically or economically.
  • loT hub 1 14 may request and obtain loT sensor 1 12's public key from central repository 130.
  • oil rig 410 may not have a continuous connection to central repository 130.
  • satellite links 425 may not be available during storm or cloudy days. Consequently, in these situations, loT hub 1 14 may not be to verify that the sensors readings are indeed from loT sensor 1 12 unless an alternative data source for the public keys is available to loT hub 1 14.
  • a subset of the public keys stored on central repository 130 may be replicated to local repositories (e.g., on-site gateway 1 18). Further, the local repositories may intercept the request for the public keys destined for central repository 130 and provide the requested public keys to loT hub 1 14.
  • loT hub 1 14 may verify loT sensor's signature by requesting another node (e.g., central repository 130) to verify the signature. For example, loT hub 1 14 may attempt to provide the obtained sensor readings and loT device 1 12's signature to central repository 130. If central repository 130 is available, central repository 130 may verify the signature using loT sensor 1 12's public key stored on central repository 130 and respond to loT hub 1 14 with a communication indicative of whether the signature is valid or not.
  • another node e.g., central repository 130
  • loT hub 1 14 may attempt to provide the obtained sensor readings and loT device 1 12's signature to central repository 130. If central repository 130 is available, central repository 130 may verify the signature using loT sensor 1 12's public key stored on central repository 130 and respond to loT hub 1 14 with a communication indicative of whether the signature is valid or not.
  • on-site gateway 1 18 may intercept the sensor readings and loT sensor 1 12's signature, verify the loT sensor 1 12's signature using replicated version of loT sensor 1 12's public key, and respond to loT hub 1 14 with a communication indicative of whether the signature is valid or not. Thus, even when central repository 130 is unavailable, trusted communications between the nodes in oil rig 410 may be possible.
  • FIG. 5 illustrates a process 500 in accordance with the disclosed embodiments.
  • central repository 130 may provide the identified portion of the data set 135 to a local repository associated with the subnetwork.
  • central repository 130 may initiate a process to replicate the identified portion of data set 135 to a local repository associated with the subnetwork.
  • the local repository associated with the subnetwork may include, for example, a gateway connected to at least one node in the subnetwork.
  • the local repository may be implemented on an edge node in the subnetwork.
  • the local repository may obtain the portion of the data set 135 provided by central repository 130.
  • the local repository may store the obtained portion of the data set 135 on a data store within the local repository and/or on a data store accessible by the local repository.
  • the local repository may obtain the updates to the identified portion of the data set 135. After obtaining the updates, the local repository may apply the updates to the portion of the data set 135 on the local repository.
  • the local repository may obtain the request for data originating from the node in the subnetwork.
  • the local repository may intercept the request for data destined for central repository 130.
  • the local repository may preven the request from reaching central repository 130.
  • the local repository may provide the requested data to the node after the central repository is determined as being unavailable.
  • the node may obtain the requested data.
  • the node may process the requested data. In some embodiments, the node may perform an action based on the requested data.

Abstract

Computer systems and methods for replicating a portion of a data set to a local repository associated with a subnetwork are disclosed. In one implementation, a method for a device associated with a subnetwork may include obtaining a portion of a data set from a central repository. The data set may be associated with one or more subnetworks, and the portion of the data set may be associated with the subnetwork. The method may further include obtaining a request for data originating from a node in the subnetwork. The requested data may include at least one of (i) the portion of the data set, and (ii) data generated based on the portion of the data set, and the request may be destined for the central repository. In addition, the method may include determining whether the central repository is unavailable to provide the requested data, and providing the requested data to the node after the central repository is determined as being unavailable.

Description

SYSTEMS AND METHODS FOR DISTRIBUTING PARTIAL DATA TO SUBNETWORKS
CROSS-REFERENCE TO RELATED APPLICATION(S)
[1 ] This application claims priority to U.S. Application No. 15/652,089, filed on July
17, 2017, which is a continuation-in-part of U.S. Application No. 15/588,533, filed on May 5, 2017, titled "SYSTEMS AND METHODS FOR ENABLING TRUSTED COMMUNICATIONS BETWEEN ENTITIES," which claims priority to U.S. Provisional Application No. 62/332,271 , filed on May 5, 2016, titled "DEVICE AUTHENTICATION USING A CENTRAL REPOSITORY." This application also claims priority to U.S. Provisional Application No. 62/469,346, filed on March 9, 2017, titled "METHODS AND SYSTEMS FOR IDENTITY MANAGEMENT." Further, this application is related to U.S. Application No. 15/652,098, titled "SYSTEMS AND METHODS FOR ENABLING TRUSTED COMMUNICATIONS BETWEEN CONTROLLERS," U.S. Application No. 15/652, 108, titled "SYSTEMS AND METHODS FOR MITIGATING AND/OR PREVENTING DISTRIBUTED DENIAL-OF- SERVICE ATTACKS," and U.S. Application No. 15/652, 1 14, titled "SYSTEMS AND METHODS FOR VERIFYING A ROUTE TAKEN BY A COMMUNICATION," which are filed concurrently with this application. The disclosures of the above applications are hereby incorporated by reference in their entirety for all purposes.
TECHNICAL FIELD
[2] The present disclosure relates to computer systems and methods for replicating a portion of a data set to a local repository. In particular, the present disclosure pertains to computer systems and methods for replicating a portion of a data set to a local repository associated with a subnetwork, the data set being stored on a central repository and associated with one or more subnetworks and the portion of the data set being associated with the subnetwork.
BACKGROUND
[3] A distributed database is a database in which portions of the database are stored in multiple physical locations and processing is distributed among multiple database nodes to provide increased availability and performance. To ensure that the multiple database nodes remain current, a replication process may be employed. A replication process may involve, for example, detecting changes in the database nodes and updating each database node such that all of the database nodes become identical to each other. However, such a process is time and resource intensive process. Further, such a process may not be feasible for systems such as internet-of-things (loT) systems that may include data for billions of nodes.
SUMMARY
[4] Computer systems and methods for replicating a portion of a data set to a local repository are disclosed. In particular, computer systems and methods for replicating a portion of a data set to a local repository associated with a subnetwork are disclosed. The data set may be stored on a central repository and associated with one or more subnetworks. Further, the portion of the data set being associated with the subnetwork.
[5] In one embodiment, a method for a device associated with a subnetwork may include obtaining a portion of a data set from a central repository. The data set may be associated with one or more subnetworks, and the portion of the data set may be associated with the subnetwork. The method may further include obtaining a request for data originating from a node in the subnetwork. The requested data may include at least one of (i) the portion of the data set, and (ii) data generated based on the portion of the data set, and the request may be destined for the central repository. In addition, the method may include determining whether the central repository is unavailable to provide the requested data, and providing the requested data to the node after the central repository is determined as being unavailable.
[6] In another embodiment, a device associated with a subnetwork may include one or more processors configured to obtain a portion of a data set from a central repository. The data set may be associated with one or more subnetworks, and the portion of the data set may be associated with the subnetwork. The one or more processors may be further configured to obtain a request for data originating from a node in the subnetwork. The requested data may include at least one of (i) the portion of the data set, and (ii) data generated based on the portion of the data set, and the request may be destined for the central repository. In addition, The one or more processors may be configured determine whether the central repository is unavailable to provide the requested data, and provide the requested data to the node after the central repository is determined as being unavailable.
[7] In yet another embodiment, a non-transitory computer-readable storage medium storing instructions that when executed by a computer cause the computer to perform a method for a device associated with a subnetwork. The method may include obtaining a portion of a data set from a central repository. The data set may be associated with one or more subnetworks, and the portion of the data set may be associated with the subnetwork. The method may further include obtaining a request for data originating from a node in the subnetwork. The requested data may include at least one of (i) the portion of the data set, and (ii) data generated based on the portion of the data set, and the request may be destined for the central repository. In addition, the method may include determining whether the central repository is unavailable to provide the requested data, and providing the requested data to the node after the central repository is determined as being unavailable.
BRIEF DESCRIPTION OF THE DRAWINGS
[8] FIG. 1 illustrates an example of a system in accordance with the disclosed embodiments.
[9] FIG. 2 illustrates another example of a system in accordance with the disclosed embodiments.
[10] FIG. 3 illustrates an example of a system deployed in an internet-of-things (loT) system in accordance with the disclosed embodiments.
[1 1 ] FIG. 4 illustrates an example of a system deployed in an oil rig in accordance with the disclosed embodiments.
[12] FIG. 5 illustrates a process in accordance with the disclosed embodiments.
DETAILED DESCRIPTION
[13] Embodiments are described more fully below with reference to the accompanying drawings, which form a part hereof, and which show specific exemplary embodiments. However, embodiments may be implemented in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope. Embodiments may be practiced as methods, systems or devices. Accordingly, embodiments may take the form of an entirely hardware implementation, an entirely software implementation or an implementation combining software and hardware aspects. The following detailed description is, therefore, not to be taken in a limiting sense.
[14] The logical operations of the various embodiments are implemented (1) as interconnected machine modules within the computing system and/or (2) as a sequence of computer implemented steps running on a computing system. The implementation is a matter of choice dependent on the performance requirements of the computing system implementing the invention. Accordingly, the logical operations making up the embodiments described herein are referred to alternatively as operations, steps or modules.
[15] Overview
[16] Aspects of the present disclosure pertains to computer systems and methods for replicating a portion of a data set to a local repository. In particular, the present disclosure pertains to computer systems and methods for replicating a portion of a data set to a local repository associated with a subnetwork, the data set being stored on a central repository and associated with one or more subnetworks, and the portion of the data set being associated with the subnetwork.
[17] In some embodiments, the replicated portion of the data set on the local repository associated with the subnetwork may be provided to nodes in the same subnetwork, for example, when the nodes request the portion of the data set from the central repository. In one example, when a node associated with the subnetwork requests the portion of the data set from the central repository, the local repository may intercept the request and provide the replicated portion of the data set on the local repository.
[18] In some embodiments, data generated based on the replicated portion of the data set (i.e. , derived data) may be provided to nodes associated with the same subnetwork, for example, when the nodes request data generated based on the portion of the data set stored on the central repository. For example, when derived data is requested by a node on the subnetwork, the local repository may intercept the request, generate the requested data based on the replicated portion of the data on the local repository, and provide the generated data to the node.
[19] Examples of Operating Environments
[20] FIG. 1 illustrates an example of a system 100 in which concepts consistent with the principles of the invention may be implemented. System 100 includes a first subnetwork 1 10, a second subnetwork 120, a central repository 130, and a gateway 140. As shown in FIG. 1 , first subnetwork 1 10, second subnetwork 120, and central repository 130 are connected to central repository 130 via gateway 140 and network links (e.g., network link 142 and network link 144).
[21 ] First subnetwork 1 10 may include a first node 1 12, a second node 1 14, and a third node 1 16. First subnetwork 1 10 may further include a gateway 1 18 connecting first node 1 12, second node 1 14, and third node 1 16 to each other and to gateway 140. Second subnetwork 120 may include a fourth node 122, a third subnetwork 150, and a gateway 128. Gateway 128 may connect fourth node 122 and third subnetwork 150 to each other and to gateway 140. Third subnetwork 150 may include a fifth node 124 and a gateway 126 that connects fifth node 124 to gateway 128 (e.g., using a network link 146).
[22] As used herein, a "node" may be any physical or virtual entity capable of communicating via a computer network. For example, a node may be a physical computer, piece(s) of software, internet-of-things device, internet-of-things hub/bridge, virtual machine, server, printer, gateway, router, switch, smartphone/cellular phone, smart watch, tablet, or combination thereof. In some embodiments, a plurality of nodes may be implemented on a single physical or virtual device. Alternatively, or additionally, a single node may be implemented on a plurality of physical and/or virtual devices. In system 100, gateway 1 18, gateway 126, gateway 128, gateway 140, and central repository 130 may also be considered "nodes."
[23] As used herein, a "subnetwork" may be any logical grouping of nodes in a network. For example, a subnetwork may include nodes that are grouped based on the nodes' type, geographical location, ownership, performance, cost (e.g., cost of ownership/use), and/or whether the nodes implement certain communication protocols/standards. In another example, a subnetwork may include nodes designated by a system administrator of system 100. In yet another example, a subnetwork may include nodes selected by an algorithm. In some embodiments, a single node may be associated with a plurality of subnetworks. In some embodiments, a subnetwork may be a part of another subnetwork. In some embodiments, nodes in a subnetwork may communicate with each other using a first communication protocol and/or standard (e.g., Ethernet), and nodes in another subnetwork may communicate with each other using a second communication protocol and/or standard (e.g., Fiber-optic Communications). In these embodiments, nodes in the two subnetworks may communicate with each other via one or more gateways. The gateways, as a collective, may be capable of communicating using at least the first and second communication protocols and/or standards. As used herein, a "gateway" may be a node that connects nodes on a subnetwork to a node outside the subnetwork.
[24] As used herein, a "network link" may be any communication component(s) enabling at least one node to communicate with at least one other node. In some embodiments, a network link may include any wired or wireless communication medium that can be used by one or more nodes for communication. Alternatively, or additionally, a network link may include a receiver and/or transmitter that receives and/or transmits data over a wired and/or wireless communication medium. In one example, a network link may be a wireless receiver and/or transmitter. In another example, a network link may be a Ethernet cable connecting two nodes. In this example, the network link may further include Ethernet modules that enables nodes to communicate over the Ethernet cable. In yet another example, a network link may include wireless transceivers.
[25] As shown in FIG. 1 , central repository 130 may have access to at least one data set 135. As used herein a "data set" may be any collection of data. In some embodiments, a data set 135 may be a collection of data for a particular system or application. For example, a data set 135 may include a collection of identity data (e.g. , public keys associated with nodes and/or users) used for an authentication subsystem of system 100. In another example, a data set 135 may include a collection of blacklists and whitelists (e.g. , identifying nodes that are prohibited/allowed to communicate) used for a distributed denial-of-service (DDOS) attack prevention subsystem of system 100. In some embodiments, at least a portion of data set 135 may be stored on central repository 130. Alternatively, or additionally, at least a portion of data set 135 may be stored on a data store external to, and accessible by, central repository 130.
[26] In system 100, central repository 130 may provide portions of data set 135 to various nodes. For example, central repository 130 may obtain a portion of data set 135 and provide the obtained portion of data set 135 to first node 1 12 via gateway 140 and gateway 1 18. Alternatively, or additionally, central repository 130 may generate new data based on portions of data set 135, and provide the generated, new data to various nodes. For example, central repository 130 may obtain a portion of data set 135, generate new data based on the portion of data set 135, and provide the generated data to fifth node 124 via gateway 140, gateway 128, and gateway 126. The nodes may use the obtained portions of data set 135 to perform at least some of their intended functions. For example, the nodes may use the portions of data set 135 including identity data to authenticate nodes and/or users. In another example, the nodes may use the portions of data set 135 including blacklists and whitelists to implement a network filter for preventing and mitigating a DDOS attack.
[27] In some embodiments, central repository 130 may provide data to a node by transmitting the data. Alternatively, or additionally, central repository 130 may provide data to a node by making the data available for retrieval (e.g. , stored in a data store accessible by the node) . Correspondingly, a node may obtain the data provided by central repository 130 by receiving the transmitted data and/or retrieving the data made available for retrieval.
[28] As described above, central repository 130 may also be considered a node.
Thus, central repository 130 may be, for example, a physical and/or software executing on a personal computer, an internet-of-things device/hub, virtual machine, server, printer, gateway, router, switch, smartphone/cellular phone, smart watch, or tablet. For example, in in some embodiments, central repository 130 may be implemented on gateway 140. In some embodiments, central repository 130 may include one or more database servers. In some embodiments, at least some functions of central repository 130 may be implemented on a cloud platform, such as Amazon Web Services (AWS), Google Cloud, and Microsoft Azure. [29] In some embodiments, central repository 130 may include a server and a data store. In these embodiments, the server may obtain data from the data store and provide the obtained data to various nodes. Alternatively, or additionally, the server may obtain data from the data store, generate new data based on the obtained data, and provide the generated data to various nodes.
[30] FIG. 2 illustrates another example of system 200 in accordance with the disclosed embodiments. System 200 is similar to system 100 of FIG. 1 , except that FIG . 2 further illustrates data accessible by various nodes in system 200. For example, in system 200, data set 135 of central repository 130 is shown to include data for various nodes in system 200. In particular, data set 135 may include, for example, data for first node 1 12, data for second node 1 14, data for third node 1 16, data for fourth node 122, and data for fifth node 124. Although not illustrated in FIG . 2, in some embodiments, data set 135 may include data for a plurality of nodes. For example, data set 135 may include data that is intended to be used by two or more nodes in system 200.
[31 ] As used herein, the phrase "data for a node" may refer to any data that may be used by the node. For example, first node 1 12 may obtain data for first node 1 12, and first node 1 12 may perform an action based on the obtained data for first node 1 12. Alternatively, or additionally, the phrase "data for a node" may refer to any data that may be used to generate new data that may be used by the node. For example, a node (e.g. , central repository 130) may generate new data from data for first node 1 12, and first node 1 12 may obtain the generated data and perform an action based on the obtained data.
[32] In some situations, however, central repository 130 may be unavailable for some of the nodes in system 200 to access. More particularly, central repository 130 may be inaccessible and/or undesirable to be accessed by one or more nodes in system 200. For example, network link 142 may experience an outage during a scheduled maintenance of network equipment. In another example, network link 144 may be a satellite communication link that may be expensive to use during peak hours. In yet another example, network link 146 may be a wireless network link connecting a portable device (e.g. , fifth node 124 and gateway 126) located underground tunnel to gateway 128. Further, central repository 130 may cease to operate, for example, due to a malicious attack (e.g. , distributed denial-of- service attack) or other technical issues. Consequently, in these situations, nodes that require the data from data set 135, or data generated based on data from data set 135, may not be able to perform their intended functions unless an alternative data source for such data is available to them. [33] To that end, in system 200, data set 135 on central repository 130 may be replicated to local repositories (e.g. , local repository 220, local repository 230, and local repository 232) when central repository 130 is available to be accessed by the local repositories (e.g. , during off peak hours or when central repository 130 is operating normally) . Further, the local repositories may be configured to perform at least some of the functions of central repository 130 for the nodes in the same subnetwork using the replicated version of data set 135 stored locally. In one example, during normal operation, data on central repository 130 may be replicated local repository 220 on gateway 1 18. After central repository 130 become unavailable, local repository 220 may provide first node 1 12, second node 1 14, and third node 1 16 with the replicated data stored in local repository 220. Alternatively, or additionally, after central repository 130 becomes unavailable, local repository 220 may generate new data based on local repository 220's replicated data and provide the newly generate data to first node 1 12, second node 1 14, and third node 1 16. The process used by local repository 220 to generate the new data may be the same, or substantially the same, as the process that would have been used by central repository 130 to generate the new data based on central repository 130's data. Further, similar to central repository 130, a local repository may store the replicated data internally or on a data store accessible by the local repository.
[34] However, replicating the entire data set 135 to multiple local repositories is resource intensive and time consuming. Moreover, in systems such as internet-of-things systems where data set 135 may include data for billions of nodes, replication of data set 135 to multiple local repositories may not be technically and/or economically feasible.
[35] Accordingly, in system 200, portions of data set 135 are selectively replicated to various local repositories. In particular, in some embodiments, a portion of data set 135 that is associated with a subnetwork may be replicated to a local repository associated with the same subnetwork. For example, as shown in FIG . 2, a portion of data set 135 associated with first subnetwork 1 10 (i.e. , data for first node 1 12, data for second node 1 14, and data for third node 1 16) may be selectively replicated local repository 220 on gateway 1 18. Similarly, a portion of data set 135 associated with second subnetwork 120 may be selectively replicated to local repository 230 on gateway 128, and a portion of data set 135 associated with third subnetwork 150 may be selectively replicated to local repository 232. In these examples, the gateways including the local repositories, or the local repositories themselves, may perform the functions of central repository 130 using the replicated data stored in the local repositories, for example, after determining that central repository 130 is unavailable. Thus, nodes with access to the local repositories may continue operating as if central repository 130 is continuously available to the nodes. In some embodiments, central repository 130 may initiate the process to replicate the portions of data set 135 to the local repositories. That is, the portions of data set 135 are "pushed" to the local repositories.
[36] In some embodiments, central repository 130 may dynamically assign nodes
(including gateways) to subnetworks. For example, central repository 130 may dynamically assign nodes and gateways to a particular subnetwork based on a current network map of system, changing performance requirements of various nodes, changing availability of various network links, and/or other non-technical factors. Thus, in these embodiments, the portion of data set 135 associated with a subnetwork may change during operation. For example, a new node may be added to a subnetwork, requiring additional data to be included in the portion of data set 135 and replicated to the local repository associated with the subnetwork. In another example, a node may be moved to another subnetwork, requiring data associated with the moved node to be replicated to a local repository in a different subnetwork. In yet another example, a new subnetwork may be created, requiring data to be replicated to an additional local repository associated with the new subnetwork.
[37] Moreover, data set 135 may be altered by one or more users, administrators, or other nodes. For example, data set 135 may include sensor readings from various nodes, and central repository 130 may receive an updated sensor reading from some of the nodes. In another example, data set 135 may be changed by one or more users via a user interface connected to central repository 130. In yet another example, an administrator may directly modify data set 135 stored on central repository 130.
[38] I n system 200, central repository 130 may provide updated portions of data set
135 to various local repositories (e.g. , local repositories containing outdated data) after data in data set 135 is altered. In some embodiments, central repository 130 may initiate the process to provide the updated portions of data set 135 to the local repositories. That is, central repository 130 "push" the updated portions of data set 135 to local repositories.
[39] In some embodiments, portions of data set 135 may be provided to local repositories using one or more trusted communications. As used herein, a trusted communication is a communication where the recipient may verify the identity of the sender. For example, in system 200, a portion of data set 135 may be signed (i.e., generate a signatures) using one or more private keys, and the generated signature may be provided to the local repository. The local repository, prior to accepting the provided portion of data set 135, may verify the signature using one or more corresponding public keys. In some embodiments, portions of data set 135 may be provided to local repositories using encrypted communications. [40] In some embodiments, a local repository associated with a subnetwork, or a node that includes the local repository, may intercept requests for data that are destined for central repository 130 and originating from nodes in the same subnetwork. Further, in response to the request, the local repository or the node that includes the local repository may provide the requested data using the replicated data stored on the local repository. As an example, in system 200, first node 1 12 may transmit a request for data for first node 1 12 destined for central repository 130. In situations where central repository 130 is available, central repository 130 may receive the request, and provide the requested data (i.e., data for first node 1 12 stored on central repository 130) to first node 1 12. However, in situations where central repository 130 is unavailable, gateway 1 18 may intercept and respond to the request by providing the requested data to first node 1 12 using the replicated data for first node 1 12 stored on local repository 220.
[41 ] In some embodiments, local repositories may provide the requested data to the nodes such that the nodes may process the data in the same, or substantially the same, manner as the data that was provided by central repository 130. For example, the data provided by local repositories may be indistinguishable from the data provided by central repository 130. In another example, the data provided by the local repositories may be in the same format, or in a substantially the same format, as the data provided by central repository 130. In yet another example, the data provided by local repositories may be signed using a private key associated with central repository 130. For example, the data provided by local repositories may be signed using a private key shared with central repository 130 or derived from a private key accessible by central repository 130. In some embodiments, local repositories, after determining that central repository 130 is unavailable, may prevent the request from reaching central repository 130.
[42] In some embodiments, local repositories may be implemented on a plurality of nodes. For example, local repositories may be implemented on a plurality of gateway devices on the same subnetwork. In these embodiments, each node in the plurality of nodes may have its own copy of the replicated portion of data set 135. Alternatively, the replicated portion of data set 135 may be distributed among the plurality of nodes. In some embodiments, local repositories may be implemented on edge nodes (e.g., first node 1 12, second node 1 14, and third node 1 16).
[43] Local repositories may determine the availability of central repository 130 in numerous way. In some embodiments, a network policy may define conditions in which central repository 130 is to be considered as being available or unavailable. The conditions may include, for example, time/date at which central repository 130 may be available. In some embodiments, central repository 130 may provide local repositories with communications indicating that central repository 130 is available or unavailable. A local repository may determine that central repository 130 is available or unavailable if such a communication was received within a predetermined amount of period. Alternatively, or additionally, a local repository may determine the availability of central repository 130 by providing a status request to central repository 130. In response, central repository 130 may provide the node with the status. The node may determine that central repository 130 is unavailable in the absence of a response from central repository 130.
[44] Although in system 200, local repositories are shown to be accessible by, and/or included in gateways, a local repository associated with a subnetwork may be made accessible and/or included in any node that can be accessed by nodes in the same subnetwork. For example, in system 200, local repository 220 may be made accessible and/or included in third node 1 16. In another example, local repository 232 may be made accessible and/or included in fourth node 122. In yet another example, a local repository may also be accessible by, and/or included in, gateway 140. Such a local repository may store, for example, data for nodes in first subnetwork 1 10, second subnetwork 120, and third subnetwork 150. In some embodiments, as shown in FIG. 2, a portion of data set 135 may be stored in multiple local repositories. For example, in system 200, replicated data for fifth node 124 may be included in both local repository 232 and local repository 230. Storing a portion of data set 135 on multiple local repositories may provide additional redundancy, for example, when both central repository 130 and one of the local repository become unavailable.
[45] In addition to enabling data in data set 135 to be provided to nodes even when central repository 130 is not available, replicating portions of data set 135 to local repositories may provide numerous benefits for various types of systems. In one example, performance of a node may be improved because data needed by the node may be obtained from a local repository which may be accessed with less latency. To that end, performance may be further improved by including a local repository close to an edge node (e.g., at a local gateway) and/or in the edge node itself. In another example, cost of operating system 200 may be reduced because data needed by a node may be obtained from a local repository which may incur less cost (e.g., when global network links such as network link 142 are charged usage fee) than obtaining the data from central repository 130. Moreover, the reduced data traffic to and from central repository 130 may enable system 200 to handle additional number of nodes. [46] FIG. 3 illustrates an example of a system 300 in accordance with the disclosed embodiments. System 300 is similar to systems 100 and 200 of FIGS. 1 and 2, except system 300 is deployed as an Internet-of-Things (loT) system. As shown in FIG . 3, first subnetwork 1 10 includes all nodes in a home 310 and gateway 1 18. In home 310, first node 1 12 may be a smart refrigerator, second node 1 14 may be a smart thermometer, and third node 1 16 may be a smartphone. Gateway 1 18 may be located near or inside home 310. For example, gateway 1 18 may be a personal Wi-Fi hotspot installed in home 310. FIG . 3 further illustrates second subnetwork 120 that includes all nodes in an office building 320, gateway 128, and gateway 126. Nodes in office building 320 may include, for example, phone, printers, scanners, fax machine, computers, routers, switches, servers, and smartphones. In system 300, third subnetwork 150 is a part of second subnetwork 120. Third subnetwork 130 may include all devices in a portion of office building 320 (e.g. , bottom half of office building 320 or floors that include data centers) and gateway 126. Gateways 128 and 126 may be near or inside office building 320. As shown in FIG . 3, communications originating from nodes in home 310 and destined for central repository 130 may be routed via gateway 1 18. Similarly, communications originating from nodes in office building 320 and destined for central repository 130 may be routed via gateway 128.
[47] In system 300, nodes may request various types of data from central repository
130, and the requested data may be required by the nodes to perform at least some of their intended functions. In the example of FIG . 3, such data may include attributes of various nodes in system 300. Attributes may include, for example, capabilities of various nodes, such as whether a node has a certain type of sensor, and/or implements a protocol. In another example, attributes may include last-known status of various nodes (e.g. , last sensor reading by a node, whether a node is active, and/or the last-known user of a node). In yet another example, attributes may include identifier(s) associated with a node, such as the node's IP address or MAC address.
[48] I n these embodiments, attributes of the nodes in a subnetwork (stored on central repository 130) may be selectively replicated to a local repository in the same subnetwork. As shown in FIG . 3, for example, attributes of first node 1 12, second node 1 14, and third node 1 16 may be replicated to local repository 220 in gateway 1 18. Similarly, attributes for all nodes in office building 320 may be replicated to local repository 230, and attributes for nodes in bottom half of office building 320 may be replicated to local repository 232. In some embodiments, local repository 230 may not store attributes for nodes in the bottom half of office building 320 to avoid redundancy. Accordingly, even when central repository 130 is unavailable to the nodes in a subnetwork, the nodes may still request attributes of the nodes in the same subnetwork from central repository 130, and subsequently receive the requested data from the local repository in the same subnetwork.
[49] In some embodiments, a node may request data generated based on the data stored in central repository 130, and after determining that central repository 130 is unavailable, a local repository may intercept the request, generate the requested data based on the replicated data stored in the local repository, and provide the generated data to the node. In one example, a computer in office building 320 may request a list of printers with a particular set of attributes. In this example, if central repository 130 is unavailable, gateway 128 or local repository 230 may perform a query on the replicated data stored on local repository 230 to generate the requested list and provide the generated list to the requesting computer.
[50] In system 300, an administrator may add, change, or remove attributes for nodes in system 300 by changing the data stored on central repository 1 30. For example, an interface may be available to provide an administer with options to add, change, or remove the attribute data on central repository 130. In some embodiments, the attributes may change in response to changes alteration of a node's configuration and removal/addition of a node. For example, a node's network configuration may change causing the node's IP address to change. In another example, a new node may be added or an existing node may be removed, requiring the attributes for the node to be added or removed.
[51 ] After the attribute data on central repository 130 is altered, the changes may be propagated to the local repositories. For example, if attributes for one of the nodes in the bottom half of office building 320 is changed, central repository 130 may initiate a process to replicate the updated attributes to both local repository 230 and local repository 232.
[52] FIG. 4 illustrates an example of a system 400 in accordance with the disclosed embodiments. System 400 is similar to systems 100 and 200 of FIGS. 1 and 2, except parts of system 400 are deployed on an oil rig 410.
[53] As shown in FIG . 4, in system 400, first node 1 12 may be an internet-of-things
(loT) sensor and second node 1 14 may be an loT hub for obtaining and processing the sensor readings from loT sensor 1 12. Both loT sensor 1 12 and loT hub 1 14 may connected to an on-site gateway 1 18. Further, gateway 1 18 may be connected to a remote gateway 140 and a cloud platform 130 via a satellite 420 and satellite links 425. Although not shown in FIG. 4, system 400 may further include tens of thousands of nodes (e.g. , additional loT sensors and hubs) , some of which may be deployed on another oil rig and some of which may be deployed on oil rig 410. In other words, central repository 130 contain data for tens of thousands of nodes. [54] In the example of FIG. 4, loT sensor 1 12 may provide sensor readings to loT hub 1 14 (e.g., by including the sensor readings in a communication destined for loT hub 1 14). Further, to enable loT hub 1 14 to verify that the sensor readings are indeed from loT sensor 1 12, loT sensor 1 12 may generate a signature based on the sensor readings using loT sensor 1 12's private key and send the signature to loT hub 1 14 along with the sensor readings.
[55] In system 400, verifying that the sensor readings are indeed from an authorized sensor (i.e., loT sensor 1 12) may enable system 400 to prevent and/or mitigate malicious attacks on system 400 such as an attack spoofing loT sensor 1 12 in an attempt to inject false sensor readings to system 400. After receiving the sensor readings and the signature, loT hub 1 14 may attempt to verify loT sensor 1 12's signature before processing the received sensor readings.
[56] In some embodiments, loT hub 1 14 may verify loT sensor 1 12's signature by obtaining and using loT sensor 1 12's public key. In the example of FIG. 4, public keys associated with the nodes in system 400 are centrally stored on central repository 130. As discussed above, system 400 may include tens of thousands of nodes, and thus, storing copies of all public keys locally (e.g., on each of the nodes or gateways) may not be feasible technically or economically. Thus, if central repository 130 is available, loT hub 1 14 may request and obtain loT sensor 1 12's public key from central repository 130.
[57] However, in system 400, oil rig 410 may not have a continuous connection to central repository 130. For example, satellite links 425 may not be available during storm or cloudy days. Consequently, in these situations, loT hub 1 14 may not be to verify that the sensors readings are indeed from loT sensor 1 12 unless an alternative data source for the public keys is available to loT hub 1 14. To that end, in system 400, a subset of the public keys stored on central repository 130 may be replicated to local repositories (e.g., on-site gateway 1 18). Further, the local repositories may intercept the request for the public keys destined for central repository 130 and provide the requested public keys to loT hub 1 14.
[58] Alternatively, or additionally, in some embodiments, loT hub 1 14 may verify loT sensor's signature by requesting another node (e.g., central repository 130) to verify the signature. For example, loT hub 1 14 may attempt to provide the obtained sensor readings and loT device 1 12's signature to central repository 130. If central repository 130 is available, central repository 130 may verify the signature using loT sensor 1 12's public key stored on central repository 130 and respond to loT hub 1 14 with a communication indicative of whether the signature is valid or not. If central repository 130 is unavailable, on-site gateway 1 18 may intercept the sensor readings and loT sensor 1 12's signature, verify the loT sensor 1 12's signature using replicated version of loT sensor 1 12's public key, and respond to loT hub 1 14 with a communication indicative of whether the signature is valid or not. Thus, even when central repository 130 is unavailable, trusted communications between the nodes in oil rig 410 may be possible.
[59] An Example of a Process
[60] FIG. 5 illustrates a process 500 in accordance with the disclosed embodiments.
[61 ] At a step 502, central repository 130 may identify a portion of a data set 135 that is associated with a subnetwork. In one example, data set 135 may include data for nodes that are in one or more subnetworks, and the portion of data set 135 may include data for nodes that are in the subnetwork of the one or more subnetworks. In another example, data set 135 may include data for nodes that are in a plurality of subnetworks, and the portion of data set 135 may include data for nodes that are in the subnetwork of the plurality of subnetworks.
[62] At a step 504, central repository 130 may provide the identified portion of the data set 135 to a local repository associated with the subnetwork. In some embodiments, central repository 130 may initiate a process to replicate the identified portion of data set 135 to a local repository associated with the subnetwork. The local repository associated with the subnetwork may include, for example, a gateway connected to at least one node in the subnetwork. Alternatively, the local repository may be implemented on an edge node in the subnetwork.
[63] At an optional step, central repository 130 may provide updates to the identified portion of the data set 135. For example, after the portion of the data set 135 is altered on central repository 130, central repository 130 may initiate a process to provide the updated portion of the data set 135 to the local repository.
[64] At a step 506, the local repository may obtain the portion of the data set 135 provided by central repository 130. In some embodiments, the local repository may store the obtained portion of the data set 135 on a data store within the local repository and/or on a data store accessible by the local repository.
[65] At an optional step, the local repository may obtain the updates to the identified portion of the data set 135. After obtaining the updates, the local repository may apply the updates to the portion of the data set 135 on the local repository.
[66] At a step 508, a node in the subnetwork may provide a request for data. The request may originate from the node in the subnetwork, and the requested data may include at least one of (i) the portion of the data set 135, and (ii) data generated based on the portion of the data set 135. Further, the request may be destined for the central repository 130.
[67] At a step 510, the local repository may obtain the request for data originating from the node in the subnetwork. For example, the local repository may intercept the request for data destined for central repository 130. In some embodiments, the local repository may preven the request from reaching central repository 130.
[68] At a step 512, the local repository may determine whether central repository
130 is unavailable to provide the requested data to the node. As discussed above, a local repository may determine the availability of central repository 130 in numerous ways. In some embodiments, a network policy may define conditions in which central repository 130 is to be considered as being available or unavailable. In these embodiments, the local repository may access the network policy (e.g. , by accessing a policy server) . The conditions may include, for example, time/date at which central repository 130 may be available. In some embodiments, as discussed above, central repository 130 may provide local repositories with communications indicating that central repository 130 is available or unavailable. A local repository may determine that central repository 130 is available or unavailable if such a communication was received within a predetermined amount of period. Alternatively, or additionally, a local repository may determine the availability of central repository 130 by providing a status request to central repository 130. In response, central repository 130 may provide the node with the status. The node may determine that central repository 1 30 is unavailable in the absence of a response from central repository 130.
[69] At a step 514, the local repository may provide the requested data to the node after the central repository is determined as being unavailable. At a step 516 the node may obtain the requested data. At a step 518, the node may process the requested data. In some embodiments, the node may perform an action based on the requested data.
[70] While illustrative embodiments have been described herein, the scope of any and all embodiments having equivalent elements, modifications, omissions, combinations (e.g. , of aspects across various embodiments), adaptations and/or alterations as would be appreciated by those skilled in the art based on the present disclosure. The limitations in the claims are to be interpreted broadly based on the language employed in the claims and not limited to examples described in the present specification or during the prosecution of the application. The examples are to be construed as non-exclusive. Furthermore, the steps of the disclosed routines may be modified in any manner, including by reordering steps and/or inserting or deleting steps. It is intended, therefore, that the specification and examples be considered as illustrative only, with a true scope and spirit being indicated by the following claims and their full scope of equivalents.

Claims

CLAIMS I/We Claims:
1 . A device associated with a subnetwork, the device comprising :
one or more processors configured to:
obtain a portion of a data set from a central repository, the data set being associated with one or more subnetworks, and the portion of the data set being associated with the subnetwork;
obtain a request for data originating from a node in the subnetwork, wherein: the requested data includes at least one of (i) the portion of the data set, and (ii) data generated based on the portion of the data set, and
the request is destined for the central repository;
determine whether the central repository is unavailable to provide the requested data; and
provide the requested data to the node after the central repository is determined as being unavailable.
2. The device of claim 1 , wherein the data set includes public keys associated with the nodes in the one or more subnetworks, and the portion of the data set includes a subset of the public keys that are associated with the subnetwork.
3 The device of claim 1 , wherein the data set includes attributes of nodes in the one or more subnetworks, and the portion of the data set includes the attributes of a subset of the nodes that are associated with the subnetwork.
4. The device of claim 1 , wherein the device is a gateway and obtaining of the request for data includes intercepting the request for data destined for the central repository.
5. The device of claim 1 , further comprising obtaining an update to the portion of the data set provided by the central repository.
6 The device of claim 5, wherein the providing of the update to the device is initiated by the central repository.
7. The device of claim 1 , wherein the determination of whether the central repository is available to provide the requested data includes at least one of:
(i) obtaining a communication indicative of a status of the central repository, and
(ii) accessing a policy defining one or more conditions in which the central repository is to be considered as being available or unavailable.
8. The device of claim 1 , wherein the one or more processors are further configured to provide a digital signature generated at least based on at least a portion of the requested data using a private key associated with the central repository.
9. The device of claim 1 , wherein the providing of the requested data includes providing the obtained portion of the data set, and wherein the portion of the data set is obtained from the central repository prior to obtaining the request for data.
10. The device of claim 1 , wherein the providing of the requested data includes (i) generating data based on the obtained portion of the data set and (ii) providing the generated data, and wherein the portion of the data set is obtained from the central repository prior to obtaining the request for data.
1 1 . A method for a device associated with a subnetwork, the method comprising:
obtaining a portion of a data set from a central repository, the data set being associated with one or more subnetworks, and the portion of the data set being associated with the subnetwork;
obtaining a request for data originating from a node in the subnetwork, wherein:
the requested data includes at least one of (i) the portion of the data set, and (ii) data generated based on the portion of the data set, and
the request is destined for the central repository;
determining whether the central repository is unavailable to provide the requested data; and
providing the requested data to the node after the central repository is determined as being unavailable.
12. The method of claim 1 1 , wherein the data set includes public keys associated with the nodes in the one or more subnetworks, and the portion of the data set includes a subset of the public keys that are associated with the subnetwork.
13 The method of claim 1 1 , wherein the data set includes attributes of nodes in the one or more subnetworks, and the portion of the data set includes the attributes of a subset of the nodes that are associated with the subnetwork.
14. The method of claim 1 1 , wherein the device is a gateway and obtaining of the request for data includes intercepting the request for data destined for the central repository.
15. The method of claim 1 1 , further comprising obtaining an update to the portion of the data set provided by the central repository.
16 The method of claim 15, wherein the providing of the update to the device is initiated by the central repository.
17. The method of claim 1 1 , wherein the determination of whether the central repository is available to provide the requested data includes at least one of:
(i) obtaining a communication indicative of a status of the central repository, and
(ii) accessing a policy defining one or more conditions in which the central repository is to be considered as being available or unavailable.
18. The method of claim 1 1 , further comprising providing a digital signature generated at least based on at least a portion of the requested data using a private key associated with the central repository.
19. The method of claim 1 1 , wherein the providing of the requested data includes providing the obtained portion of the data set, and wherein the portion of the data set is obtained from the central repository prior to obtaining the request for data.
20. The method of claim 1 1 , wherein the providing of the requested data includes (i) generating data based on the obtained portion of the data set and (ii) providing the generated data, and wherein the portion of the data set is obtained from the central repository prior to obtaining the request for data.
21 . A non-transitory computer-readable storage medium storing instructions that when executed by a computer cause the computer to perform a method for a device associated with a subnetwork, the method comprising:
obtaining a portion of a data set from a central repository, the data set being associated with one or more subnetworks, and the portion of the data set being associated with the subnetwork;
obtaining a request for data originating from a node in the subnetwork, wherein:
the requested data includes at least one of (i) the portion of the data set, and (ii) data generated based on the portion of the data set, and
the request is destined for the central repository;
determining whether the central repository is unavailable to provide the requested data; and
providing the requested data to the node after the central repository is determined as being unavailable.
22. The method of claim 21 , wherein the data set includes public keys associated with the nodes in the one or more subnetworks, and the portion of the data set includes a subset of the public keys that are associated with the subnetwork.
23 The method of claim 21 , wherein the data set includes attributes of nodes in the one or more subnetworks, and the portion of the data set includes the attributes of a subset of the nodes that are associated with the subnetwork.
24. The method of claim 21 , wherein the device is a gateway and obtaining of the request for data includes intercepting the request for data destined for the central repository.
25. The method of claim 21 , further comprising obtaining an update to the portion of the data set provided by the central repository.
26 The method of claim 25, wherein the providing of the update to the device is initiated by the central repository.
27. The method of claim 21 , wherein the determination of whether the central repository is available to provide the requested data includes at least one of: (i) obtaining a communication indicative of a status of the central repository, and
(ii) accessing a policy defining one or more conditions in which the central repository is to be considered as being available or unavailable.
28. The method of claim 21 , further comprising providing a digital signature generated at least based on at least a portion of the requested data using a private key associated with the central repository.
29. The method of claim 21 , wherein the providing of the requested data includes providing the obtained portion of the data set, and wherein the portion of the data set is obtained from the central repository prior to obtaining the request for data.
30. The method of claim 21 , wherein the providing of the requested data includes (i) generating data based on the obtained portion of the data set and (ii) providing the generated data, and wherein the portion of the data set is obtained from the central repository prior to obtaining the request for data.
PCT/US2018/042508 2017-07-17 2018-07-17 Systems and methods for distributing partial data to subnetworks WO2019018409A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CA3070412A CA3070412A1 (en) 2017-07-17 2018-07-17 Systems and methods for distributing partial data to subnetworks
AU2018302104A AU2018302104A1 (en) 2017-07-17 2018-07-17 Systems and methods for distributing partial data to subnetworks
AU2023203129A AU2023203129B2 (en) 2017-07-17 2023-05-18 Systems and methods for distributing partial data to subnetworks

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US15/652,089 2017-07-17
US15/652,089 US10958725B2 (en) 2016-05-05 2017-07-17 Systems and methods for distributing partial data to subnetworks

Publications (1)

Publication Number Publication Date
WO2019018409A1 true WO2019018409A1 (en) 2019-01-24

Family

ID=65016272

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2018/042508 WO2019018409A1 (en) 2017-07-17 2018-07-17 Systems and methods for distributing partial data to subnetworks

Country Status (3)

Country Link
AU (2) AU2018302104A1 (en)
CA (1) CA3070412A1 (en)
WO (1) WO2019018409A1 (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070198437A1 (en) * 2005-12-01 2007-08-23 Firestar Software, Inc. System and method for exchanging information among exchange applications
US20120197911A1 (en) * 2011-01-28 2012-08-02 Cisco Technology, Inc. Searching Sensor Data

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070198437A1 (en) * 2005-12-01 2007-08-23 Firestar Software, Inc. System and method for exchanging information among exchange applications
US20120197911A1 (en) * 2011-01-28 2012-08-02 Cisco Technology, Inc. Searching Sensor Data

Also Published As

Publication number Publication date
CA3070412A1 (en) 2019-01-24
AU2023203129B2 (en) 2024-04-04
AU2018302104A1 (en) 2020-03-05
AU2023203129A1 (en) 2023-06-08

Similar Documents

Publication Publication Date Title
US20220046088A1 (en) Systems and methods for distributing partial data to subnetworks
CN107690800B (en) Managing dynamic IP address allocation
US20230035336A1 (en) Systems and methods for mitigating and/or preventing distributed denial-of-service attacks
US10397273B1 (en) Threat intelligence system
US11652793B2 (en) Dynamic firewall configuration
EP3399716B1 (en) Network security threat intelligence sharing
KR101322947B1 (en) Distributed caching of files in a network
US20210273977A1 (en) Control access to domains, servers, and content
US10887333B1 (en) Multi-tenant threat intelligence service
US11050787B1 (en) Adaptive configuration and deployment of honeypots in virtual networks
EP3238096B1 (en) System and method for discovering a lan synchronization candidate for a synchronized content management system
US20180069787A1 (en) Exposing a subset of hosts on an overlay network to components external to the overlay network without exposing another subset of hosts on the overlay network
CN105340240A (en) Methods and systems for shared file storage
KR20150036597A (en) Method and apparatus for determining virtual machine drifting
US11792194B2 (en) Microsegmentation for serverless computing
US11418458B2 (en) Systems and methods of creating and operating a cloudless infrastructure of computing devices
US11381446B2 (en) Automatic segment naming in microsegmentation
US20220201041A1 (en) Administrative policy override in microsegmentation
JP6540063B2 (en) Communication information control apparatus, relay system, communication information control method, and communication information control program
JP6712744B2 (en) Network system, cache method, cache program, management device, management method and management program
CN103916489A (en) Method and system for resolving single-domain-name multi-IP domain name
KR101703491B1 (en) Method for providing security service in cloud system and the cloud system thereof
AU2023203129B2 (en) Systems and methods for distributing partial data to subnetworks
US10146953B1 (en) System and method for physical data packets isolation for different tenants in a multi-tenant protection storage environment
AU2018304187B2 (en) Systems and methods for mitigating and/or preventing distributed denial-of-service attacks

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18834527

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 3070412

Country of ref document: CA

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2018302104

Country of ref document: AU

Date of ref document: 20180717

Kind code of ref document: A

122 Ep: pct application non-entry in european phase

Ref document number: 18834527

Country of ref document: EP

Kind code of ref document: A1