WO2018041101A1 - 数据查询、数据查询处理方法及装置 - Google Patents

数据查询、数据查询处理方法及装置 Download PDF

Info

Publication number
WO2018041101A1
WO2018041101A1 PCT/CN2017/099517 CN2017099517W WO2018041101A1 WO 2018041101 A1 WO2018041101 A1 WO 2018041101A1 CN 2017099517 W CN2017099517 W CN 2017099517W WO 2018041101 A1 WO2018041101 A1 WO 2018041101A1
Authority
WO
WIPO (PCT)
Prior art keywords
query
data
request
batch
result
Prior art date
Application number
PCT/CN2017/099517
Other languages
English (en)
French (fr)
Inventor
燕红锁
陈俏钢
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2018041101A1 publication Critical patent/WO2018041101A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/951Indexing; Web crawling techniques

Definitions

  • the present invention relates to the field of communications, and in particular to a data query, data query processing method and apparatus.
  • a network In a communication network, a network consists of a number of communication device nodes, which are called network elements.
  • the network elements are connected by communication lines, including fiber optic cables and the like.
  • the network elements are distributed in various regions, some in the communication building laboratory in the city, and some network elements are in remote areas. These devices that are located in different geographical areas need to be configured, maintained, and monitored. It is impossible to assign them to each location. This requires a central network management system, which is placed in the central computer room and remotely communicates with each node on the network. Configuration, maintenance, and monitoring.
  • the Software Defined Network (SDN) controller management network is an emerging network management control system. In this control system, the control functions of the service resources in the traditional network management are separated, and only the service resources are concerned. Controllers can be hierarchically organized in a tree to manage large-scale networks.
  • the domain controller (D-Controller, DC for short) of the network element is directly managed.
  • the super controller (S-Controller, SC for short) does not directly manage the network element but manages the domain controller. Then, through the virtual network management provided by the domain controller, the management of the actual network is realized.
  • FIG. 1 is a network element management diagram of an SDN controller in the related art.
  • a controller forms a tree management system
  • an upper layer is an S-Controller (ie, an upper layer controller, referred to as SC).
  • the lower layer is the D-Controller (ie, the lower layer controller, referred to as DC), the DC partition management domain, and the management communication network and network element.
  • the controller is managed by the interface in the south direction and the network device, and the northbound interface allows the network application APP of the application layer to access the network for management.
  • the side interface and the same network management plane (including the EMS network element management system and the NMS network) can be used.
  • Management system, or OSS operation support system) communicates management information.
  • the network APP is an actual business application to the network. It uses the resources provided by the controller to issue service creation, deletion, modification, etc. begging.
  • the controller creates, deletes, and modifies services according to the request of the network APP, and monitors the alarm and performance of the service.
  • 2 is a diagram showing the relationship between an SDN controller and other entities in the related art. As shown in Figure 2, the DC directly manages the communication network, and the SC manages the DC. At the same time, it can also interact with the traditional network management system to finally provide resources and services to the APP.
  • the network may be very large, with tens of thousands of network element nodes. There are thousands of ports or terminal point resources in the network element to be managed, so that the total number of ports or terminal points will reach hundreds of millions. Correspondingly, there are tens of millions of businesses established.
  • the upper-level system of the controller needs to query resources, it may face a large amount of data.
  • the controller When there is a lot of data satisfying the query conditions, the controller generates a large response packet for the superior system, and the response is sent back through the communication connection. For a long time, the superior system may not be able to handle it.
  • large data queries can also affect the overall operational efficiency of the system, which in turn affects the operation of other functions.
  • the controller uses open state, netconf and other stateless interface protocols to communicate with the upper layer system.
  • the design idea of the SDN controller is to avoid stateless management, the above prior art is not suitable for the controller. Used in the environment. Therefore, in the data query process of a non-session-based network system (for example, an SDN network system), there are problems in that the query process is complicated, the query efficiency is low, and the network system is seriously burdened.
  • the embodiment of the invention provides a data query and a data query processing method and device, so as to at least solve the problem that the query process is complicated, the query efficiency is low, and the network system is seriously burdened in the data query process of the non-session-based network system in the related art. And other issues.
  • a data query method including: a first query request sent in batches by a superior system in a non-session based system to a lower system, the first query request being used to request query support Data that is queried in batches; the upper-level system receives a first query result sent by the subordinate system according to the batch query request; the superior system sends a second query request to the subordinate system, and the second query request is used for the request Querying data other than the first query result in the data that supports the batch query; the upper-level system receives the second query result sent by the lower-level system according to the second query request.
  • a data query processing method including: receiving, by a non-session-based system, a first query request sent by a higher-level system in batches, wherein the first query request is Requesting to query data supporting batch query; the lower-level system determines a first query result according to the first query request, and sends the first query result to the superior system; the lower-level system receives the superior system a second query request, where the second query request is used to request data in the data that supports the batch query, except for the first query result; and the lower-level system determines the second query result according to the second query request. And sending the second query result to the superior system.
  • a data query device which is located in a higher-level system, and includes: a first sending module, configured to generate a batch query request according to an interface command of a batch query when a batch query is required,
  • the first receiving module is configured to receive the first query result sent by the lower-level system according to the batch query request
  • the second sending module is configured to send a second query request to the lower-level system
  • the second query request is set to request to query data in the data that supports the batch query, except for the first query result;
  • the second receiving module is configured to receive the second sent by the lower-level system according to the second query request. search result.
  • a data query processing apparatus which is located in a lower-level system, and includes: a first receiving module, configured to receive a first query request sent by a higher-level system in batches, wherein the first a query request is used to request to query the data that supports the batch query; the first sending module is configured to determine the first query result according to the first query request, and send the first query result to the superior system; a receiving module configured to receive the upper a second query request sent by the level system, the second query request is used to request data in the data that supports the batch query, except for the first query result; and the second sending module is configured to be configured according to the second query request Determining a second query result and transmitting the second query result to the superior system.
  • a data query system which is located in a non-session-based system, and includes: a higher-level system, configured to send a first query request sent in batches to a lower-level system, the first query Requesting for requesting data for supporting a batch query; sending a second query request to the lower-level system, the second query request for requesting data in the data that supports the batch query other than the first query result;
  • the lower-level system is configured to receive the first query request sent by the upper-level system in batches; determine a first query result according to the first query request, and send the first query result to the superior system; Receiving the second query request sent by the upper-level system; determining a second query result according to the second query request, and sending the second query result to the superior system.
  • a storage medium is also provided.
  • the storage medium is arranged to store program code for performing the following steps:
  • the first query request that is sent in batches to the lower-level system that is not based on the session system, and the first query request is used to request to query data that supports batch query.
  • the upper-level system receives a first query result sent by the lower-level system according to the batch query request.
  • the upper-level system sends a second query request to the lower-level system, where the second query request is used to request data that is in addition to the first query result in the data that supports the batch query.
  • the upper-level system receives a second query result sent by the lower-level system according to the second query request.
  • the storage medium is further arranged to store program code for performing the following steps:
  • the storage medium is further arranged to store program code for performing the following steps:
  • a storage medium is also provided.
  • the storage medium is arranged to store program code for performing the following steps:
  • the sub-system that is not based on the session system receives the first query request sent by the upper-level system in batches, where the first query request is used to request to query data that supports batch query;
  • the lower-level system determines a first query result according to the first query request, and sends the first query result to the superior system.
  • the lower-level system receives a second query request sent by the upper-level system, where the second query request is used to request data that is in addition to the first query result in the data that supports the batch query.
  • the lower-level system determines a second query result according to the second query request, and sends the second query result to the superior system.
  • the storage medium is further arranged to store program code for performing the following steps:
  • the lower-level system excludes data that is not sent to the upper-level system from the data that supports the batch query according to the data identifier information in the first query result in the second query request.
  • the superior system utilizes the query result of the query request for the batch query data sent by the lower-level system for the upper-level system in batches, and also sends the query request carrying the data that has been batch-queried by the lower-level system.
  • the query process is complicated, the query efficiency is low, and the network system is seriously burdened in the data query process of the non-session-based network system in the related art can be solved. Achieving efficient query of a large amount of data, and the query method is simple, there is no missing effect.
  • 1 is a network element management diagram of an SDN controller in the related art
  • FIG. 2 is a diagram showing a relationship between an SDN controller and other entities in the related art
  • FIG. 3 is a flowchart of a data query method according to an embodiment of the present invention.
  • FIG. 4 is a flowchart of a data query processing method according to an embodiment of the present invention.
  • FIG. 5 is a timing diagram of a data query according to an embodiment of the present invention.
  • FIG. 6 is a structural diagram of a data query apparatus according to an embodiment of the present invention.
  • FIG. 7 is a structural diagram of another data query apparatus according to an embodiment of the present invention.
  • FIG. 8 is a structural diagram of a data query processing apparatus according to an embodiment of the present invention.
  • FIG. 9 is a structural diagram of another data query processing apparatus according to an embodiment of the present invention.
  • FIG. 10 is a structural diagram of still another data query processing apparatus according to an embodiment of the present invention.
  • FIG. 11 is a structural diagram of a data query system according to an embodiment of the present invention.
  • Figure 12 is a block diagram of a controller in accordance with an embodiment of the present invention.
  • a data query method for the system architecture shown in FIG. 1 and FIG. 2 wherein the controller forms a tree management system, and the upper layer is an S-Controller (ie, an upper layer controller, referred to as SC).
  • the lower layer is the D-Controller (ie, the lower layer controller, referred to as DC), the DC partition management domain, and the management communication network and network element.
  • FIG. 3 is a flowchart of a data query method according to an embodiment of the present invention. As shown in FIG. 3, the process includes the following steps:
  • Step S302 The first query request that is sent in batches to the lower-level system that is not based on the session system, and the first query request is used to request to query data that supports batch query;
  • the first query parameter pre-defined in the upper-level system is cached, and the query parameter is carried in the first query request.
  • the predefined meaning in step 302 is that, before the data query of the upper-level system in the non-session-based system (for example, in the SDN network system), the batch query of the upper-level system and the return response of the lower-level system are parameter-defined. .
  • the batch query of the upper-level system and the return response of the lower-level system are parameter-defined.
  • the parameters used in the batch query ie, the first query parameter
  • the first query parameter includes at least: a query filter condition, a batch quantity, a query batch, a query target, a query range, and a sort condition. It should be noted that the four parameters of the query filter condition, the batch quantity, the query batch, and the sort condition must be set in the first query parameter.
  • the query target and query scope are used as optional two parameters for more accurate query.
  • the data that is queried in this embodiment may be tunnel tunnel data of the entire network.
  • the tunnel data is at least hundreds of thousands.
  • the method provided in the present invention is also applicable to scenes of several hundred thousand or less.
  • the data attributes of the query data need to be correspondingly defined in the non-based session system.
  • the data attribute includes at least: an identifier information id, a user label userlabel, a direction direction, a type tunneltype, a source network element identifier sourceNEID, a sink network element identifier destNEID, a QOS information qos, and a management status. adminStatus. It should be noted that for the superior and subordinate systems, the uniqueness of the data is distinguished by identifying the identification information in the processed data attribute.
  • Step S304 the upper-level system receives the first query result sent by the lower-level system according to the batch query request.
  • the data query fails.
  • the predetermined time is not a fixed value, and may be adjusted according to the needs of the user. It should be noted that the predetermined time may be determined by using the first query parameter, and may also be determined according to the user's preference.
  • the updating refers to detecting whether there is data that is duplicated with the identification information according to the identification information in the first query result, and if the determination result is yes, replacing or discarding the duplicate of the identification information data.
  • Step S306 the upper-level system sends a second query request to the lower-level system, where the second query request is used to request data in the data that supports the batch query, except for the first query result;
  • the second query parameter is also pre-defined before the data query by the upper-level system, and the function is to instruct the upper-level system to query the missing data.
  • the downlink system can be assisted to know which data has been queried, and which data is theoretically advanced. The query was made, but the data for the query was not actually made.
  • the process of sending the second query request to the lower-level system may be sent in batches, that is, after receiving the first query result sent by each batch of the lower-level system, the second query request is sent for the batch of data.
  • the above method of sending the second query request in batches can query the missing data more accurately, and the low miss rate is guaranteed.
  • the second query request is sent at one time.
  • the above method of sending a second query request at one time can save time in a large number of data query processes. The user can confirm the method of sending the second query request according to his own needs.
  • the second query request can be sent in batches, and if the amount of data queried is very Large (for example, tens of millions or hundreds of millions, but not limited to this), then the method of sending a second query request at a time.
  • the method of sending a second query request can also be sent together. This method ensures the accuracy of the missing data query to a certain extent, and also takes into account the query time.
  • Step S308 the upper-level system receives a second query result sent by the lower-level system according to the second query request.
  • the superior system when the superior system does not receive the second query result sent by the subordinate system within a predetermined time, it is determined that no missing data needs to be processed.
  • the second query result when there is no missing data to be processed, the second query result is empty.
  • the second query result is identifier information corresponding to the missing data.
  • the upper-level system mentioned in the foregoing embodiment is an upper-layer controller, an APP, or a system that accesses the upper-layer controller, and the lower-level system is a controller for performing query processing.
  • FIG. 4 is a flowchart of a data query processing method according to an embodiment of the present invention, as shown in FIG. The process includes the following steps:
  • Step S402 the non-based system under the session system receives the first query request sent by the upper system in batches, wherein the first query request is used to request to query data supporting the batch query;
  • Step S404 the lower-level system determines a first query result according to the first query request, and sends the first query result to the superior system.
  • the lower-level system extracts data from the data supporting the batch query according to an arrangement order in the first query request and a batch request; and invokes a first response that is predefined in the lower-level system. And generating a first query result according to the extracted data.
  • the batch query of the upper-level system and the return response of the lower-level system are parameter-defined.
  • the parameter of the return response i.e., the first response parameter
  • the first response parameter includes at least the following information: identifier information of the extracted data, a query batch, and a total batch number.
  • the data attributes of the query data need to be defined accordingly.
  • the data attribute includes at least: an identifier information id, a user label userlabel, a direction direction, a type tunneltype, a source network element identifier sourceNEID, a sink network element identifier destNEID, a QOS information qos, and a management status adminStatus. Therefore,
  • the other data attributes corresponding to the extracted data identification information may also be sent to the upper-level system in the first response parameter. Specifically, it can be sent in the form of a list.
  • Step S406 The lower-level system receives a second query request sent by the upper-level system, where the second query request is used to request data in the data that supports the batch query, except for the first query result.
  • Step S408 the lower-level system determines a second query result according to the second query request, and sends the second query result to the superior system.
  • the lower-level system excludes data that is not sent to the superior system from the data that supports the batch query according to the data identification information in the first query result in the second query request.
  • the data identification information in the first query result in the second query request and the identification information of the data supporting the batch query are compared. If there is a data identifier that has not been processed in the last query processing, it is determined that the data is missing data, that is, data that is not sent to the superior system.
  • the second response parameter predefined in the lower level system is invoked, and the second query result is generated according to the data not sent to the superior system.
  • the second response parameter is also predefined before the data query by the superior system, and the function is to instruct the lower system to determine the missing data.
  • the second response parameter includes: identifier information of the data in the data that supports the batch query that does not appear in the first query result.
  • the subordinate system determines, according to the third query result, that no data is missing in the received first query result.
  • the upper-level system mentioned in the foregoing embodiment is an upper-layer controller, an APP, or a system that accesses the upper-layer controller, and the lower-level system is a controller for performing query processing.
  • FIG. 5 is a timing diagram of a data query according to an embodiment of the present invention. It should be noted that, as shown in FIG. 5, the scenario includes:
  • Step 1 Define the tunnel data structure that supports batch query.
  • the only key is id. It mainly includes the following contents: unique identifier: id, user label: userlabel, direction: direction, type: tunnelType, source NE ID: sourceNEID, sink NE ID: destNEID, QOS information: qos, management status: adminStatus.
  • Step 2 Define the interface command for batch query, so that the SC can perform batch query.
  • the details are as follows:
  • the query of the entire network tunnel is sent by the SC system.
  • the input parameters are: query target, query scope, batch quantity, sorting condition, query batch, and response parameters are: query batch, total batch number, and data list satisfying the condition.
  • the format of the list unit is as follows: unique identifier: id User label: userlabel, direction: direction, type: tunnelType, source NE ID: sourceNEID, sink NE ID: destNEID, QOS information: qos, management status: adminStatus.
  • Step 3 Define the query for the remaining tunnels as the query parameters sent by the upper-level system: query filtering conditions, the list of ids that have obtained the tunnel, the query target, and the query scope.
  • the response parameters returned by the downlink system include: a list of remaining tunnel objects in the system.
  • the format of the list unit is as follows: unique identifier: id, user label: userlabel, direction: direction, type: tunnelType, source NE ID: sourceNEID, sink NE ID: destNEID, QOS information: qos, management status: adminStatus.
  • Step 4 After the initialization is completed, the dynamic service rerouting module starts to query the entire network tunnel in batches, and uses the batch query command in step 2 to construct the query parameters and deliver them to the lower-level system. Each query is 2000, and the query batch is obtained. The number is incremented from 1.
  • the query parameters are as follows: Query target: network-wide tunnel; query scope: network-wide data; query filter condition: unconditional query; batch number: 2000; sorting condition: sort by direction; query batch: 1.
  • Step 5 After receiving the query request, the lower-level DC system collects the tunnel data records according to the query conditions, and then sorts according to the direction of the tunnel, and then extracts 2000 list of the tunnel objects to be returned according to the batch request of the query request, and returns to the superior. system.
  • Step 6 The upper-level SC system saves the received batch tunnel data and updates the memory data. During the update process, the tunnel id keyword is used for fast comparison. If there is duplicate tunnel data, it is directly discarded.
  • Step 7 Repeat steps 4 through 6 to query the 2, 3, 4...N... batches in turn until all the tunnel data has been queried.
  • Step 8 Query the remaining tunnel data.
  • all the tunnel ids that have been queried are used as the basic data, and the remaining tunnel data interfaces are sent to query.
  • the command parameters corresponding to the query are: query target: network-wide tunnel, query scope: network-wide data, query filtering conditions: unconditional query.
  • Step 9 After receiving the command to query the remaining records, the subordinate system collects the data again according to the query condition, and then matches the tunnel data represented by the data identifier that has been returned, and leaves the tunnel data that has not been returned. And return to the superior system. If no data is missing, an empty list is returned. Found missing data records, return parameters:
  • a data query device is also provided, which is used to implement the above implementation.
  • the examples and preferred embodiments have not been described again.
  • the term "module” may implement a combination of software and/or hardware of a predetermined function.
  • the apparatus described in the following embodiments is preferably implemented in software, hardware, or a combination of software and hardware, is also possible and contemplated.
  • FIG. 6 is a structural diagram of a data query apparatus according to an embodiment of the present invention. As shown in FIG. 6, the apparatus is located in a higher-level system, and includes: a first sending module 62, a first receiving module 64, and a second sending module 66. And a second receiving module 68.
  • the first sending module 62 is configured to generate a batch query request according to the interface command of the batch query, and send the batch query request to the lower-level system.
  • a first receiving module configured to receive a first query result sent by the lower-level system according to the batch query request;
  • the first sending module 62 is further configured to: call a first query parameter that is predefined in the upper-level system, and carry the query parameter in the first query request, where the query parameter At least the following parameters are included: query filter criteria, batch quantity, query batch, query target, query scope, and sorting criteria.
  • the pre-defined meaning is that, before the first sending module 62 in the non-based session system (for example, in the SDN network system) performs data query, the batch query of the upper system and the return response of the lower system are performed. definition. In this embodiment, since only the first sending module 62 in the upper system is involved, only the parameters used in the batch query (ie, the first query parameter) are used by the upper system.
  • the four parameters of the query filter condition, the batch quantity, the query batch, and the sort condition must be set in the first query parameter.
  • the query target and query scope are used as optional two parameters for more accurate query.
  • the data that is queried in this embodiment may be tunnel tunnel data of the entire network.
  • the tunnel data is at least hundreds of thousands.
  • the method provided in the present invention is also applicable to scenes of several hundred thousand or less.
  • the first receiving module 64 is configured to receive a first query result sent by the subordinate system according to the batch query request;
  • the data query fails.
  • the predetermined time is not a fixed value, and may be adjusted according to the needs of the user. It should be noted that the predetermined time may be determined by using the first query parameter, and may also be determined according to the user's preference.
  • the second sending module 66 is configured to send a second query request to the lower-level system, where the second query request is used to request data in the data that supports the batch query, except for the first query result;
  • the second sending module 66 is further configured to: call a second query parameter that is predefined in the upper-level system, and carry the second query parameter in the second query request, where
  • the second query parameter includes at least the following information: a query filtering condition, data identification information in the first query result, a query target, and a query range.
  • the second query parameter is also pre-defined before the data query by the upper-level system, and the function is to instruct the upper-level system to query the missing data.
  • the downlink system can be assisted to know which data has been queried, and which data is theoretically queried, but the query has not actually been performed. The data.
  • the process that the second sending module 66 sends the second query request to the lower-level system may be sent in batches, that is, after receiving the first query result sent by each batch of the lower-level system, the first data is sent for the batch of data.
  • Second query request The above method of sending the second query request in batches can query the missing data more accurately, and the low miss rate is guaranteed.
  • the second query request is sent at one time.
  • the above method of sending a second query request at one time can save time in a large number of data query processes. The user can confirm the method of sending the second query request according to his own needs.
  • the second query request can be sent in batches, and if the amount of data queried is very Large If it is tens of millions or hundreds of millions, but not limited to this, then the method of sending the second query request is used once. Of course, in the actual application process, multiple batches of second query requests can also be sent together. This method ensures the accuracy of the missing data query to a certain extent, and also takes into account the query time.
  • the second receiving module 68 is configured to receive a second query result sent by the subordinate system according to the second query request.
  • the second receiving module 68 when the second receiving module 68 does not receive the second query result sent by the subordinate system within a predetermined time, it is determined that no missing data needs to be processed.
  • the second query result when there is no missing data to be processed, the second query result is empty.
  • the second query result is identifier information corresponding to the missing data.
  • FIG. 7 is a structural diagram of another data query apparatus according to an embodiment of the present invention. As shown in FIG. 7, the apparatus includes an update module 72 in addition to all the modules shown in FIG.
  • the updating module 72 is configured to: according to the first query result, update data corresponding to the first query result, including: detecting, according to the identifier information in the first query result, whether there is a duplicate with the identifier information Data; in the case where the judgment result is YES, the data overlapping with the identification information is replaced or discarded.
  • each of the above modules may be implemented by software or hardware.
  • the foregoing may be implemented by, but not limited to, the foregoing modules are all located in the same processor; or, the above modules are in any combination.
  • the forms are located in different processors.
  • a data query processing device is further provided, which is used to implement the above
  • the term “module” may implement a combination of software and/or hardware of a predetermined function.
  • the apparatus described in the following embodiments is preferably implemented in software, hardware, or a combination of software and hardware, is also possible and contemplated.
  • FIG. 8 is a structural diagram of a data query processing apparatus according to an embodiment of the present invention. As shown in FIG. 8, the apparatus is located in a higher-level system, and includes: a first receiving module 82, a first sending module 84, and a second receiving module. 86 and a second sending module 88.
  • the first receiving module 82 is configured to receive a first query request sent by the upper-level system in batches, where the first query request is used to request to query data that supports batch query;
  • the first sending module 84 is configured to determine a first query result according to the first query request, and send the first query result to the superior system;
  • FIG. 9 is a structural diagram of another data query processing apparatus according to an embodiment of the present invention.
  • the first sending module includes: an extracting unit 92 and a first generating unit 94.
  • the extracting unit 92 is configured to extract data from the data supporting the batch query according to the sorting order in the first query request and the batch request;
  • the first generating unit 94 is configured to invoke a first response parameter that is predefined in the lower-level system, and generate a first query result according to the extracted data, where the first response parameter includes at least the following information : identification information of the extracted data, query batch, and total batch number.
  • the batch query of the upper-level system and the return response of the lower-level system are parameter-defined.
  • the parameter of the return response i.e., the first response parameter
  • the data attributes of the query data need to be defined accordingly.
  • the data attribute includes at least: an identifier information id, a user label userlabel, a direction direction, a type tunneltype, a source network element identifier sourceNEID, a sink network element identifier destNEID, a QOS information qos, and a management status adminStatus. Therefore,
  • the other data attributes corresponding to the extracted data identification information may also be sent to the upper-level system in the first response parameter. Specifically, it can be sent in the form of a list.
  • the second receiving module 86 is configured to receive a second query request sent by the upper-level system, where the second query request is used to request data that is in addition to the first query result in the data that supports the batch query;
  • the second sending module 88 is configured to determine a second query result according to the second query request, and send the second query result to the superior system.
  • FIG. 10 is a structural diagram of still another data query processing apparatus according to an embodiment of the present invention.
  • the second sending module 88 includes: an excluding unit 1002 and a second generating unit 1004.
  • the exclusion unit 1002 is configured to exclude, according to the data identification information in the first query result in the second query request, data that is not sent to the superior system from the data that supports the batch query;
  • the exclusion unit 1002 compares the data identification information in the first query result in the second query request with the identification information of the data supporting the batch query. If there is a data identifier that has not been processed in the last query processing, the exclusion unit 1002 determines that the data is missing data, that is, data that is not sent to the superior system.
  • the second generating unit 1004 is configured to invoke a second response parameter that is predefined in the lower-level system, and generate a second query result according to the data that is not sent to the upper-level system, where the second response parameter is at least
  • the method includes: the identification information of the data that is in the first query result is not included in the data that supports the batch query.
  • the second response parameter is also predefined before the data query by the superior system, and the function is to instruct the lower system to determine the missing data.
  • the second response parameter includes: identifier information of the data in the data that supports the batch query that does not appear in the first query result.
  • the subordinate system finds that no data is missing in the second query request, the subordinate system sends a third query result to the upper system, and the third query result is empty.
  • the superior system determines, based on the third query result, that no data is missing from the first query result received.
  • each of the above modules may be implemented by software or hardware.
  • the foregoing may be implemented by, but not limited to, the foregoing modules are all located in the same processor; or, the above modules are in any combination.
  • the forms are located in different processors.
  • FIG. 11 is a structural diagram of a data query system according to an embodiment of the present invention. As shown in FIG. 11, the device is located in a higher-level system, and includes: a superior system 1102 and a lower-level system 1104.
  • the upper system 1102 is configured to send a first query request sent in batches to the lower system 1104, the first query request is used to request to query data supporting the batch query; and the second query request is sent to the subordinate system 1104.
  • the second query request is used to request data in the data that supports the batch query, except for the first query result;
  • the lower-level system 1104 is configured to receive the first query request sent by the upper-level system 1102 in batches; determine a first query result according to the first query request, and send the first query result to the superior system Receiving the second query request sent by the upper-level system 1102; determining a second query result according to the second query request, and sending the second query result to the superior system 1102.
  • FIG. 12 is a structural diagram of a controller according to an embodiment of the present invention.
  • the controller 1202 is a controller corresponding to a lower-level system.
  • the northbound interface receives the query request sent by the upper-level interface, and after the batch query module, the resource management module, and the service management module process the module, the query result is returned through the northbound interface.
  • the lower-level system sends a management update command to each network element via the northbound interface and the southbound interface.
  • Embodiments of the present invention also provide a storage medium.
  • the foregoing storage medium may be configured to store program code for performing the following steps:
  • the first query request that is sent in batches to the lower-level system that is not based on the session system, and the first query request is used to request to query data that supports batch query.
  • the upper-level system receives a first query result sent by the lower-level system according to the batch query request.
  • the upper-level system sends a second query request to the lower-level system, where the second query request is used to request data that is in addition to the first query result in the data that supports the batch query.
  • the upper-level system receives a second query result sent by the lower-level system according to the second query request.
  • the storage medium is further arranged to store program code for performing the following steps:
  • the storage medium is further arranged to store program code for performing the following steps:
  • the foregoing storage medium may include, but not limited to, a USB flash drive, a Read-Only Memory (ROM), a Random Access Memory (RAM), a mobile hard disk, and a magnetic memory.
  • ROM Read-Only Memory
  • RAM Random Access Memory
  • a mobile hard disk e.g., a hard disk
  • magnetic memory e.g., a hard disk
  • a storage medium is also provided.
  • the storage medium is arranged to store program code for performing the following steps:
  • the first system in the non-session-based system receives the first batch transmission of the upper-level system in batches.
  • the request request wherein the first query request is used to request to query data supporting a batch query;
  • the lower-level system determines a first query result according to the first query request, and sends the first query result to the superior system.
  • the lower-level system receives a second query request sent by the upper-level system, where the second query request is used to request data that is in addition to the first query result in the data that supports the batch query.
  • the lower-level system determines a second query result according to the second query request, and sends the second query result to the superior system.
  • the storage medium is further arranged to store program code for performing the following steps:
  • the lower-level system excludes data that is not sent to the upper-level system from the data that supports the batch query according to the data identifier information in the first query result in the second query request.
  • modules or steps of the present invention described above can be implemented by a general-purpose computing device that can be centralized on a single computing device or distributed across a network of multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device such that they may be stored in the storage device by the computing device and, in some cases, may be different from the order herein.
  • the steps shown or described are performed, or they are separately fabricated into individual integrated circuit modules, or a plurality of modules or steps thereof are fabricated as a single integrated circuit module.
  • the invention is not limited to any specific combination of hardware and software.
  • the superior system utilizes the query result of the query request for the batch query data sent by the lower-level system for the upper-level system in batches, and also sends the query request carrying the data that has been batch-queried by the lower-level system.
  • the query process is complicated, the query efficiency is low, and the network system is seriously burdened in the data query process of the non-session-based network system in the related art can be solved, thereby achieving efficient query of a large amount of data, and the query mode is simple, Missing effect.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

本发明提供了一种数据查询、数据查询处理方法及装置。该数据查询方法包括:非基于会话系统下的上级系统向下级系统分批发送的第一查询请求,该所述第一查询请求用于请求查询支持批量查询的数据;所述上级系统接收所述下级系统依据所述批量查询请求发送的第一查询结果;所述上级系统向所述下级系统发送第二查询请求,该第二查询请求用于请求查询支持批量查询的数据中除所述第一查询结果之外的数据;所述上级系统接收所述下级系统依据所述第二查询请求发送的第二查询结果。通过上述方法,解决了相关技术中非基于会话的网络系统的数据查询过程中存在查询过程复杂,查询效率低下以及对网络系统造成严重负担等问题。

Description

数据查询、数据查询处理方法及装置 技术领域
本发明涉及通信领域,具体而言,涉及一种数据查询、数据查询处理方法及装置。
背景技术
在通讯网络中,网络由许多通讯设备节点组成,这些网络节点叫做网元。网元之间通过通讯线路进行连接,包括光纤电缆等多种形式。网元分散分布在各个地区,有的在城市里的通讯大楼实验室里,有的网元在偏远地区。这些分处不同地域的网元的设备需要进行配置、维护和监控,不可能每处都派人值守,这样就需要一个中心网络管理系统,放在中心机房,通过远程通讯对网络上各个节点进行配置、维护和监控。
通过软件定义网络(Software Defined Network,简称SDN)控制器管理网络是一种新出现的网络管理控制系统。在这个控制系统中,把传统网管中对业务资源的控制功能独立出来,仅仅关注业务资源。控制器可以按树型层次化组织,以便管理大规模网络。直接管理网元的叫域控制器(Domain Controller,D-Controller,简称DC);上层的控制器(Super Controller,S-Controller,简称SC)不直接管理网元,而是管理域控制器,然后再通过域控制器提供的虚拟网络管理,实现对实际网络的管理。
图1是相关技术中SDN控制器的网元管理图,如图1所示,在图1的模型中,控制器形成树型管理体系,上层是S-Controller(即上层控制器,简称SC),下层是D-Controller(即下层控制器,简称DC),DC划分管理域,管理通讯网络和网元。控制器除了南向和网络设备通过接口进行管理,还有北向接口可以让应用层的网络应用APP接入进行网络管理,另外可以通过侧接口,同网管平面(包括EMS网元管理系统,NMS网络管理系统,或者OSS操作支撑系统)沟通管理信息。网络APP是对网络的实际业务应用,它会使用控制器提供的资源,发出业务创建、删除、修改等请 求。而控制器根据网络APP的请求创建、删除、修改业务,并对业务的告警和性能进行监控。图2是相关技术中SDN控制器与其他实体的关系图。如图2所示,DC直接管理通讯网络,SC管理DC,同时还可以和传统网络管理系统进行交互,最终给APP提供资源和服务。
在实际网络管理中,网络可能非常大,有几万个网元节点,网元内有几千上万的端口或者终端点资源需要管理,这样端口或终端点的总数将达到上亿。相应的,建立的业务数也有几千万条。控制器的上级系统需要查询资源的时候,可能面临着大数据量问题,当满足查询条件的数据很多的时候,控制器给上级系统形成的应答包很大,通过通讯连接发回应答会需要很长时间,上级系统也不一定能处理过来。而且,大数据量查询还会影响系统的整体运行效率,进而影响其他功能的运行。
在传统的网管系统corba接口中,可以采用分页查询的方式,像翻页一样,一次返回一页数据。处理完后,上级系统再查下一页数据。但是这样网管需要维持查询的状态,而且因为需要支持多个上级系统的查询,网管需要实现类似会话的机制,在内存保持每个上级系统的多个不同查询会话的状态和数据,以便上级系统翻页查询。这样虽然解决了部分问题,对下级系统(提供服务的网管或者控制器)来说,也需要增加不少开销,也会增加下层的开发实现难度。
在SDN控制器网络环境中,控制器使用openflow,netconf等无状态接口协议和上层系统通讯,加上由于SDN控制器的设计思想是避免无状态管理,上述的现有技术也不适合在控制器环境中使用。因此,非基于会话的网络系统(例如SDN网络系统)的数据查询过程中存在查询过程复杂,查询效率低下以及对网络系统造成严重负担等问题。
发明内容
本发明实施例提供了一种数据查询、数据查询处理方法及装置,以至少解决相关技术中非基于会话的网络系统的数据查询过程中存在查询过程复杂,查询效率低下以及对网络系统造成严重负担等问题。
根据本发明的一个实施例,提供了一种数据查询方法,包括:非基于会话系统下的上级系统向下级系统分批发送的第一查询请求,该所述第一查询请求用于请求查询支持批量查询的数据;所述上级系统接收所述下级系统依据所述批量查询请求发送的第一查询结果;所述上级系统向所述下级系统发送第二查询请求,该第二查询请求用于请求查询支持批量查询的数据中除所述第一查询结果之外的数据;所述上级系统接收所述下级系统依据所述第二查询请求发送的第二查询结果。
根据本发明的又一个实施例,还提供了一种数据查询处理方法,包括:非基于会话系统下的下级系统接收上级系统分批发送的第一查询请求,其中,所述第一查询请求用于请求查询支持批量查询的数据;所述下级系统依据所述第一查询请求确定第一查询结果,并将所述第一查询结果发送给所述上级系统;所述下级系统接收所述上级系统发送的第二查询请求,该第二查询请求用于请求查询支持批量查询的数据中除所述第一查询结果之外的数据;所述下级系统依据所述第二查询请求确定第二查询结果,并将所述第二查询结果发送给所述上级系统。
根据本发明的另一个实施例,还提供了一种数据查询装置,位于上级系统中,包括:第一发送模块,设置为在需要进行批量查询时,根据批量查询的接口命令生成批量查询请求,并下发给下级系统;第一接收模块,设置为接收所述下级系统依据所述批量查询请求发送的第一查询结果;第二发送模块,设置为向所述下级系统发送第二查询请求,该第二查询请求设置为请求查询支持批量查询的数据中除所述第一查询结果之外的数据;第二接收模块,设置为接收所述下级系统依据所述第二查询请求发送的第二查询结果。
根据本发明的再一个实施例,还提供了一种数据查询处理装置,位于下级系统中,包括:第一接收模块,设置为接收上级系统分批发送的第一查询请求,其中,所述第一查询请求用于请求查询支持批量查询的数据;第一发送模块,设置为依据所述第一查询请求确定第一查询结果,并将所述第一查询结果发送给所述上级系统;第二接收模块,设置为接收所述上 级系统发送的第二查询请求,该第二查询请求用于请求查询支持批量查询的数据中除所述第一查询结果之外的数据;第二发送模块,设置为依据所述第二查询请求确定第二查询结果,并将所述第二查询结果发送给所述上级系统。
根据本发明的还一个实施例,还提供了一种数据查询系统,位于非基于会话系统中,包括:上级系统,设置为向下级系统分批发送的第一查询请求,该所述第一查询请求用于请求查询支持批量查询的数据;向所述下级系统发送第二查询请求,该第二查询请求用于请求查询支持批量查询的数据中除所述第一查询结果之外的数据;所述下级系统,设置为接收所述上级系统分批发送的所述第一查询请求;依据所述第一查询请求确定第一查询结果,并将所述第一查询结果发送给所述上级系统;接收所述上级系统发送的所述第二查询请求;依据所述第二查询请求确定第二查询结果,并将所述第二查询结果发送给所述上级系统。
根据本发明的另一个实施例,还提供了一种存储介质。该存储介质设置为存储用于执行以下步骤的程序代码:
S11,非基于会话系统下的上级系统向下级系统分批发送的第一查询请求,该所述第一查询请求用于请求查询支持批量查询的数据;
S12,所述上级系统接收所述下级系统依据所述批量查询请求发送的第一查询结果;
S13,所述上级系统向所述下级系统发送第二查询请求,该第二查询请求用于请求查询支持批量查询的数据中除所述第一查询结果之外的数据;
S14,所述上级系统接收所述下级系统依据所述第二查询请求发送的第二查询结果。
可选地,存储介质还设置为存储用于执行以下步骤的程序代码:
S21,根据所述第一查询结果,更新与所述第一查询结果对应的数据。
可选地,存储介质还设置为存储用于执行以下步骤的程序代码:
S31,根据所述第一查询结果中的标识信息,检测是否存在与所述标识信息重复的数据;
S32,在判断结果为是的情况下,替换或者抛弃与所述标识信息重复的数据。
根据本发明的再一个实施例,还提供了一种存储介质。该存储介质设置为存储用于执行以下步骤的程序代码:
S11,非基于会话系统下的下级系统接收上级系统分批发送的第一查询请求,其中,所述第一查询请求用于请求查询支持批量查询的数据;
S12,所述下级系统依据所述第一查询请求确定第一查询结果,并将所述第一查询结果发送给所述上级系统;
S13,所述下级系统接收所述上级系统发送的第二查询请求,该第二查询请求用于请求查询支持批量查询的数据中除所述第一查询结果之外的数据;
S14,所述下级系统依据所述第二查询请求确定第二查询结果,并将所述第二查询结果发送给所述上级系统。
可选地,存储介质还设置为存储用于执行以下步骤的程序代码:
S21,所述下级系统依据所述第二查询请求中的所述第一查询结果中的数据标识信息,从所述支持批量查询的数据中排除出没有发送给所述上级系统的数据;
S22,调用缓存在所述下级系统中预先定义的第二应答参数,并依据没有发送给所述上级系统的数据生成所述第二查询结果。
通过本发明实施例,由于上级系统利用下级系统针对上级系统分批发送的对支持批量查询的数据的查询请求的查询结果,同时还能通过下发携带有已经进行分批查询的数据的查询请求,以获取遗漏数据的查询结果。因此,可以解决相关技术中非基于会话的网络系统的数据查询过程中存在查询过程复杂,查询效率低下以及对网络系统造成严重负担等问题,从而 达到了高效查询大量数据,且查询方式简单,没有遗漏的效果。
附图说明
此处所说明的附图用来提供对本发明的进一步理解,构成本申请的一部分,本发明的示意性实施例及其说明用于解释本发明,并不构成对本发明的不当限定。在附图中:
图1是相关技术中SDN控制器的网元管理图;
图2是相关技术中SDN控制器与其他实体的关系图;
图3是根据本发明实施例的一种数据查询方法的流程图;
图4是根据本发明实施例的一种数据查询处理方法的流程图;
图5根据本发明实施例的一种数据查询的时序图;
图6是根据本发明实施例的一种数据查询装置的结构图;
图7是根据本发明实施例的另一种数据查询装置的结构图;
图8是根据本发明实施例的一种数据查询处理装置的结构图;
图9是根据本发明实施例的另一种数据查询处理装置的结构图;
图10是根据本发明实施例的再一种数据查询处理装置的结构图;
图11是根据本发明实施例的一种数据查询系统的结构图;
图12是根据本发明实施例的一种控制器的结构图。
具体实施方式
下文中将参考附图并结合实施例来详细说明本发明。需要说明的是,在不冲突的情况下,本申请中的实施例及实施例中的特征可以相互组合。
需要说明的是,本发明的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。
实施例1
在本实施例中提供了一种图1和/图2中所示的系统架构的数据查询方法,其中,控制器形成树型管理体系,上层是S-Controller(即上层控制器,简称SC),下层是D-Controller(即下层控制器,简称DC),DC划分管理域,管理通讯网络和网元。
图3是根据本发明实施例的一种数据查询方法的流程图,如图3所示,该流程包括如下步骤:
步骤S302,非基于会话系统下的上级系统向下级系统分批发送的第一查询请求,该所述第一查询请求用于请求查询支持批量查询的数据;
可选地,调用缓存在所述上级系统中预先定义的第一查询参数,并将所述查询参数携带在所述第一查询请求中。
具体地,步骤302中的预先定义的含义为,在非基于会话系统中(例如在SDN网络系统中)的上级系统进行数据查询之前,对上级系统进行批量查询和下级系统进行返回应答进行参数定义。在本实施例中,由于只涉及上级系统一侧,因此,只使用上级系统进行批量查询中所使用的参数(即第一查询参数)。
具体地,该第一查询参数至少包括:查询过滤条件、分批数量、查询批次、查询目标、查询范围以及排序条件。需要指出的是,查询过滤条件、分批数量、查询批次、排序条件这四个参数是必须设置在第一查询参数当中。而查询目标、查询范围则作为可选的两个参数,以供进行更精确的查询。
可选地,本实施例中进行查询的数据可以为全网的隧道Tunnel数据。在实际查询场景中,该Tunnel数据至少由几十万条。当然本发明中所提供的方法同样也是适用于几十万条以下的场景当中。
可选地,在步骤S302前,在非基于会话系统中还需要对进行查询数据的数据属性进行相应的定义。具体地,该数据属性至少包括:标识信息id,用户标签userlabel,方向direction,类型tunneltype,源网元标识sourceNEID,宿网元标识destNEID,QOS信息qos以及管理状态 adminStatus。需要指出的是,对于上级和下级系统,通过识别处理数据属性中的标识信息来进行数据唯一性区分。
步骤S304,所述上级系统接收所述下级系统依据所述批量查询请求发送的第一查询结果;
可选地,当所述上级系统在预定时间内未收到所述下级系统发送的所述查询结果时,数据查询失败。
具体地,该预定时间并不是固定值,可以根据用户需要进行调整,需要指出的是,该预定时间可以通过第一查询参数进行确定,当然也可以根据用户的喜好来确定,
可选地,在接收第一查询结果之后,根据所述第一查询结果,更新与所述第一查询结果对应的数据。
具体地,该更新是指根据所述第一查询结果中的标识信息,检测是否存在与所述标识信息重复的数据,在判断结果为是的情况下,替换或者抛弃与所述标识信息重复的数据。
步骤S306,所述上级系统向所述下级系统发送第二查询请求,该第二查询请求用于请求查询支持批量查询的数据中除所述第一查询结果之外的数据;
可选地,基于与重复相同的原因,多次查询期间可能存在数据更新,导致排序发生变化。因此,可能会存在查询遗漏的问题。调用缓存在所述上级系统中预先定义的第二查询参数,并将所述第二查询参数携带在所述第二查询请求中,其中,所述第二查询参数至少包括以下信息:查询过滤条件、所述第一查询结果中的数据标识信息、查询目标以及查询范围。
具体的,与第一查询参数类似的是,该第二查询参数同样也是在上级系统进行数据查询之前进行预先定义的,作用在于指示上级系统查询遗漏数据。
通过将第一查询结果中的数据标识信息携带在第二查询参数中,因此,可以协助下行系统知晓哪些的数据已经进行了查询,而哪些数据理论上进 行了查询,但是实际上没有进行过查询的数据。
可选地,上述向下级系统发送第二查询请求的过程可以是分批发送,即在接收到每一批下级系统发送的第一查询结果后,针对该批数据下发第二查询请求。上述分批发送第二查询请求的方法可以更加精确地查询遗漏数据,保证了低遗漏率。同时也可以是在上级系统接收到所有批次的第一查询结果后,一次性下发第二查询请求。上述一次发送第二查询请求的方法可以在大量数据查询过程中节省时间。用户可以根据自身需要确认发送第二查询请求的方法。例如,如果查询的数据量不是特别大(例如几千或者几万,但不限于此),同时用户追求低遗漏率的话,那么可以采取分批发送第二查询请求,而如果查询的数据量很大(例如几千万或者上亿,但不限于此),那么采用一次发送第二查询请求的方法。当然,在实际应用过程当中,还可以将多个批次的第二查询请求一同发送,这种方法在一定程度上保证了对遗漏数据查询的精确,同时还兼顾了查询时间。
步骤S308,所述上级系统接收所述下级系统依据所述第二查询请求发送的第二查询结果。
可选地,当所述上级系统在预定时间内未收到所述下级系统发送的所述第二查询结果时,确定没有遗漏数据需要处理。
可选地,当没有遗漏数据需要处理时,所述第二查询结果为空,当有遗漏数据需要处理时,所述第二查询结果为所述遗漏数据对应的标识信息。
可选地,以上实施例中提及的上级系统为上层控制器、APP或接入所述上层控制器的系统,下级系统为用于进行查询处理的控制器。
通过上述步骤,解决了相关技术中非基于会话的网络系统的数据查询过程中存在查询过程复杂,查询效率低下以及对网络系统造成严重负担等问题,从而达到了高效大量查询数据,且查询方式简单,没有遗漏的效果。
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到根据上述实施例的方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理 解,本发明的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端设备(可以是手机,计算机,服务器,或者网络设备等)执行本发明各个实施例所述的方法。
实施例2
在本实施例中提供了一种运行于图1和/图2中系统架构的数据查询处理方法,图4是根据本发明实施例的一种数据查询处理方法的流程图,如图4所示,该流程包括如下步骤:
步骤S402,非基于会话系统下的下级系统接收上级系统分批发送的第一查询请求,其中,所述第一查询请求用于请求查询支持批量查询的数据;
步骤S404,所述下级系统依据所述第一查询请求确定第一查询结果,并将所述第一查询结果发送给所述上级系统。
可选地,所述下级系统依据所述第一查询请求中的排列顺序以及分批要求,从所述支持批量查询的数据中抽取数据;调用缓存在所述下级系统中预先定义的第一应答参数,并依据所述抽取后的数据生成第一查询结果。
需要指出的是,在非基于会话系统中(例如在SDN网络系统中)的上级系统进行数据查询之前,对上级系统进行批量查询和下级系统进行返回应答进行了参数定义。在本实施例中,由于只涉及下级系统一侧,因此,只使用下级系统进行返回应答的参数(即第一应答参数)。
可选地,所述第一应答参数至少包括以下信息:所述抽取后的数据的标识信息、查询批次以及总批数。
需要指出的是,在非基于会话系统中还需要对进行查询数据的数据属性进行相应的定义。具体地,该数据属性至少包括:标识信息id,用户标签userlabel,方向direction,类型tunneltype,源网元标识sourceNEID,宿网元标识destNEID,QOS信息qos以及管理状态adminStatus。因此, 第一应答参数中还可以将抽取数据标识信息对应的其他数据属性发送给上级系统。具体可以以列表的形式发送。
步骤S406,所述下级系统接收所述上级系统发送的第二查询请求,该第二查询请求用于请求查询支持批量查询的数据中除所述第一查询结果之外的数据。
步骤S408,所述下级系统依据所述第二查询请求确定第二查询结果,并将所述第二查询结果发送给所述上级系统。
可选地,所述下级系统依据所述第二查询请求中的所述第一查询结果中的数据标识信息,从所述支持批量查询的数据中排除出没有发送给所述上级系统的数据。
具体地,通过比较第二查询请求中的第一查询结果中的数据标识信息以及支持批量查询的数据的标识信息。如果存在在上一次查询处理中没有经过处理的数据标识时,则确定该数据为遗漏数据,即确定为没有发送给所述上级系统的数据。
可选地,调用缓存在所述下级系统中预先定义的第二应答参数,并依据没有发送给所述上级系统的数据生成第二查询结果。
与第一应答参数类似的是,该第二应答参数同样也是在上级系统进行数据查询之前进行预先定义的,作用在于指示下级系统确定遗漏数据。具体地,第二应答参数包括:所述支持批量查询的数据中没有在所述第一查询结果中的出现的数据的标识信息。
具体地,如果下级系统发现在第二查询请求中没有遗漏数据的话,那么下级系统则会向上级系统发送第三查询结果,该第三查询结果为空。因此上级系统就会根据该第三查询结果确定接收的第一查询结果中没有遗漏任何数据。
可选地,以上实施例中提及的上级系统为上层控制器、APP或接入所述上层控制器的系统,下级系统为用于进行查询处理的控制器。
此外,在本发明中还提供了一种应用场景,应用于上述实施例1以及 实施例2。图5根据本发明实施例的一种数据查询的时序图。需要指出的是,如图5所示,该场景包括:
步骤1:定义支持批量查询的Tunnel数据结构,其唯一关键是id。主要包括如下内容:唯一标识:id,用户标签:userlabel,方向:direction,类型:tunnelType,源网元ID:sourceNEID,宿网元ID:destNEID,QOS信息:qos,管理状态:adminStatus。
步骤2:定义批量查询的接口命令,以便SC进行批量查询,具体如下:SC系统下发的查询全网隧道命令。输入参数为:查询目标、查询范围、分批数量、排序条件、查询批次、而应答参数为:查询批次、总批数以及满足条件的数据列表,列表单元的格式如下:唯一标识:id,用户标签:userlabel,方向:direction,类型:tunnelType,源网元ID:sourceNEID,宿网元ID:destNEID,QOS信息:qos,管理状态:adminStatus。
步骤3:定义查询其余Tunnel的接口为:上级系统发送的查询参数:查询过滤条件、已经获得Tunnel的id列表、查询目标、查询范围。
而下行系统返回的应答参数,包括:系统中剩余的Tunnel对象列表。列表单元的格式如下:唯一标识:id,用户标签:userlabel,方向:direction,类型:tunnelType,源网元ID:sourceNEID,宿网元ID:destNEID,QOS信息:qos,管理状态:adminStatus。
步骤4:上级系统在初始化完成后,动态业务重路由模块启动分批查询全网Tunnel,使用步骤2中的批量查询命令,构造查询参数,下发给下级系统,每次查询2000条,查询批次从1开始递增。
查询命令填写参数如下:查询目标:全网隧道;查询范围:全网数据;查询过滤条件:无条件查询;分批数量:2000条;排序条件:按照方向排序;查询批次:1。
步骤5:下级DC系统收到查询请求后,根据查询条件收集Tunnel数据记录,然后按照Tunnel的方向进行排序,然后按照查询请求的批次要求,抽取2000条要返回的Tunnel对象列表,返回给上级系统。其中,该 应答参数为:查询批次:第1批;总批数:100;满足条件的数据列表,列表单元如下:唯一标识:id=xsdjfw34o-epiwer034873;用户标签:userlabel=xx公司租用的隧道;方向:direction=双向;类型:tunnelType=LSP;源网元ID:sourceNEID=sdfjlsdgt-epiwer34667;宿网元ID:destNEID=w3fsa2t56-epiwer03dsr3;QOS信息:qos=glod;管理状态:adminStatus=active。
步骤6:上级SC系统保存收到的批量Tunnel数据,更新内存数据,更新过程中,根据Tunnel的id关键字进行快速对比,如果有重复的tunnel数据,直接进行丢弃。
步骤7:重复步骤4到6,依次查询第2,3,4…N…批次,直到Tunnel数据全部查询完毕。
步骤8:查询其余Tunnel数据,根据步骤3,将已经查询到的所有Tunnel关键字id做为基础数据,下发查询其余Tunnel数据接口,进行查询。其中该查询对应的命令参数为:查询目标:全网隧道、查询范围:全网数据、查询过滤条件:无条件查询。已经获取到的Tunnel的id列表:id=xsdjfw34o-epiwer034873;id=xsdjfw34o-epiwer034874………….
步骤9:下级系统收到查询其余记录的命令后,根据查询条件再次收集数据,然后匹配排除已经返回过的数据标识所代表的Tunnel数据,留下没有返回过的Tunnel数据。并返回给上级系统。如果没有遗漏数据,则返回空列表。发现有遗漏的数据记录,返回参数:
遗漏的数据列表,列表单元如下:唯一标识:id=sg345h6-epiert6664;用户标签:userlabel=yy公司租用的隧道;方向:direction=双向;类型:tunnelType=LSP;源网元ID:sourceNEID=sdfjlsdgt-epiwer346356;宿网元ID:destNEID=w3fsa2t56-epiwer03ds776;QOS信息:qos=silver;管理状态:adminStatus=active。
实施例3
在本实施例中还提供了一种数据查询装置,该装置用于实现上述实施 例及优选实施方式,已经进行过说明的不再赘述。如以下所使用的,术语“模块”可以实现预定功能的软件和/或硬件的组合。尽管以下实施例所描述的装置较佳地以软件来实现,但是硬件,或者软件和硬件的组合的实现也是可能并被构想的。
图6是根据本发明实施例的一种数据查询装置的结构图,如图6所示,该装置位于上级系统中,包括:第一发送模块62,第一接收模块64,第二发送模块66以及第二接收模块68。
第一发送模块62,设置为在需要进行批量查询时,根据批量查询的接口命令生成批量查询请求,并下发给下级系统。第一接收模块,设置为接收所述下级系统依据所述批量查询请求发送的第一查询结果;
可选地,第一发送模块62还设置为调用缓存在所述上级系统中预先定义的第一查询参数,并将所述查询参数携带在所述第一查询请求中,其中,所述查询参数至少包括以下参数:查询过滤条件、分批数量、查询批次、查询目标、查询范围以及排序条件。
需要指出的是,预先定义的含义为,在非基于会话系统中(例如在SDN网络系统中)的第一发送模块62进行数据查询之前,对上级系统进行批量查询和下级系统进行返回应答进行参数定义。在本实施例中,由于只涉及上级系统中的第一发送模块62,因此,只使用上级系统进行批量查询中所使用的参数(即第一查询参数)。
需要指出的是,查询过滤条件、分批数量、查询批次、排序条件这四个参数是必须设置在第一查询参数当中。而查询目标、查询范围则作为可选的两个参数,以供进行更精确的查询。
可选地,本实施例中进行查询的数据可以为全网的隧道Tunnel数据。在实际查询场景中,该Tunnel数据至少由几十万条。当然本发明中所提供的方法同样也是适用于几十万条以下的场景当中。
第一接收模块64,设置为接收所述下级系统依据所述批量查询请求发送的第一查询结果;
可选地,当所述第一接收模块64在预定时间内未收到所述下级系统发送的所述查询结果时,数据查询失败。
具体地,该预定时间并不是固定值,可以根据用户需要进行调整,需要指出的是,该预定时间可以通过第一查询参数进行确定,当然也可以根据用户的喜好来确定,
第二发送模块66,设置为向所述下级系统发送第二查询请求,该第二查询请求用于请求查询支持批量查询的数据中除所述第一查询结果之外的数据;
可选地,所述第二发送模块66还设置为调用缓存在所述上级系统中预先定义的第二查询参数,并将所述第二查询参数携带在所述第二查询请求中,其中,所述第二查询参数至少包括以下信息:查询过滤条件、所述第一查询结果中的数据标识信息、查询目标以及查询范围。
具体的,与第一查询参数类似的是,该第二查询参数同样也是在上级系统进行数据查询之前进行预先定义的,作用在于指示上级系统查询遗漏数据。
通过将第一查询结果中的数据标识信息携带在第二查询参数中,因此,可以协助下行系统知晓哪些的数据已经进行了查询,而哪些数据理论上进行了查询,但是实际上没有进行过查询的数据。
可选地,上述第二发送模块66向下级系统发送第二查询请求的过程可以是分批发送,即在接收到每一批下级系统发送的第一查询结果后,针对该批数据下发第二查询请求。上述分批发送第二查询请求的方法可以更加精确地查询遗漏数据,保证了低遗漏率。同时也可以是在第一接收模块64接收到所有批次的第一查询结果后,一次性下发第二查询请求。上述一次发送第二查询请求的方法可以在大量数据查询过程中节省时间。用户可以根据自身需要确认发送第二查询请求的方法。例如,如果查询的数据量不是特别大(例如几千或者几万,但不限于此),同时用户追求低遗漏率的话,那么可以采取分批发送第二查询请求,而如果查询的数据量很大(例 如几千万或者上亿,但不限于此),那么采用一次发送第二查询请求的方法。当然,在实际应用过程当中,还可以将多个批次的第二查询请求一同发送,这种方法在一定程度上保证了对遗漏数据查询的精确,同时还兼顾了查询时间。
第二接收模块68,设置为接收所述下级系统依据所述第二查询请求发送的第二查询结果。
可选地,当第二接收模块68在预定时间内未收到所述下级系统发送的所述第二查询结果时,确定没有遗漏数据需要处理。
可选地,当没有遗漏数据需要处理时,所述第二查询结果为空,当有遗漏数据需要处理时,所述第二查询结果为所述遗漏数据对应的标识信息。
图7是根据本发明实施例的另一种数据查询装置的结构图,如图7所示,该装置除包括图7所示的所有模块外,还包括:更新模块72。
更新模块72,设置为根据所述第一查询结果,更新与所述第一查询结果对应的数据,包括,根据所述第一查询结果中的标识信息,检测是否存在与所述标识信息重复的数据;在判断结果为是的情况下,替换或者抛弃与所述标识信息重复的数据。
需要指出而是,由于时间差的问题,多次查询期间可能存在数据更新,导致排序发生变化。这样各批次直接返回的数据,可能有部分重复。例如,可能第一查询结果中存在两个标识信息为xsdjfw34o-epiwer034873的数据。此时,上级系统可以将第二个标识信息为xsdjfw34o-epiwer034873的数据进行抛弃。当然上级系统也可以将该数据进行替换,替换为其他标识信息的数据。
需要说明的是,上述各个模块是可以通过软件或硬件来实现的,对于后者,可以通过以下方式实现,但不限于此:上述模块均位于同一处理器中;或者,上述各个模块以任意组合的形式分别位于不同的处理器中。
实施例4
在本实施例中还提供了一种数据查询处理装置,该装置用于实现上述 实施例及优选实施方式,已经进行过说明的不再赘述。如以下所使用的,术语“模块”可以实现预定功能的软件和/或硬件的组合。尽管以下实施例所描述的装置较佳地以软件来实现,但是硬件,或者软件和硬件的组合的实现也是可能并被构想的。
图8是根据本发明实施例的一种数据查询处理装置的结构图,如图8所示,该装置位于上级系统中,包括:第一接收模块82,第一发送模块84,第二接收模块86以及第二发送模块88。
第一接收模块82,设置为接收上级系统分批发送的第一查询请求,其中,所述第一查询请求用于请求查询支持批量查询的数据;
第一发送模块84,设置为依据所述第一查询请求确定第一查询结果,并将所述第一查询结果发送给所述上级系统;
图9是根据本发明实施例的另一种数据查询处理装置的结构图,如图9所示,该第一发送模块包括:抽取单元92以及第一生成单元94。
抽取单元92,设置为依据所述第一查询请求中的排列顺序以及分批要求,从所述支持批量查询的数据中抽取数据;
第一生成单元94,设置为调用缓存在所述下级系统中预先定义的第一应答参数,并依据所述抽取后的数据生成第一查询结果,其中,所述第一应答参数至少包括以下信息:所述抽取后的数据的标识信息、查询批次以及总批数。
需要指出的是,在非基于会话系统中(例如在SDN网络系统中)的上级系统进行数据查询之前,对上级系统进行批量查询和下级系统进行返回应答进行了参数定义。在本实施例中,由于只涉及下级系统一侧,因此,只使用下级系统进行返回应答的参数(即第一应答参数)。
需要指出的是,在非基于会话系统中还需要对进行查询数据的数据属性进行相应的定义。具体地,该数据属性至少包括:标识信息id,用户标签userlabel,方向direction,类型tunneltype,源网元标识sourceNEID,宿网元标识destNEID,QOS信息qos以及管理状态adminStatus。因此, 第一应答参数中还可以将抽取数据标识信息对应的其他数据属性发送给上级系统。具体可以以列表的形式发送。
第二接收模块86,设置为接收所述上级系统发送的第二查询请求,该第二查询请求用于请求查询支持批量查询的数据中除所述第一查询结果之外的数据;
第二发送模块88,设置为依据所述第二查询请求确定第二查询结果,并将所述第二查询结果发送给所述上级系统。
图10是根据本发明实施例的再一种数据查询处理装置的结构图,如图10所示,该第二发送模块88包括:排除单元1002以及第二生成单元1004。
排除单元1002,设置为依据所述第二查询请求中的所述第一查询结果中的数据标识信息,从所述支持批量查询的数据中排除出没有发送给所述上级系统的数据;
具体地,排除单元1002通过比较第二查询请求中的第一查询结果中的数据标识信息以及支持批量查询的数据的标识信息。如果存在在上一次查询处理中没有经过处理的数据标识时,排除单元1002则确定该数据为遗漏数据,即确定为没有发送给所述上级系统的数据。
第二生成单元1004,设置为调用缓存在所述下级系统中预先定义的第二应答参数,并依据没有发送给所述上级系统的数据生成第二查询结果,其中,所述第二应答参数至少包括:所述支持批量查询的数据中没有在所述第一查询结果中的出现的数据的标识信息。
与第一应答参数类似的是,该第二应答参数同样也是在上级系统进行数据查询之前进行预先定义的,作用在于指示下级系统确定遗漏数据。具体地,第二应答参数包括:所述支持批量查询的数据中没有在所述第一查询结果中的出现的数据的标识信息。
具体地,如果下级系统发现在第二查询请求中没有遗漏数据的话,那么下级系统则会向上级系统发送第三查询结果,该第三查询结果为空。因 此上级系统就会根据该第三查询结果确定接收的第一查询结果中没有遗漏任何数据。
需要说明的是,上述各个模块是可以通过软件或硬件来实现的,对于后者,可以通过以下方式实现,但不限于此:上述模块均位于同一处理器中;或者,上述各个模块以任意组合的形式分别位于不同的处理器中。
实施例5
在本实施例中还提供了一种数据查询系统。图11是根据本发明实施例的一种数据查询系统的结构图,如图11所示,该装置位于上级系统中,包括:上级系统1102以及下级系统1104。
上级系统1102,设置为向下级系统1104分批发送的第一查询请求,该所述第一查询请求用于请求查询支持批量查询的数据;向所述下级系统1104发送第二查询请求,该第二查询请求用于请求查询支持批量查询的数据中除所述第一查询结果之外的数据;
下级系统1104,设置为接收所述上级系统1102分批发送的所述第一查询请求;依据所述第一查询请求确定第一查询结果,并将所述第一查询结果发送给所述上级系统;接收所述上级系统1102发送的所述第二查询请求;依据所述第二查询请求确定第二查询结果,并将所述第二查询结果发送给所述上级系统1102。
图12是根据本发明实施例的一种控制器的结构图,如图12所示,该控制器1202为下级系统对应的控制器。通过北向接口接收上级系统发送的查询请求,经过批量查询模块,资源管理模块以及业务管理模块等模块进行处理后,将查询后的结果通过北向接口返回查询请求。此外,在查询过后,上级系统需要对网关进行管理更新时,经由北向接口以及南向接口,下级系统将管理更新的命令发送给各个网元。
实施例6
本发明的实施例还提供了一种存储介质。可选地,在本实施例中,上述存储介质可以被设置为存储用于执行以下步骤的程序代码:
S11,非基于会话系统下的上级系统向下级系统分批发送的第一查询请求,该所述第一查询请求用于请求查询支持批量查询的数据;
S12,所述上级系统接收所述下级系统依据所述批量查询请求发送的第一查询结果;
S13,所述上级系统向所述下级系统发送第二查询请求,该第二查询请求用于请求查询支持批量查询的数据中除所述第一查询结果之外的数据;
S14,所述上级系统接收所述下级系统依据所述第二查询请求发送的第二查询结果。
可选地,存储介质还设置为存储用于执行以下步骤的程序代码:
S21,根据所述第一查询结果,更新与所述第一查询结果对应的数据。
可选地,存储介质还设置为存储用于执行以下步骤的程序代码:
S31,根据所述第一查询结果中的标识信息,检测是否存在与所述标识信息重复的数据;
S32,在判断结果为是的情况下,替换或者抛弃与所述标识信息重复的数据。
可选地,在本实施例中,上述存储介质可以包括但不限于:U盘、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、移动硬盘、磁碟或者光盘等各种可以存储程序代码的介质。
实施例7
根据本发明的再一个实施例,还提供了一种存储介质。该存储介质设置为存储用于执行以下步骤的程序代码:
S11,非基于会话系统下的下级系统接收上级系统分批发送的第一查 询请求,其中,所述第一查询请求用于请求查询支持批量查询的数据;
S12,所述下级系统依据所述第一查询请求确定第一查询结果,并将所述第一查询结果发送给所述上级系统;
S13,所述下级系统接收所述上级系统发送的第二查询请求,该第二查询请求用于请求查询支持批量查询的数据中除所述第一查询结果之外的数据;
S14,所述下级系统依据所述第二查询请求确定第二查询结果,并将所述第二查询结果发送给所述上级系统。
可选地,存储介质还设置为存储用于执行以下步骤的程序代码:
S21,所述下级系统依据所述第二查询请求中的所述第一查询结果中的数据标识信息,从所述支持批量查询的数据中排除出没有发送给所述上级系统的数据;
S22,调用缓存在所述下级系统中预先定义的第二应答参数,并依据没有发送给所述上级系统的数据生成第二查询结果。
显然,本领域的技术人员应该明白,上述的本发明的各模块或各步骤可以用通用的计算装置来实现,它们可以集中在单个的计算装置上,或者分布在多个计算装置所组成的网络上,可选地,它们可以用计算装置可执行的程序代码来实现,从而,可以将它们存储在存储装置中由计算装置来执行,并且在某些情况下,可以以不同于此处的顺序执行所示出或描述的步骤,或者将它们分别制作成各个集成电路模块,或者将它们中的多个模块或步骤制作成单个集成电路模块来实现。这样,本发明不限制于任何特定的硬件和软件结合。
以上所述仅为本发明的优选实施例而已,并不用于限制本发明,对于本领域的技术人员来说,本发明可以有各种更改和变化。凡在本发明的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。
工业实用性
通过本发明实施例,由于上级系统利用下级系统针对上级系统分批发送的对支持批量查询的数据的查询请求的查询结果,同时还能通过下发携带有已经进行分批查询的数据的查询请求,以获取遗漏数据的查询结果。因此,可以解决相关技术中非基于会话的网络系统的数据查询过程中存在查询过程复杂,查询效率低下以及对网络系统造成严重负担等问题,从而达到了高效查询大量数据,且查询方式简单,没有遗漏的效果。

Claims (25)

  1. 一种数据查询方法,包括:
    非基于会话系统下的上级系统向下级系统分批发送第一查询请求,该所述第一查询请求用于请求查询支持批量查询的数据;
    所述上级系统接收所述下级系统依据所述批量查询请求发送的第一查询结果;
    所述上级系统向所述下级系统发送第二查询请求,该第二查询请求用于请求查询支持批量查询的数据中除所述第一查询结果之外的数据;
    所述上级系统接收所述下级系统依据所述第二查询请求发送的第二查询结果。
  2. 根据权利要求1所述的方法,其中,非基于会话的网络系统的上级系统向下级系统分批发送第一查询请求,包括:
    调用缓存在所述上级系统中预先定义的第一查询参数,并将所述查询参数携带在所述第一查询请求中;
    非基于会话的网络系统的上级系统向下级系统分批发送第一查询请求。
  3. 根据权利要求1所述的方法,其中,所述查询参数至少包括以下参数:查询过滤条件、分批数量、查询批次、查询目标、查询范围以及排序条件。
  4. 根据权利要求1所述的方法,其中,所述方法还包括:
    当所述上级系统在预定时间内未收到所述下级系统发送的所述查询结果时,数据查询失败。
  5. 根据权利要求1所述的方法,其中,在所述上级系统接收所述下级系统依据所述批量查询请求发送的第一查询结果之后,所述方 法还包括:
    根据所述第一查询结果,更新与所述第一查询结果对应的数据。
  6. 根据权利要求5所述的方法,其中,更新与所述第一查询结果对应的数据,包括:
    根据所述第一查询结果中的标识信息,检测是否存在与所述标识信息重复的数据;
    在判断结果为是的情况下,替换或者抛弃与所述标识信息重复的数据。
  7. 根据权利要求1所述的方法,其中,所述上级系统向所述下级系统发送第二查询请求,还包括:
    调用缓存在所述上级系统中预先定义的第二查询参数,并将所述第二查询参数携带在所述第二查询请求中,其中,所述第二查询参数至少包括以下信息:查询过滤条件、所述第一查询结果中的数据标识信息、查询目标以及查询范围;
    所述上级系统向所述下级系统发送第二查询请求。
  8. 根据权利要求1所述的方法,其中,所述方法还包括:
    当所述上级系统在预定时间内未收到所述下级系统发送的所述第二查询结果时,确定没有遗漏数据需要处理。
  9. 根据权利要求1所述的方法,其中,所述方法还包括,
    当没有遗漏数据需要处理时,所述第二查询结果为空,当有遗漏数据需要处理时,所述第二查询结果为所述遗漏数据对应的标识信息。
  10. 根据权利要求1至9任一项所述的方法,其中,所述上级系 统至少包括:上层控制器、APP或接入所述上层控制器的系统;和/或所述下级系统为用于进行查询处理的控制器。
  11. 一种数据查询处理方法,包括:
    非基于会话系统下的下级系统接收上级系统分批发送的第一查询请求,其中,所述第一查询请求用于请求查询支持批量查询的数据;
    所述下级系统依据所述第一查询请求确定第一查询结果,并将所述第一查询结果发送给所述上级系统;
    所述下级系统接收所述上级系统发送的第二查询请求,该第二查询请求用于请求查询支持批量查询的数据中除所述第一查询结果之外的数据;
    所述下级系统依据所述第二查询请求确定第二查询结果,并将所述第二查询结果发送给所述上级系统。
  12. 根据权利要求11所述的方法,其中,所述下级系统依据所述第一查询请求确定第一查询结果,包括:
    所述下级系统依据所述第一查询请求中的排列顺序以及分批要求,从所述支持批量查询的数据中抽取数据;
    调用缓存在所述下级系统中预先定义的第一应答参数,并依据抽取后的数据生成所述第一查询结果。
  13. 根据权利要求12所述的方法,其中,所述第一应答参数至少包括以下信息:所述抽取后的数据的标识信息、查询批次以及总批数。
  14. 根据权利要求11所述的方法,其中,所述下级系统依据所述第二查询请求确定第二查询结果,包括:
    所述下级系统依据所述第二查询请求中的所述第一查询结果中的数据标识信息,排除所述支持批量查询的数据中没有发送给所述上级系统的数据;
    调用缓存在所述下级系统中预先定义的第二应答参数,并依据没有发送给所述上级系统的数据生成所述第二查询结果。
  15. 根据权利要求14所述的方法,其中,所述第二应答参数至少包括:所述支持批量查询的数据中没有在所述第一查询结果中的出现的数据的标识信息。
  16. 根据权利要求14所述的方法,其中,在从所述支持批量查询的数据中排除出没有发送给所述上级系统的数据之后,所述方法还包括:
    当确定所有所述支持批量查询的数据发送给所述上级系统后,向所述上级系统发送第三查询结果,其中,所述第三查询结果为空信息。
  17. 一种数据查询装置,位于上级系统中,包括:
    第一发送模块,设置为在需要进行批量查询时,根据批量查询的接口命令生成批量查询请求,并下发给下级系统;
    第一接收模块,设置为接收所述下级系统依据所述批量查询请求发送的第一查询结果;
    第二发送模块,设置为向所述下级系统发送第二查询请求,该第二查询请求用于请求查询支持批量查询的数据中除所述第一查询结果之外的数据;
    第二接收模块,设置为接收所述下级系统依据所述第二查询请求发送的第二查询结果。
  18. 根据权利要求17所述的装置,其中,所述第一发送模块还设置为:调用缓存在所述上级系统中预先定义的第一查询参数,并将所述查询参数携带在所述第一查询请求中,其中,所述查询参数至少包括以下参数:查询过滤条件、分批数量、查询批次、查询目标、查询范围以及排序条件。
  19. 根据权利要求17所述的装置,其中,所述装置还包括:
    更新模块,设置为根据所述第一查询结果,更新与所述第一查询结果对应的数据,包括,根据所述第一查询结果中的标识信息,检测是否存在与所述标识信息重复的数据;在判断结果为是的情况下,替换或者抛弃与所述标识信息重复的数据。
  20. 根据权利要求17所述的装置,其中,所述第二发送模块还设置为调用缓存在所述上级系统中预先定义的第二查询参数,并将所述第二查询参数携带在所述第二查询请求中,其中,所述第二查询参数至少包括以下信息:查询过滤条件、所述第一查询结果中的数据标识信息、查询目标以及查询范围。
  21. 根据权利要求17所述的装置,其中,所述装置还包括:当没有遗漏数据需要处理时,所述第二查询结果为空,当有遗漏数据需要处理时,所述第二查询结果为所述遗漏数据对应的标识信息。
  22. 一种数据查询处理装置,位于下级系统,包括:
    第一接收模块,设置为接收上级系统分批发送的第一查询请求,其中,所述第一查询请求用于请求查询支持批量查询的数据;
    第一发送模块,设置为依据所述第一查询请求确定第一查询结果,并将所述第一查询结果发送给所述上级系统;
    第二接收模块,设置为接收所述上级系统发送的第二查询请求,该第二查询请求用于请求查询支持批量查询的数据中除所述第一查询结果之外的数据;
    第二发送模块,设置为依据所述第二查询请求确定第二查询结果,并将所述第二查询结果发送给所述上级系统。
  23. 根据权利要求22所述的装置,其中,所述第一发送模块包括:
    抽取单元,设置为依据所述第一查询请求中的排列顺序以及分批要求,从所述支持批量查询的数据中抽取数据;
    第一生成单元,设置为调用缓存在所述下级系统中预先定义的第一应答参数,并依据所述抽取后的数据生成所述第一查询结果,其中,所述第一应答参数至少包括以下信息:所述抽取后的数据的标识信息、查询批次以及总批数。
  24. 根据权利要求22所述的装置,其中,所述第二发送模块包括:
    排除单元,设置为依据所述第二查询请求中的所述第一查询结果中的数据标识信息,从所述支持批量查询的数据中排除出没有发送给所述上级系统的数据;
    第二生成单元,设置为调用缓存在所述下级系统中预先定义的第二应答参数,并依据没有发送给所述上级系统的数据生成所述第二查询结果,其中,所述第二应答参数至少包括:所述支持批量查询的数据中没有在所述第一查询结果中的出现的数据的标识信息。
  25. 一种数据查询系统,位于非基于会话系统中,包括,
    上级系统,设置为向下级系统分批发送的第一查询请求,该所述第一查询请求用于请求查询支持批量查询的数据;向所述下级系统发送第二查询请求,该第二查询请求用于请求查询支持批量查询的数据中除所述第一查询结果之外的数据;
    所述下级系统,设置为接收所述上级系统分批发送的所述第一查询请求;依据所述第一查询请求确定第一查询结果,并将所述第一查询结果发送给所述上级系统;接收所述上级系统发送的所述第二查询请求;依据所述第二查询请求确定第二查询结果,并将所述第二查询结果发送给所述上级系统。
PCT/CN2017/099517 2016-08-29 2017-08-29 数据查询、数据查询处理方法及装置 WO2018041101A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610754277.2A CN107784009A (zh) 2016-08-29 2016-08-29 数据查询、数据查询处理方法及装置
CN201610754277.2 2016-08-29

Publications (1)

Publication Number Publication Date
WO2018041101A1 true WO2018041101A1 (zh) 2018-03-08

Family

ID=61301266

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/099517 WO2018041101A1 (zh) 2016-08-29 2017-08-29 数据查询、数据查询处理方法及装置

Country Status (2)

Country Link
CN (1) CN107784009A (zh)
WO (1) WO2018041101A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111858681A (zh) * 2020-08-01 2020-10-30 生态环境部南京环境科学研究所 一种基于soa的大数据综合管理数据查询系统
CN115587233A (zh) * 2022-10-11 2023-01-10 华能信息技术有限公司 一种数据标识及目录管理方法及系统

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108629003B (zh) * 2018-05-03 2021-05-11 网易(杭州)网络有限公司 内容加载方法与装置
CN109241050B (zh) * 2018-07-10 2021-08-27 创新先进技术有限公司 一种数据查询方法、装置及系统、电子设备
CN114417081B (zh) * 2021-12-27 2024-05-24 深圳萨摩耶数字科技有限公司 一种处理方法、装置、系统及存储介质

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1755676A (zh) * 2004-09-30 2006-04-05 微软公司 用于网络文档批处理索引的系统和方法
CN102576369A (zh) * 2009-08-24 2012-07-11 阿玛得斯两合公司 对不可预测工作负荷展示可预测应答时间的连续全扫描数据存储表和分布式数据仓库
US20150186515A1 (en) * 2013-12-26 2015-07-02 Iac Search & Media, Inc. Batch crawl and fast crawl clusters for question and answer search engine

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1755676A (zh) * 2004-09-30 2006-04-05 微软公司 用于网络文档批处理索引的系统和方法
CN102576369A (zh) * 2009-08-24 2012-07-11 阿玛得斯两合公司 对不可预测工作负荷展示可预测应答时间的连续全扫描数据存储表和分布式数据仓库
US20150186515A1 (en) * 2013-12-26 2015-07-02 Iac Search & Media, Inc. Batch crawl and fast crawl clusters for question and answer search engine

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111858681A (zh) * 2020-08-01 2020-10-30 生态环境部南京环境科学研究所 一种基于soa的大数据综合管理数据查询系统
CN115587233A (zh) * 2022-10-11 2023-01-10 华能信息技术有限公司 一种数据标识及目录管理方法及系统

Also Published As

Publication number Publication date
CN107784009A (zh) 2018-03-09

Similar Documents

Publication Publication Date Title
WO2018041101A1 (zh) 数据查询、数据查询处理方法及装置
US11277306B2 (en) Sending information of a network repository function instance storing network function instance information
US10785140B2 (en) System and method for identifying components of a computer network based on component connections
EP3905598B1 (en) Message processing method and apparatus, control plane device, and computer storage medium
US10270648B2 (en) Configuration information management method, device, network element management system and storage medium
US10057109B2 (en) Defining interdependent virtualized network functions for service level orchestration
EP3353952B1 (en) Managing groups of servers
US9288162B2 (en) Adaptive infrastructure for distributed virtual switch
CN104365058B (zh) 用于在多核和集群系统中高速缓存snmp数据的系统和方法
CN107800565B (zh) 巡检方法、装置、系统、计算机设备和存储介质
EP3432517A1 (en) Device configuration method and apparatus based on network configuration protocol
US20180316594A1 (en) Dynamic update of virtual network topology
US10198338B2 (en) System and method of generating data center alarms for missing events
US9088477B2 (en) Distributed fabric management protocol
CN105765921A (zh) 用于利用软件定义网络(sdn)功能进行diameter路由的方法、系统和计算机可读介质
US20220394010A1 (en) Method, Apparatus, and System for Sending Control Request Based on Key Value Configuration
CN101035133B (zh) 网络管理的方法、系统及设备
WO2012155615A1 (zh) 一种rfid网管的实现方法、系统及相关装置
JP2016518641A (ja) 複数のコンバージドインフラストラクチャシステムへのアクセス
US9985840B2 (en) Container tracer
EP4038931A1 (en) Network entities for supporting analytics generation
CN106850803B (zh) 一种基于sdn的加权轮询系统及算法
WO2020010906A1 (zh) 操作系统os批量安装方法、装置和网络设备
WO2018036521A1 (zh) 资源调整方法、装置及系统
US10715608B2 (en) Automatic server cluster discovery

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17845403

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17845403

Country of ref document: EP

Kind code of ref document: A1