WO2019000301A1 - 网络信息采集方法及系统 - Google Patents

网络信息采集方法及系统 Download PDF

Info

Publication number
WO2019000301A1
WO2019000301A1 PCT/CN2017/090714 CN2017090714W WO2019000301A1 WO 2019000301 A1 WO2019000301 A1 WO 2019000301A1 CN 2017090714 W CN2017090714 W CN 2017090714W WO 2019000301 A1 WO2019000301 A1 WO 2019000301A1
Authority
WO
WIPO (PCT)
Prior art keywords
task
collection
collection point
network information
scheduling
Prior art date
Application number
PCT/CN2017/090714
Other languages
English (en)
French (fr)
Inventor
马岩
Original Assignee
麦格创科技(深圳)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 麦格创科技(深圳)有限公司 filed Critical 麦格创科技(深圳)有限公司
Priority to PCT/CN2017/090714 priority Critical patent/WO2019000301A1/zh
Publication of WO2019000301A1 publication Critical patent/WO2019000301A1/zh

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40Support for services or applications

Definitions

  • the present invention relates to the field of software and computers, and in particular, to a network information collection method and system.
  • the application provides a network information collection method. It solves the shortcomings of the prior art technical solutions that cannot meet the needs of customers.
  • a method for collecting network information includes:
  • the dispatch server allocates the task to a plurality of collection points
  • the collection point assigned to the task downloads the rules of the task, and collects network information according to the rules of the task.
  • the method further includes:
  • the collection point sends the collection log and the error log to the management database.
  • the method further includes:
  • the collection point uploads the collection result to the information database, and the control terminal views the collection result in real time.
  • the method further includes:
  • the control terminal analyzes and processes the collected results according to all the collection points, and then performs statistical statistics to obtain statistical results.
  • the control terminal realizes the distribution of the collection points according to the statistical results.
  • a second aspect provides a network information collection system, where the system includes: a collection point, a scheduling service, a management terminal, a task management terminal, a running statistics terminal, a management database, and an information database;
  • the task management end is configured to receive the collected task, and add the task to the local scheduling server;
  • the scheduling server is configured to perform scheduling of tasks, and the management database is configured to save rules of the task;
  • the scheduling server is further configured to allocate the task to multiple collection points
  • the collection point is used to download the rule of the task, and the network information is collected according to the rule of the task.
  • the collection point is further used for collecting logs and sending error logs to the management database.
  • the collection point is further used to upload the collection result to an information database
  • the control terminal is configured to view the collection result in real time.
  • control terminal is configured to perform analysis and processing according to the collection result of all the collection points, and then perform statistics on the data to obtain a statistical result, and implement the allocation of the collection point according to the statistical result.
  • a computer readable storage medium storing a computer program for electronic data exchange, wherein the computer program causes a computer to perform the method provided by the first aspect.
  • a computer program product comprising a non-transitory computer readable storage medium storing a computer program, the computer program being operative to cause a computer to perform the method provided by the first aspect.
  • the technical solution provided by the invention has the advantages of high efficiency by realizing the dynamic allocation of the collection points, thereby realizing the technical solutions of individual collection and collective collection.
  • FIG. 1 is a schematic structural diagram of an acquisition system according to a first preferred embodiment of the present invention
  • FIG. 2 is a schematic flowchart diagram of a network information collection method according to a second preferred embodiment of the present invention.
  • FIG. 3 is a hardware structural diagram of a computer device according to a second preferred embodiment of the present invention.
  • FIG. 1 is a schematic structural diagram of an acquisition system.
  • the collection system includes: a collection point, a scheduling service, a management terminal, a task management terminal, a running statistics terminal, a management database, and an information database.
  • the collection point is the main performer of the collection work. It can be deployed on any networked host, and the total number of supported collections can be controlled by expanding the site or reducing the site.
  • the scheduling service is used to balance the workload of each collection point, thereby supporting the enterprise.
  • the task management side can be used as an auxiliary tool for editing tasks to run independently at any location, so that multiple people can simultaneously add collection tasks, and the management terminal can view the operation of each site in real time.
  • the acquisition can be suspended, and the running statistics can collect and analyze each site and each task, list the abnormal collection points or collection sources, and assist the maintenance work.
  • FIG. 2 is a network information collection method according to an embodiment of the present disclosure.
  • the method is implemented by a computer device or a cloud server.
  • the method is as shown in FIG. 2, and includes the following steps:
  • Step S201 Receive the collected task, add the task to the local scheduling server, perform scheduling of the task, and save the rule of the task.
  • the method for receiving the collected tasks in the foregoing step S201 may be performed in various manners.
  • the collected task may be sent to the task management terminal by using one terminal device.
  • the task management terminal can directly control the release of the task.
  • Step S202 The scheduling server allocates the task to a plurality of collection points.
  • the scheduling server extracts the load and processing capability of each collection point, and the extraction processing is performed in the scheduling server of the foregoing step S202.
  • the first group collection point capable of meeting the processing requirements of the task is dynamically allocated according to the load condition of the first group collection point.
  • the first group collection point has three collection points, collection point A, collection point B, and collection point C, wherein the load corresponding to the collection point A, the collection point B, and the collection point C 50%, 60%, 70%, each subtask takes 15% of the load, and the processing task takes 10ms. If there are 5 subtasks, assign 2 subtasks to the collection point A. Assign 2 subtasks and assign 1 subtask to collection point C. In this way, the task can allocate subtasks according to the load and processing time, thereby improving the efficiency of collection and the efficiency of task processing.
  • Step S203 The collection point assigned to the task downloads the rule of the task, and performs network information collection according to the rule of the task.
  • the technical solution provided by the invention has the advantages of high efficiency by realizing the dynamic allocation of the collection points, thereby realizing the technical solutions of individual collection and collective collection.
  • the rules of the above tasks may be multiple.
  • the specific rules of the task may be set by the user who issues the task.
  • the foregoing method may further include:
  • the collection point sends the collection log and the error log to the management database.
  • the above collection log may include information collected by the collection point, for example, the URL address of the collected webpage, the time of collection, the size occupied by the webpage, and the like.
  • the above error log may include a log of the collection point collection error, and the error log may include: error time, error cause, and the like.
  • the foregoing method may further include:
  • the collection point uploads the collection result to the information database, and the control terminal views the collection result in real time.
  • the foregoing method may further include:
  • the control terminal analyzes and processes the collected results according to all the collection points, and then performs statistical statistics to obtain statistical results.
  • the control terminal realizes the distribution of the collection points according to the statistical results.
  • FIG. 3 provides a network information collection system, where the system includes: a collection point 301, a scheduling service 302, a management terminal 303, a task management terminal 304, a running statistics terminal 305, a management database 306, and an information database 307.
  • the task management terminal 304 is configured to receive the collected task, and add the task to the local scheduling server.
  • a scheduling server 302 configured to perform scheduling of tasks, where the management database is configured to save rules of the task;
  • the scheduling server 302 is further configured to allocate the task to multiple collection points;
  • the collecting point 301 is configured to download a rule of the task, and collect network information according to the rule of the task.
  • the collection point 301 is also used to collect logs and send error logs to the management database.
  • the collection point 301 is further configured to upload the collection result to the information database;
  • the control terminal 303 is configured to view the collection result in real time.
  • control terminal 303 is configured to perform analysis and processing according to the collection result of all the collection points, and then perform statistical statistics to obtain statistical results, and implement allocation of the collection points according to the statistical result.
  • Collection point responsible for the specific operation of the collection task, can be deployed on any networked host, and control the total number of collections that can be supported by expanding the site or reducing the site;
  • Scheduling service responsible for scheduling allocation of tasks, running separately, configuring the scheduling service IP of each station;
  • Control terminal Real-time management of the status of each collection task, which can be run separately or combined with the scheduling service;
  • Task management terminal Edit and maintain each collection task, which can be run separately or combined with the client/control terminal;
  • Run the statistics terminal perform statistical analysis on the collection results of each site and each task, and consult the collection log;
  • Management database store task rule data, collection logs, error logs, parameter settings;
  • Information database stores the collected data (while supporting local publishing).
  • Operation process When the task management terminal adds a task, it will notify the scheduling service to perform task assignment, and save the rule to the management database.
  • the collection point (any site, expandable) downloads the rule when receiving the task, and runs according to the setting, and is in the task.
  • the status is changed, feedback is sent to the control terminal, and the collection log and the error log are synchronously uploaded to the management database, and the collection result is uploaded to the information database;
  • the control terminal can view the collection status of each task in real time, and can send an operation instruction to the client for execution.
  • the running statistics terminal can view the collected statistics and abnormal conditions of each site or each collection task.
  • a computer readable storage medium storing a computer program for electronic data exchange, wherein the computer program causes a computer to perform the method as provided in FIG.
  • a computer program product comprising a non-transitory computer readable storage medium storing a computer program operative to cause a computer to perform the method as provided in FIG.
  • the program may be stored in a computer readable storage medium, and the storage medium may include: Flash drive, read-only memory (English: Read-Only Memory, referred to as: ROM), random accessor (English: Random Access Memory, referred to as: RAM), disk or CD.
  • ROM Read-Only Memory
  • RAM Random Access Memory

Abstract

本发明公开了一种网络信息采集方法,所述方法包括:接收采集的任务,将该任务添加至本地调度服务器进行任务的调度,保存该任务的规则;调度服务器将该任务分配给多个采集点;分配到任务的采集点下载该任务的规则,依据该任务的规则进行网络信息采集。本发明提供的技术方案具有效率高的优点。

Description

网络信息采集方法及系统 技术领域
本发明涉及软件及计算机领域,尤其涉及一种网络信息采集方法及系统。
背景技术
当前网络流行的采集器,分为单机采集和云采集。对于单机采集便于维护管理,适用于个人用户,但单机支持的采集上限较小,不容易扩展,不适用于大批量的采集。云服务器采集解决了个人用户的电脑需要长时间待机的问题,但无法管控采集运行过程,不便于维护,且支持的采集量较小,不适用于大批量的采集。所以现有的采集方式无法适应客户的需求。
技术问题
本申请提供一种网络信息采集方法。其解决现有技术的技术方案无法适应客户需求的缺点。
技术解决方案
一方面,提供一种网络信息采集方法,所述方法包括:
接收采集的任务,将该任务添加至本地调度服务器进行任务的调度,保存该任务的规则;
调度服务器将该任务分配给多个采集点;
分配到任务的采集点下载该任务的规则,依据该任务的规则进行网络信息采集。
可选的,所述方法还包括:
采集点将采集日志以及错误日志发送至管理数据库。
可选的,所述方法还包括:
采集点将该采集结果上传至信息数据库,管控端实时的查看该采集结果。
可选的,所述方法还包括:
管控端依据所有采集点的采集结果进行分析处理,然后进行数据统计得到统计结果,管控端依据该统计结果实现对采集点的分配。
第二方面,提供一种网络信息采集系统,所述系统包括:采集点、调度服务、管控端、任务管理端、运行统计端、管理数据库、信息数据库;
所述任务管理端,用于接收采集的任务,将该任务添加至本地调度服务器;
所述调度服务器,用于进行任务的调度,所述管理数据库,用于保存该任务的规则;
所述调度服务器,还用于将该任务分配给多个采集点;
所述采集点,用于下载该任务的规则,依据该任务的规则进行网络信息采集。
可选的,所述采集点,还用于采集日志以及错误日志发送至管理数据库。
可选的,所述采集点,还用于将该采集结果上传至信息数据库;
所述管控端,用于实时的查看该采集结果。
可选的,所述管控端,用于依据所有采集点的采集结果进行分析处理,然后进行数据统计得到统计结果,依据该统计结果实现对采集点的分配。
第三方面,提供一种计算机可读存储介质,其存储用于电子数据交换的计算机程序,其中,所述计算机程序使得计算机执行第一方面提供的方法。
第四方面,提供一种计算机程序产品,所述计算机程序产品包括存储了计算机程序的非瞬时性计算机可读存储介质,所述计算机程序可操作来使计算机执行第一方面提供的方法。
有益效果
本发明提供的技术方案通过对采集点的动态分配,从而能够实现单独采集以及集合采集的技术方案,所以其具有效率高的优点。
附图说明
为了更清楚地说明本发明实施例的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。
图1为本发明第一较佳实施方式提供的一种采集系统的结构示意图;
图2为本发明第二较佳实施方式提供的一种网络信息采集方法的流程示意图。
图3为本发明第二较佳实施方式提供的一种计算机设备的硬件结构图。
本发明的实施方式
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。
参阅图1,图1为一种采集系统的结构示意图,如图1所示,该采集系统包括:采集点、调度服务、管控端、任务管理端、运行统计端、管理数据库、信息数据库。其中采集点作为采集工作的主要执行者,可部署在任意联网主机,通过扩展站点或缩减站点来控制可支持的采集量总数,同时搭配调度服务来自由平衡各采集点的任务量,从而支持企业大批量采集或个人用户的单点采集;在大批量采集时,任务管理端作为编辑任务的辅助工具可以任意地点单独运行,便于多人同时添加采集任务,及管控端可以实时查看各站点的运行情况,对于有问题的或无用任务可以暂停采集,而运行统计端可以对各站点、各任务进行采集分析,罗列出异常采集点或采集源,辅助维护工作。
参阅图2,图2为本申请实施例提供的一种网络信息采集方法,该方法由计算机设备或云端服务器完成,该方法如图2所示,包括如下步骤:
步骤S201、接收采集的任务,将该任务添加至本地调度服务器进行任务的调度,保存该任务的规则。
上述步骤S201中的接收采集的任务的方式可以有多种,例如在本发明实施例的一种可选方案中,上述采集的任务可以通过一个终端设备发送至任务管理端。当然在实际应用中也可以由用户直接操控该任务管理端实现任务的发布。
步骤S202、调度服务器将该任务分配给多个采集点。
上述步骤S202的调度服务器该任务分配给多个采集点的实现方式可以有多种,例如,在本发明一个可选的实施例中,调度服务器提取每个采集点的负载以及处理能力,提取处理能够达到本次任务处理要求的第一群组采集点,依据第一群组采集点的负载情况动态对该任务进行分配。此技术方案能够充分考虑到采集点的处理能力以及负载的情况,避免调度服务器将该任务分配给采集点时,采集点无法实现采集的情况出现。另外,由于考虑到负载的情况,此技术方案也能够依据负载情况进行动态的分配。
这里以一个实际的例子来说,例如第一群组采集点具有三个采集点,采集点A、采集点B、采集点C,其中,采集点A、采集点B、采集点C对应的负载分别为50%、60%、70%,每个子任务所占用的负载为15%,处理任务所需时间为10ms,如果有5个子任务,则对采集点A分配2个子任务,对采集点B分配2个子任务,对采集点C分配1个子任务。这样该任务就能够依据该负载以及处理时间分配子任务,从而提高采集的效率和任务处理的效率。
步骤S203、分配到任务的采集点下载该任务的规则,依据该任务的规则进行网络信息采集。
本发明提供的技术方案通过对采集点的动态分配,从而能够实现单独采集以及集合采集的技术方案,所以其具有效率高的优点。
上述任务的规则可以为多种,具体的该任务的规则可以根据发布任务的用户自行设定。
可选的,上述方法在步骤S203之后还可以包括:
采集点将采集日志以及错误日志发送至管理数据库。
上述采集日志可以包含采集点采集的信息,例如,采集的网页的URL地址,采集的时间,网页所占的大小等等信息。
上述错误日志可以包含采集点采集出错的日志,错误日志可以包括:错误的时间、错误原因等等错误相关信息。
可选的,上述方法在步骤S203之后还可以包括:
采集点将该采集结果上传至信息数据库,管控端实时的查看该采集结果。
可选的,上述方法在步骤S203之后还可以包括:
管控端依据所有采集点的采集结果进行分析处理,然后进行数据统计得到统计结果,管控端依据该统计结果实现对采集点的分配。
参阅图3,图3提供一种网络信息采集系统,所述系统包括:采集点301、调度服务302、管控端303、任务管理端304、运行统计端305、管理数据库306、信息数据库307;
任务管理端304,用于接收采集的任务,将该任务添加至本地调度服务器;
调度服务器302,用于进行任务的调度,所述管理数据库,用于保存该任务的规则;
调度服务器302,还用于将该任务分配给多个采集点;
采集点301,用于下载该任务的规则,依据该任务的规则进行网络信息采集。
可选的,采集点301,还用于采集日志以及错误日志发送至管理数据库。
可选的,采集点301,还用于将该采集结果上传至信息数据库;
管控端303,用于实时的查看该采集结果。
可选的,管控端303,用于依据所有采集点的采集结果进行分析处理,然后进行数据统计得到统计结果,依据该统计结果实现对采集点的分配。
采集点:负责采集任务的具体运行,可部署在任意联网主机,通过扩展站点或缩减站点来控制可支持的采集量总数;
调度服务:负责任务的调度分配,单独运行,配置各站点的所属调度服务IP;
管控端:对各个采集任务的状态进行实时管理,可单独运行,也可以和调度服务合并;
任务管理端:对各个采集任务进行编辑维护,可单独运行或与客户端/管控端结合使用;
运行统计端:对各站点、各任务的采集结果进行统计分析,及查阅采集日志;
管理数据库:存放任务规则数据、采集日志、错误日志、参数设置;
信息数据库:存放采集到的数据(同时支持本地发布)。
运行流程:采集任务管理端添加任务时,会通知调度服务进行任务分配,同时保存规则至管理数据库;采集点(任意站点,可扩展)接收到任务时下载规则,并按照设置运行,并在任务状态变更时反馈给管控端,采集日志及错误日志同步上传至管理数据库,采集结果上传至信息数据库;管控端可实时查看各个任务的采集状态,可以发送操作指令给客户端执行。然后运行统计端可以对应查看个站点或各个采集任务的采集统计数据及异常情况。
第三方面,提供一种计算机可读存储介质,其存储用于电子数据交换的计算机程序,其中,所述计算机程序使得计算机执行如图2提供的方法。
第四方面,提供一种计算机程序产品,所述计算机程序产品包括存储了计算机程序的非瞬时性计算机可读存储介质,所述计算机程序可操作来使计算机执行如图2提供的方法。
需要说明的是,对于前述的各个方法实施例,为了简单描述,故将其都表述为一系列的动作组合,但是本领域技术人员应该知悉,本发明并不受所描述的动作顺序的限制,因为依据本发明,某一些步骤可以采用其他顺序或者同时进行。其次,本领域技术人员也应该知悉,说明书中所描述的实施例均属于优选实施例,所涉及的动作和模块并不一定是本发明所必须的。
在上述实施例中,对各个实施例的描述都各有侧重,某个实施例中没有详细描述的部分,可以参见其他实施例的相关描述。
本领域普通技术人员可以理解上述实施例的各种方法中的全部或部分步骤是可以通过程序来指令相关的硬件来完成,该程序可以存储于一计算机可读存储介质中,存储介质可以包括:闪存盘、只读存储器(英文:Read-Only Memory ,简称:ROM)、随机存取器(英文:Random Access Memory,简称:RAM)、磁盘或光盘等。
以上实施例的说明只是用于帮助理解本发明的方法及其核心思想;同时,对于本领域的一般技术人员,依据本发明的思想,在具体实施方式及应用范围上均会有改变之处,综上所述,本说明书内容不应理解为对本发明的限制。

Claims (10)

  1. 一种网络信息采集方法,其特征在于,所述方法包括:
    接收采集的任务,将该任务添加至本地调度服务器进行任务的调度,保存该任务的规则;
    调度服务器将该任务分配给多个采集点;
    分配到任务的采集点下载该任务的规则,依据该任务的规则进行网络信息采集。
  2. 根据权利要求1所述的方法,其特征在于,所述方法还包括:
    采集点将采集日志以及错误日志发送至管理数据库。
  3. 根据权利要求1所述的方法,其特征在于,所述方法还包括:
    采集点将该采集结果上传至信息数据库,管控端实时的查看该采集结果。
  4. 根据权利要求1所述的方法,其特征在于,所述方法还包括:
    管控端依据所有采集点的采集结果进行分析处理,然后进行数据统计得到统计结果,管控端依据该统计结果实现对采集点的分配。
  5. 一种网络信息采集系统,其特征在于,所述系统包括:采集点、调度服务、管控端、任务管理端、运行统计端、管理数据库、信息数据库;
    所述任务管理端,用于接收采集的任务,将该任务添加至本地调度服务器;
    所述调度服务器,用于进行任务的调度,所述管理数据库,用于保存该任务的规则;
    所述调度服务器,还用于将该任务分配给多个采集点;
    所述采集点,用于下载该任务的规则,依据该任务的规则进行网络信息采集。
  6. 根据权利要求5所述的系统,其特征在于,
    所述采集点,还用于采集日志以及错误日志发送至管理数据库。
  7. 根据权利要求5所述的系统,其特征在于,
    所述采集点,还用于将该采集结果上传至信息数据库;
    所述管控端,用于实时的查看该采集结果。
  8. 根据权利要求5所述的系统,其特征在于,
    所述管控端,用于依据所有采集点的采集结果进行分析处理,然后进行数据统计得到统计结果,依据该统计结果实现对采集点的分配。
  9. 一种计算机可读存储介质,其特征在于,其存储用于电子数据交换的计算机程序,其中,所述计算机程序使得计算机执行如权利要求1-4任一项所述的方法。
  10. 一种计算机程序产品,其特征在于,所述计算机程序产品包括存储了计算机程序的非瞬时性计算机可读存储介质,所述计算机程序可操作来使计算机执行如权利要求1-4任一项所述的方法。
PCT/CN2017/090714 2017-06-29 2017-06-29 网络信息采集方法及系统 WO2019000301A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/090714 WO2019000301A1 (zh) 2017-06-29 2017-06-29 网络信息采集方法及系统

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/090714 WO2019000301A1 (zh) 2017-06-29 2017-06-29 网络信息采集方法及系统

Publications (1)

Publication Number Publication Date
WO2019000301A1 true WO2019000301A1 (zh) 2019-01-03

Family

ID=64740282

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/090714 WO2019000301A1 (zh) 2017-06-29 2017-06-29 网络信息采集方法及系统

Country Status (1)

Country Link
WO (1) WO2019000301A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114244740A (zh) * 2021-12-22 2022-03-25 唯品会(广州)软件有限公司 一种网络数据采集方法及系统

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002082727A1 (en) * 2001-04-06 2002-10-17 Nfratech Inc. Method for collecting a network performance information, computer readable medium storing the same, and an analysis system and method for network performance
CN103188101A (zh) * 2011-12-31 2013-07-03 成都勤智数码科技股份有限公司 一种分布式采集调度方法及装置
CN106357426A (zh) * 2016-08-26 2017-01-25 东北大学 一种基于工业云的大规模分布式智能数据采集系统及方法

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002082727A1 (en) * 2001-04-06 2002-10-17 Nfratech Inc. Method for collecting a network performance information, computer readable medium storing the same, and an analysis system and method for network performance
CN103188101A (zh) * 2011-12-31 2013-07-03 成都勤智数码科技股份有限公司 一种分布式采集调度方法及装置
CN106357426A (zh) * 2016-08-26 2017-01-25 东北大学 一种基于工业云的大规模分布式智能数据采集系统及方法

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114244740A (zh) * 2021-12-22 2022-03-25 唯品会(广州)软件有限公司 一种网络数据采集方法及系统
CN114244740B (zh) * 2021-12-22 2024-02-27 唯品会(广州)软件有限公司 一种网络数据采集方法及系统

Similar Documents

Publication Publication Date Title
WO2019061615A1 (zh) 基于云监控的负载均衡优化方法及装置
WO2020192649A1 (zh) 一种数据中心管理系统
WO2013104217A1 (zh) 基于云基础设施的针对应用系统维护部署的管理系统和方法
CN105553741A (zh) 一种基于云计算的应用系统自动化部署方法
CN105653435A (zh) 一种网络文件系统nfs的性能测试方法和装置
CN103297543A (zh) 一种基于计算机集群作业调度的方法
WO2014114097A1 (zh) 一种负载分担方法及装置
CN102932455B (zh) 基于云计算渲染农场的构建方法
CN104468223B (zh) 一种数据中心计算、存储、网络设备自动管理分配方法
CN105071994B (zh) 一种海量数据监控系统
WO2020138605A1 (ko) 사용자 특성을 반영한 클러스터 기반 가상 네트워크 기능의 자원 할당 방법
TW201409357A (zh) 虛擬機資源負載平衡系統及方法
CN107634849A (zh) 一种全局区块链环境构建方法
WO2019223178A1 (zh) 跨平台任务调度方法、系统、计算机设备和存储介质
WO2019000301A1 (zh) 网络信息采集方法及系统
CN104601378A (zh) 结合应用性能指标监控数据的虚拟资源弹性调度实现方法
WO2021258861A1 (zh) 一种作业处理方法以及相关设备
CN114363164A (zh) 云网络服务编排控制方法、系统、存储介质和电子设备
WO2019061384A1 (zh) 分布式爬虫系统中任务管理器的选举方法及系统
WO2017023256A1 (en) Cloud provisioning for networks
Li et al. Study of load balancing technology for EAST data management
WO2017206590A1 (zh) 一种分布式架构下地址资源分配方法、装置和主控板
CN108667932A (zh) 一种在负载运行状态下双机大数据应用附件管理装置及方法
WO2019061385A1 (zh) 分布式爬虫任务分配方法及系统
Kumar et al. Advanced energy efficient scheduling of servers in cloud

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17915282

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17915282

Country of ref document: EP

Kind code of ref document: A1