CN111625588A - Method and system for sharing distributed data acquisition data - Google Patents

Method and system for sharing distributed data acquisition data Download PDF

Info

Publication number
CN111625588A
CN111625588A CN202010479199.6A CN202010479199A CN111625588A CN 111625588 A CN111625588 A CN 111625588A CN 202010479199 A CN202010479199 A CN 202010479199A CN 111625588 A CN111625588 A CN 111625588A
Authority
CN
China
Prior art keywords
connection pool
distributed
service center
database
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010479199.6A
Other languages
Chinese (zh)
Inventor
韩冰冰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Si Tech Information Technology Co Ltd
Original Assignee
Beijing Si Tech Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Si Tech Information Technology Co Ltd filed Critical Beijing Si Tech Information Technology Co Ltd
Priority to CN202010479199.6A priority Critical patent/CN111625588A/en
Publication of CN111625588A publication Critical patent/CN111625588A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/54Interprogram communication
    • G06F9/547Remote procedure calls [RPC]; Web services

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a method and a system for sharing distributed data acquisition data, and relates to the field of IT support. The method comprises the following steps: the distributed connection pool service center collects target data in the target database through the connection pool service type and returns the target data to the service system, unified management of an external system and the service system is achieved through the distributed connection pool service center, maintenance cost is lowered, interface reuse rate is improved, monitoring of connection of a data source and an FTP interface is increased, data taking work is divided into the service center to be processed, dependency is lowered, and risks are reduced.

Description

Method and system for sharing distributed data acquisition data
Technical Field
The invention relates to the field of IT support, in particular to a method and a system for sharing distributed data acquisition data.
Background
With the development of the internet, more and more systems and more interactive interfaces are provided in the telecommunication industry, the system is an auditing system of the telecommunication industry and depends on data provided by an external system, and the current external data acquisition modes comprise database jdbc acquisition and FTP acquisition. However, as the number of external data sources increases and the number of interface files increases, many disadvantages gradually appear in the short connection mode of the current application system. And the network policy problem is complex, and more networks need to be passed. There is a lack of uniform access. Each new acquisition host needs to get through the network of all acquisition sources.
Disclosure of Invention
The invention aims to solve the technical problem of the prior art and provides a method and a system for sharing distributed data acquisition data.
The technical scheme for solving the technical problems is as follows:
a method of sharing distributed data acquisition data, comprising:
s1, the business system sends a preset task for collecting data to the distributed connection pool service center, wherein the preset task comprises database information of an external system corresponding to target data of the business system, a called connection pool service type and a calling mode, and the business system calls the data in a connection pool of the distributed connection pool service center through the calling mode;
s2, the distributed connection pool service center obtains the connection information of the target database according to the database information;
s3, the distributed connection pool service center collects the target data in the target database through the connection pool service type and returns the target data to the service system.
The invention has the beneficial effects that: according to the scheme, the preset task is sent to the distributed connection pool service center through the service system, the distributed connection pool service center obtains the connection information of the target database according to the database information, establishes connection with the target database, collects the target data in the target database through the connection pool service type and returns the target data to the service system, and the distributed connection pool service center manages the external system and the service system in a unified mode, so that the maintenance cost is reduced, the interface reuse rate is improved, the monitoring on the connection of the data source and the FTP interface is increased, the data fetching work is divided into the service center to be processed, the dependency is reduced, and the risk is reduced.
Further, before the S1, the method further includes: the distributed connection pool service center registers connection pool services, wherein the connection pool services include: a database connection pool service, an FTP connection pool service and an SFTP connection pool service;
and configuring a connection pool in the distributed connection pool service center, and establishing connection between the distributed connection pool service center and the database of the external system through the configuration of the connection pool.
The beneficial effect of adopting the further scheme is that: according to the scheme, the distributed connection pool service center registers connection pool service, the connection pool is configured in the distributed connection pool service center, the distributed connection pool service center is connected with a database of an external system through the configuration of the connection pool, a business system does not need to care about information such as addresses, users and passwords of the database, the distributed connection pool service center performs unified management and monitoring on threads of the database connection pool and the FTP connection pool, the business system obtains data of the external system through the service center, does not need to establish connection with the external system to obtain information, the workload of data fetching of each business system is reduced, other business systems can obtain data of the external system through the service center, the same codes of the database do not need to be written, the database does not need to be managed and maintained, and the operation and maintenance cost is reduced.
Further, the configuring the connection pool specifically includes: configuring a database connection pool by configuring a database type, a drive type, a URL, a user name, a password and a database name of an external system; the FTP/SFTP connection pool is configured by configuring IP, username, password, database name and port.
The beneficial effect of adopting the further scheme is that: according to the scheme, the distributed connection pool service center is provided with the database connection pool and the FTP/SFTP connection pool, the service system does not need to maintain related information of the FTP interface, and can acquire information of the corresponding database only by sending a task of acquiring data to the service center, so that the utilization rate of a data acquisition program of the service center is improved, and the repeated work of the service system for acquiring the same type of data is reduced.
Further, the sending, by the service system, the preset task for acquiring data to the distributed connection pool service center specifically includes: and the service system sends the preset task to the distributed connection pool service center in a Dubbo calling mode or a Rest calling mode.
The beneficial effect of adopting the further scheme is that: the service system sends the preset task to the distributed connection pool service center through a Dubbo calling mode or a Rest calling mode, and an external system accesses the corresponding connection pool through a Dubbo interface or a Rest interface.
Further, still include: when the tasks to be processed received by the distributed connection pool service center exceed the upper limit power of the distributed connection pool service center, the tasks of the subsequent service system for acquiring the target data need to be sequenced according to time, and the distributed connection pool service center processes the tasks to be processed in sequence.
The beneficial effect of adopting the further scheme is that: according to the scheme, by judging that the task to be processed exceeds the upper limit power of the task, the task of acquiring the target data by the subsequent service system needs to be sequenced according to time, and the service system is ensured to orderly call data from the connection pool within the load range of the service center.
Another technical solution of the present invention for solving the above technical problems is as follows:
a system for sharing distributed data acquisition data, comprising: a database of a service system, a distributed connection pool service center and an external system;
the service system is used for sending a preset task for acquiring data to the distributed connection pool service center, wherein the preset task comprises database information of an external system corresponding to target data of the service system, a called connection pool service type and a calling mode, and the service system calls the data in a connection pool of the distributed connection pool service center through the calling mode;
the distributed connection pool service center is used for acquiring the information of a target database according to the database information; and the system is also used for collecting the target data in the target database through the service type of the connection pool and returning the target data to the business system.
The invention has the beneficial effects that: according to the scheme, the preset task is sent to the distributed connection pool service center through the service system, the distributed connection pool service center obtains the connection information of the target database according to the database information, establishes connection with the target database, collects the target data in the target database through the connection pool service type and returns the target data to the service system, and the distributed connection pool service center manages the external system and the service system in a unified mode, so that the maintenance cost is reduced, the interface reuse rate is improved, the monitoring on the connection of the data source and the FTP interface is increased, the data fetching work is divided into the service center to be processed, the dependency is reduced, and the risk is reduced.
Further, still include: a registration module for the distributed connection pool service center to register a connection pool service, wherein the connection pool service comprises: a database connection pool service, an FTP connection pool service and an SFTP connection pool service;
and configuring a connection pool in the distributed connection pool service center, and establishing connection between the distributed connection pool service center and the database of the external system through the configuration of the connection pool.
The beneficial effect of adopting the further scheme is that: according to the scheme, the distributed connection pool service center registers connection pool service, the connection pool is configured in the distributed connection pool service center, the distributed connection pool service center is connected with a database of an external system through the configuration of the connection pool, a business system does not need to care about information such as addresses, users and passwords of the database, the distributed connection pool service center performs unified management and monitoring on threads of the database connection pool and the FTP connection pool, the business system obtains data of the external system through the service center, does not need to establish connection with the external system to obtain information, the workload of data fetching of each business system is reduced, other business systems can obtain data of the external system through the service center, the same codes of the database do not need to be written, the database does not need to be managed and maintained, and the operation and maintenance cost is reduced.
Further, the registration module is specifically configured to configure the database connection pool by configuring a database type, a drive type, a URL, a user name, a password, and a database name of the external system; the FTP/SFTP connection pool is configured by configuring IP, username, password, database name and port.
The beneficial effect of adopting the further scheme is that: according to the scheme, the distributed connection pool service center is provided with the database connection pool and the FTP/SFTP connection pool, the service system does not need to maintain related information of the FTP interface, and can acquire information of the corresponding database only by sending a task of acquiring data to the service center, so that the utilization rate of a data acquisition program of the service center is improved, and the repeated work of the service system for acquiring the same type of data is reduced.
Further, the specifically sending, by the service system, the preset task for acquiring data to the distributed connection pool service center specifically includes: and the service system sends the preset task to the distributed connection pool service center in a Dubbo calling mode or a Rest calling mode.
The beneficial effect of adopting the further scheme is that: the service system sends the preset task to the distributed connection pool service center through a Dubbo calling mode or a Rest calling mode, and an external system accesses the corresponding connection pool through a Dubbo interface or a Rest interface.
Further, still include: the sequencing module is used for sequencing the tasks of acquiring the target data of the subsequent service system according to time when the tasks to be processed received by the distributed connection pool service center exceed the upper limit power of the distributed connection pool service center;
the distributed connection pool service center is used for processing the tasks to be processed in sequence.
The beneficial effect of adopting the further scheme is that: according to the scheme, by judging that the task to be processed exceeds the upper limit power of the task, the task of acquiring the target data by the subsequent service system needs to be sequenced according to time, and the service system is ensured to orderly call data from the connection pool within the load range of the service center.
Advantages of additional aspects of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.
Drawings
Fig. 1 is a schematic flow chart of a method for sharing distributed data acquisition data according to an embodiment of the present invention;
fig. 2 is a structural framework diagram of a system for sharing distributed data acquisition data according to an embodiment of the present invention.
Detailed Description
The principles and features of this invention are described below in conjunction with the following drawings, which are set forth to illustrate, but are not to be construed to limit the scope of the invention.
As shown in fig. 1, provided for an embodiment of the present invention, a method for sharing distributed data acquisition data includes:
s1, the service system sends a preset task for collecting data to the distributed connection pool service center, wherein the preset task comprises database information of an external system corresponding to target data of the service system, a called connection pool service type and a calling mode, and the service system calls the data in the connection pool of the distributed connection pool service center through the calling mode;
it should be noted that the preset task represents the content that the data to be collected by the service system needs to include, which may include the relevant information of the target database, such as the database name, the ID name, and the keyword for collecting the data;
s2, the distributed connection pool service center obtains the connection information of the target database according to the database information; the connection information may include an address of the target database, a user name and a password.
And S3, the distributed connection pool service center collects the target data in the target database through the connection pool service type and returns the target data to the service system.
According to the scheme, the preset task is sent to the distributed connection pool service center through the service system, the distributed connection pool service center obtains the connection information of the target database according to the database information, connection with the target database is established, the target data are collected in the target database through the connection pool service type and are returned to the service system, unified management of an external system and the service system is achieved through the distributed connection pool service center, maintenance cost is reduced, interface reuse rate is improved, monitoring of connection between a data source and an FTP interface is increased, data fetching work is divided into the service center to be processed, dependency is reduced, and risks are reduced.
Preferably, in any of the above embodiments, before S1, the method further includes: the distributed connection pool service center registers connection pool services, wherein the connection pool services include: a database connection pool service, an FTP connection pool service and an SFTP connection pool service; where the selection of which connection pool service to take is determined by the type of data that needs to be retrieved.
And configuring a connection pool in the distributed connection pool service center, and establishing connection between the distributed connection pool service center and a database of an external system through the configuration of the connection pool.
It should be noted that, configuring the database connection pool is to establish a connection between the service center and an external system database, connect the external databases, configure the external databases in advance before calling, configure the external databases in order to establish a connection with the databases, and increase or decrease the external databases. The configuration content comprises the following steps: database type, driver selection, URL, user name, password and name;
the configuration of the FTP connection pool and the SFTP connection pool comprises the following steps: IP, username, password, name, port.
It should be noted that, by registering the database connection pool service, the FTP connection pool service, and the SFTP connection pool service in the service center, and issuing the service while registering, the external system can only see the service of the service center.
According to the scheme, the distributed connection pool service center registers connection pool service, a connection pool is configured in the distributed connection pool service center, the distributed connection pool service center is connected with a database of an external system through the configuration connection pool, a business system does not need to care about information such as addresses, users and passwords of the database, the distributed connection pool service center uniformly manages and monitors threads of the database connection pool and an FTP connection pool, the business system obtains data of the external system through the service center, does not need to establish connection with the external system to obtain information, the workload of data fetching of each business system is reduced, other business systems can obtain data of the external system through the service center, the same codes of the database do not need to be written, the database does not need to be managed and maintained, and the operation and maintenance cost is reduced.
Preferably, in any of the above embodiments, configuring the connection pool specifically includes: configuring a database connection pool by configuring a database type, a drive type, a URL, a user name, a password and a database name of an external system; the FTP/SFTP connection pool is configured by configuring IP, username, password, database name and port.
According to the scheme, the distributed connection pool service center is provided with the database connection pool and the FTP/SFTP connection pool, the service system does not need to maintain related information of the FTP interface, and can acquire information of the corresponding database only by sending a task of acquiring data to the service center, so that the utilization rate of a data acquisition program of the service center is improved, and the repeated work of the service system for acquiring the same type of data is reduced.
Preferably, in any of the above embodiments, the sending, by the service system, the preset task for acquiring data to the distributed connection pool service center specifically includes: and the service system sends a preset task to the distributed connection pool service center through a Dubbo calling mode or a Rest calling mode.
The service system sends a preset task to the distributed connection pool service center through a Dubbo calling mode or a Rest calling mode, and the external system accesses the corresponding connection pool through a Dubbo interface or a Rest interface.
Preferably, in any of the above embodiments, further comprising: when the tasks to be processed received by the distributed connection pool service center exceed the upper limit power of the distributed connection pool service center, the tasks of the subsequent service system for acquiring the target data need to be sequenced according to time, and the distributed connection pool service center processes the tasks to be processed in sequence.
According to the scheme, by judging that the task to be processed exceeds the upper limit power of the task, the task of acquiring the target data by the subsequent service system needs to be sequenced according to time, and the service system is ensured to orderly call data from the connection pool within the load range of the service center.
In one embodiment, as shown in fig. 2, a system for sharing distributed data acquisition data, the system comprising: a business system 11, a distributed connection pool service center 12 and a database 13 of an external system;
the service system 11 is configured to send a preset task for acquiring data to the distributed connection pool service center 12, where the preset task includes information of a database 13 of an external system corresponding to target data of the service system 11, a called connection pool service type, and a calling mode, where the service system 11 calls data in a connection pool of the distributed connection pool service center 12 in the calling mode;
the distributed connection pool service center 12 is used for obtaining the information of the target database according to the database information; and is further configured to collect target data in the target database through the connection pool service type, and return the target data to the service system 11.
According to the scheme, the preset task is sent to the distributed connection pool service center 12 through the service system 11, the distributed connection pool service center 12 obtains the connection information of the target database according to the database information, connection with the target database is established, the target data are collected in the target database through the connection pool service type and are returned to the service system 11, unified management of the external system and the service system 11 is achieved through the distributed connection pool service center 12, maintenance cost is reduced, interface reuse rate is improved, monitoring of connection between a data source and an FTP interface is increased, data taking work is divided into the service center to be processed, dependency is reduced, and risks are reduced.
Preferably, in any of the above embodiments, further comprising: a registration module, configured to register a connection pool service with the distributed connection pool service center 12, where the connection pool service includes: a database connection pool service, an FTP connection pool service and an SFTP connection pool service;
and configuring a connection pool in the distributed connection pool service center 12, and enabling the distributed connection pool service center 12 to establish connection with a database 13 of an external system through the configuration of the connection pool.
According to the scheme, a distributed connection pool service center 12 registers connection pool service, a connection pool is configured in the distributed connection pool service center 12, the distributed connection pool service center 12 is connected with a database 13 of an external system through the configuration of the connection pool, information such as addresses, users and passwords of the database is not needed to be concerned by a service system 11, the distributed connection pool service center 12 performs unified management and monitoring on threads of the database connection pool and an FTP connection pool, the service system 11 acquires data of the external system through the service center, connection acquisition information with the external system is not needed to be established, the workload of data acquisition of each service system 11 is reduced, other service systems 11 can acquire the data of the external system through the service center, the same codes of the database are not needed to be written, the database is not needed to be managed and maintained, and the operation and maintenance cost is reduced.
Preferably, in any of the above embodiments, the registration module is specifically configured to configure the database connection pool by configuring a database 13 type, a drive type, a URL, a user name, a password, and a database name of the external system; the FTP/SFTP connection pool is configured by configuring IP, username, password, database name and port.
According to the scheme, the distributed connection pool service center 12 is configured with the database connection pool and the FTP/SFTP connection pool, the service system 11 does not need to maintain the related information of the FTP interface, and can acquire the information of the corresponding database only by sending a task of acquiring data to the service center, so that the utilization rate of a data acquisition program of the service center is improved, and the repeated work of the service system 11 for acquiring the same type of data is reduced.
Preferably, in any embodiment described above, the specifically sending, by the service system 11, the preset task for collecting data to the distributed connection pool service center 12 specifically includes: the service system 11 sends a preset task to the distributed connection pool service center 12 through a Dubbo calling mode or a Rest calling mode.
The service system 11 sends a preset task to the distributed connection pool service center 12 through a Dubbo calling mode or a Rest calling mode, and the external system accesses the corresponding connection pool through a Dubbo or Rest interface.
Preferably, in any of the above embodiments, further comprising: the sequencing module is used for sequencing the tasks of the subsequent service system 11 for acquiring the target data according to time when the tasks to be processed received by the distributed connection pool service center 12 exceed the upper limit power of the distributed connection pool service center;
the distributed connection pool service center 12 is used to process the tasks to be processed in sequence.
According to the scheme, by judging that the task to be processed exceeds the upper limit power of the task, the subsequent tasks of the business system 11 for acquiring the target data need to be sequenced according to time, and the business system 11 is ensured to orderly call data from the connection pool within the load range of the service center.
It is understood that some or all of the alternative embodiments described above may be included in some embodiments.
It should be noted that the above embodiments are product embodiments corresponding to the previous method embodiments, and for the description of each optional implementation in the product embodiments, reference may be made to corresponding descriptions in the above method embodiments, and details are not described here again.
The reader should understand that in the description of this specification, reference to the description of the terms "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described method embodiments are merely illustrative, and for example, the division of steps into only one logical functional division may be implemented in practice in another way, for example, multiple steps may be combined or integrated into another step, or some features may be omitted, or not implemented.
The above method, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention essentially or partially contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-only memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
While the invention has been described with reference to specific embodiments, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims (10)

1. A method of sharing distributed data acquisition data, comprising:
s1, the business system sends a preset task for collecting data to the distributed connection pool service center, wherein the preset task comprises database information of an external system corresponding to target data of the business system, a called connection pool service type and a calling mode, and the business system calls the data in a connection pool of the distributed connection pool service center through the calling mode;
s2, the distributed connection pool service center obtains the connection information of the target database according to the database information;
s3, the distributed connection pool service center collects the target data in the target database through the connection pool service type and returns the target data to the service system.
2. The method of claim 1, further comprising, before the step S1: the distributed connection pool service center registers connection pool services, wherein the connection pool services include: a database connection pool service, an FTP connection pool service and an SFTP connection pool service;
and configuring a connection pool in the distributed connection pool service center, and establishing connection between the distributed connection pool service center and the database of the external system through the configuration of the connection pool.
3. The method for sharing distributed data acquisition data according to claim 2, wherein the configuring the connection pool specifically includes: configuring a database connection pool by configuring a database type, a drive type, a URL, a user name, a password and a database name of an external system; the FTP/SFTP connection pool is configured by configuring IP, username, password, database name and port.
4. A method of sharing distributed data acquisition data according to any one of claims 1-3,
the step of sending a preset task for acquiring data to the distributed connection pool service center by the service system specifically includes: and the service system sends the preset task to the distributed connection pool service center in a Dubbo calling mode or a Rest calling mode.
5. The method of claim 4, further comprising: when the tasks to be processed received by the distributed connection pool service center exceed the upper limit power of the distributed connection pool service center, the tasks of the subsequent service system for acquiring the target data need to be sequenced according to time, and the distributed connection pool service center processes the tasks to be processed in sequence.
6. A system for sharing distributed data acquisition data, comprising: a database of a service system, a distributed connection pool service center and an external system;
the service system is used for sending a preset task for acquiring data to the distributed connection pool service center, wherein the preset task comprises database information of an external system corresponding to target data of the service system, a called connection pool service type and a calling mode, and the service system calls the data in a connection pool of the distributed connection pool service center through the calling mode;
the distributed connection pool service center is used for acquiring the information of a target database according to the database information; and the system is also used for collecting the target data in the target database through the service type of the connection pool and returning the target data to the business system.
7. The system for sharing distributed data collection data of claim 6, further comprising: a registration module for the distributed connection pool service center to register a connection pool service, wherein the connection pool service comprises: a database connection pool service, an FTP connection pool service and an SFTP connection pool service;
and configuring a connection pool in the distributed connection pool service center, and establishing connection between the distributed connection pool service center and the database of the external system through the configuration of the connection pool.
8. The system for sharing distributed data collection data of claim 7, wherein the registration module is specifically configured to configure the database connection pool by configuring a database type, a driver type, a URL, a user name, a password, and a database name of an external system; the FTP/SFTP connection pool is configured by configuring IP, username, password, database name and port.
9. A system for sharing distributed data collection data according to any one of claims 6-8,
the service system is specifically configured to send a preset task for acquiring data to the distributed connection pool service center, and includes: and the service system sends the preset task to the distributed connection pool service center in a Dubbo calling mode or a Rest calling mode.
10. The system for sharing distributed data acquisition data as recited in claim 9, further comprising: the sequencing module is used for sequencing the tasks of acquiring the target data of the subsequent service system according to time when the tasks to be processed received by the distributed connection pool service center exceed the upper limit power of the distributed connection pool service center;
the distributed connection pool service center is used for processing the tasks to be processed in sequence.
CN202010479199.6A 2020-05-29 2020-05-29 Method and system for sharing distributed data acquisition data Pending CN111625588A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010479199.6A CN111625588A (en) 2020-05-29 2020-05-29 Method and system for sharing distributed data acquisition data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010479199.6A CN111625588A (en) 2020-05-29 2020-05-29 Method and system for sharing distributed data acquisition data

Publications (1)

Publication Number Publication Date
CN111625588A true CN111625588A (en) 2020-09-04

Family

ID=72272377

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010479199.6A Pending CN111625588A (en) 2020-05-29 2020-05-29 Method and system for sharing distributed data acquisition data

Country Status (1)

Country Link
CN (1) CN111625588A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113220458A (en) * 2021-05-26 2021-08-06 西安热工研究院有限公司 Real-time scheduling method and device for realizing load balance of database connection pool

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6138143A (en) * 1999-01-28 2000-10-24 Genrad, Inc. Method and apparatus for asynchronous transaction processing
CN102385582A (en) * 2010-08-31 2012-03-21 中兴通讯股份有限公司 Method, server and system for processing production test data
CN103365929A (en) * 2012-04-10 2013-10-23 阿里巴巴集团控股有限公司 Management method and management system of database connection
US20140101100A1 (en) * 2012-10-05 2014-04-10 Oracle International Corporation Providing services across systems that manage distributed replicas
CN109189856A (en) * 2018-08-15 2019-01-11 中国联合网络通信集团有限公司 Distributed data base service management, device, server and storage medium
CN109471896A (en) * 2018-11-01 2019-03-15 数贸科技(北京)有限公司 Data source information dynamic altering method and device
CN109922158A (en) * 2019-03-22 2019-06-21 泰康保险集团股份有限公司 Data processing method, device, medium and electronic equipment based on micro services
CN110933097A (en) * 2019-12-05 2020-03-27 美味不用等(上海)信息科技股份有限公司 Multi-service gateway oriented current limiting and automatic capacity expanding and shrinking method

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6138143A (en) * 1999-01-28 2000-10-24 Genrad, Inc. Method and apparatus for asynchronous transaction processing
CN102385582A (en) * 2010-08-31 2012-03-21 中兴通讯股份有限公司 Method, server and system for processing production test data
CN103365929A (en) * 2012-04-10 2013-10-23 阿里巴巴集团控股有限公司 Management method and management system of database connection
US20140101100A1 (en) * 2012-10-05 2014-04-10 Oracle International Corporation Providing services across systems that manage distributed replicas
CN109189856A (en) * 2018-08-15 2019-01-11 中国联合网络通信集团有限公司 Distributed data base service management, device, server and storage medium
CN109471896A (en) * 2018-11-01 2019-03-15 数贸科技(北京)有限公司 Data source information dynamic altering method and device
CN109922158A (en) * 2019-03-22 2019-06-21 泰康保险集团股份有限公司 Data processing method, device, medium and electronic equipment based on micro services
CN110933097A (en) * 2019-12-05 2020-03-27 美味不用等(上海)信息科技股份有限公司 Multi-service gateway oriented current limiting and automatic capacity expanding and shrinking method

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113220458A (en) * 2021-05-26 2021-08-06 西安热工研究院有限公司 Real-time scheduling method and device for realizing load balance of database connection pool
CN113220458B (en) * 2021-05-26 2022-11-01 西安热工研究院有限公司 Real-time scheduling method and device for realizing load balance of database connection pool

Similar Documents

Publication Publication Date Title
US8140591B2 (en) Enabling workflow awareness within a business process management (BPM) system
US11579936B2 (en) System and method for cloud workload provisioning
US20080177564A1 (en) Method and apparatus of supporting business performance management with active shared data spaces
CN1836212A (en) Automatic and dynamic provisioning of databases
US20110166952A1 (en) Facilitating dynamic construction of clouds
WO2019041738A1 (en) Client resource obtaining method and apparatus, terminal device, and storage medium
CN109614227B (en) Task resource allocation method and device, electronic equipment and computer readable medium
EP1880286A1 (en) Data processing network
US20100082388A1 (en) Method and system for managing information technology (it) infrastructural elements
CN112732466A (en) Service calling method, device and system
CN110706148B (en) Face image processing method, device, equipment and storage medium
CN111767139A (en) Cross-region multi-data-center resource cloud service modeling method and system
CN108696559B (en) Stream processing method and device
CN111625588A (en) Method and system for sharing distributed data acquisition data
CN114598586A (en) Multi-cloud scene computing power gridding method and system
CN110188258B (en) Method and device for acquiring external data by using crawler
CN105791295B (en) A kind of application server based on Node.js
CN111376255B (en) Robot data acquisition method and device and terminal equipment
US20150220557A1 (en) Data distribution system, method and program product
CN115421920A (en) Task management method and device for financial product, electronic equipment and storage medium
CN110247802B (en) Resource configuration method and device for cloud service single-machine environment
CN110049065B (en) Attack defense method, device, medium and computing equipment of security gateway
CN112783920A (en) Industrial Internet of things data real-time computing method and system based on data arrangement
CN112148712A (en) Data processing method, device, equipment and medium
CN111885177A (en) Biological information analysis cloud computing method and system based on cloud computing technology

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination