CN105205088A - Mass data processing server cluster software system - Google Patents
Mass data processing server cluster software system Download PDFInfo
- Publication number
- CN105205088A CN105205088A CN201410479146.9A CN201410479146A CN105205088A CN 105205088 A CN105205088 A CN 105205088A CN 201410479146 A CN201410479146 A CN 201410479146A CN 105205088 A CN105205088 A CN 105205088A
- Authority
- CN
- China
- Prior art keywords
- mass data
- software
- processing server
- data processing
- server cluster
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The invention discloses a mass data processing server cluster software system. The mass data processing server cluster software system is characterized by comprising one or more master control servers; integrated service end software is arranged in all the servers; when the number of the master control servers provided with the integrated service end software is larger than two, all the master control servers are connected with load balancing devices; the integrated service end software is used for monitoring data query requests which can accept standard data flow of database query and operation, the data flow is generally transmitted out of a JDBC or an ODBC interface, and the integrated service end software only needs to call JDBC or ODBC. The mass data processing server cluster software system supports the rapid query requests of mass data, supports mass data storage, is easy and convenient to configure and free of complex configuration process, can be compatible with existing system, and can be connected in a seamless mode and directly used without modifying codes of application systems.
Description
Technical field
The invention belongs to a kind of mass data processing server cluster software systems.
Background technology
There are similar products in the market, but that these products adopt at present is NoSQL framework (as: hadoop), this framework is not the relevant database of a standard at present, the SQL statement of standard is not supported yet, although integrated technology can be utilized to solve the problem of mass data request, but a lot of application software system is all the database of facing relation type at present, if turn to the application of NoSQL, needs a large amount of development amounts.
When mass data processing, the e-commerce field of such as internet, or the application such as the telephone expenses inquiry of telecom operators, when there is ten hundreds of inquiry request process, often adopt large scale computer to process related service.The cost of large scale computer is higher, and needs disposable input, and is unfavorable for the development of the persistent subscriber amount of certain enterprise.
Summary of the invention
The technical problem to be solved in the present invention overcomes above-mentioned defect, a kind of mass data processing server cluster software systems are provided, the problem only having large scale computer to solve before the cluster of common PC server can be utilized just can to solve, thus reduce cost and investment risk.
For solving the problem, the technical solution adopted in the present invention is:
A kind of mass data processing server cluster software systems, is characterized in that: comprise one or some main control servers, are provided with Integration Services end software in all servers; When the main control server number of described installation Integration Services end software is greater than two, all main control servers are connected with load-balancing device; Described Integration Services end software is used for monitored data inquiry request, data inquiry request can accept the normal data stream of data base querying and operation, this data stream general is sent by JDBC or ODBC interface, and Integration Services end software only needs to call JDBC or ODBC.
Present invention also offers a kind of workflow of mass data processing server cluster software systems, it is characterized in that: after Integration Services end software obtains inquiry request, request content is analyzed, and get in touch with the back end end of specifying, the principle of work of this part is provided with a Hash table at integrating server end, what this table was safeguarded is the corresponding relation of index and back end end, so just directly can find the server node at formulation content place, and return data.
Owing to have employed technique scheme, compared with prior art, the present invention supports the fast query request of mass data, support mass data storage, configure easy, without the need to very complicated layoutprocedure, can be compatible with existing system, without the need to revising the code of application system, seamless link directly uses.
The problem that the present invention only has large scale computer to solve before the cluster of common PC server can be utilized just can to solve, thus reduce cost and investment risk.
Embodiment
Embodiment:
A kind of mass data processing server cluster software systems, comprise one or some main control servers, are provided with Integration Services end software in all servers; When the main control server number of described installation Integration Services end software is greater than two, all main control servers are connected with load-balancing device; Described Integration Services end software is used for monitored data inquiry request, data inquiry request can accept the normal data stream of data base querying and operation, this data stream general is sent by JDBC or ODBC interface, and Integration Services end software only needs to call JDBC or ODBC.
Present invention also offers a kind of workflow of mass data processing server cluster software systems: after Integration Services end software obtains inquiry request, request content is analyzed, and get in touch with the back end end of specifying, the principle of work of this part is provided with a Hash table at integrating server end, what this table was safeguarded is the corresponding relation of index and back end end, so just directly can find the server node formulating content place, and return data.
The present invention can in large-scale website or the enterprising enforcement use of service provider, needs to utilize internet to carry out data storage and query, data magnanimity, inquiry magnanimity.Can also use in telecom operators, need to be supplied to user and carry out telephone expenses or bill inquiry, data magnanimity, inquiry magnanimity.In addition, existing government organs also can use, and need to be supplied to public service, data magnanimity, inquiry magnanimity.
The present invention supports the fast query request of mass data, supports mass data storage, configures easy, without the need to very complicated layoutprocedure, can be compatible with existing system, and without the need to revising the code of application system, seamless link directly uses.
The present invention is not limited to above-mentioned preferred implementation, and anyone should learn the structure change made under enlightenment of the present invention, and every have identical or akin technical scheme with the present invention, all belongs to protection scope of the present invention.
Claims (2)
1. mass data processing server cluster software systems, is characterized in that: comprise one or some main control servers, are provided with Integration Services end software in all servers; When the main control server number of described installation Integration Services end software is greater than two, all main control servers are connected with load-balancing device; Described Integration Services end software is used for monitored data inquiry request, data inquiry request can accept the normal data stream of data base querying and operation, this data stream general is sent by JDBC or ODBC interface, and Integration Services end software only needs to call JDBC or ODBC.
2. the workflow of mass data processing server cluster software systems according to claim 1, it is characterized in that: after Integration Services end software obtains inquiry request, request content is analyzed, and get in touch with the back end end of specifying, the principle of work of this part is provided with a Hash table at integrating server end, what this table was safeguarded is the corresponding relation of index and back end end, so just directly can find the server node at formulation content place, and return data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410479146.9A CN105205088A (en) | 2014-09-19 | 2014-09-19 | Mass data processing server cluster software system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410479146.9A CN105205088A (en) | 2014-09-19 | 2014-09-19 | Mass data processing server cluster software system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105205088A true CN105205088A (en) | 2015-12-30 |
Family
ID=54952774
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410479146.9A Pending CN105205088A (en) | 2014-09-19 | 2014-09-19 | Mass data processing server cluster software system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105205088A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070171921A1 (en) * | 2006-01-24 | 2007-07-26 | Citrix Systems, Inc. | Methods and systems for interacting, via a hypermedium page, with a virtual machine executing in a terminal services session |
| CN102053982A (en) * | 2009-11-02 | 2011-05-11 | 阿里巴巴集团控股有限公司 | Method and equipment for managing database information |
| CN103336815A (en) * | 2013-06-27 | 2013-10-02 | 北京京东尚科信息技术有限公司 | System and method of pushing network advertising |
| CN103473247A (en) * | 2012-06-30 | 2013-12-25 | 中国地质调查局西安地质调查中心 | Geological data information cluster mechanism and interface aggregation model |
| CN103747060A (en) * | 2013-12-26 | 2014-04-23 | 惠州华阳通用电子有限公司 | Distributed monitor system and method based on streaming media service cluster |
-
2014
- 2014-09-19 CN CN201410479146.9A patent/CN105205088A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070171921A1 (en) * | 2006-01-24 | 2007-07-26 | Citrix Systems, Inc. | Methods and systems for interacting, via a hypermedium page, with a virtual machine executing in a terminal services session |
| CN102053982A (en) * | 2009-11-02 | 2011-05-11 | 阿里巴巴集团控股有限公司 | Method and equipment for managing database information |
| CN103473247A (en) * | 2012-06-30 | 2013-12-25 | 中国地质调查局西安地质调查中心 | Geological data information cluster mechanism and interface aggregation model |
| CN103336815A (en) * | 2013-06-27 | 2013-10-02 | 北京京东尚科信息技术有限公司 | System and method of pushing network advertising |
| CN103747060A (en) * | 2013-12-26 | 2014-04-23 | 惠州华阳通用电子有限公司 | Distributed monitor system and method based on streaming media service cluster |
Non-Patent Citations (1)
| Title |
|---|
| 王培建: "云计算环境下大规模数据存储技术研究", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11354314B2 (en) | Method for connecting a relational data store's meta data with hadoop | |
| US20210011911A1 (en) | Multi-tenancy for structured query language (sql) and non structured query language (nosql) databases | |
| WO2020220638A1 (en) | Method and apparatus for associating link system with log system, and storage medium | |
| CN109639750B (en) | Service data processing method and device | |
| AU2018200021A1 (en) | Unified device and service discovery across multiple network types | |
| US9495437B1 (en) | System and method for accessing dimensional databases | |
| CN105224613A (en) | Based on integrating heterogeneous data source system and the integration method thereof of the federal technology of data | |
| WO2020147301A1 (en) | Method and apparatus for implementing multi-tenant service access, and electronic device | |
| CN105227367A (en) | A kind of warning analysis processing method of low delay | |
| US20140214902A1 (en) | Resolving in-memory foreign keys in transmitted data packets from single-parent hierarchies | |
| US10140347B2 (en) | Exposing data to query generating applications using usage profiles | |
| JP2017535842A (en) | Simplify calling the import procedure to transfer data from the data source to the data target | |
| CN102609464A (en) | Method and device for associative table query of MONGODB shards | |
| US10360207B2 (en) | Database trigger-based eventing for data changes based on a publish/subscribe mechanism | |
| CN107491463B (en) | Optimization method and system for data query | |
| CN104486357A (en) | Method for achieving role-based access control (RBAC) based on SSH website | |
| CN104601554A (en) | Data exchange method and device | |
| CN110737676A (en) | Data query method and device | |
| CN114185973A (en) | Parameter calling method, device, equipment and computer readable storage medium | |
| US10027754B2 (en) | Large data set updating for network usage records | |
| CN105205088A (en) | Mass data processing server cluster software system | |
| CN107729579B (en) | Database separation design method and device | |
| CN112491943A (en) | Data request method, device, storage medium and electronic equipment | |
| CN103873564A (en) | Method for realizing SignalR duplex communication under balanced load condition of multiple servers | |
| CN115617795A (en) | General query method and device for database table and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| DD01 | Delivery of document by public notice | ||
| DD01 | Delivery of document by public notice |
Addressee: Zhong Sheng Document name: the First Notification of an Office Action |
|
| DD01 | Delivery of document by public notice | ||
| DD01 | Delivery of document by public notice |
Addressee: Zhong Sheng Document name: Notification that Application Deemed to be Withdrawn |
|
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20151230 |