CN101383839A - Data distribution system based on data server and implementation method - Google Patents
Data distribution system based on data server and implementation method Download PDFInfo
- Publication number
- CN101383839A CN101383839A CNA2007101470678A CN200710147067A CN101383839A CN 101383839 A CN101383839 A CN 101383839A CN A2007101470678 A CNA2007101470678 A CN A2007101470678A CN 200710147067 A CN200710147067 A CN 200710147067A CN 101383839 A CN101383839 A CN 101383839A
- Authority
- CN
- China
- Prior art keywords
- data
- client
- server
- data server
- request
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Information Transfer Between Computers (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a data distribution system which comprises, a data source used for storing application data of all client terminals which are accessed, at least one data server used for responding data requests of the client terminals and reading the data to transfer the data to corresponding client terminals, and a plurality of client terminals used for sending the data requests to the data server and receiving the data. The invention also discloses a data distribution method which comprises the steps: the data server is connected to the data source to read the data and carry out pretreatment; the client terminals send the data requests to the data server; the data server responds the requests and causes the data to return to the client terminals; and the client terminals receive the data, and renew a local database. By adopting the data distribution system and the realization method thereof, connection resources of a center database or the data source are greatly saved, the data distribution efficiency is efficiently enhanced, the amount of the client terminals which are accessed is no longer influenced by the resources of the database, and linear expansion can be carried out.
Description
Technical field
The present invention relates to the application technology of database, relate in particular to the distribution technology of large-scale data.
Background technology
Along with popularizing and the development of network application technology of the Internet, the function of application system is more and more stronger, and its scale also becomes increasing simultaneously.Usually, for a large-scale application system, hundreds of client-servers are formed the application system network of a concentrating type.For the response speed of accelerating concrete application function with provide concurrent performance, these data generally all to be stored in the central database that a plurality of clients share.Each client can be by carrying out real-time communication with central database, from central database, to read some structural data, for example, black list user's list of file names data of system, keyword of forbidding or the like.
Yet, adopt above-mentioned application system between a plurality of clients and central database, to carry out when mutual, the extensibility of system is relatively poor.Because each client all needs directly to be connected with central database, and read the data that need, when the number of client reached some, the disposal ability of central database will weaken greatly.In addition, when the storage data in the central database were changed, a plurality of clients of this system are introversive this central database request data after changing at one time.Because each client all will read identical data after changing to central database, so very easily cause the obstruction of central database, in the time of seriously even can cause system crash.And, in this application system, also need supporting synchronous communication device, with the timely notice of processing center database after carrying out data change.
Summary of the invention
At the existing above-mentioned defective the time of the central database in the application system, the invention provides a kind of data distribution systems and its implementation based on data server to a plurality of client distributing data.
According to one aspect of the present invention, provide a kind of data distribution systems.This system comprises: data source is used for storing the application data of all clients that this data distribution systems inserts; At least one data server, be used for the request of data of customer in response end and from the data source reading of data to be sent to corresponding client; And a plurality of clients, be used for sending request of data and receiving data from this data server to data server.
Preferably, each client comprises a data service communication unit, and it is used for sending request to read required data and receive the data after changing that this data server transmits when data source changes data to data server.Further, after this data communication service unit receives data, upgrade the local data base in the client.It is pointed out that when data, services communication unit and data server carry out data interaction that its client is only related with the generation of data, services communication unit, and irrelevant with the particular location of data source.
Preferably, data server carries out certain preliminary treatment to it after receiving the data of data source, comprises that mainly data structure to data, Data Format Transform, data association etc. handle.
Preferably, when data source change data, data server receives data after changing, and it is distributed to a plurality of clients synchronously.
Preferably, when certain client when data server sends request with reading of data, data server responds this request and only at the client transmission data that propose the transmission request.
Preferably, when certain client when data server sends request with the change data, data server responds this request and data is after changing reloaded to data source.
According to another aspect of the present invention, provide a kind of method of utilizing above-mentioned data distribution systems to carry out the data distribution.This method comprises:
(1) log-on data server and be connected to data source carries out preliminary treatment by the data server reading of data and to it;
(2) client sends request with reading of data to data server;
(3) data server response transmission request and return data are to client; And
(4) client receives data and upgrades local data base.
Adopt data distribution systems of the present invention and its implementation, saved the connection resource of central database or data source greatly, and data server can carry out certain preliminary treatment to the initial data from database or data source, has improved data distribution efficient effectively.In addition, the client terminal quantity that is inserted no longer is subjected to the influence of database resource and can carries out linear expansion.
Description of drawings
The reader will become apparent various aspects of the present invention after the reference accompanying drawing has been read the specific embodiment of the present invention.Wherein,
Fig. 1 illustrates in the prior art structural representation based on the data distribution systems of concentrated;
Fig. 2 illustrates the structural representation based on the data distribution systems of data server according to one or more aspects of the present invention;
Fig. 3 illustrates the program circuit schematic diagram of realization data distribution systems as shown in Figure 2; And
Fig. 4 illustrates the schematic flow sheet of data distribution systems when central database carries out data change as shown in Figure 2.
Embodiment
With reference to the accompanying drawings, the specific embodiment of the present invention is described in further detail.
Fig. 1 illustrates in the prior art structural representation based on the data distribution systems of concentrated.With reference to Fig. 1, this data distribution systems comprises a central database 110, a synchronous communication device 120 and an a plurality of client 131-135.Below described respectively.
Central database 110 is used to store the related data information of these a plurality of client 131-135, and with a plurality of client 131-135 in each carry out real-time data interaction.Synchronous communication device 120 is used for the announcement information behind the data change of processing center database 110, for example, if certain client (for example client 131) is revised the data in this central database 110, synchronous communication device 120 will be notified all client 131-135 this data change information.Client 131-135 is used for reading the data of central database 110, and is buffered in the local data base of client.
As can be seen from Figure 1, because each client 131-135 needs directly to be connected with central database 110, and read the data that need, when the number of client reached some, the disposal ability of central database 110 will weaken greatly.In addition, when the storage data in the central database 110 were changed, a plurality of client 131-135 of this system can introversive at one time these central database 110 requests data after changing.Because each client all will read identical data after changing to central database 110, so very easily cause the obstruction of central database 110, in the time of seriously even can cause system crash.
Fig. 2 illustrates the structural representation based on the data distribution systems of data server according to one or more aspects of the present invention.As shown in Figure 2, this data distribution systems comprises central database 210, data server 220 and a plurality of client 231-233, and each client also disposes the data, services communication unit 231a-233a that carries out communication with this data server 220.Wherein, central database 210 is used to store the related data information of these a plurality of clients.
(1) utilize configuration file from central database 210 reading of data and handle;
(2) response is from the request of data of client 231-233, and only this client of filing a request sent data;
(3) respond the user who is in client and change the request of data, so that reload data;
(4) after the data change of central database 210 is finished, the client of notifying all connections is obtained after changing data by data server 220.
The data, services that the data, services communication unit 231a-233a of client 231-233 by separately provides is obtained application data and is cached in the local data base (not shown).It is pointed out that each client is only related with data, services communication unit generation separately, and irrelevant with the particular location of data source.More specifically, the data, services communication unit can be regarded the communication module that is placed on as the client of data server 220 in each client as, in other words, data server 220 utilizes data, services communication unit and each client to carry out data interaction, for example, the data, services communication unit sends request to read required data to data server 220, perhaps when central database 210 change data, reception is by the data after changing of data server 220 distributions, perhaps after the change data that receive from data server 220 distributions, upgrade the local data base in the client that is associated.
It will be understood by those of skill in the art that system shown in Figure 2 only is an illustrative nature, in fact, can comprise the data server of greater number according to the data distribution systems of one aspect of the present invention or many aspects.For example, when the flow pressure of the data server 220 that is connected to central database 210 is smaller, can only dispose the request of data that a data server just can satisfy a plurality of clients.Yet when the flow pressure of the data server 220 that is connected to central database 210 is bigger, a data server may be not enough to satisfy the data, services of client, therefore can adopt the data server more than two or two.
Fig. 3 shows the program circuit schematic diagram of realization data distribution systems as shown in Figure 2.With reference to Fig. 2 and Fig. 3, can adopt following step to realize the distribution of data according to the data distribution procedure based on data server of one or more aspects of the present invention:
(1) step 300.Log-on data server 220;
(2) step 302.Data server 210 is connected to central database 220, and reading of data is also carried out preliminary treatment;
(3) step 304.Data server 210 scanning is also caught request of data from client, and specifically, data server 210 is opened its listening ports, is responded when capturing from the one or more request of data among the client 231-233;
(4) step 306.One or more data, services communication unit 231a-233a that pass through separately among the client 231-233 are connected with data server 220, wherein, the major function of data, services communication unit comprises to data server 220 request change data, receives data after changing from data server 220 distributions, handles the unexpected situation about connecting etc. that disconnects;
(5) step 308.One or more the transmission to data server 220 among the data, services communication unit 231a-233a asked with reading of data;
(6) step 310.Data server 220 responds above-mentioned request, and returns desired data to the client that sends request;
(7) step 312.If the data of central database 210 have change, data server 220 reads after changing data according to configuration file from central database 210, and should upgrade data sync and be distributed to client;
(8) step 314.The data, services communication unit receives this more new data, and upgrades local data base.
Owing between central database and each client, introduced data server, therefore greatly reducing client is connected to the resource consumption that central database produces, meanwhile, because client need not to set up communication with central database one by one again and is connected when requests data reading, obviously alleviated the pressure of central database and greatly promoted its disposal ability.
In addition, as described in above-mentioned step 302, data server is connected to central database, reading of data is also carried out preliminary treatment.Provide pretreatment operation for data by data server 220, a plurality of clients also need not oneself be taken time again and be handled the data that received.This pretreatment operation comprises the processing for data structure, Data Format Transform, data association etc.Moreover, data are carried out preliminary treatment also can improve the friendly degree that data server and client are carried out data interaction, in the preliminary treatment sensitive data, strengthened the Information Security of system.
It is pointed out that the data, services communication unit can be considered the communication module of each client, bear the each task that all and data server carry out data interaction, arrange like this to make this data distribution systems modularization more, also be easy to the expansion of client.
Fig. 4 illustrates the schematic flow sheet of data distribution systems when central database carries out data change as shown in Figure 2.Data changing method can comprise following step:
(1) step 400.Central database change 210 is data more;
(2) step 402.After central database 210 change data are finished, this Notification of Changes is sent to data server 220;
(3) step 404.Data server 220 receives this notice, and reads after changing application data from central database 210;
(4) step 406.220 pairs of data after changing of data server are carried out preliminary treatment;
(5) step 408.Data server 220 will be sent to data, services communication unit 231a-233a through pretreated change data;
(6) step 410.Client 231-233 receives this data after changing by data, services communication unit separately, and the data in the local data base are upgraded.
Above, describe the specific embodiment of the present invention with reference to the accompanying drawings.But those skilled in the art can understand, and under situation without departing from the spirit and scope of the present invention, can also do various changes and replacement to the specific embodiment of the present invention.These changes and replace all drop in claims of the present invention institute restricted portion.
Claims (10)
1. data distribution systems is characterized in that it comprises:
Data source is used for storing the application data of all clients that described data distribution systems inserts;
At least one data server is used to respond the request of data of described client, is sent to client from described data source reading of data and with described data; And
A plurality of clients are used for sending request of data and receiving data from described data server to described data server.
2. the system as claimed in claim 1, it is characterized in that, described client comprises a data service communication unit, described data, services communication unit is used for sending request reading required data to data server, and receives the data after changing that described data server transmits when described data source change data.
3. system as claimed in claim 2 is characterized in that, after described data, services communication unit receives data, upgrades the local data base in the client.
4. system as claimed in claim 2 is characterized in that, when described data, services communication unit and described data server carried out data interaction, described client was only related with the generation of data, services communication unit, and irrelevant with the particular location of described data source.
5. the system as claimed in claim 1 is characterized in that, described data server carries out preliminary treatment to it after receiving the data of described data source, and described preliminary treatment comprises that data structure, Data Format Transform, the data association to described data handle.
6. the system as claimed in claim 1 is characterized in that, when described data source changed data, described data server received data after changing, and described data sync after changing is distributed to described a plurality of client.
7. the system as claimed in claim 1 is characterized in that, when described client sent request with reading of data to described data server, described data server responded this request, and only transmits data at the described client that proposes the transmission request.
8. the system as claimed in claim 1 is characterized in that, when described client sent request with the change data to described data server, described data server responded this request, and data are after changing reloaded to described data source.
9. the system as claimed in claim 1 is characterized in that, described data server has listening port, is used for catching in real time and responding the request of data of described client.
10. the method that any described data distribution systems carries out the data distribution among utilization such as the claim 1-9 is characterized in that this method comprises:
Described data server is connected to described data source, and reading of data is also carried out preliminary treatment to it;
Described client sends request with reading of data to described data server;
Described data server responds described transmission request and return data to described client; And
Described client receives data and upgrades local data base.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA2007101470678A CN101383839A (en) | 2007-09-04 | 2007-09-04 | Data distribution system based on data server and implementation method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA2007101470678A CN101383839A (en) | 2007-09-04 | 2007-09-04 | Data distribution system based on data server and implementation method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101383839A true CN101383839A (en) | 2009-03-11 |
Family
ID=40463460
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2007101470678A Pending CN101383839A (en) | 2007-09-04 | 2007-09-04 | Data distribution system based on data server and implementation method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101383839A (en) |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102790701A (en) * | 2011-05-19 | 2012-11-21 | 阿里巴巴集团控股有限公司 | Method and system for acquiring field data |
| CN103023988A (en) * | 2012-11-27 | 2013-04-03 | 北京金山云科技有限公司 | File synchronization method, file synchronization server, file synchronization client side and terminal device |
| CN103023859A (en) * | 2011-09-22 | 2013-04-03 | 中兴通讯股份有限公司 | Content processing method and system of distributed service network (DSN) |
| CN103685421A (en) * | 2012-09-21 | 2014-03-26 | 百度在线网络技术（北京）有限公司 | Cross-data-source data submission system, device and method |
| CN103957192A (en) * | 2014-04-04 | 2014-07-30 | 驻马店市金格尔电气设备有限公司 | System for processing any GPS data based on distributed system structure |
| CN104572754A (en) * | 2013-10-24 | 2015-04-29 | 北大方正集团有限公司 | Database system and database system access method and device |
| CN105337923A (en) * | 2014-05-26 | 2016-02-17 | 腾讯科技（北京）有限公司 | Data distribution method and system, data transmitting apparatus and data receiving apparatus |
| CN105450733A (en) * | 2015-11-09 | 2016-03-30 | 北京锐安科技有限公司 | Business data distribution processing method and system |
| CN105847112A (en) * | 2016-03-11 | 2016-08-10 | 努比亚技术有限公司 | Data updating method, client and system |
| CN106888245A (en) * | 2016-06-07 | 2017-06-23 | 阿里巴巴集团控股有限公司 | A kind of data processing method, apparatus and system |
| CN107580025A (en) * | 2017-08-07 | 2018-01-12 | 国电南瑞科技股份有限公司 | A kind of more control centres of power network in a few days generation schedule Security Checking data sharing method |
| CN108509510A (en) * | 2018-03-08 | 2018-09-07 | 阿里巴巴集团控股有限公司 | Update method, server-side and the client of interface data |
| WO2018165964A1 (en) * | 2017-03-17 | 2018-09-20 | 深圳市秀趣品牌文化传播有限公司 | Cluster architecture-based e-commerce data migration system and method |
| WO2018165966A1 (en) * | 2017-03-17 | 2018-09-20 | 深圳市秀趣品牌文化传播有限公司 | Discrete e-commerce data migration processing system and method |
| CN109542905A (en) * | 2018-11-19 | 2019-03-29 | 同方知网(北京)技术有限公司 | A kind of Science Popularization Resources dissemination system and method by all kinds of means |
| CN112261043A (en) * | 2020-10-21 | 2021-01-22 | 深圳市思迅软件股份有限公司 | POS system data interaction method and device, computer equipment and storage medium |
-
2007
- 2007-09-04 CN CNA2007101470678A patent/CN101383839A/en active Pending
Cited By (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102790701B (en) * | 2011-05-19 | 2015-07-08 | 阿里巴巴集团控股有限公司 | Method and system for acquiring field data |
| CN102790701A (en) * | 2011-05-19 | 2012-11-21 | 阿里巴巴集团控股有限公司 | Method and system for acquiring field data |
| CN103023859B (en) * | 2011-09-22 | 2018-06-19 | 中兴通讯股份有限公司 | The content processing method and system of a kind of distributed business network |
| CN103023859A (en) * | 2011-09-22 | 2013-04-03 | 中兴通讯股份有限公司 | Content processing method and system of distributed service network (DSN) |
| CN103685421A (en) * | 2012-09-21 | 2014-03-26 | 百度在线网络技术（北京）有限公司 | Cross-data-source data submission system, device and method |
| CN103023988A (en) * | 2012-11-27 | 2013-04-03 | 北京金山云科技有限公司 | File synchronization method, file synchronization server, file synchronization client side and terminal device |
| CN104572754A (en) * | 2013-10-24 | 2015-04-29 | 北大方正集团有限公司 | Database system and database system access method and device |
| CN104572754B (en) * | 2013-10-24 | 2018-06-05 | 北大方正集团有限公司 | A kind of Database Systems, Database Systems access method and device |
| CN103957192A (en) * | 2014-04-04 | 2014-07-30 | 驻马店市金格尔电气设备有限公司 | System for processing any GPS data based on distributed system structure |
| CN105337923A (en) * | 2014-05-26 | 2016-02-17 | 腾讯科技（北京）有限公司 | Data distribution method and system, data transmitting apparatus and data receiving apparatus |
| CN105337923B (en) * | 2014-05-26 | 2019-07-12 | 腾讯科技（北京）有限公司 | Data distributing method and system and data sending device and data sink |
| CN105450733A (en) * | 2015-11-09 | 2016-03-30 | 北京锐安科技有限公司 | Business data distribution processing method and system |
| CN105450733B (en) * | 2015-11-09 | 2019-03-05 | 北京锐安科技有限公司 | A kind of business datum distribution processing method and system |
| CN105847112A (en) * | 2016-03-11 | 2016-08-10 | 努比亚技术有限公司 | Data updating method, client and system |
| CN105847112B (en) * | 2016-03-11 | 2020-06-16 | 深圳前海财信云科技有限公司 | Data updating method, client and system |
| CN106888245A (en) * | 2016-06-07 | 2017-06-23 | 阿里巴巴集团控股有限公司 | A kind of data processing method, apparatus and system |
| WO2018165966A1 (en) * | 2017-03-17 | 2018-09-20 | 深圳市秀趣品牌文化传播有限公司 | Discrete e-commerce data migration processing system and method |
| WO2018165964A1 (en) * | 2017-03-17 | 2018-09-20 | 深圳市秀趣品牌文化传播有限公司 | Cluster architecture-based e-commerce data migration system and method |
| CN107580025A (en) * | 2017-08-07 | 2018-01-12 | 国电南瑞科技股份有限公司 | A kind of more control centres of power network in a few days generation schedule Security Checking data sharing method |
| CN108509510A (en) * | 2018-03-08 | 2018-09-07 | 阿里巴巴集团控股有限公司 | Update method, server-side and the client of interface data |
| CN109542905A (en) * | 2018-11-19 | 2019-03-29 | 同方知网(北京)技术有限公司 | A kind of Science Popularization Resources dissemination system and method by all kinds of means |
| CN112261043A (en) * | 2020-10-21 | 2021-01-22 | 深圳市思迅软件股份有限公司 | POS system data interaction method and device, computer equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101383839A (en) | Data distribution system based on data server and implementation method | |
| CN101163265B (en) | Distributed database based on multimedia message log inquiring method and system | |
| US8769025B2 (en) | Cluster server of an instant messaging system and messaging method between clusters | |
| CN111225069B (en) | Distributed market data processing system and method | |
| CN101115225B (en) | System and method for implementing RSS subscription using multimedia message of mobile terminal | |
| CN103064731A (en) | Device and method for improving message queue system performance | |
| CN103248645A (en) | BT (Bit Torrent) off-line data downloading system and method | |
| CN101860446A (en) | Method, terminal and server for informing network content update | |
| CN104022940A (en) | Information processing method, device and system based on instant messaging (IM) | |
| CN102006568A (en) | Method, equipment and system for providing portrait service | |
| CN101662547B (en) | Method and device for realizing notification of business information of blend address book | |
| CN102982116A (en) | Multi-media transfer method and system based on cloud | |
| CN101808051A (en) | Application integration gateway and control method thereof | |
| CN100452704C (en) | Method and method for issuing blog articles | |
| CN101674143A (en) | Method and system for releasing news to mobile equipment at regular time | |
| CN105208004A (en) | Data input method based on OBD equipment | |
| CN101547414B (en) | Short message billing system and method | |
| CN101957830A (en) | System, device and method for inquiring lists | |
| CN101938383B (en) | On-line monitoring method and system of user account with multiple services as well as monitoring service system | |
| CN101605301A (en) | A kind of group system and request message distribution method that carries out the multinode transaction | |
| CN100382493C (en) | System and method for realizing service | |
| CN101753561B (en) | Business cluster processing method and cluster system | |
| CN101170584B (en) | Distributed system and data configuration method in the system | |
| CN101072182B (en) | Network content update synchronizing method, device and system | |
| CN102984276A (en) | Distribution device and distribution method for distributing multiple socket servers |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| REG | Reference to a national code |
Ref country code: HK Ref legal event code: DE Ref document number: 1128177 Country of ref document: HK |
|
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Open date: 20090311 |
|
| REG | Reference to a national code |
Ref country code: HK Ref legal event code: WD Ref document number: 1128177 Country of ref document: HK |