CN102122301A - LBS (location-based service)-oriented real-time database system - Google Patents
LBS (location-based service)-oriented real-time database system Download PDFInfo
- Publication number
- CN102122301A CN102122301A CN2011100552499A CN201110055249A CN102122301A CN 102122301 A CN102122301 A CN 102122301A CN 2011100552499 A CN2011100552499 A CN 2011100552499A CN 201110055249 A CN201110055249 A CN 201110055249A CN 102122301 A CN102122301 A CN 102122301A
- Authority
- CN
- China
- Prior art keywords
- real
- data processing
- data
- time
- database system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention discloses an LBS (location-based service)-oriented real-time database system, which is used in the field of information technology to solve the problem in the prior art that the requirement of a large-scale real-time LBS application system can not be realized. The system comprises one or a plurality of data processing servers, a naming and license server and a data access client side, wherein one or the plurality of data processing servers are used for providing a data processing function for timing sequence location information data; the naming and license server is used for providing the service name conversion and database authorization control functions for one or the plurality of data processing servers; the data access client side is used for providing the access interface of a real-time database; and each data processing server comprises the logic service name information of the data processing server. According to the embodiment of the invention, the high performance characteristic of the system processor is utilized, and the distributed architecture is adopted, so that the database system has strong real time capability, the storage space is saved, the database system is smoothly updated by adding servers, and the volume of a location acquisition spot is unlimitedly expanded.
Description
Technical field
The present invention relates to areas of information technology, relate in particular to a kind of real-time dataBase system of facing position service.
Background technology
Arrival along with the Internet of Things epoch, the information service of facing position presents polynary, the trend of explosive growth, therefore, positional information collection capacity towards the LBS service presents explosive growth, LBS (facing position service, Location Based Service) system towards terminal quantity from original hundreds of thousands of develop into up to ten thousand and even last 100,000 ultra-large, present stage is mainly adopted document handling modus or relevant database mode towards the service end data storage that LBS uses, but processing mode originally can not satisfy actual application demand, concrete analysis as hereinafter.
Document handling modus generally is used for the compact applications system of Single-Server, its advantage is to arrange simply, cost is low, but can not satisfy the concurrent of a plurality of users writes, being difficult to number of support serves according to the retrieval, be not easy to realize the Hot Spare of server, and easy damage of data causes safety of data relatively poor.Therefore, can not be applied to large-scale application system.
The relevant database processing mode can be supported fairly large application system, its advantage is to satisfy a plurality of users' concurrent reading and writing, number of support according to the retrieval very easily, be easy to realize the balanced heat of server is equipped with, data security is higher, but speed is slow when the greatest weakness of relevant database is big concurrent writing, for up to ten thousand, the application of hundreds of thousands concurrent system be difficult to be supported, if adopt the mode of piling up server then the cost costliness, enterprise is difficult to bear.Therefore, also inapplicable for ultra-large system.
The real-time data base technology is mainly used in electric system at present, because measurement point is very many, real-time requires high in the electric system, so adopted the real-time data base technology, has solved the service end data stress problems under big concurrent, the high real-time requirement condition.But each measuring point has only a data segment to preserve data in the electric system, most crucial " door-hinge compression " algorithm that is adopted in the real-time data base also can only be handled at the individual character section, can not satisfy the requirement that each station acquisition point will be stored a plurality of data fields in the LBS service.
Summary of the invention
In the above-mentioned background technology, the processing mode of data message can not satisfy all deficiencies of the ultra-large application system that realizes the service of facing position for example, the embodiment of the invention provides a kind of real-time dataBase system of facing position service, Real-time and Concurrent to Database Systems when being used for realizing having the large-scale application terminal system writes, the capacity that satisfies the location information service system data is big, security, real-time and extensibility requirement, and real-time preservation and the fast function such as retrieval of magnanimity station acquisition information in service end is provided.
In order to realize above goal of the invention, the real-time dataBase system of a kind of facing position service that the embodiment of the invention provided is to realize by following technical scheme:
A kind of real-time dataBase system of facing position service, described system comprises:
One or more data processing servers are used to provide the data processing function of sequential location information data;
Name and permit server, the Service name that is used to provide described one or more data processing servers is changed and database authorization control function;
The data access client is used to provide the access interface of described real-time data base, and wherein, described data processing server comprises the logical services name information of described data processing server.
Further preferably, described data processing server comprises:
Interface module is used for receiving the location information data that collects from acquisition interface;
Cache module provides caching function when being used for that described location information data carried out data processing;
Memory module is used for storing the location information data that carries out after the data processing;
Module is used to provide the Real-time and Concurrent of described location information data is handled in real time;
The configuration module, the result after the Real-time and Concurrent that is used for feeding back described location information data is handled.
Further preferably, described location information data comprise the longitude, latitude of location point, highly, speed, direction, time or status information, or the combination in any of above information.
Further preferably, described concurrent processing comprises concurrent compression, concurrent storage, concurrent retrieval or concurrent reading.
Further preferably, the compression of described location information data adopts improved Huffman algorithm to carry out.
Further preferably, described data processing server adopts the thread pool structure, and the Intra-request Concurrency that the terminal user submitted to is handled.
Further preferably, described data processing server adopts LRU memory cache algorithm, and described location information data is carried out data processing.
Further preferably, the access interface that provided of described data access client adopts the communication modes of finishing port.
In order to realize aforementioned goal of the invention, the embodiment of the invention also provides a kind of data processing method of the real-time dataBase system based on this facing position service, and described data processing method is achieved through the following technical solutions:
A kind of data processing method of the real-time dataBase system based on the service of aforementioned facing position, described method comprises:
When acquisition interface collected the current location information data, data processing server carried out buffer memory by high-speed cache to the described location information data that collects, and by the Huffman algorithm described location information data is compressed.
The embodiment of the invention is utilized the high characteristics of system processor performance, fully excavate the potentiality of modern processors technology, operation system technology, memory technology and network communications technology, the position data processing speed reaches per second more than 1,000,000 on common PC server, the supported collection point of system's separate unit server capacity reaches more than 100,000, and it is above to save storage space that position data store compressed ratio reaches 4:1.In addition, owing to adopt distributed structure/architecture, can realize the infinite expanding of station acquisition point capacity by adding the mode smooth upgrade of server.
Description of drawings
The present invention is further described below in conjunction with drawings and Examples:
Fig. 1 is the real-time dataBase system intention of the embodiment of the invention 1 facing position service;
Fig. 2 is the core framework map of the embodiment of the invention 2 data processing servers;
Fig. 3 is the embodiment of the invention 2 real-time data base flow chart of data processing figure.
Embodiment
As shown in Figure 1, the embodiment of the invention 1 provides a kind of real-time dataBase system of facing position service, and described real-time dataBase system comprises:
One or more data processing servers are used to provide the data processing function of sequential location information data;
Name and permit server, the Service name that is used to provide described one or more data processing servers is changed and database authorization control function;
The data access client is used to provide the access interface of described real-time data base, and wherein, described data processing server comprises the logical services name information of described data processing server.
As shown in Figure 2, further preferably, described data processing server comprises:
Interface module is used for receiving the location information data that collects from acquisition interface;
Cache module provides caching function when being used for that described location information data carried out data processing;
Memory module is used for storing the location information data that carries out after the data processing;
Module is used to provide the Real-time and Concurrent of described location information data is handled in real time;
The configuration module, the result after the Real-time and Concurrent that is used for feeding back described location information data is handled.
Further preferably, described location information data comprise the longitude, latitude of location point, highly, speed, direction, time or status information, or the combination in any of above information.
Further preferably, described concurrent processing comprises concurrent compression, concurrent storage, concurrent retrieval or concurrent reading.
Further preferably, the compression of described location information data adopts improved Huffman algorithm to carry out.
Further preferably, described data processing server adopts the thread pool structure, and the Intra-request Concurrency that the terminal user submitted to is handled.
Further preferably, described data processing server adopts LRU memory cache algorithm, and described location information data is carried out data processing.
Further preferably, the access interface that provided of described data access client adopts the communication modes of finishing port.
In order to realize location information service, 3 one kinds of data processing methods of the embodiment of the invention based on the real-time dataBase system of this facing position service, described data processing method is to be achieved through the following technical solutions:
A kind of data processing method of the real-time dataBase system based on the service of aforementioned facing position, described method comprises:
When acquisition interface collected the current location information data, data processing server carried out buffer memory by high-speed cache to the described location information data that collects, and by the Huffman algorithm described location information data is compressed.
Embodiment is described as follows:
In order to realize the function of location-based service, the positional information amount is bigger, need to gather the real-time position information of each location point, general LBS system need preserve longitude, latitude, highly, speed, direction, time, several data such as state, so this system can preserve four or more field as required.By adopting multiword section real-time dataBase system, solve the multiword segment data memory requirement of collection point, position among the LBS.
Because data volume is huge, need the location information data to compress and store, the embodiment of the invention adopts improved Huffman compression algorithm to solve the data compression requirement of LBS real-time data base multiword section, and it is above to save storage space to realize that position data store compressed ratio reaches 4:1.
In addition, because the data volume of application system is huge, the embodiment of the invention adopts the communication modes of finishing port to solve the concurrent access to netwoks of super large.Finish port and can manage a large amount of network simultaneously by a spot of thread and connect, for the CPU of multinuclear and hyperthread, CPU nuclear is many more, the lifting that performance just more can be at double.And modem computer systems generally all adopts multi-core CPU, can give full play to server resource so port technique is finished in employing, realizes that the station acquisition information of large concurrent in time receives.
Simultaneously, data processing server adopts the thread pool structure to realize concurrent processing, improve the entire system performance, this embodiment makes full use of the characteristics that modem computer systems supports all that generally multi-thread concurrent is handled, and modem computer systems all has the CPU more than 2 or 2.Therefore, data processing server adopts the thread pool structure, to data storage and inquiry that the user submitted to is the retrieval request parallel processing, comprise parallelly compressed, parallel storage, parallel search, parallel reading, eliminate software configuration to the system throughput quantitative limitation, improved the overall performance of system greatly.
Above LBS real-time dataBase system is made up of data processing server, name and permit server and data access client, and wherein, data processing server is the core of real-time data base, finishes the compression storage and the query function of time series data; Name server is then mainly finished Service name conversion and database authorization control function.
Because only need having the logical services name information of data processing server, the data access client just can conduct interviews to the data processing server, when the address of service of data processing server changes, the data access client is unaffected, thereby reaches the target of the physical location independence of data.Simultaneously, name and permit server can be managed a plurality of data processing services simultaneously, thereby the performance and the capacity that guarantee total system can smooth upgrades.Described real-time dataBase system adopts the multiple step format architectural framework, and the performance of total system and capacity can smooth upgrades, can realize the infinite expanding to collection point, position capacity by the mode of adding server, thereby realize the function of smooth upgrade.
The LBS real-time dataBase system adopts the technology of name service to realize the function of Service name conversion and data base authority control.Client is by logical services name accessing database server, and do not need to know relevant information such as its physical location, thus the smooth upgrade of the system of realization.
The above embodiment of the present invention utilizes the high characteristics of system processor performance, fully excavate the potentiality of modern processors technology, operation system technology, memory technology and network communications technology, the position data processing speed reaches per second more than 1,000,000 on common PC server, the supported collection point of system's separate unit server capacity reaches more than 100,000, and it is above to save storage space that position data store compressed ratio reaches 4:1.In addition, owing to adopt distributed structure/architecture, can realize the infinite expanding of station acquisition point capacity by adding the mode smooth upgrade of server.
Those skilled in the art will recognize that; above-mentioned embodiment is exemplary; be in order to make those skilled in the art can better understand this patent content; should not be construed as is restriction to this patent protection domain; change or modify so long as disclose spiritual any being equal to of being done, all fall into this patent protection domain according to this patent.
Claims (8)
1. the real-time dataBase system of facing position service is characterized in that described system comprises:
One or more data processing servers are used to provide the data processing function of sequential location information data;
Name and permit server, the Service name that is used to provide described one or more data processing servers is changed and database authorization control function;
The data access client is used to provide the access interface of described real-time data base, and wherein, described data processing server comprises the logical services name information of described data processing server.
2. real-time dataBase system according to claim 1 is characterized in that, described data processing server comprises:
Interface module is used for receiving the location information data that collects from acquisition interface;
Cache module provides caching function when being used for that described location information data carried out data processing;
Disk module is used for storing the location information data that carries out after the data processing;
Module is used to provide the Real-time and Concurrent of described location information data is handled in real time;
The configuration module, the result after the Real-time and Concurrent that is used for feeding back described location information data is handled.
3. real-time dataBase system according to claim 2 is characterized in that, described location information data comprise the longitude, latitude of location point, highly, speed, direction, time or status information, or the combination in any of above information.
4. real-time dataBase system according to claim 3 is characterized in that, described concurrent processing comprises concurrent compression, concurrent storage, concurrent retrieval or concurrent reading.
5. real-time dataBase system according to claim 4 is characterized in that, the compression of described location information data adopts improved Huffman algorithm to carry out.
6. according to any described real-time dataBase system of claim 1 to 5, it is characterized in that described data processing server adopts the thread pool structure, the Intra-request Concurrency that the terminal user submitted to is handled.
7. according to any described real-time dataBase system of claim 1 to 5, it is characterized in that described data processing server adopts LRU memory cache algorithm, and described location information data is carried out data processing.
8. according to any described real-time dataBase system of claim 1 to 5, it is characterized in that the access interface that described data access client is provided adopts the communication modes of finishing port.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011100552499A CN102122301A (en) | 2011-03-09 | 2011-03-09 | LBS (location-based service)-oriented real-time database system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011100552499A CN102122301A (en) | 2011-03-09 | 2011-03-09 | LBS (location-based service)-oriented real-time database system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102122301A true CN102122301A (en) | 2011-07-13 |
Family
ID=44250860
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2011100552499A Pending CN102122301A (en) | 2011-03-09 | 2011-03-09 | LBS (location-based service)-oriented real-time database system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102122301A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110232073A (en) * | 2019-05-10 | 2019-09-13 | 中国联合网络通信集团有限公司 | A kind of Data Management Analysis system and method |
| CN113961615A (en) * | 2021-09-27 | 2022-01-21 | 北京东方通科技股份有限公司 | Multi-layer service fusion decision method and system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1801131A (en) * | 2005-11-11 | 2006-07-12 | 南京科远控制工程有限公司 | Setup method for real-time database system of thermal power plant |
| CN101325801A (en) * | 2007-06-12 | 2008-12-17 | 北京三星通信技术研究有限公司 | Method and apparatus for locating business authentication and authorization examination in Winax network |
| CN101729704A (en) * | 2008-10-29 | 2010-06-09 | 中兴通讯股份有限公司 | Alarm information pushing system, device and method based on positioning technique |
| US20100235494A1 (en) * | 2009-03-16 | 2010-09-16 | Microsoft Corporation | Flexible logging, such as for a web server |
| CN101968525A (en) * | 2010-10-09 | 2011-02-09 | 杭州市电力局 | Fault positioning method for power distribution network by combining simulation calculation and real-time monitoring |
-
2011
- 2011-03-09 CN CN2011100552499A patent/CN102122301A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1801131A (en) * | 2005-11-11 | 2006-07-12 | 南京科远控制工程有限公司 | Setup method for real-time database system of thermal power plant |
| CN101325801A (en) * | 2007-06-12 | 2008-12-17 | 北京三星通信技术研究有限公司 | Method and apparatus for locating business authentication and authorization examination in Winax network |
| CN101729704A (en) * | 2008-10-29 | 2010-06-09 | 中兴通讯股份有限公司 | Alarm information pushing system, device and method based on positioning technique |
| US20100235494A1 (en) * | 2009-03-16 | 2010-09-16 | Microsoft Corporation | Flexible logging, such as for a web server |
| CN101968525A (en) * | 2010-10-09 | 2011-02-09 | 杭州市电力局 | Fault positioning method for power distribution network by combining simulation calculation and real-time monitoring |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110232073A (en) * | 2019-05-10 | 2019-09-13 | 中国联合网络通信集团有限公司 | A kind of Data Management Analysis system and method |
| CN113961615A (en) * | 2021-09-27 | 2022-01-21 | 北京东方通科技股份有限公司 | Multi-layer service fusion decision method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20230236935A1 (en) | Distributing Data on Distributed Storage Systems | |
| CN101510209B (en) | Method, system and server for implementing real time search | |
| US9836514B2 (en) | Cache based key-value store mapping and replication | |
| US20140337484A1 (en) | Server side data cache system | |
| US20070260609A1 (en) | System and method for high throughput with remote storage servers | |
| CN103020315A (en) | Method for storing mass of small files on basis of master-slave distributed file system | |
| CN102117248A (en) | Caching system and method for caching data in caching system | |
| CN103077197A (en) | Data storing method and device | |
| CN109101580A (en) | A kind of hot spot data caching method and device based on Redis | |
| CN103501319A (en) | Low-delay distributed storage system for small files | |
| CN104156482A (en) | Map tile data publishing method | |
| CN109862090A (en) | A kind of high degree of safety distribution cloud storage system | |
| CN107241444B (en) | Distributed cache data management system, method and device | |
| CN104158863A (en) | Cloud storage mechanism based on transaction-level whole-course high-speed buffer | |
| KR102471966B1 (en) | Data input and output method using storage node based key-value srotre | |
| CN102737131B (en) | A kind of disposal route for database redo log and system | |
| Luo et al. | {SMART}: A {High-Performance} Adaptive Radix Tree for Disaggregated Memory | |
| CN101453416A (en) | Service node, network for packet pre-fetching of remote program installation | |
| CN104424189A (en) | Positioning resolving method and positioning resolving system based on cloud platform | |
| CN103425694A (en) | Relational data searching method and device | |
| CN102122301A (en) | LBS (location-based service)-oriented real-time database system | |
| CN111427920A (en) | Data acquisition method, device, system, computer equipment and storage medium | |
| US20200387412A1 (en) | Method To Manage Database | |
| US11593310B2 (en) | Providing writable streams for external data sources | |
| US9069821B2 (en) | Method of processing files in storage system and data server using the method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20110713 |