CN106934001A - Distributed quick inventory inquiry system and method - Google Patents
Distributed quick inventory inquiry system and method Download PDFInfo
- Publication number
- CN106934001A CN106934001A CN201710124601.7A CN201710124601A CN106934001A CN 106934001 A CN106934001 A CN 106934001A CN 201710124601 A CN201710124601 A CN 201710124601A CN 106934001 A CN106934001 A CN 106934001A
- Authority
- CN
- China
- Prior art keywords
- service
- data
- distributed
- inquiry
- inventory
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 25
- 238000007906 compression Methods 0.000 claims abstract description 11
- 230000006835 compression Effects 0.000 claims abstract description 11
- 238000005516 engineering process Methods 0.000 claims abstract description 10
- 230000007246 mechanism Effects 0.000 claims abstract description 5
- 230000008569 process Effects 0.000 claims description 8
- 238000013500 data storage Methods 0.000 claims description 6
- 238000007726 management method Methods 0.000 claims description 6
- 238000013523 data management Methods 0.000 claims description 4
- 230000002708 enhancing effect Effects 0.000 claims description 4
- 238000001914 filtration Methods 0.000 claims description 4
- 238000004458 analytical method Methods 0.000 claims description 3
- 238000004364 calculation method Methods 0.000 claims description 3
- 238000000605 extraction Methods 0.000 claims description 3
- 230000000977 initiatory effect Effects 0.000 claims description 3
- 238000013144 data compression Methods 0.000 claims 1
- 230000004044 response Effects 0.000 abstract description 5
- 230000001965 increasing effect Effects 0.000 description 5
- 230000006837 decompression Effects 0.000 description 3
- 230000006399 behavior Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 239000000284 extract Substances 0.000 description 2
- 239000004744 fabric Substances 0.000 description 2
- 230000008520 organization Effects 0.000 description 2
- PEDCQBHIVMGVHV-UHFFFAOYSA-N Glycerine Chemical compound OCC(O)CO PEDCQBHIVMGVHV-UHFFFAOYSA-N 0.000 description 1
- 239000002253 acid Substances 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 238000000429 assembly Methods 0.000 description 1
- 230000000712 assembly Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 238000000151 deposition Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 230000003862 health status Effects 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 230000002688 persistence Effects 0.000 description 1
- 238000005201 scrubbing Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
- G06F16/24552—Database cache management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2457—Query processing with adaptation to user needs
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention relates to a kind of distributed quick inventory inquiry system and method, including distributed cache service module and distributed disk storage service module, the thinking administered using data staging, dsc data, cold data is separate, distributed cache component technology is used for dsc data, meet the search request of high concurrent, low delay, lift customer experience；For cold data, then it is stored in distributed disk database, there is provided the storage of high power capacity high compression.The present invention can be based on x86 distributed deployments, can dynamically quick dilatation；Service registry/subscribing mechanism is supported, can Dynamic Discovery service；Cold and hot data are divided and ruled management, and conventional dsc data is stored in host memory, it is possible to provide quick search service.Product of the present invention can be applied to the inventory inquiry of telecom operation support, and the wide range of areas for needing Mass storage and quick response inquiry is applied also for after extension；Its mentality of designing leads over industry colleague.
Description
Technical field
The present invention relates to a kind of distributed quick inventory inquiry system and method.
Background technology
For the storage of telecommunications inventory, in the past typically using the relevant database of non-distributed, this memory module letter
Folk prescription just, can provide more complicated querying condition combination, and support matrix correlation inquiry well, and inquiry response is also relatively rapider.
But this memory module has the problems such as compression ratio is low, and dilatation is difficult, when data magnanimity increases, often it is difficult to meet Express Order Wire
The requirement of property dilatation.Develop into using the column storage database of distributed deployment to store magnanimity listings data after again, be distributed
The column storage database of formula can provide compression ratio higher, and dilatation is also relatively easy, but because column storage database is looked into data
Need to carry out data decompression during inquiry, and column data is spliced into row data, be so difficult to meet in inquiry response speed
It is required that, particularly in the case where high concurrent is inquired about.
The content of the invention
It is low in order to solve inventory inquiry system low-response, storage compression ratio, and the problem of linear expansion is difficult, the present invention
A kind of distributed quick inventory inquiry system and method are provided, concrete scheme is as follows：
A kind of distributed quick inventory inquiry system, including：
Distributed cache service module, using distributed memory computing technique, the data management engine based on internal memory,
As the storage medium of dsc data, there is provided the data storage and query service based on internal memory of high speed；
Distributed disk storage service module, including distributed deployment column storage database, support PB grades of data pressure
Contracting storage and analysis inquiry, support high compression rate and linear expansion, as the storage system of cold data, there is provided relatively long time
Interior data storage and query service.
Preferably, also include：
Acquisition module, is responsible for the collection of data file, and registered；
Pretreatment module, file duplicate removal, integrity checking, regular, enhancing, extraction filtering is carried out to data file and is torn open
Point；
Enter library module, pretreated data are inserted into distributed cache service module or distributed disk storage
In service module.
Preferably, also include：
Service managerZ-HU, to the distributed cache service module in service node, distributed disk storage service mould
Block is managed, and receive inquire about server service registration request, and client service subscription request and reply can use
It is chartered inquiry server address；
Inquiry server, is distributed in each service node, for the distributed cache service in the service node
Module, distributed disk storage service module carry out data query.
A kind of distributed quick inventory querying method：The thinking administered using data staging, by dsc data, cold data point
Open, stored using different technology and product and process dsc data, cold data.
Preferably, for dsc data use distributed cache component technology, meet high concurrent, low delay inquiry will
Ask, lift customer experience；
For cold data, then it is stored in distributed disk database, there is provided the storage of high power capacity high compression.
Preferably, the dsc data, cold data are by acquisition module, pretreatment module and enter library module successively to data
Reason is obtained.
Preferably, the storage resume module flow includes：
1) after storage process initiation, pretreated inventory file list is first obtained；
2) open inventory file and read inventory record；
3) inventory record storage to distributed cache；
4) inventory record storage to distributed disk database；
5) listed files is updated, storage is masked as；
6) delete and be put in storage inventory file.
Preferably, set up service managerZ-HU and be distributed in the inquiry server of service node, client is by service
Manager obtains service list, is then connected to inquiry server according to list, and client is by incoming Subscriber Number, inventory class
Type and time range carry out inventory inquiry, and inquiry server is assembled into Query Result bag, returns to service according to predetermined form
Called side.
Preferably, inquiry server supports that registration subscribing mechanism, inquiry server were first registered to clothes before being serviced
Business manager, it is service registry to be, tells that service managerZ-HU, service managerZ-HU write these information and take by the service that can be provided
Business list, and be unregistered to service managerZ-HU before exiting；
Client first must initiate service subscription request in the service provided using inquiry server to service managerZ-HU,
After obtaining the service list that service managerZ-HU is returned, corresponding inquiry server is used；Service managerZ-HU is according to chartered
The service list content that information on services and the current Determines of each inquiry server are returned, client is asked by Service name
Ask desired service.
Preferably, data query flow is as follows：
1) client initiates inquiry request to inventory inquiry server, and content includes number, time period, List Type；
2) inquiry server is split as dsc data, cold data inquiry according to the time period, for dsc data inquiry request, to point
Cloth cache sends out inquiry request, for cold data inquiry request, then sends out inquiry request to distributed disk database；
3) after distributed cache is connected to inquiry request, corresponding data is found in the buffer, and return to inquiry service
Device；Distributed disk database finds corresponding data after being connected to inquiry request in disc libraries, also returns to inquire about server；
4) inquiry server does cold and hot result data and does and merges, and returns to client.
The quick inventory inquiry system of distribution and method that the present invention is provided can be based on x86 distributed deployments, can be dynamically fast
Fast dilatation；Service registry/subscribing mechanism is supported, can Dynamic Discovery service；Cold and hot data are divided and ruled management, and conventional dsc data is stored in
In host memory, it is possible to provide quick search service.Product of the present invention can be applied to the inventory inquiry of telecom operation support, and expand
The wide range of areas for needing Mass storage and quick response inquiry is applied also for after exhibition；It is same that its mentality of designing leads over industry
OK.
Brief description of the drawings
Accompanying drawing described herein is used for providing a further understanding of the present invention, constitutes the part of the application, not
Inappropriate limitation of the present invention is constituted, in the accompanying drawings：
Fig. 1 is embodiment of the present invention frame diagram；
Fig. 2 is embodiment of the present invention inventory storage flow chart；
Fig. 3 is embodiment of the present invention inventory inquiry server rack composition；
Fig. 4 inventory querying flow figures；
Fig. 5 is the embodiment of the present invention to divide and rule storage schematic diagram according to the cold and hot inventory of data.
Specific embodiment
Describe the present invention in detail below in conjunction with accompanying drawing and specific embodiment, herein illustrative examples of the invention
It is and explanation is used for explaining the present invention but not as a limitation of the invention；
Embodiment
As shown in figure 1, a kind of distributed quick inventory inquiry system, including：
Distributed cache service module, using distributed memory computing technique, the data management engine based on internal memory,
As the storage medium of dsc data, there is provided the data storage and query service based on internal memory of high speed；Cache component has been
The full data management engine based on internal memory, is devoted to solving the intrinsic problems such as existing database performance is slow, extension is difficult, cost is high.
Cache component supports distributed type assemblies deployment, supports complete ACID uniformity, supports persistence.In order to be maximized
Handling capacity, data are stored in internal memory (rather than in hard disk), so can effectively eliminate buffer management.Under cluster environment
Cache component, distributes data to each CPU treatment of cluster server.Each single thread subregion is independently performed,
Eliminate the demand of locking and breech lock.It can also realize the line of performance by way of simply increasing additional node in the cluster
Property increase.
Distributed disk storage service module, including distributed deployment column storage database, support PB grades of data pressure
Contracting storage and analysis inquiry, support high compression rate and linear expansion, as the storage system of cold data, there is provided relatively long time
Interior data storage and query service.
Data acquisition and treatment in this embodiment scheme include：
Acquisition module, is responsible for the collection of data file, and is registered, after OCS systems provide billing of services, generation
Ticket be stored in fixed place in the form of a file, the file acquisition module of inventory storehouse system is responsible for timely these tickets
File gathers using ftp agreements, and is registered.
Pretreatment module, file duplicate removal, integrity checking, regular, enhancing, extraction filtering is carried out to data file and is torn open
Point, the CDR file that collection comes, it is necessary to used by that could be put in storage after pretreatment, the content of pretreatment includes：
1) file duplicate removal, duplicate checking is carried out according to filename.OCS during engineering, may repeated acquisition same file,
Pretreatment duplicate checking function ensures to repeat to be put in storage same file.
2) integrity checking is recorded, reasonableness check is done to ticket writing, the record that some are not substantially completed is stepped on
Note and alarm.
3) record information enhancing and it is regular, in order to enter library format the need for, it is necessary to Original CDR record carry out it is necessary
Regular, such as area code is regular.In addition to convenient statistics, demand is in every ticket writing end increase file name information
Deng.
4) record information extracts filtering, is required according to inventory database design, removes some redundancy words of Original CDR record
Section, only extracts useful information.
5) CDR file split, the record in inventory storehouse is monthly to divide table, for convenience be put in storage and count, it is necessary to treat into
Storehouse CDR file is monthly split.
Enter library module, inventory storage is the service of resident operation, pretreated data is inserted into distributed type high speed and is delayed
In depositing service module or distributed disk storage service module, in order to keep one of the data in cache and disk database
Cause property, will enter in distributed cache and distributed disk database respectively with portion call bill data.
Also include in this embodiment scheme：
Service managerZ-HU, to the distributed cache service module in service node, distributed disk storage service mould
Block is managed, and receive inquire about server service registration request, and client service subscription request and reply can use
It is chartered inquiry server address；
Inquiry server, is distributed in each service node, for the distributed cache service in the service node
Module, distributed disk storage service module carry out data query.
The thinking administered using data staging from above-described embodiment scheme, the present invention, by dsc data, cold data point
Open, stored using different technology and product and process dsc data, cold data.
Specifically, in the embodiment of the present invention, distributed cache component technology is used for dsc data, meets height simultaneously
Hair, the search request of low delay, lift customer experience；Distributed cache based on internal storage access, data query treatment is complete
Portion is completed in internal memory, without disk I/O, therefore can obtain the performance boost of 1~2 data magnitude.And cache with
Behavior unit organization is recorded, therefore need not do data decompression, multiple row spelling row treatment, but directly returns to inventory record, processes effect
Rate is greatly promoted.It is distributed internally cached, the ability of horizontal extension is increased on the basis of unit caching, therefore on capacity
It is no longer restricted, mass data can be stored by increasing number of servers.
For cold data, then it is stored in distributed disk database, there is provided the storage of high power capacity high compression.
The dsc data, cold data are by acquisition module, pretreatment module and enter library module successively to data processing acquisition.
As shown in Fig. 2 the storage resume module flow in above-described embodiment scheme includes：
1) after storage process initiation, pretreated inventory file list is first obtained；
2) open inventory file and read inventory record；
3) inventory record storage to distributed cache；
4) inventory record storage to distributed disk database；
5) listed files is updated, storage is masked as；
6) delete and be put in storage inventory file.
Further, set up service managerZ-HU and be distributed in the inquiry server of service node, client is by clothes
Business manager obtains service list, is then connected to inquiry server according to list, and client passes through incoming Subscriber Number, inventory
Type and time range carry out inventory inquiry, and inquiry server is assembled into Query Result bag, returns to clothes according to predetermined form
Business called side.
In the quick inventory querying method of distribution that above-described embodiment is provided, inquiry server supports registration subscribing mechanism,
Inquiry server was first registered to service managerZ-HU before being serviced, and it is service registry to be, clothes are told by the service that can be provided
Business manager, service managerZ-HU before exiting to service managerZ-HU is unregistered these information write service lists；Clothes
The content for being engaged in registering includes：Action mark (registration 1, nullify 0), Service name, COS, service ip, serve port, protocol class
Type, protocol version, service entry-into-force time, service failure time.
Client first must initiate service subscription request in the service provided using inquiry server to service managerZ-HU,
After obtaining the service list that service managerZ-HU is returned, corresponding inquiry server is used；Service managerZ-HU is according to chartered
Information on services and the current state of each inquiry server (health status and not busy busy condition) determine the service list content for returning,
Client asks desired service by Service name.
As shown in figure 3, inquiry service main thread sets up the connection pool to cache and disk database after starting, to
After service management platform registration service success, start socket and monitor, wait as client provides inquiry service.In the company of receiving
After connecing request, connection is set up, and start new service sub-line journey for client service.It is socket long between client and sub-line journey
Connection, client actively disconnects after the completion of service.
Cache farm storage dsc data (data in 1+1 month), gbase clusters storage cold data (T>1+1),
Sub-line journey performs inquiry operation after obtaining connection, small when the date when Query Dates are to look into disk database more than 1+1
It is to look into cache in 1+1, if can not find out data to go to look into disk database again.
Service management platform is also carried out in addition to treatment registration and subscribing to request to each service node in checklist systems
Management：Receive health and not busy busy condition that each node is returned；Actively withdraw service node or receive new service node；Adjustment is each
The spare time of node busy coefficient, carries out load balance process etc..
As shown in figure 4, the quick inventory querying method of distribution that above-described embodiment is provided, data query flow is as follows：
1) client initiates inquiry request to inventory inquiry server, and content includes number, time period, List Type；
2) inquiry server is split as dsc data, cold data inquiry according to the time period, for dsc data inquiry request, to point
Cloth cache sends out inquiry request, for cold data inquiry request, then sends out inquiry request to distributed disk database；
3) after distributed cache is connected to inquiry request, corresponding data is found in the buffer, and return to inquiry service
Device；Distributed disk database finds corresponding data after being connected to inquiry request in disc libraries, also returns to inquire about server；
4) inquiry server does cold and hot result data and does and merges, and returns to client.
As shown in figure 5, the thinking that this programme is administered using data staging, separate by dsc data, cold data, using different
Technology and product store and process the data of different stage temperature.
Distributed cache component technology is used for dsc data (such as of that month and data last month), high concurrent, low is met
The search request of time delay, lifts customer experience.For cold data (such as non-of that month and data last month), then distributed disk is stored in
In database, there is provided the storage of high power capacity high compression.
In implementing, data in storage simultaneously storage to distributed cache and disk database, handle after turning moon
The data of non-of that month and last month are deleted from cache.In memory bank it is monthly to divide table due to data, deletes data
As long as when perform truncate and block and can quickly carry out data scrubbing.According to current time during inquiry, it is determined that being inquiry slow at a high speed
Deposit or disc libraries.
Distributed cache based on internal storage access, data query treatment is entirely to be completed in internal memory, without disk
IO, therefore the performance boost of 1~2 data magnitude can be obtained.And cache is recorded with behavior unit organization, therefore need not
Do data decompression, multiple row and spell row treatment, but directly return to inventory record, treatment effeciency is greatly promoted.
It is distributed internally cached, the ability of horizontal extension is increased on the basis of unit caching, therefore on capacity not
It is restricted again, mass data can be stored by increasing number of servers.
The technical scheme for being provided the embodiment of the present invention above is described in detail, specific case used herein
Principle and implementation method to the embodiment of the present invention are set forth, and the explanation of above example is only applicable to help and understands this
The principle of inventive embodiments；Simultaneously for those of ordinary skill in the art, according to the embodiment of the present invention, in specific embodiment party
Be will change in formula and range of application, in sum, this specification content should not be construed as limiting the invention.
Claims (10)
1. a kind of distributed quick inventory inquiry system, it is characterised in that including：
Distributed cache service module, using distributed memory computing technique, the data management engine based on internal memory, as
The storage medium of dsc data, there is provided the data storage and query service based on internal memory of high speed；
Distributed disk storage service module, including distributed deployment column storage database, support that PB grades of data compression is deposited
Storage and analysis inquiry, support high compression rate and linear expansion, as the storage system of cold data, there is provided in relatively long time
Data storage and query is serviced.
2. inventory inquiry system as claimed in claim 1 distributed quick, it is characterised in that also include：
Acquisition module, is responsible for the collection of data file, and registered；
Pretreatment module, file duplicate removal, integrity checking, regular, enhancing, extraction filtering is carried out to data file and is split；
Enter library module, pretreated data are inserted into distributed cache service module or distributed disk storage service
In module.
3. inventory inquiry system as claimed in claim 1 distributed quick, it is characterised in that also include：
Service managerZ-HU, enters to the distributed cache service module in service node, distributed disk storage service module
Row management, and receive inquire about server service registration request, and client service subscription request and reply it is available
The address of chartered inquiry server；
Inquiry server, be distributed in each service node, for the distributed cache service module in the service node,
Distributed disk storage service module carries out data query.
4. a kind of distributed quick inventory querying method, it is characterised in that：
The thinking administered using data staging, dsc data, cold data is separate, store and locate using different technology and product
Reason dsc data, cold data.
5. inventory querying method as claimed in claim 4 distributed quick, it is characterised in that：
Distributed cache component technology is used for dsc data, the search request of high concurrent, low delay is met, client is lifted
Experience；
For cold data, then it is stored in distributed disk database, there is provided the storage of high power capacity high compression.
6. inventory querying method as claimed in claim 5 distributed quick, it is characterised in that：
The dsc data, cold data are by acquisition module, pretreatment module and enter library module successively to data processing acquisition.
7. inventory querying method as claimed in claim 6 distributed quick, it is characterised in that the storage resume module flow
Including：
1) after storage process initiation, pretreated inventory file list is first obtained；
2) open inventory file and read inventory record；
3) inventory record storage to distributed cache；
4) inventory record storage to distributed disk database；
5) listed files is updated, storage is masked as；
6) delete and be put in storage inventory file.
8. inventory querying method as claimed in claim 4 distributed quick, it is characterised in that：
Set up service managerZ-HU and be distributed in the inquiry server of service node, client is taken by service managerZ-HU
Business list, is then connected to inquiry server according to list, and client is by incoming Subscriber Number, List Type and time range
Inventory inquiry is carried out, inquiry server is assembled into Query Result bag, returns to service call side according to predetermined form.
9. inventory querying method as claimed in claim 8 distributed quick, it is characterised in that：
Inquiry server supports that registration subscribing mechanism, inquiry server were first registered to service managerZ-HU before being serviced, are
Be service registry, service managerZ-HU told by the service that can be provided, service managerZ-HU these information write service lists, and
The forward direction service managerZ-HU for exiting is unregistered；
Client first must initiate service subscription request in the service provided using inquiry server to service managerZ-HU, obtain
After the service list that service managerZ-HU is returned, corresponding inquiry server is used；Service managerZ-HU is according to chartered service
The service list content that information and the current Determines of each inquiry server are returned, client asks to think by Service name
The service wanted.
10. inventory querying method as claimed in claim 8 distributed quick, it is characterised in that data query flow is as follows：
1) client initiates inquiry request to inventory inquiry server, and content includes number, time period, List Type；
2) inquiry server is split as dsc data, cold data inquiry according to the time period, for dsc data inquiry request, to distribution
Cache sends out inquiry request, for cold data inquiry request, then sends out inquiry request to distributed disk database；
3) after distributed cache is connected to inquiry request, corresponding data is found in the buffer, and return to inquiry server；Point
Cloth disk database finds corresponding data after being connected to inquiry request in disc libraries, also returns to inquire about server；
4) inquiry server does cold and hot result data and does and merges, and returns to client.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710124601.7A CN106934001A (en) | 2017-03-03 | 2017-03-03 | Distributed quick inventory inquiry system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710124601.7A CN106934001A (en) | 2017-03-03 | 2017-03-03 | Distributed quick inventory inquiry system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106934001A true CN106934001A (en) | 2017-07-07 |
Family
ID=59424049
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710124601.7A Pending CN106934001A (en) | 2017-03-03 | 2017-03-03 | Distributed quick inventory inquiry system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106934001A (en) |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108363813A (en) * | 2018-03-15 | 2018-08-03 | 北京小度信息科技有限公司 | Date storage method, device and system |
| CN108803542A (en) * | 2018-08-01 | 2018-11-13 | 武汉索雅信息技术有限公司 | Industrial production data manages system |
| CN109274760A (en) * | 2018-10-19 | 2019-01-25 | 西安瑜乐文化科技股份有限公司 | A kind of cold and hot data resolution method of Mobile Development |
| CN109299035A (en) * | 2018-07-04 | 2019-02-01 | 中通服建设有限公司 | A kind of CHR file management method, system and computer readable storage medium |
| CN109582223A (en) * | 2018-10-31 | 2019-04-05 | 华为技术有限公司 | A kind of method and device of internal storage data migration |
| CN110046178A (en) * | 2018-01-17 | 2019-07-23 | 北京京东尚科信息技术有限公司 | The method and apparatus of distributed data inquiry |
| CN110120972A (en) * | 2019-04-19 | 2019-08-13 | 浙江省气象台 | Distributed storage grid meteorological data read method and reading system |
| CN110795395A (en) * | 2018-07-31 | 2020-02-14 | 阿里巴巴集团控股有限公司 | File deployment system and file deployment method |
| CN111352915A (en) * | 2018-12-20 | 2020-06-30 | 北京奇虎科技有限公司 | Machine learning system, machine learning parameter server and implementation method |
| CN111367880A (en) * | 2020-02-05 | 2020-07-03 | 北京华电天仁电力控制技术有限公司 | Universal real-time data storage management system and implementation method thereof |
| CN111858654A (en) * | 2020-07-21 | 2020-10-30 | 威讯柏睿数据科技(北京)有限公司 | Data query acceleration method and device based on memory calculation |
| CN111984696A (en) * | 2020-07-23 | 2020-11-24 | 深圳市赢时胜信息技术股份有限公司 | Novel database and method |
| CN112541101A (en) * | 2020-12-11 | 2021-03-23 | 武汉旷视金智科技有限公司 | Subscription data pushing method and device, electronic equipment and computer storage medium |
| CN112650453A (en) * | 2020-12-31 | 2021-04-13 | 北京千方科技股份有限公司 | Method and system for storing and inquiring traffic data |
| CN113420021A (en) * | 2021-07-14 | 2021-09-21 | 苏州峰之鼎信息科技有限公司 | Data storage method, device, equipment and medium |
| CN113568892A (en) * | 2021-08-12 | 2021-10-29 | 威讯柏睿数据科技(北京)有限公司 | Method and equipment for carrying out data query on data source based on memory calculation |
| CN116127110A (en) * | 2023-04-04 | 2023-05-16 | 成都智元汇信息技术股份有限公司 | High-performance picture data reading and storing method and system |
| WO2023185111A1 (en) * | 2022-03-29 | 2023-10-05 | 北京柏睿数据技术股份有限公司 | Quick access method and device for data file |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102541927A (en) * | 2010-12-30 | 2012-07-04 | 北京新媒传信科技有限公司 | Method and device for realizing data cache |
| CN102739720A (en) * | 2011-04-14 | 2012-10-17 | 中兴通讯股份有限公司 | Distributed cache server system and application method thereof, cache clients and cache server terminals |
| CN104715349A (en) * | 2013-12-12 | 2015-06-17 | 世纪禾光科技发展（北京）有限公司 | Method and system for calculating e-commerce freight |
-
2017
- 2017-03-03 CN CN201710124601.7A patent/CN106934001A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102541927A (en) * | 2010-12-30 | 2012-07-04 | 北京新媒传信科技有限公司 | Method and device for realizing data cache |
| CN102739720A (en) * | 2011-04-14 | 2012-10-17 | 中兴通讯股份有限公司 | Distributed cache server system and application method thereof, cache clients and cache server terminals |
| CN104715349A (en) * | 2013-12-12 | 2015-06-17 | 世纪禾光科技发展（北京）有限公司 | Method and system for calculating e-commerce freight |
Non-Patent Citations (1)
| Title |
|---|
| 肖爱元: "基于hadoop的分布式详单査询系统设计与实现", 《中国优秀硕士学位论文全文数据库信息科技辑》 * |
Cited By (27)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110046178A (en) * | 2018-01-17 | 2019-07-23 | 北京京东尚科信息技术有限公司 | The method and apparatus of distributed data inquiry |
| CN108363813B (en) * | 2018-03-15 | 2020-06-02 | 北京星选科技有限公司 | Data storage method, device and system |
| CN108363813A (en) * | 2018-03-15 | 2018-08-03 | 北京小度信息科技有限公司 | Date storage method, device and system |
| CN109299035A (en) * | 2018-07-04 | 2019-02-01 | 中通服建设有限公司 | A kind of CHR file management method, system and computer readable storage medium |
| CN110795395A (en) * | 2018-07-31 | 2020-02-14 | 阿里巴巴集团控股有限公司 | File deployment system and file deployment method |
| CN110795395B (en) * | 2018-07-31 | 2023-04-18 | 阿里巴巴集团控股有限公司 | File deployment system and file deployment method |
| CN108803542A (en) * | 2018-08-01 | 2018-11-13 | 武汉索雅信息技术有限公司 | Industrial production data manages system |
| CN108803542B (en) * | 2018-08-01 | 2020-09-18 | 武汉索雅信息技术有限公司 | Industrial production data management system |
| CN109274760A (en) * | 2018-10-19 | 2019-01-25 | 西安瑜乐文化科技股份有限公司 | A kind of cold and hot data resolution method of Mobile Development |
| CN109582223A (en) * | 2018-10-31 | 2019-04-05 | 华为技术有限公司 | A kind of method and device of internal storage data migration |
| US11435931B2 (en) | 2018-10-31 | 2022-09-06 | Huawei Technologies Co., Ltd. | Memory data migration method and apparatus where cold data is migrated to shared storage prior to storing in destination storage |
| US11809732B2 (en) | 2018-10-31 | 2023-11-07 | Huawei Technologies Co., Ltd. | Method and apparatus of data migration based on use algorithm |
| CN109582223B (en) * | 2018-10-31 | 2023-07-18 | 华为技术有限公司 | Memory data migration method and device |
| CN111352915A (en) * | 2018-12-20 | 2020-06-30 | 北京奇虎科技有限公司 | Machine learning system, machine learning parameter server and implementation method |
| CN110120972A (en) * | 2019-04-19 | 2019-08-13 | 浙江省气象台 | Distributed storage grid meteorological data read method and reading system |
| CN111367880A (en) * | 2020-02-05 | 2020-07-03 | 北京华电天仁电力控制技术有限公司 | Universal real-time data storage management system and implementation method thereof |
| CN111858654A (en) * | 2020-07-21 | 2020-10-30 | 威讯柏睿数据科技(北京)有限公司 | Data query acceleration method and device based on memory calculation |
| CN111984696A (en) * | 2020-07-23 | 2020-11-24 | 深圳市赢时胜信息技术股份有限公司 | Novel database and method |
| CN111984696B (en) * | 2020-07-23 | 2023-11-10 | 深圳市赢时胜信息技术股份有限公司 | Novel database and method |
| CN112541101A (en) * | 2020-12-11 | 2021-03-23 | 武汉旷视金智科技有限公司 | Subscription data pushing method and device, electronic equipment and computer storage medium |
| CN112541101B (en) * | 2020-12-11 | 2023-04-21 | 武汉旷视金智科技有限公司 | Subscription data pushing method and device, electronic equipment and computer storage medium |
| CN112650453A (en) * | 2020-12-31 | 2021-04-13 | 北京千方科技股份有限公司 | Method and system for storing and inquiring traffic data |
| CN112650453B (en) * | 2020-12-31 | 2024-05-14 | 北京千方科技股份有限公司 | Method and system for storing and inquiring traffic data |
| CN113420021A (en) * | 2021-07-14 | 2021-09-21 | 苏州峰之鼎信息科技有限公司 | Data storage method, device, equipment and medium |
| CN113568892A (en) * | 2021-08-12 | 2021-10-29 | 威讯柏睿数据科技(北京)有限公司 | Method and equipment for carrying out data query on data source based on memory calculation |
| WO2023185111A1 (en) * | 2022-03-29 | 2023-10-05 | 北京柏睿数据技术股份有限公司 | Quick access method and device for data file |
| CN116127110A (en) * | 2023-04-04 | 2023-05-16 | 成都智元汇信息技术股份有限公司 | High-performance picture data reading and storing method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106934001A (en) | Distributed quick inventory inquiry system and method | |
| US20200364201A1 (en) | Journaled tables in database systems | |
| US9092475B2 (en) | Database log parallelization | |
| DE69938077T2 (en) | A client method and apparatus and program storage device and an adaptive synchronization and transformation server | |
| EP2936344B1 (en) | Searchable data archive | |
| CN102831156B (en) | Distributed transaction processing method on cloud computing platform | |
| US6401098B1 (en) | System for database creation, maintenance and access using event marking and two-dimensional partitioning | |
| CN106886371B (en) | Caching data processing method and device | |
| CN101163265B (en) | Distributed database based on multimedia message log inquiring method and system | |
| CN103678408B (en) | A kind of method and device of inquiry data | |
| US20180075071A1 (en) | Automating the Logging of Table Changes in a Database | |
| CN101464895A (en) | Method, system and apparatus for updating internal memory data | |
| AU2006275665A1 (en) | Revenue management system and method | |
| CN103440290A (en) | Big data loading system and method | |
| CN101751415A (en) | Metadata service system metadata synchronized method and writing server updating method | |
| CN101170522A (en) | A method and system for distributing history events | |
| CN107885616A (en) | A kind of mass small documents back-up restoring method based on file system parsing | |
| CN105843559A (en) | Read-write optimization method and system of disk cache system | |
| CN112131305A (en) | Account processing system | |
| DE60221156T2 (en) | METHOD AND SYSTEM FOR DISTRIBUTING THE WORKLOAD IN A NETWORK OF COMPUTER SYSTEMS | |
| CN103761256A (en) | Maintenance system and method of branch points of remote directories | |
| CN109871394B (en) | Full-distributed high-concurrency calculation method and device | |
| US20190317962A1 (en) | Database restoration across cloud environments | |
| CN110008284A (en) | Method for synchronizing data of database and equipment based on data page preloading and rollback | |
| CN113742392A (en) | Data synchronization method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170707 |
|
| RJ01 | Rejection of invention patent application after publication |