CN109783449A - Data query processing method, platform, system and readable storage medium storing program for executing - Google Patents
Data query processing method, platform, system and readable storage medium storing program for executing Download PDFInfo
- Publication number
- CN109783449A CN109783449A CN201811531175.XA CN201811531175A CN109783449A CN 109783449 A CN109783449 A CN 109783449A CN 201811531175 A CN201811531175 A CN 201811531175A CN 109783449 A CN109783449 A CN 109783449A
- Authority
- CN
- China
- Prior art keywords
- data
- file
- directory
- server
- query processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 27
- 238000012545 processing Methods 0.000 claims abstract description 65
- 238000012544 monitoring process Methods 0.000 claims abstract description 13
- GOLXNESZZPUPJE-UHFFFAOYSA-N spiromesifen Chemical compound CC1=CC(C)=CC(C)=C1C(C(O1)=O)=C(OC(=O)CC(C)(C)C)C11CCCC1 GOLXNESZZPUPJE-UHFFFAOYSA-N 0.000 claims description 5
- 238000012986 modification Methods 0.000 claims description 3
- 230000004048 modification Effects 0.000 claims description 3
- 238000000034 method Methods 0.000 abstract description 14
- 238000010586 diagram Methods 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000004044 response Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 230000004913 activation Effects 0.000 description 1
- 238000007792 addition Methods 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 210000000352 storage cell Anatomy 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Abstract
The invention discloses a kind of data query processing methods, are applied to distributed data base system, distributed data base system is equipped with multiple servers, this method comprises: monitoring each server to obtain the directory node that each server is created based on predetermined manner；When receiving data query instruction, the database safeguarded to each server carries out data interlock processing, and the data information carried according to data query instruction, searches in each directory node with the presence or absence of file directory corresponding with data information；If there is file directory corresponding with data information in directory node, the data in file directory are read to determine data volume, and feed back data volume as query result.The invention also discloses a kind of platform, system and readable storage medium storing program for executing.The present invention prevents data caused by each server concurrent operations inconsistent and unstable, and quickly navigate to target data, and then improve search efficiency and accuracy by data processing technique.
Description
Technical field
The present invention relates to technical field of data processing more particularly to a kind of data query processing method, platform, systems and can
Read storage medium.
Background technique
With the fast development of informationization technology, the data volume that large-scale database system needs to handle and store is increasingly
Greatly, in order to adapt to the development need of applied business, distributed data base is distributed data across on the different nodes of computer network,
And these data logically belong to same system.One server of each node on behalf, and distributed deployment framework is used,
It puts together to form cluster service.Due to each server can independent process data, leading to data is dynamic change, because
And the result inaccuracy of data bulk is inquired, the data between each server are inconsistent, and then mention distributed data base externally
It declines to a great extent for the overall performance of cluster service, affects the usage experience of user.
Summary of the invention
The main purpose of the present invention is to provide a kind of data query processing method, platform, system and readable storage medium storing program for executing,
Aim to solve the problem that the technical issues of how improving the search efficiency and accuracy of data bulk in distributed data base.
To achieve the above object, a kind of data query processing method provided by the invention is applied to distributed data base system
System, the distributed data base system be equipped with multiple servers, the data query processing method the following steps are included:
Each server is monitored to obtain the directory node that each server is created based on predetermined manner；
When receiving data query instruction, the database safeguarded to each server carries out data interlock processing, and root
According to the data information that data query instruction carries, search in each directory node with the presence or absence of corresponding with the data information
File directory；
If there is file directory corresponding with the data information in directory node, the number in the file directory is read
Data volume is determined accordingly, and is fed back using the data volume as query result.
Optionally, the predetermined manner includes:
When receiving the data write operation of exterior terminal submission, according to the data of the data write operation, creation
Simultaneously the file in local data base and/or in modification local data base is written in file；
Filename and storage location corresponding to the file stored according to local data base generate file directory；
By the corresponding file directory generated of each file, typing is carried out by default tree structure classification, summarizes to obtain catalogue
Node.
Optionally, in the directory node monitoring each server and being created with obtaining each server based on predetermined manner
After operation, further includes:
Whether the item number changing value for monitoring each directory node file directory within a preset time is greater than or equal to preset threshold；
If directory node within a preset time file directory item number changing value be greater than or equal to preset threshold, according to text
The generation time of part catalogue and filename, triggering generate data query instruction.
Optionally, if there is file directory corresponding with the data information in the directory node, described in reading
While data in file directory are to determine data volume, further includes:
If file directory corresponding with the data information is not present in directory node, according to the file mesh of reading
Data in record update local directory node, with synchrodata.
Optionally, if file directory corresponding with the data information is not present in the directory node, according to reading
Data in the file directory taken update local directory node, after the operation of synchrodata, further includes:
When there is file directory corresponding with the data information in each directory node, number that each server is safeguarded
Unlocking data processing is carried out according to library.
Optionally, the database safeguarded to each server carries out data interlock processing, comprising: allows exterior terminal
When accessing server to it where database carry out data read operation, forbid exterior terminal when accessing server to it
The data write operation that place database carries out；
The database safeguarded to each server carries out unlocking data processing, comprising: exterior terminal is allowed to access
The data read operation and data write operation that database where it is carried out when server.
Optionally, if there is file directory corresponding with the data information in the directory node, the text is read
Data in part catalogue are to determine data volume, comprising:
If there is file directory corresponding with the data information in directory node, according to file directory record
Storage location jumps to the file of storage and reads the data in the file to determine data volume.
In addition, to achieve the above object, the present invention also provides a kind of data query processing platform, the data query processing
Platform includes: memory, processor and is stored on the memory and at the data query that can be run on the processor
Program is managed, the data query as described in any one of above-mentioned is realized when the data query processing routine is executed by the processor
The step of processing method.
In addition, to achieve the above object, the present invention also provides a kind of distributed data base system, the distributed data base
System is equipped with multiple servers, and the distributed data base system further includes that data query processing as claimed in claim 8 is flat
Platform, exterior terminal；
The server is used for, and is established and is communicated to connect with the data query processing platform, at the data query
Platform carries out monitoring and/or data query；
The server is also used to, and according to the control instruction of the data query processing platform, is allowed or is forbidden described outer
The access right that portion's terminal accesses.
In addition, to achieve the above object, it is described computer-readable the present invention also provides a kind of computer readable storage medium
It is stored with data query processing routine on storage medium, realizes when the data query processing routine is executed by processor as above-mentioned
Any one of described in data query processing method the step of.
The present invention is applied to the distributed data base system equipped with multiple servers, first by monitoring each server
To obtain the directory node that each server is created based on predetermined manner, then when receiving data query instruction, to each service
The database that device is safeguarded carries out data interlock processing, and the data information carried according to data query instruction, searches each catalogue
It whether there is file directory corresponding with data information in node, finally when there is file directory corresponding with data information,
The data in file directory are read to determine data volume, and are fed back data volume as query result.The present invention is inquiring
When data, using the lock mechanism in data processing technique, data interlock processing is carried out to each database, each service can be prevented
Data caused by device concurrent operations are inconsistent and unstable, and quickly navigate to target data by the directory node of creation, into
And improve search efficiency and accuracy.
Detailed description of the invention
Fig. 1 is the structural schematic diagram for the data query processing platform running environment that the embodiment of the present invention is related to；
Fig. 2 is the flow diagram of one embodiment of data query processing method of the present invention；
Fig. 3 is the functional block diagram of distributed data base system unified implementation example of the present invention.
The embodiments will be further described with reference to the accompanying drawings for the realization, the function and the advantages of the object of the present invention.
Specific embodiment
It should be appreciated that described herein, specific examples are only used to explain the present invention, is not intended to limit the present invention.
Referring to Fig.1, Fig. 1 is the structural representation for the data query processing platform running environment that the embodiment of the present invention is related to
Figure.
As shown in Figure 1, the data query processing platform includes: processor 1001, such as CPU, communication bus 1002, user
Interface 1003, network interface 1004, memory 1005.Wherein, communication bus 1002 is for realizing the connection between these components
Communication.User interface 1003 may include display screen (Display), input unit such as keyboard (Keyboard), network interface
1004 may include optionally standard wireline interface and wireless interface (such as WI-FI interface).Memory 1005 can be high speed
RAM memory is also possible to stable memory (non-volatile memory), such as magnetic disk storage.Memory 1005
It optionally can also be the storage device independently of aforementioned processor 1001.
It will be understood by those skilled in the art that the hardware configuration of data query processing platform shown in Fig. 1 is not constituted
Restriction to data query processing platform, may include than illustrating more or fewer components, perhaps combine certain components or
Different component layouts.
As shown in Figure 1, as may include operating system, net in a kind of memory 1005 of computer readable storage medium
Network communication module, Subscriber Interface Module SIM and computer program.Wherein, operating system is to manage and control data query processing to put down
The program of platform and software resource supports the operation of data query processing routine and other softwares and/or program.
In the hardware configuration of data query processing platform shown in Fig. 1, network interface 1004 is mainly used for accessing network；
User interface 1003 is mainly used for detecting confirmation Command And Edit instruction etc..And processor 1001 can be used for calling memory
The data query processing routine stored in 1005, and execute the operation of each embodiment of following data inquiry processing method.
Based on above-mentioned data query processing platform hardware configuration, each implementation of data query processing method of the present invention is proposed
Example.
It is the flow diagram of one embodiment of data query processing method of the present invention referring to Fig. 2, Fig. 2.
In the present embodiment, data query processing method includes:
Step S10 monitors each server to obtain the directory node that each server is created based on predetermined manner；
In the present embodiment, multiple servers use distributed deployment framework, put together and carry out same service, shape together
At cluster.Any one server in cluster can request to service to same service platform, that is, to notebook data Directory Enquiries
Platform sends service request.And the processing type of service request includes inquiry, transaction, uploads log, subscribe to, place an order, infusing
Volume etc. specifically can need to be configured according to practical application scene.Each server is externally supplied to the corresponding business clothes of user
Business, i.e. user establish connection and interaction data by the terminals such as mobile phone, computer and server.Each server has independence in system
Database for storing data.For convenience of the data for managing and monitoring each server storage, each server is monitored to obtain
To corresponding directory node.
It creaties directory node it should be added that server is based on predetermined manner, specifically, comprising: 1) receiving
When the data write operation submitted to exterior terminal, according to the data of data write operation, creates file and local data simultaneously is written
File in library and/or in modification local data base；Such as when receiving trade order, trade order is written in database simultaneously
It is stored with document form；Or receive when recalling an order, order revocation will be written in the corresponding file of the order；Or it connects
When receiving change order, order is accordingly changed in respective file, depending on practical business situation.It should be clear that
Its data volume of data difference is also different.Each server independent operation, leads to the inconsistency of each database data.2) according to this
Filename and storage location corresponding to the file of ground database storage, generate file directory；The database that server is safeguarded
In have thousands of a files, accessed and managed for the ease of file, establish the index of file, i.e. filename and file object
The mapping relations between storage location are managed, the index of this file is known as file directory.3) by the corresponding text generated of each file
Part catalogue carries out typing by default tree structure classification, summarizes to obtain directory node.Each file is registered in file directory
One, the inventory with maintenance documentation is established as file system.And directory node is summarized by what multiple file directorys formed, respectively
File directory can be divided into the multistage subdirectory such as first class catalogue, second-level directory, and this multistage subdirectory structure is using tree-like
Structure establishes mode.Server Default has arranged a set of general bibliographic structure, and is created using this set bibliographic structure as template
Build file directory.By monitoring each server, the directory node of each server creation can be obtained, and then pass through catalogue section
Point supervises the data in each database.It is understood that server, local data base in the present invention and the mesh of creation
It is one-to-one for recording node.
Step S20, when receiving data query instruction, the database safeguarded to each server is carried out at data interlock
Reason, and the data information carried according to data query instruction, are searched in each directory node with the presence or absence of corresponding with data information
File directory；
In the present embodiment, due to each server can independent work, and when data are written arrange Structure Creating file mesh
Record, thus the data information carried according to data query instruction, such as order title, O/No., are searched in each directory node
With the presence or absence of corresponding file directory.It searches each directory node and namely searches each server database with the presence or absence of therewith
Corresponding file directory, and be indexed by directory node, file can be faster positioned, search efficiency is promoted.
In the present embodiment, the database safeguarded to each server carries out data interlock processing, can prevent concurrent operations
Caused data are inconsistent.Data interlock processing, specifically, comprising: where allowing exterior terminal when accessing server to it
Database carry out data read operation, forbid exterior terminal when access server to it where database progress data write
Enter operation.When exterior terminal accesses distributed data base system, any one server can be selected nearby, and mentioned by the server
For cluster service.Exterior terminal submits data (writing) etc. to server request data (reading), it should be understood that read and write operation is that have
Essential distinction.Request data are by the data feedback being locally stored by server to exterior terminal, and data are written
It is to be committed to data in server and write service device database.Because of this characteristic of write operation, when looking into quantity, Number dynamics
Variation, each server concurrent operations result in the inconsistency of each database data, and then inquire quantity result inaccuracy.And it counts
Refer to that the data in each database can only be modified and additions and deletions by system according to locking processing, and other exterior terminals collect in request
Reading data are only enjoyed when group's service, and data cannot be written, i.e., system is exclusive reads and writes to prevent data entanglement, and then to server
The database of maintenance is managed, and prevents data caused by concurrent operations inconsistent, to improve the accurate of inquiry data bulk
Property.
Step S30 reads the number in file directory if there is file directory corresponding with data information in directory node
Data volume is determined accordingly, and is fed back data volume as query result.
In the present embodiment, in computer science, data, which refer to, all can be input to computer and by computer program
The general name of the medium of the symbol of reason is handled for inputting electronic computer, number, letter, symbol with definite meaning
Number and analog quantity etc. common name.Data are the form of expression and carrier of information, can be symbol, text, number, voice, image,
Video etc..And information is the intension of data, information is loaded on data, and data are made with have significant explanation.And data
Amount refers to the item number (hundreds of thousands data) or storage cell (2MB data) of activation record according to service concept.Read how many
How many data volume is data be assured that.By locking processing, system is exclusive to be read and write to prevent data entanglement, and then inquire
Data volume is not influenced by exterior terminal, ensure that the accuracy of data volume.Inquiry data volume can meet the industry of different application scene
Business demand, such as trade order, automatic trigger and the next service link of entrance when inquiring data volume and meeting preset condition.
It is that it is each to pass through monitoring first applied to the distributed data base system equipped with multiple servers in the present embodiment
Server is right then when receiving data query instruction to obtain the directory node that each server is created based on predetermined manner
The database that each server is safeguarded carries out data interlock processing, and the data information carried according to data query instruction, searches
It whether there is file directory corresponding with data information in each directory node, finally when in the presence of file mesh corresponding with data information
When record, the data in file directory are read to determine data volume, and feed back data volume as query result.Namely exist
When inquiring data, using the lock mechanism in data processing technique, data interlock processing is carried out to each database, can be prevented each
Data caused by server concurrent operations are inconsistent and unstable, and quickly navigate to number of targets by the directory node of creation
According to, and then improve search efficiency and accuracy.
Still optionally further, in an alternative embodiment of the invention, after step slo, data query processing method is also wrapped
It includes:
1, whether the item number changing value for monitoring each directory node file directory within a preset time is greater than or equal to default threshold
Value；
If 2, directory node within a preset time file directory item number changing value be greater than or equal to preset threshold, basis
The generation time of file directory and filename, triggering generate data query instruction.
In the present embodiment, data query instruction by system trigger, such as trade order, each server can independently into
When a certain server reception order database is written and by agreement bibliographic structure in directory node in order by row order processing
Create file directory.System monitors the item number of each directory node, when item number changes, and item number changing value be greater than or equal to it is pre-
If when threshold value, triggering generates data query instruction, data query instruction carries data information, for example order title, order are compiled
Number etc., it can be depending on the generation time of variation item file directory and filename.For example listen to the mesh of a certain server creation
Item number of the file directory in nearly three days in record node increases to 1308 by 1200, and changing value=1308-1200=108 is greater than
Preset threshold 100, so according to the generation time of file directory, that is, the corresponding filename of the file directory newly increased, triggering life
It is instructed at data query.System is right under the data information Query Location to the server database according to data query instruction carrying
The file that should be stored determines data volume, and by the data synchronization updating in the file of reading into other servers.Preset threshold
Setting be arranged according to the actual situation, details are not described herein.By monitoring item number changing value, triggering generates data query and refers to
It enables, and then inquires data bulk automatically, meet the business demands such as order, transaction, while each database of synchronized update, be allowed to several
According to consistent.Further, data query instruction can also be is triggered by system staff, to inquire the data of some order
Amount.
Still optionally further, based on the above embodiment, in the present embodiment, in step S30, if existing and number in directory node
It is believed that ceasing corresponding file directory, then while reading the data in file directory to determine data volume, further includes: if catalogue section
File directory corresponding with data information is not present in point, then updates local directory section according to the data in the file directory of reading
Point, with synchrodata.
In the present embodiment, to make each database in distributed data base keep data consistent, when one of directory node
(server) does not have, and when other directory nodes have file directory, need the file directory being had according to other directory nodes come more
New local database.It should be added that in actual use, there are the access of following situations a. exterior terminal is distributed
It is to interact write-in data X with a wherein server Z when Database Systems, only has server Z to have this data X at this time,
Thus system requires to look up each directory node just to find the file directory of server Z storage, while data X is synchronized to it
In his server；B. each server is stored with a certain data in system, i.e., after synchronization, system reads any one in inquiry
Data X can be obtained in platform；C. it synchronizes rear exterior terminal and connects server C in access next time, can equally obtain data X.
It is understood that exterior terminal connects any one in access next time in distributed data base after each database in phase
Identical data can be obtained in platform server, further, the catalogue section that exterior terminal can also be created by local server
Point skips full dose file search, is directly targeted to required target data, realizes the beneficial effect of quick response, and then promoted
The usage experience of user.
Further, after synchrodata, further includes: when each directory node has file mesh corresponding with data information
When record, the database safeguarded to each server carries out unlocking data processing.Unlocking data processing, exactly allows exterior terminal to exist
The data read operation and data write operation that database where it is carried out when accessing server.Each directory node exist with
When the corresponding file directory of the data information, illustrates that each database data is consistent in distributed data base, guarantee that next time is external
Terminal reads the accuracy of the data of any one server storage.Unlocking data processing namely releases lock, so that external
Terminal not only enjoys reading data when requesting cluster service, and data can also be written.Simultaneously because Distributed Data Synchronization, outside
Portion's terminal can skip full dose file search by directory node when accessing distributed data base, realize the beneficial of quick response
Effect improves the usage experience of user.
Based on the above embodiment, in the present embodiment, in step S30, if existing in directory node corresponding with data information
File directory reads the data in file directory then to determine data volume, comprising: if existing and data information pair in directory node
The file directory answered, the then storage location recorded according to file directory, jumps to the file of storage and reads the data in file
To determine data volume.
In the present embodiment, file or data are exactly stored in hard disk by storage location, also referred to as storage or storing path
In some subregion or the subregion some file.Since file is practical being previously stored server, and server is in systems
Have multiple, the file of storage is even more thousands of.By directory node lock file catalogue, then the storage for the file directory record that follows up
Position is deposited, the file of storage is jumped directly to, then reads the data in file, that is, can determine the data volume in file data, from
And full dose file search is skipped, it realizes and quickly navigates to target query data, and then improve search efficiency.
It is the functional block diagram of one embodiment of distributed data base system of the present invention referring to Fig. 3, Fig. 3.
In the present embodiment, it further includes data query as described above that distributed data base system, which is equipped with multiple servers 10,
Processing platform 20 and exterior terminal 30；
The server 10 is used for, and is established and is communicated to connect with the data query processing platform 20, so that the data are looked into
It askes processing platform 20 and carries out monitoring and/or data query；
The server 10 is also used to, and according to the control instruction of the data query processing platform 20, allows or forbid institute
State the access right that exterior terminal 30 accesses.
In the present embodiment, multiple servers 10 use distributed deployment framework, put together and carry out same service together,
Form cluster.Each server 10 is independently operable, communicates respectively with data query processing platform 20, the foundation of exterior terminal 30
Information data interaction is realized in connection.Exterior terminal 30 includes the terminals such as mobile phone, laptop, tablet computer, Intelligent bracelet,
When user accesses distributed data base system by exterior terminal 30, any one server 10 can be selected nearby, and by the clothes
Business device 10 provides cluster service.Exterior terminal 30 is submitted data (write-in) to 10 request data (reading) of server.Data
Query processing platform 20 monitors server 10, and the data in query service device 10 based on the above embodiment.It needs to mend
Explanation is filled, data query processing platform 20 is in the data that query service device 10 stores, to the database of each server 10
Carry out lock locking/unlocking processing, that is, server 10 response lock locking/unlocking processing, thus allow or forbid exterior terminal 30 into
The access right (read-write operation permission) of row access.
In addition, being stored on the computer readable storage medium the present invention also provides a kind of computer readable storage medium
There is data query processing routine, is realized as described in any one of above-mentioned when the data query processing routine is executed by processor
The step of data query processing method.
Each embodiment base of computer readable storage medium specific embodiment of the present invention and above-mentioned data query processing method
This is identical, and in this not go into detail.
It should be noted that, in this document, the terms "include", "comprise" or its any other variant are intended to non-row
His property includes, so that the process, method, article or the device that include a series of elements not only include those elements, and
And further include other elements that are not explicitly listed, or further include for this process, method, article or device institute it is intrinsic
Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including being somebody's turn to do
There is also other identical elements in the process, method of element, article or device.
The serial number of the above embodiments of the invention is only for description, does not represent the advantages or disadvantages of the embodiments.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side
Method can be realized by means of software and necessary general hardware platform, naturally it is also possible to by hardware, but in many cases
The former is more preferably embodiment.Based on this understanding, technical solution of the present invention substantially in other words does the prior art
The part contributed out can be embodied in the form of software products, which is stored in a readable storage medium
In matter (such as ROM/RAM, magnetic disk, CD), including some instructions are used so that a terminal (can be mobile phone, computer, service
Device, air conditioner or network equipment etc.) method that executes each embodiment of the present invention.
The embodiment of the present invention is described with above attached drawing, but the invention is not limited to above-mentioned specific
Embodiment, the above mentioned embodiment is only schematical, rather than restrictive, those skilled in the art
Under the inspiration of the present invention, without breaking away from the scope protected by the purposes and claims of the present invention, it can also make very much
Form, it is all using equivalent structure or equivalent flow shift made by description of the invention and accompanying drawing content, directly or indirectly
Other related technical areas are used in, all of these belong to the protection of the present invention.
The above is only a preferred embodiment of the present invention, is not intended to limit the scope of the invention, all to utilize this hair
Equivalent structure or equivalent flow shift made by bright specification and accompanying drawing content is applied directly or indirectly in other relevant skills
Art field, is included within the scope of the present invention.
Claims (10)
1. a kind of data query processing method, is applied to distributed data base system, the distributed data base system is equipped with more
A server, which is characterized in that the data query processing method the following steps are included:
Each server is monitored to obtain the directory node that each server is created based on predetermined manner；
When receiving data query instruction, the database safeguarded to each server carries out data interlock processing, and according to institute
The data information that data query instruction carries is stated, is searched in each directory node with the presence or absence of file corresponding with the data information
Catalogue；
If in directory node exist file directory corresponding with the data information, read the data in the file directory with
It determines data volume, and is fed back using the data volume as query result.
2. data query processing method as described in claim 1, which is characterized in that the predetermined manner includes:
When receiving the data write operation of exterior terminal submission, according to the data of the data write operation, file is created
And the file in local data base and/or in modification local data base is written；
Filename and storage location corresponding to the file stored according to local data base generate file directory；
By the corresponding file directory generated of each file, typing is carried out by default tree structure classification, summarizes to obtain directory node.
3. data query processing method as claimed in claim 2, which is characterized in that monitor each server described to obtain
After the operation for the directory node that each server is created based on predetermined manner, further includes:
Whether the item number changing value for monitoring each directory node file directory within a preset time is greater than or equal to preset threshold；
If directory node within a preset time file directory item number changing value be greater than or equal to preset threshold, according to file mesh
The generation time of record and filename, triggering generate data query instruction.
4. data query processing method as described in claim 1, which is characterized in that if existing and institute in the directory node
The corresponding file directory of data information is stated, then while reading the data in the file directory to determine data volume, further includes:
If file directory corresponding with the data information is not present in directory node, according in the file directory of reading
Data update local directory node, with synchrodata.
5. data query processing method as claimed in claim 4, which is characterized in that if in the directory node there is no with
The corresponding file directory of the data information, then update local directory node according to the data in the file directory of reading,
After the operation of synchrodata, further includes:
When there is file directory corresponding with the data information in each directory node, database that each server is safeguarded
Carry out unlocking data processing.
6. data query processing method as claimed in claim 1 or 5, which is characterized in that
The database safeguarded to each server carries out data interlock processing, comprising: exterior terminal is allowed to service in access
Database where it is carried out when device data read operation, forbid exterior terminal when accessing server to it where database
The data write operation of progress；
The database safeguarded to each server carries out unlocking data processing, comprising: exterior terminal is allowed to service in access
The data read operation and data write operation that database where it is carried out when device.
7. data query processing method according to any one of claims 1 to 5, which is characterized in that if in the directory node
In the presence of file directory corresponding with the data information, then the data in the file directory are read to determine data volume, comprising:
If there is file directory corresponding with the data information in directory node, the storage recorded according to the file directory
Position jumps to the file of storage and reads the data in the file to determine data volume.
8. a kind of data query processing platform, which is characterized in that the data query processing platform includes: memory, processor
And it is stored in the data query processing routine that can be run on the memory and on the processor, the data query processing
The step of data query processing method as described in any one of claims 1 to 7 is realized when program is executed by the processor.
9. a kind of distributed data base system, which is characterized in that the distributed data base system is equipped with multiple servers, described
Distributed data base system further includes data query processing platform as claimed in claim 8, exterior terminal；
The server is used for, and is established and is communicated to connect with the data query processing platform, so that data query processing is flat
Platform carries out monitoring and/or data query；
The server is also used to, and according to the control instruction of the data query processing platform, is allowed or is forbidden described external whole
Hold the access right to access.
10. a kind of computer readable storage medium, which is characterized in that be stored with data on the computer readable storage medium and look into
Processing routine is ask, is realized as described in any one of claims 1 to 7 when the data query processing routine is executed by processor
The step of data query processing method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811531175.XA CN109783449A (en) | 2018-12-13 | 2018-12-13 | Data query processing method, platform, system and readable storage medium storing program for executing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811531175.XA CN109783449A (en) | 2018-12-13 | 2018-12-13 | Data query processing method, platform, system and readable storage medium storing program for executing |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109783449A true CN109783449A (en) | 2019-05-21 |
Family
ID=66496900
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811531175.XA Pending CN109783449A (en) | 2018-12-13 | 2018-12-13 | Data query processing method, platform, system and readable storage medium storing program for executing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109783449A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111339042A (en) * | 2020-03-26 | 2020-06-26 | 佛山中科芯蔚科技有限公司 | Data operation processing method and system and scheduling server |
| CN111405015A (en) * | 2020-03-09 | 2020-07-10 | 中国建设银行股份有限公司 | Data processing method, device, equipment and storage medium |
| CN111475291A (en) * | 2020-03-27 | 2020-07-31 | 深圳市梦网科技发展有限公司 | Data processing method, system, server and medium |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102262640A (en) * | 2010-05-31 | 2011-11-30 | 中国移动通信集团贵州有限公司 | Method and device for full-text retrieval of document database |
| CN102508926A (en) * | 2011-11-30 | 2012-06-20 | 山东中创软件商用中间件股份有限公司 | Catalog data parsing method and system |
| CN103002027A (en) * | 2012-11-26 | 2013-03-27 | 中国科学院高能物理研究所 | System and method for data storage on basis of key-value pair system tree-shaped directory achieving structure |
| CN103150394A (en) * | 2013-03-25 | 2013-06-12 | 中国人民解放军国防科学技术大学 | Distributed file system metadata management method facing to high-performance calculation |
| CN103500173A (en) * | 2013-09-03 | 2014-01-08 | 北京泰乐德信息技术有限公司 | Method for inquiring rail transit monitoring data |
| US9645893B1 (en) * | 2012-09-28 | 2017-05-09 | EMC IP Holding Company LLP | Method and system for file recovery using enhanced backup database indexing |
| CN106874383A (en) * | 2017-01-10 | 2017-06-20 | 清华大学 | A kind of decoupling location mode of metadata of distributed type file system |
| CN107977376A (en) * | 2016-10-24 | 2018-05-01 | 腾讯科技（深圳）有限公司 | Distributed data base system and transaction methods |
| CN108052661A (en) * | 2017-12-27 | 2018-05-18 | 广州品唯软件有限公司 | The method, apparatus and readable storage medium storing program for executing of polymerization retrieval under distributed environment |
| CN108491549A (en) * | 2018-04-09 | 2018-09-04 | 深圳市茁壮网络股份有限公司 | The creation method and device of file directory in a kind of distributed memory system |
| CN108959468A (en) * | 2018-06-20 | 2018-12-07 | 平安科技（深圳）有限公司 | A kind of monitoring method of data base directory, storage medium and server |
-
2018
- 2018-12-13 CN CN201811531175.XA patent/CN109783449A/en active Pending
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102262640A (en) * | 2010-05-31 | 2011-11-30 | 中国移动通信集团贵州有限公司 | Method and device for full-text retrieval of document database |
| CN102508926A (en) * | 2011-11-30 | 2012-06-20 | 山东中创软件商用中间件股份有限公司 | Catalog data parsing method and system |
| US9645893B1 (en) * | 2012-09-28 | 2017-05-09 | EMC IP Holding Company LLP | Method and system for file recovery using enhanced backup database indexing |
| CN103002027A (en) * | 2012-11-26 | 2013-03-27 | 中国科学院高能物理研究所 | System and method for data storage on basis of key-value pair system tree-shaped directory achieving structure |
| CN103150394A (en) * | 2013-03-25 | 2013-06-12 | 中国人民解放军国防科学技术大学 | Distributed file system metadata management method facing to high-performance calculation |
| CN103500173A (en) * | 2013-09-03 | 2014-01-08 | 北京泰乐德信息技术有限公司 | Method for inquiring rail transit monitoring data |
| CN107977376A (en) * | 2016-10-24 | 2018-05-01 | 腾讯科技（深圳）有限公司 | Distributed data base system and transaction methods |
| CN106874383A (en) * | 2017-01-10 | 2017-06-20 | 清华大学 | A kind of decoupling location mode of metadata of distributed type file system |
| CN108052661A (en) * | 2017-12-27 | 2018-05-18 | 广州品唯软件有限公司 | The method, apparatus and readable storage medium storing program for executing of polymerization retrieval under distributed environment |
| CN108491549A (en) * | 2018-04-09 | 2018-09-04 | 深圳市茁壮网络股份有限公司 | The creation method and device of file directory in a kind of distributed memory system |
| CN108959468A (en) * | 2018-06-20 | 2018-12-07 | 平安科技（深圳）有限公司 | A kind of monitoring method of data base directory, storage medium and server |
Non-Patent Citations (1)
| Title |
|---|
| 姜俊;朱小冬;杨崇俊;任应超;: "网格环境下空间元数据目录服务", 计算机工程与设计, no. 03, 16 March 2011 (2011-03-16), pages 901 - 904 * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111405015A (en) * | 2020-03-09 | 2020-07-10 | 中国建设银行股份有限公司 | Data processing method, device, equipment and storage medium |
| CN111405015B (en) * | 2020-03-09 | 2022-09-30 | 中国建设银行股份有限公司 | Data processing method, device, equipment and storage medium |
| CN111339042A (en) * | 2020-03-26 | 2020-06-26 | 佛山中科芯蔚科技有限公司 | Data operation processing method and system and scheduling server |
| CN111339042B (en) * | 2020-03-26 | 2024-03-01 | 北京快映互娱传媒有限公司 | Data operation processing method, system and scheduling server |
| CN111475291A (en) * | 2020-03-27 | 2020-07-31 | 深圳市梦网科技发展有限公司 | Data processing method, system, server and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11704336B2 (en) | Efficient filename storage and retrieval | |
| US7730097B2 (en) | Smart database | |
| US7752165B2 (en) | Persistent query system for automatic on-demand data subscriptions from mobile devices | |
| US8108360B2 (en) | Database object update order determination | |
| CN102378975A (en) | Extending collaboration capabilities to external data | |
| CN109783449A (en) | Data query processing method, platform, system and readable storage medium storing program for executing | |
| CN108614976A (en) | Authority configuring method, device and storage medium | |
| US10855637B2 (en) | Architecture for large data management in communication applications through multiple mailboxes | |
| JP7355964B2 (en) | External location synchronization | |
| US7246344B1 (en) | Drag and drop stateless data class specification and programming | |
| CN111400334A (en) | Data processing method, data processing device, storage medium and electronic device | |
| US7991798B2 (en) | In place migration when changing datatype of column | |
| US20110196847A1 (en) | Conflict management in a versioned file system | |
| CN111680036B (en) | Configuration management database based on graph storage | |
| US11445018B2 (en) | Technologies for synchronizing content items across content management systems | |
| JP7355959B2 (en) | External location synchronization | |
| US20220147504A1 (en) | Methods, systems and computer programs for managing control system engineering data | |
| L’Esteve | Load Data Lake Storage Gen2 Files into a Synapse Analytics Dedicated SQL Pool | |
| CN117093207A (en) | Entity processing method, device and system of multi-service data model | |
| CN116775204A (en) | Probe updating method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |