CN102609464A - Method and device for associative table query of MONGODB shards - Google Patents
Method and device for associative table query of MONGODB shards Download PDFInfo
- Publication number
- CN102609464A CN102609464A CN2012100121242A CN201210012124A CN102609464A CN 102609464 A CN102609464 A CN 102609464A CN 2012100121242 A CN2012100121242 A CN 2012100121242A CN 201210012124 A CN201210012124 A CN 201210012124A CN 102609464 A CN102609464 A CN 102609464A
- Authority
- CN
- China
- Prior art keywords
- data
- sign
- mongodb
- data table
- burst
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Information Transfer Between Computers (AREA)
Abstract
The invention discloses a method and a device for associative table query of MONGODB shards. The method includes: determining query conditions which are used for querying grouping summary information, corresponding to assigned grouping, in assigned data tables of all MONGDB shards; determining data recording marks of an optional grouping belongs to the assigned grouping in the assigned data tables and using the data recording marks as target data recording marks; obtaining data information of the data recording marks, belonging to one of the target data recording marks, in the assigned data tables of each MONGODB fragment; storing the obtained data information in a temporary data table; implementing grouping summary to the obtained data information based on the temporary data table to obtain the grouping summary information. The method and the device for associative table query of the MONGODB shards are capable of realizing high-efficient associative table grouping query of a plurality of MONGODB servers.
Description
Technical field
The present invention relates to data-base cluster technology, relate in particular to a kind of MONGODB burst couplet table querying method based on the distributed document storage.
Background technology
The data-base cluster technology is multiple servers to be joined together to form cluster realize that combination property is superior to the technology of single large server.
MONGODB is a database based on the distributed document storage, is write by C Plus Plus, and being intended to provides extendible high-performance data storage solution for WEB uses.
MAPREDUCE is a kind of programming model, is used for the concurrent operation of large-scale dataset (greater than 1TB).Notion " Map (mapping) " and " Reduce (abbreviation) " and their main thought are all borrowed in Functional Programming, also have the characteristic of borrowing in the vector programming language.He is very easy to the programming personnel can not distributed parallel under the situation of programming, with oneself program run on distributed system.Current software realizes it being to specify a Map (mapping) function, is used for being mapped to one group of new key-value pair to one group of key-value pair, specifies concurrent Reduce (abbreviation) function, is used for guaranteeing each the shared identical key group in the key-value pair of all mappings.
SHARDING is the solution of a kind of database on horizontal extension, and its fundamental purpose is for breaking through the I/O capabilities limits of single-node data storehouse server, solving the database scaling concern.
But along with the development of data-base cluster technology, people are also increasingly high to the demand of its business function.For example, require the data with existing among the MONGODB is divided into groups in batches.Yet the inventor gathers (being GROUP BY) through discovering though current MapReduce can realize many data between the MONGODB server, is difficult to carry out many couplet tables between the MONGODB server and divides group polling.
Summary of the invention
One of technical matters to be solved by this invention is need provide a kind of can be implemented in the MONGODB burst couplet table querying method that couplet table between many MONGODB servers divides group polling.
In order to solve the problems of the technologies described above, the invention provides a kind of MONGODB burst couplet table querying method.This method comprises:
Confirm querying condition, said querying condition is used for inquiring about the specific data table and designated packet corresponding packet summary information of all bursts of MONGDB;
Confirm to belong in the said specific data table data recording sign of arbitrary grouping in the said designated packet, identify as target data record;
Obtain the data message that the sign of data recording in the specific data table in each burst of said MONGODB is one of each said target data record sign;
With the data information memory of being obtained in an ephemeral data table;
Based on said ephemeral data table the data message that is obtained is divided into groups to gather, obtain the summary information of dividing into groups.
MONGODB burst according to another aspect of the invention joins the table querying method, and the user who sends based on the user side that receives through network asks to confirm querying condition; Resulting grouping summary information is returned to said user side.
Join the table querying method according to the MONGODB burst of another aspect of the invention, obtain through Mongos that the data recording sign is the data message of one of each said target data record sign in the specific data table in each burst of said MONGODB.
MONGODB burst according to another aspect of the invention joins the table querying method, the data message that is obtained is divided into groups to gather based on said ephemeral data table through MAPREDUCE.
Join the table querying method according to the MONGODB burst of another aspect of the invention, said querying condition is used for inquiring about in the specific data table of all bursts of MONGDB corresponding with designated packet and satisfy pre-conditioned grouping summary information; When data recording sign is the data message of one of each said target data record sign in the specific data table in obtaining each burst of said MONGODB, obtain that the data recording sign is one of each said target data record sign and satisfies said pre-conditioned data message in the specific data table in each burst of said MONGODB.
MONGODB burst according to another aspect of the invention joins the table querying method; Contingency table based on incidence relation between the sign of data recording sign of having stored said specific data table and said designated packet; Confirm to belong in the said specific data table data recording sign of arbitrary grouping in the said designated packet, identify as target data record.
According to another aspect of the invention a kind of MONGODB burst couplet table inquiry unit is provided also.This device comprises definite unit, query unit and temporary table administrative unit, wherein,
Said definite querying condition, said querying condition are used for inquiring about in all burst specific data tables of MONGDB and designated packet corresponding packet summary information;
Said query unit confirms to belong in the said specific data table data recording sign of arbitrary grouping in the said designated packet; As target data record sign, obtain that the data recording sign is the data message of one of each said target data record sign in the specific data table in each burst of said MONGODB;
Said temporary table administrative unit with the data information memory of being obtained in an ephemeral data table;
Said query unit, also divides into groups to gather to the data message that is obtained based on said ephemeral data table with after the data information memory of being obtained is in an ephemeral data table in said temporary control and education unit, obtains the summary information of dividing into groups.
MONGODB burst according to another aspect of the invention joins the table inquiry unit; Also comprise communication unit; Wherein, The user that the user side that said communication unit receives through network is sent asks to confirm querying condition, and after said query unit obtains dividing into groups summary information, resulting grouping summary information is returned to said user side.
Join the table inquiry unit according to the MONGODB burst of another aspect of the invention, said query unit obtains through Mongos that the data recording sign is the data message of one of each said target data record sign in the specific data table in each burst of said MONGODB.
MONGODB burst according to another aspect of the invention joins the table inquiry unit, and said query unit divides into groups to gather to the data message that is obtained based on said ephemeral data table through MAPREDUCE.
Compared with prior art, the present invention can have the following advantages.
The present invention can realize that efficient couplet table divides group polling between many MONGODB servers.
Pass through in one embodiment of the invention in the process that between many MONGODB servers, joins table branch group polling; Set up an ephemeral data table; To gather the data recording that belongs to each designated packet that is obtained through inquiry and be stored in this ephemeral data table, can improve couplet table grouping inquiry velocity between many MONGODB servers.
The present invention gathers based on above-mentioned ephemeral data table through MAPREDUCE, can reduce research staff's workload, increases work efficiency.
Other features and advantages of the present invention will be set forth in instructions subsequently, and, partly from instructions, become obvious, perhaps understand through embodiment of the present invention.The object of the invention can be realized through the structure that in instructions, claims and accompanying drawing, is particularly pointed out and obtained with other advantages.
Description of drawings
Accompanying drawing is used to provide further understanding of the present invention, and constitutes the part of instructions, is used to explain the present invention jointly with embodiments of the invention, is not construed as limiting the invention.In the accompanying drawings:
Fig. 1 is the example of some records in the ad data table;
Fig. 2 is the MONGODB burst couplet table querying method schematic flow sheet according to first embodiment;
Fig. 3 is the example of coming the data query record identification according to first embodiment of the invention based on group id orgid;
Fig. 4 is to the example screenshot according to the ephemeral data table tempDB content of first embodiment of the invention;
Fig. 5 is the configuration diagram according to the MONGODB burst couplet table inquiry unit of second embodiment of the invention.
Embodiment
Below will combine accompanying drawing and embodiment to specify embodiment of the present invention, how the application technology means solve technical matters to the present invention whereby, and the implementation procedure of reaching technique effect can make much of and implement according to this.Need to prove that only otherwise constitute conflict, each embodiment among the present invention and each characteristic among each embodiment can mutually combine, formed technical scheme is all within protection scope of the present invention.
In addition; Can in computer system, carry out in the step shown in the process flow diagram of accompanying drawing such as a set of computer-executable instructions, and, though logical order has been shown in process flow diagram; But in some cases, can carry out step shown or that describe with the order that is different from here.
First embodiment
Present embodiment provides a kind of MONGODB burst couplet table querying method that table divides group polling that under the data-base cluster environment that has disposed burst (SHARDING), joins.
For the ease of explanation, be provided with one in the data-base cluster of present embodiment and be used for the ad data table of stores advertisements information, and the packet map table that is used for the corresponding relation of stores advertisements information and advertising message grouping.The record of ad data table comprises adid field and date field etc.Wherein, The adid field is used for the advertisement putting that identifying user is created; A record in the ad data table comprises adid field, Advertisement arrangement, commit condition (start, delete, hang up), advertisement location (rendering to which region, which customer group, which industry) etc.In the ad data table, do not require record of adid unique identification, many records can have identical adid.Fig. 1 shows the example of some records in the ad data table.The corresponding relation that the packet map table comes stores advertisements information and advertising message to divide into groups through related adid field and orgid field, wherein argid is the sign of each grouping.
Need to prove that inventor of the present invention is also noted that when in storage time during field, prior art generally is the function that stabs through the rise time of various language, directly the timestamp that generates is deposited among the MONODB, and the time is not set to integer.Yet; In the present embodiment; Overcome technological prejudice in the ad data table and adopted the timestamp of integer data type, thereby thereby handling like this having makes unique conveniently foundation of time data of each record inquire about, conveniently sort, make things convenient for the data comparison behind the index and/or make it possible to convert the timestamp of this integer to time dimension convenient search arbitrarily as far as possible.For example, can become simple so that the date adopts integer to come express time to stab through following code.
Specify the process that advertising record is divided group polling of carrying out in this case below in conjunction with Fig. 2.
Fig. 2 illustrates the MONGODB burst couplet table querying method schematic flow sheet according to present embodiment.
In this process flow diagram, the user hopes to check all the advertisement summary information under certain grouping of 2011-11-1 to 2011-11-30 day.In other words, the user hopes to see is to belong to certain advertising message down of dividing into groups in the ad data table of all bursts of MONGDB.Because each ad data table distributed earth is stored in each server, the data result that therefore can't as relevant database, want through the simple operation associated user of obtaining.Below specify the implementation procedure of present embodiment.
Step S210 confirms querying condition.
Querying condition is used for inquiring about in the specific data table of all bursts of MONGDB and designated packet corresponding packet summary information.A grouping can be specified, also a plurality of groupings can be specified.
Usually, can ask to confirm querying condition through the user that the reception user side is sent.Can receive user's request of sending through network from user sides such as browsers.More specifically, the user can be in browser send user's request with modes such as selection, click and/or inputs, and the equipment such as Website server, service server that are in the backstage receive this user's request and carry out subsequent treatment.
For example; The user can send user request through browser; Be used for checking 2011-11-1 to 2011-11-30 between day all burst packet number of MONGDB be all the advertisement summary information under 1 the grouping, wherein advertisement summary information can be through obtaining in the ad data table as the example of specific data table.
In addition, user request can also be used for inquiring about in the specific data table of all bursts of MONGDB corresponding with designated packet and satisfy the data of pre-conditioned (for example, in the certain hour section and/or belong in a certain region etc.).
Need to prove that user's request of sending through user side reception user is an example,
Step S220 confirms that the data recording that belongs to arbitrary grouping in the said designated packet in the specific data table identifies, and identifies as target data record.
Can carry out the processing of this step based on the contingency table of incidence relation between the sign of data recording sign of having stored the specific data table and designated packet.With Fig. 3 is example, and Fig. 3 shows when orgid=1, comes the example of data query record identification according to group number (group id) orgid.
Need to prove; Fig. 3 is merely among the inquiry MONGDB in the specific data table in all bursts the example with the corresponding data of dividing into groups; This is just simple for what explain; This enforcement is equally applicable to the situation of a plurality of groupings, as long as in step 120, determine the data recording sign that belongs in a plurality of groups arbitrary group.
Step S230 obtains the data message that the sign of data recording in the specific data table in each burst of MONGODB is one of above-mentioned each target data record sign.
Can be to each target data record sign, inquire about the data message in the specific data table of each burst of MONGDB one by one.For example, can utilize following code to come to carry out the data message below certain adid in the ad data table of all bursts of branch group polling by the sky.
In this moment data message that obtained, comprise the incidence relation of adid and orgid, do not carried out the grouping summary information after grouping gathers according to orgid but be that the user is needed.If the data message that will be obtained this moment just returns to the user without dividing into groups to gather, then the user possibly see rambling data message, therefore the user is had little significance.
In addition, the data recording sign is the data message of one of above-mentioned each target data record sign in the specific data table in each burst of MONGODB to obtain can to carry out this step through Mongos.
In addition; When user request is to be used for inquiring about in the specific data table of all bursts of MONGDB corresponding with designated packet and when satisfying pre-conditioned packetized digital information, in this step, obtain in the specific data table of each burst among the said MONGODB data recording sign and be each data recording of above-mentioned target and one of identify and satisfy pre-conditioned data message.
Step S240, with the data information memory of being obtained among the step S230 in an ephemeral data table.
If utilize program directly the data message that is obtained among the step S230 to be carried out aggregation process, then when data volume is very big, with taking a large amount of processing resources, and handling duration.In the present embodiment, creatively proposed the design of the data information memory of being obtained among the step S230 in an ephemeral data table reduced calculated amount and handling duration widely, reduced research staff's program code and write workload.
For example, in the time of in will leaving ephemeral data table tempDB in, can see data message through following code easily to all each data recording sign adid through the data message that above-mentioned code obtained:
Fig. 4 is the example that ephemeral data table tempDB content is carried out sectional drawing.
Step S250 divides into groups to gather to the data message that is obtained among the step S230 based on the ephemeral data table among the step S240, obtains the summary information of dividing into groups.
The data storage of in step S230, being obtained can wait through for example MAPREDUCE easily the data in the ephemeral data table are gathered after an ephemeral data table, obtains the summary information of dividing into groups.
When this grouping summary information is when answering the user to obtain through user side requests such as browsers, can also easily the grouping summary information be returned to user side.
Second embodiment
Present embodiment provides a kind of MONGODB burst couplet table inquiry unit.Fig. 5 shows the structural representation of this device.
MONGODB burst couplet table inquiry unit according to present embodiment comprises definite unit 51, query unit 52 and temporary table administrative unit 53.Wherein, confirm that the unit carries out and the corresponding operation of step S210 during first implements, step S220, S230 and the corresponding operation of S250 in query unit execution and first enforcement.Explanation about step S210 to S250 among first embodiment all is applicable to present embodiment, repeats no more at this.
In addition, when the user who sends based on the user side that receives through network asks to confirm querying condition, also comprise communication unit 54 according to the MONGODB burst couplet table inquiry unit of present embodiment.The user that the user side that this communication unit 54 receives through network is sent asks to confirm querying condition, and after query unit 52 obtains dividing into groups summary information, resulting grouping summary information is returned to said user side.
Though the embodiment that the present invention disclosed as above, the embodiment that described content just adopts for the ease of understanding the present invention is not in order to limit the present invention.Technician under any the present invention in the technical field; Under the prerequisite of spirit that does not break away from the present invention and disclosed and scope; Can do any modification and variation what implement in form and on the details; But scope of patent protection of the present invention still must be as the criterion with the scope that appending claims was defined.
Claims (10)
1. a MONGODB burst joins the table querying method, it is characterized in that, comprising:
Confirm querying condition, said querying condition is used for inquiring about the specific data table and designated packet corresponding packet summary information of all bursts of MONGDB;
Confirm to belong in the said specific data table data recording sign of arbitrary grouping in the said designated packet, identify as target data record;
Obtain the data message that the sign of data recording in the specific data table in each burst of said MONGODB is one of each said target data record sign;
With the data information memory of being obtained in an ephemeral data table;
Based on said ephemeral data table the data message that is obtained is divided into groups to gather, obtain the summary information of dividing into groups.
2. method according to claim 1 is characterized in that,
The user who sends based on the user side that receives through network asks to confirm querying condition;
Resulting grouping summary information is returned to said user side.
3. method according to claim 1 is characterized in that,
Obtain the data message that the sign of data recording in the specific data table in each burst of said MONGODB is one of each said target data record sign through Mongos.
4. according to each described method in the claim 1 to 3, it is characterized in that,
The data message that is obtained is divided into groups to gather based on said ephemeral data table through MAPREDUCE.
5. according to each described method in the claim 1 to 3, it is characterized in that,
Said querying condition is used for inquiring about in the specific data table of all bursts of MONGDB corresponding with designated packet and satisfy pre-conditioned grouping summary information;
When data recording sign is the data message of one of each said target data record sign in the specific data table in obtaining each burst of said MONGODB, obtain that the data recording sign is one of each said target data record sign and satisfies said pre-conditioned data message in the specific data table in each burst of said MONGODB.
6. according to each described method in the claim 1 to 3, it is characterized in that,
Contingency table based on incidence relation between the sign of data recording sign of having stored said specific data table and said designated packet; Confirm to belong in the said specific data table data recording sign of arbitrary grouping in the said designated packet, identify as target data record.
7. a MONGODB burst joins the table inquiry unit, it is characterized in that, comprises definite unit, query unit and temporary table administrative unit, wherein,
Said definite querying condition, said querying condition are used for inquiring about in all burst specific data tables of MONGDB and designated packet corresponding packet summary information;
Said query unit confirms to belong in the said specific data table data recording sign of arbitrary grouping in the said designated packet; As target data record sign, obtain that the data recording sign is the data message of one of each said target data record sign in the specific data table in each burst of said MONGODB;
Said temporary table administrative unit with the data information memory of being obtained in an ephemeral data table;
Said query unit, also divides into groups to gather to the data message that is obtained based on said ephemeral data table with after the data information memory of being obtained is in an ephemeral data table in said temporary control and education unit, obtains the summary information of dividing into groups.
8. device according to claim 7 is characterized in that, also comprises communication unit, wherein,
The user that the user side that said communication unit receives through network is sent asks to confirm querying condition, and after said query unit obtains dividing into groups summary information, resulting grouping summary information is returned to said user side.
9. device according to claim 7 is characterized in that,
Said query unit is obtained the data message that the sign of data recording in the specific data table in each burst of said MONGODB is one of each said target data record sign through Mongos.
10. according to each described device in the claim 7 to 9, it is characterized in that,
Said query unit divides into groups to gather to the data message that is obtained based on said ephemeral data table through MAPREDUCE.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012100121242A CN102609464A (en) | 2012-01-16 | 2012-01-16 | Method and device for associative table query of MONGODB shards |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012100121242A CN102609464A (en) | 2012-01-16 | 2012-01-16 | Method and device for associative table query of MONGODB shards |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102609464A true CN102609464A (en) | 2012-07-25 |
Family
ID=46526836
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2012100121242A Pending CN102609464A (en) | 2012-01-16 | 2012-01-16 | Method and device for associative table query of MONGODB shards |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102609464A (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102937980A (en) * | 2012-10-18 | 2013-02-20 | 亿赞普(北京)科技有限公司 | Method for inquiring data of cluster database |
| CN103020227A (en) * | 2012-12-13 | 2013-04-03 | 中国银行股份有限公司 | Data processing method and system in computer equipment |
| CN103207919A (en) * | 2013-04-26 | 2013-07-17 | 北京亿赞普网络技术有限公司 | Method and device for quickly inquiring and calculating MangoDB cluster |
| CN104239511A (en) * | 2014-09-15 | 2014-12-24 | 西安交通大学 | File system in user space implementation method oriented to MongoDB |
| CN104298742A (en) * | 2014-10-09 | 2015-01-21 | 国电南瑞科技股份有限公司 | Data fragmentation method for fragmentation real-time database of energy management system |
| CN104660442A (en) * | 2013-11-25 | 2015-05-27 | 中国移动通信集团福建有限公司 | Service provisioning method and system based on MongoDB |
| CN104794244A (en) * | 2015-05-13 | 2015-07-22 | 南京大学 | Method and device for realizing graph conversion based on MongoDB |
| CN106776837A (en) * | 2016-11-25 | 2017-05-31 | 国云科技股份有限公司 | A kind of method of the security real-time deal association analysis based on MongoDB |
| CN108280032A (en) * | 2017-01-06 | 2018-07-13 | 慧荣科技股份有限公司 | Data storage device and flash memory control method |
| CN110083602A (en) * | 2019-04-15 | 2019-08-02 | 北京三快在线科技有限公司 | A kind of method and device of data storage and data processing based on hive table |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1647901A1 (en) * | 2004-10-15 | 2006-04-19 | Samsung Electronics Co.,Ltd. | System and method for collecting network performance data and storing it in a single relational table. |
| CN101685449A (en) * | 2008-09-26 | 2010-03-31 | 国际商业机器公司 | Method and system for connecting tables in a plurality of heterogeneous distributed databases |
-
2012
- 2012-01-16 CN CN2012100121242A patent/CN102609464A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1647901A1 (en) * | 2004-10-15 | 2006-04-19 | Samsung Electronics Co.,Ltd. | System and method for collecting network performance data and storing it in a single relational table. |
| CN101685449A (en) * | 2008-09-26 | 2010-03-31 | 国际商业机器公司 | Method and system for connecting tables in a plurality of heterogeneous distributed databases |
Non-Patent Citations (1)
| Title |
|---|
| 蔡柳青: "基于MongoDB的云监控设计与应用", 《中国优秀硕士学位论文全文数据库》 * |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102937980B (en) * | 2012-10-18 | 2016-04-13 | 亿赞普(北京)科技有限公司 | A kind of Cluster Database data enquire method |
| CN102937980A (en) * | 2012-10-18 | 2013-02-20 | 亿赞普(北京)科技有限公司 | Method for inquiring data of cluster database |
| CN103020227A (en) * | 2012-12-13 | 2013-04-03 | 中国银行股份有限公司 | Data processing method and system in computer equipment |
| CN103020227B (en) * | 2012-12-13 | 2016-06-29 | 中国银行股份有限公司 | Data processing method in computer equipment and system |
| CN103207919A (en) * | 2013-04-26 | 2013-07-17 | 北京亿赞普网络技术有限公司 | Method and device for quickly inquiring and calculating MangoDB cluster |
| CN104660442A (en) * | 2013-11-25 | 2015-05-27 | 中国移动通信集团福建有限公司 | Service provisioning method and system based on MongoDB |
| CN104239511A (en) * | 2014-09-15 | 2014-12-24 | 西安交通大学 | File system in user space implementation method oriented to MongoDB |
| CN104239511B (en) * | 2014-09-15 | 2016-03-30 | 西安交通大学 | A kind of user's space file system implementation method towards MongoDB |
| CN104298742A (en) * | 2014-10-09 | 2015-01-21 | 国电南瑞科技股份有限公司 | Data fragmentation method for fragmentation real-time database of energy management system |
| CN104794244A (en) * | 2015-05-13 | 2015-07-22 | 南京大学 | Method and device for realizing graph conversion based on MongoDB |
| CN104794244B (en) * | 2015-05-13 | 2018-02-16 | 南京大学 | A kind of method and apparatus that figure conversion is realized based on MongoDB |
| CN106776837A (en) * | 2016-11-25 | 2017-05-31 | 国云科技股份有限公司 | A kind of method of the security real-time deal association analysis based on MongoDB |
| CN108280032A (en) * | 2017-01-06 | 2018-07-13 | 慧荣科技股份有限公司 | Data storage device and flash memory control method |
| CN110083602A (en) * | 2019-04-15 | 2019-08-02 | 北京三快在线科技有限公司 | A kind of method and device of data storage and data processing based on hive table |
| CN110083602B (en) * | 2019-04-15 | 2021-07-06 | 北京三快在线科技有限公司 | Method and device for data storage and data processing based on hive table |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102609464A (en) | Method and device for associative table query of MONGODB shards | |
| CN109947668B (en) | Method and device for storing data | |
| CN103703467B (en) | Method and apparatus for storing data | |
| JP6716727B2 (en) | Streaming data distributed processing method and apparatus | |
| CN105138592A (en) | Distributed framework-based log data storing and retrieving method | |
| CN104463472A (en) | Electronic government platform system | |
| CN113515545B (en) | Data query method, device, system, electronic equipment and storage medium | |
| CN110471900A (en) | Data processing method and terminal device | |
| US10860604B1 (en) | Scalable tracking for database udpates according to a secondary index | |
| CN110110006A (en) | Data managing method and Related product | |
| CN103207919A (en) | Method and device for quickly inquiring and calculating MangoDB cluster | |
| CN104298687B (en) | A kind of hash partition management method and device | |
| CN103838770A (en) | Logic data partition method and system | |
| CN111258978A (en) | Data storage method | |
| CN109614402A (en) | Multidimensional data query method and device | |
| CN109918425A (en) | A kind of method and system realized data and import non-relational database | |
| EP2778968B1 (en) | Mobile telecommunication device remote access to cloud-based or virtualized database systems | |
| CN104283975A (en) | File distribution method and device | |
| CN103246659A (en) | Method and device for key value data query | |
| CN105405070A (en) | Distributed memory power grid system construction method | |
| US10140347B2 (en) | Exposing data to query generating applications using usage profiles | |
| CN103034650B (en) | A kind of data handling system and method | |
| CN115423030A (en) | Equipment identification method and device | |
| CN109726219A (en) | The method and terminal device of data query | |
| US20200167357A1 (en) | Query enhancement system and method for constructing elastic field based on time delay |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20120725 |