CN108733724A - One kind is across the real-time connection method of heterogeneous data source and device - Google Patents
One kind is across the real-time connection method of heterogeneous data source and device Download PDFInfo
- Publication number
- CN108733724A CN108733724A CN201710271174.5A CN201710271174A CN108733724A CN 108733724 A CN108733724 A CN 108733724A CN 201710271174 A CN201710271174 A CN 201710271174A CN 108733724 A CN108733724 A CN 108733724A
- Authority
- CN
- China
- Prior art keywords
- data source
- inquiry request
- data
- connection
- inquiry
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention provides one kind across the real-time connection method of heterogeneous data source and device, wherein before the inquiry request for receiving user, establishes unified virtual view, when receiving the inquiry request of the user, this method executes following steps:Receive first inquiry request of the user to virtual view;The first inquiry request is parsed, and according to the first inquiry request structure after parsing to the second inquiry request of each data source;The second inquiry request is sent to each data source, query result associated with each data source is obtained according to default inquiry mode;Tables of data corresponding with each data source is generated according to acquired query result associated with each data source, and each tables of data splice according to default connecting method and spliced data are added to virtual view.It enables to user in analyzing and processing data through the invention, has masked the otherness between underlying database completely.
Description
Technical field
The present invention relates to field of computer technology, and in particular to one kind is across the real-time connection method of heterogeneous data source and device.
Background technology
It is convenient that the high speed development of information age is brought to us, but we must face another problem simultaneously:I
How will analyze and handle the data from different data sources, for example, some of which data source be relevant database, some
It is key assignments kv types database (Key-Value databases), some are text files, some then come from certain services.For
The data of different data sources, due to storage organization difference, for data processor, it is difficult to these different data sources
Data spliced.However, these information are transparent to user, make user's perception less than the presence of heterogeneous database, thus
Simplify the application method of user.Have become the critical problem that various storage systems are faced.
The related art that current industry uses includes following two methods:
1, prefix connection (Prefix join):Hierarchical relationship is established between table, is used between the table of father and son's level identical
" major key prefix ", by " record " with identical " major key prefix " in table it is orderly be stored in adjacent position, it is last direct suitable
Record in sequence traversal list, and done " internal chaining " according to " major key ".
2, the grand filtering connection (bloom filter Join) of cloth:" the grand filter condition of cloth " is established to the corresponding field of right table,
And " the grand filter condition of cloth " built up is sent to left-handed watch.Left-handed watch finds the data met the requirements according to " the grand filter condition of cloth ",
And the data-moving for the condition that meets is spliced to right table.
In realizing process of the present invention, inventor has found that at least there are the following problems in the prior art:
1, for prefix connection, this mode needs specific storage model and is set with the relevant schema of business
Meter, therefore this mode is not general enough.
2, for cloth grand filtering connection, this mode is more and more with data element, misjudgement " in set "
Probability is also increasing therewith.
In addition, although above two data connection approach supports inter-library connection, heterogeneous data source is not supported, and
It does not support concurrently to inquire.
Invention content
In view of this, the embodiment of the present invention provides one kind across the real-time connection method of heterogeneous data source and device, at analysis
When managing the data of different data sources, the difference of underlying database can be masked completely.
To achieve the above object, according to an aspect of the invention, there is provided one kind is across the real-time connection side of heterogeneous data source
Method, wherein before the inquiry request for receiving user, establish unified virtual view, looked into described in the user when receiving
When asking request, the method executes following steps:
Receive first inquiry request of the user to the virtual view;
First inquiry request is parsed, and is built to each data source according to first inquiry request after parsing
Second inquiry request;
Second inquiry request is sent to each data source, is obtained and each data source according to default inquiry mode
Associated query result;
It is generated and each data source according to the acquired query result associated with each data source
Corresponding tables of data, and each tables of data splice and add spliced data according to default connecting method
To the virtual view.
Optionally, described to include to each data source transmission second inquiry request:By concurrent mode, to each
Data source sends second inquiry request.
Optionally, the data source includes at least one of the following:Mysql databases, Redis databases,
HBase databases.
Optionally, the default inquiry mode includes at least one of the following:Left connection, right connection, full connection.
Optionally, the default connecting method includes at least one of the following:Hash connection, nested cycle connect
It connects, merge connection.
Optionally, when the default inquiry mode is left connection, the redundant data of right table is filtered in query process
Fall.
The embodiment of the present invention also provides one kind across the real-time attachment device of heterogeneous data source, wherein in the inquiry for receiving user
Before request, unified virtual view is established, when receiving the inquiry request of the user, described device includes:
Receiving module, for receiving first inquiry request of the user to the virtual view;
Parsing module is built for parsing first inquiry request, and according to first inquiry request after parsing
To the second inquiry request of each data source;
Enquiry module, for sending second inquiry request to each data source, according to default inquiry mode obtain with
The associated query result of each data source;
Concatenation module, for being generated according to the acquired query result associated with each data source and institute
The corresponding tables of data of each data source is stated, and splicing is carried out to each tables of data according to default connecting method and will be spliced
Data afterwards are added to the virtual view.
Optionally, described to include to each data source transmission second inquiry request:By concurrent mode, to each
Data source sends second inquiry request.
Optionally, the data source includes at least one of the following:Mysql databases, Redis databases,
HBase databases.
Optionally, the default inquiry mode includes at least one of the following:Left connection, right connection, full connection.
Optionally, the default connecting method includes at least one of the following:Hash connection, nested cycle connect
It connects, merge connection.
Optionally, if the default inquiry mode is left connection, by the redundant data mistake of right table in query process
It filters.
The embodiment of the present invention also provides a kind of terminal device connected in real time across heterogeneous data source, which is characterized in that including:
One or more processors;Storage device, for storing one or more programs, when one or more of programs are by described one
A or multiple processors execute so that one or more of processors are realized as provided by the invention real-time across heterogeneous data source
The method of connection.
The embodiment of the present invention provides a kind of computer-readable medium again, is stored thereon with computer program, which is characterized in that
It is realized as provided by the invention across the real-time connection method of heterogeneous data source when described program is executed by processor.
One embodiment in foregoing invention has the advantages that:Because being regarded using the virtual of virtual unification is established
Then the technological means of figure will be converted into the corresponding querying command of various data sources to the querying command of the virtual view, and
People's virtual view is added after obtaining query result, then by the query result of various data sources so that user is in analyzing processing
When data, the otherness between underlying database has been masked completely.
Further effect possessed by above-mentioned non-usual optional mode adds hereinafter in conjunction with specific implementation mode
With explanation.
Description of the drawings
To describe the technical solutions in the embodiments of the present invention more clearly, make required in being described below to embodiment
Attached drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, for
For those of ordinary skill in the art, without creative efforts, other are can also be obtained according to these attached drawings
Attached drawing.In the accompanying drawings:
Fig. 1 is the flow diagram according to the ... of the embodiment of the present invention across the real-time connection method of heterogeneous data source;
Fig. 2 is the structural schematic diagram according to the ... of the embodiment of the present invention across the real-time attachment device of heterogeneous data source;
Fig. 3 is adapted for the computer of the terminal device connected in real time across heterogeneous data source for realizing the embodiment of the present invention
The structural schematic diagram of system.
Specific implementation mode
It explains to the exemplary embodiment of the present invention below in conjunction with attached drawing, including the various of the embodiment of the present invention
Details should think them only exemplary to help understanding.Therefore, those of ordinary skill in the art should recognize
It arrives, various changes and modifications can be made to the embodiments described herein, without departing from scope and spirit of the present invention.Together
The description to known function and structure is omitted for clarity and conciseness in sample in following description.
Art technology technical staff knows, embodiments of the present invention can be implemented as a kind of system, device, equipment,
Method or computer program product.Therefore, the present invention can be with specific implementation is as follows, i.e.,:It is complete hardware, complete soft
The form that part (including firmware, resident software, microcode etc.) or hardware and software combine.
Herein, it is to be understood that in involved term:
Index:A kind of data structure of record is quickly positioned according to major key.
Left connection (left join):It is the query type in sql like language, i.e. Connection inquiring.Its full name is left outside connection
(left outer join), is one kind of outer connection.
Full connection (full join):It is the query type in sql like language, there is matching, matching is shown, while will be each
Unmatched data are matched with empty data line and are shown in table.
As shown in Figure 1, for according to the flow diagram across the real-time connection method of heterogeneous data source of the embodiment of the present invention.Its
In, before the inquiry request for receiving user, unified virtual view is established, when the inquiry request for receiving the user
When, the method executes following steps:
Step S101:Receive first inquiry request of the user to the virtual view;
Step S102:First inquiry request is parsed, and is built to each according to first inquiry request after parsing
Second inquiry request of a data source;
Step S103:Send second inquiry request to each data source, according to default inquiry mode obtain with it is described
Each associated query result of data source;
Step S104:According to the acquired query result associated with each data source generate with it is described each
A corresponding tables of data of data source, and according to default connecting method to each tables of data carry out splicing and will be spliced
Data are added to the virtual view.
Optionally, described to include to each data source transmission second inquiry request:By concurrent mode, to each
Data source sends second inquiry request.
Optionally, the data source includes at least one of the following:Mysql databases, Redis databases,
HBase databases.
Optionally, the default inquiry mode includes at least one of the following:Left connection, right connection, full connection.
Optionally, the default connecting method includes at least one of the following:Hash connection, nested cycle connect
It connects, merge connection.
Optionally, when the default inquiry mode is left connection, the redundant data of right table is filtered in query process
Fall.
Embodiment
The present invention is specifically described with reference to a specific embodiment, however, it should be noted that the specific implementation
Example merely to preferably description the present invention, do not constitute improper limitations of the present invention.
First, the unified virtual view of an integration different data sources is established, which uses for unified receive
Each inquiry request at family.It is noted that due to using special data storage organization as unified void in internal system
Quasi- view, the data of various data sources are converted to unified virtual view data using data source adapter, to externally carry
For unified query grammar.
Then, according to user to the inquiry request of data, using the data field source-information of the virtual view, to user
Inquiry request parsed, the inquiry request to each data source is built with this.
Corresponding inquiry request is sent to each data source according to concurrent fashion, and phase is obtained according to default inquiry mode
Answer the query result of each data source.It is noted that each data source is inquired according to concurrent fashion, it can be effective
The whole inquiry velocity to disparate databases is improved, to reduce the inquiry stand-by period of early period.
In addition, default inquiry mode can be left connection, right connection and full connection.Specifically, if carrying out a left side
When connection, toward turning right, table quite a few data can't be used.Therefore it needs the partial redundance number in query process
According to directly filtering out, to reduce query time.
Finally, the query result of each data source of acquisition is stored in tables of data corresponding with each data source, and
Each tables of data is spliced according to default connecting method according to the query demand of user and is added to spliced data
The virtual view.
It is to be spliced each query result by Hash connection type in one embodiment of the invention.Specifically, make
The process spliced with Hash connection includes the following steps:
Step S201:The link field of right table and left-handed watch is obtained, hash indexes are established to right table row number according to link field;
Step S202:Take out the untreated record of left-handed watch one;
Step S203:The value of link field in being recorded using this calculates cryptographic Hash;
Step S204:Right table, which is searched, according to right table index corresponds to row record;
Step S205:If not finding corresponding record, return to step S202 in right table;
Step S206:The data of right table are added to left-handed watch.
Step S207:Until all data processings of left-handed watch terminate.
Step S208:If it is the inquiry carried out in the way of connecting entirely, and right table data are still promising is connected to a left side
The data of table create new record in left-handed watch, right table data supplementing are got on.
It is illustrated in figure 2 the structural schematic diagram according to the ... of the embodiment of the present invention across the real-time attachment device of heterogeneous data source,
In,
Before the inquiry request for receiving user, unified virtual view is established, is looked into described in the user when receiving
When asking request, described device includes:
Receiving module 21, for receiving first inquiry request of the user to the virtual view;
Parsing module 22, for parsing first inquiry request, and according to the first inquiry request structure after parsing
Build the second inquiry request to each data source;
Enquiry module 23 is obtained for sending second inquiry request to each data source according to default inquiry mode
Query result associated with each data source;
Concatenation module 24, for according to the acquired query result associated with each data source generate with
The corresponding tables of data of each data source, and splicing is carried out to each tables of data according to default connecting method and will be spelled
Data after connecing are added to the virtual view.
Optionally, described to include to each data source transmission second inquiry request:By concurrent mode, to each
Data source sends second inquiry request.
Optionally, the data source includes at least one of the following:Mysql databases, Redis databases,
HBase databases.
Optionally, the default inquiry mode includes at least one of the following:Left connection, right connection, full connection.
Optionally, the default connecting method includes at least one of the following:Hash connection, nested cycle connect
It connects, merge connection.
Optionally, if the default inquiry mode is left connection, by the redundant data mistake of right table in query process
It filters.
Due to it is provided by the invention across the real-time attachment device of heterogeneous data source be the corresponding device of the above method, therefore not herein
It repeats.
Below with reference to Fig. 3, it illustrates suitable for for realize the embodiment of the present invention across the real-time connection side of heterogeneous data source
The structural schematic diagram of the computer system 300 of the terminal device of method.Terminal device shown in Fig. 3 is only an example, is not answered
Any restrictions are brought to the function and use scope of the embodiment of the present invention.
As shown in figure 3, computer system 300 includes central processing unit (CPU) 301, it can be read-only according to being stored in
Program in memory (ROM) 302 or be loaded into the program in random access storage device (RAM) 303 from storage section 308 and
Execute various actions appropriate and processing.In RAM 303, also it is stored with system 300 and operates required various programs and data.
CPU 301, ROM 302 and RAM 303 are connected with each other by bus 304.Input/output (I/O) interface 305 is also connected to always
Line 304.
It is connected to I/O interfaces 305 with lower component:Importation 306 including keyboard, mouse etc.;It is penetrated including such as cathode
The output par, c 307 of spool (CRT), liquid crystal display (LCD) etc. and loud speaker etc.;Storage section 308 including hard disk etc.;
And the communications portion 309 of the network interface card including LAN card, modem etc..Communications portion 309 via such as because
The network of spy's net executes communication process.Driver 310 is also according to needing to be connected to I/O interfaces 305.Detachable media 311, such as
Disk, CD, magneto-optic disk, semiconductor memory etc. are mounted on driver 310, as needed in order to be read from thereon
Computer program be mounted into storage section 308 as needed.
Particularly, it according to embodiment disclosed by the invention, may be implemented as counting above with reference to the process of flow chart description
Calculation machine software program.For example, embodiment disclosed by the invention includes a kind of computer program product comprising be carried on computer
Computer program on readable medium, the computer program include the program code for executing method shown in FIG. 1.In this way
Embodiment in, which can be downloaded and installed by communications portion 309 from network, and/or from detachable
Medium 311 is mounted.When the computer program is executed by central processing unit (CPU) 301, executes and limited in the system of the present invention
Fixed above-mentioned function.
It should be noted that computer-readable medium shown in the present invention can be computer-readable signal media or meter
Calculation machine readable storage medium storing program for executing either the two arbitrarily combines.Computer readable storage medium can be for example but not limited to
System, device or the device of electricity, magnetic, optical, electromagnetic, infrared ray or semiconductor, or the arbitrary above combination.It is computer-readable
The more specific example of storage medium can include but is not limited to:Electrical connection, portable computing with one or more conducting wires
Machine disk, hard disk, random access storage device (RAM), read-only memory (ROM), erasable programmable read only memory (EPROM
Or flash memory), optical fiber, portable compact disc read-only memory (CD-ROM), light storage device, magnetic memory device or above-mentioned
Any appropriate combination.In the present invention, computer readable storage medium can be any include or storage program it is tangible
Medium, the program can be commanded the either device use or in connection of execution system, device.And in the present invention,
Computer-readable signal media may include in a base band or as the data-signal that a carrier wave part is propagated, wherein carrying
Computer-readable program code.Diversified forms may be used in the data-signal of this propagation, and including but not limited to electromagnetism is believed
Number, optical signal or above-mentioned any appropriate combination.Computer-readable signal media can also be computer-readable storage medium
Any computer-readable medium other than matter, the computer-readable medium can be sent, propagated or transmitted for being held by instruction
Row system, device either device use or program in connection.The program code for including on computer-readable medium
It can transmit with any suitable medium, including but not limited to:Wirelessly, electric wire, optical cable, RF etc. or above-mentioned arbitrary conjunction
Suitable combination.
Flow chart in attached drawing and block diagram, it is illustrated that according to the system of various embodiments of the invention, method and computer journey
The architecture, function and operation in the cards of sequence product.In this regard, each box in flowchart or block diagram can generation
A part for a part for one module, program segment, or code of table, above-mentioned module, program segment, or code includes one or more
Executable instruction for implementing the specified logical function.It should also be noted that in some implementations as replacements, institute in box
The function of mark can also occur in a different order than that indicated in the drawings.For example, two boxes succeedingly indicated are practical
On can be basically executed in parallel, they can also be executed in the opposite order sometimes, this is depended on the functions involved.Also it wants
It is noted that the combination of each box in block diagram or flow chart and the box in block diagram or flow chart, can use and execute rule
The dedicated hardware based systems of fixed functions or operations is realized, or can use the group of specialized hardware and computer instruction
It closes to realize.
Being described in module involved in the embodiment of the present invention can be realized by way of software, can also be by hard
The mode of part is realized.Described module can also be arranged in the processor, for example, can be described as:A kind of processor packet
Include receiving module 21, parsing module 22, enquiry module 23 and concatenation module 24.Wherein, the title of these units is in certain situation
Under do not constitute restriction to the unit itself.
As on the other hand, the present invention also provides a kind of computer-readable medium, which can be
Included in equipment described in above-described embodiment;Can also be individualism, and without be incorporated the equipment in.Above-mentioned calculating
Machine readable medium carries one or more program, when said one or multiple programs are executed by the equipment, makes
Obtaining the equipment includes:
Step S101:Receive first inquiry request of the user to the virtual view;
Step S102:First inquiry request is parsed, and is built to each according to first inquiry request after parsing
Second inquiry request of a data source;
Step S103:Send second inquiry request to each data source, according to default inquiry mode obtain with it is described
Each associated query result of data source;
Step S104:According to the acquired query result associated with each data source generate with it is described each
A corresponding tables of data of data source, and according to default connecting method to each tables of data carry out splicing and will be spliced
Data are added to the virtual view.
Then technical solution according to the ... of the embodiment of the present invention will because using the technological means for establishing unified virtual view
The corresponding querying command of various data sources is converted into the querying command of the virtual view, and after obtaining query result, then
The query result of various data sources is added into the virtual view so that user masks completely in analyzing and processing data
Otherness between underlying database.
In addition, if when carrying out left connection, toward turning right, table quite a few data can't be used.Therefore it needs
The partial redundance data are directly filtered out in query process, to reduce redundant data, improve memory and the utilization rate of CPU,
Effectively reduce query time.
Above-mentioned specific implementation mode, does not constitute limiting the scope of the invention.Those skilled in the art should be bright
It is white, design requirement and other factors are depended on, various modifications, combination, sub-portfolio and replacement can occur.It is any
Modifications, equivalent substitutions and improvements made by within the spirit and principles in the present invention etc., should be included in the scope of the present invention
Within.
Claims (14)
1. a kind of method connected in real time across heterogeneous data source, which is characterized in that before the inquiry request for receiving user, establish
Unified virtual view, when receiving the inquiry request of the user, the method executes following steps:
Receive first inquiry request of the user to the virtual view;
First inquiry request is parsed, and is built to the second of each data source according to first inquiry request after parsing
Inquiry request;
Second inquiry request is sent to each data source, is obtained according to default inquiry mode related to each data source
The query result of connection;
It is generated according to the acquired query result associated with each data source opposite with each data source
The tables of data answered, and each tables of data splice according to default connecting method and spliced data are added to institute
State virtual view.
2. connection method according to claim 1, which is characterized in that described to send second inquiry to each data source
Request includes:By concurrent mode, second inquiry request is sent to each data source.
3. connection method according to claim 1, which is characterized in that the data source includes at least one in the following terms
?:Mysql databases, Redis databases, HBase databases.
4. connection method according to claim 1, which is characterized in that the default inquiry mode includes in the following terms
At least one of:Left connection, right connection, full connection.
5. connection method according to claim 1, which is characterized in that the default connecting method includes in the following terms
At least one of:Hash connection, nesting is connected by circulation, merging connects.
6. connection method according to claim 4, which is characterized in that when the default inquiry mode is left connection,
The redundant data of right table is filtered out in query process.
7. one kind is across the real-time attachment device of heterogeneous data source, which is characterized in that before the inquiry request for receiving user, establish system
One virtual view, when receiving the inquiry request of the user, described device includes:
Receiving module, for receiving first inquiry request of the user to the virtual view;
Parsing module is built for parsing first inquiry request, and according to first inquiry request after parsing to each
Second inquiry request of a data source;
Enquiry module, for sending second inquiry request to each data source, according to default inquiry mode obtain with it is described
Each associated query result of data source;
Concatenation module, for according to the acquired query result associated with each data source generate with it is described each
A corresponding tables of data of data source, and according to default connecting method to each tables of data carry out splicing and will be spliced
Data are added to the virtual view.
8. attachment device according to claim 7, which is characterized in that described to send second inquiry to each data source
Request includes:By concurrent mode, second inquiry request is sent to each data source.
9. attachment device according to claim 7, which is characterized in that the data source includes at least one in the following terms
?:Mysql databases, Redis databases, HBase databases.
10. attachment device according to claim 7, which is characterized in that the default inquiry mode includes in the following terms
At least one of:Left connection, right connection, full connection.
11. attachment device according to claim 7, which is characterized in that the default connecting method includes in the following terms
At least one of:Hash connection, nesting is connected by circulation, merging connects.
12. attachment device according to claim 10, which is characterized in that if the default inquiry mode is left connection,
Then the redundant data of right table is filtered out in query process.
13. a kind of terminal device connected in real time across heterogeneous data source, which is characterized in that including:
One or more processors;
Storage device, for storing one or more programs,
When one or more of programs are executed by one or more of processors so that one or more of processors are real
The now method as described in any in claim 1-6.
14. a kind of computer-readable medium, is stored thereon with computer program, which is characterized in that described program is held by processor
The method as described in any in claim 1-6 is realized when row.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710271174.5A CN108733724A (en) | 2017-04-24 | 2017-04-24 | One kind is across the real-time connection method of heterogeneous data source and device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710271174.5A CN108733724A (en) | 2017-04-24 | 2017-04-24 | One kind is across the real-time connection method of heterogeneous data source and device |
Publications (1)
Publication Number | Publication Date |
---|---|
CN108733724A true CN108733724A (en) | 2018-11-02 |
Family
ID=63933978
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710271174.5A Pending CN108733724A (en) | 2017-04-24 | 2017-04-24 | One kind is across the real-time connection method of heterogeneous data source and device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN108733724A (en) |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109508338A (en) * | 2018-11-23 | 2019-03-22 | 成都四方伟业软件股份有限公司 | Data sheet correlating method and device |
CN109739855A (en) * | 2018-12-28 | 2019-05-10 | 第四范式(北京)技术有限公司 | Realize the method and system of tables of data splicing and automatic training machine learning model |
WO2020151209A1 (en) * | 2019-01-23 | 2020-07-30 | 集奥聚合(北京)人工智能科技有限公司 | Multi-dimensional data variable-based data interaction method and platform |
CN111767328A (en) * | 2020-06-04 | 2020-10-13 | 北京思特奇信息技术股份有限公司 | Method for inquiring data through interface |
CN112115114A (en) * | 2020-09-25 | 2020-12-22 | 北京百度网讯科技有限公司 | Log processing method, device, equipment and storage medium |
CN113268517A (en) * | 2020-02-14 | 2021-08-17 | 中电长城网际系统应用有限公司 | Data analysis method and device, electronic equipment and readable medium |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104657426A (en) * | 2015-01-22 | 2015-05-27 | 江苏瑞中数据股份有限公司 | Unified-view-based row and column hybrid data storage model establishment method |
CN104932895A (en) * | 2015-06-26 | 2015-09-23 | 南京邮电大学 | Middleware based on SOA (Service-Oriented Architecture) and information publishing method thereof |
US20150310067A1 (en) * | 2014-04-28 | 2015-10-29 | Red Hat, Inc. | Method and system for providing security in a data federation system |
US20160283511A1 (en) * | 2015-03-24 | 2016-09-29 | International Business Machines Corporation | Systems and methods for query evaluation over distributed linked data stores |
-
2017
- 2017-04-24 CN CN201710271174.5A patent/CN108733724A/en active Pending
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150310067A1 (en) * | 2014-04-28 | 2015-10-29 | Red Hat, Inc. | Method and system for providing security in a data federation system |
CN104657426A (en) * | 2015-01-22 | 2015-05-27 | 江苏瑞中数据股份有限公司 | Unified-view-based row and column hybrid data storage model establishment method |
US20160283511A1 (en) * | 2015-03-24 | 2016-09-29 | International Business Machines Corporation | Systems and methods for query evaluation over distributed linked data stores |
CN104932895A (en) * | 2015-06-26 | 2015-09-23 | 南京邮电大学 | Middleware based on SOA (Service-Oriented Architecture) and information publishing method thereof |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109508338A (en) * | 2018-11-23 | 2019-03-22 | 成都四方伟业软件股份有限公司 | Data sheet correlating method and device |
CN109739855A (en) * | 2018-12-28 | 2019-05-10 | 第四范式(北京)技术有限公司 | Realize the method and system of tables of data splicing and automatic training machine learning model |
WO2020151209A1 (en) * | 2019-01-23 | 2020-07-30 | 集奥聚合(北京)人工智能科技有限公司 | Multi-dimensional data variable-based data interaction method and platform |
CN113268517A (en) * | 2020-02-14 | 2021-08-17 | 中电长城网际系统应用有限公司 | Data analysis method and device, electronic equipment and readable medium |
CN113268517B (en) * | 2020-02-14 | 2024-04-02 | 中电长城网际系统应用有限公司 | Data analysis method and device, electronic equipment and readable medium |
CN111767328A (en) * | 2020-06-04 | 2020-10-13 | 北京思特奇信息技术股份有限公司 | Method for inquiring data through interface |
CN112115114A (en) * | 2020-09-25 | 2020-12-22 | 北京百度网讯科技有限公司 | Log processing method, device, equipment and storage medium |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN108733724A (en) | One kind is across the real-time connection method of heterogeneous data source and device | |
CN110032575A (en) | Data query method, apparatus, equipment and storage medium | |
CN108932313B (en) | Data processing method and device, electronic equipment and storage medium | |
CN110019213A (en) | Data managing method, device, electronic equipment and storage medium | |
US9442964B2 (en) | Conforming data structure instances to schema versions | |
CN109413127A (en) | A kind of method of data synchronization and device | |
CN111813804B (en) | Data query method and device, electronic equipment and storage medium | |
CN110427415A (en) | Knowledge share method, device, system media and electronic equipment | |
CN109524070A (en) | Data processing method and device, electronic equipment, storage medium | |
CN111666293A (en) | Database access method and device | |
CN111061680A (en) | Data retrieval method and device | |
US20140007038A1 (en) | Social project management system and marketplace | |
CN109597810A (en) | A kind of task cutting method, device, medium and electronic equipment | |
US20230099501A1 (en) | Masking shard operations in distributed database systems | |
CN111338944A (en) | Remote Procedure Call (RPC) interface test method, device, medium and equipment | |
US11704327B2 (en) | Querying distributed databases | |
CN113704291A (en) | Data query method and device, storage medium and electronic equipment | |
CN109344152A (en) | Data processing method, device, electronic equipment and storage medium | |
CN113760961A (en) | Data query method and device | |
CN110019331A (en) | A kind of method and apparatus of the inquiry database based on structured query language | |
CN112395302A (en) | SQL instruction execution method and device, electronic equipment and computer readable medium | |
US20230153300A1 (en) | Building cross table index in relational database | |
CN107832347A (en) | Method of Data with Adding Windows, system and electronic equipment | |
CN113760969A (en) | Data query method and device based on elastic search | |
CN113377808A (en) | SQL optimization method and device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181102 |
|
RJ01 | Rejection of invention patent application after publication |