CN109960704A - Big data machine learning intelligence Scientific Research Platform - Google Patents
Big data machine learning intelligence Scientific Research Platform Download PDFInfo
- Publication number
- CN109960704A CN109960704A CN201910003841.0A CN201910003841A CN109960704A CN 109960704 A CN109960704 A CN 109960704A CN 201910003841 A CN201910003841 A CN 201910003841A CN 109960704 A CN109960704 A CN 109960704A
- Authority
- CN
- China
- Prior art keywords
- data
- machine learning
- scientific research
- cube
- automotive engine
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000010801 machine learning Methods 0.000 title claims abstract description 16
- 238000011160 research Methods 0.000 title claims abstract description 16
- 238000013499 data model Methods 0.000 claims description 7
- 238000010276 construction Methods 0.000 claims description 6
- 238000012549 training Methods 0.000 claims description 4
- 230000004927 fusion Effects 0.000 abstract description 8
- 238000012545 processing Methods 0.000 abstract description 8
- 238000012098 association analyses Methods 0.000 abstract description 3
- 238000000034 method Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 241001269238 Data Species 0.000 description 1
- 238000010219 correlation analysis Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000003780 insertion Methods 0.000 description 1
- 230000037431 insertion Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003032 molecular docking Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a kind of big data machine learning intelligence Scientific Research Platforms, including mass data access system, structuralized query automotive engine system, data cube system, data cube storage system and data terminal display system, the data cube system respectively with mass data access system, structuralized query automotive engine system and data cube storage system are bi-directionally connected, the structuralized query automotive engine system and data terminal display system are bi-directionally connected, big data machine learning intelligence Scientific Research Platform disclosed in this invention is by mass data access system to the mass data fusion treatment of access, it goes to realize complicated business processing logic automatically by structuralized query automotive engine system, a whole set of data fusion association analysis system is constructed by data cube system, solve the complexity during Data Fusion, it is cumbersome and fast Spend slow problem.
Description
Technical field
The present invention relates to a kind of big data scientific tools, in particular to a kind of big data machine learning intelligence Scientific Research Platform.
Background technique
In big data treatment process, the processing of data is a complexity, cumbersome high-tech work.Especially for each
The fusion association analysis of kind of mass data, and to the data query of mass data different dimensions, all exist processing it is complicated and
Speed is slow, the low problem of search efficiency.
Summary of the invention
In order to solve the above technical problems, the present invention provides a kind of big data machine learning intelligence Scientific Research Platforms, to reach
A kind of rapid build data cube tupe is provided, realizes the intelligent big data machine learning scientific research of various dimensions quick search
The purpose of platform.
In order to achieve the above objectives, technical scheme is as follows:
Big data machine learning intelligence Scientific Research Platform, including mass data access system, structuralized query automotive engine system, number
According to cube system, data cube storage system and data terminal display system, the data cube system respectively with sea
Amount data insertion system, structuralized query automotive engine system and data cube storage system are bi-directionally connected, the structuralized query
Automotive engine system and data terminal display system are bi-directionally connected.
In above scheme, the data cube system includes data model construction unit, data model verifying training list
Member, data dependence analysis unit and data cube construction unit.
In above scheme, the data terminal display systems and structuralized query automotive engine system are connected by RestAPI interface
It connects.
In above scheme, the structuralized query automotive engine system and data cubic system system by RestAPI interface and
The connection of JDBC/ODBC interface.
Through the above technical solutions, big data machine learning intelligence Scientific Research Platform provided by the invention is connect by mass data
Enter the mass data fusion treatment that system docking enters, provides data basis for structuralized query automotive engine system and cube system；
By structuralized query automotive engine system, data cube system, those of ordinary skill need to only write sql like language, pass through structuring
Query engine system goes to realize complicated business processing logic automatically, is melted by the data that data cube system constructs a whole set of
Association analysis system is closed, is solved the problems, such as complicated, cumbersome and slow-footed during Data Fusion.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described.
Fig. 1 is big data machine learning intelligence Scientific Research Platform composition schematic diagram disclosed in the embodiment of the present invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description.
The present invention provides a kind of big data machine learning intelligence Scientific Research Platforms, as shown in Figure 1, the platform can solve number
According to complicated, the cumbersome and slow-footed problem during fusion treatment.
Big data machine learning intelligence Scientific Research Platform as shown in Figure 1, including mass data access system, structuralized query
Automotive engine system, data cube system, data cube storage system and data terminal display system, data cube system point
It is not bi-directionally connected with mass data access system, structuralized query automotive engine system and data cube storage system, structuring is looked into
It askes automotive engine system and data terminal display system is bi-directionally connected.
1, mass data access system
This system module, to the various relevance mass datas of access, carries out primary clear mainly by way of interface
Storage is washed, and relevance index tab is established to data, makes data that there is the basic condition of correlation analysis, and carry out provisional
Storage, provides data basis for structuralized query automotive engine system and cube system.
2, structuralized query automotive engine system
This system module is to carry out service logic parsing to standardized structured query language (SQL), and draw to inquiry
The service logic for holding up parsing is converted, and by way of interface, is handled into cube system.
3, data cube system
A) this system module is mainly and docks the structuralized query engine service logic that mouth passes over to carry out service resolution
With processing.
B) module is constructed by visual business model and builds business model, realize various data correlation sex cords tenderings
Sign the processing of building.
C) correctness of business model is guaranteed by the verifying training of data from the sample survey to the data model of foundation.
D) to the business model of verifying, mass data is accessed, data cube is established, realizes the quick search of various dimensions
Body guarantees the efficiency of inquiry.
E) system, to the structured query sentence executed, carries out data simultaneously in such a way that intelligent memory learns
Difference processing, guarantees the processing speed and inquiry velocity of data cube, realizes efficient data fusion inquiry.
4, data cube storage system
A) this system module carries out column storage to the cube metadata from data cube system, guarantees that data are becoming
When changing structure, the effect data of entire cube is not influenced.
B) result response is carried out for the inquiry from data terminal display systems.
5, data terminal display systems
This system module, to the data of data cube storage system, is carried out visual more by structured query sentence
Terminal (APP, wechat, PC etc.) is shown.
In the present embodiment, data cube system includes data model construction unit, data model verifying training unit, number
According to dependency analysis unit and data cube construction unit.
Data terminal display systems are connected with structuralized query automotive engine system by RestAPI interface, and structuralized query draws
It holds up system and is connected with data cubic system system by RestAPI interface and JDBC/ODBC interface.
The foregoing description of the disclosed embodiments enables those skilled in the art to implement or use the present invention.
Various modifications to these embodiments will be readily apparent to those skilled in the art, as defined herein
General Principle can be realized in other embodiments without departing from the spirit or scope of the present invention.Therefore, of the invention
It is not intended to be limited to the embodiments shown herein, and is to fit to and the principles and novel features disclosed herein phase one
The widest scope of cause.
Claims (4)
1. big data machine learning intelligence Scientific Research Platform, which is characterized in that draw including mass data access system, structuralized query
Hold up system, data cube system, data cube storage system and data terminal display system, the data cube system
It is bi-directionally connected respectively with mass data access system, structuralized query automotive engine system and data cube storage system, the knot
Structure query engine system and data terminal display system are bi-directionally connected.
2. big data machine learning intelligence Scientific Research Platform according to claim 1, which is characterized in that the data cube
System includes data model construction unit, data model verifying training unit, data dependence analysis unit and data cube
Construction unit.
3. big data machine learning intelligence Scientific Research Platform according to claim 1, which is characterized in that the data terminal exhibition
Show that system is connected with structuralized query automotive engine system by RestAPI interface.
4. big data machine learning intelligence Scientific Research Platform according to claim 1, which is characterized in that the structuralized query
Automotive engine system is united with data cubic system and is connected by RestAPI interface and JDBC/ODBC interface.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910003841.0A CN109960704A (en) | 2019-01-03 | 2019-01-03 | Big data machine learning intelligence Scientific Research Platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910003841.0A CN109960704A (en) | 2019-01-03 | 2019-01-03 | Big data machine learning intelligence Scientific Research Platform |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109960704A true CN109960704A (en) | 2019-07-02 |
Family
ID=67023439
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910003841.0A Pending CN109960704A (en) | 2019-01-03 | 2019-01-03 | Big data machine learning intelligence Scientific Research Platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109960704A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105205085A (en) * | 2014-06-30 | 2015-12-30 | 中兴通讯股份有限公司 | Multi-dimensional analysis method and device for mass data |
| US20180157749A1 (en) * | 2016-12-06 | 2018-06-07 | International Business Machines Corporation | Building a data query engine that leverages expert data preparation operations |
| CN108829707A (en) * | 2018-05-02 | 2018-11-16 | 国网浙江省电力有限公司信息通信分公司 | Big data intelligent analysis system and method across business domains |
-
2019
- 2019-01-03 CN CN201910003841.0A patent/CN109960704A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105205085A (en) * | 2014-06-30 | 2015-12-30 | 中兴通讯股份有限公司 | Multi-dimensional analysis method and device for mass data |
| US20180157749A1 (en) * | 2016-12-06 | 2018-06-07 | International Business Machines Corporation | Building a data query engine that leverages expert data preparation operations |
| CN108829707A (en) * | 2018-05-02 | 2018-11-16 | 国网浙江省电力有限公司信息通信分公司 | Big data intelligent analysis system and method across business domains |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101819578B (en) | Retrieval method, method and device for establishing index and retrieval system | |
| CN106777275A (en) | Entity attribute and property value extracting method based on many granularity semantic chunks | |
| CN101251862B (en) | Content-based problem automatic classifying method and system | |
| CN109726293A (en) | A kind of causal event map construction method, system, device and storage medium | |
| CN105047042B (en) | It is a kind of towards children's material object programming method and system | |
| CN103927360A (en) | Software project semantic information presentation and retrieval method based on graph model | |
| CN101281687A (en) | Learning machine and used dynamic graph and text analysis method | |
| CN111930793A (en) | Target behavior mining and retrieval analysis method, system, computer equipment and application | |
| CN109710261A (en) | A kind of method and electronic equipment that building blocks code is automatically converted to programming code | |
| US10747824B2 (en) | Building a data query engine that leverages expert data preparation operations | |
| CN108491421A (en) | A kind of method, apparatus, equipment and computer storage media generating question and answer | |
| CN111061828B (en) | Digital library knowledge retrieval method and device | |
| Rücklé et al. | Representation learning for answer selection with LSTM-based importance weighting | |
| CN107656921A (en) | A kind of short text dependency analysis method based on deep learning | |
| CN108763428A (en) | A kind of information technology consulting system based on search engine | |
| CN114328951A (en) | Knowledge graph construction method integrating information acquisition and triple extraction | |
| CN104951439A (en) | Electronic book and integration obtaining method and system for relevant electronic resources thereof | |
| CN105760425A (en) | Ontology data storage method | |
| US20120324346A1 (en) | Method for relational analysis of parsed input for visual mapping of knowledge information | |
| CN117196042B (en) | Semantic reasoning method and terminal for learning target in education universe | |
| CN109960704A (en) | Big data machine learning intelligence Scientific Research Platform | |
| CN110362688A (en) | Examination question mask method, device, equipment and computer readable storage medium | |
| CN109903754B (en) | Method, device and memory device for speech recognition | |
| Malbon | Structuralism, hermeneutics, and contextual meaning | |
| CN109522920A (en) | Training method and equipment based on the synonymous discrimination model for combining semantic feature |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190702 |
|
| RJ01 | Rejection of invention patent application after publication |