CN112162985A - Asynchronous downloading method based on button business intelligent platform - Google Patents
Asynchronous downloading method based on button business intelligent platform Download PDFInfo
- Publication number
- CN112162985A CN112162985A CN202011055484.1A CN202011055484A CN112162985A CN 112162985 A CN112162985 A CN 112162985A CN 202011055484 A CN202011055484 A CN 202011055484A CN 112162985 A CN112162985 A CN 112162985A
- Authority
- CN
- China
- Prior art keywords
- file
- downloading
- user
- button
- downloaded
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 22
- 230000000903 blocking effect Effects 0.000 abstract description 3
- 230000009286 beneficial effect Effects 0.000 abstract description 2
- 230000000694 effects Effects 0.000 description 2
- 238000013075 data extraction Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2282—Tablespace storage structures; Management thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
- G06F16/273—Asynchronous replication or reconciliation
Abstract
The invention provides a method for asynchronous downloading based on a button business intelligent platform, relating to the technical field of business intelligence; the method comprises the following steps: s1, searching the files saved by the current user previously from the file download server; s2, creating an initial table corresponding to the large table to be downloaded in the database; s3, compiling a schema model of common dimensions; s4, carrying out secondary development on the saiku, and selecting required fields according to the schema model; s5, acquiring the dimension, style and field requirements of the file to be downloaded, and inquiring template data of the corresponding initial table to give a user preview style; s6, analyzing the dimension selected by the user and the required field, and transmitting the dimension and the required field to a button in a parameter form; s7, obtaining the required file; s8, downloading the file; the invention has the beneficial effects that: the downloading task is transferred to the background of the button, so that the problem of blocking of the batch downloading pages is solved.
Description
Technical Field
The invention relates to the technical field of business intelligence, in particular to a method for asynchronous downloading based on a button business intelligent platform.
Background
With the continuous deepening of the informatization degree, the desire of enterprises for the analysis service of the big data is increasingly strong. The continuous increase of information resources of the internet contains huge amount of information with commercial value, and becomes an important business intelligent service information source.
At present, data of a plurality of business intelligent analysis tools are stored in an oracle database, and the downloading of an oracle-based business intelligent analysis platform is mostly synchronous. Due to business needs, a large data volume downloading requirement is often met, page jamming often occurs during batch downloading, and an operator can only wait for other operations. In addition, the commercial intelligent analysis platform cannot perform distributed capacity expansion, and the situation that the cluster load is too high and is broken down frequently occurs in the case of large-batch downloading operation. In addition, the number of supported databases is small, only the relational database is supported, and the nosql database is not supported.
Disclosure of Invention
In order to overcome the defects of the prior art, the invention provides a method for asynchronous downloading based on a button business intelligent platform, and the problem of deadlocking of batch downloading pages is solved by transferring a downloading task to a button background.
The technical scheme adopted by the invention for solving the technical problems is as follows: in a method for asynchronous downloading based on a keylet business intelligence platform, the improvement comprising the steps of:
s1, nesting an asynchronous download button and a file download server button on a commercial intelligent platform by inquiring files stored by a current user previously from a file download server;
s2, creating an initial table corresponding to the large table to be downloaded in the database, and only storing template data in the initial table;
s3, compiling a schema model of common dimensions;
s4, carrying out secondary development on saiku, selecting required fields according to the schema model, checking whether the file download server has the files which are downloaded once in the user authority range when a user needs to download the files, and directly downloading the files to the local through the file download server if the files exist; if not, go to step S5;
s5, acquiring the dimension, style and field requirements of the file to be downloaded, and inquiring template data of the corresponding initial table to give a user preview style;
s6, analyzing the dimension selected by the user and the required field, and transmitting the dimension and the required field to a button in a parameter form;
s7, the button calls presto, and queries a corresponding database according to a corresponding configuration file and a required file to obtain the required file;
and S8, downloading the file, and saving the downloaded file to the file downloading server.
Further, in step S1, the file previously saved by the current user is queried from the file download server by writing the code.
Further, in step S2, after querying the file previously saved by the current user from the file download server, the file is displayed on the download list page.
Further, in step S4, when secondary development is performed on saiku, a download button is added to the page, and when the user needs to download the file, the download button of the page is clicked.
Further, in step S5, when the user previews the style, after the user confirms, step S6 is performed, otherwise, step S5 is performed to retrieve the dimension, style and field requirements of the file to be downloaded.
Further, in step S2 and step S7, the database includes, but is not limited to, an Oracle database, a mysql database, a hive database, and a mongodb database.
Further, in step S4, when the file that was downloaded once in the user right range exists, the file is searched in the file download server according to the user right, and the file is directly downloaded to the local through the file download server.
Further, in step S8, the downloaded file is saved according to the user authority.
Further, step S8 is followed by the steps of:
and S9, directly downloading the file to the local through the file downloading server, and simultaneously returning the file to the foreground page.
The invention has the beneficial effects that: the downloading task is transferred to a button background, so that the problem of blocking of the batch downloading pages is solved; a user preview style is given for the case that the big data is downloaded, so that the user can preview the file conveniently, and the operation of the user is facilitated; multiple tasks can be synchronously downloaded asynchronously and in multiple threads, and a user can do other operations during downloading, so that the use convenience is improved; and the bottleneck problem of the server can be solved through distributed lateral expansion according to the service condition at the later stage.
Drawings
Fig. 1 is a schematic flow chart of a method for asynchronous downloading based on a button business intelligence platform according to the present invention.
Detailed Description
The invention is further illustrated with reference to the following figures and examples.
The conception, the specific structure, and the technical effects produced by the present invention will be clearly and completely described below in conjunction with the embodiments and the accompanying drawings to fully understand the objects, the features, and the effects of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all embodiments, and those skilled in the art can obtain other embodiments without inventive effort based on the embodiments of the present invention, and all embodiments are within the protection scope of the present invention. In addition, all the connection/connection relations referred to in the patent do not mean that the components are directly connected, but mean that a better connection structure can be formed by adding or reducing connection auxiliary components according to specific implementation conditions. All technical characteristics in the invention can be interactively combined on the premise of not conflicting with each other.
Referring to fig. 1, the invention discloses a method for asynchronous downloading based on a button business intelligent platform, which can avoid the dead page jam when the file batch downloading is realized, and can solve the bottleneck problem of a server through distributed transverse expansion according to the service condition. Specifically, in this embodiment, the method includes the following steps:
s1, nesting an asynchronous download button and a file download server button on a commercial intelligent platform by inquiring files stored by a current user previously from a file download server;
in this embodiment, by writing a code, a file previously saved by a current user is queried from a file download server.
S2, creating an initial table corresponding to the large table to be downloaded in the database, and only storing template data in the initial table; in the step, after a file which is stored by a current user in advance is inquired from a file downloading server, the file is displayed on a downloading list page;
s3, compiling a schema model of common dimensions;
s4, carrying out secondary development on saiku, selecting required fields according to the schema model, checking whether the file download server has the files which are downloaded once in the user authority range when a user needs to download the files, and directly downloading the files to the local through the file download server if the files exist; if not, go to step S5;
in the embodiment, when the saiku is developed for the second time, a download button is added to the page, and when a user needs to download a file, the download button of the page is clicked;
when the files which are downloaded once in the user authority range exist, searching is carried out in a file downloading server according to the user authority, and the files are directly downloaded to the local through the file downloading server;
s5, acquiring the dimension, style and field requirements of the file to be downloaded, and inquiring template data of the corresponding initial table to give a user preview style;
as shown in fig. 1, when the user previews the style, after the user confirms, step S6 is entered, otherwise, step S5 is returned to, and the dimension, style and field requirements of the file to be downloaded are obtained again;
s6, analyzing the dimension selected by the user and the required field, and transmitting the dimension and the required field to a button in a parameter form;
s7, the button calls presto, and queries a corresponding database according to a corresponding configuration file and a required file to obtain the required file; in a specific scheme, a database and a table which need to be queried are configured inside the button through a configuration file; for example, when transaction data of a certain merchant needs to be downloaded, the transaction data exists in an oracle database, and when a keyword calls presto to query the oracle database, corresponding database connection settings are configured. In the scheme, the database comprises but is not limited to an Oracle database, a mysql database, a hive database and a mongodb database;
s8, downloading the file, and storing the downloaded file in a file downloading server; in step S8, the downloaded file is saved according to the user authority.
In addition, the step S8 is followed by the steps of: and S9, directly downloading the file to the local through the file downloading server, and simultaneously returning the file to the foreground page.
In the embodiment, the button is an ETL tool, is written by pure java, can run on Windows, Linux and Unix, and has high efficiency and stability in data extraction; the key chinese name calls Kettle, and the main programmer MATT of the project wishes to put various data into a Kettle and then flow it out in a specified format. The schema is the organization and structure of the database, both schema and schema ta can be in plural form. Schema objects are included in the schema, and may be tables (table), columns (column), data types (datatype), views (view), stored procedures (stored procedures), relationships (relationships), primary keys (primary keys), foreign keys (foreignkeys), and the like. The database schema may be represented by a visual graph showing the database objects and their relationships to each other. Saiku is a modular open source analysis suite that provides lightweight OLAP (online analytical processing) and is embeddable, extensible, and configurable.
According to the method for asynchronous downloading based on the button business intelligent platform, the downloading task is transferred to the button background, so that the problem of blocking of batch downloading pages is solved; a user preview style is given for the case that the big data is downloaded, so that the user can preview the file conveniently, and the operation of the user is facilitated; multiple tasks can be simultaneously downloaded asynchronously and in multiple threads, and a user can do other operations during downloading, so that the use convenience is improved. The download management page is added, due to the fact that a plurality of download tasks are repeated, all downloaded tasks can be conveniently checked, if the same download requirements appear, the download tasks can be directly downloaded on the file server, and therefore resource occupation is reduced, and file download efficiency is improved. Additionally, relational as well as non-relational database query downloads are supported. Presto is used as a data query engine, so that the efficiency of ad hoc query downloading is improved; and the bottleneck problem of the server can be solved through distributed lateral expansion according to the service condition at the later stage.
While the preferred embodiments of the present invention have been illustrated and described, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (9)
1. A method for asynchronous downloading based on a button business intelligent platform is characterized by comprising the following steps:
s1, nesting an asynchronous download button and a file download server button on a commercial intelligent platform by inquiring files stored by a current user previously from a file download server;
s2, creating an initial table corresponding to the large table to be downloaded in the database, and only storing template data in the initial table;
s3, compiling a schema model of common dimensions;
s4, carrying out secondary development on saiku, selecting required fields according to the schema model, checking whether the file download server has the files which are downloaded once in the user authority range when a user needs to download the files, and directly downloading the files to the local through the file download server if the files exist; if not, go to step S5;
s5, acquiring the dimension, style and field requirements of the file to be downloaded, and inquiring template data of the corresponding initial table to give a user preview style;
s6, analyzing the dimension selected by the user and the required field, and transmitting the dimension and the required field to a button in a parameter form;
s7, the button calls presto, and queries a corresponding database according to a corresponding configuration file and a required file to obtain the required file;
and S8, downloading the file, and saving the downloaded file to the file downloading server.
2. The method for asynchronous downloading based on a keylet business intelligence platform as claimed in claim 1, wherein in step S1, the file previously saved by the current user is queried from the file download server by writing code.
3. The method for asynchronous downloading based on a keylet business intelligence platform as claimed in claim 2, wherein in step S2, after querying the file download server for the file previously saved by the current user, the file is displayed on the download list page.
4. The method for asynchronous downloading based on a keytle business intelligence platform as claimed in claim 1, wherein in step S4, when secondary development is performed on saiku, a download button is added to the page, and when the user needs to download the file, the download button of the page is clicked.
5. The method for asynchronous downloading based on a keylet business intelligence platform as claimed in claim 1, wherein in step S5, when the user preview style is given, after the user confirms, step S6 is entered, otherwise, step S5 is returned to retrieve the dimension, style and field requirement of the file to be downloaded.
6. The method for asynchronous downloading based on a keylet business intelligence platform as claimed in claim 1, wherein said database includes but is not limited to Oracle database, mysql database, hive database and mongodb database in steps S2 and S7.
7. The method for asynchronous downloading based on a keylet business intelligence platform as claimed in claim 1, wherein in step S4, when the file once downloaded in the user right range exists, the file is searched in the file download server according to the user right, and the file is directly downloaded to the local through the file download server.
8. The method for asynchronous downloading based on a keylet business intelligence platform as claimed in claim 1, wherein in step S8, the downloaded file is saved according to the user' S right.
9. The method for asynchronous downloading based on a keylet business intelligence platform as claimed in claim 1, wherein said step S8 is followed by the further steps of:
and S9, directly downloading the file to the local through the file downloading server, and simultaneously returning the file to the foreground page.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011055484.1A CN112162985B (en) | 2020-09-29 | 2020-09-29 | Asynchronous downloading method based on keyle business intelligent platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011055484.1A CN112162985B (en) | 2020-09-29 | 2020-09-29 | Asynchronous downloading method based on keyle business intelligent platform |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112162985A true CN112162985A (en) | 2021-01-01 |
| CN112162985B CN112162985B (en) | 2024-05-03 |
Family
ID=73861425
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011055484.1A Active CN112162985B (en) | 2020-09-29 | 2020-09-29 | Asynchronous downloading method based on keyle business intelligent platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112162985B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140108508A1 (en) * | 2012-02-13 | 2014-04-17 | Tencent Technology (Shenzhen) Company Limited | Cloud subscription download method and system, and computer storage medium |
| CN104219271A (en) * | 2013-06-05 | 2014-12-17 | 北京齐尔布莱特科技有限公司 | Method for synchronizing multiple servers on basis of multi-thread asynchronous download pages |
| CN108268542A (en) * | 2016-12-31 | 2018-07-10 | 中国移动通信集团河北有限公司 | For the method and system of data-base cluster Data Migration |
-
2020
- 2020-09-29 CN CN202011055484.1A patent/CN112162985B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140108508A1 (en) * | 2012-02-13 | 2014-04-17 | Tencent Technology (Shenzhen) Company Limited | Cloud subscription download method and system, and computer storage medium |
| CN104219271A (en) * | 2013-06-05 | 2014-12-17 | 北京齐尔布莱特科技有限公司 | Method for synchronizing multiple servers on basis of multi-thread asynchronous download pages |
| CN108268542A (en) * | 2016-12-31 | 2018-07-10 | 中国移动通信集团河北有限公司 | For the method and system of data-base cluster Data Migration |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112162985B (en) | 2024-05-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2605158B1 (en) | Mixed join of row and column database tables in native orientation | |
| EP3066585B1 (en) | Generic indexing for efficiently supporting ad-hoc query over hierarchically marked-up data | |
| US5802524A (en) | Method and product for integrating an object-based search engine with a parametrically archived database | |
| US6374252B1 (en) | Modeling of object-oriented database structures, translation to relational database structures, and dynamic searches thereon | |
| US5761654A (en) | Memory structure and method for tuning a database statement using a join-tree data structure representation, including selectivity factors, of a master table and detail table | |
| US6789071B1 (en) | Method for efficient query execution using dynamic queries in database environments | |
| US9390115B2 (en) | Tables with unlimited number of sparse columns and techniques for an efficient implementation | |
| US7996387B2 (en) | Techniques for extending user-defined indexes with auxiliary properties | |
| US7899837B2 (en) | Apparatus and method for generating queries and reports | |
| US8078652B2 (en) | Virtual columns | |
| US8862588B1 (en) | Generating an empirically-determined schema for a schemaless database | |
| US7672961B2 (en) | Database having heterogeneous object types | |
| US6763350B2 (en) | System and method for generating horizontal view for SQL queries to vertical database | |
| US8015165B2 (en) | Efficient path-based operations while searching across versions in a repository | |
| EP2843567B1 (en) | Computer-implemented method for improving query execution in relational databases normalized at level 4 and above | |
| EP1302871A2 (en) | Collecting statistics in a database system | |
| US9824128B1 (en) | System for performing single query searches of heterogeneous and dispersed databases | |
| CN111259004B (en) | Method for indexing data in storage engine and related device | |
| US20080201290A1 (en) | Computer-implemented methods, systems, and computer program products for enhanced batch mode processing of a relational database | |
| US9489413B2 (en) | Asynchronous global index maintenance during partition maintenance | |
| US8204895B2 (en) | Apparatus and method for receiving a report | |
| US7475088B2 (en) | Systems and methods of providing data from a data source to a data sink | |
| US20040039755A1 (en) | Metadata relationships | |
| Elamparithi et al. | A Review on Database Migration Strategies, Techniques and Tools | |
| US20050114404A1 (en) | Database table version upload |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant |