CN112667716A - Data processing method and device, electronic equipment and storage medium - Google Patents
Data processing method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN112667716A CN112667716A CN202011606664.4A CN202011606664A CN112667716A CN 112667716 A CN112667716 A CN 112667716A CN 202011606664 A CN202011606664 A CN 202011606664A CN 112667716 A CN112667716 A CN 112667716A
- Authority
- CN
- China
- Prior art keywords
- data
- target
- database
- query
- databases
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 14
- 238000003860 storage Methods 0.000 title claims abstract description 12
- 238000012545 processing Methods 0.000 claims abstract description 38
- 230000002452 interceptive effect Effects 0.000 claims abstract description 31
- 238000000034 method Methods 0.000 claims abstract description 27
- 238000006243 chemical reaction Methods 0.000 claims description 35
- 238000004891 communication Methods 0.000 claims description 19
- 230000006870 function Effects 0.000 claims description 18
- 238000013500 data storage Methods 0.000 claims description 12
- 238000004590 computer program Methods 0.000 claims description 9
- 238000012216 screening Methods 0.000 claims description 5
- 238000010586 diagram Methods 0.000 description 16
- 238000004458 analytical method Methods 0.000 description 6
- 230000005540 biological transmission Effects 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000007405 data analysis Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000013473 artificial intelligence Methods 0.000 description 1
- 238000004140 cleaning Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000007619 statistical method Methods 0.000 description 1
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application relates to a data processing method, a data processing device, an electronic device and a storage medium, wherein the method comprises the following steps: receiving a data query request from a front-end interactive interface, wherein the data query request comprises database identifications and query parameters of at least two target databases, and the database types of the at least two target databases are different; determining characteristic information of each target database according to the database identification, and accessing the target databases based on the characteristic information; and inquiring from each target database according to the inquiry parameters to obtain target data. According to the technical scheme, the data processing platform can be connected into the databases of different types, a user can simply, quickly and flexibly realize data query operation on the databases through the unified external interface of the platform, the user does not need to customize codes for each database to query and analyze and operate data of the databases, the data processing efficiency is improved, and the labor time cost is saved.
Description
Technical Field
The present application relates to the field of computer technologies, and in particular, to a data processing method and apparatus, an electronic device, and a storage medium.
Background
With the continuous development of big data and artificial intelligence, the analysis application scenes of the big data are more and more, and decision support is provided for production through the analysis of the data. With the continuous development of big data related technology, different types of data can be stored in different types of databases, such as a non-relational database Elastic Search (ES), a relational database management system MySQL, a data warehouse platform HIVE, and the like. Therefore, when the data is queried and summarized, the codes need to be customized according to different databases for query and analysis, the number of the butted databases is large, the data processing efficiency is greatly reduced, and a large amount of labor time cost is consumed.
Disclosure of Invention
In order to solve the technical problem or at least partially solve the technical problem, embodiments of the present application provide a data processing method, an apparatus, an electronic device, and a storage medium.
According to an aspect of an embodiment of the present application, there is provided a data processing method, including:
receiving a data query request from a front-end interactive interface, wherein the data query request comprises database identifications and query parameters of at least two target databases, and the database types of the at least two target databases are different;
determining characteristic information of each target database according to the database identification, and accessing the target databases based on the characteristic information;
and inquiring from each target database according to the inquiry parameters to obtain target data.
Alternatively to this, the first and second parts may,
the accessing each target database according to the characteristic information of each target database includes:
generating access parameters corresponding to the target databases according to the characteristic information;
and accessing the target database through the access parameters.
Optionally, the querying, according to the query parameter, from each of the target databases to obtain target data includes:
acquiring a database type of the target database;
determining a data storage mode of the target database according to the database type;
generating a data query script corresponding to the query parameter according to the data storage mode;
and inquiring in the target database according to the data inquiry script to obtain the target data.
Optionally, the method further includes:
receiving a data display request from the front-end interactive interface, wherein the data display request comprises a display style script;
and generating a chart corresponding to the target data according to the display style script, and displaying the chart.
Optionally, the data display request further includes: displaying a data range and/or a data refreshing frequency;
generating a chart corresponding to the target data according to the presentation style script, wherein the generating of the chart comprises the following steps:
screening data to be displayed from the target data according to the display data range, and/or periodically inquiring the target data from the target database according to the inquiry parameters according to the data refreshing frequency, and taking the target data obtained by each inquiry as the data to be displayed;
and generating a chart corresponding to the data to be displayed according to the display style script.
Optionally, the data display request further includes: overall pattern of the chart;
generating a chart corresponding to the target data according to the presentation style script, further comprising:
and generating the chart according to the overall chart style.
Optionally, the generating a chart corresponding to the target data according to the presentation style script includes:
receiving a data conversion request from the front-end interactive interface, wherein the data conversion request comprises a data conversion function;
carrying out format conversion on the target data according to the data conversion function to obtain data to be displayed;
and generating a chart corresponding to the data to be displayed according to the display style script.
According to another aspect of the embodiments of the present application, there is provided a data processing apparatus including:
the receiving module is used for receiving a data query request from a front-end interactive interface, wherein the data query request comprises database identifications and query parameters of at least two target databases, and the database types of the at least two target databases are different;
the access module is used for determining the characteristic information of each target database according to the database identification and accessing the target databases based on the characteristic information;
and the query module is used for querying the target databases according to the query parameters to obtain target data.
According to another aspect of the embodiments of the present application, there is also provided a storage medium including a stored program that executes the above steps when the program is executed.
According to another aspect of an embodiment of the present application, there is provided an electronic device including: the system comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory complete mutual communication through the communication bus;
the memory is used for storing a computer program;
the processor is configured to implement the above method steps when executing the computer program.
According to another aspect of embodiments of the present application, there is provided a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, performs the above-mentioned method steps.
Compared with the prior art, the technical scheme provided by the embodiment of the application has the following advantages:
after determining a plurality of different types of databases to be queried, the data processing platform can automatically access the databases according to the database characteristics of each database so as to perform processing operations such as data query statistics and the like in the different types of databases. Like this, the data processing platform can insert the database of different grade type, and the user can simply, fast, realize the data query operation to a plurality of databases in a flexible way through the unified external interface of platform, need not to come the custom code to inquire the analysis and reach a plurality of database operation data to every database, improves data processing efficiency, practices thrift the human time cost.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.
In order to more clearly illustrate the embodiments or technical solutions in the prior art of the present invention, the drawings used in the description of the embodiments or prior art will be briefly described below, and it is obvious for those skilled in the art that other drawings can be obtained based on these drawings without creative efforts.
Fig. 1 is a flowchart of a data processing method according to an embodiment of the present application;
FIG. 2 is a diagram illustrating a data processing platform accessing a multi-type database according to an embodiment of the present disclosure;
FIG. 3 is a schematic diagram of a front-end interactive interface provided by an embodiment of the present application;
FIG. 4 is a flow chart of a data processing method according to another embodiment of the present application;
FIG. 5 is a schematic diagram of a front-end interactive interface provided in another embodiment of the present application;
FIG. 6 is a schematic diagram of a front-end interactive interface provided in another embodiment of the present application;
FIG. 7 is a schematic diagram of a front-end interactive interface provided in another embodiment of the present application;
FIG. 8 is a schematic diagram illustrating a chart provided in the present embodiment;
FIG. 9 is a flow chart of a data processing method according to another embodiment of the present application;
fig. 10 is a block diagram of a data processing apparatus according to an embodiment of the present application;
fig. 11 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The embodiment of the application provides a data processing platform, the platform can be accessed to databases of various different types, data query services for data of various different types are provided, a user does not need to customize codes for each database to perform query analysis, data processing efficiency is improved, and labor time cost is saved.
First, a data processing method provided in an embodiment of the present invention is described below.
The method of the embodiment is applied to a data processing platform accessing different types of databases. Fig. 1 is a flowchart of a data processing method according to an embodiment of the present application. As shown in fig. 1, the method comprises the steps of:
step S11, receiving a data query request from the front-end interactive interface, wherein the data query request comprises database identifications and query parameters of at least two target databases, and the database types of the at least two target databases are different;
step S12, determining the characteristic information of each target database according to the database identification, and accessing the target database based on the characteristic information;
and step S13, obtaining target data from each target database according to the query parameters.
Fig. 2 is a schematic diagram illustrating that a data processing platform accesses a multi-type database according to an embodiment of the present application. As shown in fig. 2, data acquired due to different application scenarios may be stored in different types of databases. For example, the HIVE database stores offline data, which is poor in effectiveness, but the query statistics function is powerful and flexible, so that historical marketing data, historical business data and the like are generally stored in the HIVE database. The ES database generally stores real-time data, has high timeliness and is suitable for displaying data reports of real-time trends, so that flow data, examination and approval data, digitalized data, real-time marketing data, real-time business data and the like can be stored in the ES database. The MySQL database has better effectiveness and higher query flexibility, and can ensure the transaction consistency, so the MySQL database can be used for storing the authority data. In summary, the data processing platform of the embodiment can interface with databases of various types and storing different data.
Fig. 3 is a schematic diagram of a front-end interactive interface provided in an embodiment of the present application. As shown in fig. 3, on the front-end interactive interface of the data processing platform, a database accessed by the data processing platform is provided, and a user can select the database required for data processing through a pull-down menu and input a data query statement in an sql script input box on the front-end interactive interface as a query parameter for data query. In addition, the data processing platform can also provide historical query parameters or common query parameters corresponding to the user account for the user to directly select and use. In the step S11, a data query request is generated according to the target database selected by the user on the front-end interactive interface and the input query parameters, and is sent to the back-end server of the data processing platform.
Different types of databases have different access modes. The step S12 includes:
step A1, generating access parameters corresponding to each target database according to the characteristic information;
step A2, accessing the target database through the access parameters.
The characteristic information of the target database comprises database types and attribute information, for example, the database is ES, HIVE or MySQL and the like, and the attribute information of the database comprises a database coding mode, an access address, an access user name and a password, a database driver and the like. Based on the characteristic information, the data processing platform can access the target database.
With respect to the above step S13, the data in the target database is queried based on the query parameters. Optionally, because different types of databases have different data storage manners, for different databases, the query parameter needs to be converted into a query script corresponding to the database for querying. The step S13 includes:
step B1, acquiring the database type of the target database;
step B2, determining the data storage mode of the target database according to the database type;
step B3, generating a data query script corresponding to the query parameter according to the data storage mode;
and step B4, inquiring in the target database according to the data inquiry script to obtain target data.
For example, if the query parameter is written in an SQL script manner, the query parameter may be directly used to query data in the MySQL database; for the ES database, the query parameters of the SQL query script can be converted into a Domain Specific Language (DSL) query script, and the DSL query script is used for carrying out data query on the ES database; for the HIVE database, the SQL query script can be converted into an HIVE-SQL query script, and the query is carried out on the HIVE database.
In the above steps, the user may select multiple target databases on the front-end interaction page, the types of the multiple target databases may be different, the databases are accessed based on the feature information of each database, a query script corresponding to each database is generated, and data query is performed in each database.
Through the steps S11 to S13, after determining a plurality of different types of databases to be queried, the data processing platform can automatically access the databases according to the database characteristics of each database, so as to perform processing operations such as data query statistics and the like in the different types of databases. Like this, the data processing platform can insert the database of different grade type, and the user can simply, fast, realize the data query operation to a plurality of databases in a flexible way through the unified external interface of platform, need not to come the custom code to inquire the analysis and reach a plurality of database operation data to every database, improves data processing efficiency, practices thrift the human time cost.
In an optional embodiment, the user may also add an accessed database on the data analysis platform, and for the added database, the user needs to input feature information of the added database, such as a database type, a database encoding mode, an access address, an access user name, a password, and the like. After the newly added database is accessed, a user can perform processing operations such as data query and display on the data processing platform aiming at the newly added database.
In another optional embodiment, since each database may have an access right, the data processing platform may obtain the access right of each database according to a pre-negotiated right obtaining manner. The data processing platform can also set data transmission keys with each database, and the data transmission keys are used for carrying out encryption transmission on the transmission data.
In another alternative embodiment, the data processing platform may perform data cleaning and data format conversion on the data from each database according to a preset data check rule or a preset data format, so as to facilitate subsequent statistical analysis and presentation.
In another optional embodiment, for the target data obtained by query, corresponding report display can be performed according to the user requirement. Fig. 4 is a flowchart of a data processing method according to another embodiment of the present application. As shown in fig. 4, the method further comprises the steps of:
step S21, receiving a data display request from the front-end interactive interface, wherein the data display request comprises a display style script;
and step S22, generating a chart corresponding to the target data according to the display style script, and displaying the chart.
Fig. 5 is a schematic diagram of a front-end interaction interface provided in another embodiment of the present application, and as shown in fig. 5, the front-end interaction page provides an interface of "page layout", and on the interface, a user can perform operations such as selecting, modifying, deleting, and the like on a data presentation style. For example, for an existing data presentation style, a user may add a new line layout and a new block layout on the basis of the existing data presentation style, may delete the layout, or may set a global style and store the modified data presentation style. And obtaining a display style script based on the edited data display style, and generating an icon corresponding to the target data when the target data is displayed subsequently.
Optionally, on the front-end interactive interface, the user may also directly write a presentation style script. Fig. 6 is a schematic diagram of a front-end interactive interface provided in another embodiment of the present application, and as shown in fig. 6, a presentation style script is written through an html code input box 61.
Optionally, as shown in fig. 6, the user may also input/select a style name in the CSS style input box 62 of the front-end interface, and may graphically display the data using the existing CSS style.
Through the steps S21 and S22, the user can set a data presentation style script according to the user' S own needs on the front-end interactive interface, so as to perform chart presentation on the queried target data according to the presentation style script. Therefore, a user does not need to respectively query the data of the databases to obtain reports and then gather all the reports, and the reports can be directly displayed on the query results of different databases, so that the data display operation is more flexible, simple and rapid, the data processing efficiency is improved, and the labor time cost is saved.
In an alternative embodiment, the user may also set the picture display pattern by setting parameters to control the data dynamic display, such as using an open source tool ECharts (Enterprise Charts, business level data diagram library). The data presentation request further comprises: the data range and/or data refresh frequency is shown. The step S22 includes:
step C1, screening the data to be displayed from the target data according to the display data range, and/or periodically inquiring the target data from the target database according to the inquiry parameters according to the data refreshing frequency, and taking the target data obtained by each inquiry as the data to be displayed;
and step C2, generating a chart corresponding to the data to be displayed according to the display style script.
Fig. 7 is a schematic diagram of a front-end interactive interface according to another embodiment of the present application, as shown in fig. 7, target data obtained by query can be filtered by displaying a data range, and a portion of data required by a user is selected for display, for example, the number of data required for display can be input in a "number of TOP pieces of default data" input box 71, and if 7 is input, the first 7 pieces of data are selected for display in all target data. Through the data refreshing frequency, the target data can be periodically updated, and the display chart can be updated, if 10 (unit: second) can be input in the real-time refreshing input box 72, the data is inquired again every 10 seconds, the display chart is generated according to the target data obtained by inquiring again, and the chart is periodically updated.
In another optional embodiment, the data presentation request further comprises: overall pattern of the chart; the step S22 further includes: and generating the chart according to the overall chart style.
As shown in fig. 7, in the chart overall style input box 73 on the front-end interactive interface, the user may set the overall style of the chart, such as the style parameters of the chart size, the background color, the line thickness, and the like. For example, in the chart overall style input box 73, "width: 100%; height:250 px; ", when the chart width is 100%, the height is 250 pixels, that is, the finally generated chart size is set to be 250 pixels in height, and the width is the actual size.
As shown in fig. 7, when setting a chart style based on ECharts, the user may also input a presentation style script in the chart code input box 74 to set a presentation chart.
Through the plurality of optional embodiments, data display can be further set, data to be displayed can be set, the pattern of the displayed chart can also be further set, and therefore the final displayed chart meets the requirements of users, the users do not need to perform complex setting operation, data display efficiency is improved, and labor time cost is reduced.
Fig. 8 is a schematic diagram of the display chart provided in the present embodiment, and as shown in fig. 8, the display chart of the marketing fee is generated based on the display data range, the data refresh frequency, the overall chart style and the display style script set in fig. 7.
In an alternative embodiment, since the storage formats of the same type of data in different databases may be different, and the data storage format may also be different from the data presentation format required by the user when data presentation is performed, in the data analysis platform, a plurality of data conversion functions are further provided to perform format conversion on the target data.
Fig. 9 is a flowchart of a data processing method according to another embodiment of the present application. As shown in fig. 9, the step S22 includes the following steps:
step S31, receiving a data conversion request from the front-end interactive interface, wherein the data conversion request comprises a data conversion function;
step S32, format conversion is carried out on the target data according to the data conversion function to obtain data to be displayed;
and step S33, generating a chart corresponding to the data to be displayed according to the display style script.
The user can select an existing data conversion function or edit a desired data conversion function as desired. And converting the target data into a format required by a user through a data conversion function so as to be convenient for subsequent chart display.
For example, the date data may be formatted by a date data conversion function.
Type of date
<div lict＝"licd_yyyyMMdd--1d">
Wherein, the licd represents a fixed identifier; yyymmdd represents the formatted date; 1d denotes the distance from the current time (subtraction).
The converted date data is 20180117.
As another example of the present invention,
as another example, the user may customize the data conversion functions, such as formatting the amount data:
fmoney(s,n)
where s represents the amount of money and n represents the reserved decimal place.
If n is 2, then 2 decimal places are reserved for all the amount data.
In the embodiment, the data conversion function set by the user is used for performing conversion processing on the data before the report is displayed, so that the data in different storage formats can be displayed according to the display format required by the user, the data processing efficiency and the data display effect are further improved, and the labor time cost is saved.
The following are embodiments of the apparatus of the present application that may be used to perform embodiments of the method of the present application.
Fig. 10 is a block diagram of a data processing apparatus provided in an embodiment of the present application, which may be implemented as part of or all of an electronic device through software, hardware, or a combination of the two. As shown in fig. 10, the data processing apparatus includes:
a receiving module 91, configured to receive a data query request from a front-end interactive interface, where the data query request includes database identifiers and query parameters of at least two target databases, and the database types of the at least two target databases are different;
an access module 92, configured to determine feature information of each target database according to the database identifier, and access the target database based on the feature information;
and the query module 93 is configured to query the target databases according to the query parameters to obtain target data.
Optionally, the access module 92 is configured to generate an access parameter corresponding to each target database according to the feature information; and accessing the target database through the access parameters.
Optionally, the query module 93 is configured to obtain a database type of the target database; determining a data storage mode of the target database according to the database type; generating a data query script corresponding to the query parameter according to the data storage mode; and inquiring in the target database according to the data inquiry script to obtain the target data.
Optionally, the apparatus further comprises: and a display module. The receiving module is used for receiving a data display request from the front-end interactive interface, and the data display request comprises a display style script; and the display module is used for generating a chart corresponding to the target data according to the display style script and displaying the chart.
Optionally, the data display request further includes: the data range and/or data refresh frequency is shown. The display module is used for screening the data to be displayed from the target data according to the display data range, and/or periodically inquiring the target data from the target database according to the inquiry parameters according to the data refreshing frequency, and taking the target data obtained by each inquiry as the data to be displayed; and generating a chart corresponding to the data to be displayed according to the display style script.
Optionally, the data display request further includes: overall style of the chart. And the display module is also used for generating the chart according to the overall pattern of the chart.
The display module is used for receiving a data conversion request from the front-end interactive interface, wherein the data conversion request comprises a data conversion function; carrying out format conversion on the target data according to the data conversion function to obtain data to be displayed; and generating a chart corresponding to the data to be displayed according to the display style script.
An embodiment of the present application further provides an electronic device, as shown in fig. 11, the electronic device may include: the system comprises a processor 1501, a communication interface 1502, a memory 1503 and a communication bus 1504, wherein the processor 1501, the communication interface 1502 and the memory 1503 complete communication with each other through the communication bus 1504.
A memory 1503 for storing a computer program;
the processor 1501, when executing the computer program stored in the memory 1503, is configured to implement the steps of the following method embodiments:
receiving a data query request from a front-end interactive interface, wherein the data query request comprises database identifications and query parameters of at least two target databases, and the database types of the at least two target databases are different;
determining characteristic information of each target database according to the database identification, and accessing the target databases based on the characteristic information;
and inquiring from each target database according to the inquiry parameters to obtain target data.
Alternatively to this, the first and second parts may,
accessing each of the target databases according to the characteristic information of each of the target databases, including:
generating access parameters corresponding to the target databases according to the characteristic information;
and accessing the target database through the access parameters.
Alternatively to this, the first and second parts may,
the obtaining of the target data from the query of each target database according to the query parameters includes:
acquiring a database type of the target database;
determining a data storage mode of the target database according to the database type;
generating a data query script corresponding to the query parameter according to the data storage mode;
and inquiring in the target database according to the data inquiry script to obtain the target data.
Optionally, the method further includes:
receiving a data display request from the front-end interactive interface, wherein the data display request comprises a display style script;
and generating a chart corresponding to the target data according to the display style script, and displaying the chart.
Optionally, the data display request further includes: displaying a data range and/or a data refreshing frequency;
generating a chart corresponding to the target data according to the presentation style script, wherein the generating of the chart comprises the following steps:
screening data to be displayed from the target data according to the display data range, and/or periodically inquiring the target data from the target database according to the inquiry parameters according to the data refreshing frequency, and taking the target data obtained by each inquiry as the data to be displayed;
and generating a chart corresponding to the data to be displayed according to the display style script.
Optionally, the data display request further includes: overall pattern of the chart;
generating a chart corresponding to the target data according to the presentation style script, further comprising:
and generating the chart according to the overall chart style.
Optionally, the generating a chart corresponding to the target data according to the presentation style script includes:
receiving a data conversion request from the front-end interactive interface, wherein the data conversion request comprises a data conversion function;
carrying out format conversion on the target data according to the data conversion function to obtain data to be displayed;
and generating a chart corresponding to the data to be displayed according to the display style script.
The communication bus mentioned in the electronic device may be a Peripheral component interconnect (pci) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.
The communication interface is used for communication between the electronic equipment and other equipment.
The Memory may include a Random Access Memory (RAM) or a Non-Volatile Memory (NVM), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.
The Processor may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic device, discrete hardware component.
The present application also provides a computer-readable storage medium having stored thereon a computer program which, when being executed by a processor, carries out the steps of the method embodiments described below.
It should be noted that, for the above-mentioned apparatus, electronic device and computer-readable storage medium embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and for the relevant points, reference may be made to the partial description of the method embodiments.
It is further noted that, herein, relational terms such as "first" and "second," and the like, may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The foregoing are merely exemplary embodiments of the present invention, which enable those skilled in the art to understand or practice the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. A data processing method, comprising:
receiving a data query request from a front-end interactive interface, wherein the data query request comprises database identifications and query parameters of at least two target databases, and the database types of the at least two target databases are different;
determining characteristic information of each target database according to the database identification, and accessing the target databases based on the characteristic information;
and inquiring from each target database according to the inquiry parameters to obtain target data.
2. The method of claim 1, wherein accessing each of the target databases based on the characteristic information of each of the target databases comprises:
generating access parameters corresponding to the target databases according to the characteristic information;
and accessing the target database through the access parameters.
3. The method of claim 2, wherein querying each of the target databases for target data according to the query parameters comprises:
acquiring a database type of the target database;
determining a data storage mode of the target database according to the database type;
generating a data query script corresponding to the query parameter according to the data storage mode;
and inquiring in the target database according to the data inquiry script to obtain the target data.
4. The method of claim 1, further comprising:
receiving a data display request from the front-end interactive interface, wherein the data display request comprises a display style script;
and generating a chart corresponding to the target data according to the display style script, and displaying the chart.
5. The method of claim 4, wherein the data presentation request further comprises: displaying a data range and/or a data refreshing frequency;
generating a chart corresponding to the target data according to the presentation style script, wherein the generating of the chart comprises the following steps:
screening data to be displayed from the target data according to the display data range, and/or periodically inquiring the target data from the target database according to the inquiry parameters according to the data refreshing frequency, and taking the target data obtained by each inquiry as the data to be displayed;
and generating a chart corresponding to the data to be displayed according to the display style script.
6. The method of claim 4 or 5, wherein the data presentation request further comprises: overall pattern of the chart;
generating a chart corresponding to the target data according to the presentation style script, further comprising:
and generating the chart according to the overall chart style.
7. The method of claim 4, wherein generating the graph corresponding to the target data according to the presentation style script comprises:
receiving a data conversion request from the front-end interactive interface, wherein the data conversion request comprises a data conversion function;
carrying out format conversion on the target data according to the data conversion function to obtain data to be displayed;
and generating a chart corresponding to the data to be displayed according to the display style script.
8. A data processing apparatus, comprising:
the receiving module is used for receiving a data query request from a front-end interactive interface, wherein the data query request comprises database identifications and query parameters of at least two target databases, and the database types of the at least two target databases are different;
the access module is used for determining the characteristic information of each target database according to the database identification and accessing the target databases based on the characteristic information;
and the query module is used for querying the target databases according to the query parameters to obtain target data.
9. An electronic device, comprising: the system comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory complete mutual communication through the communication bus;
the memory is used for storing a computer program;
the processor, when executing the computer program, implementing the method steps of any of claims 1-7.
10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method steps of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011606664.4A CN112667716A (en) | 2020-12-30 | 2020-12-30 | Data processing method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011606664.4A CN112667716A (en) | 2020-12-30 | 2020-12-30 | Data processing method and device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112667716A true CN112667716A (en) | 2021-04-16 |
Family
ID=75410816
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011606664.4A Pending CN112667716A (en) | 2020-12-30 | 2020-12-30 | Data processing method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112667716A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113476853A (en) * | 2021-07-26 | 2021-10-08 | 北京达佳互联信息技术有限公司 | Data processing method and device for interactive tasks, electronic equipment and storage medium |
| CN114595245A (en) * | 2022-03-18 | 2022-06-07 | 上海哔哩哔哩科技有限公司 | Data processing method and device |
| CN114896272A (en) * | 2022-06-15 | 2022-08-12 | 北京奇艺世纪科技有限公司 | Information acquisition method and device, electronic equipment and computer readable storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105843945A (en) * | 2016-04-08 | 2016-08-10 | 联动优势科技有限公司 | Report generation method and system |
| US20190228095A1 (en) * | 2018-01-25 | 2019-07-25 | Capital One Services, Llc | Systems and methods for storing and accessing database queries |
| CN110209705A (en) * | 2019-04-25 | 2019-09-06 | 深圳壹账通智能科技有限公司 | Data query method, apparatus, computer equipment, computer storage medium |
| CN111125205A (en) * | 2019-12-19 | 2020-05-08 | 广州唯品会信息科技有限公司 | Signboard data display method, terminal and storage medium |
| CN111309785A (en) * | 2020-02-14 | 2020-06-19 | 广州极晟网络技术有限公司 | Spring framework-based database access method and device, computer equipment and medium |
| CN111400388A (en) * | 2020-03-20 | 2020-07-10 | 北京东方金信科技有限公司 | Method and system for uniformly connecting and sharing multiple data sources |
| CN111581231A (en) * | 2020-04-20 | 2020-08-25 | 北京明略软件系统有限公司 | Query method and device based on heterogeneous database |
| CN111881192A (en) * | 2020-08-03 | 2020-11-03 | 浪潮云信息技术股份公司 | Method and system for generating visual configuration report, electronic equipment and storage medium |
-
2020
- 2020-12-30 CN CN202011606664.4A patent/CN112667716A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105843945A (en) * | 2016-04-08 | 2016-08-10 | 联动优势科技有限公司 | Report generation method and system |
| US20190228095A1 (en) * | 2018-01-25 | 2019-07-25 | Capital One Services, Llc | Systems and methods for storing and accessing database queries |
| CN110209705A (en) * | 2019-04-25 | 2019-09-06 | 深圳壹账通智能科技有限公司 | Data query method, apparatus, computer equipment, computer storage medium |
| CN111125205A (en) * | 2019-12-19 | 2020-05-08 | 广州唯品会信息科技有限公司 | Signboard data display method, terminal and storage medium |
| CN111309785A (en) * | 2020-02-14 | 2020-06-19 | 广州极晟网络技术有限公司 | Spring framework-based database access method and device, computer equipment and medium |
| CN111400388A (en) * | 2020-03-20 | 2020-07-10 | 北京东方金信科技有限公司 | Method and system for uniformly connecting and sharing multiple data sources |
| CN111581231A (en) * | 2020-04-20 | 2020-08-25 | 北京明略软件系统有限公司 | Query method and device based on heterogeneous database |
| CN111881192A (en) * | 2020-08-03 | 2020-11-03 | 浪潮云信息技术股份公司 | Method and system for generating visual configuration report, electronic equipment and storage medium |
Non-Patent Citations (2)
| Title |
|---|
| 姚怡: "大学计算机基础——基于CDIO项目教学", 31 July 2020, 中国铁道出版社, pages: 194 - 195 * |
| 彭军等: "数据库原理及应用 （SQL Server2014）", 31 August 2020, 中国铁道出版社, pages: 270 - 271 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113476853A (en) * | 2021-07-26 | 2021-10-08 | 北京达佳互联信息技术有限公司 | Data processing method and device for interactive tasks, electronic equipment and storage medium |
| CN113476853B (en) * | 2021-07-26 | 2023-10-03 | 北京达佳互联信息技术有限公司 | Data processing method and device for interactive task, electronic equipment and storage medium |
| CN114595245A (en) * | 2022-03-18 | 2022-06-07 | 上海哔哩哔哩科技有限公司 | Data processing method and device |
| CN114896272A (en) * | 2022-06-15 | 2022-08-12 | 北京奇艺世纪科技有限公司 | Information acquisition method and device, electronic equipment and computer readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11669503B2 (en) | Building and managing data-processing attributes for modeled data sources | |
| CN112667716A (en) | Data processing method and device, electronic equipment and storage medium | |
| CN111008253A (en) | Data model generation method, data warehouse generation device and electronic equipment | |
| CN111414405A (en) | Data acquisition method and device and electronic equipment | |
| CN112433712A (en) | Report display method and device, computer equipment and storage medium | |
| CN111414410A (en) | Data processing method, device, equipment and storage medium | |
| CN112036631A (en) | Purchasing quantity determination method, device, equipment and storage medium | |
| CN113885860A (en) | Method and equipment for automatically configuring management page to generate interface service | |
| CN111198678A (en) | Method and device for generating GraphQL front-end operation interface | |
| CN113986954B (en) | User event acquisition method and device, intelligent terminal and readable storage medium | |
| CN115543428A (en) | Simulated data generation method and device based on strategy template | |
| KR102198686B1 (en) | Method for creating business screen and system for performing the same | |
| CN112785418A (en) | Credit risk modeling method, credit risk modeling device, credit risk modeling equipment and computer readable storage medium | |
| CN113434585A (en) | Resource saving method and equipment | |
| CN115017185A (en) | Data processing method, device and storage medium | |
| CN115599433A (en) | Configuration method and device of business process attribute, electronic equipment and storage medium | |
| CN117406985A (en) | Page batch generation method and device | |
| CN116401140A (en) | Data processing method, device, equipment, readable medium and software product | |
| CN115879427A (en) | Form template construction method, system, equipment and medium | |
| CN116414880A (en) | Feature engineering method and device and electronic equipment | |
| CN113420053A (en) | Data processing method and device, electronic equipment and storage medium | |
| CN114547327A (en) | Method, device and equipment for generating space-time big data relation map and storage medium | |
| CN117035664A (en) | Template-based trust approval standardized processing method, device, equipment and medium | |
| CN116185375A (en) | Attribute editing generation method, device, electronic equipment and storage medium | |
| CN115905356A (en) | Method and device for generating business diagram and knowledge mining application |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: Room 221, 2 / F, block C, 18 Kechuang 11th Street, Daxing District, Beijing, 100176 Applicant after: Jingdong Technology Holding Co.,Ltd. Address before: Room 221, 2 / F, block C, 18 Kechuang 11th Street, Daxing District, Beijing, 100176 Applicant before: Jingdong Digital Technology Holding Co., Ltd |