CN116150235A - Data statistics method, device, system, electronic equipment and medium - Google Patents

Data statistics method, device, system, electronic equipment and medium Download PDF

Info

Publication number
CN116150235A
CN116150235A CN202111425928.0A CN202111425928A CN116150235A CN 116150235 A CN116150235 A CN 116150235A CN 202111425928 A CN202111425928 A CN 202111425928A CN 116150235 A CN116150235 A CN 116150235A
Authority
CN
China
Prior art keywords
data
configuration
data statistics
database
request
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111425928.0A
Other languages
Chinese (zh)
Inventor
田帅朋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qingdao Haier Technology Co Ltd
Haier Smart Home Co Ltd
Original Assignee
Qingdao Haier Technology Co Ltd
Haier Smart Home Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qingdao Haier Technology Co Ltd, Haier Smart Home Co Ltd filed Critical Qingdao Haier Technology Co Ltd
Priority to CN202111425928.0A priority Critical patent/CN116150235A/en
Publication of CN116150235A publication Critical patent/CN116150235A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25—Integrating or interfacing systems involving database management systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2455—Query execution
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/10—Text processing
    • G06F40/166—Editing, e.g. inserting or deleting
    • G06F40/186—Templates

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention provides a data statistics method, a device, a system, electronic equipment and a medium, wherein the method comprises the following steps: and receiving a data statistics request, loading corresponding configuration according to the data statistics request, and processing data according to the configuration, wherein the data statistics request corresponds to the configuration one by one, the data is stored in a first database, and the configuration is stored in a second database. The configuration is stored in the independent database, the data statistics request is received, the configuration corresponding to the data statistics request one by one is loaded from the independent database according to the data statistics request, and the data is processed according to the configuration, so that codes and business logic are separated, functions are centrally managed, the maintenance of a data statistics system and the online process of new functions are simplified, the online period of the new functions is shortened, and the iteration of versions of the data statistics system is accelerated, thereby overcoming the problems in the prior art.

Description

Data statistics method, device, system, electronic equipment and medium
Technical Field
The present invention relates to the field of data statistics technologies, and in particular, to a data statistics method, apparatus, system, electronic device, and medium.
Background
In the big data age, the rules and trends contained in the analysis data are of great significance. Data statistics are also becoming increasingly important, as the volume of data becomes increasingly large, the diversity and complexity of data, so are the data statistics methods and data statistics systems.
In the development process of the data statistics system, when a new statistics function needs to be added, a development engineer is required to develop codes, a test engineer is required to test the codes, and then an operation and maintenance engineer is required to package and release the codes. Therefore, even if a simple function is newly added, a complete development process is required, and the whole process consumes more manpower and time, wherein there is a repetitive work. Moreover, as the amount of code increases, the maintainability of the system becomes worse.
Disclosure of Invention
Aiming at the problems existing in the prior art, the invention provides a data statistics method, a device, a system, electronic equipment and a medium, and the configuration is stored in a separate database so as to be dynamically loaded when in use, so that codes and business logic are separated and functions are centrally managed, thereby simplifying the maintenance of a data statistics system and the online process of new functions, shortening the online period of the new functions, and accelerating the iteration of versions of the data statistics system.
Specifically, the invention is realized by the following technical scheme:
in a first aspect, the present invention provides a data statistics method, the method comprising: receiving a data statistics request, loading corresponding configuration according to the data statistics request, processing data according to the configuration,
wherein the data statistics requests are in one-to-one correspondence with the configurations and the data is stored in a first database and the configurations are stored in a second database different from the first database.
Further, the configuration comprises a function tag, the data statistics request comprises a request tag, and the function tag corresponds to the request tag one by one;
the loading of the corresponding configuration according to the data statistics request includes:
and determining and loading the configuration corresponding to the function label corresponding to the request label contained in the data statistics request.
Further, the configuration further includes at least one of a data processing script, a return results template, a data presentation template, and the data statistics request further includes a query date.
Further, the first database includes one or more databases.
Further, the method further comprises:
the configuration is maintained by a background, wherein the maintenance configuration includes at least one of an add, modify, and delete configuration.
Further, processing the data according to the configuration includes:
the generating data statistics commands according to the data processing script included in the configuration, and processing data according to the data statistics commands.
Further, the method further comprises:
after the data processing is completed, the return result template is acquired from the configuration, and the processed data is packaged based on the return result template.
Further, the method further comprises: after the processed data is packaged, a data display template is acquired from the configuration, and the packaged data is displayed according to the data display template.
In a second aspect, the present invention provides a data statistics apparatus, the apparatus comprising: a data statistics module for receiving a data statistics request, loading a corresponding configuration according to the data statistics request, processing data according to the configuration,
wherein the data statistics requests are in one-to-one correspondence with the configurations and the data is stored in a first database and the configurations are stored in a second database.
In a third aspect, the present invention provides a data statistics system comprising a data statistics module as described in the second aspect, and a management background module for maintaining a configuration.
Further, the data statistics module further includes: a data processing interface for interfacing with a first database and a second database to query data from the first database or to load a configuration from the second database; and is also provided with
The management background module further comprises: and the management background service interface is used for connecting with the second database to maintain the configuration.
In a fourth aspect, the present invention provides an electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the steps of the data statistics method according to any of the first aspects when the program is executed by the processor.
In a fifth aspect, the present invention provides a non-transitory computer readable storage medium having stored thereon a computer program, characterized in that the computer program when executed by a processor implements the steps of the data statistics method according to any of the first aspects.
According to the data statistics method, the device, the system, the electronic equipment and the medium, the configuration is stored in the independent database, the data statistics request is received, the configuration corresponding to the data statistics request one by one is loaded from the independent database according to the data statistics request, and the data is processed according to the configuration, so that codes and business logic are separated, functions are centrally managed, maintenance of a data statistics system and a new function online process are simplified, the new function online period is shortened, iteration of a data statistics system version is accelerated, and the problems in the prior art are overcome.
Drawings
In order to more clearly illustrate the invention or the technical solutions of the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described, and it is obvious that the drawings in the description below are some embodiments of the invention, and other drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flow chart of a data statistics method according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a data statistics apparatus according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of a data statistics system according to an embodiment of the present invention;
fig. 4 is a schematic structural view of an electronic device according to an embodiment of the present invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the present invention more apparent, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is apparent that the described embodiments are some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
The various terms or phrases used herein have the ordinary meaning known to those of ordinary skill in the art, but rather the invention is intended to be more fully described and explained herein. If the terms and phrases referred to herein have a meaning inconsistent with the known meaning, the meaning expressed by the present invention; and if not defined in the present application, have meanings commonly understood by one of ordinary skill in the art.
Fig. 1 is a flow chart of a data statistics method according to an embodiment of the present invention. Referring to fig. 1, the data statistics method may include the steps of:
step 101: receiving a data statistics request, loading a corresponding configuration according to the data statistics request, and processing data according to the configuration, wherein the data statistics request corresponds to the configuration one by one, and the data is stored in a first database (a database storing business data), and the configuration is stored in a second database (a database storing the configuration) different from the first database.
Specifically, in this embodiment, it should be noted that, first, the data to be counted may be data stored in a first database, where the first database may be a database configured by a data statistics system, or may be a database provided by a third party (for example, a user), and the first database may be a single database or may include multiple databases on different servers, and only needs to establish a connection with the database through a database interface. The configuration is stored in a second database, which is a dedicated database, for storing configuration data as well as system configuration only. Access to the first database and the second database may be made through a database interface that establishes a connection with the database, e.g., common database interfaces may include ODBC (open database connection, open Database Connectivity) and JDBC (Java database connection, java Database Connectivity). Where ODBC was generated to address data sharing among heterogeneous databases, it has become an integral part of WOSA (The Windows Open System Architecture (Windows open system architecture)) and a database access interface standard based on the Windows environment. ODBC provides a unified interface for heterogeneous database access, allowing application programs to access data managed by different DBMSs in SQL data access standards; the application program is enabled to directly manipulate the data in the DB, and the change along with the change of the DB is avoided. DB files on various computers, and even non-database objects such as Excel tables and ASCII data files, can be accessed by ODBC. In addition, JDBC is an application program interface in the Java language that is used to specify how a client program accesses a database, and provides methods such as querying and updating data in the database, and is commonly referred to as a relational-oriented database. In this embodiment, the system configuration is described as being stored in the second database together with the configuration of the statistical data, but the present invention is not limited thereto, and the system configuration may be stored in any other database as long as it can be loaded at the time of system startup.
In this embodiment, a data statistics request input by a User through a User Interface (UI) may be initially received through the data processing Interface, where the data statistics request includes request parameters including, for example, a request tag, a query date, and other filtering conditions. Wherein the request tag is used to indicate the type of data statistics request, such as query, summary, ranking, classification, etc.; the query date is used to determine the time frame of the data statistics.
Further, the corresponding configuration may be loaded from the second database according to the data statistics request. The configuration includes at least one of a function tag, a data processing script, a return result template, a data presentation template, and the like. The function labels are used for representing functions corresponding to the configuration, such as inquiry, summarization, sorting, classification and the like, the function labels are in one-to-one correspondence with the request labels, namely, for each request label, a unique corresponding function label can be found in the configuration, namely, for each data statistics request, a unique configuration corresponding to the data statistics request exists in the configuration, and the data statistics request can be met based on the configuration; in the configuration, a data processing script is pre-written and stored in the configuration, the data processing script can be dynamically modified, added and deleted, the data processing script is a set of sentences for database operation corresponding to the function labels and is used for processing data in the database, dependent SQL sentences can be generated according to the data processing script and corresponding parameters, and then data in a first database is counted according to the SQL sentences, so that functions corresponding to the function labels are realized, and corresponding data counting requests are further met; the return result template is configured according to a specific function request, and the packaging template corresponding to the function label is used for packaging the counted data; the data display template is configured according to a specific function request, and the display template corresponding to the function label is used for displaying the packaged data through the user interface. Before loading the corresponding configuration, the configuration corresponding to the data statistics request needs to be retrieved, namely, the configuration corresponding to the function label corresponding to the request label of the data statistics request is retrieved, and the configuration is loaded after the corresponding configuration is retrieved.
It should be noted that, in this embodiment, the process of loading the corresponding configuration is dynamic, that is, the configuration corresponding to the data statistics request is loaded at any time according to the data statistics request when needed.
Further, the data may be processed according to the loaded configuration. As described above, the configuration includes a data processing script corresponding to a function tag, which is a batch file written using a certain programming language (e.g., lua, javaScript, scala, etc.), and the data processing script can implement a function corresponding to a certain task. Particularly when it is necessary to perform a series of repetitive tasks or routines periodically, manual work associated with complex routines can be avoided by using data processing scripts. In an application, the more complex the routine, the more time is saved by running the data processing script. The use of data processing scripts has many advantages, for example, the flow may be performed automatically, and repetitive tasks or routines may be performed automatically by using data processing scripts; the process can be scheduled, when a large data set needs to be processed, the script is usually necessary to be scheduled, the script can be run according to a plan by using the data processing script, the script can be run even outside working time, and a single script or a series of scripts can be scheduled to run on a specific date and time; the accuracy is improved, when the manual execution is performed, the complex data analysis routine is easy to cause artificial errors, the consistency and the accuracy of the processing flow can be ensured by using the data processing script, and the same instruction can be executed according to the same sequence every time the same script is operated; the complexity can be reduced, the data processing script can process complex file structures and perform complex computation on the data domain, and even when the script can only be used for performing relatively complex analysis, for example, continuous monitoring plans generally require the data processing script to automatically execute a flow; the data processing script is portable and shared, can be sent to other users, shared in a network location, and replicated among multiple items; user interaction can be realized, and the data processing script can be correspondingly designed to prompt the user to provide input, so that the user can run the data processing script against their own tables and domains with unique names by using their own input conditions; the document can be captured, the data processing script is a good source of audit document and can be used as part of an audit trail by creating the data processing script, which is equivalent to noting the flow of creating analytical test results, which can be easily referenced in the future, and adding comments to the script to further supplement the document. A data processing script typically executed by one or more of the following flows: importing data, preparing the data and analyzing the data.
Specifically, a data statistics command may be generated according to a data processing script included in the configuration, and the data statistics command may be, for example, an SQL statement set, and then data may be processed through the SQL statement set to implement a function corresponding to the function tag. The specific use environment of the data processing script comprises: MY-SQL, SQLServer, oracle, etc., and contains stored procedures, transactions, views, indexes, triggers, functions, etc. For the database, the data processing script can improve the efficiency of data access and perform relevant data processing. The following table shows an example of an SQL statement:
Figure BDA0003368259690000081
further, after the data processing is completed, a return result template may be obtained from the corresponding configuration, and the processed data may be packaged based on the return result template, where the return result template corresponds to a function tag, and is used to package the counted data according to the user request.
Further, after the processed data is packaged, a data display template is acquired from the corresponding configuration, and the packaged data can be displayed through a user interface based on the data display template, wherein the data display template is configured according to a specific function request, and the display template corresponding to the function label is used for displaying the packaged data through the user interface.
In addition, in the present embodiment, the configuration may be maintained by the background, where maintaining the configuration includes dynamically adding the configuration, modifying the configuration, and deleting the configuration. Specifically, a connection can be established with the second database through the background service interface, so that the second database can be accessed; in addition, the second database can be queried regularly, and the configuration in the second database can be updated timely according to the user requirement, namely corresponding function labels, data processing scripts, returned result templates, data display templates and the like can be updated timely. For example, when a new statistical function needs to be added according to the user requirement, the new configuration can be added and stored into the second database through the background at any time, wherein the new configuration comprises a corresponding function label, a data processing script, a returned result template, a data display template and the like, and the new configuration is used for realizing the new statistical function; according to the user demand, when a certain statistical function needs to be modified, the configuration corresponding to the statistical function can be edited through background modification, such as modification of corresponding function labels, data processing scripts, returned result templates, data display templates and the like, and the modified configuration is stored in a second database and is used for realizing the statistical function to be modified; similarly, when a certain statistical function needs to be deleted according to the requirement of a user, the corresponding configuration in the second database can be deleted through the background, so that the aim of deleting the certain statistical function is fulfilled.
Therefore, in the embodiment, the configuration is stored in the special database, the data statistics request is received, the configuration corresponding to the data statistics request one by one is loaded from the independent database according to the data statistics request, the codes and the business logic are separated according to the configuration processing data, the configuration is carried out through the management background, the functions can be dynamically added, modified and deleted, the functions are centrally managed, the maintenance of the data statistics system is simplified, the new function online flow is simplified, the new function online period is reduced, the iteration of the data statistics system version is further accelerated, the workload of a developer is simplified, and the developer can concentrate on the business development.
Fig. 2 is a schematic diagram of a data statistics apparatus according to an embodiment of the present invention. Referring to fig. 2, the data statistics apparatus may include a data statistics module 210, and the data statistics module 210 may be configured to receive data statistics requests, load corresponding configurations from the second database according to the data statistics requests, and process data according to the configurations. The data statistics module 210 receives the data statistics request, loads configuration corresponding to the data statistics request one by one from a special database according to the data statistics request, and processes data according to the configuration and the request parameters in the data processing request, so that codes and business logic are separated, functions can be dynamically added, modified and deleted, and centralized management is performed on the functions, therefore, the data statistics module 210 can simplify maintenance of a data statistics system, simplify the online process of new functions, reduce the online period of the new functions, further accelerate iteration of versions of the data statistics system, simplify workload of developers, and concentrate efforts on business development by the developers; the complexity of the data statistics system can be simplified through the data statistics module 210, repeated work of developers is reduced, and the reliability and stability of the system are improved.
Since the data statistics device provided by the embodiment of the present invention can be used to perform the data statistics method described in the above embodiment, the working principle is similar, so the details will not be described herein, and the detailed description will be referred to the description of the above embodiment.
Fig. 3 is a schematic diagram of a data statistics system according to an embodiment of the present invention. Referring to fig. 3, the data statistics system may include the data statistics module 210 and the management background module 310 described above. Specifically, the data statistics apparatus 200 may include: a user interface 201, a data processing interface 202, wherein the user interface 201 is for interacting with a user and exposing statistical data, the data processing interface 202 is for interfacing with a first database and a second database to query data from the first database or to load a configuration from the second database; the management background module 310 may include: a management background interface 301, a management background service interface 302, and a second database 303, wherein the management background interface 301 is configured to interact with a background administrator, the management background service interface 302 is configured to connect with the second database 303 to maintain a configuration (i.e., add configuration, modify configuration, and delete configuration), and the second database 303 is configured to store a configuration including a system configuration and a corresponding configuration required for statistics.
The workflow of the data statistics system is described in detail below: after the data statistics system is started, an initialization operation is needed to be performed firstly, and system configuration is loaded from a second database 303 through a data processing interface in the initialization operation to initialize the data statistics system; the data processing interface 202 then queries the first database or other database to be used and creates a connection with the first database or other database; after receiving a data statistics request input by a user through the user interface 201 through the data processing interface 202, retrieving, in the second database 303, a configuration corresponding to a function tag corresponding to the request tag in the data statistics request according to the request tag in the data statistics request, and loading the configuration into the data statistics system; the data statistics system generates a query SQL statement according to the request data processing script in the configuration and the request parameters in the data statistics request, and then performs data statistics query in the connected first database in combination with the filtering conditions (such as query date) in the data statistics request; after the data statistics query is completed, the data statistics system can package the data of the statistics query according to the corresponding returned result template included in the configuration; the data statistics system returns the packaged data and the data display templates included in the configuration to the user interface 301, and the user interface 301 displays the packaged data according to the data display templates.
It should be noted that this system configuration is a base configuration required for the operation of the data statistics system, and in the present embodiment, the system configuration is described as being stored in the second database 303 together with the configuration of the statistics data, but the present invention is not limited thereto, and the system configuration may be stored in any other database as long as the system configuration can be loaded at the time of the start-up of the data statistics system.
The management background module 310 periodically queries the second database 303 through the management background service interface 302, and timely updates the configuration in the second database 303 according to the user's requirement, that is, timely updates the corresponding function tag, the data processing script, the returned result template, the data presentation template, and the like. Specifically, the management background module 310 is connected to the configuration creation database through the management background service interface 302, and a background manager maintains the configuration through the management background interface 301 and stores the maintained configuration in the second database 303. For example, when a new statistical function needs to be added according to a user requirement, a background manager may add and store a new configuration into the second database 303 through the management background module 310, where the new configuration includes a corresponding function tag, a data processing script, a returned result template, a data display template, and the like, and the new configuration is used to implement the new statistical function; according to the user requirement, when a certain statistical function needs to be modified, a background manager can modify and edit the configuration corresponding to the statistical function through the management background module 310, for example, modify corresponding function labels, data processing scripts, return result templates, data display templates and the like, and store the modified configuration into the second database 303, wherein the modified configuration is used for realizing the statistical function to be modified; similarly, when a certain statistical function needs to be deleted according to the user requirement, the background manager can delete the corresponding configuration in the second database 303 through the management background module 310, thereby achieving the purpose of deleting the certain statistical function.
It should be noted that the data to be counted may be data stored in a first database, which may be a database configured by the data counting system, or may be a database provided by a third party (e.g., a user), and the first database may be a single database, or may include multiple databases on different servers, and only needs to establish a connection with the database through a database interface (e.g., an open database connection ODBC, and a Java database connection JDBC). The data statistics system can perform data statistics and display of different dimensionalities on the data in the databases according to the specific requirements of users. In addition, the configuration is stored in a second database, which is a dedicated database, for storing configuration data as well as system configuration only. In this embodiment, fig. 3 shows that the second database is a database that may be part of the management background module 310 and is configured by the data statistics system, but the present invention is not limited thereto, and the second database may be any database that the data statistics system uses through a database interface.
As can be seen from the above, in the data statistics system provided by the embodiment of the present invention, the configuration is stored in the separate database, the data statistics request is received, the configuration corresponding to the data statistics request one by one is loaded from the separate database according to the data statistics request, the code and the service logic are separated according to the configuration processing data, and the configuration is performed through the management background, so that the addition, modification and deletion of the functions can be dynamically implemented, and the centralized management of the functions is performed, thereby simplifying the maintenance of the data statistics system, simplifying the online process of the new functions, reducing the online period of the new functions, further accelerating the iteration of the version of the data statistics system, simplifying the workload of the developer, and enabling the developer to concentrate on the service development. The data statistics system has lower complexity, can reduce repeated work of developers, and has higher reliability and stability.
Based on the same inventive concept, a further embodiment of the present invention provides an electronic device, see fig. 4, comprising in particular: a processor 401, a memory 402, a communication interface 403, and a communication bus 404; wherein the processor 401, the memory 402, and the communication interface 403 complete communication with each other through the communication bus 404.
The processor 401 is configured to invoke a computer program in the memory 402, where the processor executes the computer program to implement all the steps of the data statistics method described above, for example, the processor executes the computer program to implement the following procedures: and receiving a data statistics request, loading corresponding configuration according to the data statistics request, and processing data according to the configuration, wherein the data statistics request corresponds to the configuration one by one, the data is stored in a first database, and the configuration is stored in a second database different from the first database.
It will be appreciated that the refinement and expansion functions that the computer program may perform are as described with reference to the above embodiments.
Based on the same inventive concept, a further embodiment of the present invention provides a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements all the steps of the data statistics method described above, for example, the processor implements the following processes when executing the computer program: and receiving a data statistics request, loading corresponding configuration according to the data statistics request, and processing data according to the configuration, wherein the data statistics request corresponds to the configuration one by one, the data is stored in a first database, and the configuration is stored in a second database different from the first database.
It will be appreciated that the refinement and expansion functions that the computer program may perform are as described with reference to the above embodiments.
Based on the same inventive concept, a further embodiment of the present invention provides a computer program product comprising a computer program which, when executed by a processor, implements all the steps of the data statistics method described above, for example, the processor implementing the following procedure when executing the computer program: and receiving a data statistics request, loading corresponding configuration according to the data statistics request, and processing data according to the configuration, wherein the data statistics request corresponds to the configuration one by one, the data is stored in a first database, and the configuration is stored in a second database different from the first database.
It will be appreciated that the refinement and expansion functions that the computer program may perform are as described with reference to the above embodiments.
Further, the logic instructions in the memory described above may be implemented in the form of software functional units and stored in a computer-readable storage medium when sold or used as a stand-alone product. Based on this understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
The apparatus embodiments described above are merely illustrative, wherein the elements illustrated as separate elements may or may not be physically separate, and the elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purposes of the embodiment of the present invention. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
In the above-described embodiments, the various steps or methods may be implemented using software or firmware stored in a memory and executed by a suitable instruction execution system. If implemented in hardware, as in another embodiment, may be implemented using any one or combination of the following techniques, as are known in the art: discrete logic circuits having logic gates for implementing logic functions on data signals, application specific integrated circuits having suitable combinational logic gates, programmable Gate Arrays (PGAs), field Programmable Gate Arrays (FPGAs), and the like.
Furthermore, those skilled in the art will appreciate that while some embodiments described herein include some features but not others included in other embodiments, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments. For example, in the following claims, any of the claimed embodiments can be used in any combination.
Those skilled in the art will appreciate that some or all of the functions of some or all of the components in a communication device and system according to embodiments of the present invention may be implemented in practice using a microprocessor or Digital Signal Processor (DSP). The present invention may also be embodied as a device or apparatus program (e.g., a PC program and a PC program product) for performing part or all of the methods described herein. Such a program embodying the present invention may be stored on a PC readable medium, or may have the form of one or more signals. Such signals may be downloaded from an internet website, provided on a carrier signal, or provided in any other form.
From the above description of the embodiments, it will be apparent to those skilled in the art that the embodiments may be implemented by means of software plus necessary general hardware platforms, or of course may be implemented by means of hardware. Based on this understanding, the foregoing technical solution may be embodied essentially or in a part contributing to the prior art in the form of a software product, which may be stored in a computer readable storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, etc., including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform the data statistics method described in the various embodiments or some parts of the embodiments.
Moreover, in the present invention, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Furthermore, in the present disclosure, descriptions of the terms "one embodiment," "some embodiments," "examples," "particular examples," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present disclosure. In this specification, schematic representations of the above terms are not necessarily directed to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, the different embodiments or examples described in this specification and the features of the different embodiments or examples may be combined and combined by those skilled in the art without contradiction.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present invention, and are not limiting; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims (13)

1. A method of data statistics, comprising:
receiving a data statistics request, loading corresponding configuration according to the data statistics request, processing data according to the configuration,
wherein the data statistics requests are in one-to-one correspondence with the configurations and the data is stored in a first database and the configurations are stored in a second database different from the first database.
2. The method of data statistics according to claim 1, wherein,
the configuration comprises a function tag, the data statistics request comprises a request tag, and the function tag corresponds to the request tag one by one;
the loading of the corresponding configuration according to the data statistics request includes:
and determining and loading the configuration corresponding to the function label corresponding to the request label contained in the data statistics request.
3. The method of data statistics according to claim 2, wherein,
the configuration further includes at least one of a data processing script, a return results template, a data presentation template, and the data statistics request further includes a query date.
4. A data statistics method according to any one of claims 1 to 3, wherein the first database comprises one or more databases.
5. The data statistics method as recited in claim 1, further comprising:
the configuration is maintained by a background, wherein the maintenance configuration includes at least one of an add, modify, and delete configuration.
6. The data statistics method as recited in claim 4, wherein said processing data according to said configuration comprises:
a data statistics command is generated according to a data processing script included in the configuration, and data is processed according to the data statistics command.
7. The data statistics method as recited in claim 6, further comprising:
after the data processing is completed, the return result template is acquired from the configuration, and the processed data is packaged based on the return result template.
8. The data statistics method as recited in claim 7, further comprising: after the processed data is packaged, a data display template is acquired from the configuration, and the packaged data is displayed according to the data display template.
9. A data statistics apparatus, comprising: a data statistics module for receiving a data statistics request, loading a corresponding configuration according to the data statistics request, processing data according to the configuration,
wherein the data statistics requests are in one-to-one correspondence with the configurations and the data is stored in a first database and the configurations are stored in a second database.
10. A data statistics system comprising the data statistics module of claim 9, and a management background module for maintaining a configuration.
11. The data statistics system as recited in claim 10, wherein,
the data statistics module further comprises: a data processing interface for interfacing with a first database and a second database to query data from the first database or to load a configuration from the second database; and is also provided with
The management background module further comprises: and the management background service interface is used for connecting with the second database to maintain the configuration.
12. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the steps of the data statistics method according to any of claims 1-8 when the program is executed by the processor.
13. A non-transitory computer readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the steps of the data statistics method according to any of claims 1-8.
CN202111425928.0A 2021-11-22 2021-11-22 Data statistics method, device, system, electronic equipment and medium Pending CN116150235A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111425928.0A CN116150235A (en) 2021-11-22 2021-11-22 Data statistics method, device, system, electronic equipment and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111425928.0A CN116150235A (en) 2021-11-22 2021-11-22 Data statistics method, device, system, electronic equipment and medium

Publications (1)

Publication Number Publication Date
CN116150235A true CN116150235A (en) 2023-05-23

Family

ID=86372466

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111425928.0A Pending CN116150235A (en) 2021-11-22 2021-11-22 Data statistics method, device, system, electronic equipment and medium

Country Status (1)

Country Link
CN (1) CN116150235A (en)

Similar Documents

Publication Publication Date Title
US10853338B2 (en) Universal data pipeline
US11030166B2 (en) Smart data transition to cloud
US10162612B2 (en) Method and apparatus for inventory analysis
US8065315B2 (en) Solution search for software support
US7523128B1 (en) Method and system for discovering relationships
US7689582B2 (en) Data flow system and method for heterogeneous data integration environments
US9280568B2 (en) Zero downtime schema evolution
US8838654B1 (en) Data modeling system for runtime schema extensibility
US7865900B2 (en) Systems and methods for providing mockup business objects
US9507820B1 (en) Data modeling system for runtime schema extensibility
US20150317331A1 (en) Unified platform for application development
US7779047B2 (en) Pluggable merge patterns for data access services
EP1810131A2 (en) Services oriented architecture for data integration services
US20100312592A1 (en) Confirming enforcement of business rules specified in a data access tier of a multi-tier application
US11487742B2 (en) Consistency checks between database systems
US11615076B2 (en) Monolith database to distributed database transformation
Gousios et al. A platform for software engineering research
JP7373587B2 (en) Service management in DBMS
EP3657351A1 (en) Smart data transition to cloud
US11615061B1 (en) Evaluating workload for database migration recommendations
CN113885970A (en) Method, system and medium for generating report data based on script
CN116150235A (en) Data statistics method, device, system, electronic equipment and medium
Thomsen et al. Programmatic Etl
Pedersen Programmatic ETL
US11853275B2 (en) Upgrading a database management system deployed in a cloud platform

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination