CN112417010A - User group tracking analysis system and method based on configuration - Google Patents

User group tracking analysis system and method based on configuration Download PDF

Info

Publication number
CN112417010A
CN112417010A CN202011228852.8A CN202011228852A CN112417010A CN 112417010 A CN112417010 A CN 112417010A CN 202011228852 A CN202011228852 A CN 202011228852A CN 112417010 A CN112417010 A CN 112417010A
Authority
CN
China
Prior art keywords
query
data
multidimensional
configuration
user group
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
CN202011228852.8A
Other languages
Chinese (zh)
Inventor
彭浩
李柯辰
何伟
唐宏禹
魏战松
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhuhai Zhuohuan Technology Co ltd
Original Assignee
Zhuhai Zhuohuan Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhuhai Zhuohuan Technology Co ltd filed Critical Zhuhai Zhuohuan Technology Co ltd
Priority to CN202011228852.8A priority Critical patent/CN112417010A/en
Publication of CN112417010A publication Critical patent/CN112417010A/en
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/248—Presentation of query results
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/70—Game security or game management aspects
    • A63F13/79—Game security or game management aspects involving player-related data, e.g. identities, accounts, preferences or play histories
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Computational Linguistics (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • Computer Security & Cryptography (AREA)
  • General Business, Economics & Management (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention relates to a technical scheme of a user group tracking and analyzing system and method based on configuration, which comprises the following steps: obtaining game log data, and partitioning the game log data; s200, storing the game service data through a multi-dimensional database; s300, generating a corresponding multidimensional query condition for a query request of a user through an interactive interface; and S400, executing query to the multidimensional database according to the ad hoc query conditions, and generating a corresponding ad hoc report. The invention has the beneficial effects that: the game data are stored in a partitioned and multidimensional mode, and quick data display is conducted on business requirements through multidimensional query.

Description

User group tracking analysis system and method based on configuration
Technical Field
The invention relates to the field of computers, in particular to a user group tracking and analyzing system and method based on configuration.
Background
In recent years, a business problem currently encountered is that when a business needs to temporarily view user data or perform tracking query on a user, query is generally performed through a business data center, and the business data center provides four types of forms of data, including: conventional requirements-report, deep interpretation-unscheduled subject report, system integration/reprocessing-data model table; temporary enumeration/analysis-manual support/business self-help product.
The current report lacks flexibility, only a small number of established dimensions and indexes can be seen, data displayed in the report needs to be well converged by ETL in advance, development efficiency is low, and maintenance cost is high; the temporary data extraction/analysis has no technical background or is weak on the data demand side (general product/operation manager), the demand is complicated/random/time-critical and cannot be met at the first time.
Disclosure of Invention
The invention aims to solve at least one technical problem in the prior art, and provides a user group tracking analysis system and method based on configuration.
The technical scheme of the invention comprises a user group tracking and analyzing system based on configuration, which is characterized by comprising the following components: the data acquisition module is used for acquiring game log data and partitioning the game log data; the data storage module is used for storing the game service data through the multi-dimensional database; the configuration query module is used for generating corresponding multidimensional query conditions for the query requests of the users through an interactive interface; and the report generation module is used for executing query to the multidimensional database according to the ad hoc query condition and generating a corresponding ad hoc report.
The system for tracking and analyzing a user group based on configuration is characterized in that the data acquisition module comprises: and reading the log data generated by the game, and performing characteristic partitioning on the corresponding game log data according to the dimension, the row, the column, the granularity and the time effectiveness.
The profiling-based user group tracking analysis system according to the present invention, wherein the data storage module comprises: the game log data aggregation device is used for automatically aggregating game log data of the partitions to coarse granularity in advance according to aggregation rules, wherein the aggregation rules can be set in a self-defined mode, and the aggregation mode of the game log data comprises data and/or a data table.
The system for profiling based user group tracking analysis according to the present invention is characterized in that the multidimensional database is configured to: based on star relational database, it is composed of many different types of databases, and according to data inquiry request, it automatically routes to the most suitable storage engine and table for inquiry, and according to the standard interface of storage engine and storage table type, it automatically routes.
The system for tracking and analyzing a user group based on configuration is characterized in that the configuration query module comprises: the condition editing module is used for carrying out self-defined selection on the query conditions in a dragging mode of the interactive interface, wherein the query conditions comprise any combination of one or more of query subjects, query tables, query dimensions and query indexes, and the query conditions are generated; and the data query module extracts data from the automatic route to the optimal database based on the multidimensional model operation primitive according to the query condition.
According to the user group tracking and analyzing system based on configuration, the data query module further comprises: and constructing a multidimensional model of the query condition, and automatically displaying, filtering and summarizing the service and service data with the authority according to the authority associated with the query condition, wherein the multidimensional model carries out multidimensional storage on the row, column, granularity and timeliness of the data according to a storage engine corresponding to the database.
According to the user group tracking and analyzing system based on configuration, the report generating module comprises: the query mode comprises ad hoc query, offline query and self-service query, wherein the ad hoc query is subjected to multidimensional query through MDX, and the offline query and the self-service query are subjected to query through SQL (structured query language) and an ad hoc two-dimensional mode.
According to the user group tracking and analyzing system based on configuration, the report generating module further comprises: and directly returning the query data of the query condition, or returning a query statement, and correspondingly processing the query statement according to the requirements of the interactive interface.
The system for profiling based user group tracking analysis according to the present invention further comprises: data query and analysis are provided through JDBC, JOLAP and XMLA specification interfaces.
The technical scheme of the invention also comprises a user group tracking and analyzing method based on configuration, which is characterized by comprising the following steps: s100, obtaining game log data and partitioning the game log data; s200, storing the game service data through a multi-dimensional database; s300, generating a corresponding multidimensional query condition for a query request of a user through an interactive interface; and S400, executing query to the multidimensional database according to the ad hoc query conditions, and generating a corresponding ad hoc report.
The invention has the beneficial effects that: the game data are stored in a partitioned and multidimensional mode, and quick data display is conducted on business requirements through multidimensional query.
Drawings
The invention is further described below with reference to the accompanying drawings and examples;
FIG. 1 is a block diagram of a system according to an embodiment of the invention;
FIG. 2 is a diagram illustrating a multidimensional database according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of system interaction according to an embodiment of the present invention;
fig. 4 is a flow chart of a method according to an embodiment of the present invention.
Detailed Description
Reference will now be made in detail to the present preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to like elements throughout.
In the description of the present invention, the meaning of a plurality of means is one or more, the meaning of a plurality of means is two or more, and larger, smaller, larger, etc. are understood as excluding the number, and larger, smaller, inner, etc. are understood as including the number.
In the description of the present invention, the consecutive reference numbers of the method steps are for convenience of examination and understanding, and the implementation order between the steps is adjusted without affecting the technical effect achieved by the technical solution of the present invention by combining the whole technical solution of the present invention and the logical relationship between the steps.
In the description of the present invention, unless otherwise explicitly defined, terms such as set, etc. should be broadly construed, and those skilled in the art can reasonably determine the specific meanings of the above terms in the present invention in combination with the detailed contents of the technical solutions.
FIG. 1 is a block diagram of a system according to an embodiment of the invention, the system comprising: the data acquisition module is used for acquiring game log data and partitioning the game log data; the data storage module is used for storing the game service data through the multi-dimensional database; the configuration query module is used for generating corresponding multidimensional query conditions for the query requests of the users through an interactive interface; and the report generation module is used for executing query to the multidimensional database according to the ad hoc query conditions and generating a corresponding ad hoc report.
Fig. 2 is a schematic diagram of a multidimensional database structure according to an embodiment of the present invention, including a storage engine, a query processing mechanism, a query mode, and a data interface, where the database according to the technical solution of the present invention supports Master data and a data bus, and supports a semi-accumulation index, based on a star-type modeling of a relational database; the data architecture is a HOLAP architecture, when partitions of the data table are created, the partitions are automatically pre-converged to coarse granularity according to rules, the query performance of coarse granularity data is improved, and a pre-converged combination is designated during modeling or an ETL pre-converged table is added during modeling. The storage engine comprises a drive storage driver, an ES storage driver and an SQL storage driver; the query language comprises MDX and SQL, wherein the MDX is used for inquiring the extension index of the With Member statement in an ad hoc multidimensional way, and the commonly used Member function is as follows: such as Parent, despendants, Children, PreMember, etc., completing indexes such as ring ratio and geometric proportion, expanding the syntax of the MDX, simplifying the use of the MDX, such as [ Time ] [. multidot. ]. [01] representing No. 1 of all months in all years; SQL is used for inquiring and reducing the use threshold of the multidimensional database in an ad hoc and offline two-dimensional mode, and has good relevance; the data interface comprises XLMA, JDBC and OLAP and is an industry standard interface; the data query mode is to process multidimensional operation primitives and execute corresponding logic plans according to the multidimensional query service model.
FIG. 3 is a schematic diagram of interaction of a system according to an embodiment of the present invention, which collects and partitions data from a plurality of game services, such as game log 1 and game log 2 … …, and stores the data in different storage engines (storage engine 1 and storage engine 2 … … in the figure) and tables according to characteristics of rows, columns, granularity, and timeliness, and analyzes query statements during query and automatically routes the query statements to the most suitable storage engine and table; at the same time, for rank data authority control
Data control to rows for dimension
Controlling to traffic classification for indicators
The query statement does not need to care about data authority, and the bottom layer can automatically filter during query
“[Game].[WEB].Children ON ROWS”
Games which only show the authority
“[Game].[WEB]ON ROWS”
Only game data with authority will be summarized
With reference to the embodiment of fig. 2, data required by a service is constructed as a multidimensional model, a self-service product displays a model structure of the multidimensional model, a user drags and sets a query condition according to a requirement through a query interface, a multidimensional database finds an optimal storage engine and table according to the query condition, and returns a native status (such as HiveSql) corresponding to the storage engine, the self-service system then reprocesses the SQL on the basis and throws the SQL back to the storage engine for execution, the multidimensional database can not only directly return query data, but also can return only SQL without returning data, a product layer is processed according to requirements, the use scene of the multidimensional database is greatly improved, and the query mode includes ad hoc query, offline query and the like according to requirements. Based on the multidimensional database and the corresponding mode thereof, the invention completes the rapid generation of the business data report, and meanwhile, the multidimensional database per se: the specification covers, uses the external tool to dock, suitable for the development of the storage engine, and also includes to the upper application: the system comprises a multi-dimensional rendering control, a report development platform and more self-service functions.
Fig. 3 is a flow chart of a method according to an embodiment of the present invention. The process comprises the following steps: s100, obtaining game log data and partitioning the game log data; s200, storing the game service data through a multi-dimensional database; s300, generating a corresponding multidimensional query condition for a query request of a user through an interactive interface; and S400, executing query to the multidimensional database according to the ad hoc query conditions, and generating a corresponding ad hoc report.
The embodiments of the present invention have been described in detail with reference to the accompanying drawings, but the present invention is not limited to the above embodiments, and various changes can be made within the knowledge of those skilled in the art without departing from the gist of the present invention.

Claims (10)

1. A system for profiling-based user group tracking analysis, the system comprising:
the data acquisition module is used for acquiring game log data and partitioning the game log data;
the data storage module is used for storing the game service data through the multi-dimensional database;
the configuration query module is used for generating corresponding multidimensional query conditions for the query requests of the users through an interactive interface;
and the report generation module is used for executing query to the multidimensional database according to the ad hoc query condition and generating a corresponding ad hoc report.
2. The configuration-based user group tracking analysis system of claim 1, wherein the data collection module comprises:
and reading the log data generated by the game, and performing characteristic partitioning on the corresponding game log data according to the dimension, the row, the column, the granularity and the time effectiveness.
3. The configuration-based user group tracking analytics system of claim 1, wherein the data storage module comprises:
the game log data aggregation device is used for automatically aggregating game log data of the partitions to coarse granularity in advance according to aggregation rules, wherein the aggregation rules can be set in a self-defined mode, and the aggregation mode of the game log data comprises data and/or a data table.
4. The configuration-based user group tracking analytics system of claim 1, wherein the multidimensional database is configured to:
based on star relational database, it is composed of many different types of databases, and according to data inquiry request, it automatically routes to the most suitable storage engine and table for inquiry, and according to the standard interface of storage engine and storage table type, it automatically routes.
5. The configuration-based user group tracking analysis system of claim 1, wherein the configuration query module comprises:
the condition editing module is used for carrying out self-defined selection on the query conditions in a dragging mode of the interactive interface, wherein the query conditions comprise any combination of one or more of query subjects, query tables, query dimensions and query indexes, and the query conditions are generated;
and the data query module extracts data from the automatic route to the optimal database based on the multidimensional model operation primitive according to the query condition.
6. The configuration-based user group tracking analysis system of claim 5, wherein the data query module further comprises:
and constructing a multidimensional model of the query condition, and automatically displaying, filtering and summarizing the service and service data with the authority according to the authority associated with the query condition, wherein the multidimensional model carries out multidimensional storage on the row, column, granularity and timeliness of the data according to a storage engine corresponding to the database.
7. The configuration-based user group tracking analysis system of claim 1, wherein the report generation module comprises:
the query mode comprises ad hoc query, offline query and self-service query, wherein the ad hoc query is subjected to multidimensional query through MDX, and the offline query and the self-service query are subjected to query through SQL (structured query language) and an ad hoc two-dimensional mode.
8. The configuration-based user group tracking analysis system of claim/7, wherein the report generation module further comprises:
and directly returning the query data of the query condition, or returning a query statement, and correspondingly processing the query statement according to the requirements of the interactive interface.
9. The system of claim/7, further comprising:
data query and analysis are provided through JDBC, JOLAP and XMLA specification interfaces.
10. A user group tracking analysis method based on configuration is characterized by comprising the following steps:
s100, obtaining game log data and partitioning the game log data;
s200, storing the game service data through a multi-dimensional database;
s300, generating a corresponding multidimensional query condition for a query request of a user through an interactive interface;
and S400, executing query to the multidimensional database according to the ad hoc query conditions, and generating a corresponding ad hoc report.
CN202011228852.8A 2020-11-06 2020-11-06 User group tracking analysis system and method based on configuration Withdrawn CN112417010A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011228852.8A CN112417010A (en) 2020-11-06 2020-11-06 User group tracking analysis system and method based on configuration

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011228852.8A CN112417010A (en) 2020-11-06 2020-11-06 User group tracking analysis system and method based on configuration

Publications (1)

Publication Number Publication Date
CN112417010A true CN112417010A (en) 2021-02-26

Family

ID=74780439

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011228852.8A Withdrawn CN112417010A (en) 2020-11-06 2020-11-06 User group tracking analysis system and method based on configuration

Country Status (1)

Country Link
CN (1) CN112417010A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114405002A (en) * 2022-01-25 2022-04-29 深圳市飞鸟与鱼科技开发有限公司 Internet game data intelligent storage analysis management system
CN114443683A (en) * 2021-12-16 2022-05-06 广东电网有限责任公司 System, method, device and medium for on-site query of automatic operation of power grid equipment

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114443683A (en) * 2021-12-16 2022-05-06 广东电网有限责任公司 System, method, device and medium for on-site query of automatic operation of power grid equipment
CN114405002A (en) * 2022-01-25 2022-04-29 深圳市飞鸟与鱼科技开发有限公司 Internet game data intelligent storage analysis management system

Similar Documents

Publication Publication Date Title
EP3695289B1 (en) Using an object model of heterogeneous data to facilitate building data visualizations
US9747360B2 (en) Mapping non-relational database objects into a relational database model
US7689553B2 (en) Execution cost reduction of sampled queries in a database
US7363287B2 (en) OLAP query generation engine
US10585887B2 (en) Multi-system query execution plan
US8799209B2 (en) Data aggregation module supporting dynamic query responsive aggregation during the servicing of database query requests provided by one or more client machines
US6223171B1 (en) What-if index analysis utility for database systems
EP2341451A1 (en) Optimizing data transfer time on graphics processor units
Chai et al. Crowdsourcing database systems: Overview and challenges
US20070027904A1 (en) System and method for translating between relational database queries and multidimensional database queries
CN106933833B (en) Method for quickly querying position information based on spatial index technology
WO2015060893A1 (en) Systems and methods for interest-driven data visualization systems utilizing visualization image data and trellised visualizations
JP2003526159A (en) Multidimensional database and integrated aggregation server
CN112417010A (en) User group tracking analysis system and method based on configuration
US20080288525A1 (en) System and method for sparsity removal
CN101556602B (en) Memory OLAP What-if analytical method based on a difference table
US20170031980A1 (en) Visual Aggregation Modeler System and Method for Performance Analysis and Optimization of Databases
CN110489441B (en) Big data-based ad hoc query method and equipment
JPH1055367A (en) Data utilization system
Jiang et al. Cohort query processing
Haynes et al. High performance analysis of big spatial data
CN111563081A (en) Vector element parallel computing method and device, storage medium and terminal
US20040015507A1 (en) System and method for analytically modeling data organized according to related attributes
CN106682173B (en) A kind of social security big data OLAP preprocess method and on-line analysis querying method
Jarke et al. Multidimensional data models and aggregation

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WW01 Invention patent application withdrawn after publication
WW01 Invention patent application withdrawn after publication

Application publication date: 20210226