CN112364086A - Business visualization method and system based on big data platform - Google Patents

Business visualization method and system based on big data platform Download PDF

Info

Publication number
CN112364086A
CN112364086A CN202011330960.6A CN202011330960A CN112364086A CN 112364086 A CN112364086 A CN 112364086A CN 202011330960 A CN202011330960 A CN 202011330960A CN 112364086 A CN112364086 A CN 112364086A
Authority
CN
China
Prior art keywords
data
business
service
module
warehouse
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011330960.6A
Other languages
Chinese (zh)
Inventor
尹亮
罗春江
刘引
周期律
张轶
张�浩
委中原
税萍
李海波
丁莉楠
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chongqing Rural Commercial Bank Co ltd
Original Assignee
Chongqing Rural Commercial Bank Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chongqing Rural Commercial Bank Co ltd filed Critical Chongqing Rural Commercial Bank Co ltd
Priority to CN202011330960.6A priority Critical patent/CN112364086A/en
Publication of CN112364086A publication Critical patent/CN112364086A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • G06F16/254Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28Databases characterised by their database models, e.g. relational or object models
    • G06F16/283Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP

Abstract

The invention discloses a business visualization method and a system based on a big data platform, wherein the system comprises a data generation module, a data exchange module, a data integration module, a data application module and a data access module; wherein: a data generation module to: acquiring data generated by a service system and externally input data, and determining that the acquired data are all service data; a data exchange module to: integrating the service data based on a preset tool and a preset standard, and transmitting the organized service data to a data integration module; a data integration module to: processing the business data by using an ETL technology, and storing the processed business data into a data warehouse; a data application module to: calling the business data in the data warehouse and sending the called business data to corresponding application; a data access module to: and calling and displaying the business data in the data warehouse. Therefore, unified management and control of corresponding service data can be achieved.

Description

Business visualization method and system based on big data platform
Technical Field
The invention relates to the technical field of information management, in particular to a service visualization method and system based on a big data platform.
Background
With the rapid development of information technology, in recent years, mobile payment, artificial intelligence, big data, universal internet, 5G, block chains and the like are popular, people gradually move from off-line to on-line in the aspects of work and life, and many demands can be realized only by logging in a website or opening an APP. For banks, no matter internal management or external business, realization of digitization and intellectualization is inevitable, however, a technical scheme capable of realizing unified management and control of corresponding business data in banks does not exist in the prior art.
Disclosure of Invention
The invention aims to provide a service visualization method and a service visualization system based on a big data platform, which can realize the unified management and control of corresponding service data.
In order to achieve the above purpose, the invention provides the following technical scheme:
a business visualization system based on a big data platform comprises a data generation module, a data exchange module, a data integration module, a data application module and a data access module; wherein:
the data generation module is configured to: acquiring data generated by a service system and externally input data, and determining that the acquired data are all service data;
the data exchange module is configured to: integrating the service data based on a preset tool and a preset specification, and transmitting the organized service data to the data integration module;
the data integration module is configured to: processing the business data by utilizing the ETL technology, and storing the processed business data into a data warehouse;
the data application module is configured to: calling the business data in the data warehouse and sending the called business data to corresponding application;
the data access module is configured to: and calling and displaying the business data in the data warehouse.
Preferably, the data integration module comprises a source data layer, a middle detail layer, a middle summary layer and a market layer; wherein:
the source data layer is configured to: collecting and loading corresponding data as service data;
the intermediate fine layer is used for: processing the service data by utilizing the ETL technology;
the intermediate summary layer is configured to: classifying the service data, and respectively storing the classified service data into corresponding storage areas;
the bazaar layer is used for: providing data support for the bazaar based on the business data in the storage area.
Preferably, the data access module includes a permission determination unit, and the permission determination unit is configured to: and determining the identity information of a user needing to access the service data in the data warehouse, and determining the service data with the access authority of the user based on the identity information so as to realize corresponding calling and displaying for the user.
Preferably, the data access module includes a login authentication unit, and the login authentication unit is configured to: and verifying login information input by a user needing to access the business data in the data warehouse, if the login information passes the verification, allowing the user to access the data warehouse, and if the login information does not pass the verification, refusing the user to access the data warehouse.
Preferably, the data access module includes a data presentation unit, and the data presentation unit is configured to: and displaying the service data called by the user in the data warehouse at a terminal corresponding to the user, wherein the terminal of the user comprises the APP, the data screen and the digital panel of the user.
Preferably, the data presentation unit includes a first data presentation subunit, and the first data presentation subunit is configured to: and graphically displaying the service data in the data warehouse called by the user at a terminal corresponding to the user.
Preferably, the data presentation unit includes a second data presentation subunit, and the second data presentation subunit is configured to: and carrying out voice broadcast on the service data in the data warehouse called by the user at a terminal corresponding to the user.
Preferably, the data application module includes a BI data tool platform and a machine learning data tool platform, and the BI data tool platform and the machine learning data tool platform are configured to: and the application calls the data analysis function to realize the corresponding data analysis function.
Preferably, the data access module includes a data retrieving unit, and the data retrieving unit is configured to: and calling the business data in the data warehouse by calling an API (application program interface) provided by the data warehouse.
A business visualization method based on a big data platform comprises the following steps:
acquiring data generated by a service system and externally input data, determining that the acquired data are all service data, and integrating the service data based on a preset tool and a preset specification;
processing the business data by utilizing the ETL technology, and storing the processed business data into a data warehouse;
calling the business data in the data warehouse and sending the called business data to corresponding application; or calling and displaying the business data in the data warehouse.
The invention provides a business visualization method and a system based on a big data platform, wherein the system comprises a data generation module, a data exchange module, a data integration module, a data application module and a data access module; wherein: the data generation module is configured to: acquiring data generated by a service system and externally input data, and determining that the acquired data are all service data; the data exchange module is configured to: integrating the service data based on a preset tool and a preset specification, and transmitting the organized service data to the data integration module; the data integration module is configured to: processing the business data by utilizing the ETL technology, and storing the processed business data into a data warehouse; the data application module is configured to: calling the business data in the data warehouse and sending the called business data to corresponding application; the data access module is configured to: and calling and displaying the business data in the data warehouse. Therefore, according to the application, after the data generation module acquires the data generated by the service system and receives the externally input data, the data exchange module integrates the data, the data integration module correspondingly processes and stores the data, and the data application module and the data access module can call the required data and then send the data to the application or display the data, so that unified management and control of the corresponding service data can be realized.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a first structural schematic diagram of a business visualization system based on a big data platform according to an embodiment of the present invention;
fig. 2 is a schematic diagram of an ETL architecture in a business visualization system based on a big data platform according to an embodiment of the present invention;
fig. 3 is a second structural schematic diagram of a business visualization system based on a big data platform according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, a service visualization system based on a big data platform according to an embodiment of the present invention is shown, which may include a data generation module, a data exchange module, a data integration module, a data application module, and a data access module; wherein:
a data generation module to: acquiring data generated by a service system and externally input data, and determining that the acquired data are all service data;
a data exchange module to: integrating the service data based on a preset tool and a preset standard, and transmitting the organized service data to a data integration module;
a data integration module to: processing the business data by using an ETL technology, and storing the processed business data into a data warehouse;
a data application module to: calling the business data in the data warehouse and sending the called business data to corresponding application;
a data access module to: and calling and displaying the business data in the data warehouse.
The data generation module can receive data generated by the business system and data input from the outside, and further transmit the data to the data exchange module as business data, wherein the data received by the data generation module specifically comprises credit management department data, risk management department data, asset management department data, personal business department data, small and micro business department data, lease data, financing sub-company data and the like. After acquiring the data sent by the data generation module, the data exchange module may integrate the data through a preset tool and specification, and further transmit the integrated data to the data integration module, specifically, the data integration may include respectively integrating and processing the data into structured data, unstructured data, and semi-structured data for corresponding storage, and may further include arranging the data in a certain order, and the like; and other settings according to actual needs are within the protection scope of the present invention. The data integration module can utilize an Extract-Transform-Load (ETL) technology to correspondingly process the data sent by the data exchange module, and then store the processed data into a data warehouse of the big data platform; the ETL is an important link of a BI (business intelligence) project, and the ETL technology is a process of loading corresponding data into a data warehouse after extraction, cleaning, conversion, and the like, and aims to integrate scattered, disordered, and non-uniform data to provide an analysis basis for enterprise decision making, so that the corresponding processing of the data by the data integration module using the ETL technology may specifically include loading, cleaning, converting, distributing, and the like of the in-line and out-of-line data. After the data is stored in the data warehouse, the data can be called for the corresponding application by the data application module, and the data can be called and displayed for the corresponding user by the data access module, so that the application or the user can quickly acquire the required data through the data warehouse, and the corresponding analysis and other operations can be realized.
According to the data integration system, after the data generation module acquires data generated by the service system and receives externally input data, the data exchange module integrates the data, the data integration module performs corresponding processing and storage on the data, and the data application module and the data access module can call required data and then send the data to an application or display the data, so that unified management and control of corresponding service data can be achieved.
It should be noted that, when the data exchange module integrates the data, the substantial content of the data is not changed, and in addition, the data may be processed by using real-time stream computation (datahub), for example, the credit system may start a monitoring mode, which needs to transmit each update of the real-time index (i.e. the data that needs to be integrated) to the real-time stream component of the real-time stream computation, and the real-time stream component transmits the update of the index to the streamcomputer for real-time stream computation, and transmits the result of computation back to the real-time stream component for storage, for obtaining when needed; and the live streaming component can turn on a subscription distribution mechanism. The functions of the data exchange module are illustrated, for example, two indexes, such as a payment amount and a credit amount, are generated by a credit system, after the data exchange module obtains data values (which may be called as source data) of the two indexes, such as the payment amount and the credit amount, corresponding data structures can be selected to be stored according to different data source formats, and the data structures may include structured data, unstructured data and semi-structured data; specifically, if the source data is structured data, such as a service data warehouse RDS, etc., it is directly stored in the form of structured data, if the source data is semi-structured data, such as consumption behavior, transaction behavior, interpersonal relationship, etc., of an individual in credit information, it is stored in the form of semi-structured data, and if the source data is unstructured data, such as pictures, sounds, video files, etc., it is stored in the form of unstructured data.
In the service visualization system based on the big data platform provided by the embodiment of the invention, the data integration module can comprise a source data layer, a middle detail layer, a middle summary layer and a market layer; wherein:
a source data layer to: collecting and loading corresponding data as service data;
an intermediate fine layer for: processing the service data by using an ETL technology;
an intermediate aggregation layer to: classifying the service data, and respectively storing the classified service data into corresponding storage areas;
a bazaar layer to: providing data support for the bazaars based on the business data in the storage area.
In this embodiment of the present application, the data integration module may include a source data layer, an intermediate detail layer, an intermediate summary layer, and a market layer, where the source data layer is a basic data layer, and may acquire data transmitted by the data exchange module to perform corresponding processing on the data, and specifically, the source data layer may load acquired data into the service visualization system in advance through an offline data acquisition module, a quasi-real-time acquisition DTS, a log data acquisition LogService, a message data synchronization databub, a source pasting data mode, and the like, and the data may be from a message queue, log data, a data warehouse RDS, a data warehouse, and the like. The middle detail layer can utilize the ETL technology to perform corresponding operations such as extraction, refining, integration and the like based on data to be applied by the marts (namely, the data marts). The storage area of the middle gathering layer can comprise a client domain, a relation domain and a basic domain, wherein the client domain is a client label library, the relation domain is an oneID and a relation model thereof, and the basic domain is a universal middle layer design for supporting marts. And the mart layer provides required data support for different marts based on the service data stored in the storage area. Therefore, the embodiment of the application effectively realizes the corresponding functions of the data integration module through the different processing layers.
The OneID method breaks a data island through unified entity identification and connection, realizes data fusion, global link, label extraction and three-dimensional portrait and is also called main data management; briefly, business entities such as users, equipment, consumers, enterprises, contents, commodities, positions and the like can be called as main data, the business entities can be mapped into Unique Identification (UID) in corresponding business data, data of all dimensions of the business entities are associated through the UID, for example, entity abstract persons, positions, commodities, families, companies, organizations and the like are mapped into UIDs, the business entities can be mapped into ID cards, equipment IDs, mobile phone numbers, application account IDs and the like, and tags such as natural attributes, social attributes, interests and industrial consumption interests are finally formed through two-dimensional code relation construction and oneID construction. The basic domain is a middle layer from top to bottom and is used as a general design for supporting the market of the application data area. The market layer can comprise marketing market, wind control market, report market, customer figures, public market and the like, data support is carried out according to specific application scenes, and complete, consistent and extensible data service is provided for upper-layer application.
It should be noted that the data acquisition channel is divided into a batch channel and a flow calculation channel. The big data platform can comprise a batch computing engine (maxcompute) and a real-time computing engine (streamcomputer), and can simultaneously build a data integration development platform (DIP), and periodically collect, load, clean, convert and distribute various structured or unstructured data through an ETL technology, so that data storage and reference are provided for OTS, ADS and RDS in the aspect of data consumption. The architecture of ETL technology corresponding to the batch computation engine (maxcompute) and the real-time computation engine (streamcompute) may be as shown in fig. 2, which may include a batch ETL architecture and a real-time ETL architecture, wherein: the batch ETL framework is responsible for acquiring data from the ODS, and loading the data to a batch data processing platform (maxcompute) in a text mode for consumption; the real-time ETL framework is responsible for collecting stream data transmitted by a message queue, a text log, a data warehouse log, and the like, and loading the stream data to a stream data processing platform (streamcomputer) through the datahub and loghub, so as to perform data consumption. The data analysis realized by the ETL technology can comprise the steps of collecting and analyzing the full-scale behaviors of the user, establishing a user portrait and restoring a user behavior model as the basis of product analysis and optimization. Specifically, the data embedding method can be used for collecting embedded data, establishing a user index system, analyzing user behaviors and establishing a user portrait through user indexes, and the data embedding is a good privatized data deployment collection mode, so that data collection is accurate, the requirements of enterprises on rough and precise removal and realization of rapid optimization and iteration of products and services are met. For example, when ETL is performed on two indexes, such as a payment amount and a credit amount, if the requirement on timeliness is not high, the two indexes are implemented by using a batch ETL framework, and if the requirement on timeliness is high, the two indexes are implemented by using a real-time ETL framework.
In the service visualization system based on the big data platform provided by the embodiment of the present invention, the data access module may include an authority determination unit, and the authority determination unit is configured to: and determining the identity information of the user needing to access the service data in the data warehouse, and determining the service data with the access authority of the user based on the identity information, so that the user can realize corresponding calling and displaying.
In order to meet the requirements of a head office product operation manager on the operation and comparison of products in a whole row range and different branch rows and the requirements of a front-line product worker on related operation states, namely different user roles, an authority determining unit can be arranged in a data access module, the authority determining unit can be realized based on an authority system and an account system, and accounts in the account system can comprise a product operation post, a product management post, a wind control post, an anti-fraud post, a head office management post, a branch row management post, a client manager post, a network site master post and the like. Correspondingly, the method and the device can determine the identity information of the user accessing the data warehouse, namely which type of account belongs to the account system, and then only allow the user to correspondingly access all service systems which the account belongs to and can access. In addition, different accounts can see different pages when accessing the data warehouse, and different accounts on the same page can also see different modules, so that the visual content can be controlled according to business needs, such as: the risk radar module can be checked only by a risk management post, and other posts have no permission.
In the service visualization system based on the big data platform provided by the embodiment of the present invention, the data access module may include a login verification unit, and the login verification unit is configured to: and verifying login information input by a user needing to access the business data in the data warehouse, if the login information passes the verification, allowing the user to access the data warehouse, and if the login information does not pass the verification, refusing the user to access the data warehouse.
In order to ensure the security and reliability of data in the data warehouse, the embodiment of the application can perform identity authentication on a user needing to access the data warehouse, namely, judge whether the input login information is correct, if so, indicate that the identity of the user can log in and realize the access of the data warehouse, otherwise, indicate that the identity of the user cannot log in and realize the access of the data warehouse.
In the service visualization system based on the big data platform provided by the embodiment of the present invention, the data access module may include a data display unit, and the data display unit is configured to: and displaying the service data called by the user in the data warehouse at a terminal corresponding to the user, wherein the terminal of the user comprises an APP (application), a data screen and a digital panel of the user.
According to the embodiment of the application, the user can select the index (data) to be displayed through the PC end interface, and the index is dragged to complete operation analysis such as addition, subtraction, multiplication, division, average number and summation of the index. The data access module can realize multi-channel terminal display, such as APP, a PC terminal, a public number, IPAD, a data screen, a digital board (or referred to as a data board) and the like, and achieves the effect of experience upgrading.
In the service visualization system based on the big data platform provided by the embodiment of the present invention, the data display unit may include a first data display subunit and a second data display subunit, and the first data display subunit is configured to: carrying out graphical display on the service data in the data warehouse called by the user at a terminal corresponding to the user; the second data presentation subunit is to: and voice broadcasting the service data in the data warehouse called by the user at the terminal corresponding to the user.
It should be noted that, this application can carry out graphical show or voice broadcast with the data that need show through cell-phone end etc. makes things convenient for corresponding personnel directly perceived to obtain, and the online product operation manager of being convenient for and operation analyst in time master product operation trend and analysis customer action to the influence of product operation state, the comprehensive operation control of the online product of being convenient for.
In the service visualization system based on the big data platform provided by the embodiment of the present invention, the data application module may include a BI data tool platform and a machine learning data tool platform, and the BI data tool platform and the machine learning data tool platform are used for: the application calls are provided to implement the corresponding data analysis functions.
It should be noted that, two data tool platforms, namely, a data analysis (BI) and a machine learning, can be set up in the data application module, and then the two data tool platforms can be called as needed to realize corresponding data analysis, thereby improving the automatic analysis level of business personnel, reducing the threshold of user data use, and promoting the data to be quickly applied to business decisions. In addition, a report unified portal can be set up, so that the unified management and access of the report are realized; and based on the specific demand condition in the row, the business scenes such as APP, wind control, marketing, customer service and the like are supported. The BI is an operation analysis tool, the machine learning platform is index AI, and the two platforms call data of the data integration module and need to pass through a data scheduling layer, a service gateway layer and an atomic service layer. Specifically, the data scheduling layer supports service scheduling modes such as HTTP, RPC online service, batch file interfaces, message queues, asynchronous callback push and the like, and meets various scene requirements such as real-time and quasi-real-time; the service gateway layer comprises service registration, service discovery, service authentication and service combination; the atomic service layer comprises a marketing service group, an operation service group, a performance service group and a report service group. Inside each group is an index system divided according to the service lines.
In the service visualization system based on the big data platform provided by the embodiment of the present invention, the data access module may include a data retrieving unit, and the data retrieving unit is configured to: and calling the business data in the data warehouse by calling an API (application program interface) provided by the data warehouse.
In order to conveniently realize data calling, the application can set a corresponding API (application programming interface) for the data warehouse, so that the business data in the data warehouse can be called through the API, and further, corresponding data operations such as analysis and processing are realized.
In a specific application scenario, a service visualization system based on a big data platform provided in an embodiment of the present invention may be as shown in fig. 3; according to the method and the system, monitoring of the whole process links of application, approval and expenditure and tracking of overdue conditions can be achieved, nearly 300 relevant indexes of buried point data are combed, and the access conditions of customers at the WeChat end and the mobile bank app end to products are monitored. The generation of indexes to the query result is real-time or quasi-real-time, the data are all data such as service operation, product performance, real-time reports and the like, the terminal is checked through a service monitoring large screen and an app end, and the management layer also has account authority to check, so that the terminal has reference value for leader management decision making and strategy adjustment. When the online business operation early warning system is applied to wind control, for example, a business lookout tower (which is a digitalized platform based on online business operation and provides professional and accurate management decision support for a user through digitalized monitoring and analysis in operation so as to achieve the purposes of optimizing operation, reducing operation cost and improving income) has pre-credit, mid-credit and post-credit in a smart early warning module, and enterprise concentration early warning, personal concentration early warning, anti-fraud index calling condition, fraud passing rate and anti-fraud rejection rate are arranged before credit; when the business lookout tower is applied to marketing, a module called a dragon and tiger list is arranged on the business lookout tower, full-line innovation line products are arranged inside the business lookout tower for marketing ranking, and according to branch lines or individual ranking, when the business lookout tower is used by a client manager, performance ranking, backlog and the like of the business lookout tower can be checked.
Therefore, the method and the system help branch management personnel and head office management personnel to quickly master performance completion conditions, branch ranking, product information and the like, and improve working efficiency; management personnel can conveniently master product operation conditions, risk indexes and organization performance in time, and management efficiency is improved; the method is beneficial to the insight of the behavior of the customer, provides more timely and professional service, effectively improves the customer experience and increases the customer satisfaction.
The embodiment of the invention also provides a service visualization method based on the big data platform, which specifically comprises the following steps:
s11: acquiring data generated by a service system and externally input data, determining that the acquired data are all service data, and integrating the service data based on a preset tool and a preset specification;
s12: processing the business data by using an ETL technology, and storing the processed business data into a data warehouse;
s13: calling the business data in the data warehouse and sending the called business data to corresponding application; or calling and displaying the business data in the data warehouse.
It should be noted that for the description of the relevant part in the service visualization method based on the big data platform provided in the embodiment of the present invention, reference is made to the detailed description of the corresponding part in the service visualization system based on the big data platform provided in the embodiment of the present invention, and details are not repeated here. In addition, parts of the above technical solutions provided in the embodiments of the present invention that are consistent with the implementation principles of the corresponding technical solutions in the prior art are not described in detail, so as to avoid redundant description.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (10)

1. A business visualization system based on a big data platform is characterized by comprising a data generation module, a data exchange module, a data integration module, a data application module and a data access module; wherein:
the data generation module is configured to: acquiring data generated by a service system and externally input data, and determining that the acquired data are all service data;
the data exchange module is configured to: integrating the service data based on a preset tool and a preset specification, and transmitting the organized service data to the data integration module;
the data integration module is configured to: processing the business data by utilizing the ETL technology, and storing the processed business data into a data warehouse;
the data application module is configured to: calling the business data in the data warehouse and sending the called business data to corresponding application;
the data access module is configured to: and calling and displaying the business data in the data warehouse.
2. The system of claim 1, wherein the data integration module comprises a source data layer, an intermediate detail layer, an intermediate summary layer, and a bazaar layer; wherein:
the source data layer is configured to: collecting and loading corresponding data as service data;
the intermediate fine layer is used for: processing the service data by utilizing the ETL technology;
the intermediate summary layer is configured to: classifying the service data, and respectively storing the classified service data into corresponding storage areas;
the bazaar layer is used for: providing data support for the bazaar based on the business data in the storage area.
3. The system of claim 2, wherein the data access module comprises a permission determination unit configured to: and determining identity information of a user needing to access the service data in the data warehouse, and determining the service data with the access authority of the user based on the identity information, so that the user can realize corresponding calling and displaying.
4. The system of claim 3, wherein the data access module comprises a login authentication unit configured to: and verifying login information input by a user needing to access the business data in the data warehouse, if the login information passes the verification, allowing the user to access the data warehouse, and if the login information does not pass the verification, refusing the user to access the data warehouse.
5. The system of claim 4, wherein the data access module comprises a data presentation unit configured to: and displaying the service data called by the user in the data warehouse at a terminal corresponding to the user, wherein the terminal of the user comprises the APP, the data screen and the digital panel of the user.
6. The system of claim 5, wherein the data presentation unit comprises a first data presentation subunit configured to: and graphically displaying the service data in the data warehouse called by the user at a terminal corresponding to the user.
7. The system of claim 6, wherein the data presentation unit comprises a second data presentation subunit configured to: and carrying out voice broadcast on the service data in the data warehouse called by the user at a terminal corresponding to the user.
8. The system of claim 7, wherein the data application module comprises a BI data tool platform and a machine learning data tool platform, the BI data tool platform and the machine learning data tool platform configured to: and the application calls the data analysis function to realize the corresponding data analysis function.
9. The system of claim 8, wherein the data access module comprises a data retrieval unit configured to: and calling the business data in the data warehouse by calling an API (application program interface) provided by the data warehouse.
10. A business visualization method based on a big data platform is characterized by comprising the following steps:
acquiring data generated by a service system and externally input data, determining that the acquired data are all service data, and integrating the service data based on a preset tool and a preset specification;
processing the business data by utilizing the ETL technology, and storing the processed business data into a data warehouse;
calling the business data in the data warehouse and sending the called business data to corresponding application; or calling and displaying the business data in the data warehouse.
CN202011330960.6A 2020-11-24 2020-11-24 Business visualization method and system based on big data platform Pending CN112364086A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011330960.6A CN112364086A (en) 2020-11-24 2020-11-24 Business visualization method and system based on big data platform

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011330960.6A CN112364086A (en) 2020-11-24 2020-11-24 Business visualization method and system based on big data platform

Publications (1)

Publication Number Publication Date
CN112364086A true CN112364086A (en) 2021-02-12

Family

ID=74532838

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011330960.6A Pending CN112364086A (en) 2020-11-24 2020-11-24 Business visualization method and system based on big data platform

Country Status (1)

Country Link
CN (1) CN112364086A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113111089A (en) * 2021-04-09 2021-07-13 重庆农村商业银行股份有限公司 Information acquisition management system and method
CN114827149A (en) * 2022-04-29 2022-07-29 北京尚谷彤邺科技发展有限公司 Transmission system, method and device for real-time communication big data
CN115174420A (en) * 2022-07-05 2022-10-11 中信百信银行股份有限公司 Safe operation method, system, terminal device and storage medium based on index measurement
US11940962B2 (en) 2021-12-09 2024-03-26 International Business Machines Corporation Preparing a database for a domain specific application using a centralized data repository

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105117587A (en) * 2015-08-04 2015-12-02 杭州健港信息科技有限公司 Medical big data based intelligent analysis method in field of medical insurance
CN108829731A (en) * 2018-05-15 2018-11-16 吉贝克信息技术(北京)有限公司 Data analysing method, system, computer readable storage medium and electric terminal
CN110232098A (en) * 2019-04-22 2019-09-13 汇通达网络股份有限公司 A kind of data warehouse administered based on data and genetic connection designs
CN110489459A (en) * 2019-08-07 2019-11-22 国网安徽省电力有限公司 A kind of enterprise-level industry number fused data analysis system based on big data platform
CN110991984A (en) * 2019-11-08 2020-04-10 卡斯柯信号有限公司 Digital operation analysis platform and method based on enterprise information heterogeneous system
CN111753034A (en) * 2020-05-20 2020-10-09 广东省国土资源测绘院 One-stop type geographical big data platform

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105117587A (en) * 2015-08-04 2015-12-02 杭州健港信息科技有限公司 Medical big data based intelligent analysis method in field of medical insurance
CN108829731A (en) * 2018-05-15 2018-11-16 吉贝克信息技术(北京)有限公司 Data analysing method, system, computer readable storage medium and electric terminal
CN110232098A (en) * 2019-04-22 2019-09-13 汇通达网络股份有限公司 A kind of data warehouse administered based on data and genetic connection designs
CN110489459A (en) * 2019-08-07 2019-11-22 国网安徽省电力有限公司 A kind of enterprise-level industry number fused data analysis system based on big data platform
CN110991984A (en) * 2019-11-08 2020-04-10 卡斯柯信号有限公司 Digital operation analysis platform and method based on enterprise information heterogeneous system
CN111753034A (en) * 2020-05-20 2020-10-09 广东省国土资源测绘院 One-stop type geographical big data platform

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113111089A (en) * 2021-04-09 2021-07-13 重庆农村商业银行股份有限公司 Information acquisition management system and method
US11940962B2 (en) 2021-12-09 2024-03-26 International Business Machines Corporation Preparing a database for a domain specific application using a centralized data repository
CN114827149A (en) * 2022-04-29 2022-07-29 北京尚谷彤邺科技发展有限公司 Transmission system, method and device for real-time communication big data
CN115174420A (en) * 2022-07-05 2022-10-11 中信百信银行股份有限公司 Safe operation method, system, terminal device and storage medium based on index measurement

Similar Documents

Publication Publication Date Title
US10896203B2 (en) Digital analytics system
CN112241924B (en) Wisdom gas system
CN112364086A (en) Business visualization method and system based on big data platform
US7181417B1 (en) System and method for revenue generation in an automatic, real-time delivery of personalized informational and transactional data
CN104809634B (en) Tourism data is investigated and monitoring system
CN105303300A (en) Intelligent product maintenance platform system and intelligent product maintenance method
JP2017500621A (en) Personal big data collection, management and authorization system and method
CN101576988A (en) Credit data interactive system and interactive method
CN107784577A (en) A kind of credit product distribution and recommendation method and the system for realizing this method
CN106156902A (en) Real estate marketing management system
KR102295636B1 (en) System and method for providing of trading area information using big data
KR102203893B1 (en) System for automating customer management using auto-call based on Artificial Intelligence and method thereof
CN106779104A (en) A kind of campus maintenance service system and method based on mobile terminal
CN111639983A (en) Intelligent farmer market information management system based on one cloud and multiple ends
CN114707914B (en) Supply and marketing management center platform system based on SaaS framework
KR101313158B1 (en) Cloud service platform system of damage assessment
CN107977855B (en) Method and device for managing user information
Kaswan et al. Big data in insurance innovation
US11190643B1 (en) Automated redistribution of queries to underutilized channels
CN112308698B (en) WeChat end loan product management method and system supporting second-level legal person
Migdadi Proposed typologies of banking operations strategy
CN115567563B (en) Comprehensive transportation hub monitoring and early warning system based on end edge cloud and control method thereof
CN111461365A (en) Installation, maintenance and operation integrated autonomous sharing service platform system
Stone et al. Interactive marketing, customer information and marketing research
CN115880077A (en) Recommendation method and device based on client label, electronic device and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination