CN115795400A - Application fusion framework oriented to big data analysis - Google Patents
Application fusion framework oriented to big data analysis Download PDFInfo
- Publication number
- CN115795400A CN115795400A CN202310075868.7A CN202310075868A CN115795400A CN 115795400 A CN115795400 A CN 115795400A CN 202310075868 A CN202310075868 A CN 202310075868A CN 115795400 A CN115795400 A CN 115795400A
- Authority
- CN
- China
- Prior art keywords
- data
- behavior
- application
- request
- platform
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Data Exchanges In Wide-Area Networks (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention relates to an application fusion framework facing big data analysis, which comprises a fusion portal platform, a capability opening platform and a data management platform, wherein the fusion portal platform is used for supporting unified user management, unified application management, unified authentication, unified authorization and single sign-on; the capability open platform is used for providing a unified data sharing exchange service, a unified message service, a unified Internet of things service and a unified AI service; the data management platform is used for providing data acquisition and aggregation, data standardization, main data management, metadata management and data quality management. The invention realizes the fusion of the business data and the behavior data and provides a foundation for big data application. And the data sharing exchange service of the capability open platform is opened to the application, so that conditions are created for big data analysis of the application.
Description
Technical Field
The invention relates to the technical field of big data processing and analysis, in particular to an application fusion framework oriented to big data analysis.
Background
With the continuous development of the information era, the current situation and characteristics of the informatization of government agencies and enterprises in various industries are as follows: the service application is multiple, the service application is built by different manufacturers, the application is built in a scattered manner, data among the applications cannot be effectively shared, users use services from various application inlets, the experience is poor, and the application and user behavior data cannot be effectively used for big data analysis.
Service applications built by various manufacturers cannot be effectively fused, the applications and users do not realize unified management, the data standards of the applications are not unified, and the data cannot be effectively fused. Application behavior data and user behavior data are not fully utilized, and fusion and innovation of service data and behavior data are difficult.
Disclosure of Invention
In view of this, an object of the embodiment of the present application is to provide an application fusion framework oriented to big data analysis, where the fusion framework is designed to include a fusion portal platform, a capability opening platform, and a data governance platform, and fusion of business data and behavior data is implemented through a behavior registration unit and a behavior acquisition gateway, so as to provide a basis for big data application.
In order to achieve the purpose, the invention provides the following technical scheme:
according to a first aspect of the invention, an application fusion framework facing big data analysis is provided, which comprises a fusion portal platform, a capability opening platform and a data governance platform, wherein the fusion portal platform is used for supporting unified user management, unified application management, unified authentication, unified authorization and single sign-on, the fusion portal platform comprises a behavior acquisition gateway, and the behavior acquisition gateway is used for processing all HTTP requests and responses of interaction of an application client and a server in the fusion portal platform;
the capability open platform is used for providing a unified data sharing exchange service, a unified message service, a unified Internet of things service and a unified AI service; the data management platform is used for providing data acquisition and aggregation, data standardization, main data management, metadata management and data quality management.
As a further scheme of the present invention, the converged portal platform includes a PC end and a mobile end, and is further configured to allow a user to access an application client, where the application client accesses an application server through an HTTP protocol.
As a further aspect of the present invention, the capability opening platform is further configured to provide a unified data sharing exchange service, a unified message service, a unified internet of things service, and a unified AI service through an API (application program interface) of the HTTP protocol.
As a further scheme of the present invention, the capability open platform includes a behavior registration unit and a behavior acquisition gateway, the behavior registration unit is configured to accept behavior registration of each application, and the behavior acquisition gateway is configured to process HTTP requests and responses of all applications accessing the capability development platform application.
As a further scheme of the invention, the behavior acquisition gateway of the fusion portal platform accesses an application server of an application library through an HTTP protocol, and the application library comprises an application database.
As a further scheme of the invention, behavior log databases are arranged in the behavior acquisition gateway of the fusion portal platform and the behavior acquisition gateway of the capability opening platform.
As a further scheme of the present invention, the data governance platform is further configured to collect data from the application database and the behavior log database at the same time, and classify the data after governance to form a subject library including behavior data, where the subject library includes a business data subject library and a behavior subject library.
As a further scheme of the present invention, the data sharing exchange service of the capability opening platform is further configured to open the data of the business data topic library and the behavior topic library to an application, so as to create conditions for big data analysis of the application.
As a further aspect of the present invention, the behavior registration unit is further configured to implement behavior registration through an HTTP protocol feature defining a behavior, and define an HTTP request forwarding target and a data parsing rule of the behavior, where the HTTP protocol feature includes: request type, request URL, request parameter, response status code, response head and response body; the forwarding target comprises a forwarding host and a port, and the information of the behavior registration is stored in a database of the behavior registration unit.
As a further aspect of the present invention, the behavior collection gateway includes an interceptor, a forwarder, and an analyzer, and the step of processing the HTTP request by the behavior collection gateway through the interceptor and the forwarder includes:
the method comprises the steps that a repeater acquires a forwarding rule list, wherein the repeater acquires the forwarding rule list from a behavior registration information database, the forwarding rule list comprises HTTP characteristics and forwarding targets, and the HTTP characteristics comprise a request method, a URL (uniform resource locator) and a forwarding host port;
the interceptor receives an HTTP request of an application and caches the received request data;
the interceptor forwards the request to the forwarder;
the repeater forwards the request, wherein a request line is analyzed from the request message to obtain a request method and a URL (uniform resource locator), a corresponding host and a corresponding port are found out from the forwarding rule list according to the request method and the URL, the request data are forwarded according to the host and the port, and the host and the port in the URL in the request line are modified to be the host port of a forwarding target;
the transponder receives the response;
the repeater forwards the response data to the interceptor;
the interceptor processes the response data, wherein the cached request message and the received response message are put into a queue to be processed;
the interceptor returns an HTTP response to the application.
As a further aspect of the present invention, the step of processing the queue data by the analyzer of the behavior collection gateway includes:
the method comprises the steps that an analyzer acquires behavior data, wherein the analyzer acquires behaviors, HTTP characteristics and data analysis rules from a behavior registration information database;
the analyzer acquires a data element to be processed from the queue to be processed;
the analyzer identifies behaviors, wherein the analyzer analyzes a request line from a request message in a data element to obtain a request method and a URL (Uniform resource locator), and identifies corresponding behaviors according to the matching of the request method, the URL and HTTP characteristics;
the analyzer generates a behavior log, wherein the analyzer analyzes high-value core data from request data and response data by using a semi-structured analysis technology according to a data analysis rule to form the behavior log;
the analyzer saves the behavior log, wherein the behavior log is saved to a behavior log database.
According to a second aspect of embodiments of the present invention, there is provided a computer apparatus comprising:
a processor; and a storage device, configured to store one or more programs, which when executed by the one or more processors, cause the one or more processors to implement the steps in the big data analytics oriented application fusion architecture as described in the first aspect of the embodiments.
According to a third aspect of the present invention, there is provided a computer readable storage medium, on which a computer program is stored, which when executed by a processor, implements the steps in the big data analytics oriented application fusion architecture as described in the first aspect of the embodiments above.
The technical scheme provided by the embodiment of the invention can have the following beneficial effects:
according to the application fusion framework oriented to big data analysis, the data management platform collects the behavior log applied to the fusion portal and the behavior log applied to the application access capability open platform, and forms the theme library of the business data and the behavior data after management, so that fusion of the business data and the behavior data is realized, and a foundation is provided for big data application. And the data sharing exchange service of the capacity open platform is opened to the application, so that conditions are created for big data analysis of the application.
These and other aspects of the present application will be more readily apparent from the following description of the embodiments. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application. In the drawings:
FIG. 1 is a diagram schematically illustrating an overall architecture of a big data analytics oriented application fusion architecture in an exemplary embodiment of the invention;
fig. 2 is an architecture diagram schematically illustrating a behavior registration unit and a behavior collection gateway in an application fusion architecture oriented to big data analysis according to an exemplary embodiment of the present invention;
fig. 3 is a flow chart schematically illustrating HTTP request processing by behavior collection gateway interceptors and forwarders in a big data analytics oriented application fusion architecture according to an exemplary embodiment of the present invention;
fig. 4 is a flowchart schematically illustrating processing of queue data by a behavior collection gateway analyzer in a big data analysis oriented application fusion architecture according to an exemplary embodiment of the present invention;
FIG. 5 schematically illustrates a block diagram of a computer system suitable for use with the computer device used to implement the exemplary embodiments of this invention.
The objectives, features, and advantages of the present application will be further described with reference to the accompanying drawings.
Detailed Description
The present application is further described with reference to the accompanying drawings and the detailed description, and it should be noted that, in the case of no conflict, any combination between the embodiments or technical features described below may form a new embodiment.
It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application without making any creative effort belong to the protection scope of the present application.
The flow diagrams depicted in the figures are merely illustrative and do not necessarily include all of the elements and operations/steps, nor do they necessarily have to be performed in the order depicted. For example, some operations/steps may be decomposed, combined or partially combined, so that the actual execution order may be changed according to the actual situation.
Some embodiments of the present application will be described in detail below with reference to the accompanying drawings. The embodiments described below and the features of the embodiments can be combined with each other without conflict.
The current state and characteristics of informatization of government agencies and enterprises in various industries are as follows: the service application is many, and is built by different manufacturers, and the application is scattered and built, and the data can not effectively be shared between the applications, and the user uses the service from each application entrance, and experience is not good, and application and user behavior data can not effectively be used for big data analysis. Business applications built by various manufacturers cannot be effectively fused, the applications and users do not realize unified management, data standards of various applications are not unified, and data cannot be effectively fused. Application behavior data and user behavior data are not fully utilized. The business data and the behavior data are fused and innovated difficultly.
Based on the above reasons, embodiments of the present application provide an application fusion framework oriented to big data analysis, which can implement fusion of business data and behavior data through designing a fusion framework including a fusion portal platform, a capability opening platform, and a data governance platform, and through a behavior registration unit and a behavior acquisition gateway, and provide a basis for big data application.
In some embodiments, the application fusion architecture for big data analysis may be applied to a computer device, which may be a device with display and processing functions, such as a PC, a portable computer, a mobile terminal, and the like, but is not limited thereto.
Referring to fig. 1, fig. 1 is a general architecture diagram of an application fusion architecture oriented to big data analysis according to the present application. In an embodiment of the present application, the application fusion framework for big data analysis provided in this embodiment includes a fusion portal platform, a capability opening platform, and a data governance platform. The converged portal platform is used for supporting unified user management, unified application management, unified authentication, unified authorization and single sign-on. The capability opening platform is used for providing a unified data sharing exchange service, a unified message service, a unified Internet of things service and a unified AI service. The data management platform is used for providing data acquisition and aggregation, data standardization, main data management, metadata management and data quality management.
The integrated portal platform is used as a platform for integrating all applications, the integrated portal platform comprises a PC end and a mobile end, the integrated portal platform is also used for a user to access an application client, and the application client accesses an application server through an HTTP protocol. Referring to fig. 1, the converged portal platform includes a behavior collection gateway, and the behavior collection gateway is configured to process all HTTP requests and responses of interaction between a built-in application client and a server of the converged portal platform.
Referring to fig. 1, the capability opening platform is further configured to provide a unified data sharing exchange service, a unified message service, a unified internet of things service, and a unified AI service through an API (application program interface) of the HTTP protocol.
In this embodiment, the capability open platform includes a behavior registration unit and a behavior acquisition gateway, where the behavior registration unit is configured to accept behavior registration of each application, and the behavior acquisition gateway is configured to process HTTP requests and responses of all applications accessing the capability development platform application.
As shown in fig. 1, the behavior collection gateway of the converged portal platform further accesses an application server of an application library through an HTTP protocol, where the application library includes an application database. And behavior log databases are arranged in the behavior acquisition gateway of the fusion portal platform and the behavior acquisition gateway of the capacity open platform.
The data management platform is also used for collecting data from the application database and the behavior log database at the same time, and after data management, a subject library containing behavior data is formed by classification, wherein the subject library comprises a business data subject library and a behavior subject library.
In this embodiment, the data sharing exchange service of the capability opening platform is further configured to open the data of the business data topic library and the behavior topic library to an application, so as to create conditions for big data analysis of the application.
Referring to fig. 2, in the application fusion architecture for big data analysis according to the embodiment of the present invention, the behavior registration unit is further configured to implement behavior registration by defining HTTP protocol features of a behavior, and define an HTTP request forwarding target and a data parsing rule of the behavior. Wherein the HTTP protocol features include: request type, request URL, request parameter, response status code, response head and response body; the forwarding target comprises a forwarding host and a port, and the information of the behavior registration is stored in a database of the behavior registration unit.
Referring to fig. 2, the behavior collection gateway includes an interceptor, a repeater, and an analyzer. Referring to fig. 3, the step of the behavior collection gateway processing the HTTP request through the interceptor and the forwarder includes:
s1, a repeater acquires a forwarding rule list. The repeater acquires a forwarding rule list from the behavior registration information database, wherein the forwarding rule list comprises HTTP characteristics and forwarding targets thereof, and the HTTP characteristics comprise a request method, a URL (uniform resource locator) and forwarding host ports thereof.
S2, the interceptor receives an HTTP request of the application. And caching the accepted request data.
And S3, the interceptor forwards the request to the forwarder.
And S4, the repeater forwards the request. And analyzing the request line from the request message to obtain a request method and a URL. And finding out the corresponding host and port from the forwarding rule list according to the request method and the URL. Depending on the host and port, the request data (request line, request header, message body) is forwarded. The host and port in the URL in the request line are modified to the host port of the forwarding target.
And S5, the repeater receives the response.
And S6, the repeater forwards the response data to the interceptor.
And S7, processing the response data by the interceptor. And the cached request message and the received response message are placed in a queue to be processed.
And S8, the interceptor returns the HTTP response to the application.
Referring to fig. 4, the step of processing the queue data by the analyzer of the behavior collection gateway includes:
s101, an analyzer acquires behavior data, wherein the analyzer acquires behaviors, HTTP characteristics and data analysis rules from a behavior registration information database;
s102, an analyzer acquires a data element to be processed from a queue to be processed;
s103, an analyzer identifies behaviors, wherein the analyzer analyzes a request line from a request message in a data element to obtain a request method and a URL (Uniform resource locator), and identifies corresponding behaviors according to the request method, the URL and HTTP feature matching;
s104, an analyzer generates a behavior log, wherein the analyzer analyzes high-value core data from request data and response data by using a semi-structured analysis technology according to a data analysis rule to form the behavior log;
s105, the analyzer saves the behavior log, wherein the behavior log is saved in a behavior log database.
In the embodiment of the present invention, when the behavior collection gateway is designed, it may be implemented that: the method comprises the steps of (1) uniformly processing requests initiated by applications, (2) uniformly identifying behaviors, (3) uniformly analyzing HTTP data, (4) uniformly generating behavior logs, and (5) realizing complex function decoupling and having good processing performance by designing three modules, namely an interceptor, a forwarder and an analyzer.
According to the application fusion framework oriented to big data analysis, the data management platform collects the behavior log applied to the fusion portal and the behavior log applied to the application access capability open platform, and forms the theme library of the business data and the behavior data after management, so that fusion of the business data and the behavior data is realized, and a foundation is provided for big data application. And the data sharing exchange service of the capability open platform is opened to the application, so that conditions are created for big data analysis of the application.
It is to be noted that the above-mentioned figures are only schematic illustrations of the processes involved in the method according to an exemplary embodiment of the invention, and are not intended to be limiting. It will be readily understood that the processes shown in the above figures are not intended to indicate or limit the chronological order of the processes. In addition, it is also readily understood that these processes may be performed synchronously or asynchronously, e.g., in multiple modules.
In addition, in an exemplary embodiment of the present invention, a computer device capable of implementing the big data analysis-oriented application fusion architecture is also provided.
As will be appreciated by one skilled in the art, aspects of the present invention may be embodied as a system, method or program product. Thus, various aspects of the invention may be embodied in the form of: an entirely hardware embodiment, an entirely software embodiment (including firmware, microcode, etc.) or an embodiment combining hardware and software aspects that may all generally be referred to herein as a "circuit," module "or" system.
A computer apparatus according to such an embodiment of the present invention is described below with reference to fig. 5. The computer device shown in fig. 5 is only an example, and should not bring any limitation to the function and the scope of use of the embodiments of the present invention.
As shown in fig. 5, the computer device is in the form of a general purpose computing device. Components of the computer device may include, but are not limited to: the at least one processor 401, the at least one memory 402, the bus 403 connecting the various system components (including the memory 402 and the processor 401), and the display 404.
Wherein the memory stores program code that is executable by the processor 401 to cause the processor 401 to perform steps according to various exemplary embodiments of the present invention as described in the "exemplary methods" section above of this specification.
In an embodiment of the application, the computer device is configured to execute the behavior collection gateway to process the HTTP request through the interceptor and the forwarder, and the steps are as follows:
the method comprises the steps that a repeater obtains a forwarding rule list, wherein the repeater obtains the forwarding rule list from a behavior registration information database, the forwarding rule list comprises HTTP characteristics and forwarding targets, and the HTTP characteristics comprise a request method, a URL (uniform resource locator) and a forwarding host port;
the interceptor receives an HTTP request of an application and caches the received request data;
the interceptor forwards the request to the forwarder;
the repeater forwards the request, wherein a request line is analyzed from the request message to obtain a request method and a URL (uniform resource locator), a corresponding host and a corresponding port are found out from the forwarding rule list according to the request method and the URL, the request data are forwarded according to the host and the port, and the host and the port in the URL in the request line are modified to be the host port of a forwarding target;
the transponder receives the response;
the repeater forwards the response data to the interceptor;
the interceptor processes the response data, wherein the cached request message and the received response message are placed in a queue to be processed;
the interceptor returns an HTTP response to the application.
In one embodiment of the present application, the step of processing the queue data by the analyzer of the behavior collection gateway includes:
the method comprises the steps that an analyzer obtains behavior data, wherein the analyzer obtains behaviors, HTTP characteristics and data analysis rules from a behavior registration information database;
the analyzer acquires a data element to be processed from the queue to be processed;
the analyzer identifies behaviors, wherein the analyzer analyzes a request line from a request message in a data element to obtain a request method and a URL (Uniform resource locator), and identifies corresponding behaviors according to the matching of the request method, the URL and HTTP characteristics;
the analyzer generates a behavior log, wherein the analyzer analyzes high-value core data from request data and response data by using a semi-structured analysis technology according to a data analysis rule to form the behavior log;
the analyzer saves the behavior log, wherein the behavior log is saved to a behavior log database.
The memory 402 may include readable media in the form of volatile memory, such as Random Access Memory (RAM) and/or cache memory, and may further include Read Only Memory (ROM).
The bus 403 may be any of several types of bus structures including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, or a local bus using any of a variety of bus architectures.
In summary, the invention collects the behavior log applied to the fusion portal and the behavior log applied to the application access capability open platform, and forms the theme library of the business data and the behavior data after treatment, thereby realizing the fusion of the business data and the behavior data and providing a basis for big data application. And the data sharing exchange service of the capability open platform is opened to the application, so that conditions are created for big data analysis of the application.
The above description is only a preferred embodiment of the present application, and not intended to limit the scope of the present application, and all modifications of equivalent structures and equivalent processes, which are made by the contents of the specification and the drawings of the present application, or which are directly or indirectly applied to other related technical fields, are included in the scope of the present application.
Claims (10)
1. An application fusion architecture for big data analysis is characterized by comprising a fusion portal platform, a capability opening platform and a data governance platform;
the system comprises a fusion portal platform, a service end and a client side, wherein the fusion portal platform is used for supporting unified user management, unified application management, unified authentication, unified authorization and single sign-on, and comprises a behavior acquisition gateway which is used for processing all HTTP requests and responses interacted by the application client side and the service end in the fusion portal platform;
the capability open platform is used for providing a unified data sharing exchange service, a unified message service, a unified Internet of things service and a unified AI service; the data management platform is used for providing data acquisition and aggregation, data standardization, main data management, metadata management and data quality management.
2. The application fusion architecture of claim 1, wherein the fusion portal platform is configured to include a PC side and a mobile side, and the fusion portal platform is further configured to allow a user to access an application client, and the application client accesses an application server side through an HTTP protocol.
3. The application convergence fabric of claim 2 wherein the capability openness platform is further configured to provide a unified data sharing exchange service, a unified message service, a unified internet of things service, and a unified AI service through an API of an HTTP protocol.
4. The application fusion architecture of claim 3, wherein the capability openness platform comprises a behavior registration unit and a behavior collection gateway, the behavior registration unit is configured to accept behavior registration of each application, and the behavior collection gateway is configured to process HTTP requests and responses of all applications accessing the capability development platform application.
5. The application fusion architecture of claim 2, wherein the behavior collection gateway of the fusion portal platform accesses an application server of an application library via an HTTP protocol, the application library containing an application database.
6. The application fusion architecture of claim 5, wherein a behavior log database is disposed in both the behavior collection gateway of the fusion portal platform and the behavior collection gateway of the capability openness platform.
7. The application fusion framework of claim 6, wherein the data governance platform is further configured to collect data from an application database and a behavior log database at the same time, and classify the data after governance to form a subject library including behavior data, wherein the subject library includes a business data subject library and a behavior subject library.
8. The application fusion framework of claim 4, wherein the behavior registration unit is further configured to implement a behavior registration through an HTTP protocol feature defining a behavior, and define an HTTP request forwarding target and a data parsing rule for the behavior, wherein the HTTP protocol feature includes: request type, request URL, request parameter, response status code, response head and response body; the forwarding target comprises a forwarding host and a port, and the information of the behavior registration is stored in a database of the behavior registration unit.
9. The application fusion architecture of claim 4, wherein the behavior collection gateway comprises an interceptor, a forwarder, and an analyzer, and wherein the step of the behavior collection gateway processing the HTTP request through the interceptor and the forwarder comprises:
the method comprises the steps that a repeater obtains a forwarding rule list, wherein the repeater obtains the forwarding rule list from a behavior registration information database, the forwarding rule list comprises HTTP characteristics and forwarding targets, and the HTTP characteristics comprise a request method, a URL (uniform resource locator) and a forwarding host port;
the interceptor receives an HTTP request of an application and caches the received request data;
the interceptor forwards the request to the forwarder;
the repeater forwards the request, wherein a request line is analyzed from the request message to obtain a request method and a URL (uniform resource locator), a corresponding host and a corresponding port are found out from the forwarding rule list according to the request method and the URL, the request data are forwarded according to the host and the port, and the host and the port in the URL in the request line are modified to be the host port of a forwarding target;
the transponder receives the response;
the repeater forwards the response data to the interceptor;
the interceptor processes the response data, wherein the cached request message and the received response message are put into a queue to be processed;
the interceptor returns an HTTP response to the application.
10. The application fusion architecture of claim 9, wherein the step of the analyzer of the behavior collection gateway processing queue data comprises:
the method comprises the steps that an analyzer acquires behavior data, wherein the analyzer acquires behaviors, HTTP characteristics and data analysis rules from a behavior registration information database;
the analyzer acquires a data element to be processed from the queue to be processed;
the analyzer identifies behaviors, wherein the analyzer analyzes a request line from a request message in a data element to obtain a request method and a URL (Uniform resource locator), and identifies corresponding behaviors according to the matching of the request method, the URL and HTTP characteristics;
the analyzer generates a behavior log, wherein the analyzer analyzes high-value core data from request data and response data by using a semi-structured analysis technology according to a data analysis rule to form the behavior log;
the analyzer saves the behavior log, wherein the behavior log is saved to a behavior log database.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310075868.7A CN115795400B (en) | 2023-02-07 | 2023-02-07 | Application fusion system oriented to big data analysis |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310075868.7A CN115795400B (en) | 2023-02-07 | 2023-02-07 | Application fusion system oriented to big data analysis |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115795400A true CN115795400A (en) | 2023-03-14 |
| CN115795400B CN115795400B (en) | 2023-05-09 |
Family
ID=85430311
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310075868.7A Active CN115795400B (en) | 2023-02-07 | 2023-02-07 | Application fusion system oriented to big data analysis |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115795400B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116541887B (en) * | 2023-07-07 | 2023-09-15 | 云启智慧科技有限公司 | Data security protection method for big data platform |
| DE202023105431U1 (en) | 2023-09-18 | 2024-01-18 | Patev Holding Gmbh | Information processing device |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106550033A (en) * | 2016-10-27 | 2017-03-29 | 普元信息技术股份有限公司 | Based on the system and method that cloud computing system realizes simulation the whole network ability open platform |
| CN110300056A (en) * | 2019-06-28 | 2019-10-01 | 四川长虹电器股份有限公司 | A kind of real-time response formula API gateway and its request processing method |
| CN112732811A (en) * | 2020-12-31 | 2021-04-30 | 广西中科曙光云计算有限公司 | Data open platform |
| CN113592680A (en) * | 2021-07-28 | 2021-11-02 | 浙江省公众信息产业有限公司 | Service platform based on regional education big data |
| CN113938282A (en) * | 2021-09-26 | 2022-01-14 | 用友网络科技股份有限公司 | Privatization deployment data acquisition method of hybrid cloud, electronic device and storage medium |
| CN113946451A (en) * | 2021-08-31 | 2022-01-18 | 度小满科技(北京)有限公司 | Micro-service calling method, device, system and computer equipment |
| CN114866479A (en) * | 2022-04-24 | 2022-08-05 | 中电万维信息技术有限责任公司 | Service gateway-based service fusion method |
| WO2023284725A1 (en) * | 2021-07-15 | 2023-01-19 | 卡奥斯工业智能研究院(青岛)有限公司 | Smart energy management and control platform based on industrial internet |
-
2023
- 2023-02-07 CN CN202310075868.7A patent/CN115795400B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106550033A (en) * | 2016-10-27 | 2017-03-29 | 普元信息技术股份有限公司 | Based on the system and method that cloud computing system realizes simulation the whole network ability open platform |
| CN110300056A (en) * | 2019-06-28 | 2019-10-01 | 四川长虹电器股份有限公司 | A kind of real-time response formula API gateway and its request processing method |
| CN112732811A (en) * | 2020-12-31 | 2021-04-30 | 广西中科曙光云计算有限公司 | Data open platform |
| WO2023284725A1 (en) * | 2021-07-15 | 2023-01-19 | 卡奥斯工业智能研究院(青岛)有限公司 | Smart energy management and control platform based on industrial internet |
| CN113592680A (en) * | 2021-07-28 | 2021-11-02 | 浙江省公众信息产业有限公司 | Service platform based on regional education big data |
| CN113946451A (en) * | 2021-08-31 | 2022-01-18 | 度小满科技(北京)有限公司 | Micro-service calling method, device, system and computer equipment |
| CN113938282A (en) * | 2021-09-26 | 2022-01-14 | 用友网络科技股份有限公司 | Privatization deployment data acquisition method of hybrid cloud, electronic device and storage medium |
| CN114866479A (en) * | 2022-04-24 | 2022-08-05 | 中电万维信息技术有限责任公司 | Service gateway-based service fusion method |
Non-Patent Citations (1)
| Title |
|---|
| 吴乃星: "《基于移动通信大数据的城市计算》", 华中科技大学出版社 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116541887B (en) * | 2023-07-07 | 2023-09-15 | 云启智慧科技有限公司 | Data security protection method for big data platform |
| DE202023105431U1 (en) | 2023-09-18 | 2024-01-18 | Patev Holding Gmbh | Information processing device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115795400B (en) | 2023-05-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110300056B (en) | Real-time response type API gateway and request processing method thereof | |
| CN107743616B (en) | Endpoint management system providing application programming interface proxy services | |
| CN115795400A (en) | Application fusion framework oriented to big data analysis | |
| US9344371B1 (en) | Dynamic throttling systems and services | |
| Tas et al. | An approach to standalone provenance systems for big social provenance data | |
| CN111046237B (en) | User behavior data processing method and device, electronic equipment and readable medium | |
| US8799714B1 (en) | Generating test scenarios from application-layer messages | |
| US9910858B2 (en) | System and method for providing contextual analytics data | |
| CN113010818A (en) | Access current limiting method and device, electronic equipment and storage medium | |
| US11297105B2 (en) | Dynamically determining a trust level of an end-to-end link | |
| CN111694866A (en) | Data searching and storing method, data searching system, data searching device, data searching equipment and data searching medium | |
| CN112087520A (en) | Data processing method, device, equipment and computer readable storage medium | |
| EP3583766B1 (en) | Service discovery using attribute matching | |
| CN113472901A (en) | Load balancing method, device, equipment, storage medium and program product | |
| Wang et al. | A novel complex event processing engine for intelligent data analysis in integrated information systems | |
| Aktas et al. | XML metadata services | |
| US9819759B2 (en) | Inter-site integration platform for communication between social networking sites | |
| CN112417016B (en) | Data exchange method, system, equipment and storage medium | |
| CN110019077A (en) | Log inquiring method, device, equipment and computer readable storage medium | |
| US20210367829A1 (en) | Iot application learning | |
| CN107332824B (en) | Cloud application identification method and device | |
| Eid et al. | Framework for Cybersecurity Centers to Mass Scan Networks. | |
| CN114155969A (en) | Medical data acquisition method and device, electronic equipment and storage medium | |
| Liu et al. | Performance modeling and evaluating workflow of ITS: real-time positioning and route planning | |
| US10447777B1 (en) | Method and system for providing a dynamically updated expertise and context based peer-to-peer customer support system within a software application |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |