CN107483622A - Browser operation behavioral data acquisition method based on component - Google Patents
Browser operation behavioral data acquisition method based on component Download PDFInfo
- Publication number
- CN107483622A CN107483622A CN201710797710.5A CN201710797710A CN107483622A CN 107483622 A CN107483622 A CN 107483622A CN 201710797710 A CN201710797710 A CN 201710797710A CN 107483622 A CN107483622 A CN 107483622A
- Authority
- CN
- China
- Prior art keywords
- data
- component
- browser
- user
- data acquisition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0803—Configuration setting
- H04L41/0806—Configuration setting for initial configuration or provisioning, e.g. plug-and-play
Abstract
The present invention discloses a kind of browser operation behavioral data acquisition method based on component mechanism, it is characterised in that comprises the following steps：The first step：The deployment of acquisition component；Second step：Data acquisition；3rd step：Data storage；4th step：Data analysis.The present invention carries out front end uncorrected data collection using browser data acquisition component, data acquisition automatically and efficiently can be carried out to browser operation behavior, as a result of browser plug-in mechanism, user's real-time operation behavior on a web browser and webpage state can be obtained to greatest extent.
Description
Technical field
The invention discloses a kind of browser operation behavioral data acquisition method based on component mechanism, belongs to computer neck
Domain.
Background technology
Browser component technology
In WEB systems, the performance of web system, including the performance of web server, client hardware server and
The performance of operating system, the performance of browser, the performance of weblication include background program and foreground step program
Performance.The performance of web server can monitor in real time on a web server, but lack the browser end user operation of WEB systems
Behavior detects in real time, the evaluation meanses of webpage entirety usage experience.User's operation data is gathered by browser plug-in to realize
Web system entirety usage experience possesses advantages below：
Data are comprehensive, and a plug-in unit acquisition system can detect to all clients browser operation.
Real-time is good, and plug-in system monitors browser process in real time, and the operation behavior of user on a web browser, plug-in unit can be real
Shi Jinhang is recorded, and client local file is arrived in storage, and machine uploads to specified data server in due course.
Detection means specialty, efficiently solve traditional means can only the mode of utility efficiency questionnaire obtain user to browser
The experience of operation, or overall performance is inferred simply by Analysis server performance.
Analysis is direct, analyzes the data used and is directly derived from operation behavior of the user to browser, data are more directly perceived.
Management statisticses are convenient, according to the configuration of administrative staff, the record inspection of browser plug-in user's operation behavior acquisition system
The particular condition found during survey, can only detection, acquisition analysis system be concerned about browser operation behavior and the page or page
In face of as that and historical data can be analyzed and counted.
The content of the invention
The present invention carries for deficiency existing for web server overall performance and browser client operating experience evaluation meanses
A kind of collection that is efficient, real-time, supporting client collection user browser operation behavior based on browser component mechanism is gone out
Detection method, it is referred to as " the browser client operation behavior collecting method based on component ".
The present invention specifically adopts the following technical scheme that：
A kind of browser operation behavioral data acquisition method based on component mechanism, it is characterised in that comprise the following steps：
The first step：The deployment of acquisition component
(1) component register, the component bag that the packing of browser data acquisition component forms is added to system；
(2) component Configuration, its operational factor is configured to deployed browser data acquisition component；
Second step：Data acquisition
The configuration information of each acquisition component is downloaded, acquisition component corresponding to startup carries out front end uncorrected data collection, by dividing
The subsequent operation analysed the behavior event of user behavior and triggered by user, captures significant data, includes the anchor of trigger action
Point, the URL of the page, label information, timestamp, response time, user profile mark, system information；The data captured are straight
Sending and receiving are sent to data storage server end；
3rd step：Data storage
Data storage server end is by the data storage received in database；
4th step：Data analysis
The data being stored in database are analyzed using algorithm according to data dependence at data analytics server end
Arrange, result data is supplied to the user of behavioral data to carry out secondary analysis by external interface mode.
Preferably, the database includes two major class tables of data：
The first kind：User data acquisition tables, for depositing data caused by user's access browser, including access when
Between stamp, click on text element, click on event type and access URL；
Second class：Enter element-function mapping table of edlin by keeper, it is semantic for being assigned for the access data of user
Information, storage and managenent person to click on element mapping relations explanation, including：Click on the path of element, click on the explanation of element
And the explanation of the page where clicking on element.
Wherein, the mapping table can enter edlin by the interface that keeper is provided by browser plug-in.
The present invention carries out front end uncorrected data collection using browser data acquisition component, can be automatically and efficiently to browser
Operation behavior carries out data acquisition, as a result of browser plug-in mechanism, can obtain user to greatest extent in browser
On real-time operation behavior and webpage state.
There is following application innovation part using the browser operation behavioral data acquisition method of component mechanism：
● can be efficient, the detection of browser operation behavior is realized in real time, and records behavioral data.
● based on component mechanism, it can rapidly construct the browser operation behavior collection system to meet the needs of different users
System.
● dynamic addition, it can be removed, the component that configuration is related according to the requirement of user.
● individually component is upgraded, does not influence system.
● the Component Gallery for supporting a variety of service state detections can be formed, effectively realizes technology multiplexing and accumulation.
Brief description of the drawings
Fig. 1 is acquisition system structure chart；
Fig. 2 is acquisition method flow chart.
Embodiment
Acquisition system chief component of the present invention includes：
● data collection and analysis
Browser client behavioral data has that distribution is wide, form is various, the typical feature of the big data such as unstructured, to
These data are analyzed, it is necessary to targetedly be acquired, change, process and store.Data acquisition and analysis system is adopted
The structure being combined with the collection of system front end uncorrected data and servers' data analysis and arrangement.
The collection of system front end uncorrected data is caught by the subsequent operation analyzed the behavior event of user behavior and triggered by user
Significant data are received, such as the anchor point of trigger action, the URL of the page, label information, timestamp, response time, user profile
Mark, system information etc..These, which capture uncorrected data, can be sent directly to data storage server end.Data acquisition is with quiet
Silent mode is carried out, and will not give any prompting of user, and user can't perceive behavioral data and be adopted in use
Collection.
Application system front-end collection to data be user's single motion data, although data contain correlation in itself
Property, but can not direct feel.Data storage server end receives these data collected, warehousing, and Analysis server utilizes
The data of collection carry out behavioural analysis, such as count some URL page click frequency altogether, the average response time of some action,
Page that certain user often accesses etc., completeness of some flow etc. can also be analyzed according to custom rule.These data
The user for being supplied to behavioral data by external interface mode carries out secondary analysis.
● data storage
To after data, the database being sent in the storage server of rear end is stored front-end collection.
The content of data storage is divided into two major classes.
1. user data acquisition tables
What this table the inside was deposited is user in data caused by access browser.Data inside table are included but not only
The timestamp for being limited to access, the text element, the event type of click and the URL of access that click on.
2. enter element-function mapping table of edlin by keeper
The table assigns semantic information for the access data of user, and storage and managenent person is to clicking on the mapping relations of element in table
Illustrate, including：Click on the path of element, the explanation of click element and the explanation for clicking on the element place page.For example, keeper
The button of one login can be mapped to " login system X " functionally.
The content of mapping table can enter edlin by the interface that keeper is provided by browser plug-in, it is not necessary to directly enter
Row database manipulation.
Initial data is more trifling, and data become huge lengthy and jumbled after long-time statistical, is unfavorable for follow-up analysis, backstage is periodically
Basic analysis, arrangement, filing are carried out to data, by database new the data Cun Chudao put in order.
It is illustrated in figure 2 the browser operation behavioral data acquisition method flow based on component mechanism of the invention, including with
Family browser operation-browser plug-in gathered data-gathered data uploads data storage server storage-data analysis clothes
Business device analysis.Comprise the following steps that：
The first step：The deployment of acquisition component
(1) component register, the component bag that the packing of browser data acquisition component forms is added to system；
(2) component Configuration, its operational factor is configured to deployed browser data acquisition component；
Second step：Data acquisition
The configuration information of each acquisition component is downloaded, acquisition component corresponding to startup carries out front end uncorrected data collection, by dividing
The subsequent operation analysed the behavior event of user behavior and triggered by user, captures significant data, includes the anchor of trigger action
Point, the URL of the page, label information, timestamp, response time, user profile mark, system information；The data captured are straight
Sending and receiving are sent to data storage server end；
3rd step：Data storage
Data storage server end is by the data storage received in database；
4th step：Data analysis
The data being stored in database are analyzed using algorithm according to data dependence at data analytics server end
Arrange, result data is supplied to the user of behavioral data to carry out secondary analysis by external interface mode.
Specific embodiment
As shown in figure 1, it is a concrete application example block diagram of the invention.The plug-in system supports windows platform, collection
Data storage server use MySQL database.The installation and deployment of system are completed by performing plug-in unit installation procedure.
● Components Development, using Components Development instrument, develop the related browser data collection of the service of user's needs
Component, and it is packaged into the component bag that can be registered.
● component register, sign in user console, by component upgrade service, component bag is added to system, to same
The component bag of one type can inquire about upgrade history.
● component Configuration, its operational factor is configured to deployed browser data acquisition component.
● assembly operating, assembly management service from database configuration database (can be same number with data storage database
According to storehouse) download the configuration information of each component, component corresponding to startup.
● component upgrade, component upgrade service scan have new version to the component being currently running, can trigger it is automatic or
Person upgrades manually.Assembly management service will first stop the component that is currently running, from database download corresponding to component can hold
Style of writing part, and reload.
● component Configuration is changed, and the configuration information after change is saved in database, and notification component by component Configuration service
Management service, assembly management service are downloaded newest matching somebody with somebody and postponed, and call the renewal configuration interface of corresponding component.
Claims (6)
1. a kind of browser operation behavioral data acquisition method based on component mechanism, it is characterised in that comprise the following steps：
The first step：The deployment of acquisition component
（1）Component register, the component bag that the packing of browser data acquisition component forms is added to system；
（2）Component Configuration, its operational factor is configured to deployed browser data acquisition component；
Second step：Data acquisition
The configuration information of each acquisition component is downloaded, acquisition component corresponding to startup carries out front end uncorrected data collection, is used by analyzing
The behavior event of family behavior and the subsequent operation triggered by user, capture significant data, including the anchor point of trigger action, page
The URL in face, label information, timestamp, response time, user profile mark, system information；The data captured are sent directly between
To data storage server end；
3rd step：Data storage
Data storage server end is by the data storage received in database；
4th step：Data analysis
Data analytics server end carries out analysis and arrangement using algorithm according to data dependence to the data being stored in database,
Result data is supplied to the user of behavioral data to carry out secondary analysis by external interface mode.
2. the browser operation behavioral data acquisition method based on component mechanism as claimed in claim 1, it is characterised in that institute
State database and include two major class tables of data：
The first kind：User data acquisition tables, for depositing data caused by user's access browser, include the time of access
Stamp, the text element clicked on, the event type clicked on and the URL of access；
Second class：Enter element-function mapping table of edlin by keeper, for assigning semantic letter for the access data of user
Breath, storage and managenent person to click on element mapping relations explanation, including：Click on element path, click on element explanation and
The explanation of the page where clicking on element.
3. the browser operation behavioral data acquisition method based on component mechanism as claimed in claim 2, it is characterised in that institute
State the interface that mapping table is provided by keeper by browser plug-in and enter edlin.
4. the browser operation behavioral data acquisition method based on component mechanism as claimed in claim 1, it is characterised in that number
Carried out according to gatherer process in a manner of silent, any prompting of user will not be given, user will not perceive behavior in use
Data are collected.
5. the browser operation behavioral data acquisition method based on component mechanism as claimed in claim 1, it is characterised in that when
The acquisition component being currently running has new version, and triggering either automatically or manually upgrades：First stop the collection group being currently running
Part, acquisition component executable file corresponding to download, and reload.
6. the browser operation behavioral data acquisition method based on component mechanism as claimed in claim 1, it is characterised in that when
When the configuration of acquisition component is changed, the configuration information after change is saved in database, re-downloads newest collection group
Part configures, and calls the renewal configuration interface of corresponding acquisition component.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710797710.5A CN107483622A (en) | 2017-09-06 | 2017-09-06 | Browser operation behavioral data acquisition method based on component |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710797710.5A CN107483622A (en) | 2017-09-06 | 2017-09-06 | Browser operation behavioral data acquisition method based on component |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107483622A true CN107483622A (en) | 2017-12-15 |
Family
ID=60584300
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710797710.5A Pending CN107483622A (en) | 2017-09-06 | 2017-09-06 | Browser operation behavioral data acquisition method based on component |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107483622A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109189642A (en) * | 2018-09-04 | 2019-01-11 | 广州供电局有限公司 | Application system business conduct characteristic-acquisition method and monitoring system based on plug-in unit |
| CN109558561A (en) * | 2018-12-04 | 2019-04-02 | 深圳创维数字技术有限公司 | A kind of user behavior path acquisition method, device, equipment and medium |
| CN111459775A (en) * | 2020-02-21 | 2020-07-28 | 北京数立得科技有限公司 | Web system function evaluation method and device, electronic equipment and readable storage medium |
| CN111639009A (en) * | 2020-06-04 | 2020-09-08 | 山东汇贸电子口岸有限公司 | Service monitoring data acquisition system and method |
| CN113254914A (en) * | 2021-04-24 | 2021-08-13 | 中电长城网际系统应用广东有限公司 | Front-end and back-end synchronous management method and system based on visual display |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101634994A (en) * | 2009-08-28 | 2010-01-27 | 北京大学 | Service discovery and combination device |
| CN104579789A (en) * | 2015-01-23 | 2015-04-29 | 广东能龙教育股份有限公司 | Massive user behavior data acquisition method and system based on message queue |
| CN104750471A (en) * | 2013-12-30 | 2015-07-01 | 上海格尔软件股份有限公司 | WEB page performance detection and analysis plug-in and method based on browser |
| CN105589782A (en) * | 2014-10-22 | 2016-05-18 | 中国银联股份有限公司 | User behavior collection method based on browser |
| EP3164802A1 (en) * | 2014-07-03 | 2017-05-10 | Realeyes OÜ | Method of collecting and processing computer user data during interaction with web-based content |
| CN106933722A (en) * | 2017-03-06 | 2017-07-07 | 腾云天宇科技（北京）有限公司 | A kind of web application monitoring method, server and system |
-
2017
- 2017-09-06 CN CN201710797710.5A patent/CN107483622A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101634994A (en) * | 2009-08-28 | 2010-01-27 | 北京大学 | Service discovery and combination device |
| CN104750471A (en) * | 2013-12-30 | 2015-07-01 | 上海格尔软件股份有限公司 | WEB page performance detection and analysis plug-in and method based on browser |
| EP3164802A1 (en) * | 2014-07-03 | 2017-05-10 | Realeyes OÜ | Method of collecting and processing computer user data during interaction with web-based content |
| CN105589782A (en) * | 2014-10-22 | 2016-05-18 | 中国银联股份有限公司 | User behavior collection method based on browser |
| CN104579789A (en) * | 2015-01-23 | 2015-04-29 | 广东能龙教育股份有限公司 | Massive user behavior data acquisition method and system based on message queue |
| CN106933722A (en) * | 2017-03-06 | 2017-07-07 | 腾云天宇科技（北京）有限公司 | A kind of web application monitoring method, server and system |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109189642A (en) * | 2018-09-04 | 2019-01-11 | 广州供电局有限公司 | Application system business conduct characteristic-acquisition method and monitoring system based on plug-in unit |
| CN109558561A (en) * | 2018-12-04 | 2019-04-02 | 深圳创维数字技术有限公司 | A kind of user behavior path acquisition method, device, equipment and medium |
| CN111459775A (en) * | 2020-02-21 | 2020-07-28 | 北京数立得科技有限公司 | Web system function evaluation method and device, electronic equipment and readable storage medium |
| CN111459775B (en) * | 2020-02-21 | 2023-08-08 | 北京数立得科技有限公司 | Web system function evaluation method, device, electronic equipment and readable storage medium |
| CN111639009A (en) * | 2020-06-04 | 2020-09-08 | 山东汇贸电子口岸有限公司 | Service monitoring data acquisition system and method |
| CN113254914A (en) * | 2021-04-24 | 2021-08-13 | 中电长城网际系统应用广东有限公司 | Front-end and back-end synchronous management method and system based on visual display |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107483622A (en) | Browser operation behavioral data acquisition method based on component | |
| US11669382B2 (en) | Anomaly detection for data stream processing | |
| CN106502902B (en) | Web page operational efficiency monitoring method and device | |
| CN106649063B (en) | Method and system for monitoring time-consuming data during program operation | |
| US9578118B2 (en) | Detecting content and user response to content | |
| CN105657003B (en) | Information processing method and server | |
| US9197710B1 (en) | Temporal based data string intern pools | |
| CN1901568B (en) | Method for realizing historical property collection in network managing system | |
| CN105490854B (en) | Real-time logs collection method, system and application server cluster | |
| CN107995266A (en) | Bury point data processing method, device, computer equipment and storage medium | |
| CN108011752A (en) | Fault locating analysis method and device, computer-readable recording medium | |
| US20150046512A1 (en) | Dynamic collection analysis and reporting of telemetry data | |
| RU2691595C2 (en) | Constructed data stream for improved event processing | |
| EP0994602A2 (en) | Computer system and network performance monitoring | |
| CN108509326B (en) | Service state statistical method and system based on nginx log | |
| CN105468989B (en) | Cloud storage quota management method based on linux kernel monitoring | |
| CN102567185B (en) | Monitoring method of application server | |
| CN105589782B (en) | User behavior acquisition method based on browser | |
| CN109560989B (en) | Link monitoring system | |
| WO2014166292A1 (en) | Application program management method and apparatus, server, and terminal device | |
| CN108804497A (en) | A kind of big data analysis method based on daily record | |
| CN105183873A (en) | Malicious clicking behavior detection method and device | |
| CN109246116A (en) | A kind of Network anomaly detection system based on DNS log analysis | |
| CN108965048A (en) | Collecting method, device and storage medium, the server of voice gateways | |
| CN109189642A (en) | Application system business conduct characteristic-acquisition method and monitoring system based on plug-in unit |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20171215 |
|
| RJ01 | Rejection of invention patent application after publication |