CN107688619A - 一种日志数据处理方法及装置 - Google Patents
一种日志数据处理方法及装置 Download PDFInfo
- Publication number
- CN107688619A CN107688619A CN201710680824.1A CN201710680824A CN107688619A CN 107688619 A CN107688619 A CN 107688619A CN 201710680824 A CN201710680824 A CN 201710680824A CN 107688619 A CN107688619 A CN 107688619A
- Authority
- CN
- China
- Prior art keywords
- timestamp
- session
- monitored
- conversion
- daily record
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012545 processing Methods 0.000 title claims abstract description 13
- 238000003672 processing method Methods 0.000 title claims abstract description 8
- 238000006243 chemical reaction Methods 0.000 claims abstract description 103
- 238000004458 analytical method Methods 0.000 claims abstract description 43
- 238000000034 method Methods 0.000 claims abstract description 42
- 238000007621 cluster analysis Methods 0.000 claims abstract description 22
- 238000006116 polymerization reaction Methods 0.000 claims description 19
- 230000008859 change Effects 0.000 claims description 12
- 238000004422 calculation algorithm Methods 0.000 claims description 11
- 230000002159 abnormal effect Effects 0.000 claims description 8
- 230000001052 transient effect Effects 0.000 claims description 7
- 239000000284 extract Substances 0.000 claims description 6
- 238000004891 communication Methods 0.000 claims description 3
- 230000005055 memory storage Effects 0.000 claims description 2
- 230000008569 process Effects 0.000 description 10
- 238000010586 diagram Methods 0.000 description 8
- 241001269238 Data Species 0.000 description 4
- 238000004590 computer program Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 238000012544 monitoring process Methods 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 2
- 238000002224 dissection Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000002955 isolation Methods 0.000 description 2
- 230000002123 temporal effect Effects 0.000 description 2
- PEDCQBHIVMGVHV-UHFFFAOYSA-N Glycerine Chemical compound OCC(O)CO PEDCQBHIVMGVHV-UHFFFAOYSA-N 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 210000004209 hair Anatomy 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/1734—Details of monitoring file system events, e.g. by the use of hooks, filter drivers, logs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/23—Clustering techniques
Landscapes
- Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Artificial Intelligence (AREA)
- Evolutionary Biology (AREA)
- Evolutionary Computation (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Bioinformatics & Computational Biology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Databases & Information Systems (AREA)
- Debugging And Monitoring (AREA)
Abstract
Description
Claims (14)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710680824.1A CN107688619B (zh) | 2017-08-10 | 2017-08-10 | 一种日志数据处理方法及装置 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710680824.1A CN107688619B (zh) | 2017-08-10 | 2017-08-10 | 一种日志数据处理方法及装置 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN107688619A true CN107688619A (zh) | 2018-02-13 |
CN107688619B CN107688619B (zh) | 2020-06-16 |
Family
ID=61153195
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710680824.1A Active CN107688619B (zh) | 2017-08-10 | 2017-08-10 | 一种日志数据处理方法及装置 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN107688619B (zh) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111367958A (zh) * | 2019-11-19 | 2020-07-03 | 杭州海康威视系统技术有限公司 | 一种数据分析方法、装置、电子设备及存储介质 |
CN113342744A (zh) * | 2021-06-02 | 2021-09-03 | 北京优特捷信息技术有限公司 | 调用链的并行构建方法、装置、设备及存储介质 |
CN113364863A (zh) * | 2021-06-03 | 2021-09-07 | 上海微盟企业发展有限公司 | 一种行为数据会话id分配的方法、系统及设备 |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101751248A (zh) * | 2008-11-28 | 2010-06-23 | 国际商业机器公司 | 为Web应用设计时间敏感的性能测试用例的方法和系统 |
CN103178982A (zh) * | 2011-12-23 | 2013-06-26 | 阿里巴巴集团控股有限公司 | 日志分析方法和装置 |
CN104317811A (zh) * | 2014-09-25 | 2015-01-28 | 小米科技有限责任公司 | 业务指标的统计方法、装置及服务器 |
US9430501B1 (en) * | 2012-12-31 | 2016-08-30 | Emc Corporation | Time sanitization of network logs from a geographically distributed computer system |
CN106685984A (zh) * | 2017-01-16 | 2017-05-17 | 东北大学 | 一种基于数据包捕获技术的网络威胁分析系统及方法 |
CN106682097A (zh) * | 2016-12-01 | 2017-05-17 | 北京奇虎科技有限公司 | 一种处理日志数据的方法和装置 |
CN106776622A (zh) * | 2015-11-20 | 2017-05-31 | 北京国双科技有限公司 | 访问日志的查询方法和装置 |
-
2017
- 2017-08-10 CN CN201710680824.1A patent/CN107688619B/zh active Active
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101751248A (zh) * | 2008-11-28 | 2010-06-23 | 国际商业机器公司 | 为Web应用设计时间敏感的性能测试用例的方法和系统 |
CN103178982A (zh) * | 2011-12-23 | 2013-06-26 | 阿里巴巴集团控股有限公司 | 日志分析方法和装置 |
US9430501B1 (en) * | 2012-12-31 | 2016-08-30 | Emc Corporation | Time sanitization of network logs from a geographically distributed computer system |
CN104317811A (zh) * | 2014-09-25 | 2015-01-28 | 小米科技有限责任公司 | 业务指标的统计方法、装置及服务器 |
CN106776622A (zh) * | 2015-11-20 | 2017-05-31 | 北京国双科技有限公司 | 访问日志的查询方法和装置 |
CN106682097A (zh) * | 2016-12-01 | 2017-05-17 | 北京奇虎科技有限公司 | 一种处理日志数据的方法和装置 |
CN106685984A (zh) * | 2017-01-16 | 2017-05-17 | 东北大学 | 一种基于数据包捕获技术的网络威胁分析系统及方法 |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111367958A (zh) * | 2019-11-19 | 2020-07-03 | 杭州海康威视系统技术有限公司 | 一种数据分析方法、装置、电子设备及存储介质 |
CN111367958B (zh) * | 2019-11-19 | 2024-03-08 | 杭州海康威视系统技术有限公司 | 一种数据分析方法、装置、电子设备及存储介质 |
CN113342744A (zh) * | 2021-06-02 | 2021-09-03 | 北京优特捷信息技术有限公司 | 调用链的并行构建方法、装置、设备及存储介质 |
CN113364863A (zh) * | 2021-06-03 | 2021-09-07 | 上海微盟企业发展有限公司 | 一种行为数据会话id分配的方法、系统及设备 |
CN113364863B (zh) * | 2021-06-03 | 2022-12-30 | 上海微盟企业发展有限公司 | 一种行为数据会话id分配的方法、系统及设备 |
Also Published As
Publication number | Publication date |
---|---|
CN107688619B (zh) | 2020-06-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN106936781B (zh) | 一种用户操作行为的判定方法及装置 | |
CN109254959B (zh) | 一种数据评价方法、装置、终端设备及可读存储介质 | |
CN110910982A (zh) | 自编码模型训练方法、装置、设备及存储介质 | |
CN107748782A (zh) | 查询语句处理方法及装置 | |
CN107688619A (zh) | 一种日志数据处理方法及装置 | |
EP3871120A1 (en) | Apparatus and method for detecting an anomaly among successive events and computer program product therefor | |
CN114742477A (zh) | 企业订单数据处理方法、装置、设备及存储介质 | |
CN112685215A (zh) | 一种云平台异常日志分析方法 | |
CN112506750A (zh) | 一种用于海量日志分析预警的大数据处理系统 | |
CN116112283A (zh) | 一种基于cnn-lstm的电力系统网络安全态势预测方法及系统 | |
CN111078457A (zh) | 一种基于大数据的存储故障分析方法与装置 | |
Chomyat et al. | Process mining on medical treatment history using conformance checking | |
CN114238383A (zh) | 一种用于供应链监控的大数据提取方法及装置 | |
CN110750299A (zh) | 智能软件质量跟踪系统、方法及存储介质 | |
CN114465875B (zh) | 故障处理方法及装置 | |
CN117291575A (zh) | 设备检修方法、装置、计算机设备和存储介质 | |
CN115271933B (zh) | 贷款决策方法及装置、决策设备及计算机可读存储介质 | |
CN111352820A (zh) | 一种高性能应用运行状态预测和监控方法、设备和装置 | |
CN113241063B (zh) | 语音识别系统中的算法参数更新方法、装置、终端及介质 | |
CN113408210B (zh) | 基于深度学习的非侵入负荷分解方法、系统、介质和设备 | |
CN111193631A (zh) | 信息处理方法、系统和计算机可读存储介质 | |
CN112905579A (zh) | 一种日志优化方法及系统 | |
CN114760109A (zh) | 用于安全分析的数值行为安全基线生成方法及装置 | |
Jing et al. | A microservice fault identification method based on LightGBM | |
CN114566964A (zh) | 一种配电网馈线自动化控制方法、装置、设备及存储介质 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
TA01 | Transfer of patent application right | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20190328 Address after: 100015 15, 17 floor 1701-26, 3 building, 10 Jiuxianqiao Road, Chaoyang District, Beijing. Applicant after: BEIJING QIANXIN TECHNOLOGY Co.,Ltd. Applicant after: LEGENDSEC INFORMATION TECHNOLOGY (BEIJING) Inc. Address before: 100015 15, 17 floor 1701-26, 3 building, 10 Jiuxianqiao Road, Chaoyang District, Beijing. Applicant before: BEIJING QIANXIN TECHNOLOGY Co.,Ltd. |
|
CB02 | Change of applicant information | ||
CB02 | Change of applicant information |
Address after: 100088 Building 3 332, 102, 28 Xinjiekouwai Street, Xicheng District, Beijing Applicant after: QAX Technology Group Inc. Applicant after: LEGENDSEC INFORMATION TECHNOLOGY (BEIJING) Inc. Address before: 100015 Jiuxianqiao Chaoyang District Beijing Road No. 10, building 15, floor 17, layer 1701-26, 3 Applicant before: BEIJING QIANXIN TECHNOLOGY Co.,Ltd. Applicant before: LEGENDSEC INFORMATION TECHNOLOGY (BEIJING) Inc. |
|
GR01 | Patent grant | ||
GR01 | Patent grant | ||
CP01 | Change in the name or title of a patent holder | ||
CP01 | Change in the name or title of a patent holder |
Address after: Room 332, 3 / F, Building 102, 28 xinjiekouwei street, Xicheng District, Beijing 100088 Patentee after: QAX Technology Group Inc. Patentee after: Qianxin Wangshen information technology (Beijing) Co.,Ltd. Address before: Room 332, 3 / F, Building 102, 28 xinjiekouwei street, Xicheng District, Beijing 100088 Patentee before: QAX Technology Group Inc. Patentee before: LEGENDSEC INFORMATION TECHNOLOGY (BEIJING) Inc. |