CN103763150B - Data collecting system - Google Patents
Data collecting system Download PDFInfo
- Publication number
- CN103763150B CN103763150B CN201410001462.5A CN201410001462A CN103763150B CN 103763150 B CN103763150 B CN 103763150B CN 201410001462 A CN201410001462 A CN 201410001462A CN 103763150 B CN103763150 B CN 103763150B
- Authority
- CN
- China
- Prior art keywords
- data
- acquisition plan
- packet capture
- filter condition
- way
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
The present invention provides a kind of data collecting system, and the data collecting system includes：The newly-built of acquisition plan configuration module, typing and management interface for providing acquisition plan, including acquisition plan, modification, deletion and preservation, the acquisition plan include the transmission source of gathered data and send the related identification information of target；Acquisition plan parsing module, for being parsed to the acquisition plan, obtains the corresponding filter condition of the acquisition plan, the filter condition includes the transmission source and sends the IP address of target；Packet capture module, for being captured according to the filter condition to the data of collected operation system.The data collecting system framework that the present invention is provided is succinct, it is easy to accomplish.
Description
Technical field
The present invention relates to computer realm, more particularly to a kind of data collecting system.
Background technology
With the development of modern science and technology, Real-time Data Acquisition Technology has penetrated into geological prospecting, medicine equipment, thunder
Reach, the development of guided missile, numerous technical fields such as observing and controlling.In field of scientific study, by a large amount of numbers for checking collection storage in real time
According to come find it is new be significant connect each other, provide data foundation for scientific research；In terms of production management, it can lead to
Real-time Monitoring Data is crossed, the problem of finding to exist in time, it is to avoid dangerous generation, while also solving problem for the later stage provides data
Foundation, and current data collecting system structure is complex, is difficult to realize.
The content of the invention
（One）The technical problem to be solved
The technical problem to be solved in the present invention is to provide a kind of data collecting system being easily achieved.
（Two）Technical scheme
In order to solve the above technical problems, technical scheme provides a kind of data collecting system, including：
Acquisition plan configuration module, typing and management interface for providing acquisition plan, including acquisition plan it is newly-built,
Modification, deletion and preservation, the acquisition plan include the transmission source of gathered data and send the related identification information of target；
Acquisition plan parsing module, for being parsed to the acquisition plan, obtains the corresponding mistake of the acquisition plan
Filter condition, the filter condition includes the transmission source and sends the IP address of target；
Packet capture module, for being captured according to the filter condition to the data of collected operation system.
Further, the acquisition plan is preserved in xml format.
Further, the packet capture module is according to application layer of the filter condition to collected operation system
Data captured.
Further, the packet capture module is according to transport layer of the filter condition to collected operation system
Data captured.
Further, the packet capture module is according to Internet of the filter condition to collected operation system
Data captured.
（Three）Beneficial effect
The data collecting system that the present invention is provided includes acquisition plan configuration module, acquisition plan parsing module and data
Packet capturing module, wherein, the acquisition plan configuration module is used for typing and the management interface for providing acquisition plan, the acquisition plan
Parsing module is used to parse acquisition plan, obtains the corresponding filter condition of acquisition plan, then passes through packet capture
Module is captured according to filter condition to the data of collected operation system, and its framework is succinct, it is easy to accomplish.
Brief description of the drawings
Fig. 1 is a kind of schematic diagram for data collecting system that embodiment of the present invention is provided.
Embodiment
With reference to the accompanying drawings and examples, the embodiment to the present invention is described in further detail.Implement below
Example is used to illustrate the present invention, but is not limited to the scope of the present invention.
Fig. 1 is a kind of schematic diagram for data collecting system that embodiment of the present invention is provided, including：
Acquisition plan configuration module 1, typing and management interface for providing acquisition plan, including acquisition plan are new
Build, change, delete and preserve, the acquisition plan includes the transmission source of gathered data and sends the related identification information of target；
Acquisition plan parsing module 2, for being parsed to the acquisition plan, obtains the corresponding mistake of the acquisition plan
Filter condition, the filter condition includes the transmission source and sends the IP of target（Internet Protocol, Internet protocol）Ground
Location；
Packet capture module 3, for being captured according to the filter condition to the data of collected operation system.
Wherein, the acquisition plan can be with XML（Extensible Markup Language, extensible markup language）Lattice
Formula is preserved.
Wherein, the packet capture module is according to number of the filter condition to the application layer of collected operation system
According to being captured.
Wherein, the packet capture module is according to number of the filter condition to the transport layer of collected operation system
According to being captured.
Wherein, the packet capture module is according to number of the filter condition to the Internet of collected operation system
According to being captured.
In embodiment of the present invention, acquisition plan configuration client is used to provide acquisition plan typing and management interface, wraps
The newly-built of acquisition plan, modification are included, deletes and preserves.Acquisition plan can include the transmission source of gathered data and send target
Related identification information, can also include purpose, the information such as class of business, information type of collection of collection, and acquisition plan can be with
Preserve in xml format.Acquisition plan parsing module is mainly used in parsing acquisition plan, obtains packet capture module
The information such as filter condition, and carry out corresponding configuration.The filter condition of packet capture module mainly includes the transmission of gathered data
Source and the IP address for sending target, can also include port numbers and network protocol type etc..
In embodiment of the present invention, the mode of packet capture module capture data can have three kinds, and first way is
Each business software, can be according to the requirement pre-set while making a copy for a to packet capture mould when swapping information
Block, or the application layer of operation system can provide the access interface of transceiving data in itself, call this to connect by datagram trapping module
The data that mouth is received and dispatched.The second way is that each business software transmits service transmission, long data message by short data message
Transmit service transmission and real-time information transmission service transmission carries out information transmission, data can be carried out in the transport layer of operation system
Packet capturing.The third mode is that can carry out packet capture in Internet by network Sniffer Technique, it is preferable that packet is caught
The mode for obtaining module capture data can be to use above-mentioned three kinds of modes simultaneously, specifically, preferentially using first way, if
First way can not be coordinated, then can use the second way, wherein, the second way needs to enter different type message
Row coding-decoding operation, for example, its type of message can have hundreds of kinds, encoding and decoding workload therefore, it can second than larger
Mode, if certain class business can not realize that data are made a copy for, is captured as the supplement of first way by the second way
The data of such business transmitting-receiving.
The data collecting system that embodiment of the present invention is provided includes acquisition plan configuration module, acquisition plan parsing module
And packet capture module, wherein, the acquisition plan configuration module is used for typing and the management interface for providing acquisition plan, should
Acquisition plan parsing module is used to parse acquisition plan, obtains the corresponding filter condition of acquisition plan, then passes through number
The data of collected operation system are captured according to filter condition according to Packet capturing module, its framework is succinct, it is easy to accomplish.
Embodiment of above is merely to illustrate the present invention, and not limitation of the present invention, about the common of technical field
Technical staff, without departing from the spirit and scope of the present invention, can also make a variety of changes and modification, therefore all
Equivalent technical scheme falls within scope of the invention, and scope of patent protection of the invention should be defined by the claims.
Claims (5)
1. a kind of data collecting system, it is characterised in that including：
Acquisition plan configuration module, typing and management interface for providing acquisition plan, including acquisition plan it is newly-built, repair
Change, delete and preserve, the transmission source of the acquisition plan including gathered data, the related identification information that sends target, collection
Purpose, the class of business and information type of collection；
Acquisition plan parsing module, for being parsed to the acquisition plan, obtains the corresponding filtering rod of the acquisition plan
Part, the filter condition includes the transmission source and sends the IP address of target；
Packet capture module, for being captured according to the filter condition to the data of collected operation system；
The mode of packet capture module capture data has three kinds, and first way is that each business software is swapping information
When, in itself can according to the requirement pre-set while making a copy for portion to packet capture module, or the application layer of operation system
The access interface of transceiving data is provided, the data that the interface is received and dispatched are called by datagram trapping module, the second way is
Each business software transmits service transmission, long data message by short data message and transmits service transmission and real-time information transmission service
Transmission carries out information transmission, and packet capture is carried out in the transport layer of operation system, and the third mode is to pass through Network Sniffing skill
Art carries out packet capture in Internet, and the mode of packet capture module capture data is to use above-mentioned three kinds of modes simultaneously,
Or, preferentially using first way, if first way can not be coordinated, using the second way, wherein, second
Mode need to different type message carry out coding-decoding operation, using the second way as first way supplement, if certain
Class business can not realize that data are made a copy for, then the data of such business transmitting-receiving are captured by the second way.
2. data collecting system according to claim 1, it is characterised in that the acquisition plan is preserved in xml format.
3. data collecting system according to claim 1, it is characterised in that the packet capture module is according to the mistake
Filter condition is captured to the data of the application layer of collected operation system.
4. data collecting system according to claim 1, it is characterised in that the packet capture module is according to the mistake
Filter condition is captured to the data of the transport layer of collected operation system.
5. data collecting system according to claim 1, it is characterised in that the packet capture module is according to the mistake
Filter condition is captured to the data of the Internet of collected operation system.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410001462.5A CN103763150B (en) | 2014-01-02 | 2014-01-02 | Data collecting system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410001462.5A CN103763150B (en) | 2014-01-02 | 2014-01-02 | Data collecting system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103763150A CN103763150A (en) | 2014-04-30 |
| CN103763150B true CN103763150B (en) | 2017-09-22 |
Family
ID=50530313
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410001462.5A Active CN103763150B (en) | 2014-01-02 | 2014-01-02 | Data collecting system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103763150B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106953774A (en) * | 2016-01-07 | 2017-07-14 | 无锡聚云科技有限公司 | One kind is based on user-defined network packet snapping system |
| CN107167839A (en) * | 2017-06-05 | 2017-09-15 | 王伟巍 | A kind of IMF OBS multi-channel data acquisition application systems |
| CN110351259A (en) * | 2019-06-28 | 2019-10-18 | 深圳数位传媒科技有限公司 | A kind of method and device obtaining APP authentication information based on network packet capturing |
| CN112034802A (en) * | 2020-09-02 | 2020-12-04 | 江苏工程职业技术学院 | Data acquisition system applied to cloud data computing |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101068229A (en) * | 2007-06-08 | 2007-11-07 | 北京工业大学 | Content filtering gateway realizing method based on network filter |
| CN101594182A (en) * | 2009-06-15 | 2009-12-02 | 中兴通讯股份有限公司 | In ASON, realize the method and system of signaling tracing |
| CN101808017A (en) * | 2010-03-26 | 2010-08-18 | 中国科学院计算技术研究所 | Method and system for quantificationally calculating network abnormity index |
| CN101902365A (en) * | 2009-05-26 | 2010-12-01 | 北京启明星辰信息技术股份有限公司 | Method for monitoring P2P traffic of wide area network and system thereof |
-
2014
- 2014-01-02 CN CN201410001462.5A patent/CN103763150B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101068229A (en) * | 2007-06-08 | 2007-11-07 | 北京工业大学 | Content filtering gateway realizing method based on network filter |
| CN101902365A (en) * | 2009-05-26 | 2010-12-01 | 北京启明星辰信息技术股份有限公司 | Method for monitoring P2P traffic of wide area network and system thereof |
| CN101594182A (en) * | 2009-06-15 | 2009-12-02 | 中兴通讯股份有限公司 | In ASON, realize the method and system of signaling tracing |
| CN101808017A (en) * | 2010-03-26 | 2010-08-18 | 中国科学院计算技术研究所 | Method and system for quantificationally calculating network abnormity index |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103763150A (en) | 2014-04-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103763150B (en) | Data collecting system | |
| CN104301393B (en) | Laboratory data gathers and management system | |
| WO2017084600A1 (en) | Internet of things system used for intelligent gas meter and information transmission method for internet of things system | |
| CN104036000B (en) | A kind of database audit method, Apparatus and system | |
| CN110401624A (en) | The detection method and system of source net G system mutual message exception | |
| CN108123931A (en) | Ddos attack defence installation and method in a kind of software defined network | |
| CN110413591A (en) | A kind of industrial data acquisition method and edge calculations gateway | |
| CN102148827B (en) | Security event management method, device and security management platform | |
| CN105072196B (en) | The storage of distributed data packet, retrogressive method and system | |
| CN102123044A (en) | Detection device and method of network topology consistency based on topology discovery technology | |
| CN102611626B (en) | System and method for analyzing network flow | |
| CN102857788A (en) | Video quality diagnostic system and video quality diagnostic method | |
| CN108737385A (en) | A kind of malice domain name matching method mapping IP based on DNS | |
| CN102624878B (en) | Method and system for identifying P2P (peer-to-peer) protocol on basis of DNS (domain name server) protocol | |
| CN108347698A (en) | A kind of on-line off-line event trace analysis method, apparatus and system | |
| CN104202328B (en) | A kind of method, configuration module and the subscription end of subscription GOOSE/SMV messages | |
| CN103516558B (en) | Monitor supervision platform and on server application monitoring method | |
| Hurley et al. | ITACA: Flexible, scalable network analysis | |
| CN103023891B (en) | The detection method of Botnet and device, the countercheck of Botnet and device | |
| CN106446008A (en) | Management method and analysis system for database security event | |
| CN202696825U (en) | Set top box information management system | |
| CN205693815U (en) | A kind of ultra high-definition transmission of video and storage system | |
| CN105302012B (en) | Information collecting method and system in agriculture field | |
| CN104993977B (en) | Online data monitoring method and system based on IEC61968 standard | |
| CN106501644A (en) | A kind of transformer station measurement and control device test visualization and test information extracting method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |