CN105740396B - HTTP data processing method and device - Google Patents
HTTP data processing method and device Download PDFInfo
- Publication number
- CN105740396B CN105740396B CN201610057592.XA CN201610057592A CN105740396B CN 105740396 B CN105740396 B CN 105740396B CN 201610057592 A CN201610057592 A CN 201610057592A CN 105740396 B CN105740396 B CN 105740396B
- Authority
- CN
- China
- Prior art keywords
- http
- network
- tool
- component interface
- event
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/951—Indexing; Web crawling techniques
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
- Information Transfer Between Computers (AREA)
Abstract
the invention relates to a method and a device for processing HTTP data, and belongs to the technical field of computers. The method comprises the following steps: the method comprises the steps of inquiring a component interface of a network grabbing tool, calling the network grabbing tool to grab a hypertext transfer protocol (HTTP) communication data packet of a target process according to the inquired component interface, and carrying out statistical processing on data contained in the grabbed HTTP communication data packet.
Description
Technical Field
The invention relates to the technical field of computers, in particular to a method and a device for processing HTTP data.
Background
the web application is an application program which can be accessed through the web, and has the advantage that the user can easily access the application program, namely, the user only needs to install a browser in the electronic equipment to browse the web application program, and other components or programs do not need to be additionally installed.
for a web application developed based on an HTTP (Hyper Text Transfer Protocol), a developer needs to capture and analyze an HTTP packet of the web application in the processes of development, testing, and operation and maintenance. Because the existing network packet capturing tool can only display captured data in a display area of the existing network packet capturing tool and developers cannot perform statistics and other processing on the captured data, the current method for developers is to independently develop a complete program containing HTTP packet capturing and data processing.
in implementing the present invention, the applicant has found that the following problems exist in the prior art:
When programs including HTTP packet capturing and data processing are developed autonomously, the implementation of HTTP bottom protocol packet capturing is involved, the development difficulty and workload are high, and the development period of web application products is influenced.
Disclosure of Invention
the embodiment of the invention provides a method and a device for processing HTTP data, and the technical scheme is as follows:
according to a first aspect of the embodiments of the present invention, there is provided an HTTP data processing method, including:
Querying a component interface of a network capture tool;
calling a network grabbing tool to grab a hypertext transfer protocol (HTTP) communication data packet of a target process according to the inquired component interface;
And performing statistical processing on the data contained in the captured HTTP communication data packet.
Optionally, the invoking a network crawling tool to crawl the HTTP packet of the target process according to the queried component interface includes:
Detecting whether the target process is running;
if the detection result is that the target process is running, calling a network grabbing tool background according to the component interface to grab the HTTP communication data packet in a preset time period;
and saving the captured HTTP communication data packet to a specified document.
optionally, the statistical processing of the data included in the captured HTTP communication packet includes:
Counting data corresponding to a specified event in data contained in the HTTP communication data packet, wherein the data corresponding to the specified event comprises: whether the specified event is reported, the reporting time, the event version and the event source;
And storing the data corresponding to the specified event.
Optionally, the method further includes:
And generating a chart or an event report according to the data corresponding to the specified event.
optionally, the component interface of the query network crawling tool includes:
acquiring the identifier of the network grabbing tool;
and inquiring the component interface from the network side according to the identifier of the network grabbing tool.
According to a second aspect of the embodiments of the present invention, there is provided an HTTP data processing apparatus including:
The query module is used for querying the component interface of the network grabbing tool;
The capturing module is used for calling a network capturing tool to capture a hypertext transfer protocol (HTTP) communication data packet of the target process according to the inquired component interface;
and the processing module is used for carrying out statistical processing on the data contained in the captured HTTP communication data packet.
optionally, the grabbing module includes:
A detection unit for detecting whether the target process is running;
The capturing unit is used for calling a network capturing tool to capture the HTTP communication data packet in the subsequent preset time period according to the component interface if the detection result of the detection unit indicates that the target process is running;
And the storage unit is used for storing the captured HTTP communication data packet to a specified document.
optionally, the processing module includes:
A counting unit, configured to count data corresponding to a specified event in data included in the HTTP communication packet, where the data corresponding to the specified event includes: whether the specified event is reported, the reporting time, the event version and the event source;
and the storage unit is used for storing the data corresponding to the specified event.
Optionally, the apparatus further comprises:
And the generating module is used for generating a chart or an event report according to the data corresponding to the specified event.
optionally, the query module includes:
the identification acquisition unit is used for acquiring the identification of the network grabbing tool;
And the interface query unit is used for querying the component interface from the network side according to the identifier of the network grabbing tool.
The technical scheme provided by the embodiment of the invention has the following beneficial effects:
By inquiring a component interface of a network grabbing tool, calling the network grabbing tool to grab a hypertext transfer protocol (HTTP) communication data packet of a target process according to the inquired component interface, and performing statistical processing on data contained in the grabbed HTTP communication data packet; the method has the advantages that the HTTP communication data packet of the target process is captured based on the calling of the existing network capture tool component interface, the captured data packet is subjected to statistical processing, the problems that development difficulty and workload are large and the development cycle of a web application product is influenced when programs including HTTP capture and data processing are independently developed are solved, and the effects of reducing development difficulty and workload, saving development time and shortening the development cycle of the web application product are achieved.
it is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as claimed.
Drawings
the accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.
FIG. 1 is a flow diagram illustrating a method of HTTP data processing in accordance with an illustrative embodiment;
FIG. 2 is a flow diagram illustrating a method of HTTP data processing in accordance with another illustrative embodiment;
FIG. 3 is a block diagram illustrating an HTTP data processing apparatus according to an exemplary embodiment;
Fig. 4 is a block diagram illustrating an HTTP data processing apparatus according to another exemplary embodiment;
FIG. 5 is a block diagram illustrating an apparatus in accordance with an exemplary embodiment;
FIG. 6 is a block diagram illustrating a device according to an example embodiment.
Detailed Description
reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the invention, as detailed in the appended claims.
the method provided by the embodiment of the invention can be applied to the electronic equipment for installing and running the application program. For example, electronic devices include, but are not limited to, electronic devices such as PCs (Personal computers), cell phones, tablet computers, laptop computers, and wearable devices. The application program may be a Web application program, and the Web application program may be run on an operating system such as a window system, a Mac system, a Unix system, or a Linux system based on a browser program installed in the operating system.
fig. 1 is a flowchart illustrating an HTTP data processing method according to an exemplary embodiment, which may be used in an electronic device, such as a PC, a mobile phone, a tablet computer, a laptop computer, and a wearable device, and as shown in fig. 1, the method may include the following steps.
In step 101, the component interface of the network crawling tool is queried.
in step 102, a network grabbing tool is called according to the inquired component interface to grab a hypertext transfer protocol (HTTP) communication data packet of the target process.
in step 103, statistical processing is performed on the data included in the captured HTTP communication packet.
in summary, according to the HTTP data processing method provided in this embodiment, by querying the component interface of the network capture tool, invoking the network capture tool to capture the hypertext transfer protocol HTTP communication data packet of the target process according to the queried component interface, and performing statistical processing on the data included in the captured HTTP communication data packet, the problems that development difficulty and workload are large and the development cycle of the web application product is affected when a program including HTTP capture and data processing is autonomously developed are solved, and effects of reducing development difficulty and workload, saving development time, and shortening the development cycle of the web application product are achieved.
in the method provided by the above embodiment of the present invention, a com (component) interface provided by an existing third-party network grabber is obtained, a network grabber object is obtained through the com interface, and the object can call an API method of the network grabber through an autonomous programming means after being obtained, so as to implement the functions of grabbing and storing a data packet, and after the packet grabbing is finished, required data is automatically extracted from the automatically stored data and processed. By the method, codes for realizing bottom layer packet capturing can be saved from being independently developed, and HTTP data packet capturing can be realized through the existing network capturing tool by calling the component interface. The following embodiments of the present invention will illustrate the above-described scheme with reference to specific application scenarios.
fig. 2 is a flowchart illustrating an HTTP data processing method according to another exemplary embodiment, which may be used in an electronic device, such as a PC, a mobile phone, a tablet computer, a laptop computer, and a wearable device, as shown in fig. 2, and which may include the following steps.
In step 201, the component interface of the network crawling tool is queried.
In the embodiment of the invention, the electronic equipment can acquire the identifier of the network grasping tool and inquire the component interface from the network side according to the identifier of the network grasping tool.
For example, taking the program implementation language as the AutoIT language and the network crawling tool as the Http Analyzer as an example, the server on the network side may store component interfaces called by the Http Analyzer for different programming languages, and after the electronic device obtains the identifier of the Http Analyzer, the electronic device may query the network side for the component interface of the Http Analyzer corresponding to the AutoIT language, or the electronic device may query a locally stored help manual (which may be a txt document) of the Http Analyzer, so as to obtain the component interface of the Http Analyzer corresponding to the AutoIT language; the code may be as follows:
$oInternet=ObjCreate("HTTPAnalyzerStd.HTTPAnalyzerStandAlone")
In step 202, a network grabbing tool is called according to the inquired component interface to grab a hypertext transfer protocol (HTTP) communication data packet of the target process.
in the embodiment of the invention, the electronic equipment can call the method of the network capture tool through the inquired component interface so as to realize the functions of real-time monitoring of the network capture tool in the background, automatic starting of packet capture in the background, stopping of packet capture, filtering of data packets, automatic storage and the like.
for example, taking the web crawler as Http Analyzer and the scripting language as AutoIT language as examples, the code for setting the web crawler to start in the background may be as follows:
$oInternet.Visible=$Visible
The advantage of setting up the background running is that other tasks can be processed after real-time monitoring of HTTP communication packets.
when the inquired component interface calls a network grabbing tool to grab a hypertext transfer protocol (HTTP) communication data packet of a target process, the electronic equipment can detect whether the target process is running, if the detection result is that the target process is running, the electronic equipment calls a network grabbing tool background according to the component interface to grab the HTTP communication data packet in a preset time period, and the grabbed HTTP communication data packet is stored in a specified document. Similarly, taking the network crawling tool as http library and the scripting language as AutoIT language as examples, the code can be implemented as follows:
The code represents: by monitoring the process A (namely the target process, A is the process name), starting the data packet capturing action, stopping the capturing action after capturing the HTTP communication data packet corresponding to the process A of the previous 5s, and storing the captured HTTP communication data packet into the data.
In step 203, data corresponding to a specified event is counted among data included in the HTTP communication packet, where the data corresponding to the specified event includes: whether the specified event is reported, the reporting time, the event version and the event source.
the HTTP communication packets captured by the electronic device in the above steps include all HTTP communication packets performed by the target process with the network side within a specified time period, wherein only a part of the HTTP communication packets is data required by the developer. In the embodiment of the present invention, after the electronic device captures the HTTP communication data packet, the electronic device may screen data in the HTTP communication data packet, and count data required by a developer therein, for example, data corresponding to a crash event, including time for reporting the crash, a crash version, a channel source, whether the crash is reported, and the like.
In step 204, the data corresponding to the specified event is stored.
After counting the data corresponding to the specified event, the electronic device stores the counted data in another document for further processing.
similarly, taking the web crawler as Http Analyzer, the scripting language as AutoIT language, and the event as a crash event as an example, the codes of step 203 and step 204 may be implemented as follows:
in step 205, a chart or an event report is generated based on the data corresponding to the specified event.
In the embodiment of the invention, after the electronic device stores the data corresponding to the specified event, a chart or an event report corresponding to the specified event can be generated according to the data corresponding to the specified event, so that a subsequent developer can conveniently view the chart or the event report.
in summary, according to the HTTP data processing method provided in the embodiment of the present invention, by querying the component interface of the network capture tool, invoking the network capture tool to capture the HTTP communication data packet of the target process according to the queried component interface, and performing statistical processing on the data included in the captured HTTP communication data packet, problems that development difficulty and workload are large and the development cycle of the web application product is affected when a program including HTTP capture and data processing is autonomously developed are solved, and effects of reducing development difficulty and workload, saving development time, and shortening the development cycle of the web application product are achieved.
Fig. 3 is a block diagram of an HTTP data processing apparatus provided according to an example embodiment. The apparatus may be applied to an electronic device, which may be an electronic device such as a PC, a mobile phone, a tablet computer, a laptop computer, and a wearable device, and as shown in fig. 3, the apparatus may include: a query module 301, a grab module 302, and a processing module 303.
the query module 301 is used for querying the component interfaces of the network grabbing tool;
a fetching module 302, configured to invoke the network fetching tool to fetch a hypertext transfer protocol HTTP communication data packet of a target process according to the queried component interface;
and the processing module 303 is configured to perform statistical processing on the data included in the captured HTTP communication data packet.
In summary, the HTTP data processing apparatus provided in this embodiment queries the component interface of the network capture tool, invokes the network capture tool to capture the HTTP communication data packet of the target process according to the queried component interface, and performs statistical processing on the data included in the captured HTTP communication data packet, thereby solving the problems of large development difficulty and workload and affecting the development cycle of the web application product when independently developing a program including HTTP capture and data processing, and achieving the effects of reducing the development difficulty and workload, saving the development time, and shortening the development cycle of the web application product.
fig. 4 is a block diagram of an HTTP data processing apparatus provided according to another exemplary embodiment. The apparatus may be applied to the above electronic devices, which may be electronic devices such as a PC, a mobile phone, a tablet computer, a laptop computer, and a wearable device, and as shown in fig. 4, the apparatus may include: a query module 401, a grab module 402, and a processing module 403.
The query module 401 is configured to query a component interface of a network capture tool;
a fetching module 402, configured to invoke the network fetching tool to fetch a hypertext transfer protocol HTTP communication data packet of a target process according to the queried component interface;
A processing module 403, configured to perform statistical processing on data included in the captured HTTP communication data packet.
Optionally, the grabbing module 402 includes:
a detecting unit 402a, configured to detect whether the target process is running;
A fetching unit 402b, configured to, if the detection result of the detecting unit 402a is that the target process is running, invoke the network fetching tool to fetch an HTTP communication data packet in a subsequent predetermined time period according to the component interface;
A saving unit 402c, configured to save the captured HTTP communication packet to a specified document.
optionally, the processing module 403 includes:
A counting unit 403a, configured to count data corresponding to a specified event in the data included in the HTTP communication packet, where the data corresponding to the specified event includes: whether the specified event is reported, reporting time, event version and event source;
The storage unit 403b is configured to store data corresponding to the specified event.
Optionally, the apparatus further comprises:
A generating module 404, configured to generate a chart or an event report according to the data corresponding to the specified event.
optionally, the query module 401 includes:
An identifier obtaining unit 401a, configured to obtain an identifier of the network grasping tool;
The interface query unit 401b is configured to query the component interface from the network side according to the identifier of the network crawling tool.
in summary, the HTTP data processing apparatus provided in the embodiment of the present invention queries the component interface of the network capture tool, calls the network capture tool to capture the HTTP communication data packet of the target process according to the queried component interface, and performs statistical processing on the data included in the captured HTTP communication data packet, so as to solve the problems of large development difficulty and workload and influence on the development cycle of the web application product when a program including HTTP capture and data processing is autonomously developed, thereby achieving the effects of reducing the development difficulty and workload, saving the development time, and shortening the development cycle of the web application product.
Fig. 5 is a schematic structural diagram of an apparatus 500 provided according to an embodiment of the invention. For example, the device 500 may be a PC. Referring to fig. 5, device 500 includes a processing component 522 that further includes one or more processors and memory resources, represented by memory 532, for storing instructions, e.g., applications, that are executable by processing component 522. The application programs stored in memory 532 may include one or more modules that each correspond to a set of instructions. Further, the processing component 522 is configured to execute instructions to perform the HTTP data processing method described above.
The device 500 may also include a power component 526 configured to perform power management for the device 500, a wired or wireless network interface 550 configured to connect the device 500 to a network, and an input/output (I/O) interface 558. The device 500 may operate based on an operating system stored in memory 532, such as Windows Server, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM, or the like.
Referring to fig. 6, a schematic structural diagram of an apparatus 600 according to an embodiment of the present invention is shown. The electronic device may be a mobile phone, a tablet computer, a laptop computer, a wearable device, or other electronic device. Specifically, the method comprises the following steps:
Device 600 may include RF circuitry 610, memory 620 including one or more computer-readable storage media, input unit 630, display unit 640, sensor 650, audio circuitry 660, WiFi (wireless fidelity) module 670, processor 680 including one or more processing cores, and power supply 690 among other components. Those skilled in the art will appreciate that the configuration of the apparatus shown in fig. 6 is not intended to be limiting of the apparatus and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components. Wherein:
the RF circuit 610 may be used for receiving and transmitting signals during information transmission and reception or during a call, and in particular, for receiving downlink information from a base station and then processing the received downlink information by the one or more processors 680; in addition, data relating to uplink is transmitted to the base station. Typically, the RF circuitry includes, but is not limited to, an antenna, at least one Amplifier, a tuner, one or more oscillators, a Subscriber Identity Module (SIM) card, a transceiver, a coupler, an LNA (Low Noise Amplifier), a duplexer, and the like. In addition, the RF circuitry may also communicate with networks and other devices via wireless communications. The wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System for Mobile communications), GPRS (General Packet Radio Service), CDMA (Code Division Multiple Access), WCDMA (Wideband Code Division Multiple Access), LTE (Long Term Evolution), email, SMS (Short messaging Service), etc.
The memory 620 may be used to store software programs and modules. The processor 680 executes various functional applications and data processing by executing software programs and modules stored in the memory 620. The memory 620 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the stored data area may store data (such as audio data, a phonebook, etc.) created according to the use of the apparatus 600, and the like. Further, the memory 620 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, the memory 620 may also include a memory controller to provide the processor 680 and the input unit 630 access to the memory 620.
the input unit 630 may be used to receive input numeric or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control. In particular, the input unit 630 may include a touch sensitive surface 631 as well as other input devices 632. The touch sensitive surface 631, also referred to as a touch display screen or a touch pad, may collect touch operations by a user (e.g., operations by a user on the touch sensitive surface 631 or near the touch sensitive surface 631 using any suitable object or attachment such as a finger, a stylus, etc.) on or near the touch sensitive surface 631 and drive the corresponding connection device according to a predetermined program. Alternatively, the touch sensitive surface 631 may comprise two parts, a touch detection means and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 680, and can receive and execute commands sent by the processor 680. In addition, the touch sensitive surface 631 may be implemented using various types of resistive, capacitive, infrared, and surface acoustic waves. The input unit 630 may include other input devices 632 in addition to the touch-sensitive surface 631. In particular, other input devices 632 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.
The display unit 640 may be used to display information input by or provided to a user and various graphical user interfaces of the device 100, which may be made up of graphics, text, icons, video, and any combination thereof. The Display unit 640 may include a Display panel 641, and optionally, the Display panel 641 may be configured in the form of an LCD (Liquid Crystal Display), an OLED (Organic Light-Emitting Diode), or the like. Further, the touch sensitive surface 631 can be overlaid on the display panel 641, and when the touch sensitive surface 631 detects a touch operation thereon or nearby, the touch operation can be transmitted to the processor 680 to determine the type of the touch event, and then the processor 680 can provide a corresponding visual output on the display panel 641 according to the type of the touch event. Although in FIG. 6, the touch-sensitive surface 631 and the display panel 641 are implemented as two separate components to implement input and output functions, in some embodiments, the touch-sensitive surface 631 and the display panel 641 may be integrated to implement input and output functions.
The device 600 may also include at least one sensor 650, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor that may adjust the brightness of the display panel 641 according to the brightness of ambient light, and a proximity sensor that may turn off the display panel 641 and/or the backlight when the device 600 is moved to the ear. As one of the motion sensors, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when the mobile phone is stationary, and can be used for applications of recognizing the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer and tapping), and the like; as for the other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which may be further configured to the device 600, they will not be described herein.
Audio circuitry 660, speaker 621, microphone 622 may provide an audio interface between a user and device 600. The audio circuit 660 can transmit the electrical signal converted from the received audio data to the speaker 621, and the electrical signal is converted into a sound signal by the speaker 621 and output; on the other hand, the microphone 622 converts the collected sound signals into electrical signals, which are received by the audio circuit 660 and converted into audio data, which are then processed by the audio data output processor 680 and sent to another device via the RF circuit 610 or output to the memory 620 for further processing. The audio circuitry 660 may also include an earbud jack to provide communication of peripheral headphones with the device 600.
WiFi belongs to short-range wireless transmission technology, and the device 600 can help the user send and receive e-mails, browse web pages, access streaming media, etc. through the WiFi module 670, which provides wireless broadband internet access for the user. Although fig. 6 shows a WiFi module 670, it is understood that it does not belong to the essential constitution of the device 600 and can be omitted entirely as needed within the scope not changing the essence of the invention.
the processor 680 is the control center of the device 600, and connects various parts of the entire device using various interfaces and lines, and performs various functions of the device 600 and processes data by operating or executing software programs and/or modules stored in the memory 620 and calling data stored in the memory 620, thereby monitoring the entire device. Optionally, processor 680 may include one or more processing cores; optionally, the processor 680 may integrate an application processor and a modem processor, wherein the application processor mainly handles operating systems, user interfaces, application programs, and the like, and the modem processor mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 680.
device 600 also includes a power supply 690 (e.g., a battery) for powering the various components, which may be preferably logically coupled to processor 680 via a power management system that may be used to manage charging, discharging, and power consumption. The power supply 690 may also include any component including one or more dc or ac power sources, recharging systems, power failure detection circuitry, power converters or inverters, power status indicators, and the like.
although not shown, the device 600 may also include a camera, a bluetooth module, etc., which are not described in detail herein.
The apparatus 600 further comprises a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, so that the electronic apparatus 600 can perform all or part of the steps of the HTTP data processing method performed by the electronic apparatus shown in fig. 1 or fig. 2.
other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.
It will be understood that the invention is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the invention is limited only by the appended claims.
Claims (6)
1. An HTTP data processing method, comprising:
querying a component interface of a third-party network crawling tool, wherein the component interface comprises:
obtaining the identification of the third-party network crawling tool,
Inquiring the component interface from a network side according to the identifier of the third-party network grabbing tool;
Calling the network grabbing tool to grab a hypertext transfer protocol (HTTP) communication data packet of a target process according to the inquired component interface;
Performing statistical processing on data contained in the captured HTTP communication data packet, wherein the statistical processing on data contained in the captured HTTP communication data packet includes:
Screening the data contained in the HTTP communication data packet, and counting the data corresponding to the specified event, wherein the data corresponding to the specified event comprises: whether the specified event is reported, reporting time, event version and event source;
And storing the data corresponding to the specified event.
2. the method according to claim 1, wherein the invoking the network crawling tool to crawl the hypertext transfer protocol (HTTP) packet of the target process according to the queried component interface comprises:
Detecting whether the target process is running;
if the detection result is that the target process is running, calling the network grabbing tool background to grab the HTTP communication data packet in a preset time period according to the component interface;
and saving the captured HTTP communication data packet to a specified document.
3. the method of claim 1, further comprising:
And generating a chart or an event report according to the data corresponding to the specified event.
4. an HTTP data processing apparatus, comprising:
The query module is used for querying the component interface of the third-party network grasping tool, wherein the query module comprises:
An identification obtaining unit, configured to obtain an identification of the third-party network crawling tool,
The interface query unit is used for querying the component interface from a network side according to the identifier of the third-party network capture tool;
The grabbing module is used for calling the network grabbing tool to grab a hypertext transfer protocol (HTTP) communication data packet of a target process according to the inquired component interface;
The processing module is used for performing statistical processing on the data contained in the captured HTTP communication data packet, wherein the processing module comprises:
a counting unit, configured to filter data included in the HTTP communication packet, and count data corresponding to a specified event, where the data corresponding to the specified event includes: whether the specified event is reported, reporting time, event version and event source;
And the storage unit is used for storing the data corresponding to the specified event.
5. the apparatus of claim 4, wherein the grasping module comprises:
the detection unit is used for detecting whether the target process is running;
The capturing unit is used for calling the network capturing tool to capture the HTTP communication data packet in the subsequent preset time period according to the component interface if the detection result of the detection unit indicates that the target process is running;
And the storage unit is used for storing the captured HTTP communication data packet to a specified document.
6. the apparatus of claim 4, further comprising:
and the generating module is used for generating a chart or an event report according to the data corresponding to the specified event.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610057592.XA CN105740396B (en) | 2016-01-27 | 2016-01-27 | HTTP data processing method and device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610057592.XA CN105740396B (en) | 2016-01-27 | 2016-01-27 | HTTP data processing method and device |
Publications (2)
Publication Number | Publication Date |
---|---|
CN105740396A CN105740396A (en) | 2016-07-06 |
CN105740396B true CN105740396B (en) | 2019-12-10 |
Family
ID=56246771
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610057592.XA Active CN105740396B (en) | 2016-01-27 | 2016-01-27 | HTTP data processing method and device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN105740396B (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110113771B (en) * | 2019-03-22 | 2022-06-17 | 深圳市飞比电子科技有限公司 | Data processing method, device, gateway equipment and storage medium |
CN114417103A (en) * | 2021-12-30 | 2022-04-29 | 中国电信股份有限公司 | Processing method of spectroscopic data and related device |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102045220A (en) * | 2010-12-09 | 2011-05-04 | 国都兴业信息审计系统技术(北京)有限公司 | Wooden horse monitoring and auditing method and system thereof |
CN102664935A (en) * | 2012-04-06 | 2012-09-12 | 北京锐安科技有限公司 | Method and system for associated output of WEB class user behavior and user information |
US8577956B2 (en) * | 2006-03-01 | 2013-11-05 | Riverbed Technology | User-configurable network performance monitors |
CN103763125A (en) * | 2013-12-27 | 2014-04-30 | 北京集奥聚合科技有限公司 | Statistical method and device for number of actual users in operator network |
CN104022924A (en) * | 2014-07-02 | 2014-09-03 | 浪潮电子信息产业股份有限公司 | Method for detecting HTTP (hyper text transfer protocol) communication content |
-
2016
- 2016-01-27 CN CN201610057592.XA patent/CN105740396B/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8577956B2 (en) * | 2006-03-01 | 2013-11-05 | Riverbed Technology | User-configurable network performance monitors |
CN102045220A (en) * | 2010-12-09 | 2011-05-04 | 国都兴业信息审计系统技术(北京)有限公司 | Wooden horse monitoring and auditing method and system thereof |
CN102664935A (en) * | 2012-04-06 | 2012-09-12 | 北京锐安科技有限公司 | Method and system for associated output of WEB class user behavior and user information |
CN103763125A (en) * | 2013-12-27 | 2014-04-30 | 北京集奥聚合科技有限公司 | Statistical method and device for number of actual users in operator network |
CN104022924A (en) * | 2014-07-02 | 2014-09-03 | 浪潮电子信息产业股份有限公司 | Method for detecting HTTP (hyper text transfer protocol) communication content |
Also Published As
Publication number | Publication date |
---|---|
CN105740396A (en) | 2016-07-06 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2017206916A1 (en) | Method for determining kernel running configuration in processor and related product | |
EP3525417A1 (en) | Data processing method, device, storage medium, electronic device and server | |
CN104383681B (en) | Method for controlling game program, device and mobile terminal | |
CN106502906B (en) | A kind of method and apparatus of test application program | |
WO2018077041A1 (en) | Method and apparatus for running application | |
CN103473163B (en) | application program detection method and device | |
CN106874077B (en) | Process running method and device | |
WO2018076945A1 (en) | Thread data processing method, device and terminal | |
WO2017206915A1 (en) | Method for determining kernel running configuration in processor and related product | |
CN108111676B (en) | Application program control method, mobile terminal and computer readable storage medium | |
CN106649126B (en) | Method and device for testing application program | |
WO2016082109A1 (en) | User equipment power management method and power management device | |
CN106254910B (en) | Method and device for recording image | |
CN109284144B (en) | Fast application processing method and mobile terminal | |
CN104123276A (en) | Method, device and system for intercepting popup windows in browser | |
WO2018166204A1 (en) | Method for controlling fingerprint recognition module, and mobile terminal and storage medium | |
WO2014206138A1 (en) | Webpage data update method, apparatus and terminal device | |
CN106919458B (en) | Method and device for Hook target kernel function | |
CN106101764A (en) | A kind of methods, devices and systems showing video data | |
CN112199246B (en) | Terminal test method and device, storage medium and mobile terminal | |
CN107122036B (en) | Method and device for adjusting frequency of central processing unit | |
CN109688611B (en) | Frequency band parameter configuration method, device, terminal and storage medium | |
CN105740396B (en) | HTTP data processing method and device | |
CN108984265B (en) | Method and device for detecting virtual machine environment | |
CN108089935B (en) | Application program management method and mobile terminal |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
CB02 | Change of applicant information | ||
CB02 | Change of applicant information |
Address after: 510660 Guangzhou City, Guangzhou, Guangdong, Whampoa Avenue, No. 315, self - made 1-17 Applicant after: Guangzhou KuGou Networks Co., Ltd. Address before: 510000 B1, building, No. 16, rhyme Road, Guangzhou, Guangdong, China 13F Applicant before: Guangzhou KuGou Networks Co., Ltd. |
|
GR01 | Patent grant | ||
GR01 | Patent grant |