CN108647315A - Collecting method and system - Google Patents
Collecting method and system Download PDFInfo
- Publication number
- CN108647315A CN108647315A CN201810443020.4A CN201810443020A CN108647315A CN 108647315 A CN108647315 A CN 108647315A CN 201810443020 A CN201810443020 A CN 201810443020A CN 108647315 A CN108647315 A CN 108647315A
- Authority
- CN
- China
- Prior art keywords
- data
- user terminal
- proxy server
- terminal
- harvesting request
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The present invention is suitable for technical field of data processing, provides collecting method and system, this method includes：Proxy server receives the data harvesting request that each user terminal is sent；Proxy server is identified according to destination application, terminal where data harvesting request is forwarded to destination application；Terminal where destination application identifies operational objective application program according to destination application, and carries out data acquisition to the destination application based on target data feature；Terminal where destination application generates data acquisition response according to the user terminal identification in collected data and the data harvesting request, and is sent to proxy server；Proxy server is forwarded to the corresponding user terminal according to the user terminal identification carried in data acquisition response, by data acquisition response.The above method and system can handle the data harvesting request that multiple user terminals are sent simultaneously, multiple user terminals can be supported to be used both independently of each simultaneously.
Description
Technical field
The invention belongs to technical field of data processing more particularly to collecting method and systems.
Background technology
In the information age, enterprise increasingly payes attention to the efficiency that data acquire.At present in the data to application software
When being acquired, data acquisition is usually carried out by data collection agent server such as charles, fiddler and anyproxy.
And traditional data collection agent server can not support multiple long-range user terminals mutually only simultaneously in local disposition
It is vertical to use, cause the efficiency that data acquire poor.
Invention content
In view of this, an embodiment of the present invention provides collecting method and system, it is traditional in the prior art to solve
Data collection agent server can only be used for a user terminal, be unable to support multiple user terminals mutual indepedent simultaneously
The problem of use.
The first aspect of the embodiment of the present invention provides a kind of collecting method, including：
Proxy server receives the data harvesting request that each user terminal is sent, and is carried in the data harvesting request
Destination application mark, user terminal identification and target data feature；
The proxy server is identified according to the destination application, and the data harvesting request, which is forwarded to target, answers
The terminal where program；
Terminal where the destination application runs the destination application according to destination application mark,
And data acquisition is carried out to the destination application based on the target data feature；
Terminal where the destination application is whole according to the user in collected data and the data harvesting request
End mark generates data acquisition response, and is sent to the proxy server；
The proxy server is according to the user terminal identification carried in data acquisition response, by the data
Acquisition response is forwarded to the corresponding user terminal.
Optionally, the method further includes：
The user terminal obtains pre-stored first list, and each application program is had recorded respectively in the first list
Mark and the corresponding target data feature of each application program identification；
Gathered data is extracted in the data acquisition response that the user terminal is forwarded from the proxy server；
The user terminal parses the gathered data, obtains the data characteristics of the gathered data；
The data characteristics of the gathered data is inputted the first list by the user terminal, determines matched institute
Target data feature is stated, and according to the corresponding application program identification of target data feature, determines the data of the gathered data
Source.
Optionally, the method further includes：
The proxy server is index with the user terminal identification, is carried out to the data harvesting request received
Caching；
In the proxy server according to the user terminal identification carried in data acquisition response, by the number
After being forwarded to the corresponding user terminal according to acquisition response, the method further includes：
The corresponding data harvesting request of the user terminal identification is deleted in the buffer.
Optionally, the method further includes：
The modification about the data harvesting request that the user terminal is sent is received to ask；
If being stored with the modification in the caching asks the corresponding data harvesting request, asked according to the modification
The corresponding data harvesting request in the caching is changed, and the modified data harvesting request is forwarded to the mesh
Terminal where marking application program.
Optionally, the proxy server is identified according to the destination application, and the data harvesting request is forwarded
Terminal where to destination application, including：
The proxy server obtains pre-stored second list, and each application is had recorded respectively in the second list
The network address of terminal where program identification and each application program；
Destination application mark is inputted the second list by the proxy server, obtains matched answer
The network address of terminal where program, and according to the network address got, the data harvesting request is forwarded to target
Terminal where application program.
The second aspect of the embodiment of the present invention provides a kind of data collecting system, which is characterized in that including agency service
Terminal and multiple user terminals where device and multiple destination applications；
The proxy server is used to receive the data harvesting request that each user terminal is sent, the data acquisition
Destination application mark, user terminal identification and target data feature are carried in request；
The proxy server is additionally operable to be identified according to the destination application, and the data harvesting request is forwarded to
Terminal where corresponding destination application；
User terminal where the destination application is used to run the target according to destination application mark
Application program, and data acquisition is carried out to the destination application based on the target data feature；
Terminal is also according to the user in collected data and the data harvesting request where the destination application
Terminal iidentification generates data acquisition response, and is sent to the proxy server；
The proxy server is additionally operable to according to the user terminal identification carried in data acquisition response, by institute
It states data acquisition response and is forwarded to the corresponding user terminal.
Optionally, the user terminal has recorded for obtaining pre-stored first list in the first list respectively
Each application program identification and the corresponding target data feature of each application program identification；
The user terminal is additionally operable to the extraction acquisition number from the data acquisition response that the proxy server forwards
According to；
The user terminal is additionally operable to parse the gathered data, obtains the data characteristics of the gathered data；
The user terminal is additionally operable to the data characteristics of the gathered data inputting the first list, determines and it
The target data feature matched, and according to the corresponding application program identification of target data feature, determine the gathered data
Data source.
Optionally, the proxy server is index with the user terminal identification, is acquired to the data received
Request is cached；
In the proxy server according to the user terminal identification carried in data acquisition response, by the number
After being forwarded to the corresponding user terminal according to acquisition response, the proxy server is additionally operable to：
The corresponding data harvesting request of the user terminal identification is deleted in the buffer.
Optionally, the proxy server is additionally operable to：
The modification about the data harvesting request that the user terminal is sent is received to ask；
If being stored with the modification in the caching asks the corresponding data harvesting request, asked according to the modification
The corresponding data harvesting request in the caching is changed, and the modified data harvesting request is forwarded to the mesh
Terminal where marking application program.
The third aspect of the embodiment of the present invention provides a kind of computer readable storage medium, the computer-readable storage
Media storage has computer program, and the step such as above-mentioned collecting method is realized when the computer program is executed by processor
Suddenly.
Existing advantageous effect is the embodiment of the present invention compared with prior art：The embodiment of the present invention, proxy server connect
The data harvesting request that each user terminal is sent is received, and is identified according to destination application, data harvesting request is forwarded to
Terminal where destination application；Terminal identifies operational objective application journey according to destination application where destination application
Sequence, and data acquisition is carried out to destination application based on target data feature, and adopted according to collected data and data
User terminal identification in collection request generates data acquisition response, and is sent to proxy server；Proxy server is according to data
Data acquisition response is forwarded to corresponding user terminal, so as to simultaneously by the user terminal identification carried in acquisition response
The data harvesting request that multiple user terminals are sent is handled, multiple user terminals can be supported to be used both independently of each simultaneously.
Description of the drawings
It to describe the technical solutions in the embodiments of the present invention more clearly, below will be to embodiment or description of the prior art
Needed in attached drawing be briefly described, it should be apparent that, the accompanying drawings in the following description be only the present invention some
Embodiment for those of ordinary skill in the art without having to pay creative labor, can also be according to these
Attached drawing obtains other attached drawings.
Fig. 1 is the system architecture diagram of collecting method provided in an embodiment of the present invention being applicable in；
Fig. 2 is the flow chart of collecting method provided in an embodiment of the present invention；
Fig. 3 is the implementation flow chart of step S102 in Fig. 2；
Fig. 4 is the flow chart of another collecting method provided in an embodiment of the present invention；
Fig. 5 is the running environment schematic diagram of data acquisition program provided in an embodiment of the present invention.
Specific implementation mode
In being described below, for illustration and not for limitation, it is proposed that such as tool of particular system structure, technology etc
Body details, to understand thoroughly the embodiment of the present invention.However, it will be clear to one skilled in the art that there is no these specific
The present invention can also be realized in the other embodiments of details.In other situations, it omits to well-known system, device, electricity
The detailed description of road and method, in case unnecessary details interferes description of the invention.
In order to illustrate technical solutions according to the invention, illustrated below by specific embodiment.
Embodiment one
Fig. 1 shows the system architecture diagram that collecting method provided in an embodiment of the present invention is applicable in, for the ease of saying
Bright, only the parts related to this embodiment are shown.
Referring to Fig.1, the system is by least one user terminal 100, proxy server 200 and at least one application program institute
It is formed in terminal 300, wherein proxy server 200 is for the data harvesting request that each user terminal 100 generates to be sent to
Terminal 300 where corresponding application program, and the response data that application program place terminal 300 returns is received, and will response
Data are sent to corresponding user terminal 100.In Fig. 1, illustrated by taking N number of user terminal, M application program as an example, N and M
It is positive integer, but not limited to this, such as the number of user terminal can be multiple, and the number of application program may be one
It is a.
Within the system, user terminal 100 can be the terminal devices such as personal computer, tablet computer or mobile phone；It answers
The terminal 300 where program may operate in including on the terminal devices such as personal computer, tablet computer or mobile phone；Agency's clothes
Business device 200 is used to provide communication connection between terminal 300 where each user terminal 100 and each application program.
Embodiment two
Fig. 2 shows the implementation processes of collecting method provided by Embodiment 2 of the present invention, and details are as follows：
Step S101, proxy server receive the data harvesting request that each user terminal is sent, and the data acquisition is asked
Destination application mark, user terminal identification and target data feature are carried in asking.
Wherein, the proxy server is separately connected terminal where multiple user terminals and multiple application programs, and target is answered
It can be by the network address for the terminal that destination application is run with program identification.
The destination application is identified as the mark of the application program where the data that user terminal to be acquired, if such as
Data in user's A application programs to be acquired, then the destination application be identified as the corresponding mark of A application programs, such as
By the network address for the terminal that A application programs are run.
The user terminal identification is the mark for the application user terminal for generating the data harvesting request, is used for table
Show the correspondence of each data harvesting request and each user terminal.
The target data is characterized as feature possessed by the characterization user terminal data to be acquired, such as target data spy
Sign can include the information such as object time node, user behavior information and/or target user's mark, and but not limited to this.
In one application scenarios, destination application is A application programs, is identified comprising target user in target data feature
When, then the data corresponding to the target data feature are in A application programs, and target user identifies caused by corresponding user
Behavioural information, for example, target user identify user behavior path node of the corresponding user in A application programs and with each use
Behavior path node corresponding user's operation behavior in family is noted wherein target user mark can be user in A application programs
The account number of volume.
In one application scenarios, destination application is A application programs, is identified comprising target user in target data feature
When with user behavior information, then the data corresponding to the target data feature are in A application programs, and target user, which identifies, to be corresponded to
User caused by certain user behavior information, such as target user identifies corresponding user and generates friendship in A application programs
Easy behavioural information, wherein target user mark can be the account number that user registers in A application programs.
In one application scenarios, destination application is A application programs, is marked comprising target user in target data feature
Know, user behavior information and when preset time node, the satisfaction which generates in A application programs
Certain user behavior information of preset time node, such as between 10 points to 12 points of morning, target user identifies corresponding use
Family generates the behavioural information of transaction in A application programs, is noted in A application programs wherein target user mark can be user
The account number of volume.
It, can be with before the data harvesting request that proxy server receives that each user terminal is sent in the present embodiment
The process that connection is established including each user terminal and proxy server, specifically can be as follows：
Proxy server receives the first connection request that each user terminal is sent, and the first connection request includes target user
Terminal iidentification and the first connectivity verification information for establishing connectivity verification with proxy server；
Whether proxy server verifies the first connectivity verification information correct, if then according to user terminal identification with it is right
The user terminal answered establishes connection.
Wherein, the first connectivity verification information can be digital verification information, word verification information, picture verification information etc.,
This is not limited.
Step S102, the proxy server are identified according to the destination application, and the data harvesting request is turned
Terminal where being sent to destination application.
Wherein, proxy server extracts mesh therein after receiving the data harvesting request that each user terminal is sent
Application program identification is marked, then the data harvesting request is forwarded to corresponding destination application place terminal.
Referring to Fig. 3, the realization process of step S102 can be：
Step S201, proxy server obtain pre-stored second list, are had recorded respectively in the second list each
The network address of terminal where a application program identification and each application program；
Wherein, the second list is stored in advance in proxy server, for terminal where identifying each application program
Network address so that proxy server with can determining the network of terminal where the application program according to application program identification
Location, to which data are sent and/or received with terminal where application program.
In one embodiment, user can record each application program identification and each application in the form of excel tables
The network address of terminal, is then uploaded to proxy server, proxy server reads excel again by excel tables where program
The network address of terminal where each application program identification in table and each application program, by each application program identification and
The network address of terminal is stored where each application program.It is sent out in this way in the network address of terminal where multiple application programs
When changing, user need to only change excel tables and be uploaded to proxy server, can be eaily to each application
The network address of terminal is modified where program identification and each application program.It certainly, in other embodiments, can also be with
Other modes realize, for example, user can directly input each application program in the user interface of proxy server where terminal
Network address generates second list.
Destination application mark is inputted the second list, obtained and it by step S202, proxy server
The network address of terminal where the application program matched, and according to the network address got, the data harvesting request is forwarded
Terminal where to destination application.
Wherein, proxy server is after extracting corresponding destination application mark in each data harvesting request,
Each destination application mark is inputted into the second list respectively, obtains and identifies matched answer with each destination application
The network address of terminal where program, and according to each network address got, each data harvesting request is forwarded to
Terminal where corresponding destination application.
In one application scenarios, illustrated by taking terminal where two user terminals and two destination applications as an example,
Two user terminals are respectively user terminal 1 and user terminal 2, and terminal where two destination applications is respectively A application journeys
Terminal 2 where terminal 1 where sequence and B application programs.Wherein, the application program identification of 1 corresponding A application program of user terminal is used
Family terminal 2 corresponds to the application program identification of B application programs.Record has application program identification and the A of A application programs in second list
The application program identification of the network address and B application programs of the terminal 1 that application program is run is run with B application programs
Terminal 2 network address.
The application program identification of the A application programs extracted from request of data 1 is inputted second list by proxy server
In, the network address for the terminal 1 that A application programs corresponding with the application program identification of A application programs are run is matched, then
Request of data 1 is sent to the terminal 1 that A application programs are run；The B applications that proxy server is extracted from request of data 2
In the application program identification input second list of program, B application journeys corresponding with the application program identification of B application programs are matched
Then request of data 2 is sent to the terminal 2 that A application programs are run by the network address for the terminal 2 that sequence is run.
In one embodiment, proxy server after receiving the data harvesting request that user terminal is sent, first with
Terminal where the corresponding destination application of data harvesting request establishes connection, and data harvesting request is then sent to correspondence again
Destination application where terminal.Wherein, proxy server can with the process of terminal foundation connection where destination application
Think：
Proxy server obtains the second pre-stored connectivity verification information according to destination application mark, and by institute
State terminal request connection where the second connectivity verification information is sent to corresponding destination application；It is pre- in the proxy server
It is stored with multipair one-to-one destination application mark and the second connectivity verification information；
Terminal where destination application is verified according to the second connectivity verification information, and in second connection
When verification information is correct, establishes and connect with the proxy server.
Wherein, the second connectivity verification information can be digital verification information, word verification information, picture verification information etc.,
This is not limited.
In addition, for multiple data harvesting requests, proxy server can be excellent according to the forwarding of each data harvesting request
First grade determines forwarding form.Specifically, according to the sequence of the forwarding priority of each data harvesting request, according to
The data harvesting request is sent to corresponding application program by corresponding data forwarding form, and the data forwarding form includes
Http acts on behalf of forwarding form, https acts on behalf of forwarding form and directly acts on behalf of forwarding form.
For example, https, which acts on behalf of forwarding form, can correspond to the data harvesting request of forwarding priority highest level, http generations
Reason forwarding form can correspond to the data harvesting request of forwarding priority intermediate-grade, directly act on behalf of forwarding form and can correspond to and turn
Send out the data harvesting request of priority lowest level.In the present embodiment, pass through the data harvesting request for different forwarding priorities
Corresponding data forwarding form is set, the efficiency of data forwarding can be improved.
Step S103, terminal where the destination application run the target according to destination application mark
Application program, and data acquisition is carried out to the destination application based on the target data feature.
Wherein, after terminal where destination application receives data harvesting request, the mesh in data harvesting request is extracted
Application program identification is marked, and runs the destination application, is then based on the target data feature to the intended application
Program carries out data acquisition.In the present embodiment, target signature data include object time node, user behavior information and/or mesh
Mark the information such as user identifier.
In one application scenarios, destination application is A application programs, is identified comprising target user in target data feature
When, then the data acquired are in A application programs, and target user identifies behavioural information caused by corresponding user, such as mesh
Mark user behavior path node of the corresponding user of user identifier in A application programs and with each user behavior path node pair
The user's operation behavior answered.
In one application scenarios, destination application is A application programs, is identified comprising target user in target data feature
When with user behavior information, then the data acquired are in A application programs, and target user identifies certain caused by corresponding user
Kind user behavior information, such as target user identify the behavioural information that corresponding user generates transaction in A application programs.
In one application scenarios, destination application is A application programs, is marked comprising target user in target data feature
When knowledge, user behavior information and preset time node, then the data acquired are that the satisfaction that user generates in A application programs is default
Certain user behavior information of timing node, such as between 10 points to 12 points of morning, target user identifies corresponding user in A
The behavioural information of transaction is generated in application program.
Step S104, terminal is according in collected data and the data harvesting request where the destination application
User terminal identification generate data acquisition response, and be sent to the proxy server.
Wherein, after destination application is according to target data collection apparatus to gathered data, can by gathered data and
User terminal identification in data harvesting request the operations such as is packaged and generates data acquisition response, is sent to proxy server.
Wherein, the user terminal identification in data acquisition response is for making proxy server identify that data acquisition responds corresponding user
Terminal.
When corresponding to more than two data harvesting requests for a destination application, proxy server can be by two
Above data harvesting request is sent to terminal where destination application one by one；The destination application is adopted according to each data
Target data feature in collection request carries out data acquisition one by one, and by collected gathered data and corresponding user terminal mark
Know generation data acquisition response and is sent to proxy server.
Step S105, the user terminal identification that the proxy server carries in being responded according to data acquisition,
Data acquisition response is forwarded to the corresponding user terminal.
Wherein, after the data acquisition response that terminal where proxy server receives each destination application is sent back,
The user terminal identification in each data acquisition response is extracted, data acquisition response is then forwarded to corresponding user terminal.
Referring to Fig. 4, in one embodiment, after user terminal receives the data acquisition response that proxy server is sent back,
Execute following process：
Step S301, the user terminal obtain pre-stored first list, are had recorded respectively in the first list each
A application program identification and the corresponding target data feature of each application program identification.
Wherein, user terminal acquires each data of transmission after being sent to the data harvesting request of proxy server
Application program identification and corresponding target data feature in request carry out storage and generate first list, for receiving agency
It is checked after the data acquisition response that server is sent back, if all data harvesting requests receive data acquisition and ring
It answers.
Step S302 extracts acquisition in the data acquisition response that the user terminal is forwarded from the proxy server
Data.
Wherein, after user terminal receives the data acquisition response that the proxy server forwards, described in extraction
Gathered data in data acquisition response.
In one embodiment, appointment data the data format responded and gathered data can be acquired in the data in advance
Corresponding position in format, to extract gathered data according to the position of agreement.Certainly, destination application institute in step S104
In terminal when generating data acquisition response according to gathered data and user terminal identification, it should also be given birth to according to the data format of agreement
It acquires and responds at data.
Step S303, the user terminal parse the gathered data, obtain the data characteristics of the gathered data.
Wherein, the user terminal parses to obtain gathered data gathered data after extracting gathered data
In data characteristics.For example, user terminal can extract the keyword in gathered data by way of keyword extraction, then
Using the keyword extracted as the data characteristics of gathered data.The keyword is keyword corresponding with target data feature.
For example, the keyword is user identifier, timing node etc..The keyword is determined in destination application, user
In the user behavior that some timing node is implemented.
The data characteristics of the gathered data is inputted the first list by step S304, the user terminal, determine with
Its matched described target data feature, and according to the corresponding application program identification of target data feature, determine the acquisition
The data source of data.
Wherein, user terminal may send multiple data harvesting requests, each data harvesting request to proxy server
Different destination application marks and/or target data feature may be corresponded to.User terminal extracts the number of gathered data
After feature, data characteristics is input in first list, to the target data feature in data characteristics and first list into
Row matching, corresponding application program identification is determined according to the target data feature matched, so that it is determined that data acquisition response
Corresponding destination application determines that data acquisition responds corresponding data harvesting request.
In one embodiment, data characteristics is matched with the target data feature in first list, so that it is determined that should
The process that data acquisition responds corresponding destination application can be：
Data characteristics is matched with all information in each target data feature；Such as target data feature includes
Object time node, user behavior information and target user's mark, data characteristics include characterizing object time node respectively, using
The keyword of family behavioural information and target user's mark, then by each keyword and object time node, user behavior information and
Target user identifies Corresponding matching；
The highest target data feature of matching degree is obtained, and true according to the corresponding application program identification of target data feature
Fixed data acquisition responds corresponding destination application.
Optionally, after step s 102, the method further includes：The proxy server is with the user terminal identification
For index, the data harvesting request received is cached.Corresponding, after step S105, the method is also wrapped
It includes：The proxy server deletes the corresponding data harvesting request of the user terminal identification in the buffer.
Wherein, proxy server is that index caches data harvesting request with the user terminal identification, Neng Gouji
The data harvesting request that each user terminal is sent is recorded, while after completion of step s 105, deletes the user in the buffer
The corresponding data harvesting request of terminal iidentification, can clearly record whether each data harvesting request all has received data
Acquisition responds and is transmitted to user terminal, exercises supervision so as to the executive condition to data harvesting request, is especially receiving
When the data harvesting request arrived is more.
Further, the method can also include：
The modification about the data harvesting request that the user terminal is sent is received to ask；
If being stored with the modification in the caching asks the corresponding data harvesting request, asked according to the modification
The corresponding data harvesting request in the caching is changed, and the modified data harvesting request is forwarded to the mesh
Terminal where marking application program.
Wherein, user terminal can be as needed or modifies within a preset period of time to data harvesting request.Specifically
, user terminal, which generates, asks the modification that some data harvesting request is modified, whole comprising user in the modification request
End mark and modification information；After proxy server receives the modification request, according to the user terminal in the modification request
Mark is detected in the buffer, if is stored with the modification and is asked the corresponding data harvesting request, if so, then basis
Modification information in the modification request changes the corresponding data harvesting request in the caching, and will be modified described
Data harvesting request is forwarded to terminal where the destination application.
Above-mentioned collecting method, proxy server receive the data harvesting request that each user terminal is sent, and according to
Destination application identifies, terminal where data harvesting request is forwarded to destination application；Where destination application eventually
End identifies operational objective application program according to destination application, and based on target data feature to destination application into line number
Data acquisition response is generated according to acquisition, and according to the user terminal identification in collected data and data harvesting request, and
It is sent to proxy server；Data are acquired and are rung according to the user terminal identification carried in data acquisition response by proxy server
It should be forwarded to corresponding user terminal, so as to handle the data harvesting request that multiple user terminals are sent, Neng Goutong simultaneously
When support multiple user terminals to be used both independently of each；And each user terminal can in real time repair data harvesting request
Change, the data harvesting request that different user terminals are sent out can be directed to same destination application, can also be directed to different
Destination application, it is mutual indepedent between each user terminal, it is unaffected.
It should be understood that the size of the serial number of each step is not meant that the order of the execution order in above-described embodiment, each process
Execution sequence should be determined by its function and internal logic, the implementation process without coping with the embodiment of the present invention constitutes any limit
It is fixed.
Embodiment three
Corresponding to the collecting method described in foregoing embodiments, Fig. 5 shows that data provided in an embodiment of the present invention are adopted
The structural schematic diagram of collecting system.
Terminal 502 and multiple use where the data collecting system, including proxy server 501 and multiple destination applications
Family terminal 503.
The proxy server 501 is used to receive the data harvesting request that each user terminal 503 is sent, the number
Destination application mark, user terminal identification and target data feature are carried in being asked according to acquisition.
The proxy server 501 is additionally operable to be identified according to the destination application, and the data harvesting request is turned
Terminal 502 where being sent to corresponding destination application.
User terminal 502 where the destination application is used to run the mesh according to destination application mark
Application program is marked, and data acquisition is carried out to the destination application based on the target data feature.
Terminal 502 is also according to the use in collected data and the data harvesting request where the destination application
Family terminal iidentification generates data acquisition response, and is sent to the proxy server 501.
The proxy server 501 is additionally operable to according to the user terminal identification carried in data acquisition response,
Data acquisition response is forwarded to the corresponding user terminal 503.
Optionally, the user terminal 503 is used for：
Pre-stored first list is obtained, each application program identification is had recorded respectively in the first list and each answers
With the corresponding target data feature of program identification；
Gathered data is extracted from the data acquisition response that the proxy server forwards；
The gathered data is parsed, the data characteristics of the gathered data is obtained；
The data characteristics of the gathered data is inputted into the first list, determines that the matched target data is special
Sign, and according to the corresponding application program identification of target data feature, determine the data source of the gathered data.
Optionally, the proxy server 501 is index with the user terminal identification, is adopted to the data received
Collection request is cached；
In the proxy server according to the user terminal identification carried in data acquisition response, by the number
After being forwarded to the corresponding user terminal according to acquisition response, the proxy server 501 is additionally operable to：
The corresponding data harvesting request of the user terminal identification is deleted in the buffer.
Optionally, the proxy server 501 is additionally operable to：
The modification about the data harvesting request that the user terminal is sent is received to ask；
If being stored with the modification in the caching asks the corresponding data harvesting request, asked according to the modification
The corresponding data harvesting request in the caching is changed, and the modified data harvesting request is forwarded to the mesh
Terminal where marking application program.
Optionally, the proxy server 501 is identified according to the destination application, and the data harvesting request is turned
Terminal where being sent to destination application, including：
The proxy server 501 obtains pre-stored second list, is had recorded respectively in the second list each
The network address of terminal where application program identification and each application program；
Destination application mark is inputted the second list by the proxy server 501, is obtained matched
Application program where terminal 502 network address, and according to the network address got, the data harvesting request is forwarded
Terminal 502 where to destination application.
In embodiment provided by the present invention, it should be understood that disclosed device/terminal device and method, it can be with
It realizes by another way.For example, device described above/terminal device embodiment is only schematical, for example, institute
The division of module or unit is stated, only a kind of division of logic function, formula that in actual implementation, there may be another division manner, such as
Multiple units or component can be combined or can be integrated into another system, or some features can be ignored or not executed.Separately
A bit, shown or discussed mutual coupling or direct-coupling or communication connection can be by some interfaces, device
Or INDIRECT COUPLING or the communication connection of unit, can be electrical, machinery or other forms.
The unit illustrated as separating component may or may not be physically separated, aobvious as unit
The component shown may or may not be physical unit, you can be located at a place, or may be distributed over multiple
In network element.Some or all of unit therein can be selected according to the actual needs to realize the mesh of this embodiment scheme
's.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, it can also
It is that each unit physically exists alone, it can also be during two or more units be integrated in one unit.Above-mentioned integrated list
The form that hardware had both may be used in member is realized, can also be realized in the form of SFU software functional unit.
If the integrated module/unit be realized in the form of SFU software functional unit and as independent product sale or
In use, can be stored in a computer read/write memory medium.Based on this understanding, the present invention realizes above-mentioned implementation
All or part of flow in example method, can also instruct relevant hardware to complete, the meter by computer program
Calculation machine program can be stored in a computer readable storage medium, the computer program when being executed by processor, it can be achieved that on
The step of stating each embodiment of the method.Wherein, the computer program includes computer program code, the computer program generation
Code can be source code form, object identification code form, executable file or certain intermediate forms etc..The computer-readable medium
May include：Any entity or device, recording medium, USB flash disk, mobile hard disk, magnetic of the computer program code can be carried
Dish, CD, computer storage, read-only memory (ROM, Read-Only Memory), random access memory (RAM,
Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium etc..It should be noted that described
The content that computer-readable medium includes can carry out increasing appropriate according to legislation in jurisdiction and the requirement of patent practice
Subtract, such as in certain jurisdictions, according to legislation and patent practice, computer-readable medium does not include electric carrier signal and electricity
Believe signal.
Embodiment described above is merely illustrative of the technical solution of the present invention, rather than its limitations；Although with reference to aforementioned reality
Applying example, invention is explained in detail, it will be understood by those of ordinary skill in the art that：It still can be to aforementioned each
Technical solution recorded in embodiment is modified or equivalent replacement of some of the technical features；And these are changed
Or replace, the spirit and scope for various embodiments of the present invention technical solution that it does not separate the essence of the corresponding technical solution should all
It is included within protection scope of the present invention.
Claims (10)
1. a kind of collecting method, which is characterized in that including：
Proxy server receives the data harvesting request that each user terminal is sent, and target is carried in the data harvesting request
Application program identification, user terminal identification and target data feature；
The proxy server is identified according to the destination application, and the data harvesting request is forwarded to intended application journey
Terminal where sequence；
Terminal where the destination application runs the destination application, and base according to destination application mark
Data acquisition is carried out to the destination application in the target data feature；
Terminal is according to the user terminal mark in collected data and the data harvesting request where the destination application
Know and generate data acquisition response, and is sent to the proxy server；
The proxy server acquires the data according to the user terminal identification carried in data acquisition response
Response is forwarded to the corresponding user terminal.
2. collecting method as described in claim 1, which is characterized in that further include：
The user terminal obtains pre-stored first list, and each application program identification is had recorded respectively in the first list
And the corresponding target data feature of each application program identification；
Gathered data is extracted in the data acquisition response that the user terminal is forwarded from the proxy server；
The user terminal parses the gathered data, obtains the data characteristics of the gathered data；
The data characteristics of the gathered data is inputted the first list by the user terminal, determines the matched mesh
Data characteristics is marked, and according to the corresponding application program identification of target data feature, determines the data source of the gathered data.
3. collecting method as described in claim 1, which is characterized in that the method further includes：
The proxy server is index with the user terminal identification, is delayed to the data harvesting request received
It deposits；
In the proxy server according to the user terminal identification carried in data acquisition response, the data are adopted
Collection response is forwarded to after the corresponding user terminal, and the method further includes：
The corresponding data harvesting request of the user terminal identification is deleted in the buffer.
4. collecting method as claimed in claim 3, which is characterized in that the method further includes：
The modification about the data harvesting request that the user terminal is sent is received to ask；
If being stored with the modification in the caching asks the corresponding data harvesting request, ask to change according to the modification
The corresponding data harvesting request in the caching, and the modified data harvesting request is forwarded to the target and is answered
The terminal where program.
5. such as Claims 1-4 any one of them collecting method, which is characterized in that the proxy server is according to institute
Destination application mark is stated, the data harvesting request is forwarded to destination application place terminal, including：
The proxy server obtains pre-stored second list, and each application program is had recorded respectively in the second list
The network address of terminal where mark and each application program；
Destination application mark is inputted the second list by the proxy server, obtains matched application journey
The network address of terminal where sequence, and according to the network address got, the data harvesting request is forwarded to intended application
Terminal where program.
6. a kind of data collecting system, which is characterized in that including terminal where proxy server and multiple destination applications and
Multiple user terminals；
The proxy server is used to receive the data harvesting request that each user terminal is sent, the data harvesting request
In carry destination application mark, user terminal identification and target data feature；
The proxy server is additionally operable to be identified according to the destination application, and the data harvesting request is forwarded to correspondence
Destination application where terminal；
User terminal where the destination application is used to run the intended application according to destination application mark
Program, and data acquisition is carried out to the destination application based on the target data feature；
Terminal is also according to the user terminal in collected data and the data harvesting request where the destination application
Mark generates data acquisition response, and is sent to the proxy server；
The proxy server is additionally operable to according to the user terminal identification carried in data acquisition response, by the number
It is forwarded to the corresponding user terminal according to acquisition response.
7. data collecting system as claimed in claim 6, which is characterized in that
The user terminal has recorded each application program respectively for obtaining pre-stored first list in the first list
Mark and the corresponding target data feature of each application program identification；
The user terminal is additionally operable to extract gathered data from the data acquisition response that the proxy server forwards；
The user terminal is additionally operable to parse the gathered data, obtains the data characteristics of the gathered data；
The user terminal is additionally operable to the data characteristics of the gathered data inputting the first list, determines matched
The target data feature, and according to the corresponding application program identification of target data feature, determine the number of the gathered data
According to source.
8. data collecting system as claimed in claim 7, which is characterized in that the proxy server is with the user terminal mark
Know to index, the data harvesting request received is cached；
In the proxy server according to the user terminal identification carried in data acquisition response, the data are adopted
Collection response is forwarded to after the corresponding user terminal, and the proxy server is additionally operable to：
The corresponding data harvesting request of the user terminal identification is deleted in the buffer.
9. data collecting system as claimed in claim 8, which is characterized in that the proxy server is additionally operable to：
The modification about the data harvesting request that the user terminal is sent is received to ask；
If being stored with the modification in the caching asks the corresponding data harvesting request, ask to change according to the modification
The corresponding data harvesting request in the caching, and the modified data harvesting request is forwarded to the target and is answered
The terminal where program.
10. a kind of computer readable storage medium, the computer-readable recording medium storage has computer program, feature to exist
In when the computer program is executed by processor the step of any one of such as claim 1 to 5 of realization the method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810443020.4A CN108647315A (en) | 2018-05-10 | 2018-05-10 | Collecting method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810443020.4A CN108647315A (en) | 2018-05-10 | 2018-05-10 | Collecting method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108647315A true CN108647315A (en) | 2018-10-12 |
Family
ID=63754284
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810443020.4A Pending CN108647315A (en) | 2018-05-10 | 2018-05-10 | Collecting method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108647315A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110138626A (en) * | 2019-07-10 | 2019-08-16 | 江苏金恒信息科技股份有限公司 | System, the method and device that a kind of pair of terminal device is monitored |
| CN110222253A (en) * | 2019-06-12 | 2019-09-10 | 北京睦合达信息技术股份有限公司 | A kind of collecting method, equipment and computer readable storage medium |
| CN111355787A (en) * | 2020-02-20 | 2020-06-30 | 北京汽车集团有限公司 | Information transmission method and device and electronic equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103294515A (en) * | 2013-06-28 | 2013-09-11 | 北京小米科技有限责任公司 | Method, device and system for acquiring application programs |
| CN103678417A (en) * | 2012-09-25 | 2014-03-26 | 华为技术有限公司 | Man-machine interaction data processing method and device |
| CN104483880A (en) * | 2014-12-15 | 2015-04-01 | 四川长虹电器股份有限公司 | Data acquisition method and data acquisition server |
| CN105141663A (en) * | 2015-07-27 | 2015-12-09 | 北京邮电大学世纪学院 | User behavior information acquisition method and device |
| CN107018046A (en) * | 2017-06-06 | 2017-08-04 | 上海鋆创信息技术有限公司 | A kind of collecting method, device, terminal and storage medium |
-
2018
- 2018-05-10 CN CN201810443020.4A patent/CN108647315A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103678417A (en) * | 2012-09-25 | 2014-03-26 | 华为技术有限公司 | Man-machine interaction data processing method and device |
| CN103294515A (en) * | 2013-06-28 | 2013-09-11 | 北京小米科技有限责任公司 | Method, device and system for acquiring application programs |
| CN104483880A (en) * | 2014-12-15 | 2015-04-01 | 四川长虹电器股份有限公司 | Data acquisition method and data acquisition server |
| CN105141663A (en) * | 2015-07-27 | 2015-12-09 | 北京邮电大学世纪学院 | User behavior information acquisition method and device |
| CN107018046A (en) * | 2017-06-06 | 2017-08-04 | 上海鋆创信息技术有限公司 | A kind of collecting method, device, terminal and storage medium |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110222253A (en) * | 2019-06-12 | 2019-09-10 | 北京睦合达信息技术股份有限公司 | A kind of collecting method, equipment and computer readable storage medium |
| CN110138626A (en) * | 2019-07-10 | 2019-08-16 | 江苏金恒信息科技股份有限公司 | System, the method and device that a kind of pair of terminal device is monitored |
| CN111355787A (en) * | 2020-02-20 | 2020-06-30 | 北京汽车集团有限公司 | Information transmission method and device and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107872772B (en) | Method and device for detecting fraud short messages | |
| CN107404481B (en) | User information recognition methods and device | |
| CN106921957B (en) | The recognition methods of secondary number of distributing telephone numbers and device | |
| CN105469502A (en) | Intelligent oiling method and terminal | |
| CN109582655B (en) | Method and device for positioning system log and computer readable storage medium | |
| CN109639636A (en) | Business datum forwarding, business data processing method, device and electronic equipment | |
| CN102932775A (en) | Method and device for carrying out terminal identification by combining IMEI and UA | |
| CN104133765B (en) | The test case sending method of network activity and test case server | |
| CN108647315A (en) | Collecting method and system | |
| CN108810123A (en) | The method and apparatus for opening mobile cellular network service | |
| JP6974688B2 (en) | Communication methods, terminals, telecommunications company servers and smart devices | |
| CN104796322A (en) | Message processing method and equipment | |
| CN103581317B (en) | A kind of method of network resources locating | |
| CN107590682B (en) | Advertisement putting method, server, hotspot device and system | |
| CN110392155A (en) | It has been shown that, processing method, device and the equipment of notification message | |
| CN104765792A (en) | Dimension data storing method, device and system | |
| CN105959306A (en) | IP address identification method and device | |
| KR100752351B1 (en) | System and method realtime question and answers by communication media which can transfer interactively data or voice | |
| CN103326892B (en) | The operating method and device of web interface | |
| CN110287049A (en) | Data processing method, device and storage medium | |
| CN106452816A (en) | Information processing method, server and client | |
| CN105704237B (en) | A kind of charge processing method and relevant device, server | |
| CN110337074B (en) | Interactive information transmission method, system and terminal equipment | |
| CN114222284A (en) | Terminal equipment identification method and device and readable storage medium | |
| CN109348053B (en) | Telephone number mark processing method, server, terminal device and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |