CN106611019A - Collection method, device and system for Web page data - Google Patents

Collection method, device and system for Web page data Download PDF

Info

Publication number
CN106611019A
CN106611019A CN201510708638.5A CN201510708638A CN106611019A CN 106611019 A CN106611019 A CN 106611019A CN 201510708638 A CN201510708638 A CN 201510708638A CN 106611019 A CN106611019 A CN 106611019A
Authority
CN
China
Prior art keywords
page
collection
picture
page data
area domain
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510708638.5A
Other languages
Chinese (zh)
Inventor
李夫强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Gridsum Technology Co Ltd
Original Assignee
Beijing Gridsum Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Gridsum Technology Co Ltd filed Critical Beijing Gridsum Technology Co Ltd
Priority to CN201510708638.5A priority Critical patent/CN106611019A/en
Publication of CN106611019A publication Critical patent/CN106611019A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/958Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
    • G06F16/972Access to data in other repository systems, e.g. legacy data or dynamic Web page generation

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The invention discloses a collection method, device and system for Web page data. The method, the device and the system are convenient for a user to directly view collected local area data and can store a real visual effect of the collected area data, and the user does not need to carry out composing on the collected area data. The method comprises the following steps of obtaining page data collection information when a page data collection request sent by the user is received; sending the page data collection information to a server to generate to-be-collected page area pictures according to the page data collection information, and storing the to-be-collected page area pictures into a picture server; and receiving an address of the picture server, which is sent by the server, in order to make the user view the collected page data subsequently. The method, the device and the system are mainly used for local data collection of a Web page.

Description

The collecting method of Web page data, apparatus and system
Technical field
The present invention relates to page data collection field, more particularly to a kind of collection side of Web page data Method, apparatus and system.
Background technology
Web page collection of data is one of basic function of Modern Web website, and user is carrying out Web The data in current page can be collected while page access, so as to facilitate user in needs Shi Jinhang is checked.
Generally when user checks collection data, mainly using following two methods:One kind is in user When checking collection data, according to User Status from page data set (such as tables of data or daily record) Association is found actual collection content and is presented, and does not preserve the real data of collection, but is preserved Unique mark of current User Status, i.e. active user mark, querying condition or data to be collected etc., However, the method needs the data again to collecting to be associated inquiry when collection data are checked every time, Equivalent to searching again for data, it has not been convenient to which user directly carries out collecting data and checks, while working as The data volume collected than it is larger when, also data acquisition system can be caused during data are checked Larger pressure;Another kind is that actual data are directly collected when user checks collection data, is presented To the data of the actual collection of user, however, what the method only preserved is collection data itself, not The actual visual effect of collection data is preserved, user is if wanting to obtain the real visual effect of collection data Need, by re-starting typesetting to collecting data, to user operation inconvenience to be brought.
The content of the invention
In view of the above problems, it is proposed that the present invention overcomes the problems referred to above or at least portion to provide one kind Collecting method, the apparatus and system of the Web page data for solving the above problems with dividing, is easy to user straight Connect the part area data to collecting to check, while collection area data can be preserved really regarding Feel effect, user to collecting area data without the need for re-starting typesetting.
By above-mentioned technical proposal, according to one aspect of the present invention, there is provided a kind of Web page data Collecting method, including:
When page data collection request is received, page data Information on Collection, the page number are obtained Include according to Information on Collection:The page feature information of current page, the page in page data collection region are special Reference breath, the page data collect region with respect to the side-play amount of basic point, the reference address of current page And the querying condition set of impact page data;
The page data Information on Collection is sent to into server, so that the server is according to the page Face collection of data information generates the page and treats collecting area domain picture, and the page is treated into collecting area domain picture Store to picture servers, the page is treated collecting area domain picture and had in the page for collection page data The upper true picture that effect is presented;
The address of the picture servers that the reception server sends, so that user subsequently checks collection Page data.
According to another aspect of the present invention, there is provided a kind of collecting method of Web page data, including:
Page data Information on Collection is received, the page data Information on Collection includes:The page of current page Region feature information, the page feature information in page data collection region, page data collection region The reference address of side-play amount, current page with respect to basic point and the querying condition collection of impact page data Close;
The page is generated according to the page data Information on Collection and treats collecting area domain picture, the page is due-in Tibetan area domain picture is to collect page data to have the true picture that effect is presented on the page;
The page is treated into that collecting area domain picture is stored to picture servers, and by the picture servers Address be sent to user, so that user subsequently checks the page data of collection.
According to another aspect of the invention, there is provided a kind of client, including:
Acquiring unit, for when page data collection request is received, obtaining page data collection letter Breath, the page data Information on Collection includes:The page feature information of current page, page data are received The page feature information in Tibetan area domain, the side-play amount of the relative basic point in page data collection region, currently The reference address of the page and the querying condition set of impact page data;
Transmitting element, for the page data Information on Collection to be sent to into server, so as to the clothes Business device generates the page and treats collecting area domain picture according to the page data Information on Collection, and by the page Treat that collecting area domain picture is stored to picture servers, the page treats collecting area domain picture for the collection page Data have the true picture that effect is presented on the page;
Receiving unit, the address of the picture servers sent for the reception server, so as to user Subsequently check the page data of collection.
According to further aspect of the present invention, there is provided a kind of server, including:
Receiving unit, for receiving page data Information on Collection, the page data Information on Collection includes: The page feature information of current page, page data collect page feature information, the page in region Collection of data region is with respect to the side-play amount of basic point, the reference address of current page and affects page data Querying condition set;
Picture signal generating unit, generates the page and treats collecting area domain picture according to the page data Information on Collection, The page treats that collecting area domain picture is to collect page data to have the true figure that effect is presented on the page Piece;
Memory cell, for the page to be treated into collecting area domain picture is stored to picture servers, and will The address of the picture servers is sent to user, so that user subsequently checks the page data of collection.
According to present invention also offers a kind of collection system of Web page data, including:Client and Server;
The client, for obtaining page data Information on Collection, and page data collection is believed Breath is sent to server;
The server, for receiving the page data Information on Collection that the client sends, according to institute State the page data Information on Collection generation page and treat collecting area domain picture;
The server, is additionally operable to for the page to treat that collecting area domain picture is stored to picture servers, The page treats that collecting area domain picture is to collect page data to have the true figure that effect is presented on the page Piece;
The client, is additionally operable to the address of the picture servers of the reception server transmission, so as to User subsequently checks the page data of collection.
A kind of collecting method of the Web page data provided by above-mentioned technical proposal, the present invention, dress Put and system, first, client obtains page data Information on Collection, and the page data is collected Information is sent to server;Server receives the page data Information on Collection that the client sends, root The page being generated according to the page data Information on Collection and treating collecting area domain picture, the page of the generation is waited to collect Region picture retains real visual effect;Further by the page treat collecting area domain picture store to Picture servers, so that user subsequently checks the page data of collection;The method is by server end Picture processing is carried out, the page is generated and is treated collecting area domain picture, with existing page data collecting method phase Than the collection of data of regional area can be realized, while remaining the true of regional area collection data Visual effect, and then reduce data coupling, by treating that collecting area domain picture is carried out to the page Storage, facilitates user to check.
Described above is only the general introduction of technical solution of the present invention, in order to better understand the present invention's Technological means, and being practiced according to the content of specification, and in order to allow the above-mentioned of the present invention and Other objects, features and advantages can become apparent, below especially exemplified by the specific embodiment of the present invention.
Description of the drawings
By the detailed description for reading hereafter preferred embodiment, various other advantage and benefit for Those of ordinary skill in the art will be clear from understanding.Accompanying drawing is only used for illustrating the mesh of preferred embodiment , and it is not considered as limitation of the present invention.And in whole accompanying drawing, with identical with reference to symbol Number represent identical part.In the accompanying drawings:
Fig. 1 shows a kind of collecting method flow chart of Web page data provided in an embodiment of the present invention;
Fig. 2 shows the collecting method flow process of another kind of Web page data provided in an embodiment of the present invention Figure;
Fig. 3 shows the collecting method flow process of another Web page data provided in an embodiment of the present invention Figure;
Fig. 4 shows the collecting method flow process of another Web page data provided in an embodiment of the present invention Figure;
Fig. 5 shows a kind of client provided in an embodiment of the present invention;
Fig. 6 shows another kind of client provided in an embodiment of the present invention;
Fig. 7 shows a kind of server provided in an embodiment of the present invention;
Fig. 8 shows another kind of server provided in an embodiment of the present invention;
Fig. 9 shows a kind of collection system construction drawing of Web page data provided in an embodiment of the present invention.
Specific embodiment
The exemplary embodiment of the disclosure is more fully described below with reference to accompanying drawings.Although showing in accompanying drawing The exemplary embodiment of the disclosure is shown, it being understood, however, that may be realized in various forms the disclosure And should not be limited by embodiments set forth here.On the contrary, there is provided these embodiments are able to more Thoroughly understand the disclosure, and can be by the complete technology for conveying to this area of the scope of the present disclosure Personnel.
A kind of collecting method of Web page data is embodiments provided, client is can apply to End, as shown in figure 1, methods described includes:
101st, when the page data collection request of user's transmission is received, page data collection letter is obtained Breath.
Wherein, the page data Information on Collection includes:The page feature information of current page, the page The page feature information in collection of data region, page data collection region with respect to basic point side-play amount, The reference address of current page and the querying condition set of impact page data;
It should be noted that the relative basic point can sets itself as the case may be, for example, The basic point can be set to the top left corner apex or upper right angular vertex of current page, or on the page Any point.
Further, the page feature information of the current page is the total length and beam overall of current page Degree;The page feature information in the page data collection region is the total of the page data collection region Length and overall width;The page data collection region is left side offset X with respect to the side-play amount of basic point, Head bias amount Y;It is described to affect the querying condition collection of page data to be combined into what is presented for current page The querying condition of data, the querying condition set includes all querying condition collection of current page data Close.
102nd, the page data Information on Collection is sent to into server.
Wherein, the server can generate the page and treat collecting area according to the page data Information on Collection Domain picture, and the page is treated into that collecting area domain picture is stored to picture servers.Wherein, the page The picture that collecting area domain picture is the data that user needs collection is treated in face, and by the server The page obtained after process treats that collecting area domain picture remains real visual effect.
Further, the present embodiment can be received the page data for getting by Ajax Post modes Tibetan information is sent to server;Wherein, the Ajax is a kind of technology for creating interaction network page, In the present invention Ajax realizes transmitting data by Post, so as to the data transfer of client extremely be taken Business end.
In addition, can be convenient by the way that the page of acquisition is treated into collecting area domain picture is stored to picture servers User is checked, and records the access network address of the picture servers, and user can be with client Check that the page of collection treats collecting area domain picture by the access network address.
103rd, the address of the picture servers that the reception server sends, so that user subsequently checks receipts The page data of Tibetan.
Wherein, if when user needs to check page collection data, needing the figure sent according to server The network address of piece server carries out page data and checks, now user only needs to check a pictures, together When can present and collect the same effect of the page with Web.
A kind of collecting method of Web page data provided in an embodiment of the present invention, first, client is obtained Page data Information on Collection is taken, and the page data Information on Collection is sent to into server;Server The page data Information on Collection that the client sends is received, is given birth to according to the page data Information on Collection Collecting area domain picture is treated into the page, the page of the generation treats that collecting area domain picture retains real vision effect Really;Further the page is treated into that collecting area domain picture is stored to picture servers, so as to user it is follow-up Check the page data of collection;The method generates the page and treats by carrying out picture processing in server end Collection region picture, compared with existing page data collecting method, can realize the number of regional area According to collection, while remaining the real visual effect of regional area collection data, and then data are reduced Coupling, by treating that collecting area domain picture is stored to the page, facilitates user to check.
The collecting method of another kind of Web page data is embodiments provided, visitor is can apply to Family end, as shown in Fig. 2 methods described includes:
201st, when the page data collection request of user's transmission is received, page is obtained by predetermined instruction Face collection of data information.
Specifically, the predetermined instruction is by existing instruction in JavaScript, you can obtain the page Collection of data information, wherein, the page data Information on Collection includes:The page feature of current page Information, the page feature information in page data collection region, the page data collect region with respect to base The querying condition set of the side-play amount, the reference address of current page and impact page data of point.
202nd, the page data Information on Collection is sent to into server, so that the server is according to institute State the page data Information on Collection generation page and treat collecting area domain picture, and the page is treated into collecting area domain Picture is stored to picture servers.
It should be noted that because current page cannot carry out picture processing, therefore the above-mentioned generation page Treating the operation of collecting area domain picture is carried out in the server.
Further, the server is according to the page data Information on Collection for receiving, first according to page Veil location and the querying condition of data, generate the page consistent with current page, then call drawing letter It is several that the above-mentioned page is processed, the picture consistent with current page is generated, finally the picture is carried out One partial cut away, intercepts region and is data area to be collected, and by the picture in the intercepting region Preserve to picture servers, while recording the picture servers network address, collection process is completed, with standby Family is checked.
Picture servers described in this step are the separate servers exclusively for the optimization of picture read-write operation, Generally when website has a large amount of picture read-write operations, it should photo services are separated first, Independent picture servers are exactly set up, the picture servers set up in the present embodiment are used for storing use The page data picture of the collection finally to be checked of family, can not only improve web site performance, while also can Improve Consumer's Experience, facilitate user to check collection data picture.
203rd, when the collection page data for receiving user's transmission checks request, taken according to the picture The address of business device sends to the picture servers checks request.
Specifically, when user needs to check the page data collected, can be sent out according to picture servers The network address sent is clicked through checks, page collection data now are presented in the form of picture, and And the visual effect of current browse webpage is saved, user is without the need for carrying out any process or inquiring about behaviour Make.
204th, the corresponding page of the collection page data for receiving the picture servers transmission is waited to collect Region picture.
For the embodiment of the present invention, specific application scenarios are as follows, but not limited to this, including: When user clicks on the collection of data button of current page, client obtains page data by JavaScript Information on Collection, for example, the total length for remembering current page is PW, and the overall width for remembering current page is PH; The page data treats that the total length in collecting area domain is designated as AW, and the page data treats the total of collecting area domain Width is designated as AH;The page data collection region is left side offset X with respect to the side-play amount of basic point, Head bias amount Y;The reference address of note current page is PageUrl, by the impact page data Query set is designated as Query;Obtain and above-mentioned page data Information on Collection is transferred to into clothes after information above Business device, server is processed the page data Information on Collection for receiving, specially:According to above-mentioned Current page reference address be PageUrl and affect page data query set be designated as Query, One is generated with the current page identical page, as Page, then by the drawing of invoking server Function, to Page process, generates and current page identical picture.I.e. total length is PW, Overall width is the picture Pic of PH, similar to the picture that Baidu's Snapshot Method is realized;Then to the picture Pic carries out the intercepting of local, intercepts the rectangular extent that region is data area to be collected, specific to intercept According to can be:With the picture upper left corner as basic point, then left side skew X, head bias Y intercept One rectangular area, the total length of the rectangular area is AW, and overall width is AH.And will be truncated to Picture is saved in picture servers, records the network address of the picture servers, completes page data collection.
A kind of collecting method of Web page data provided in an embodiment of the present invention, first, client is obtained Page data Information on Collection is taken, and the page data Information on Collection is sent to into server;Server The page data Information on Collection that the client sends is received, is given birth to according to the page data Information on Collection Collecting area domain picture is treated into the page, the page of the generation treats that collecting area domain picture retains real vision effect Really;Further the page is treated into that collecting area domain picture is stored to picture servers, so as to user it is follow-up Check the page data of collection;The method generates the page and treats by carrying out picture processing in server end Collection region picture, compared with existing page data collecting method, can realize the number of regional area According to collection, while remaining the real visual effect of regional area collection data, and then data are reduced Coupling, by treating that collecting area domain picture is stored to the page, facilitates user to check.
Embodiments provide the collecting method flow chart of another Web page data, Ke Yiyong In server, as shown in figure 3, methods described includes:
301st, the page data Information on Collection that receive user sends.
Wherein, the page data Information on Collection includes:The page feature information of current page, the page The page feature information in collection of data region, page data collection region with respect to basic point side-play amount, The reference address of current page and the querying condition set of impact page data;
The specific descriptions of the page data Information on Collection and explanation have been elaborated in a step 101, Here is not being repeated.
302nd, the page is generated according to the page data Information on Collection and treats collecting area domain picture.
The concrete operations of this step have:According to the reference address of current page and looking into for impact page data Ask set of circumstances and generate customer terminal webpage;Drawing function is called to process the customer terminal webpage, Obtain the total length of the current page and the customer terminal webpage picture of overall width;Advised using default intercepting Then partial cut away is carried out to the customer terminal webpage picture, obtain the page and treat collecting area domain picture;Wherein, It is described it is default intercepting rule be:It is basic point according to the customer terminal webpage picture upper left corner, with respect to basic point Side-play amount be left side offset X, head bias amount be Y, by the page data collection region enter Row rectangular area intercepts.
303rd, the page is treated into that collecting area domain picture is stored to picture servers, and the picture is taken The address of business device is sent to user, so that user subsequently checks the page data of collection.
Wherein, if when user needs to check local page collection data, needing to be sent according to server The network address of picture servers carry out page data and check, now user only needs to check a pictures, Can present simultaneously and collect the same effect of the page with Web.
A kind of collecting method of Web page data provided in an embodiment of the present invention, first, client is obtained Page data Information on Collection is taken, and the page data Information on Collection is sent to into server;Server The page data Information on Collection that the client sends is received, is given birth to according to the page data Information on Collection Collecting area domain picture is treated into the page, collection of data is realized, the page of the generation treats that collecting area domain picture is protected Stay real visual effect;Further the page is treated into that collecting area domain picture is stored to picture servers, So that user subsequently checks the page data of collection;The method by carrying out picture processing in server end, Generate the page and treat collecting area domain picture, compared with existing page data collecting method, office can be realized The collection of data in portion region, while the real visual effect of regional area collection data is remained, and then Data coupling is reduced, by treating that collecting area domain picture is stored to the page, facilitates user to look into See.
Embodiments provide the collecting method flow chart of another Web page data, Ke Yiyong In server, as shown in figure 4, methods described includes:
401st, the page data Information on Collection that receive user sends.
Wherein, the page data Information on Collection includes:The page feature information of current page, the page The page feature information in collection of data region, page data collection region with respect to basic point side-play amount, The reference address of current page and the querying condition set of impact page data;
The specific descriptions of the page data Information on Collection and explanation have been elaborated in a step 101, Here is not being repeated.
402nd, the page is generated according to the page data Information on Collection and treats collecting area domain picture.
For the embodiment of the present invention, specific application scenarios can be:Page data Information on Collection is remembered first For the total length of current page is PW, and the overall width of current page is PH;The page data is treated The total length in collection region is AW, and the page data treats that the overall width in collecting area domain is AH;It is described The side-play amount of the relative basic point in page data collection region is left side offset X, head bias amount Y;When The reference address of the front page is PageUrl, and the query set by the impact page data is Query; Then it is PageUrl and the query set for affecting page data according to the reference address of above-mentioned current page Conjunction is designated as Query, generates one with the current page identical page, as Page, then by adjusting With the drawing function of server, to Page process, generate and current page identical picture.I.e. Total length is PW, and overall width is the picture Pic of PH, similar to the picture that Baidu's Snapshot Method is realized; Then the intercepting of local is carried out to picture Pic, the rectangle model that region is data area to be collected is intercepted Enclose, the specific foundation that intercepts can be:With the picture upper left corner as basic point, left side skew X, head is inclined Y is moved, a rectangular area is then intercepted, the total length of the rectangular area is AW, and overall width is AH. The rectangular area picture for finally giving is that the page for generating treats collecting area domain picture.
403rd, the page is treated into that collecting area domain picture is stored to picture servers, and the picture is taken The address of business device is sent to user.
Wherein, the picture servers treat collecting area domain picture for memory page, by clicking on the figure The access network address of piece server carries out local data's collection picture and checks, convenient user operation, together Shi Tigao access speeds.
404th, when the collection page data for receiving user's transmission checks request, store described to figure The collection page datagram piece of piece server is sent to user and checks.
Specifically, when user needs to check the page data collected, can be sent out according to picture servers The network address sent is clicked through checks, page collection data now are presented in the form of picture, and And the visual effect of current browse webpage is saved, user is without the need for carrying out any process or inquiring about behaviour Make.
A kind of collecting method of Web page data provided in an embodiment of the present invention, first, client is obtained Page data Information on Collection is taken, and the page data Information on Collection is sent to into server;Server The page data Information on Collection that the client sends is received, is given birth to according to the page data Information on Collection Collecting area domain picture is treated into the page, the page of the generation treats that collecting area domain picture retains real vision effect Really;Further the page is treated into that collecting area domain picture is stored to picture servers, so as to user it is follow-up Check the page data of collection;The method generates the page and treats by carrying out picture processing in server end Collection region picture, compared with existing page data collecting method, can realize the number of regional area According to collection, while remaining the real visual effect of regional area collection data, and then data are reduced Coupling, by treating that collecting area domain picture is stored to the page, facilitates user to check.
Further, implementing as Fig. 1 methods describeds, the embodiment of the present invention provides a kind of visitor Family end, as shown in figure 5, the client includes:Acquiring unit 51, transmitting element 52, reception are single Unit 53.
The acquiring unit 51, for when the page data collection request of user's transmission is received, obtaining Take page data Information on Collection;
The transmitting element 52, for the page data Information on Collection to be sent to into server;
Further, so that the server is due-in according to the page data Information on Collection generation page Tibetan area domain picture, and the page is treated into that collecting area domain picture is stored to picture servers;
The receiving unit 53, the address of the picture servers sent for the reception server, with Just user subsequently checks the page data of collection.
It should be noted that each functional unit involved by a kind of client provided in an embodiment of the present invention Other are accordingly described, and may be referred to the correspondence description in Fig. 1, be will not be described here.
A kind of client provided in an embodiment of the present invention, first, client obtains page data collection letter Breath, and the page data Information on Collection is sent to into server;Server receives the client and sends out The page data Information on Collection sent, generates the page and treats collecting area domain according to the page data Information on Collection Picture, the page of the generation treats that collecting area domain picture retains real visual effect;Further will be described The page treats that collecting area domain picture is stored to picture servers, so that user subsequently checks the page number of collection According to;The method generates the page and treats collecting area domain picture by carrying out picture processing in server end, with Existing page data collecting method is compared, and can realize the collection of data of regional area, while retaining The real visual effects of regional area collection data, and then data coupling is reduced, by described The page treats that collecting area domain picture is stored, and facilitates user to check.
Further, implementing as Fig. 2 methods describeds, embodiments provides another Client is planted, as shown in fig. 6, further, the receiving unit 53, including:
Sending module, for when receive user transmission collection page data check request when, according to The address of the picture servers sends to the picture servers and checks request;
Receiver module, the collection page data for receiving the picture servers transmission is corresponding The page treats collecting area domain picture.
It should be noted that each functional unit involved by another kind of client provided in an embodiment of the present invention Other corresponding descriptions, may be referred in Fig. 2 correspondence description, will not be described here.
Another kind of client provided in an embodiment of the present invention, first, client obtains page data collection Information, and the page data Information on Collection is sent to into server;Server receives the client The page data Information on Collection of transmission, generates the page and treats collecting area according to the page data Information on Collection Domain picture, the page of the generation treats that collecting area domain picture retains real visual effect;Further by institute State the page and treat that collecting area domain picture is stored to picture servers, so that user subsequently checks the page of collection Data;The method generates the page and treats collecting area domain picture by carrying out picture processing in server end, Compared with existing page data collecting method, the collection of data of regional area can be realized, while protecting The real visual effect of regional area collection data is stayed, and then has reduced data coupling, by institute State the page and treat that collecting area domain picture is stored, facilitate user to check.
In addition, when user needs to check the page data collected, can be sent according to picture servers Network address click through and check, page collection data now are presented in the form of picture, and The visual effect of current browse webpage is saved, user is without the need for carrying out any process or inquiry operation.
Further, implementing as Fig. 3 methods describeds, embodiments provides one kind Server, as shown in fig. 7, the server includes:Receiving unit 71, picture signal generating unit 72, Memory cell 73.
The receiving unit 71, for the page data Information on Collection that receive user sends.
The picture signal generating unit 72, it is due-in for generating the page according to the page data Information on Collection Tibetan area domain picture.
The memory cell 73, for the page to be treated into collecting area domain picture is stored to picture servers, And the address of the picture servers is sent to into user, so that user subsequently checks the page number of collection According to.
Further, the picture signal generating unit 72, including:
Page generation module, for according to the reference address of current page and affecting page data to look into Ask set of circumstances and generate customer terminal webpage;
Image generating module, for calling drawing function to process the customer terminal webpage, obtains The total length of the current page and the customer terminal webpage picture of overall width;
Interception module, for being intercepted to the customer terminal webpage picture using the default rule that intercepts, Obtain the page and treat collecting area domain picture;
It is described it is default intercepting rule be:It is basic point according to the customer terminal webpage picture upper left corner, relatively The side-play amount of basic point is left side offset X, and head bias amount is Y, by the page data collecting area Domain carries out rectangular area intercepting.
It should be noted that each functional unit involved by a kind of server provided in an embodiment of the present invention Other are accordingly described, and may be referred to the correspondence description in Fig. 3, be will not be described here.
A kind of server provided in an embodiment of the present invention, first, client obtains page data collection letter Breath, and the page data Information on Collection is sent to into server;Server receives the client and sends out The page data Information on Collection sent, generates the page and treats collecting area domain according to the page data Information on Collection Picture, the page of the generation treats that collecting area domain picture retains real visual effect;Further will be described The page treats that collecting area domain picture is stored to picture servers, so that user subsequently checks the page number of collection According to;The method generates the page and treats collecting area domain picture by carrying out picture processing in server end, with Existing page data collecting method is compared, and can realize the collection of data of regional area, while retaining The real visual effects of regional area collection data, and then data coupling is reduced, by described The page treats that collecting area domain picture is stored, and facilitates user to check.
Further, implementing as Fig. 4 methods describeds, embodiments provides another Server is planted, as shown in figure 8, the server also includes:Transmitting element 74.
The transmitting element 74, for when receive user transmission collection page data check request when, Described storage is sent to user and checks to the collection page datagram piece of picture servers.
It should be noted that each functional unit involved by another kind of server provided in an embodiment of the present invention Other corresponding descriptions, may be referred in Fig. 4 correspondence description, will not be described here.
Another kind of server provided in an embodiment of the present invention, first, client obtains page data collection Information, and the page data Information on Collection is sent to into server;Server receives the client The page data Information on Collection of transmission, generates the page and treats collecting area according to the page data Information on Collection Domain picture, the page of the generation treats that collecting area domain picture retains real visual effect;Further by institute State the page and treat that collecting area domain picture is stored to picture servers, so that user subsequently checks the page of collection Data;The method generates the page and treats collecting area domain picture by carrying out picture processing in server end, Compared with existing page data collecting method, the collection of data of regional area can be realized, while protecting The real visual effect of regional area collection data is stayed, and then has reduced data coupling, by institute State the page and treat that collecting area domain picture is stored, facilitate user to check.
Further, a kind of collection system of Web page data is embodiments provided, is such as schemed Shown in 9, the system includes:Client 91, server 92.
The client 91, for obtaining page data Information on Collection, and the page data is collected Information is sent to server;
The server 92, for receiving the page data Information on Collection that the client sends, according to The page data Information on Collection generates the page and treats collecting area domain picture;
The server 91, is additionally operable to for the page to treat that collecting area domain picture is stored to picture servers, The page treats that collecting area domain picture is to collect page data to have the true figure that effect is presented on the page Piece;
The client 92, is additionally operable to the address of the picture servers of the reception server transmission, with Just user subsequently checks the page data of collection.
A kind of collection system of Web page data provided in an embodiment of the present invention, first, client is obtained Page data Information on Collection is taken, and the page data Information on Collection is sent to into server;Server The page data Information on Collection that the client sends is received, is given birth to according to the page data Information on Collection Collecting area domain picture is treated into the page, the page of the generation treats that collecting area domain picture retains real vision effect Really;Further the page is treated into that collecting area domain picture is stored to picture servers, so as to user it is follow-up Check the page data of collection;The method generates the page and treats by carrying out picture processing in server end Collection region picture, compared with existing page data collecting method, can realize the number of regional area According to collection, while remaining the real visual effect of regional area collection data, and then data are reduced Coupling, by treating that collecting area domain picture is stored to the page, facilitates user to check.
The client includes processor and memory, above-mentioned acquiring unit 51, transmitting element 52, connects Receive the grade of unit 53 to store in memory as program unit, memory is stored in by computing device In said procedure unit realizing corresponding function.
The server includes processor and memory, above-mentioned receiving unit 71, picture signal generating unit 72, The grade of memory cell 73 is stored in memory as program unit, and by computing device storage is stored in Said procedure unit in device is realizing corresponding function.
Kernel is included in processor, is gone in memory to transfer corresponding program unit by kernel.Kernel can To arrange one or more, regional area of the user directly to collecting is easy to by adjusting kernel parameter Data are checked that, while the visual effect of collection area data can be preserved, user is without the need for collection Area data re-starts typesetting.
Memory potentially includes the volatile memory in computer-readable medium, random access memory The form such as device (RAM) and/or Nonvolatile memory, such as read-only storage (ROM) or flash memory (flash RAM), memory includes at least one storage chip.
Present invention also provides a kind of computer program, when performing on data processing equipment, It is adapted for carrying out initializing the program code of there are as below methods step:When the page number for receiving user's transmission According to during collection request, page data Information on Collection is obtained;The page data Information on Collection is sent to Server, so that the server generates the page according to the page data Information on Collection collecting area domain is treated Picture, and the page is treated into that collecting area domain picture is stored to picture servers;The reception server sends The picture servers address, so that user subsequently checks the page data of collection.
Those skilled in the art it should be appreciated that embodiments herein can be provided as method, system, Or computer program.Therefore, the application can be implemented using complete hardware embodiment, complete software Example or with reference to the form of the embodiment in terms of software and hardware.And, the application can be adopted at one Or it is multiple wherein include computer usable program code computer-usable storage medium (including but not Be limited to magnetic disc store, CD-ROM, optical memory etc.) on the computer program implemented Form.
The application is with reference to the method according to the embodiment of the present application, equipment (system) and computer program The flow chart and/or block diagram of product is describing.It should be understood that can be realized flowing by computer program instructions In each flow process and/or square frame and flow chart and/or block diagram in journey figure and/or block diagram Flow process and/or square frame combination.Can provide these computer program instructions to all-purpose computer, specially With the processor of computer, Embedded Processor or other programmable data processing devices producing one Machine so that produced by the instruction of computer or the computing device of other programmable data processing devices It is raw to be used to realize in one flow process of flow chart or one square frame of multiple flow processs and/or block diagram or multiple sides The device of the function of specifying in frame.
These computer program instructions may be alternatively stored in can guide computer or other programmable datas to process In the computer-readable memory that equipment works in a specific way so that be stored in the computer-readable and deposit Instruction in reservoir is produced and includes the manufacture of command device, and command device realization is in flow chart one The function of specifying in flow process or one square frame of multiple flow processs and/or block diagram or multiple square frames.
These computer program instructions can also be loaded into computer or other programmable data processing devices On so that series of operation steps is performed on computer or other programmable devices to produce computer The process of realization, so as to the instruction performed on computer or other programmable devices is provided for realizing Specify in one flow process of flow chart or one square frame of multiple flow processs and/or block diagram or multiple square frames The step of function.
In a typical configuration, computing device include one or more processors (CPU), input/ Output interface, network interface and internal memory.
Memory potentially includes the volatile memory in computer-readable medium, random access memory The form such as device (RAM) and/or Nonvolatile memory, such as read-only storage (ROM) or flash memory (flash RAM).Memory is the example of computer-readable medium.
Computer-readable medium includes that permanent and non-permanent, removable and non-removable media can be with Information Store is realized by any method or technique.Information can be computer-readable instruction, data knot Structure, the module of program or other data.The example of the storage medium of computer includes, but are not limited to phase Become internal memory (PRAM), static RAM (SRAM), dynamic random access memory (DRAM), other kinds of random access memory (RAM), read-only storage (ROM), electricity can Erasable programmable read-only memory (EPROM) (EEPROM), fast flash memory bank or other memory techniques, read-only light Disk read-only storage (CD-ROM), digital versatile disc (DVD) or other optical storages, magnetic Cassette tape, the storage of tape magnetic rigid disk or other magnetic storage apparatus or any other non-transmission medium, Can be used to store the information that can be accessed by a computing device.Define according to herein, computer-readable Medium does not include temporary computer readable media (transitory media), the such as data-signal and load of modulation Ripple.
Embodiments herein is these are only, the application is not limited to.For this area skill For art personnel, the application can have various modifications and variations.It is all spirit herein and principle it Interior made any modification, equivalent substitution and improvements etc., should be included in claims hereof model Within enclosing.

Claims (13)

1. a kind of collecting method of Web page data, it is characterised in that include:
When page data collection request is received, page data Information on Collection, the page number are obtained Include according to Information on Collection:The page feature information of current page, the page in page data collection region are special Reference breath, the page data collect region with respect to the side-play amount of basic point, the reference address of current page And the querying condition set of impact page data;
The page data Information on Collection is sent to into server, so that the server is according to the page Face collection of data information generates the page and treats collecting area domain picture, and the page is treated into collecting area domain picture Store to picture servers, the page is treated collecting area domain picture and had in the page for collection page data The upper true picture that effect is presented;
The address of the picture servers that the reception server sends, so that user subsequently checks collection Page data.
2. method according to claim 1, it is characterised in that include:
The page feature information of the current page is the total length and overall width of current page;
The page feature information in the page data collection region is the total of the page data collection region Length and overall width;
The side-play amount of the relative basic point in page data collection region is left side offset X, head bias Amount Y.
3. method according to claim 2, it is characterised in that the acquisition page data collection Information, including:
Page data Information on Collection is obtained by predetermined instruction.
4. the method according to any one of claim 1-3, it is characterised in that also include:
When receiving collection page data and checking request, according to the address of the picture servers to institute State picture servers transmission and check request;
The corresponding page of the collection page data for receiving the picture servers transmission treats collecting area domain Picture.
5. a kind of collecting method of Web page data, it is characterised in that include:
Page data Information on Collection is received, the page data Information on Collection includes:The page of current page Region feature information, the page feature information in page data collection region, page data collection region The reference address of side-play amount, current page with respect to basic point and the querying condition collection of impact page data Close;
The page is generated according to the page data Information on Collection and treats collecting area domain picture, the page is due-in Tibetan area domain picture is to collect page data to have the true picture that effect is presented on the page;
The page is treated into that collecting area domain picture is stored to picture servers, and by the picture servers Address be sent to user, so that user subsequently checks the page data of collection.
6. method according to claim 5, it is characterised in that include:
The page feature information of the current page is the total length and overall width of current page;
The page feature information in the page data collection region is the total of the page data collection region Length and overall width;
The side-play amount of the relative basic point in page data collection region is left side offset X, head bias Amount Y.
7. method according to claim 6, it is characterised in that described according to the page data Information on Collection generates the page and treats collecting area domain picture, including:
Client is generated according to the reference address of current page and the querying condition set of impact page data End page face;
Call drawing function to process the customer terminal webpage, obtain the overall length of the current page The customer terminal webpage picture of degree and overall width;
Partial cut away is carried out to the customer terminal webpage picture using the default rule that intercepts, the page is obtained and is treated Collection region picture;
It is described it is default intercepting rule be:It is basic point according to the customer terminal webpage picture upper left corner, relatively The side-play amount of basic point is left side offset X, and head bias amount is Y, by the page data collecting area Domain carries out rectangular area intercepting.
8. the method according to any one of claim 5-7, it is characterised in that by the page Face collection picture is stored to server, is also included:
When receive collection page data check request when, store described to described in picture servers Collection page datagram piece is sent to user and checks.
9. a kind of client, it is characterised in that include:
Acquiring unit, for when page data collection request is received, obtaining page data collection letter Breath, the page data Information on Collection includes:The page feature information of current page, page data are received The page feature information in Tibetan area domain, the side-play amount of the relative basic point in page data collection region, currently The reference address of the page and the querying condition set of impact page data;
Transmitting element, for the page data Information on Collection to be sent to into server, so as to the clothes Business device generates the page and treats collecting area domain picture according to the page data Information on Collection, and by the page Treat that collecting area domain picture is stored to picture servers, the page treats collecting area domain picture for the collection page Data have the true picture that effect is presented on the page;
Receiving unit, the address of the picture servers sent for the reception server, so as to user Subsequently check the page data of collection.
10. client according to claim 9, it is characterised in that the receiving unit, bag Include:
Sending module, for when receive collection page data check request when, according to the picture take The address of business device sends to the picture servers checks request;
Receiver module, the collection page data for receiving the picture servers transmission is corresponding The page treats collecting area domain picture.
11. a kind of servers, it is characterised in that include:
Receiving unit, for receiving page data Information on Collection, the page data Information on Collection includes: The page feature information of current page, page data collect page feature information, the page in region Collection of data region is with respect to the side-play amount of basic point, the reference address of current page and affects page data Querying condition set;
Picture signal generating unit, generates the page and treats collecting area domain picture according to the page data Information on Collection, The page treats that collecting area domain picture is to collect page data to have the true figure that effect is presented on the page Piece;
Memory cell, for the page to be treated into collecting area domain picture is stored to picture servers, and will The address of the picture servers is sent to user, so that user subsequently checks the page data of collection.
12. servers according to claim 11, it is characterised in that the picture signal generating unit, Including:
Page generation module, for according to the reference address of current page and affecting page data to look into Ask set of circumstances and generate customer terminal webpage;
Image generating module, for calling drawing function to process the customer terminal webpage, obtains The total length of the current page and the customer terminal webpage picture of overall width;
Interception module, for carrying out locally cutting to the customer terminal webpage picture using the default rule that intercepts Take, obtain the page and treat collecting area domain picture;
It is described it is default intercepting rule be:It is basic point according to the customer terminal webpage picture upper left corner, relatively The side-play amount of basic point is left side offset X, and head bias amount is Y, by the page data collecting area Domain carries out rectangular area intercepting.
13. a kind of collection systems of Web page data, it is characterised in that include:Claim 9 Or the server described in the client described in 10, claim 11 or 12,
The client, for obtaining page data Information on Collection, and page data collection is believed Breath is sent to server;
The server, for receiving the page data Information on Collection that the client sends, according to institute State the page data Information on Collection generation page and treat collecting area domain picture;
The server, is additionally operable to for the page to treat that collecting area domain picture is stored to picture servers, The page treats that collecting area domain picture is to collect page data to have the true figure that effect is presented on the page Piece;
The client, is additionally operable to the address of the picture servers of the reception server transmission, so as to User subsequently checks the page data of collection.
CN201510708638.5A 2015-10-27 2015-10-27 Collection method, device and system for Web page data Pending CN106611019A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510708638.5A CN106611019A (en) 2015-10-27 2015-10-27 Collection method, device and system for Web page data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510708638.5A CN106611019A (en) 2015-10-27 2015-10-27 Collection method, device and system for Web page data

Publications (1)

Publication Number Publication Date
CN106611019A true CN106611019A (en) 2017-05-03

Family

ID=58614399

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510708638.5A Pending CN106611019A (en) 2015-10-27 2015-10-27 Collection method, device and system for Web page data

Country Status (1)

Country Link
CN (1) CN106611019A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109948041A (en) * 2017-12-07 2019-06-28 北京国双科技有限公司 Data push method and device

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103685514A (en) * 2013-12-13 2014-03-26 北京奇虎科技有限公司 Method for storing page in webpage favorite and browser
CN104125264A (en) * 2013-04-28 2014-10-29 腾讯科技(深圳)有限公司 Resource collecting method, device and equipment

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104125264A (en) * 2013-04-28 2014-10-29 腾讯科技(深圳)有限公司 Resource collecting method, device and equipment
CN103685514A (en) * 2013-12-13 2014-03-26 北京奇虎科技有限公司 Method for storing page in webpage favorite and browser

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
《计算机应用基础实验指导及习题解答》编委会: "《计算机应用基础实验指导及习题解答》", 31 August 2007 *
曾强聪: "《软件工程》", 30 November 2004 *
殷占录等: "《数字信息资源研究》", 31 August 2015 *
赵磊: "《电脑全能技巧6000招》", 30 September 2009 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109948041A (en) * 2017-12-07 2019-06-28 北京国双科技有限公司 Data push method and device
CN109948041B (en) * 2017-12-07 2021-05-18 北京国双科技有限公司 Data pushing method and device

Similar Documents

Publication Publication Date Title
IL275042A (en) Self-adaptive application programming interface level security monitoring
CN109977690A (en) A kind of data processing method, device and medium
US20180025049A1 (en) Server and Data Processing Method
CN104144142B (en) A kind of Web bug excavation methods and system
CN104268082B (en) The method for testing pressure and device of browser
CN104283975B (en) Document distribution method and device
KR102111192B1 (en) Method and apparatus for identity information verification
US10462257B2 (en) Method and apparatus for obtaining user account
CN113452780B (en) Access request processing method, device, equipment and medium for client
CN104809116A (en) Method and device for collecting contents as well as terminal
CN104135507A (en) A method and a device for hotlink protection
CN108243079A (en) A kind of method and apparatus that network access is carried out based on VPC
CN108429785A (en) A kind of generation method, reptile recognition methods and the device of reptile identification encryption string
US10225358B2 (en) Page push method, device, server and system
CN109446761A (en) A kind of information security processing method, storage medium and terminal device
US9043535B1 (en) Minimizing application response time
CN109714208A (en) A kind of equipment is included in method, storage medium and the electronic equipment of network management
US20220311773A1 (en) Method and device for communication between microservices
CN110119396A (en) Data managing method and Related product
CN106611019A (en) Collection method, device and system for Web page data
CN106557342A (en) A kind of implementation method and device of service logic
CN110321507A (en) Browser cross-domain communication method and device
CN103312785B (en) A kind of determination method and device of access relation
CN106919595A (en) A kind of method, device and electronic equipment mapped for Cookie
CN115757639A (en) Data source synchronization method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: 100083 No. 401, 4th Floor, Haitai Building, 229 North Fourth Ring Road, Haidian District, Beijing

Applicant after: Beijing Guoshuang Technology Co.,Ltd.

Address before: 100086 Cuigong Hotel, 76 Zhichun Road, Shuangyushu District, Haidian District, Beijing

Applicant before: Beijing Guoshuang Technology Co.,Ltd.

CB02 Change of applicant information
RJ01 Rejection of invention patent application after publication

Application publication date: 20170503

RJ01 Rejection of invention patent application after publication