CN110858238A - Data processing method and device - Google Patents

Data processing method and device Download PDF

Info

Publication number
CN110858238A
CN110858238A CN201810898226.6A CN201810898226A CN110858238A CN 110858238 A CN110858238 A CN 110858238A CN 201810898226 A CN201810898226 A CN 201810898226A CN 110858238 A CN110858238 A CN 110858238A
Authority
CN
China
Prior art keywords
data
page
access request
prefetching
preprocessing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810898226.6A
Other languages
Chinese (zh)
Other versions
CN110858238B (en
Inventor
李猛
段岩
高超
崔洁
朱晓晗
吕春
朱雪莹
陈良
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba Group Holding Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Priority to CN201810898226.6A priority Critical patent/CN110858238B/en
Publication of CN110858238A publication Critical patent/CN110858238A/en
Application granted granted Critical
Publication of CN110858238B publication Critical patent/CN110858238B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

The embodiment of the application provides a data processing method and a data processing device, wherein the method comprises the following steps: receiving an access request aiming at a page, wherein the access request comprises URL (uniform resource locator) information of the page; according to the URL information, performing data prefetching on page data of the page; and preprocessing the access request, the preprocessing being performed in parallel with the data prefetching; and when the preprocessed access request is received, displaying the prefetched page data. In the embodiment, each step which needs to be executed serially when the server data is acquired in the prior art is optimized to be executed in parallel by partial steps, so that the time consumption for executing each step serially is saved, the data acquisition efficiency is improved, and the waiting time for a user to access a page is reduced.

Description

Data processing method and device
Technical Field
The present application relates to the field of communications technologies, and in particular, to a data processing method and a data processing apparatus.
Background
Mobile terminals such as mobile phones have become one of the main ways for people to obtain information in daily work and life. The user can initiate an access request through an application program App installed on the mobile phone, and after receiving the request, the application program App can acquire corresponding data from the server and then display the data on the mobile phone.
The user accesses a URL page through an application program App on the mobile phone, and the complete process can comprise the following steps: accessing URL-initialize page-load static resource-first screen UI second out-script run-request server data-get data-page complete.
Since the application App needs to sequentially execute the above steps each time it acquires data from the server, the sum of the time consumed by the above steps is the waiting time for the user to normally access the URL page. If a certain step or link is overtime, the efficiency of obtaining information by a user is seriously influenced. Taking a search service as an example, when an application App jumps from a search page to a search result page, if a search result interface responds slowly due to network congestion or high server concurrency, the waiting time of a user is increased, so that the user cannot acquire corresponding information in time.
Disclosure of Invention
In view of the above, embodiments of the present application are proposed to provide a method of data processing and a corresponding apparatus of data processing that overcome or at least partially solve the above problems.
In order to solve the above problem, the present application discloses a data processing method, including:
receiving an access request aiming at a page, wherein the access request comprises URL (uniform resource locator) information of the page;
according to the URL information, performing data prefetching on page data of the page; and the number of the first and second groups,
preprocessing the access request, the preprocessing being performed in parallel with the data prefetching;
and when the preprocessed access request is received, displaying the prefetched page data.
In order to solve the above problem, the present application discloses a data processing method, including:
receiving pre-fetching configuration information sent by a specific configuration platform and starting a route interception function of a current client;
when an access request for a page is received, determining whether URL information in the access request is included in the pre-fetching configuration information;
if so, performing data prefetching on the page data of the page according to the URL information; and the number of the first and second groups,
preprocessing the access request, the preprocessing being performed in parallel with the data prefetching;
and when the preprocessed access request is received, intercepting the preprocessed access request and displaying the prefetched page data.
In order to solve the above problem, the present application discloses a data processing method, including:
receiving an access request aiming at a page, wherein the access request comprises URL (uniform resource locator) information of the page;
calling a bridge between the current client and the server according to the URL information;
performing data prefetching on the page data of the page through the network bridge; and the number of the first and second groups,
preprocessing the access request, the preprocessing being performed in parallel with the data prefetching;
and when the preprocessed access request is received, intercepting the preprocessed access request and displaying the prefetched page data.
In order to solve the above problem, the present application discloses an apparatus for data processing, comprising:
the system comprises a receiving module, a processing module and a processing module, wherein the receiving module is used for receiving an access request aiming at a page, and the access request comprises URL (uniform resource locator) information of the page;
the data prefetching module is used for prefetching data of the page according to the URL information; and the number of the first and second groups,
a preprocessing module for preprocessing the access request, the preprocessing being performed in parallel with the data prefetching;
and the display module is used for displaying the pre-fetched page data when receiving the preprocessed access request.
In order to solve the above problem, the present application discloses an apparatus for data processing, comprising:
the pre-fetching configuration information receiving module is used for receiving the pre-fetching configuration information sent by the specific configuration platform and starting a route intercepting function of the current client;
the URL information determining module is used for determining whether URL information in an access request is included in the pre-fetching configuration information when the access request aiming at a page is received;
the data prefetching module is used for prefetching data of the page according to the URL information when the prefetching configuration information comprises the URL information in the access request; and the number of the first and second groups,
a preprocessing module for preprocessing the access request, the preprocessing being performed in parallel with the data prefetching;
and the data display module is used for intercepting the preprocessed access request and displaying the pre-fetched page data when the preprocessed access request is received.
In order to solve the above problem, the present application discloses an apparatus for data processing, comprising:
the system comprises a receiving module, a processing module and a processing module, wherein the receiving module is used for receiving an access request aiming at a page, and the access request comprises URL (uniform resource locator) information of the page;
the calling module is used for calling the bridge between the current client and the server according to the URL information;
the data prefetching module is used for prefetching data of the page through the network bridge; and the number of the first and second groups,
a preprocessing module for preprocessing the access request, the preprocessing being performed in parallel with the data prefetching;
and the display module is used for intercepting the preprocessed access request and displaying the pre-fetched page data when the preprocessed access request is received.
Compared with the background art, the embodiment of the application has the following advantages:
according to the embodiment of the application, by receiving the access request aiming at the page, the data prefetching can be carried out on the page data of the page according to the page URL information included in the access request, and the preprocessing of the access request is executed in parallel in the process, so that the prefetched page data can be directly displayed when the preprocessed access request is received. In the embodiment, each step which needs to be executed serially when the server data is acquired in the prior art is optimized to be executed in parallel by partial steps, so that the time consumption for executing each step serially is saved, the data acquisition efficiency is improved, and the waiting time for a user to access a page is reduced.
Drawings
FIG. 1 is a flow chart illustrating steps of a method of data processing according to one embodiment of the present application;
FIG. 2 is a flow chart illustrating steps of another method of data processing according to one embodiment of the present application;
FIG. 3 is a flow chart illustrating steps of a method of data processing according to an embodiment of the present application;
FIG. 4 is a flow chart illustrating steps of yet another method of data processing according to an embodiment of the present application;
FIG. 5 is a schematic diagram of a method of data processing according to an embodiment of the present application;
FIG. 6 is a graph illustrating a comparison of performance of a method of data processing according to an embodiment of the present application;
FIG. 7 is a block diagram of a schematic structure of an apparatus for data processing according to an embodiment of the present application;
FIG. 8 is a block diagram of a schematic structure of another data processing apparatus according to an embodiment of the present application;
fig. 9 is a schematic block diagram of a data processing apparatus according to an embodiment of the present application.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present application more comprehensible, the present application is described in further detail with reference to the accompanying drawings and the detailed description.
Referring to fig. 1, a schematic flow chart illustrating steps of a data processing method according to an embodiment of the present application is shown, which may specifically include the following steps:
step 101, receiving an access request aiming at a page, wherein the access request comprises URL information of the page;
it should be noted that the method may be applied to mobile terminals such as mobile phones and tablet computers, and the specific type of the mobile terminal is not limited in this embodiment.
In the embodiment of the application, the access request for the page can be actively initiated in the page of the client by the user. For example, a user may install a client of an application on a mobile terminal and initiate an access request for a page by clicking on a certain page in the client or performing a certain search task, etc. The embodiment does not limit the specific manner in which the user initiates the access request.
Generally, the access request initiated by the user may include URL (Uniform resource locator) information of a page to be accessed.
For example, for a page of a marketing campaign, after a user clicks an icon or a control of the page, the client may send an access request containing URL information of the page of the marketing campaign to the server, and request the server to issue data of the page, so as to display the page to the user.
For another example, taking the user searching in the client as an example, after the user inputs a search keyword and clicks the search button, the client may send an access request including URL information of a search result page to the server, request the server to search according to the search keyword, and return a corresponding search result.
102, performing data prefetching on page data of the page according to the URL information;
generally, when a user initiates an access request for a page in a client, the client performs a series of processing procedures in sequence after receiving URL information of the page. For example, initializing a page, loading dynamic resources, completing User Interface (UI) first screen second (the UI first screen second indicates that a visible part of a screen is completely displayed within 1 second when the mobile terminal just opens the page), completing script operation, sending a data request to a server and acquiring data, and completing page rendering and displaying. In the above process, different interfaces of the client are required to respond respectively, and the total time consumption is the waiting time for the user to open the page.
In the embodiment of the present application, in order to reduce the waiting time, when receiving URL information of a page visited by a user, data prefetching may be performed on page data of the page according to the URL information.
The data prefetching technology is to issue a prefetch request before Cache (a Cache file) may be invalidated through overlapping of computation and access, so as to fetch a data block into the Cache in advance when the data is actually used, thereby avoiding processor stall caused by Cache invalidation.
In the embodiment of the present application, the data prefetching may be implemented by issuing prefetching configuration information in advance. The prefetch configuration information may be preconfigured by a particular configuration platform and sent to the client.
Alternatively, data prefetching may also be accomplished by invoking bridge functionality. Data prefetching is accomplished through a channel established between the client and the server. The present embodiment does not limit the specific manner of data prefetching.
Step 103, preprocessing the access request, wherein the preprocessing and the data prefetching are executed in parallel;
in the embodiment of the present application, the preprocessing of the access request may be, according to a normal operation sequence, initializing the page, loading dynamic resources, completing the first screen UI second out, completing the script running, and the like after receiving the URL information of the access page, and the preprocessing process may be executed in parallel with the data prefetching process. That is, the preprocessing of the access request and the data prefetching are performed simultaneously.
And 104, displaying the pre-fetched page data when the pre-processed access request is received.
Generally, after preprocessing the access request, the preprocessed access request may be issued to request the server to obtain data. In this embodiment, the client may capture the preprocessed access request, and obtain the data from the pre-fetched page data.
In a specific implementation, when capturing a preprocessed access request, a client may first determine whether data corresponding to the preprocessed access request is included in pre-fetched page data, and if so, may directly extract the data from the pre-fetched page data, and render the data in a page of the client for presentation to a user.
It should be noted that, if the pre-fetched page data does not include data corresponding to the pre-processed access request, the pre-processed access request that has been captured may be re-sent to the server, and the server is requested to issue the page data according to the access request.
In the embodiment of the application, by receiving an access request for a page, data prefetching may be performed on page data of the page according to page URL information included in the access request, and preprocessing of the access request is performed in parallel in the process, so that when the preprocessed access request is received, the prefetched page data may be directly displayed. In the embodiment, each step which needs to be executed serially when the server data is acquired in the prior art is optimized to be executed in parallel by partial steps, so that the time consumption for executing each step serially is saved, the data acquisition efficiency is improved, and the waiting time for a user to access a page is reduced.
Referring to fig. 2, a schematic flow chart illustrating steps of another data processing method according to an embodiment of the present application is shown, which may specifically include the following steps:
step 201, receiving an access request for a page, wherein the access request comprises URL information of the page;
it should be noted that the method can be applied to mobile terminals such as mobile phones and tablet computers. For convenience of understanding, the following description and introduction are made by taking the application of the present embodiment to a mobile phone as an example.
In the embodiment of the application, a user can install a client of an application program on a mobile phone, and initiate an access request for a certain page by clicking a certain icon or control in the client. The access request may be a request for showing a certain page, or a request for completing a search task, etc., and this embodiment is not limited thereto.
In the embodiment of the application, the URL information of the page may be included in the access request initiated by the user for the page.
Step 202, performing data prefetching on the page data of the page according to the URL information;
generally, when a user initiates an access request for a page in a client, after receiving URL information of the page, the client needs to complete processing procedures of initializing the page, loading dynamic resources, sending a first screen UI second, running a script, sending a data request to a server and acquiring data, rendering and displaying the page, and the like in sequence.
In order to reduce the time consumed by the client for responding to the above processes and reduce the waiting time for the user to open the page, the present embodiment may optimize each process executed sequentially as described above to be executed in parallel among part of the processes.
In the embodiment of the application, the data request can be sent to the server and the data can be acquired by executing the parallel execution while the page is initialized, the dynamic resources are loaded, the first screen UI is output for a second, and the script is run, so that the time for opening the page is saved.
In a particular implementation, sending a data request to a server and obtaining the data may refer to pre-fetching the data for the access page.
In the embodiment of the application, the data prefetching for the access page can be realized by issuing the prefetching configuration information in advance or calling the bridge function.
When data prefetching is performed by issuing prefetching configuration information in advance, the client may first determine whether the preset prefetching configuration information includes the URL information after receiving the URL information of the access page.
In this embodiment of the present application, the prefetch configuration information may be generated by manual configuration and issued to the client by combining the specific configuration platform with the requirements of the actual service. Therefore, the prefetching configuration information can be preset in the client by receiving the prefetching configuration information sent by the specific configuration platform and storing the prefetching configuration information in the current client.
It should be noted that, after the client receives the prefetch configuration information issued by the configuration platform, the routing interception function of the current client can be started. By the function, interception of the preprocessed access request can be realized.
If the pre-fetching configuration information preset in the client side comprises the URL information of the access page, a data pre-fetching request can be sent to the server.
In specific implementation, a preset value can be used for replacing the placeholder in the URL information to obtain the replaced URL information, then the replaced URL information is sent to the server, and the server acquires page data according to the replaced URL information and returns the page data to the client.
The client can receive the page data returned by the server according to the data prefetching request, and store the page data into the cache pool, so that data prefetching is completed.
When the bridge function is called to perform data prefetching, the bridge between the current client and the server can be called according to the received URL information, the page data of the page is obtained through the bridge, and the page data is stored in the cache pool to complete data prefetching.
Step 203, preprocessing the access request, wherein the preprocessing and the data prefetching are executed in parallel;
in the embodiment of the application, preprocessing the access request means that processing processes of initializing a page, loading dynamic resources, outputting first screen UI for a second, running scripts and the like are sequentially completed according to the received access request while data prefetching is performed. Because the processing process is executed in parallel with the data prefetching process, when the page is initialized after the access request is received, the processing process of data prefetching is simultaneously performed, and compared with a processing mode in the prior art that each processing process needs to be executed in series, the processing method can effectively reduce the time consumed by executing each processing process in series and save the response time of the client.
Step 204, intercepting the preprocessed access request when the preprocessed access request is received;
generally, after completing processes of initializing a page, loading dynamic resources, exiting a first screen for a second, running a script, and the like, a client should send a data request to a server, and request the server to return data corresponding to the page.
In the embodiment of the application, the data request sent by the client to the server can be intercepted.
Generally, each URL access request entering the client needs to go through route management first, and the URL information can be captured through route interception.
By determining whether the data already exists in the cache pool, repeated requests for the data from the server are avoided.
Step 205, determining whether the cache pool includes data corresponding to the preprocessed access request;
in the embodiment of the application, the corresponding relationship between the access request and the page data can be set according to a certain rule, so that whether the data corresponding to the preprocessed access request exists in the cache pool or not is determined by analyzing the rule.
For example, the URL information of the access page may be used as a key to establish a corresponding relationship between the URL information of the access page and the page data, so that after receiving the preprocessed access request, whether the cache pool includes the corresponding page data is determined by parsing out the URL information in the request.
Of course, a person skilled in the art may also determine whether the cache pool includes corresponding data in other manners according to actual needs, which is not limited in this embodiment.
After determining that the data corresponding to the preprocessed access request exists in the cache pool, step 206 may be executed to extract the data from the cache pool; otherwise, step 207 may be performed.
Step 206, if yes, acquiring the data;
in this embodiment of the application, after the data corresponding to the access request is extracted from the cache pool, step 208 may be executed to render the data in the page of the client and generate a corresponding client page for presentation to the user.
Step 207, if not, sending the preprocessed access request to a server; receiving data returned by the server according to the preprocessed access request;
in this embodiment of the present application, if the cache pool does not include data corresponding to the preprocessed access request, the intercepted preprocessed access request may be resent to the server, and the server is requested to issue corresponding data according to the access request.
Similar to the direct extraction of data from the cache pool, after the corresponding data is obtained from the server, step 208 may also be executed to render the data in the page of the client and generate a corresponding client page for presentation to the user.
Step 208, generating a client page based on the data.
In the embodiment of the application, by receiving an access request for a page, data prefetching may be performed on page data of the page by issuing prefetch configuration information in advance or calling a bridge function by a client according to page URL information included in the access request, then the prefetched data is stored in a cache pool, and preprocessing on the access request is performed in parallel in the process of data prefetching, so that when the preprocessed access request is received, whether data corresponding to the preprocessed access request already exists in the cache pool may be determined, if so, the data may be directly extracted from the cache pool, and a client page is generated based on the data, thereby improving efficiency of data acquisition and reducing waiting time for a user to access the page.
Referring to fig. 3, a schematic flow chart illustrating steps of another data processing method according to an embodiment of the present application is shown, which may specifically include the following steps:
step 301, receiving prefetch configuration information sent by a specific configuration platform and starting a route interception function of a current client;
it should be noted that this embodiment is described in the context of implementing data prefetching by issuing prefetch configuration information in advance.
In the embodiment of the application, the specific configuration platform can configure the prefetching configuration information according to the actual service requirement, and issue the prefetching configuration information to the client.
After receiving the prefetch configuration information, the client can start a routing interception function of the client.
Step 302, when an access request for a page is received, determining whether the prefetch configuration information includes URL information in the access request;
in this embodiment of the present application, when a user initiates an access request for a certain page in a client, the client may first determine whether the pre-fetch configuration information received in advance includes URL information carried in the access request.
Step 303, if yes, performing data prefetching on the page data of the page according to the URL information;
in this embodiment of the present application, when the URL information carried in the access request hits the pre-received prefetch configuration information, data prefetching may be performed according to the URL information.
In a specific implementation, a preset value may be used to replace the placeholder in the URL information, and the replaced URL information is sent to the server, and the server is requested to return page data corresponding to the URL information.
Step 304, preprocessing the access request, wherein the preprocessing is executed in parallel with the data prefetching;
in the embodiment of the application, when data prefetching is carried out, preprocessing of access requests can be executed in parallel. For example, initializing a page, loading dynamic resources, first screen UI second out, scripting, etc.
And 305, intercepting the preprocessed access request and displaying the prefetched page data when the preprocessed access request is received.
Generally, after completing the preprocessing of the access request, the client sends the preprocessed access request to the server, and requests the server to issue data according to the request. At this time, the preprocessed access request can be captured through the route interception of the client, so that the access request cannot be sent to the server.
Then, it may be determined whether page data corresponding to the access request already exists in the cache pool, and if so, the page data may be directly extracted from the cache pool, rendered, and then the rendered page may be presented to a user.
Since steps 301 to 305 in this embodiment are similar to steps 101 to 104 and steps 201 to 208 in the above embodiment, the description of this embodiment is simpler, and the details of implementation can refer to the description and introduction in the above embodiment.
Referring to fig. 4, a schematic flow chart illustrating steps of a further data processing method according to an embodiment of the present application is shown, which may specifically include the following steps:
step 401, receiving an access request for a page, where the access request includes URL information of the page;
step 402, according to the URL information, calling a bridge between the current client and the server;
step 403, performing data prefetching on the page data of the page through the network bridge; and the number of the first and second groups,
step 404, preprocessing the access request, wherein the preprocessing and the data prefetching are executed in parallel;
step 405, when receiving the preprocessed access request, intercepting the preprocessed access request and displaying the pre-fetched page data.
It should be noted that the present embodiment is described in the context of implementing data prefetching by invoking a bridge function.
In the embodiment of the application, when an access request for a page initiated by a user in a client is received, a bridge function can be called to realize data prefetching, and preprocessing of the access request is executed in parallel while the data prefetching is performed. And when the preprocessed access request is received, intercepting the access request so that the access request cannot be sent to the server. Then, it may be determined whether page data corresponding to the access request already exists in the cache pool, and if so, the page data may be directly extracted from the cache pool, rendered, and then the rendered page may be presented to a user.
Since steps 401 to 405 in this embodiment are similar to steps 101 to 104 and steps 201 to 208 in the above embodiment, the description of this embodiment is simpler, and the details of implementation can refer to the description and introduction in the above embodiment.
For ease of understanding, the data processing method of the present application is described below as a complete example.
Fig. 5 is a schematic diagram illustrating a method of data processing according to an embodiment of the present application. In fig. 5, the method can be implemented in two ways. One is to issue the prefetch configuration information to the client in advance through the configuration platform, and the other is to invoke the bridge function. The two modes are described below.
First, pre-issue prefetch configuration information
1. Firstly, according to the actual requirements of the service, the configuration of the prefetch configuration information (prefetch configuration) is manually carried out on a specific configuration platform and the prefetch configuration information is issued to the client.
2. And after receiving the pre-fetching configuration information, the client list starts a route interception function. When a user accesses a certain page, the client can execute the following two processes in parallel:
a) and intercepting the route. After the URL information is determined to hit the prefetching configuration information, the placeholders in the URL information are replaced by dynamic parameter values or preset values and the like, a data prefetching request is sent to a server to obtain data, and then the obtained data is written into a cache pool.
b) The operations of transition animation, loading static resources, first screen UI second out, loading/running script, and issuing data request, etc. shown in fig. 5 are performed. However, the data request is intercepted and not sent to the server. After intercepting the request, data corresponding to the request can be obtained from the cache pool according to the cache rule. If the data exist in the cache pool, the data can be directly extracted for page use; if the data does not exist in the cache pool, the request of the client needs to be sent to the server, and the data is obtained again for the page to use.
3. And rendering the data to generate a client page and displaying the client page to a user.
Second mode, calling bridge function
1. When a user accesses a certain page, the client can execute the following two processes in parallel:
a) and initiating a bridge function call, sending a data prefetching request to the server to acquire data, and writing the acquired data into a cache pool.
b) The operations of transition animation, loading static resources, first screen UI second out, loading/running script, and issuing data request, etc. shown in fig. 5 are performed. However, the data request is intercepted and not sent to the server. After intercepting the request, data corresponding to the request can be obtained from the cache pool according to the cache rule. If the data exist in the cache pool, the data can be directly extracted for page use; if the data does not exist in the cache pool, the request of the client needs to be sent to the server, and the data is obtained again for the page to use.
2. And rendering the data to generate a client page and displaying the client page to a user.
In the embodiment of the application, by receiving an access request for a page, data prefetching may be performed on page data of the page according to page URL information included in the access request, and preprocessing of the access request is performed in parallel in the process, so that when the preprocessed access request is received, the prefetched page data may be directly displayed. In the embodiment, each step which needs to be executed serially when the server data is acquired in the prior art is optimized to be executed in parallel by partial steps, so that the time consumption for executing each step serially is saved, the data acquisition efficiency is improved, and the waiting time for a user to access a page is reduced. Fig. 6 is a schematic diagram illustrating comparison of performances of a data processing method according to an embodiment of the present application. As can be seen from fig. 6, after the data processing method according to the embodiment of the present application is adopted, no matter the Android client or the iOS client is adopted, average time consumption for opening a page can be significantly reduced.
It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the embodiments are not limited by the order of acts described, as some steps may occur in other orders or concurrently depending on the embodiments. Further, those skilled in the art will also appreciate that the embodiments described in the specification are presently preferred and that no particular act is required of the embodiments of the application.
Referring to fig. 7, a schematic block diagram of a data processing apparatus according to an embodiment of the present application is shown, which may specifically include the following modules:
a receiving module 701, configured to receive an access request for a page, where the access request includes URL information of the page;
a data prefetching module 702, configured to perform data prefetching on the page data of the page according to the URL information; and the number of the first and second groups,
a preprocessing module 703, configured to preprocess the access request, where the preprocessing is performed in parallel with the data prefetching;
and a presentation module 704, configured to present the pre-fetched page data when the pre-processed access request is received.
In this embodiment of the present application, the data prefetching module 702 may specifically include the following sub-modules:
a URL information determining submodule for determining whether preset prefetch configuration information includes the URL information;
a data prefetch request sending submodule, configured to send a data prefetch request to a server when the preset prefetch configuration information includes the URL information;
the page data receiving submodule is used for receiving page data returned by the server according to the data pre-fetching request;
and the first page data storage submodule is used for storing the page data to a cache pool.
In this embodiment of the present application, the data prefetch request sending submodule may specifically include the following units:
the replacing unit is used for replacing the placeholder in the URL information by adopting a preset value to obtain the replaced URL information;
and the sending unit is used for sending the replaced URL information to a server.
In this embodiment of the present application, the prefetch configuration information may be preset by calling the following modules:
the prefetch configuration information receiving module is used for receiving prefetch configuration information sent by a specific configuration platform;
and the prefetch configuration information storage module is used for storing the prefetch configuration information in the current client.
In this embodiment, the apparatus may further include the following modules:
and the route interception function starting module is used for starting the route interception function of the current client.
In this embodiment, the apparatus may further include the following modules:
and the interception module is used for intercepting the preprocessed access request.
In this embodiment of the present application, the data prefetching module 702 may further include the following sub-modules:
the network bridge calling submodule is used for calling the network bridge between the current client and the server according to the URL information;
the page data acquisition submodule is used for acquiring the page data of the page through the network bridge;
and the second page data storage submodule is used for storing the page data to a cache pool.
In this embodiment, the display module 704 may specifically include the following sub-modules:
the data determination submodule is used for determining whether the cache pool comprises data corresponding to the preprocessed access request or not when the preprocessed access request is received;
a data obtaining submodule, configured to obtain the data if the cache pool includes data corresponding to the preprocessed access request;
and the first client page generation submodule is used for generating a client page based on the data.
In this embodiment, the display module 704 may further include the following sub-modules:
a request sending submodule, configured to send the preprocessed access request to a server if the cache pool does not include data corresponding to the preprocessed access request;
the data receiving submodule is used for receiving data returned by the server according to the preprocessed access request;
and the second client page generation submodule is used for generating a client page based on the data.
Referring to fig. 8, a schematic block diagram of another data processing apparatus according to an embodiment of the present application is shown, which may specifically include the following modules:
a prefetch configuration information receiving module 801, configured to receive prefetch configuration information sent by a specific configuration platform and start a route interception function of a current client;
a URL information determining module 802, configured to determine, when an access request for a page is received, whether URL information in the access request is included in the prefetch configuration information;
a data prefetching module 803, configured to perform data prefetching on the page data of the page according to the URL information when the prefetching configuration information includes the URL information in the access request; and the number of the first and second groups,
a preprocessing module 804, configured to preprocess the access request, where the preprocessing is performed in parallel with the data prefetching;
and a data presentation module 805, configured to intercept the preprocessed access request and present the pre-fetched page data when the preprocessed access request is received.
Referring to fig. 9, a schematic block diagram of a further data processing apparatus according to an embodiment of the present application is shown, which may specifically include the following modules:
a receiving module 901, configured to receive an access request for a page, where the access request includes URL information of the page;
a calling module 902, configured to call a bridge between the current client and the server according to the URL information;
a data prefetching module 903, configured to perform data prefetching on the page data of the page through the network bridge; and the number of the first and second groups,
a preprocessing module 904, configured to preprocess the access request, where the preprocessing is performed in parallel with the data prefetching;
the presentation module 905 is configured to intercept the preprocessed access request and present the pre-fetched page data when the preprocessed access request is received.
For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
As will be appreciated by one of skill in the art, embodiments of the present application may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
In a typical configuration, the computer device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory. The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium. Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include non-transitory computer readable media (fransitory media), such as modulated data signals and carrier waves.
Embodiments of the present application are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present application have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including the preferred embodiment and all such alterations and modifications as fall within the true scope of the embodiments of the application.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.
The foregoing detailed description is directed to a data processing method and a data processing apparatus, and the principles and embodiments of the present application are described in detail herein with reference to specific examples, which are provided only to help understand the method and core concepts of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims (14)

1. A method of data processing, comprising:
receiving an access request aiming at a page, wherein the access request comprises URL (uniform resource locator) information of the page;
according to the URL information, performing data prefetching on page data of the page; and the number of the first and second groups,
preprocessing the access request, the preprocessing being performed in parallel with the data prefetching;
and when the preprocessed access request is received, displaying the prefetched page data.
2. The method of claim 1, wherein the pre-fetching of page data of the page according to the URL information comprises:
determining whether the URL information is included in preset prefetching configuration information;
when the preset prefetching configuration information comprises the URL information, sending a data prefetching request to a server;
receiving page data returned by the server according to the data pre-fetching request;
and storing the page data to a cache pool.
3. The method of claim 2, wherein the step of sending a data prefetch request to a server comprises:
replacing the placeholder in the URL information by adopting a preset value to obtain the replaced URL information;
and sending the replaced URL information to a server.
4. The method of claim 2, wherein the prefetch configuration information is preset by:
receiving pre-fetching configuration information sent by a specific configuration platform;
storing the prefetch configuration information in a current client.
5. The method of claim 4, further comprising, after the step of storing the prefetch configuration information in the current client:
and starting the route interception function of the current client.
6. The method of claim 5, further comprising, after receiving the preprocessed access request:
and intercepting the preprocessed access request.
7. The method of claim 1, wherein the pre-fetching of page data of the page according to the URL information comprises:
calling a bridge between the current client and the server according to the URL information;
acquiring page data of the page through the network bridge;
and storing the page data to a cache pool.
8. The method of any of claims 2-7, wherein exposing the pre-fetched page data upon receiving the pre-processed access request comprises:
when a preprocessed access request is received, determining whether the cache pool comprises data corresponding to the preprocessed access request;
if the cache pool comprises data corresponding to the preprocessed access request, acquiring the data;
generating a client page based on the data.
9. The method of claim 8, further comprising:
if the cache pool does not contain the data corresponding to the preprocessed access request, sending the preprocessed access request to a server;
receiving data returned by the server according to the preprocessed access request;
generating a client page based on the data.
10. A method of data processing, comprising:
receiving pre-fetching configuration information sent by a specific configuration platform and starting a route interception function of a current client;
when an access request for a page is received, determining whether URL information in the access request is included in the pre-fetching configuration information;
if so, performing data prefetching on the page data of the page according to the URL information; and the number of the first and second groups,
preprocessing the access request, the preprocessing being performed in parallel with the data prefetching;
and when the preprocessed access request is received, intercepting the preprocessed access request and displaying the prefetched page data.
11. A method of data processing, comprising:
receiving an access request aiming at a page, wherein the access request comprises URL (uniform resource locator) information of the page;
calling a bridge between the current client and the server according to the URL information;
performing data prefetching on the page data of the page through the network bridge; and the number of the first and second groups,
preprocessing the access request, the preprocessing being performed in parallel with the data prefetching;
and when the preprocessed access request is received, intercepting the preprocessed access request and displaying the prefetched page data.
12. An apparatus for data processing, comprising:
the system comprises a receiving module, a processing module and a processing module, wherein the receiving module is used for receiving an access request aiming at a page, and the access request comprises URL (uniform resource locator) information of the page;
the data prefetching module is used for prefetching data of the page according to the URL information; and the number of the first and second groups,
a preprocessing module for preprocessing the access request, the preprocessing being performed in parallel with the data prefetching;
and the display module is used for displaying the pre-fetched page data when receiving the preprocessed access request.
13. An apparatus for data processing, comprising:
the pre-fetching configuration information receiving module is used for receiving the pre-fetching configuration information sent by the specific configuration platform and starting a route intercepting function of the current client;
the URL information determining module is used for determining whether URL information in an access request is included in the pre-fetching configuration information when the access request aiming at a page is received;
the data prefetching module is used for prefetching data of the page according to the URL information when the prefetching configuration information comprises the URL information in the access request; and the number of the first and second groups,
a preprocessing module for preprocessing the access request, the preprocessing being performed in parallel with the data prefetching;
and the data display module is used for intercepting the preprocessed access request and displaying the pre-fetched page data when the preprocessed access request is received.
14. An apparatus for data processing, comprising:
the system comprises a receiving module, a processing module and a processing module, wherein the receiving module is used for receiving an access request aiming at a page, and the access request comprises URL (uniform resource locator) information of the page;
the calling module is used for calling the bridge between the current client and the server according to the URL information;
the data prefetching module is used for prefetching data of the page through the network bridge; and the number of the first and second groups,
a preprocessing module for preprocessing the access request, the preprocessing being performed in parallel with the data prefetching;
and the display module is used for intercepting the preprocessed access request and displaying the pre-fetched page data when the preprocessed access request is received.
CN201810898226.6A 2018-08-08 2018-08-08 Data processing method and device Active CN110858238B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810898226.6A CN110858238B (en) 2018-08-08 2018-08-08 Data processing method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810898226.6A CN110858238B (en) 2018-08-08 2018-08-08 Data processing method and device

Publications (2)

Publication Number Publication Date
CN110858238A true CN110858238A (en) 2020-03-03
CN110858238B CN110858238B (en) 2023-08-22

Family

ID=69634674

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810898226.6A Active CN110858238B (en) 2018-08-08 2018-08-08 Data processing method and device

Country Status (1)

Country Link
CN (1) CN110858238B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111611479A (en) * 2020-05-07 2020-09-01 北京达佳互联信息技术有限公司 Data processing method and related device for network resource recommendation

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2053941A1 (en) * 1991-03-29 1992-09-30 Stamatis Vassiliadis System for preparing instructions for instruction parallel processor and system with mechanism for branching in the middle of a compound instruction
US20020062384A1 (en) * 1998-03-06 2002-05-23 Tso Michael M. Method of proxy-assisted predictive pre-fetching
CN101682621A (en) * 2007-03-12 2010-03-24 思杰系统有限公司 Systems and methods for cache operations
CN102033935A (en) * 2010-12-20 2011-04-27 深圳市五巨科技有限公司 Preloading method, preloading device and preloading system of mobile terminal browser
US20160062894A1 (en) * 2014-08-28 2016-03-03 Oracle International Corporation System and Method for Performing Message Driven Prefetching at the Network Interface
CN106302557A (en) * 2015-05-11 2017-01-04 阿里巴巴集团控股有限公司 Page loading method and relevant device, system
CN107943825A (en) * 2017-10-19 2018-04-20 阿里巴巴集团控股有限公司 Data processing method, device and the electronic equipment of page access

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2053941A1 (en) * 1991-03-29 1992-09-30 Stamatis Vassiliadis System for preparing instructions for instruction parallel processor and system with mechanism for branching in the middle of a compound instruction
US20020062384A1 (en) * 1998-03-06 2002-05-23 Tso Michael M. Method of proxy-assisted predictive pre-fetching
CN101682621A (en) * 2007-03-12 2010-03-24 思杰系统有限公司 Systems and methods for cache operations
CN102033935A (en) * 2010-12-20 2011-04-27 深圳市五巨科技有限公司 Preloading method, preloading device and preloading system of mobile terminal browser
US20160062894A1 (en) * 2014-08-28 2016-03-03 Oracle International Corporation System and Method for Performing Message Driven Prefetching at the Network Interface
CN106302557A (en) * 2015-05-11 2017-01-04 阿里巴巴集团控股有限公司 Page loading method and relevant device, system
CN107943825A (en) * 2017-10-19 2018-04-20 阿里巴巴集团控股有限公司 Data processing method, device and the electronic equipment of page access

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111611479A (en) * 2020-05-07 2020-09-01 北京达佳互联信息技术有限公司 Data processing method and related device for network resource recommendation
CN111611479B (en) * 2020-05-07 2024-02-13 北京达佳互联信息技术有限公司 Data processing method and related device for network resource recommendation

Also Published As

Publication number Publication date
CN110858238B (en) 2023-08-22

Similar Documents

Publication Publication Date Title
US10255255B2 (en) Customization of mobile applications using web-based technology
US10783211B2 (en) Page processing method and device thereof
CN106484862B (en) Page control method and device
US8612418B2 (en) Mobile web browser for pre-loading web pages
US9703761B2 (en) Delayed code parsing for reduced startup latency
US8386955B1 (en) User-optimized content for web browsing windows
US10911565B2 (en) Method, device and system for associating a service account
JP2019520624A (en) Page component dynamic layout
US20180253503A1 (en) Method, Apparatus and System for Preloading of APP Launch Advertising
CN107168960B (en) Service execution method and device
CN107276842B (en) Interface test method and device and electronic equipment
CN110502699B (en) Method and device for acquiring information
US10082937B2 (en) Intelligent rendering of webpages
CN109656670B (en) Page rendering method and device
EP3863252A1 (en) Advertisement anti-shielding method and device
CN111125595A (en) Multi-page control method and device, electronic equipment and storage medium
US9164817B2 (en) Mobile communication terminal to provide widget expansion function using message communication, and operation method of the mobile communication terminal
CN111259283A (en) Page resource preloading processing method and device, electronic device and storage device
CN112307386A (en) Information monitoring method, system, electronic device and computer readable storage medium
CN110858238B (en) Data processing method and device
CN111767053A (en) Front-end page data acquisition method and device
CN116304403A (en) Webpage access method and device, computer equipment and storage medium
CN108268298B (en) Desktop icon generation method and device, storage medium and electronic equipment
CN112115738A (en) Image identification method and device applied to browser end
CN110825603A (en) Page first loading time determining method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant