CN113742618A - Data processing method, device, related equipment and storage medium - Google Patents

Data processing method, device, related equipment and storage medium Download PDF

Info

Publication number
CN113742618A
CN113742618A CN202011255946.4A CN202011255946A CN113742618A CN 113742618 A CN113742618 A CN 113742618A CN 202011255946 A CN202011255946 A CN 202011255946A CN 113742618 A CN113742618 A CN 113742618A
Authority
CN
China
Prior art keywords
picture
click position
preset click
preset
point information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011255946.4A
Other languages
Chinese (zh)
Inventor
章启翔
周廉贵
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Jingdong Century Trading Co Ltd
Beijing Wodong Tianjun Information Technology Co Ltd
Original Assignee
Beijing Jingdong Century Trading Co Ltd
Beijing Wodong Tianjun Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Jingdong Century Trading Co Ltd, Beijing Wodong Tianjun Information Technology Co Ltd filed Critical Beijing Jingdong Century Trading Co Ltd
Priority to CN202011255946.4A priority Critical patent/CN113742618A/en
Publication of CN113742618A publication Critical patent/CN113742618A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/958Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/955Retrieval from the web using information identifiers, e.g. uniform resource locators [URL]

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The application discloses a data processing method, a data processing device, a terminal, a server and a storage medium. The method comprises the following steps: the terminal acquires data to be processed; the data to be processed comprises at least one picture; the at least one picture can form a complete screenshot of the target webpage; acquiring coordinates of at least one preset click position corresponding to the corresponding picture aiming at each picture in the at least one picture; acquiring buried point information corresponding to each preset click position; and reporting the at least one picture, the coordinates of at least one preset click position corresponding to each picture and the embedded point information corresponding to each preset click position to a server, so that the server can generate a thermodynamic diagram corresponding to the target webpage.

Description

Data processing method, device, related equipment and storage medium
Technical Field
The present application relates to the field of internet technologies, and in particular, to a data processing method and apparatus, a related device, and a storage medium.
Background
In order to understand the online sales/marketing effect of consumers and their own goods, more and more electric consumers are starting to subscribe to a merchant thermodynamic diagram service.
However, in the related art, in the process of providing the thermodynamic diagram for the user, the data processing method needs to be optimized.
Disclosure of Invention
In order to solve the related technical problems, embodiments of the present application provide a data processing method, an apparatus, a related device, and a storage medium.
The technical scheme of the embodiment of the application is realized as follows:
at least one embodiment of the present application provides a data processing method, applied to a terminal, including:
acquiring data to be processed; the data to be processed comprises at least one picture; the at least one picture can form a complete screenshot of the target webpage;
acquiring coordinates of at least one preset click position corresponding to the corresponding picture aiming at each picture in the at least one picture; acquiring buried point information corresponding to each preset click position;
and reporting the at least one picture, the coordinates of at least one preset click position corresponding to each picture and the embedded point information corresponding to each preset click position to a server, so that the server can generate a thermodynamic diagram corresponding to the target webpage.
Furthermore, according to at least one embodiment of the present application, the acquiring data to be processed includes:
acquiring a task to be processed from a server;
determining a target webpage according to the acquired task to be processed;
and acquiring data to be processed based on the determined target webpage.
In addition, according to at least one embodiment of the present application, the acquiring data to be processed based on the determined target webpage includes:
and performing screenshot processing on the target webpage to obtain at least one picture.
Further, in accordance with at least one embodiment of the present application,
and obtaining the coordinates of at least one preset click position corresponding to the corresponding picture and the buried point information corresponding to each preset click position from the local information base.
In addition, according to at least one embodiment of the present application, reporting the at least one picture, the coordinates of at least one preset click position corresponding to each picture, and the buried point information corresponding to each preset click position to a server includes:
reporting the at least one picture to a server, and acquiring a Uniform Resource Locator (URL) corresponding to each picture in the at least one picture;
and aiming at each picture in the at least one picture, establishing a corresponding relation among a URL corresponding to the corresponding picture, coordinates of at least one preset click position corresponding to the corresponding picture and embedded point information corresponding to each preset click position, and reporting the established corresponding relation to a server.
In addition, according to at least one embodiment of the present application, the establishing a corresponding relationship between the URL corresponding to the corresponding picture, the coordinates of the at least one preset click position corresponding to the corresponding picture, and the embedded point information corresponding to each preset click position includes:
and establishing a corresponding relation among the URL corresponding to the corresponding picture, the coordinates of at least one preset click position corresponding to the corresponding picture and the buried point information corresponding to each preset click position in a JavaScript Object Notation (JSON, JavaScript Object Notation) mode.
At least one embodiment of the present application further provides a data processing method, which is applied to a server, and includes:
receiving at least one picture reported by a terminal, coordinates of at least one preset click position corresponding to each picture and embedded point information corresponding to each preset click position; the at least one picture can form a complete screenshot of the target webpage;
generating a thermodynamic diagram corresponding to the target webpage based on the at least one picture, the coordinates of at least one preset click position corresponding to each picture and the buried point information corresponding to each preset click position;
and issuing the thermodynamic diagram corresponding to the target webpage to a target client.
In addition, according to at least one embodiment of the present application, the generating a thermodynamic diagram corresponding to the target webpage based on the at least one picture, the coordinates of the at least one preset click position corresponding to each picture, and the buried point information corresponding to each preset click position includes:
performing picture splicing processing on the at least one picture to obtain a first picture, wherein the first picture corresponds to at least one preset click position;
aiming at each preset click position in the at least one preset click position, determining the number of times that the corresponding preset click position is clicked within a preset time range by using the embedded point information corresponding to the corresponding preset click position, and marking the number of times that the corresponding preset click position is clicked within the preset time range on the first picture by using the coordinate of the corresponding preset click position to obtain the thermodynamic diagram corresponding to the target webpage.
In addition, according to at least one embodiment of the present application, the generating a thermodynamic diagram corresponding to the target webpage based on the at least one picture, the coordinates of the at least one preset click position corresponding to each picture, and the buried point information corresponding to each preset click position includes:
aiming at least one preset click position corresponding to each picture in at least one picture, determining the number of times that the corresponding preset click position is clicked within a preset time range by utilizing the buried point information corresponding to the corresponding preset click position, and marking the number of times that the corresponding preset click position is clicked within the preset time range on the corresponding picture by utilizing the coordinate of the corresponding preset click position to obtain at least one second picture corresponding to the at least one picture;
and carrying out picture splicing processing on the at least one second picture to obtain a thermodynamic diagram corresponding to the target webpage.
At least one embodiment of the present application further provides a terminal, including:
the acquisition unit is used for acquiring data to be processed; the data to be processed comprises at least one picture; the at least one picture can form a complete screenshot of the target webpage;
the first processing unit is used for acquiring the coordinates of at least one preset click position corresponding to the corresponding picture aiming at each picture in the at least one picture; acquiring buried point information corresponding to each preset click position;
the first sending unit is used for reporting the at least one picture, the coordinates of at least one preset click position corresponding to each picture and the embedded point information corresponding to each preset click position to a server so that the server can generate the thermodynamic diagram corresponding to the target webpage.
At least one embodiment of the present application further provides a server, including:
the first receiving unit is used for receiving at least one picture reported by the terminal, the coordinates of at least one preset click position corresponding to each picture and embedded point information corresponding to each preset click position; the at least one picture can form a complete screenshot of the target webpage;
the second processing unit is used for generating a thermodynamic diagram corresponding to the target webpage based on the at least one picture, the coordinates of at least one preset click position corresponding to each picture and the embedded point information corresponding to each preset click position;
and the second sending unit is used for issuing the thermodynamic diagram corresponding to the target webpage to the target client.
At least one embodiment of the present application also provides a data processing apparatus including: a processor and a memory for storing a computer program capable of running on the processor; wherein,
the processor is configured to execute the steps of any method on the terminal side or execute the steps of any method on the server side when running the computer program.
At least one embodiment of the present application also provides a storage medium storing a computer program that, when executed by a processor, implements the steps of any of the methods on the terminal side or implements the steps of any of the methods on the server side.
According to the data processing method, the data processing device, the related equipment and the storage medium, the terminal obtains data to be processed; the data to be processed comprises at least one picture; the at least one picture can form a complete screenshot of the target webpage; acquiring coordinates of at least one preset click position corresponding to the corresponding picture aiming at each picture in the at least one picture; acquiring buried point information corresponding to each preset click position; reporting the at least one picture, the coordinates of at least one preset click position corresponding to each picture and the embedded point information corresponding to each preset click position to a server; the server generates a thermodynamic diagram corresponding to the target webpage based on the at least one picture, the coordinates of at least one preset click position corresponding to each picture and the embedded point information corresponding to each preset click position; and issuing the thermodynamic diagram corresponding to the target webpage to the target client. According to the scheme of the embodiment of the application, at least one picture to be processed, the coordinate of at least one preset click position corresponding to each picture and the embedded point information corresponding to each preset click position are determined in a real terminal environment, the determined information is reported to the server to be used for the server to generate the thermodynamic diagram, so that the problem of system compatibility possibly caused by data processing in a simulation environment of the server can be avoided, the operation and maintenance cost is reduced, the data processing efficiency is improved, the efficiency of providing the thermodynamic diagram for a user is improved, and the user experience is improved.
Drawings
Fig. 1 is a schematic flowchart of a data processing method according to an embodiment of the present application;
fig. 2 is a schematic view of an application scenario according to an embodiment of the present application;
FIG. 3 is a schematic flow chart illustrating another data processing method according to an embodiment of the present application;
FIG. 4 is a schematic diagram of an application scenario of an application embodiment of the present application;
FIG. 5 is a schematic flow chart of a data processing method according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of a terminal according to an embodiment of the present application;
FIG. 7 is a schematic structural diagram of a server according to an embodiment of the present application;
fig. 8 is a schematic diagram of a hardware structure of a data processing apparatus according to an embodiment of the present application.
Detailed Description
The technical solution of the present application is further described in detail below with reference to the accompanying drawings and embodiments.
An embodiment of the present application provides a data processing method, which is applied to a terminal, and as shown in fig. 1, the method includes:
step 101: acquiring data to be processed;
here, the data to be processed includes at least one picture; the at least one picture can form a complete screenshot of the target webpage;
step 102: acquiring coordinates of at least one preset click position corresponding to the corresponding picture aiming at each picture in the at least one picture; acquiring buried point information corresponding to each preset click position;
step 103: and reporting the at least one picture, the coordinates of at least one preset click position corresponding to each picture and the embedded point information corresponding to each preset click position to a server, so that the server can generate a thermodynamic diagram corresponding to the target webpage.
Here, it should be noted that the terminal may include a Personal Computer (PC), a mobile phone, and the like; the PC may include a desktop computer, a notebook computer, a tablet computer, and the like.
In actual Application, the data processing method provided by the embodiment of the present Application may be implemented by an Application program (APP) installed on a terminal. For example, since online sales of goods are generally realized through a mobile phone APP, in order to more conveniently acquire data to be processed, the data processing method provided by the embodiment of the present application may be realized in a manner of adding a new function to the e-commerce APP, where the mobile phone may be an Android (english may be expressed as Android) system or an apple mobile device operating system (english may be expressed as iOS).
In practical application, the data processing method provided by the application embodiment can be selected to be implemented in a simulation environment according to requirements, for example, as shown in fig. 2, a script module (which may be a Shell script) and an Android simulator operate on a first server, the first server obtains a task to be processed from a second server, obtains a picture to be processed according to the task to be processed, and after obtaining the picture to be processed, uploads the picture to a third server and obtains a URL corresponding to the picture, and uploads the URL, click position coordinate information and embedded point information corresponding to the picture to the second server for the second server to generate a corresponding thermodynamic diagram and provide the thermodynamic diagram for a user; after the script module acquires the task to be processed, the Android simulator can be started by carrying task information through an Android startup command (adb shell am start), and the Android simulator opens a corresponding target webpage and acquires the picture to be processed. However, when the data processing method provided by the embodiment of the present application is implemented by using the application scenario of fig. 2, a problem of compatibility between the Android system and a system of the server may occur, which may result in low data processing efficiency; in addition, the operation and maintenance cost is high because a large number of servers (the first server, the second server and the third server) need to be maintained during operation and maintenance. Therefore, the data processing method provided by the embodiment can be realized in a real terminal environment, such as a mobile phone; therefore, in a real terminal environment, the development environment of the APP is consistent with the actual application environment, the problem of system compatibility cannot occur, the data processing efficiency is improved, meanwhile, the maintenance cost of the terminal is lower than that of the server, and the operation and maintenance cost is greatly reduced.
Based on this, in various embodiments of the application, at least one picture to be processed, coordinates of at least one preset click position corresponding to each picture and embedded point information corresponding to each preset click position are determined in a real terminal environment, and the determined information is reported to a server for the server to generate a thermodynamic diagram.
During actual application, after receiving the at least one picture reported by the terminal, the coordinates of at least one preset click position corresponding to each picture and the embedded point information corresponding to each preset click position, the server may perform picture splicing processing on the at least one picture to obtain a first picture, where the first picture corresponds to the at least one preset click position; combining the at least one picture into the first picture, and integrating the coordinates of at least one preset click position corresponding to each picture to obtain the coordinates of at least one preset click position corresponding to the first picture; then, for each preset click position in the at least one preset click position, determining the number of times that the corresponding preset click position is clicked within a preset time range (for example, 24 hours) by using the buried point information corresponding to the corresponding preset click position, and marking the number of times that the corresponding preset click position is clicked within the preset time range on the first picture by using the coordinate of the corresponding preset click position to obtain a thermodynamic diagram corresponding to the target webpage. Or, the server may first determine, for at least one preset click position corresponding to each picture in the at least one picture, the number of times that the corresponding preset click position is clicked within a preset time range by using the buried point information corresponding to the corresponding preset click position, and mark, by using the coordinate of the corresponding preset click position, the number of times that the corresponding preset click position is clicked within the preset time range on the corresponding picture to obtain at least one second picture corresponding to the at least one picture; and finally, carrying out jigsaw processing on the at least one second picture to obtain the thermodynamic diagram corresponding to the target webpage. Here, the server may locally maintain an information base, the information base may store the information of the embedded point and the clicked information of the corresponding preset click position, and the server may perform query in the information base by using the information of the embedded point corresponding to the corresponding preset click position to determine the number of times the corresponding preset click position is clicked within a preset time range.
In practical application, a user (such as an e-commerce merchant) may subscribe to the thermodynamic diagram service, so that when the user subscribing to the thermodynamic diagram service publishes a new webpage, the server may add webpage information published by the user to a task list maintained by the server, the terminal may cyclically acquire a task to be processed from the server, determine a target webpage according to the task to be processed, and acquire data to be processed based on the determined target webpage, thereby further improving data processing efficiency.
Based on this, in an embodiment, the method may further include:
acquiring a task to be processed from a server;
determining a target webpage according to the acquired task to be processed;
accordingly, the acquiring the data to be processed may include:
and acquiring data to be processed based on the determined target webpage.
In actual application, the to-be-processed task acquired by the terminal from the server may include information such as a user Identity Identification (ID) corresponding to the target web page (for example, a merchant ID), a web page ID, and a task ID. The step of acquiring the data to be processed based on the determined target webpage comprises the following steps: and acquiring at least one picture capable of forming a complete screenshot of the target webpage, and specifically acquiring data to be processed in a screenshot mode.
Based on this, in an embodiment, the obtaining the to-be-processed data based on the determined target webpage may include:
and performing screenshot processing on the target webpage to obtain at least one picture.
Specifically, in actual application, the terminal may automatically open the target web page according to the information such as the user ID, the web page ID, and the task ID, and perform screenshot processing on the target web page.
In actual application, the screenshot processing mode of the target webpage can be selected according to requirements, for example, the screenshot processing is rolled; as another example, a partition screenshot process.
Based on this, in an embodiment, the screenshot processing on the target web page may include:
and performing rolling screenshot processing on the target webpage.
In actual application, the terminal may be locally provided with an information base, and the information base may store preset click position coordinate information and corresponding buried point information corresponding to a preset click position. The preset click position can be determined according to the requirement of the user when the user subscribes to the thermodynamic diagram service. Here, in the case that the data processing method provided in the embodiment of the present application is implemented by an APP installed on a terminal, the information base may also refer to data stored in an operating memory of the terminal when the APP is running.
Based on this, in an embodiment, the obtaining the coordinates of the at least one preset click position corresponding to the corresponding picture may include:
obtaining the coordinates of at least one preset click position corresponding to the corresponding picture from a local information base;
correspondingly, the obtaining of the buried point information corresponding to each preset click position may include:
and acquiring the buried point information corresponding to each preset click position from a local information base.
In practical application, a mode of reporting the at least one picture, the coordinates of the at least one preset click position corresponding to each picture and the embedded point information corresponding to each preset click position to the server can be set according to requirements, for example, the picture information, the coordinate information of the click position and the embedded point information can be respectively reported to the server; for another example, the correspondence between the picture information, the coordinate information of the click position, and the buried point information may be established, and the picture information, the coordinate information of the click position, and the buried point information may be reported to the server together.
Based on this, in an embodiment, the reporting, to the server, the at least one picture, the coordinates of the at least one preset click position corresponding to each picture, and the buried point information corresponding to each preset click position may include:
reporting the at least one picture to a server, and acquiring a URL (uniform resource locator) corresponding to each picture in the at least one picture;
and aiming at each picture in the at least one picture, establishing a corresponding relation among a URL corresponding to the corresponding picture, coordinates of at least one preset click position corresponding to the corresponding picture and embedded point information corresponding to each preset click position, and reporting the established corresponding relation to a server.
In an embodiment, the establishing a corresponding relationship between the URL corresponding to the corresponding picture, the coordinate of the at least one preset click position corresponding to the corresponding picture, and the buried point information corresponding to each preset click position may include:
and establishing a corresponding relation among the URL corresponding to the corresponding picture, the coordinates of at least one preset click position corresponding to the corresponding picture and the embedded point information corresponding to each preset click position in a JSON mode.
Correspondingly, an embodiment of the present application further provides a data processing method, which is applied to a server, and as shown in fig. 3, the method includes:
step 301: receiving at least one picture reported by a terminal, coordinates of at least one preset click position corresponding to each picture and embedded point information corresponding to each preset click position;
here, the at least one picture can constitute a complete screenshot of the target web page;
step 302: generating a thermodynamic diagram corresponding to the target webpage based on the at least one picture, the coordinates of at least one preset click position corresponding to each picture and the buried point information corresponding to each preset click position;
step 303: and issuing the thermodynamic diagram corresponding to the target webpage to a target client.
In an embodiment, the generating a thermodynamic diagram corresponding to the target webpage based on the at least one picture, the coordinates of the at least one preset click position corresponding to each picture, and the buried point information corresponding to each preset click position includes:
performing picture splicing processing on the at least one picture to obtain a first picture, wherein the first picture corresponds to at least one preset click position;
aiming at each preset click position in the at least one preset click position, determining the number of times that the corresponding preset click position is clicked within a preset time range by using the embedded point information corresponding to the corresponding preset click position, and marking the number of times that the corresponding preset click position is clicked within the preset time range on the first picture by using the coordinate of the corresponding preset click position to obtain the thermodynamic diagram corresponding to the target webpage.
In an embodiment, the generating a thermodynamic diagram corresponding to the target webpage based on the at least one picture, the coordinates of the at least one preset click position corresponding to each picture, and the buried point information corresponding to each preset click position includes:
aiming at least one preset click position corresponding to each picture in at least one picture, determining the number of times that the corresponding preset click position is clicked within a preset time range by utilizing the buried point information corresponding to the corresponding preset click position, and marking the number of times that the corresponding preset click position is clicked within the preset time range on the corresponding picture by utilizing the coordinate of the corresponding preset click position to obtain at least one second picture corresponding to the at least one picture;
and carrying out picture splicing processing on the at least one second picture to obtain a thermodynamic diagram corresponding to the target webpage.
According to the data processing method provided by the embodiment of the application, the terminal acquires data to be processed; the data to be processed comprises at least one picture; the at least one picture can form a complete screenshot of the target webpage; acquiring coordinates of at least one preset click position corresponding to the corresponding picture aiming at each picture in the at least one picture; acquiring buried point information corresponding to each preset click position; reporting the at least one picture, the coordinates of at least one preset click position corresponding to each picture and the embedded point information corresponding to each preset click position to a server; the server generates a thermodynamic diagram corresponding to the target webpage based on the at least one picture, the coordinates of at least one preset click position corresponding to each picture and the embedded point information corresponding to each preset click position; and issuing the thermodynamic diagram corresponding to the target webpage to the target client. According to the scheme of the embodiment of the application, at least one picture to be processed, the coordinate of at least one preset click position corresponding to each picture and the embedded point information corresponding to each preset click position are determined in a real terminal environment, the determined information is reported to the server to be used for the server to generate the thermodynamic diagram, so that the problem of system compatibility possibly caused by data processing in a simulation environment of the server can be avoided, the operation and maintenance cost is reduced, the data processing efficiency is improved, the efficiency of providing the thermodynamic diagram for a user is improved, and the user experience is improved.
The present application will be described in further detail with reference to the following application examples.
An application scenario of the data processing method provided by the embodiment is shown in fig. 4, where a mobile phone (i.e., the terminal) with an operating system being Android acquires a task to be processed from a fourth server, and enters a webpage corresponding to the task to be processed to perform rolling screenshot, so as to obtain at least one picture (each picture may correspond to index information, and the index information represents a splicing sequence of the corresponding pictures when the at least one picture is used to splice out the corresponding webpage); reporting the obtained at least one picture to a fifth server (the fifth server may be the same as or different from the fourth server), acquiring a URL corresponding to each picture in the at least one picture, determining click position information (i.e., coordinates of the at least one preset click position) and embedded point information (i.e., embedded point information corresponding to the at least one preset click position) corresponding to each picture in the at least one picture, and reporting the URL, index information, click position information and embedded point information corresponding to each picture in the at least one picture to the fourth server, so that the fourth server generates a corresponding thermodynamic diagram and provides the corresponding thermodynamic diagram for a user.
Specifically, based on the application scenario shown in fig. 4, as shown in fig. 5, the data processing method provided in the present application embodiment may include:
step 501: the terminal acquires a task to be processed from the server; step 502 is then performed.
Specifically, the mobile phone with the Android operating system acquires the to-be-processed task from the task queue locally maintained by the fourth server, where the acquired to-be-processed task may include parameters of the target web page, such as information of a user ID, a web page ID, a task ID, and the like.
Step 502: judging whether a task to be processed is acquired; if yes, go to step 503; if not, go to step 501.
Specifically, when a task to be processed does not exist in a task queue maintained by the fourth server and the mobile phone does not acquire the task to be processed from the fourth server, the task acquisition may be performed again after waiting for a first time (for example, 10 seconds); when the mobile phone fails to acquire the to-be-processed task due to a program error or the like, the task acquisition may be performed again after waiting for a second time period (the second time period may be shorter than the first time period, for example, when the first time period is 10 seconds, the second time period may be 5 seconds).
Step 503: starting a target webpage according to a task to be processed; step 504 is then performed.
Specifically, the mobile phone can carry the parameters of the target webpage to determine and enter the target webpage, that is, the target webpage is automatically opened.
Step 504: performing rolling screenshot on a target webpage to obtain at least one picture, and acquiring a URL (uniform resource locator) of each picture; step 505 is then performed.
Step 505: integrating the URL, index information, click position information and embedded point information of each picture; step 506 is then performed.
Step 506: reporting the integration information to a server; after which step 501 is re-executed.
Specifically, after the mobile phone reports the integration information to the server, the current task to be processed is completed, and the next task to be processed can be processed by executing steps 501 to 506, that is, steps 501 to 506 are executed in a circulating manner.
In practical application, steps 501 to 506 shown in fig. 5 can be implemented by one control page of the APP, and the specific implementation logic of the control page is the same as the specific implementation process of the data processing method shown in fig. 1, which is not described herein again.
The data processing method provided by the application embodiment has the following advantages:
firstly, the system compatibility problem possibly caused by an Android simulator is avoided without depending on the simulation environment of a server.
Secondly, the maintenance cost of the mobile phone is lower than that of the server, so that the overall maintenance cost of the system is reduced.
And thirdly, the logic of the whole data processing method can be realized through the APP, and the good communication is carried out with the target webpage inside the APP, so that the complexity of data processing is reduced, and the data processing efficiency is improved.
In order to implement the method of the terminal side in the embodiment of the present application, an embodiment of the present application further provides a terminal, and as shown in fig. 6, the terminal includes:
an acquisition unit 601 configured to acquire data to be processed; the data to be processed comprises at least one picture; the at least one picture can form a complete screenshot of the target webpage;
a first processing unit 602, configured to obtain, for each picture in the at least one picture, coordinates of at least one preset click position corresponding to the corresponding picture; acquiring buried point information corresponding to each preset click position;
a first sending unit 603, configured to report the at least one picture, the coordinates of the at least one preset click position corresponding to each picture, and the embedded point information corresponding to each preset click position to a server, so that the server generates a thermodynamic diagram corresponding to the target webpage.
In an embodiment, the obtaining unit 601 is configured to:
acquiring a task to be processed from a server;
determining a target webpage according to the acquired task to be processed;
and acquiring data to be processed based on the determined target webpage.
In an embodiment, the obtaining unit 601 is configured to perform screenshot processing on the target webpage to obtain at least one picture.
In an embodiment, the first processing unit 602 is configured to obtain, from a local information base, coordinates of at least one preset click position corresponding to a corresponding picture and embedded point information corresponding to each preset click position.
In an embodiment, the first sending unit 603 is configured to:
reporting the at least one picture to a server, and acquiring a URL (uniform resource locator) corresponding to each picture in the at least one picture;
and aiming at each picture in the at least one picture, establishing a corresponding relation among a URL corresponding to the corresponding picture, coordinates of at least one preset click position corresponding to the corresponding picture and embedded point information corresponding to each preset click position, and reporting the established corresponding relation to a server.
In an embodiment, the first sending unit 603 is configured to establish, in a JSON manner, a correspondence between a URL corresponding to the corresponding picture, coordinates of at least one preset click position corresponding to the corresponding picture, and embedded point information corresponding to each preset click position.
In practical application, the obtaining unit 601 may be implemented by a processor in the terminal in combination with a communication interface; the first processing unit 602 may be implemented by a processor in the terminal; the first sending unit 603 may be implemented by a communication interface in the terminal.
Correspondingly, in order to implement the method on the server side in the embodiment of the present application, an embodiment of the present application further provides a server, and as shown in fig. 7, the server includes:
the first receiving unit 701 is configured to receive at least one picture reported by a terminal, coordinates of at least one preset click position corresponding to each picture, and embedded point information corresponding to each preset click position; the at least one picture can form a complete screenshot of the target webpage;
a second processing unit 702, configured to generate a thermodynamic diagram corresponding to the target webpage based on the at least one picture, coordinates of at least one preset click position corresponding to each picture, and embedded point information corresponding to each preset click position;
the second sending unit 703 is configured to issue the thermodynamic diagram corresponding to the target webpage to the target client.
In an embodiment, the second processing unit 702 is configured to:
performing picture splicing processing on the at least one picture to obtain a first picture, wherein the first picture corresponds to at least one preset click position;
aiming at each preset click position in the at least one preset click position, determining the number of times that the corresponding preset click position is clicked within a preset time range by using the embedded point information corresponding to the corresponding preset click position, and marking the number of times that the corresponding preset click position is clicked within the preset time range on the first picture by using the coordinate of the corresponding preset click position to obtain the thermodynamic diagram corresponding to the target webpage.
In an embodiment, the second processing unit 702 is configured to:
aiming at least one preset click position corresponding to each picture in at least one picture, determining the number of times that the corresponding preset click position is clicked within a preset time range by utilizing the buried point information corresponding to the corresponding preset click position, and marking the number of times that the corresponding preset click position is clicked within the preset time range on the corresponding picture by utilizing the coordinate of the corresponding preset click position to obtain at least one second picture corresponding to the at least one picture;
and carrying out picture splicing processing on the at least one second picture to obtain a thermodynamic diagram corresponding to the target webpage.
In actual application, the first receiving unit 701 and the second sending unit 703 may be implemented by a communication interface in a server; the second processing unit 702 may be implemented by a processor in a server.
It should be noted that: the terminal and the server provided in the above embodiments are only exemplified by the division of the above program modules when processing data, and in practical applications, the above processing may be distributed to different program modules according to needs, that is, the internal structure of the terminal or the server is divided into different program modules to complete all or part of the above described processing. In addition, the terminal and the server provided by the above embodiments belong to the same concept as the embodiments of the data processing method, and specific implementation processes thereof are described in the embodiments of the method and are not described herein again.
Based on the hardware implementation of the program modules, and in order to implement the method of the embodiment of the present application, an embodiment of the present application further provides a data processing apparatus, where the data processing apparatus may be a terminal or a server, as shown in fig. 8, the data processing apparatus 800 includes:
a communication interface 801 capable of performing information interaction with other electronic devices;
the processor 802 is connected with the communication interface 801 to realize information interaction with other electronic devices, and is used for executing the method provided by one or more technical schemes when running a computer program;
a memory 803 for storing computer programs that can be run on the processor 802.
Here, in the case where the data processing apparatus 800 is a terminal, the other electronic device may be a server; in case the data processing apparatus 800 is a server, the other electronic devices may be terminals or clients.
Specifically, in the case that the data processing apparatus 800 is a terminal, the processor 802 is configured to perform the following operations:
acquiring data to be processed; the data to be processed comprises at least one picture; the at least one picture can form a complete screenshot of the target webpage;
acquiring coordinates of at least one preset click position corresponding to the corresponding picture aiming at each picture in the at least one picture; acquiring buried point information corresponding to each preset click position;
and reporting the at least one picture, the coordinates of at least one preset click position corresponding to each picture and the embedded point information corresponding to each preset click position to a server through the communication interface 801, so that the server can generate the thermodynamic diagram corresponding to the target webpage.
Wherein, in an embodiment, the processor 802 is configured to perform the following operations:
acquiring a task to be processed from a server through the communication interface 801;
determining a target webpage according to the acquired task to be processed;
and acquiring data to be processed based on the determined target webpage.
In one embodiment, the processor 802 is configured to perform the following operations:
and performing screenshot processing on the target webpage to obtain at least one picture.
In one embodiment, the processor 802 is configured to perform the following operations:
and obtaining the coordinates of at least one preset click position corresponding to the corresponding picture and the buried point information corresponding to each preset click position from the local information base.
In one embodiment, the processor 802 is configured to perform the following operations:
reporting the at least one picture to a server through the communication interface 801, and acquiring a URL corresponding to each picture in the at least one picture;
for each picture in the at least one picture, a corresponding relationship between the URL corresponding to the corresponding picture, the coordinates of the at least one preset click position corresponding to the corresponding picture, and the embedded point information corresponding to each preset click position is established, and the established corresponding relationship is reported to the server through the communication interface 801.
In one embodiment, the processor 802 is configured to perform the following operations:
and establishing a corresponding relation among the URL corresponding to the corresponding picture, the coordinates of at least one preset click position corresponding to the corresponding picture and the embedded point information corresponding to each preset click position in a JSON mode.
Accordingly, in the case where the data processing apparatus 800 is a server, the processor 802 is configured to:
receiving at least one picture reported by a terminal, coordinates of at least one preset click position corresponding to each picture and embedded point information corresponding to each preset click position through the communication interface 801; the at least one picture can form a complete screenshot of the target webpage;
generating a thermodynamic diagram corresponding to the target webpage based on the at least one picture, the coordinates of at least one preset click position corresponding to each picture and the buried point information corresponding to each preset click position;
and issuing the thermodynamic diagram corresponding to the target webpage to the target client through the communication interface 801.
Wherein, in an embodiment, the processor 802 is configured to perform the following operations:
performing picture splicing processing on the at least one picture to obtain a first picture, wherein the first picture corresponds to at least one preset click position;
aiming at each preset click position in the at least one preset click position, determining the number of times that the corresponding preset click position is clicked within a preset time range by using the embedded point information corresponding to the corresponding preset click position, and marking the number of times that the corresponding preset click position is clicked within the preset time range on the first picture by using the coordinate of the corresponding preset click position to obtain the thermodynamic diagram corresponding to the target webpage.
In one embodiment, the processor 802 is configured to perform the following operations:
aiming at least one preset click position corresponding to each picture in at least one picture, determining the number of times that the corresponding preset click position is clicked within a preset time range by utilizing the buried point information corresponding to the corresponding preset click position, and marking the number of times that the corresponding preset click position is clicked within the preset time range on the corresponding picture by utilizing the coordinate of the corresponding preset click position to obtain at least one second picture corresponding to the at least one picture;
and carrying out picture splicing processing on the at least one second picture to obtain a thermodynamic diagram corresponding to the target webpage.
It should be noted that: the process of the processor 802 specifically executing the above operations is detailed in the method embodiment, and is not described here again.
Of course, in practice, the various components in the data processing device 800 are coupled together by a bus system 804. It is understood that the bus system 804 is used to enable communications among the components. The bus system 804 includes a power bus, a control bus, and a status signal bus in addition to a data bus. For clarity of illustration, however, the various buses are labeled as bus system 804 in FIG. 8.
The memory 803 in the present embodiment is used to store various types of data to support the operation of the data processing apparatus 800. Examples of such data include: any computer program for operating on the data processing device 800.
The method disclosed in the embodiments of the present application can be applied to the processor 802, or implemented by the processor 802. The processor 802 may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be performed by integrated logic circuits of hardware or instructions in the form of software in the processor 802. The Processor 802 may be a general purpose Processor, a Digital Signal Processor (DSP), or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, or the like. The processor 802 may implement or perform the methods, steps, and logic blocks disclosed in the embodiments of the present application. A general purpose processor may be a microprocessor or any conventional processor or the like. The steps of the method disclosed in the embodiments of the present application may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software modules may be located in a storage medium located in the memory 803, and the processor 802 reads the information in the memory 803 and performs the steps of the aforementioned methods in conjunction with its hardware.
In an exemplary embodiment, the data processing Device 800 may be implemented by one or more Application Specific Integrated Circuits (ASICs), DSPs, Programmable Logic Devices (PLDs), Complex Programmable Logic Devices (CPLDs), Field Programmable Gate Arrays (FPGAs), general purpose processors, controllers, Micro Controllers (MCUs), microprocessors (microprocessors), or other electronic components for performing the foregoing methods.
It is to be appreciated that the memory 803 of the subject embodiment can be either volatile memory or nonvolatile memory, and can include both volatile and nonvolatile memory. Among them, the nonvolatile Memory may be a Read Only Memory (ROM), a Programmable Read Only Memory (PROM), an Erasable Programmable Read-Only Memory (EPROM), an Electrically Erasable Programmable Read-Only Memory (EEPROM), a magnetic random access Memory (FRAM), a Flash Memory (Flash Memory), a magnetic surface Memory, an optical disk, or a Compact Disc Read-Only Memory (CD-ROM); the magnetic surface storage may be disk storage or tape storage. Volatile Memory can be Random Access Memory (RAM), which acts as external cache Memory. By way of illustration and not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Synchronous Static Random Access Memory (SSRAM), Dynamic Random Access Memory (DRAM), Synchronous Dynamic Random Access Memory (SDRAM), Double Data Rate Synchronous Dynamic Random Access Memory (DDRSDRAM), Enhanced Synchronous Dynamic Random Access Memory (ESDRAM), Enhanced Synchronous Dynamic Random Access Memory (Enhanced DRAM), Synchronous Dynamic Random Access Memory (SLDRAM), Direct Memory (DRmb Access), and Random Access Memory (DRAM). The memories described in the embodiments of the present application are intended to comprise, without being limited to, these and any other suitable types of memory.
In an exemplary embodiment, the present application further provides a storage medium, specifically a computer-readable storage medium, for example, a memory 803 storing a computer program, which can be executed by the processor 802 of the data processing apparatus 800 to perform the steps of the foregoing method. The computer readable storage medium may be Memory such as FRAM, ROM, PROM, EPROM, EEPROM, Flash Memory, magnetic surface Memory, optical disk, or CD-ROM.
It should be noted that: "first," "second," and the like are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order.
The technical means described in the embodiments of the present application may be arbitrarily combined without conflict.
The above description is only a preferred embodiment of the present application, and is not intended to limit the scope of the present application.

Claims (13)

1. A data processing method is applied to a terminal and comprises the following steps:
acquiring data to be processed; the data to be processed comprises at least one picture; the at least one picture can form a complete screenshot of the target webpage;
acquiring coordinates of at least one preset click position corresponding to the corresponding picture aiming at each picture in the at least one picture; acquiring buried point information corresponding to each preset click position;
and reporting the at least one picture, the coordinates of at least one preset click position corresponding to each picture and the embedded point information corresponding to each preset click position to a server, so that the server can generate a thermodynamic diagram corresponding to the target webpage.
2. The method of claim 1, wherein the obtaining the data to be processed comprises:
acquiring a task to be processed from a server;
determining a target webpage according to the acquired task to be processed;
and acquiring data to be processed based on the determined target webpage.
3. The method of claim 2, wherein the obtaining the data to be processed based on the determined target webpage comprises:
and performing screenshot processing on the target webpage to obtain at least one picture.
4. The method according to any one of claims 1 to 3,
and obtaining the coordinates of at least one preset click position corresponding to the corresponding picture and the buried point information corresponding to each preset click position from the local information base.
5. The method according to any one of claims 1 to 3, wherein the reporting the at least one picture, the coordinates of the at least one preset click position corresponding to each picture, and the buried point information corresponding to each preset click position to a server comprises:
reporting the at least one picture to a server, and acquiring a Uniform Resource Locator (URL) corresponding to each picture in the at least one picture;
and aiming at each picture in the at least one picture, establishing a corresponding relation among a URL corresponding to the corresponding picture, coordinates of at least one preset click position corresponding to the corresponding picture and embedded point information corresponding to each preset click position, and reporting the established corresponding relation to a server.
6. The method according to claim 5, wherein the establishing a corresponding relationship between the URL corresponding to the corresponding picture, the coordinates of the at least one preset click position corresponding to the corresponding picture, and the embedded point information corresponding to each preset click position comprises:
and establishing a corresponding relation among the URL corresponding to the corresponding picture, the coordinates of at least one preset click position corresponding to the corresponding picture and the embedded point information corresponding to each preset click position in a JavaScript object notation JSON mode.
7. A data processing method is applied to a server and comprises the following steps:
receiving at least one picture reported by a terminal, coordinates of at least one preset click position corresponding to each picture and embedded point information corresponding to each preset click position; the at least one picture can form a complete screenshot of the target webpage;
generating a thermodynamic diagram corresponding to the target webpage based on the at least one picture, the coordinates of at least one preset click position corresponding to each picture and the buried point information corresponding to each preset click position;
and issuing the thermodynamic diagram corresponding to the target webpage to a target client.
8. The method of claim 7, wherein generating the thermodynamic diagram corresponding to the target webpage based on the at least one picture, the coordinates of the at least one preset click position corresponding to each picture, and the buried point information corresponding to each preset click position comprises:
performing picture splicing processing on the at least one picture to obtain a first picture, wherein the first picture corresponds to at least one preset click position;
aiming at each preset click position in the at least one preset click position, determining the number of times that the corresponding preset click position is clicked within a preset time range by using the embedded point information corresponding to the corresponding preset click position, and marking the number of times that the corresponding preset click position is clicked within the preset time range on the first picture by using the coordinate of the corresponding preset click position to obtain the thermodynamic diagram corresponding to the target webpage.
9. The method of claim 7, wherein generating the thermodynamic diagram corresponding to the target webpage based on the at least one picture, the coordinates of the at least one preset click position corresponding to each picture, and the buried point information corresponding to each preset click position comprises:
aiming at least one preset click position corresponding to each picture in at least one picture, determining the number of times that the corresponding preset click position is clicked within a preset time range by utilizing the buried point information corresponding to the corresponding preset click position, and marking the number of times that the corresponding preset click position is clicked within the preset time range on the corresponding picture by utilizing the coordinate of the corresponding preset click position to obtain at least one second picture corresponding to the at least one picture;
and carrying out picture splicing processing on the at least one second picture to obtain a thermodynamic diagram corresponding to the target webpage.
10. A terminal, comprising:
the acquisition unit is used for acquiring data to be processed; the data to be processed comprises at least one picture; the at least one picture can form a complete screenshot of the target webpage;
the first processing unit is used for acquiring the coordinates of at least one preset click position corresponding to the corresponding picture aiming at each picture in the at least one picture; acquiring buried point information corresponding to each preset click position;
the first sending unit is used for reporting the at least one picture, the coordinates of at least one preset click position corresponding to each picture and the embedded point information corresponding to each preset click position to a server so that the server can generate the thermodynamic diagram corresponding to the target webpage.
11. A server, comprising:
the first receiving unit is used for receiving at least one picture reported by the terminal, the coordinates of at least one preset click position corresponding to each picture and embedded point information corresponding to each preset click position; the at least one picture can form a complete screenshot of the target webpage;
the second processing unit is used for generating a thermodynamic diagram corresponding to the target webpage based on the at least one picture, the coordinates of at least one preset click position corresponding to each picture and the embedded point information corresponding to each preset click position;
and the second sending unit is used for issuing the thermodynamic diagram corresponding to the target webpage to the target client.
12. A data processing apparatus, comprising: a processor and a memory for storing a computer program capable of running on the processor; wherein,
the processor is adapted to perform the steps of the method of any one of claims 1 to 6 or the steps of the method of any one of claims 7 to 9 when running the computer program.
13. A storage medium storing a computer program, characterized in that the computer program, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 6 or carries out the steps of the method of any one of claims 7 to 9.
CN202011255946.4A 2020-11-11 2020-11-11 Data processing method, device, related equipment and storage medium Pending CN113742618A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011255946.4A CN113742618A (en) 2020-11-11 2020-11-11 Data processing method, device, related equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011255946.4A CN113742618A (en) 2020-11-11 2020-11-11 Data processing method, device, related equipment and storage medium

Publications (1)

Publication Number Publication Date
CN113742618A true CN113742618A (en) 2021-12-03

Family

ID=78728147

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011255946.4A Pending CN113742618A (en) 2020-11-11 2020-11-11 Data processing method, device, related equipment and storage medium

Country Status (1)

Country Link
CN (1) CN113742618A (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150302466A1 (en) * 2012-08-17 2015-10-22 Beijing Gridsum Technology Co., Ltd. Data determination method and device for a thermodynamic chart
CN108804445A (en) * 2017-04-28 2018-11-13 北京京东尚科信息技术有限公司 Heating power drawing generating method and device
CN110020350A (en) * 2017-09-28 2019-07-16 北京国双科技有限公司 Method for drafting, device, storage medium and the processor of webpage thermodynamic
CN110472175A (en) * 2019-07-03 2019-11-19 平安证券股份有限公司 User behavior analysis method and terminal device
CN111104608A (en) * 2018-10-25 2020-05-05 华为技术有限公司 Webpage data processing method and related device
CN111125590A (en) * 2018-10-31 2020-05-08 北京国双科技有限公司 Method and device for drawing thermodynamic diagram
CN111125564A (en) * 2018-11-01 2020-05-08 百度在线网络技术(北京)有限公司 Thermodynamic diagram generation method and device, computer equipment and storage medium
CN111240947A (en) * 2018-11-29 2020-06-05 北京京东尚科信息技术有限公司 Page thermodynamic diagram generation method and system

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150302466A1 (en) * 2012-08-17 2015-10-22 Beijing Gridsum Technology Co., Ltd. Data determination method and device for a thermodynamic chart
CN108804445A (en) * 2017-04-28 2018-11-13 北京京东尚科信息技术有限公司 Heating power drawing generating method and device
CN110020350A (en) * 2017-09-28 2019-07-16 北京国双科技有限公司 Method for drafting, device, storage medium and the processor of webpage thermodynamic
CN111104608A (en) * 2018-10-25 2020-05-05 华为技术有限公司 Webpage data processing method and related device
CN111125590A (en) * 2018-10-31 2020-05-08 北京国双科技有限公司 Method and device for drawing thermodynamic diagram
CN111125564A (en) * 2018-11-01 2020-05-08 百度在线网络技术(北京)有限公司 Thermodynamic diagram generation method and device, computer equipment and storage medium
CN111240947A (en) * 2018-11-29 2020-06-05 北京京东尚科信息技术有限公司 Page thermodynamic diagram generation method and system
CN110472175A (en) * 2019-07-03 2019-11-19 平安证券股份有限公司 User behavior analysis method and terminal device

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
蔡玉鑫;汤志伟;赵博;杨明;吴禹非;: "基于嵌入式多核DSP的加速软件系统", 计算机科学, no. 1, 15 June 2020 (2020-06-15) *
金尧;王瀛;程欢;陈昱驰;杨星浩;: "用户行为数据分析平台用户竞品分析及相关探究", 信息与电脑(理论版), no. 09, 15 May 2019 (2019-05-15) *

Similar Documents

Publication Publication Date Title
CN109460527B (en) Product data configuration method, device, computer equipment and storage medium
US20170163753A1 (en) Method and apparatus for controlling play device to play video
CN108255701B (en) Scene testing method and mobile terminal
CN111414391A (en) Method and system for accessing multiple data sources
CN111309991B (en) Query statement generation method and device and data query method and system
US11244153B2 (en) Method and apparatus for processing information
CN107479868B (en) Interface loading method, device and equipment
CN109376354A (en) Fraud recognition methods, device, electronic equipment and readable storage medium storing program for executing
CN110007936B (en) Data processing method and device
CN115065652B (en) Message reply method and device, storage medium and computer equipment
US20160162984A1 (en) Processing unstructured messages
CN111694639A (en) Method and device for updating address of process container and electronic equipment
CN111026988A (en) Page loading method, device and system and computer equipment
CN113742618A (en) Data processing method, device, related equipment and storage medium
CN114063958B (en) Page split screen display method and device
CN116304403A (en) Webpage access method and device, computer equipment and storage medium
CN113342447B (en) Page generation method, device, equipment and storage medium based on Flutter
CN104407846B (en) Information processing method and device
CN114880018A (en) Request processing method and device, storage medium and electronic equipment
CN111314462A (en) Resource processing method, device and storage medium
CN107454124B (en) Equipment automation method and device
CN105988917A (en) Method and device for obtaining abnormal information
CN104780188A (en) Information sharing method, information sharing device and information sharing system
CN112559930B (en) Webpage integration method, webpage integration device, computer equipment and storage medium
CN111859230B (en) Control method for monitoring hot spot trend of internet information

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination