CN117271289A - Webpage monitoring method, device, equipment and storage medium - Google Patents
Webpage monitoring method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN117271289A CN117271289A CN202311311699.9A CN202311311699A CN117271289A CN 117271289 A CN117271289 A CN 117271289A CN 202311311699 A CN202311311699 A CN 202311311699A CN 117271289 A CN117271289 A CN 117271289A
- Authority
- CN
- China
- Prior art keywords
- webpage
- target
- content
- monitoring
- determining
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 154
- 238000000034 method Methods 0.000 title claims abstract description 51
- 238000013515 script Methods 0.000 claims abstract description 42
- 238000012795 verification Methods 0.000 claims abstract description 23
- 238000004590 computer program Methods 0.000 claims description 16
- 238000004422 calculation algorithm Methods 0.000 claims description 11
- 238000012806 monitoring device Methods 0.000 claims description 6
- 238000005259 measurement Methods 0.000 claims description 5
- 230000008859 change Effects 0.000 abstract description 12
- 238000004891 communication Methods 0.000 description 9
- 230000008569 process Effects 0.000 description 8
- 230000004044 response Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 6
- 238000012545 processing Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000009877 rendering Methods 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3466—Performance evaluation by tracing or monitoring
- G06F11/3476—Data logging
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Data Mining & Analysis (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention discloses a webpage monitoring method, device, equipment and storage medium. The method comprises the following steps: responding to a monitoring request of a target webpage, determining first webpage content at the current moment, and carrying out integrity check on the first webpage content; if the verification is passed, determining a target monitoring moment, and adopting a preset monitoring script to acquire contents of a target webpage at the target monitoring moment so as to determine second contents of the webpage; and determining whether the target webpage changes according to the first webpage content and the second webpage content so as to monitor the target webpage. According to the technical scheme, the change of the webpage can be accurately monitored by using the preset monitoring script, and updated webpage data can be timely obtained, so that real-time monitoring of the target webpage can be realized, and related personnel can timely know the webpage update information and obtain the latest webpage data.
Description
Technical Field
The present invention relates to the field of communications, and in particular, to a method, an apparatus, a device, and a storage medium for web page monitoring.
Background
When the page performance data is monitored, an application performance management automation monitoring product can be adopted, wherein the traditional application performance management (Application Performance Management, APM) automation monitoring product can only capture the performance data of which the default first screen content loading is completed for the page to which the lazy loading technology is applied, the follow-up elements are placeholders, and the monitoring of the webpage is not comprehensive enough.
Therefore, how to accurately monitor the change of the web page and timely acquire the updated page data by using the preset monitoring script is a current urgent problem to be solved.
Disclosure of Invention
The invention provides a webpage monitoring method, device, equipment and storage medium, which can accurately monitor the change of a webpage and timely acquire updated webpage data by utilizing a preset monitoring script, thereby realizing the real-time monitoring of a target webpage, and being beneficial to relevant personnel to timely know the webpage updating information and acquire the latest webpage data.
According to an aspect of the present invention, there is provided a web page monitoring method, including:
responding to a monitoring request of a target webpage, determining first webpage content at the current moment, and carrying out integrity check on the first webpage content;
if the verification is passed, determining a target monitoring moment, and adopting a preset monitoring script to acquire contents of a target webpage at the target monitoring moment so as to determine second contents of the webpage;
and determining whether the target webpage changes according to the first webpage content and the second webpage content so as to monitor the target webpage.
Optionally, determining the first content of the web page at the current moment includes:
based on a preset page scrolling screenshot tool, screenshot is carried out on a target webpage at the current moment so as to obtain a target image;
and identifying the target image by adopting a preset image identification algorithm, and obtaining the first content of the webpage at the current moment according to the identification result.
Optionally, the integrity checking of the first content of the web page includes:
determining the bottom characteristic of the current webpage from the first content of the webpage;
determining target similarity between the current webpage bottom feature and the expected webpage bottom feature based on a preset similarity measurement algorithm;
and generating an integrity check result of the first content of the webpage according to the size relation between the target similarity and a preset similarity threshold.
Optionally, generating an integrity check result of the first content of the web page according to the size relation between the target similarity and a preset similarity threshold value includes:
and if the target similarity is larger than a preset similarity threshold, determining that the integrity check result of the first content of the webpage is passing the check.
Optionally, determining the target monitoring time includes:
determining a preset number of target monitoring moments from the current moment based on a preset monitoring period and a preset number; and/or
If an operation request to a target webpage is detected from the current moment, determining the moment of responding to the operation request as a target monitoring moment.
Optionally, the content acquisition is performed on the target web page at the target monitoring time by adopting a preset monitoring script to determine the second content of the web page, including:
loading a preset monitoring script at the front end of the webpage;
and acquiring the content of the webpage data of the front-end target webpage in real time through a preset monitoring script, and feeding back the webpage data to the background to determine the second content of the webpage.
Optionally, after determining whether the target web page changes, the method further includes:
if the target webpage is determined to be changed, grouping the data of the second content of the webpage, and determining the category of each group of data; the categories are conventional values, important values and non-important values;
and according to the category, classifying and storing the second content of the webpage.
According to another aspect of the present invention, there is provided a web page monitoring apparatus, including:
the verification module is used for responding to the monitoring request of the target webpage, determining the first webpage content at the current moment and carrying out integrity verification on the first webpage content;
the determining module is used for determining the target monitoring time if the verification is passed, adopting a preset monitoring script, and collecting the content of the target webpage at the target monitoring time to determine the second content of the webpage;
and the monitoring module is used for determining whether the target webpage changes according to the first webpage content and the second webpage content so as to monitor the target webpage.
According to another aspect of the present invention, there is provided an electronic apparatus including:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores a computer program executable by the at least one processor to enable the at least one processor to perform the web page monitoring method according to any one of the embodiments of the present invention.
According to another aspect of the present invention, there is provided a computer readable storage medium storing computer instructions for causing a processor to execute a web page monitoring method according to any embodiment of the present invention.
According to the technical scheme, the first content of the webpage at the current moment is determined in response to the monitoring request of the target webpage, and the integrity check is carried out on the first content of the webpage; if the verification is passed, determining a target monitoring moment, and adopting a preset monitoring script to acquire contents of a target webpage at the target monitoring moment so as to determine second contents of the webpage; and determining whether the target webpage changes according to the first webpage content and the second webpage content so as to monitor the target webpage. By means of the method, the change of the webpage can be accurately monitored by using the preset monitoring script, updated webpage data can be timely obtained, real-time monitoring of the target webpage can be achieved, and relevant personnel can timely know the webpage update information and timely obtain the latest webpage data.
It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the invention or to delineate the scope of the invention. Other features of the present invention will become apparent from the description that follows.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for the description of the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flowchart of a method for monitoring web pages according to an embodiment of the present invention;
FIG. 2 is a flowchart of a web page monitoring method according to a second embodiment of the present invention;
fig. 3 is a block diagram of a web page monitoring device according to a third embodiment of the present invention;
fig. 4 is a schematic structural diagram of an electronic device according to a fourth embodiment of the present invention.
Detailed Description
In order that those skilled in the art will better understand the present invention, a technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in which it is apparent that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present invention without making any inventive effort, shall fall within the scope of the present invention.
It should be noted that the terms "first," "second," "target," "candidate," "alternative," and the like in the description and claims of the invention and in the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the invention described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
It should be noted that, by monitoring the web page content, the performance of the page can be better estimated, when the performance data of the page is monitored, an application performance management automation monitoring product can be adopted, wherein the traditional application performance management (Application Performance Management, APM) automation monitoring product can only capture the performance data completed by the default first screen content loading for the page to which the Lazy load (Lazy load) technology is applied, and the subsequent elements are placeholders, so that the complete performance data of the page cannot be obtained.
In the related art, the manner of determining the web page content is: the invention provides a new webpage monitoring scheme, which is characterized in that a monitoring client receives a monitoring task, accesses a webpage based on an address carried in the monitoring task, when the monitoring task carries an automatic page scrolling instruction, the accessed webpage is scrolled and displayed, and in the scrolling and displaying process, performance data of resources newly appear in a visual area of the monitoring webpage are loaded together with a webpage response message until the webpage scrolls to the bottom of the webpage, namely, the monitoring client automatically scrolls and displays the webpage based on the monitoring task, and in the scrolling process, the performance data of the resources newly appear in the visual area of the webpage are detected, so that complete data of the webpage are obtained, but the tool simulation test deviates from the real situation to a certain extent, sometimes the fluctuation situation of the performance cannot be reflected, the real webpage data cannot be obtained in real time from the front end.
Example 1
FIG. 1 is a flowchart of a method for monitoring web pages according to an embodiment of the present invention; the method is suitable for real-time monitoring of content changes of the webpage and recording of the change conditions, and can be executed by a webpage monitoring device which can be realized in a software and/or hardware mode and can be integrated in electronic equipment with a webpage monitoring function, such as terminal equipment with a browser kernel. As shown in fig. 1, the method includes:
s101, responding to a monitoring request of a target webpage, determining first webpage content at the current moment, and carrying out integrity check on the first webpage content.
The target webpage is a webpage for monitoring a target. The monitoring request refers to a request for monitoring the web content change condition of the target web page. The first content of the webpage refers to the webpage content of the target webpage at the current moment.
Optionally, determining the first content of the web page at the current moment includes: based on a preset page scrolling screenshot tool, screenshot is carried out on a target webpage at the current moment so as to obtain a target image; and identifying the target image by adopting a preset image identification algorithm, and obtaining the first content of the webpage at the current moment according to the identification result.
Optionally, the integrity check of the first content of the web page includes: determining the bottom characteristic of the current webpage from the first content of the webpage; determining target similarity between the current webpage bottom feature and the expected webpage bottom feature based on a preset similarity measurement algorithm; and generating an integrity check result of the first content of the webpage according to the size relation between the target similarity and the preset similarity threshold.
Optionally, generating the integrity check result of the first content of the web page according to the size relation between the target similarity and the preset similarity threshold value includes: if the target similarity is larger than a preset similarity threshold, determining that the integrity check result of the first content of the webpage is passing the check.
Optionally, if the integrity check result of the first content of the web page is that the check is not passed, the page information of the web page can be obtained again, and the first content of the web page is updated.
And S102, if the verification is passed, determining a target monitoring moment, adopting a preset monitoring script, and collecting contents of the target webpage at the target monitoring moment to determine second contents of the webpage.
The preset monitoring script may include a download time monitoring script, a DNS resolution time monitoring script, a TCP connection time monitoring script, an HTTP request time monitoring script, an HTTP response time monitoring script, a page rendering time monitoring script, and other web page performance monitoring scripts.
Optionally, determining the target monitoring time includes: determining a preset number of target monitoring moments from the current moment based on a preset monitoring period and a preset number; and/or from the current moment, if the operation request to the target webpage is detected, determining the moment responding to the operation request as the target monitoring moment.
Optionally, the web page data may be monitored periodically in a fixed period of time, that is, from the current time, a preset number of target monitoring times are determined; or when detecting the operation request to the target webpage, loading a preset monitoring script and a corresponding page response message at the front end of the webpage, determining the moment of responding to the operation request as the target monitoring moment, and finally acquiring the performance data of the front end webpage in real time through the monitoring script to obtain the second content of the webpage and feeding back to the background.
Optionally, the preset number of target monitoring moments may be determined based on a preset monitoring period and a preset number, from the current moment, further, when an operation request for the target web page is detected, whether the detection moment belongs to the determined preset number of target monitoring moments is determined, if yes, the determined preset number of target monitoring moments are directly determined as final target monitoring moments, and if no, the moment when the operation request for the target web page is detected is integrated with the determined preset number of target monitoring moments, so as to determine the final target monitoring moments.
Optionally, the content acquisition is performed on the target web page at the target monitoring time by adopting a preset monitoring script to determine the second content of the web page, including: loading a preset monitoring script at the front end of the webpage; and acquiring the content of the webpage data of the front-end target webpage in real time through a preset monitoring script, and feeding back the webpage data to the background to determine the second content of the webpage.
S103, determining whether the target webpage changes according to the first webpage content and the second webpage content so as to monitor the target webpage.
Optionally, the deviation between the first content of the web page and the second content of the web page may be determined based on a preset rule, and whether the deviation exceeds a threshold value is determined, if yes, the target web page is determined to change, a preset script is further started, the web page data at the current moment is obtained, and classification storage is performed.
Specifically, after determining whether the target web page changes, the method further includes: if the target webpage is determined to be changed, grouping the data of the second content of the webpage, and determining the category of each group of data; the categories are regular, important and non-important values; and storing the second content of the webpage in a classified manner according to the category.
Illustratively, the conventional value may be a download time, the important data may be an interface rendering time, and the non-important data may be a DNS resolution time.
Alternatively, the conventional data may be subjected to a hiding process, the important data may be subjected to a special display process, and the non-important data may be directly stored in a third party and periodically deleted.
According to the technical scheme, the first content of the webpage at the current moment is determined in response to the monitoring request of the target webpage, and the integrity check is carried out on the first content of the webpage; if the verification is passed, determining a target monitoring moment, and adopting a preset monitoring script to acquire contents of a target webpage at the target monitoring moment so as to determine second contents of the webpage; and determining whether the target webpage changes according to the first webpage content and the second webpage content so as to monitor the target webpage. By means of the method, the change of the webpage can be accurately monitored by using the preset monitoring script, updated webpage data can be timely obtained, real-time monitoring of the target webpage can be achieved, and relevant personnel can timely know the webpage update information and timely obtain the latest webpage data.
Example two
FIG. 2 is a flowchart of a web page monitoring method according to a second embodiment of the present invention; the present embodiment provides a preferred example of web page monitoring based on the above embodiments.
As shown in fig. 2, the method may include the following process:
s201, responding to a monitoring request of the target webpage, and based on a preset webpage scrolling screenshot tool, screenshot is conducted on the target webpage at the current moment to obtain a target image.
S202, a target image is identified by adopting a preset image identification algorithm, and the first content of the webpage at the current moment is obtained according to the identification result.
S203, determining the bottom characteristics of the current webpage from the first content of the webpage.
S204, determining the target similarity between the current webpage bottom feature and the expected webpage bottom feature based on a preset similarity measurement algorithm.
S205, generating an integrity check result of the first content of the webpage according to the size relation between the target similarity and a preset similarity threshold.
S206, if the verification is passed, determining the moment of responding to the operation request as the target monitoring moment when the operation request to the target webpage is detected from the current moment.
S207, loading a preset monitoring script at the front end of the webpage; and acquiring the content of the webpage data of the front-end target webpage in real time through a preset monitoring script, and feeding back the webpage data to the background to determine the second content of the webpage.
S208, determining whether the target webpage changes according to the first webpage content and the second webpage content so as to monitor the target webpage.
S209, if the target webpage is determined to be changed, grouping the data of the second content of the webpage, determining the category of each group of data, and storing the second content of the webpage in a classified manner according to the category.
According to the technical scheme, the first content of the webpage at the current moment is determined in response to the monitoring request of the target webpage, and the integrity check is carried out on the first content of the webpage; if the verification is passed, determining a target monitoring moment, and adopting a preset monitoring script to acquire contents of a target webpage at the target monitoring moment so as to determine second contents of the webpage; and determining whether the target webpage changes according to the first webpage content and the second webpage content so as to monitor the target webpage. By means of the method, the change of the webpage can be accurately monitored by using the preset monitoring script, updated webpage data can be timely obtained, real-time monitoring of the target webpage can be achieved, and relevant personnel can timely know the webpage update information and timely obtain the latest webpage data.
Example III
Fig. 3 is a block diagram of a web page monitoring device according to a third embodiment of the present invention; the embodiment can be suitable for real-time monitoring of the content change of the webpage and recording of the change condition, and the webpage monitoring device can be realized in a hardware and/or software mode and is configured in equipment with a webpage monitoring function. As shown in fig. 3, the web page monitoring device specifically includes:
the verification module 301 is configured to determine a first content of a web page at a current moment in response to a monitoring request for a target web page, and perform integrity verification on the first content of the web page;
the determining module 302 is configured to determine a target monitoring time if the verification passes, and perform content acquisition on the target webpage at the target monitoring time by adopting a preset monitoring script to determine second content of the webpage;
and the monitoring module 303 is configured to determine whether the target web page changes according to the first web page content and the second web page content, so as to monitor the target web page.
According to the technical scheme, the first content of the webpage at the current moment is determined in response to the monitoring request of the target webpage, and the integrity check is carried out on the first content of the webpage; if the verification is passed, determining a target monitoring moment, and adopting a preset monitoring script to acquire contents of a target webpage at the target monitoring moment so as to determine second contents of the webpage; and determining whether the target webpage changes according to the first webpage content and the second webpage content so as to monitor the target webpage. By means of the method, the change of the webpage can be accurately monitored by using the preset monitoring script, updated webpage data can be timely obtained, real-time monitoring of the target webpage can be achieved, and relevant personnel can timely know the webpage update information and timely obtain the latest webpage data.
Further, the verification module 301 is specifically configured to:
based on a preset page scrolling screenshot tool, screenshot is carried out on a target webpage at the current moment so as to obtain a target image;
and identifying the target image by adopting a preset image identification algorithm, and obtaining the first content of the webpage at the current moment according to the identification result.
Further, the verification module 301 further includes:
the feature determining unit is used for determining the bottom feature of the current webpage from the first content of the webpage;
the similarity determining unit is used for determining target similarity between the current webpage bottom feature and the expected webpage bottom feature based on a preset similarity measurement algorithm;
and the verification unit is used for generating an integrity verification result of the first content of the webpage according to the size relation between the target similarity and a preset similarity threshold.
Further, the verification unit is specifically configured to:
and if the target similarity is larger than a preset similarity threshold, determining that the integrity check result of the first content of the webpage is passing the check.
Further, the determining module 302 is specifically configured to:
determining a preset number of target monitoring moments from the current moment based on a preset monitoring period and a preset number; and/or
If an operation request to a target webpage is detected from the current moment, determining the moment of responding to the operation request as a target monitoring moment.
Further, the determining module 302 is further configured to:
loading a preset monitoring script at the front end of the webpage;
and acquiring the content of the webpage data of the front-end target webpage in real time through a preset monitoring script, and feeding back the webpage data to the background to determine the second content of the webpage.
Further, the device is also used for:
if the target webpage is determined to be changed, grouping the data of the second content of the webpage, and determining the category of each group of data; the categories are conventional values, important values and non-important values;
and according to the category, classifying and storing the second content of the webpage.
Example IV
Fig. 4 is a schematic structural diagram of an electronic device according to a fourth embodiment of the present invention. Fig. 4 shows a schematic diagram of the structure of an electronic device 10 that may be used to implement an embodiment of the invention. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. Electronic equipment may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the inventions described and/or claimed herein.
As shown in fig. 4, the electronic device 10 includes at least one processor 11, and a memory, such as a Read Only Memory (ROM) 12, a Random Access Memory (RAM) 13, etc., communicatively connected to the at least one processor 11, in which the memory stores a computer program executable by the at least one processor, and the processor 11 may perform various appropriate actions and processes according to the computer program stored in the Read Only Memory (ROM) 12 or the computer program loaded from the storage unit 18 into the Random Access Memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 may also be stored. The processor 11, the ROM 12 and the RAM 13 are connected to each other via a bus 14. An input/output (I/O) interface 15 is also connected to bus 14.
Various components in the electronic device 10 are connected to the I/O interface 15, including: an input unit 16 such as a keyboard, a mouse, etc.; an output unit 17 such as various types of displays, speakers, and the like; a storage unit 18 such as a magnetic disk, an optical disk, or the like; and a communication unit 19 such as a network card, modem, wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information/data with other devices via a computer network, such as the internet, and/or various telecommunication networks.
The processor 11 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of processor 11 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various processors running machine learning model algorithms, digital Signal Processors (DSPs), and any suitable processor, controller, microcontroller, etc. The processor 11 performs the various methods and processes described above, such as the web page monitoring method.
In some embodiments, the web page monitoring method may be implemented as a computer program tangibly embodied on a computer-readable storage medium, such as storage unit 18. In some embodiments, part or all of the computer program may be loaded and/or installed onto the electronic device 10 via the ROM 12 and/or the communication unit 19. One or more of the steps of the web page monitoring method described above may be performed when the computer program is loaded into RAM 13 and executed by processor 11. Alternatively, in other embodiments, the processor 11 may be configured to perform the web page monitoring method in any other suitable manner (e.g., by means of firmware).
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuit systems, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), systems On Chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.
A computer program for carrying out methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the computer programs, when executed by the processor, cause the functions/acts specified in the flowchart and/or block diagram block or blocks to be implemented. The computer program may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of the present invention, a computer-readable storage medium may be a tangible medium that can contain, or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. The computer readable storage medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. Alternatively, the computer readable storage medium may be a machine readable signal medium. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) through which a user can provide input to the electronic device. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), blockchain networks, and the internet.
The computing system may include clients and servers. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also called a cloud computing server or a cloud host, and is a host product in a cloud computing service system, so that the defects of high management difficulty and weak service expansibility in the traditional physical hosts and VPS service are overcome.
It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps described in the present invention may be performed in parallel, sequentially, or in a different order, so long as the desired results of the technical solution of the present invention are achieved, and the present invention is not limited herein.
The above embodiments do not limit the scope of the present invention. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives are possible, depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the scope of the present invention.
Claims (10)
1. A web page monitoring method, comprising:
responding to a monitoring request of a target webpage, determining first webpage content at the current moment, and carrying out integrity check on the first webpage content;
if the verification is passed, determining a target monitoring moment, and adopting a preset monitoring script to acquire contents of a target webpage at the target monitoring moment so as to determine second contents of the webpage;
and determining whether the target webpage changes according to the first webpage content and the second webpage content so as to monitor the target webpage.
2. The method of claim 1, wherein determining the first content of the web page at the current time comprises:
based on a preset page scrolling screenshot tool, screenshot is carried out on a target webpage at the current moment so as to obtain a target image;
and identifying the target image by adopting a preset image identification algorithm, and obtaining the first content of the webpage at the current moment according to the identification result.
3. The method of claim 1, wherein performing integrity check on the first content of the web page comprises:
determining the bottom characteristic of the current webpage from the first content of the webpage;
determining target similarity between the current webpage bottom feature and the expected webpage bottom feature based on a preset similarity measurement algorithm;
and generating an integrity check result of the first content of the webpage according to the size relation between the target similarity and a preset similarity threshold.
4. The method of claim 3, wherein generating the integrity check result of the first content of the web page according to the magnitude relation between the target similarity and the preset similarity threshold comprises:
and if the target similarity is larger than a preset similarity threshold, determining that the integrity check result of the first content of the webpage is passing the check.
5. The method of claim 1, wherein determining a target monitoring time comprises:
determining a preset number of target monitoring moments from the current moment based on a preset monitoring period and a preset number; and/or
If an operation request to a target webpage is detected from the current moment, determining the moment of responding to the operation request as a target monitoring moment.
6. The method of claim 1, wherein the content capturing of the target web page at the target monitoring time using the preset monitoring script to determine the second content of the web page comprises:
loading a preset monitoring script at the front end of the webpage;
and acquiring the content of the webpage data of the front-end target webpage in real time through a preset monitoring script, and feeding back the webpage data to the background to determine the second content of the webpage.
7. The method of claim 1, wherein after determining whether the target web page has changed, further comprising:
if the target webpage is determined to be changed, grouping the data of the second content of the webpage, and determining the category of each group of data; the categories are conventional values, important values and non-important values;
and according to the category, classifying and storing the second content of the webpage.
8. A web page monitoring device, comprising:
the verification module is used for responding to the monitoring request of the target webpage, determining the first webpage content at the current moment and carrying out integrity verification on the first webpage content;
the determining module is used for determining the target monitoring time if the verification is passed, adopting a preset monitoring script, and collecting the content of the target webpage at the target monitoring time to determine the second content of the webpage;
and the monitoring module is used for determining whether the target webpage changes according to the first webpage content and the second webpage content so as to monitor the target webpage.
9. An electronic device, the electronic device comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores a computer program executable by the at least one processor to enable the at least one processor to perform the web page monitoring method of any one of claims 1-7.
10. A computer readable storage medium storing computer instructions for causing a processor to implement the web page monitoring method of any one of claims 1-7 when executed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311311699.9A CN117271289A (en) | 2023-10-10 | 2023-10-10 | Webpage monitoring method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311311699.9A CN117271289A (en) | 2023-10-10 | 2023-10-10 | Webpage monitoring method, device, equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117271289A true CN117271289A (en) | 2023-12-22 |
Family
ID=89214166
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311311699.9A Pending CN117271289A (en) | 2023-10-10 | 2023-10-10 | Webpage monitoring method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117271289A (en) |
-
2023
- 2023-10-10 CN CN202311311699.9A patent/CN117271289A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112559086B (en) | Applet page rendering method and device, electronic equipment and readable storage medium | |
| CN112857268B (en) | Object area measuring method, device, electronic equipment and storage medium | |
| CN114428677B (en) | Task processing method, processing device, electronic equipment and storage medium | |
| CN116545905A (en) | Service health detection method and device, electronic equipment and storage medium | |
| CN113596011B (en) | Flow identification method and device, computing device and medium | |
| CN117271289A (en) | Webpage monitoring method, device, equipment and storage medium | |
| CN115437961A (en) | Data processing method and device, electronic equipment and storage medium | |
| CN114706610A (en) | Business flow chart generation method, device, equipment and storage medium | |
| CN114693116A (en) | Method and device for detecting code review validity and electronic equipment | |
| CN114780550A (en) | Automatic updating method, device, equipment and medium for element positioning path | |
| CN115361308B (en) | Industrial control network data risk determination method, device, equipment and storage medium | |
| CN113239296B (en) | Method, device, equipment and medium for displaying small program | |
| CN114511535A (en) | White screen detection method and device, electronic equipment, medium and product | |
| CN114782383A (en) | Webpage quality monitoring method, device, equipment and storage medium | |
| CN117806764A (en) | Data collection method, device, equipment and storage medium of user interface | |
| CN115904899A (en) | Operation record generation method, operation record acquisition method, operation record generation device, operation record acquisition device and operation record acquisition medium | |
| CN116303071A (en) | Interface testing method and device, electronic equipment and storage medium | |
| CN117290179A (en) | Method, device, equipment and storage medium for determining event timeout state | |
| CN117576077A (en) | Defect detection method, device, equipment and storage medium | |
| CN116225941A (en) | Page detection method and device, electronic equipment and storage medium | |
| CN116028228A (en) | Bitmap memory occupation detection method, device, equipment and storage medium | |
| CN116975653A (en) | Sample information determining method and device, electronic equipment and storage medium | |
| CN114399333A (en) | Method, device, equipment and storage medium for detecting medium information releasing effect | |
| CN118210670A (en) | Log abnormality detection method and device, electronic equipment and storage medium | |
| CN117216066A (en) | Material code generation method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |