CN107528818B

CN107528818B - Data processing method and device for media file

Info

Publication number: CN107528818B
Application number: CN201610856322.5A
Authority: CN
Inventors: 赫阳; 高翔宇; 徐伟
Original assignee: Tencent Technology Beijing Co Ltd
Current assignee: Tencent Technology Beijing Co Ltd
Priority date: 2016-09-27
Filing date: 2016-09-27
Publication date: 2019-12-06
Anticipated expiration: 2036-09-27
Also published as: CN107528818A

Abstract

The invention discloses a data processing method and device for a media file. Wherein, the method comprises the following steps: receiving a request message, wherein the request message is used for requesting to monitor a landing page of a target media file, the request message carries monitoring parameters for monitoring the landing page of the target media file, and the landing page is a page loaded after a click operation is performed on a playing interface of the target media file when the target media file is played; generating a routing key according to the monitoring parameters, wherein the routing key is a character string formed according to a preset format; sending the request message to a target message queue corresponding to the type of the request message according to the routing key; and monitoring the landing page of the target media file according to the request message through the target monitoring node corresponding to the target message queue to obtain a monitoring result. The invention solves the technical problem of low monitoring efficiency of the landing page of the media file in the related technology.

Description

Data processing method and device for media file

Technical Field

The invention relates to the field of data processing, in particular to a data processing method and device for a media file.

Background

At present, with the development of internet advertisements, more and more traditional small advertisers are also transferred from off-line to on-line, and various false, pornographic, violent and other media files are generated along with the development of the internet advertisements. Meanwhile, in the case where the media files comply with the national laws, they are also required to be able to release various media files strictly according to various release rules and restrictions established inside the media file platform.

The existing various rules require that auditors need to check media files one by one before the media files are on line, and most of the media files have directional platforms (IOS, android) and directional cities, so that the auditors need to macroscopically grasp the landing page condition of the media files and need to refine to different platforms and different cities to check the security condition of the media files. The method can still cope when the order number of the media files is small, and when the order number of the media files is large, the missing situation caused by the drop page putting of each media file is inevitable, the drop page accuracy of media file monitoring and the safety of the drop page of the put media file are difficult to guarantee, so that the monitoring efficiency of the media files is low.

Aiming at the problem of low efficiency of monitoring landing pages of media files in the related art, no effective solution is provided at present.

Disclosure of Invention

The embodiment of the invention provides a data processing method and a data processing device for a media file, which are used for at least solving the technical problem of low efficiency of monitoring landing pages of the media file in the related art.

according to an aspect of an embodiment of the present invention, a data processing method for a media file is provided. The data processing method of the media file comprises the following steps: receiving a request message, wherein the request message is used for requesting to monitor a landing page of a target media file, the request message carries monitoring parameters for monitoring the landing page of the target media file, and the landing page is a page loaded after a click operation is performed on a playing interface of the target media file when the target media file is played; generating a routing key according to the monitoring parameters, wherein the routing key is a character string formed according to a preset format; sending the request message to a target message queue corresponding to the type of the request message according to the routing key; and monitoring the landing page of the target media file according to the request message through the target monitoring node corresponding to the target message queue to obtain a monitoring result.

According to another aspect of the embodiment of the invention, a data processing device of the media file is also provided. The data processing device of the media file comprises: the first receiving unit is used for receiving a request message, wherein the request message is used for requesting to monitor a landing page of a target media file, the request message carries monitoring parameters for monitoring the landing page of the target media file, and the landing page is a page loaded after a click operation is executed on a playing interface of the target media file when the target media file is played; the generating unit is used for generating a routing key according to the monitoring parameters, wherein the routing key is a character string formed according to a preset format; the sending unit is used for sending the request message to a target message queue corresponding to the type of the request message according to the routing key; and the monitoring unit is used for monitoring the landing page of the target media file according to the request message through the target monitoring node corresponding to the target message queue to obtain a monitoring result.

In the embodiment of the invention, a request message is received, wherein the request message is used for requesting to monitor the landing page of a target media file, the request message carries monitoring parameters for monitoring the landing page of the target media file, and the landing page is a page loaded after a click operation is executed on a playing interface of the target media file when the target media file is played; generating a routing key according to the monitoring parameters, wherein the routing key is a character string formed according to a preset format; sending the request message to a target message queue corresponding to the type of the request message according to the routing key; the target monitoring node corresponding to the target message queue monitors the landing page of the target media file according to the request message to obtain a monitoring result, and the purpose of monitoring the target media file is achieved, so that the technical effect of improving the monitoring efficiency of the media file is achieved, and the technical problem of low monitoring efficiency of the landing page of the media file in the related technology is solved.

Drawings

the accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:

FIG. 1 is a diagram of a hardware environment for a data processing method of a media file according to an embodiment of the present invention;

FIG. 2 is a flowchart of a data processing method of a media file according to an embodiment of the present invention;

FIG. 3 is a flowchart of another data processing method of a media file according to an embodiment of the present invention;

FIG. 4 is a flowchart of a method for monitoring landing pages of a target media file according to a request message by a target monitoring node corresponding to a target message queue according to an embodiment of the present invention;

Fig. 5 is a flowchart of another method for monitoring landing pages of a target media file according to a request message by a target monitoring node corresponding to a target message queue according to an embodiment of the present invention;

Fig. 6 is a flowchart of another method for monitoring landing pages of a target media file according to a request message by a target monitoring node corresponding to a target message queue according to an embodiment of the present invention;

FIG. 7 is a flowchart illustrating a method for processing data of a media file according to an embodiment of the present invention;

FIG. 8 is a schematic illustration of a data processing page of a media file according to an embodiment of the invention;

FIG. 9 is a schematic diagram of another data processing page of a media file according to an embodiment of the invention;

FIG. 10 is a diagram illustrating a data processing procedure for a media file according to an embodiment of the present invention;

FIG. 11 is a schematic diagram of another data processing page of a media file according to an embodiment of the invention;

FIG. 12 is a schematic diagram of a data processing apparatus for media files according to an embodiment of the present invention;

FIG. 13 is a schematic diagram of another data processing apparatus for media files according to an embodiment of the present invention;

FIG. 14 is a schematic diagram of another data processing apparatus for media files according to an embodiment of the present invention;

FIG. 15 is a schematic diagram of a data processing apparatus for media files according to an embodiment of the present invention;

FIG. 16 is a schematic diagram of a data processing apparatus for media files according to an embodiment of the present invention; and

fig. 17 is a block diagram of a terminal according to an embodiment of the present invention.

Detailed Description

in order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

Example 1

According to an embodiment of the present invention, an embodiment of a data processing method for a media file is provided.

Alternatively, in the present embodiment, the data processing method of the media file may be applied to a hardware environment formed by the server 102 and the terminal 104 as shown in fig. 1. Fig. 1 is a schematic diagram of a hardware environment of a data processing method of a media file according to an embodiment of the present invention. As shown in fig. 1, a server 102 is connected to a terminal 104 via a network including, but not limited to: the terminal 104 is not limited to a PC, a mobile phone, a tablet computer, etc. in a wide area network, a metropolitan area network, or a local area network. The data processing method of the media file according to the embodiment of the present invention may be executed by the server 102, or executed by the terminal 104, or executed by both the server 102 and the terminal 104. The data processing method for the media file executed by the terminal 104 according to the embodiment of the present invention may also be executed by a client installed thereon.

Fig. 2 is a flowchart of a data processing method of a media file according to an embodiment of the present invention. As shown in fig. 2, the data processing method of the media file may include the steps of:

step S202, receiving a request message.

In the technical solution provided in step S202 of the present invention, a request message is received, where the request message is used to request to monitor a landing page of a target media file, the request message carries monitoring parameters for monitoring the landing page of the target media file, and the landing page is a page loaded after a click operation is performed on a play interface of the target media file when the target media file is played.

The receiving request message may be a request message sent by a receiving order delivery channel. When the target media file is an advertisement, the order of the order delivery channel is an advertisement resource delivered by an advertiser, the system distributes a unique ID number, and the unique ID number distributed by the system is used for identifying the uniqueness of the target media file. The landing page is a page loaded after a click operation is performed on a playing interface of the target media file when the target media file is played, and may be a page loaded after a click operation is performed on the target media file when the target media file is played, for example, a web page loaded after a user clicks an advertisement delivered by an advertiser. The landing pages of different platforms are different, and the strategy for opening the landing pages in different regions is also different, for example, the strategy for skipping to the landing pages in different cities is different. The landing page has Uniform Resource Locator (URL) data for determining an access position and an access method of the landing page. The request message carries monitoring parameters for monitoring landing pages of the target media file, wherein the monitoring parameters comprise a channel type for delivering the target media file, an ID (identity) of the target media file and a system type of a monitoring system for monitoring the target media file, the system type can be an IOS (internet of things) system, an Android (Android) system and the like, and therefore the landing pages of the target media file are monitored through the monitoring parameters.

optionally, the request message is received by a receiving process of the monitoring platform.

it should be noted that, in the embodiment of the present invention, the type of the media file delivered by the server is not specifically limited, and the media file delivered by the server may be a video file, an audio file, a picture file, or a text file, and the like, or may be any combination of these files, for example, a combination of a text file and a picture file, and a combination of a video file and a text file. The specific product modality may be, for example, a video advertisement, a native advertisement, a search advertisement, and the like.

And step S204, generating a routing key according to the monitoring parameters.

In the technical solution provided by step S204 of the present invention, a routing key is generated according to the monitoring parameter, wherein the routing key is a character string composed according to a preset format.

the request message carries monitoring parameters for monitoring the landing page of the target media file, and after receiving the request message, a Routing Key (Routing Key) is generated according to the monitoring parameters, for example, the Routing Key is generated according to parameters such as a channel type of the target media file, an ID of the target media file, a system type of a monitoring system for monitoring the landing page of the target media file, and the like. The routing key has a preset format and can be three character strings connected together through ". The first character string is used for representing the system type applicable to the monitoring platform, including an IOS type, an Android (Android) type, a Mobile (Mobile) type and All (All) types, the second character string is used for representing the channel corresponding to the sending request message, such as a wisdom sink (snswin) and a conventional brand order channel (ads5), and the third character string is used for representing whether the order of the target media file is a download-type order.

step S206, the request message is sent to the target message queue corresponding to the type of the request message according to the routing key.

In the technical solution provided by step S206 of the present invention, the request message is sent to the target message queue corresponding to the type of the request message according to the routing key.

After generating a routing key according to the monitoring parameter, sending the request message to a message queue switch (exchange), where the message queue switch is configured to send the request message to a target message queue corresponding to the type of the request message according to the routing key of the request message, where the message queue includes a plurality of message queues, each message queue corresponds to the type of the request message one-to-one, and each request message binds the type of the request message that can be received preferentially when initialized.

Optionally, a message middle key (rabbitmq) is used to perform distribution routing of the task according to the routing key of the landing page of the target media file.

And S208, monitoring the landing page of the target media file according to the request message through the target monitoring node corresponding to the target message queue to obtain a monitoring result.

In the technical solution provided in step S208 of the present invention, the target monitoring node corresponding to the target message queue monitors the landing page of the target media file according to the request message, so as to obtain a monitoring result.

after the request message is sent to the target message queue corresponding to the type of the request message according to the routing key, the target message queue sends the request message to the target monitoring node corresponding to the target queue, and the target monitoring node monitors the landing page of the target media file according to the request message to obtain a monitoring result. The monitoring node monitors the landing page of the target media file through the monitoring module, is used for executing a specific task, can be used for pulling the landing page of the target media file, analyzes the landing page of the target media file, and obtains a monitoring result, wherein the landing page is a webpage loaded by the target media file when receiving a trigger signal. The target monitoring nodes corresponding to the target message queue monitor the landing pages of the target media file according to the request message to obtain a monitoring result, so that the condition that an auditor of the media file checks the landing pages of the target media file one by one before the media file is online due to various rules is avoided, the condition that the auditor needs to macroscopically master the landing pages of the target media file is avoided, different platforms need to be refined, missing monitoring on the media file is avoided, further unsafe media files are prevented from being released, the safety of the released media files is improved, the monitoring speed and the monitoring accuracy of the media files are improved, and the technical effect of improving the monitoring efficiency of the media files is achieved.

Optionally, the target message queue is applied to security monitoring of the media file through a message middleware (rabbitmq), so that the request message can be prevented from being distributed to all monitoring nodes, thereby wasting resources of the message queue and wasting system resources required by the monitoring nodes, the request message can be only distributed to one or more monitoring nodes in the system, and the one or more monitoring nodes in the system consume data of one message queue, thereby realizing monitoring.

Through the steps S202 to S208, a request message is received, where the request message is used to request to monitor a landing page of a target media file, and the request message carries monitoring parameters for monitoring the landing page of the target media file; generating a routing key according to the monitoring parameters, wherein the routing key is a character string formed according to a preset format; sending the request message to a target message queue corresponding to the type of the request message according to the routing key; the target monitoring node corresponding to the target message queue monitors the landing page of the target media file according to the request message to obtain a monitoring result, so that the technical problem of low monitoring efficiency of the related technology on the landing page of the media file can be solved, and the technical effect of improving the monitoring efficiency of the media file is further achieved.

as an optional implementation manner, after monitoring the landing page of the target media file according to the request message by the target monitoring node corresponding to the target message queue, caching the monitoring result to a preset cache position, and sending the monitoring result to a target delivery channel through the preset cache position, wherein the target delivery channel is used for delivering the landing page of the target media file according to the monitoring result to obtain a delivery result; and/or storing the monitoring result to a preset storage position to store the monitoring result.

Optionally, the target monitoring node includes a plurality of monitoring nodes, the landing pages of the target media file are monitored by the plurality of monitoring nodes corresponding to the target message queue according to the request message respectively to obtain a plurality of monitoring results, and the plurality of monitoring nodes are scanned to obtain a plurality of monitoring results. And when all the monitoring results are stored to the preset storage position, all the monitoring results of the preset cache position are sent to a target delivery channel through a return process, wherein the target delivery channel, namely, a media file delivery platform and a submission channel are used for delivering landing pages of a target media file according to the monitoring results, and a data source of the landing pages of the target media file is provided.

optionally, after the target monitoring node corresponding to the target message queue monitors the landing page of the target media file according to the request message to obtain the monitoring result, the monitoring result is stored to a preset storage position to store the monitoring result, and the monitoring result can be stored in the database to record the monitoring result, so that subsequent checking and sorting of the monitoring result are facilitated, and the delivery quantity, the delivery content and the like of the media file are determined.

According to the embodiment, after the landing page of the target media file is monitored according to the request message through the target monitoring node corresponding to the target message queue, the monitoring result is cached to the preset cache position, and the monitoring result is sent to the target delivery channel through the preset cache position, wherein the target delivery channel is used for delivering the landing page of the target media file according to the monitoring result to obtain the delivery result; and/or storing the monitoring result to a preset storage position to store the monitoring result, thereby realizing the caching or storage of the monitoring result.

As an optional implementation manner, after the monitoring result is sent to the target delivery channel through the preset storage position, a delivery result obtained by delivering the landing page of the target media file according to the monitoring result by the target delivery channel is received; and storing the releasing result to a preset storage position to store the releasing result.

Fig. 3 is a flowchart of another data processing method of a media file according to an embodiment of the present invention. As shown in fig. 3, the data processing method of the media file further includes the following steps:

Step S301, receiving a delivery result fed back by a target delivery channel.

In the technical solution provided by step S301 of the present invention, a delivery result fed back by the target delivery channel is received, where the delivery result is a delivery result obtained by delivering the landing page of the target media file according to the monitoring result by the target delivery channel.

after the monitoring result is sent to the target delivery channel through the preset storage position, the target delivery channel reads the monitoring result cached by the preset cache position, calls a Common Gateway Interface (CGI) registered by each channel, returns the monitoring result of the landing page of the target media file to the target delivery channel, and can return a plurality of monitoring results of the landing page of the target media file to the target delivery channel in batches. And the target delivery channel delivers the landing page of the target media file according to the monitoring result to obtain a delivery result, and receives the delivery result fed back by the target delivery channel through a feedback process. Optionally, the delivery result can be artificially fed back, and the feedback of the artificial delivery result is received through the feedback process, so that the accuracy of feeding back the delivery result is improved.

step S302, storing the releasing result to a preset storage position to store the releasing result.

In the technical solution provided in the above step S302 of the present invention, the delivery result is stored in a preset storage location to store the delivery result.

After receiving the delivery result fed back by the target delivery channel, storing the delivery result to a preset storage position to store the delivery result, so that the subsequent viewing, sorting and the like of the delivery result are facilitated.

the embodiment receives a delivery result fed back by a target delivery channel after sending a monitoring result to the target delivery channel through a preset storage position, wherein the delivery result is obtained by delivering a landing page of a target media file according to the monitoring result by the target delivery channel; and storing the delivery result to a preset storage position to store the delivery result, so that the purpose that the target delivery channel delivers the delivery result obtained by the landing page of the target media file according to the monitoring result is achieved.

as an optional implementation manner, the request message includes identification information of the target media file and URL data of a landing page of the target media file, and monitoring the landing page of the target media file according to the request message by a target monitoring node corresponding to the target message queue includes: and monitoring the landing page of the target media file through the target monitoring node corresponding to the target message queue according to the identification information and the URL data of the landing page to obtain a monitoring result.

The target delivery channel sends a request message, the request message comprises identification information of a target media file and Uniform Resource Locator (URL) data of a landing page of the target media file, namely, the target delivery channel sends the identification information of the target media file and the URL data of the landing page of the target media file, the identification information of the target media file and the URL data of the landing page of the target media file are put into a system, the target message queue sends the request message to be processed to a monitoring node corresponding to the target message queue, the monitoring node monitors the landing page of the target media file through a corresponding monitoring module according to the identification information and the URL data of the landing page to obtain a monitoring result, the monitoring result is returned to a corresponding delivery channel, and the landing page of the target media file is monitored through the target monitoring node corresponding to the target message queue according to the identification information and the URL data of the landing page, and obtaining a monitoring result, thereby completing the task of scanning the landing page of the target media file once.

as an optional implementation manner, the monitoring, by a target monitoring node corresponding to the target message queue, a landing page of the target media file according to the request message includes: the method comprises the steps of sending a request message to a page with a preset event through a target message queue, scanning the page with the preset event according to the request message to obtain a monitoring result, wherein the monitoring node comprises the page with the preset event, the page with the preset event is associated with a landing page of a target media file, and the purpose of monitoring the landing page of the target media file to obtain the monitoring result can be achieved by scanning the page with the preset event.

As an optional implementation manner, the request message includes an http return code of the target media file, and in step S208, monitoring, by the target monitoring node corresponding to the target message queue, the landing page of the target media file according to the request message includes: judging whether the http return code is in an abnormal state or not through the target monitoring node; and determining that the landing page of the target media file is in a closed state by the number of times that the http return code is in an abnormal state within the preset time.

fig. 4 is a flowchart of a method for monitoring landing pages of a target media file according to a request message by a target monitoring node corresponding to a target message queue according to an embodiment of the present invention. As shown in fig. 4, the method for monitoring landing pages of a target media file according to a request message by a target monitoring node corresponding to a target message queue includes the following steps:

Step S401, an http return code is obtained from the request message through the target monitoring node.

in the technical solution provided by step S401 of the present invention, an http return code is obtained from the request message by the target monitoring node.

the request message comprises an http return code of the target media file, and after the request message is sent to a target message queue corresponding to the type of the request message according to the routing key, the http return code is obtained from the request message through a target monitoring node corresponding to the target message queue. Optionally, the request message is for requesting a web advertisement.

and step S402, judging whether the http return code is in an abnormal state or not through the target monitoring node.

In the technical solution provided by step S402 of the present invention, whether the http return code is in an abnormal state is determined by the target monitoring node.

and after the target monitoring node acquires the http return code from the request message, judging whether the http return code is in an abnormal state or not by the target monitoring node. And judging whether the frequency of the http return code in the abnormal state exceeds the preset frequency or not.

Step S403, determining that the landing page of the target media file is in a closed state.

in the technical solution provided in step S403 of the present invention, if it is determined that the number of times that the http return code is in the abnormal state within the preset time exceeds the preset number of times, it is determined that the landing page of the target media file is in the closed state.

After the target monitoring node judges whether the http return code is in the abnormal state, if the number of times that the http return code is in the abnormal state in the preset time exceeds the preset number of times, determining that the landing page of the target media file is in the closed state, namely determining that the webpage corresponding to the landing page of the target media file cannot be opened.

Optionally, for the http return code being recorded to be in an abnormal state when the http return code is greater than 400, and in order to eliminate the influence caused by network instability at the capture time, if the number of times that the system monitors that the http return code is in the abnormal state within one day exceeds 3 times, the webpage marking the landing page of the target media file cannot be opened, so that the situation that the media file cannot be opened when the landing page is clicked is avoided, and the user experience is ensured.

In the embodiment, the http return code is obtained from the request message through the target monitoring node; judging whether the http return code is in an abnormal state or not through the target monitoring node; and if the number of times that the http return code is in the abnormal state within the preset time exceeds the preset number of times, determining that the landing page of the target media file is in the closed state, so that the purpose of monitoring the landing page of the target media file according to the request message by the target monitoring node corresponding to the target message queue is realized, and the monitoring efficiency of monitoring the landing page of the target media file is improved.

As an optional implementation manner, the request message includes a web page source code of a landing page of the target media file, and the step S208 of monitoring, according to the request message, the landing page of the target media file by the target monitoring node corresponding to the target message queue includes: matching the webpage source code pulled from the request message with the script for monitoring the IP to obtain a matching result; and performing offline processing on the landing page of the target media file through the matching result.

Fig. 5 is a flowchart of another method for monitoring landing pages of a target media file according to a request message by a target monitoring node corresponding to a target message queue according to an embodiment of the present invention. As shown in fig. 5, the method for monitoring landing pages of a target media file according to a request message by a target monitoring node corresponding to a target message queue includes the following steps:

step S501, a webpage source code is pulled from the request message through the target monitoring node.

In the technical solution provided by step S501 of the present invention, the target monitoring node pulls the web page source code from the request message.

The request message comprises a web page source code of a landing page of the target media file, after the request message is sent to a target message queue corresponding to the type of the request message according to the routing key, the web page source code is pulled from the request message through the target monitoring node, and the web page source code can be pulled through the monitoring program.

And step S502, matching the webpage source code with the script for monitoring the IP to obtain a matching result.

In the technical solution provided by step S502 of the present invention, the source code of the web page is matched with the script for monitoring the IP, so as to obtain a matching result.

After the webpage source code is pulled from the request message through the target monitoring node, the webpage source code is matched with the script for monitoring the IP, and a matching result is obtained. The webpage source code is generally embedded with a script capable of monitoring the IP, the webpage source code is pulled through a monitoring program to perform script matching, if the webpage source code can be matched with the script for monitoring the IP, the webpage source code is determined to have a problem, the delivery of the landing page of the target media file is not qualified, if the webpage source code cannot be matched with the script for monitoring the IP, the webpage source code does not have a problem, and the delivery of the landing page of the target media file is qualified.

In step S503, when the matching result is the result that the script is matched with the web page source code, the offline processing is performed on the landing page of the target media file.

In the technical solution provided by step S503 of the present invention, when the matching result is a result that the source code of the web page matches the script, the offline processing is performed on the landing page of the target media file.

After the webpage source code and the script for monitoring the IP are matched to obtain the matching result, when the matching result is the result that the script is matched with the webpage source code, namely once landing pages are opened in different regions through the script, offline processing can be performed on the landing pages of the target media file, offline processing can be performed on orders of the landing pages of the target media file to achieve offline processing on the landing pages of the target media file, illegal release of the landing pages of the target media file is avoided in time, and safety of the landing pages of the released media file is improved.

The embodiment pulls the webpage source code from the request message through the target monitoring node; matching the webpage source code with a script for monitoring the IP to obtain a matching result; and when the matching result is the result that the script is matched with the webpage source code, performing offline processing on the landing page of the target media file, so that the purpose of monitoring the landing page of the target media file according to the request message through the target monitoring node corresponding to the target message queue is realized, and the technical effect of improving the monitoring efficiency of the landing page of the target media file is further achieved.

As an optional implementation manner, the requesting message includes a message for requesting a first landing page of the target media file, and the step S208 of monitoring, by the target monitoring node corresponding to the target message queue, the landing page of the target media file according to the requesting message includes: and when the first landing page of the target media file has the JS jump code, jumping the first landing page according to the URL address of the first landing page to obtain a second landing page.

Fig. 6 is a flowchart of another method for monitoring landing pages of a target media file according to a request message by a target monitoring node corresponding to a target message queue according to an embodiment of the present invention. As shown in fig. 6, the method for monitoring landing pages of a target media file according to a request message by a target monitoring node corresponding to a target message queue includes the following steps:

Step S601, requesting, by the target monitoring node, a first landing page according to the message for requesting the first landing page of the target media file.

in the technical solution provided by step S601 of the present invention, the target monitoring node requests the first landing page according to the message for requesting the first landing page of the target media file.

And simulating an IOS (input/output) end by a monitoring program of the monitoring node, and requesting a webpage.

Step S602, when the first landing page of the target media file has the JS jump code, the first landing page is jumped according to the URL address of the first landing page to obtain a second landing page.

in the technical solution provided by step S602 in the present invention, it is determined whether the first landing page of the target media file has the JS jump code, and when the first landing page of the target media file has the JS jump code, a webpage jump is performed on the webpage having the JS jump code. Optionally, whether a waiting function exists in the webpage code is monitored, after waiting for a certain time through the waiting function, the URL address of the last jump of the landing page is captured for judgment, and if the jump can be made, it is determined that the landing page for launching the target media file has a problem.

The embodiment requests a first landing page through the target monitoring node according to a message for requesting the first landing page of the target media file; when the first landing page of the target media file has the JS jump code, the first landing page is jumped according to the URL address of the first landing page to obtain the second landing page, so that the purpose of monitoring the landing page of the target media file according to the request message by the target monitoring node corresponding to the target message queue is achieved, and the technical effect of improving the monitoring efficiency of the landing page of the target media file is achieved.

Example 2

The technical solution of the present invention will be described below with reference to preferred embodiments.

the media file safety monitoring platform is mainly used for accessing orders and landing page URL data sent by delivery channels of all media files, and sending request messages to be processed to monitoring modules corresponding to corresponding monitoring nodes through message queues. And after the monitoring node finishes processing the request message, returning the monitoring result to the corresponding target delivery channel, thereby finishing a floor page scanning task of the target media file.

Fig. 7 is a flowchart illustrating a data processing method for a media file according to an embodiment of the present invention. As shown in fig. 7, the data processing method of the media file at least includes a receiving process, a message middleware, a monitoring node, and a returning process, and the data method of the media file may be executed by a security detection platform of the media file, wherein the security detection platform of the media file preferably executes the method contained in the dashed box.

And (3) receiving a process: the CGI is configured to provide a CGI, receive a request message sent by a target delivery channel, that is, invoke the request message sent by an order delivery channel, and distinguish an invocation type through the CGI, where the invocation type includes real-time and timing, that is, request information of a periodic task sent by the order delivery channel is invoked periodically, or request information of a real-time task sent by the order delivery channel is invoked in real time. The receiving process issues the URL of the landing page of the target media file to be monitored according to the calling type. The order delivery channel includes a conventional brand channel, a programmed channel, an intelligent channel, and the like.

message middleware: and performing task distribution routing according to the request message by adopting rabbitmq message middleware. The URL of the landing page of the target media file to be monitored can be received, and a Rabbitmq topic model is adopted to process the URL of the landing page of the target media file to obtain a processing result.

Optionally, for each request message, the receiving process generates a routing key (routing key) for the request message according to the parameters carried in the request message, where the routing key is three character strings connected by ". the first character string is used to indicate a platform to be monitored, such as ios/android/mobile/all, the second character string is used to indicate a channel corresponding to the sent message, such as wisdom sink (snswin)/regular brand order channel (ads5), and the third character string is used to indicate whether the order of the target media file is a download-type order. The receiving process sends the request message to a message queue switch (exchange) which is used for sending the request message to a corresponding message queue according to the routing key of the request message. Wherein, each message queue can bind the type of the request message received by itself preferentially when initializing.

Monitoring nodes: and the different monitoring nodes correspond to different tasks and are used for pulling the landing page in the request message for analysis and writing the monitoring result into a redis cache.

the greatest benefit of applying the rabbitmq message queue to the security monitoring of the media file is that one request message is prevented from being distributed to all monitoring modules, so that the message queue resources are wasted, the system resources required by the monitoring modules are wasted, the data of one message queue is consumed by one or more monitoring nodes in the system through which the request message is distributed, the monitoring is carried out, and the maximum monitoring efficiency of the landing page of the target media file is achieved.

and returning to the process: reading the scanning result of the redis cache record, calling the returned CGI registered by each channel, returning the monitoring result of the landing page to the target delivery channel in batch to inform an external interface of scanning and filling, returning the monitoring result of the landing page to the monitoring result of the target delivery channel in batch, namely returning the monitoring result, returning the monitoring result to the target delivery channel in real time, and returning the monitoring result to the target delivery channel periodically.

The embodiment also receives feedback of the user on the monitoring result through the CGI to obtain a feedback result, and the feedback result is stored to a preset storage position so as to facilitate subsequent checking, reporting and the like of the result.

The embodiment scans pages of yellow gambling poison and the like which violate national laws in real time, and returns monitoring data to websites with gambling, pornography, extortion and the like in real time. FIG. 8 is a schematic diagram of a data processing page of a media file according to an embodiment of the invention. As shown in FIG. 8, the monitoring data for the "Australian Casino" website is returned in real time.

The embodiment requests the media files on the webpage, obtains the return code of the http, records the abnormal return code of the http if the return code of the http is larger than 400, and marks that the webpage cannot be opened if the abnormal return code of the http is monitored for more than 3 times within one day by the system in order to eliminate the influence caused by unstable network at the capturing moment, so that the condition that the clicked landing page of the media files cannot be opened is avoided, and the user experience can be well guaranteed. FIG. 9 is a schematic diagram of another data processing page of a media file according to an embodiment of the invention. As shown in fig. 9, when the system monitors http for return code abnormality more than 3 times within one day, the flag is that the web page cannot be opened, and the reason why "the web page cannot be accessed" is shown as follows: no prompt message for the requested page exists.

This embodiment is also used for zone jump monitoring. The region jump monitoring means that the landing pages are opened differently in different regions. Generally, a script (for example, http:// int. dpool. sina. com. cn/iplookup. php. Fig. 10 is a schematic diagram of a data processing program of a media file according to an embodiment of the present invention. As shown in fig. 10, by using the region monitoring script, one page (normal page) is skipped for the users in beijing and wuhan, and another page is skipped for other cities.

FIG. 11 is a schematic diagram of another data processing page of a media file according to an embodiment of the invention. As shown in fig. 11, the client is induced to promote its product by supposing the name of "news". For the release of the media files which do not meet the requirements, the monitoring platform can accurately identify and stop releasing in time, and due to the fact that the processing speed of the messages is within 1-2 minutes, the order can be timely stopped for problematic orders, loss is reduced, and the media image is maintained. In the illegal release, if the auditor is in the city where the media file belongs and the filtering is selected, no way is available for finding the problem in time, and the data processing method of the media file in the embodiment can effectively make up for the defect.

This embodiment is also used to strictly display landing pages in the form of three thumbnails, a media file, based on the delivery logic of the news client. The monitoring program simulates an ios terminal (setting a user-agent) and requests a webpage. And for webpage skipping by JS skipping codes on the webpage, monitoring whether the webpage codes have waiting functions such as setTimeout and the like. And after waiting for a certain time, capturing the url address of the last hop of the landing page for judgment.

This embodiment is also applicable to other monitoring nodes, such as a pop-up page message group: and analyzing the webpage source codes to find whether the codes for calling the message and adding the group exist.

The embodiment is also used for directly downloading the software installation package by the landing page and judging whether the webpage jump address is an installation package downloading address.

The embodiment is also used for sensitive word monitoring, and whether the source code of the landing page of the real estate advertiser comprises a user interface, an entrance, a employment, a geomantic omen, a promotion value, an investment and a return file or not is monitored for the real estate advertiser. The daily chemical advertising department monitors whether the source code of the landing page of the daily chemical advertising department contains the characters such as 'pure nature' and 'no side effect'.

The embodiment is also used for semantic analysis based on the URL of the advertiser landing page or on the basis of other landing page source codes, and is the same as the method of the embodiment of the invention, and the method is not repeated herein.

According to the embodiment of the invention, under the safety monitoring of the landing page of the target media file, more information needs to be provided for an auditor as far as possible from a technical audit level so that the auditor can timely examine the safety of the landing page of the target media file. For yellow gambling poison, the processing, analysis and feedback conditions of landing pages of different platforms are different, and the jumping landing pages of different cities are different, so that the problem that direct downloading, browser popup windows and other release forms which do not meet the requirements are effectively solved, the manual auditing pressure of the media files is greatly reduced, and the monitoring efficiency of the media files is improved.

it should be noted that the above data processing method for media files can be applied to real-time monitoring of advertisement security, and is not described herein again.

it should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the order of acts, as some steps may occur in other orders or concurrently in accordance with the invention. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required by the invention.

Through the above description of the embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but the former is a better implementation mode in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.

Example 3

according to the embodiment of the invention, the data processing device of the media file is also provided for implementing the data processing method of the media file. Fig. 12 is a schematic diagram of a data processing apparatus for media files according to an embodiment of the present invention. As shown in fig. 12, the data processing apparatus of the media file may include: a first receiving unit 10, a generating unit 20, a transmitting unit 30 and a monitoring unit 40.

The first receiving unit 10 is configured to receive a request message, where the request message is used to request to monitor a landing page of a target media file, the request message carries a monitoring parameter for monitoring the landing page of the target media file, and the landing page is a page loaded after a click operation is performed on a play interface of the target media file when the target media file is played.

And the generating unit 20 is configured to generate a routing key according to the monitoring parameter, where the routing key is a character string composed according to a preset format.

And a sending unit 30, configured to send the request message to a target message queue corresponding to the type of the request message according to the routing key.

And the monitoring unit 40 is used for monitoring the landing page of the target media file according to the request message through the target monitoring node corresponding to the target message queue to obtain a monitoring result.

FIG. 13 is a schematic diagram of another data processing apparatus for media files according to an embodiment of the present invention. As shown in fig. 13, the data processing apparatus of the media file may include: a first receiving unit 10, a generating unit 20, a transmitting unit 30 and a monitoring unit 40. The data processing apparatus of the media file further comprises: a processing unit 50.

It should be noted that the first receiving unit 10, the generating unit 20, the sending unit 30 and the monitoring unit 40 in this embodiment are the same as those in the data processing apparatus for media files in the embodiment shown in fig. 12 of the present invention, and are not described again here.

the processing unit 50 is configured to cache the monitoring result to a preset cache position after monitoring the landing page of the target media file according to the request message by the target monitoring node corresponding to the target message queue, and send the monitoring result to the target delivery channel through the preset cache position, where the target delivery channel is configured to deliver the landing page of the target media file according to the monitoring result to obtain a delivery result; and/or storing the monitoring result to a preset storage position to store the monitoring result.

FIG. 14 is a schematic diagram of another data processing apparatus for media files according to an embodiment of the present invention. As shown in fig. 14, the data processing apparatus of the media file may include: a first receiving unit 10, a generating unit 20, a transmitting unit 30, a monitoring unit 40 and a processing unit 50. The data processing apparatus for media files further comprises: a second receiving unit 60 and a storage unit 70.

it should be noted that the first receiving unit 10, the generating unit 20, the sending unit 30, the monitoring unit 40, the processing unit 50 and the first storage unit 60 in this embodiment are the same as those in the data processing apparatus for media files in the embodiment shown in fig. 13 of the present invention, and are not described again here.

And a second receiving unit 60, configured to receive a delivery result fed back by the target delivery channel after sending the monitoring result to the target delivery channel through the preset storage location, where the delivery result is a delivery result obtained by the target delivery channel delivering the landing page of the target media file according to the monitoring result.

And the storage unit 70 is used for storing the putting result to a preset storage position so as to store the putting result.

Optionally, the request message includes identification information of the target media file and URL data of a landing page of the target media file, and the monitoring unit 40 is configured to monitor the landing page of the target media file according to the identification information and the URL data of the landing page by using a target monitoring node corresponding to the target message queue, so as to obtain a monitoring result.

optionally, the monitoring unit 40 is configured to send the request message to a page with a preset event through the target message queue, and perform scanning on the page with the preset event according to the request message to obtain a monitoring result, where the monitoring node includes a page with the preset event, and the page with the preset event is associated with a landing page of the target media file.

Fig. 15 is a schematic diagram of a data processing apparatus for media files according to an embodiment of the present invention. As shown in fig. 15, the data processing apparatus of the media file may include: a first receiving unit 10, a generating unit 20, a transmitting unit 30 and a monitoring unit 40. Wherein, the monitoring unit 40 includes: an acquisition module 41, a judgment module 42 and a determination module 43.

It should be noted that, the first receiving unit 10, the generating unit 20, the sending unit 30 and the monitoring unit 40 in this embodiment have the same functions as those in the data processing apparatus for media files in the embodiment shown in fig. 12 of the present invention, and are not described again here.

The request message includes an http return code for the target media file.

And an obtaining module 41, configured to obtain, by the target monitoring node, an http return code from the request message.

And the judging module 42 is configured to judge whether the http return code is in an abnormal state through the target monitoring node.

And the determining module 43 is configured to determine that the landing page of the target media file is in the closed state when the number of times that the http return code is in the abnormal state within the preset time exceeds the preset number of times.

Fig. 16 is a schematic diagram of a data processing apparatus for media files according to an embodiment of the present invention. As shown in fig. 16, the data processing apparatus of the media file may include: a first receiving unit 10, a generating unit 20, a transmitting unit 30 and a monitoring unit 40. Wherein, the monitoring unit 40 includes: a pull module 44, a matching module 45 and a processing module 46.

The request message includes the web page source code for the landing page of the target media file.

And the pulling module 44 is used for pulling the webpage source code from the request message through the target monitoring node.

And the matching module 45 is used for matching the webpage source code with the script for monitoring the IP to obtain a matching result.

And the processing module 46 is configured to, when the matching result is a result that the source code of the web page matches the script, perform offline processing on the landing page of the target media file.

It should be noted that the first receiving unit 10 in this embodiment may be configured to execute step S202 in embodiment 1 of this application, the generating unit 20 in this embodiment may be configured to execute step S204 in embodiment 1 of this application, the sending unit 30 in this embodiment may be configured to execute step S206 in embodiment 1 of this application, and the monitoring unit 40 in this embodiment may be configured to execute step S208 in embodiment 1 of this application.

It should be noted here that the modules described above are the same as the examples and application scenarios implemented by the corresponding steps, but are not limited to the disclosure of embodiment 1 described above. It should be noted that the modules described above as a part of the apparatus may be operated in a hardware environment as shown in fig. 1, and may be implemented by software, or may be implemented by hardware, where the hardware environment includes a network environment.

example 4

According to the embodiment of the invention, the server or the terminal for implementing the data processing method of the media file is also provided.

Fig. 17 is a block diagram of a terminal according to an embodiment of the present invention. As shown in fig. 17, the terminal may include: one or more processors 171 (only one shown), a memory 173, and a transmission device 175 (such as the transmitting device in the above-described embodiment), as shown in fig. 17, the terminal may further include an input-output device 177.

The memory 173 may be used to store software programs and modules, such as program instructions/modules corresponding to the method and apparatus for processing media file data in the embodiment of the present invention, and the processor 171 executes various functional applications and data processing by running the software programs and modules stored in the memory 173, that is, implements the above-mentioned data processing method for media file. The memory 173 may include high speed random access memory and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 173 can further include memory located remotely from the processor 171, which can be connected to the terminal over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The transmission device 175 is used for receiving or transmitting data via a network, and may also be used for data transmission between the processor and the memory. Examples of the network may include a wired network and a wireless network. In one example, the transmission device 175 includes a Network adapter (NIC) that can be connected to a router via a Network cable and other Network devices to communicate with the internet or a local area Network. In one example, the transmission device 175 is a Radio Frequency (RF) module, which is used for communicating with the internet in a wireless manner.

Among them, the memory 173 is used to store an application program, in particular.

The processor 171 may call the application stored in the memory 173 through the transmission device 175 to perform the following steps:

receiving a request message, wherein the request message is used for requesting to monitor a landing page of a target media file, the request message carries monitoring parameters for monitoring the landing page of the target media file, and the landing page is a page loaded after a click operation is performed on a playing interface of the target media file when the target media file is played;

Generating a routing key according to the monitoring parameters, wherein the routing key is a character string formed according to a preset format;

Sending the request message to a target message queue corresponding to the type of the request message according to the routing key;

And monitoring the landing page of the target media file according to the request message through the target monitoring node corresponding to the target message queue to obtain a monitoring result.

The processor 171 is further configured to perform the following steps: after the landing page of the target media file is monitored according to the request message by the target monitoring node corresponding to the target message queue, caching the monitoring result to a preset cache position, and sending the monitoring result to a target delivery channel through the preset cache position, wherein the target delivery channel is used for delivering the landing page of the target media file according to the monitoring result to obtain a delivery result; and/or storing the monitoring result to a preset storage position to store the monitoring result.

the processor 171 is further configured to perform the following steps: after the monitoring result is sent to the target delivery channel through the preset storage position, receiving a delivery result fed back by the target delivery channel, wherein the delivery result is obtained by delivering the landing page of the target media file according to the monitoring result by the target delivery channel; and storing the releasing result to a preset storage position to store the releasing result.

the processor 171 is further configured to perform the following steps: the request message comprises identification information of the target media file and URL data of a landing page of the target media file, and the landing page of the target media file is monitored through a target monitoring node corresponding to the target message queue according to the identification information and the URL data of the landing page, so that a monitoring result is obtained.

The processor 171 is further configured to perform the following steps: and sending the request message to a page with a preset event through the target message queue, and scanning the page with the preset event according to the request message to obtain a monitoring result, wherein the monitoring node comprises the page with the preset event, and the page with the preset event is associated with a landing page of the target media file.

The processor 171 is further configured to perform the following steps: the request message comprises an http return code of the target media file, and the http return code is obtained from the request message through the target monitoring node; judging whether the http return code is in an abnormal state or not through the target monitoring node; and if the number of times that the http return code is in the abnormal state within the preset time exceeds the preset number of times, determining that the landing page of the target media file is in the closed state.

The processor 171 is further configured to perform the following steps: the request message comprises a webpage source code of a landing page of the target media file, and the webpage source code is pulled from the request message through the target monitoring node; matching the webpage source code with a script for monitoring the IP to obtain a matching result; and when the matching result is the result that the webpage source code is matched with the script, performing offline processing on the landing page of the target media file.

the processor 171 is further configured to perform the following steps: the request message comprises a message for requesting a first landing page of the target media file, and the first landing page is requested by the target monitoring node according to the message for requesting the first landing page of the target media file; and when the first landing page of the target media file has the JS jump code, jumping the first landing page according to the URL address of the first landing page to obtain a second landing page.

The embodiment of the invention provides a scheme of a data processing method of a media file. Receiving a request message, wherein the request message is used for requesting to monitor a landing page of a target media file, and the request message carries monitoring parameters for monitoring the landing page of the target media file; generating a routing key according to the monitoring parameters, wherein the routing key is a character string formed according to a preset format; sending the request message to a target message queue corresponding to the type of the request message according to the routing key; the landing page of the target media file is monitored through the target monitoring node corresponding to the target message queue according to the request message, a monitoring result is obtained, and the purpose of monitoring the landing page of the target media file is achieved, so that the technical effect of improving the monitoring efficiency of the media file is achieved, and the technical problem of low monitoring efficiency of the related technology on the landing page of the media file is solved.

optionally, the specific examples in this embodiment may refer to the examples described in the above embodiments, and this embodiment is not described herein again.

It can be understood by those skilled in the art that the structure shown in fig. 17 is only an illustration, and the terminal may be a terminal device such as a smart phone (e.g., an Android phone, an iOS phone, etc.), a tablet computer, a palm computer, and a Mobile Internet Device (MID), a PAD, etc. Fig. 17 is a diagram illustrating the structure of the electronic device. For example, the terminal may also include more or fewer components (e.g., network interfaces, display devices, etc.) than shown in FIG. 17, or have a different configuration than shown in FIG. 17.

those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by a program instructing hardware associated with the terminal device, where the program may be stored in a computer-readable storage medium, and the storage medium may include: flash disks, Read-Only memories (ROMs), Random Access Memories (RAMs), magnetic or optical disks, and the like.

Example 5

the embodiment of the invention also provides a storage medium. Alternatively, in this embodiment, the storage medium may be a program code for executing a data processing method for a media file.

Optionally, in this embodiment, the storage medium may be located on at least one of a plurality of network devices in a network shown in the above embodiment.

Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps:

Optionally, the storage medium is further arranged to store program code for performing the steps of: after the landing page of the target media file is monitored according to the request message by the target monitoring node corresponding to the target message queue, caching the monitoring result to a preset cache position, and sending the monitoring result to a target delivery channel through the preset cache position, wherein the target delivery channel is used for delivering the landing page of the target media file according to the monitoring result to obtain a delivery result; and/or storing the monitoring result to a preset storage position to store the monitoring result.

The storage medium is further configured to store program code for performing the steps of: after the monitoring result is sent to the target delivery channel through the preset storage position, receiving a delivery result fed back by the target delivery channel, wherein the delivery result is obtained by delivering the landing page of the target media file according to the monitoring result by the target delivery channel; and storing the releasing result to a preset storage position to store the releasing result.

The storage medium is further configured to store program code for performing the steps of: the request message comprises identification information of the target media file and URL data of a landing page of the target media file, and the landing page of the target media file is monitored through a target monitoring node corresponding to the target message queue according to the identification information and the URL data of the landing page, so that a monitoring result is obtained.

The storage medium is further configured to store program code for performing the steps of: and sending the request message to a page with a preset event through the target message queue, and scanning the page with the preset event according to the request message to obtain a monitoring result, wherein the monitoring node comprises the page with the preset event, and the page with the preset event is associated with a landing page of the target media file.

The storage medium is further configured to store program code for performing the steps of: the request message comprises an http return code of the target media file, and the http return code is obtained from the request message through the target monitoring node; judging whether the http return code is in an abnormal state or not through the target monitoring node; and if the number of times that the http return code is in the abnormal state within the preset time exceeds the preset number of times, determining that the landing page of the target media file is in the closed state.

The storage medium is further configured to store program code for performing the steps of: the request message comprises a webpage source code of a landing page of the target media file, and the webpage source code is pulled from the request message through the target monitoring node; matching the webpage source code with a script for monitoring the IP to obtain a matching result; and when the matching result is the result that the webpage source code is matched with the script, performing offline processing on the landing page of the target media file.

The storage medium is further configured to store program code for performing the steps of: the request message comprises a message for requesting a first landing page of the target media file, and the first landing page is requested by the target monitoring node according to the message for requesting the first landing page of the target media file; and when the first landing page of the target media file has the JS jump code, jumping the first landing page according to the URL address of the first landing page to obtain a second landing page.

Optionally, in this embodiment, the storage medium may include, but is not limited to: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.

The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.

The integrated unit in the above embodiments, if implemented in the form of a software functional unit and sold or used as a separate product, may be stored in the above computer-readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing one or more computer devices (which may be personal computers, servers, network devices, etc.) to execute all or part of the steps of the method according to the embodiments of the present invention.

in the above embodiments of the present invention, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.

In the several embodiments provided in the present application, it should be understood that the disclosed client may be implemented in other manners. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one type of division of logical functions, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, units or modules, and may be in an electrical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The foregoing is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and decorations can be made without departing from the principle of the present invention, and these modifications and decorations should also be regarded as the protection scope of the present invention.

Claims

1. a method for processing data of a media file, comprising:

and monitoring the landing page of the target media file according to the request message through a target monitoring node corresponding to the target message queue to obtain a monitoring result.

2. The method of claim 1, wherein after monitoring landing pages of the target media file according to the request message by a target monitoring node corresponding to the target message queue, the method further comprises:

caching the monitoring result to a preset cache position, and sending the monitoring result to a target delivery channel through the preset cache position, wherein the target delivery channel is used for delivering a landing page of the target media file according to the monitoring result to obtain a delivery result; and/or the presence of a gas in the gas,

and storing the monitoring result to a preset storage position to store the monitoring result.

3. The method of claim 2, wherein after sending the monitoring result to the target delivery channel via the predetermined cache location, the method further comprises:

Receiving a delivery result fed back by the target delivery channel, wherein the delivery result is obtained by delivering the landing page of the target media file according to the monitoring result by the target delivery channel;

And storing the releasing result to the preset storage position so as to save the releasing result.

4. The method of claim 1, wherein the request message includes identification information of the target media file and URL data of landing pages of the target media file,

Monitoring the landing page of the target media file according to the request message by a target monitoring node corresponding to the target message queue comprises: and monitoring the landing page of the target media file through a target monitoring node corresponding to the target message queue according to the identification information and the URL data of the landing page to obtain the monitoring result.

5. The method of claim 1,

monitoring the landing page of the target media file according to the request message by a target monitoring node corresponding to the target message queue comprises: and sending the request message to a page with a preset event through the target message queue, and scanning the page with the preset event according to the request message to obtain the monitoring result, wherein the monitoring node comprises the page with the preset event, and the page with the preset event is associated with a landing page of the target media file.

6. The method of claim 1, wherein the request message comprises an http return code of the target media file, and wherein monitoring landing pages of the target media file according to the request message by a target monitoring node corresponding to the target message queue comprises:

Acquiring the http return code from the request message through the target monitoring node;

Judging whether the http return code is in an abnormal state or not through the target monitoring node;

And if the number of times that the http return code is in the abnormal state within the preset time exceeds the preset number of times, determining that the landing page of the target media file is in the closed state.

7. The method of claim 1, wherein the request message comprises a web page source code of a landing page of the target media file, and wherein monitoring the landing page of the target media file according to the request message by a target monitoring node corresponding to the target message queue comprises:

pulling the webpage source code from the request message through the target monitoring node;

matching the webpage source code with a script for monitoring IP to obtain a matching result;

And when the matching result is the result that the webpage source code is matched with the script, executing offline processing on the landing page of the target media file.

8. The method of claim 1, wherein the request message comprises a message requesting a first landing page of the target media file, and wherein monitoring, by a target monitoring node corresponding to the target message queue, the landing page of the target media file according to the request message comprises:

requesting, by the target monitoring node, a first landing page of the target media file according to a message for requesting the first landing page;

And when the first landing page of the target media file has the JS jump code, jumping the first landing page according to the URL address of the first landing page to obtain a second landing page.

9. A data processing apparatus for media files, comprising:

The device comprises a first receiving unit, a second receiving unit and a third receiving unit, wherein the first receiving unit is used for receiving a request message, the request message is used for requesting to monitor a landing page of a target media file, the request message carries monitoring parameters used for monitoring the landing page of the target media file, and the landing page is a page loaded after a click operation is executed on a playing interface of the target media file when the target media file is played;

The generating unit is used for generating a routing key according to the monitoring parameters, wherein the routing key is a character string formed according to a preset format;

The sending unit is used for sending the request message to a target message queue corresponding to the type of the request message according to the routing key;

And the monitoring unit is used for monitoring the landing page of the target media file according to the request message through the target monitoring node corresponding to the target message queue to obtain a monitoring result.

10. the apparatus of claim 9, further comprising:

the processing unit is used for caching the monitoring result to a preset caching position after the landing page of the target media file is monitored according to the request message through a target monitoring node corresponding to the target message queue, and sending the monitoring result to a target delivery channel through the preset caching position, wherein the target delivery channel is used for delivering the landing page of the target media file according to the monitoring result to obtain a delivery result; and/or the monitoring device is used for storing the monitoring result to a preset storage position so as to save the monitoring result.

11. The apparatus of claim 10, further comprising:

A second receiving unit, configured to receive a delivery result fed back by a target delivery channel after sending the monitoring result to the target delivery channel through the preset cache location, where the delivery result is a delivery result obtained by the target delivery channel delivering a landing page of the target media file according to the monitoring result;

And the storage unit is used for storing the releasing result to the preset storage position so as to store the releasing result.

12. The apparatus of claim 9, wherein the request message includes identification information of the target media file and URL data of a landing page of the target media file,

And the monitoring unit is used for monitoring the landing page of the target media file through a target monitoring node corresponding to the target message queue according to the identification information and the URL data of the landing page to obtain the monitoring result.

13. the apparatus of claim 9,

The monitoring unit is used for sending the request message to a page with a preset event through the target message queue, and scanning the page with the preset event according to the request message to obtain the monitoring result, wherein the monitoring node comprises the page with the preset event, and the page with the preset event is associated with the landing page of the target media file.

14. The apparatus according to claim 9, wherein the request message comprises an http return code of the target media file, and wherein the monitoring unit comprises:

An obtaining module, configured to obtain the http return code from the request message through the target monitoring node;

The judging module is used for judging whether the http return code is in an abnormal state or not through the target monitoring node;

And the determining module is used for determining that the landing page of the target media file is in a closed state when the number of times that the http return code is in an abnormal state within the preset time exceeds the preset number of times.

15. The apparatus of claim 9, wherein the request message comprises a web page source code of a landing page of the target media file, and wherein the monitoring unit comprises:

The pull module is used for pulling the webpage source code from the request message through the target monitoring node;

The matching module is used for matching the webpage source code with the script for monitoring the IP to obtain a matching result;

And the processing module is used for executing offline processing on the landing page of the target media file when the matching result is the result that the webpage source code is matched with the script.