CN112261118B - Multimedia data anomaly detection method, terminal and server - Google Patents

Multimedia data anomaly detection method, terminal and server Download PDF

Info

Publication number
CN112261118B
CN112261118B CN202011117530.6A CN202011117530A CN112261118B CN 112261118 B CN112261118 B CN 112261118B CN 202011117530 A CN202011117530 A CN 202011117530A CN 112261118 B CN112261118 B CN 112261118B
Authority
CN
China
Prior art keywords
multimedia data
target
abnormal
detection result
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202011117530.6A
Other languages
Chinese (zh)
Other versions
CN112261118A (en
Inventor
武斌
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN202011117530.6A priority Critical patent/CN112261118B/en
Publication of CN112261118A publication Critical patent/CN112261118A/en
Application granted granted Critical
Publication of CN112261118B publication Critical patent/CN112261118B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00—Diagnosis, testing or measuring for television systems or their details

Abstract

The invention provides a multimedia data anomaly detection method, a terminal and a server, wherein the method comprises the following steps: responding to a pulling request of a plurality of target multimedia data sent by a client, acquiring the plurality of target multimedia data, and sending the plurality of target multimedia data to the client so that the client plays the plurality of target multimedia data; when the client detects that an error callback event occurs, the client generates an abnormal playing detection result of the current target multimedia data; and enabling the client to acquire a corresponding abnormal log file; and transmitting the abnormal playing detection result and the abnormal log file sent by the client to the management front end so that the management front end displays the abnormal log file and the abnormal playing detection result on the basis of the first information display interface. The management server can be a cloud server, and the method can be used for simultaneously carrying out abnormity detection on a plurality of pieces of target multimedia data without modifying the project file of the player, and has higher automation degree.

Description

Multimedia data anomaly detection method, terminal and server
Technical Field
The invention belongs to the technical field of multimedia, and particularly relates to a multimedia data anomaly detection method, a terminal and a server.
Background
Fig. 1 shows a multimedia stream playing anomaly detection method in the prior art, which mainly includes: modifying the player project file, manually adding the stream to be detected to the project, recompiling the project, and manually observing whether there is an anomaly in playing the multimedia stream.
However, the multimedia stream anomaly detection method in the prior art has strong dependence on manual work, and the whole process from adding the detected multimedia stream to obtaining the detection result needs manual participation, so that the automation degree is low. And each detection can not be carried out aiming at all the testing multimedia streams, and is only carried out in the routine debugging and developing link, when a plurality of testing media streams need to be detected simultaneously, the engineering file needs to be modified, and the multimedia stream addresses are sequentially written into the playing array. In addition, the detection result is not recorded, so that the detection result cannot be subjected to retrospective reference subsequently.
Disclosure of Invention
In order to solve the technical problem, the invention provides a multimedia data anomaly detection method, a terminal and a server.
In one aspect, the present invention provides a method for detecting an anomaly of multimedia data, where the method includes:
receiving a pull request of a plurality of target multimedia data sent by a client;
responding to the pull request, acquiring the target multimedia data from the multi-point broadcast streaming media data included in the local server, and sending the target multimedia data to the client so that the client can play the target multimedia data in sequence; when the client detects that an error callback event occurs in the current playing process, the client generates an abnormal playing detection result of the current played target multimedia data; and enabling the client to acquire an abnormal log file of the current target multimedia data;
receiving the abnormal playing detection result and the abnormal log file sent by the client;
and transmitting the abnormal playing detection result and the abnormal log file to a management front end so that the management front end displays the abnormal log file and the abnormal playing detection result based on a first information display interface.
In another aspect, an embodiment of the present invention provides an anomaly detection method for multimedia data, where the method includes:
sending a pull request of a plurality of target multimedia data to a management server; the management server comprises a plurality of multicast streaming media data;
receiving the target multimedia data obtained from the multicast streaming media data in response to the pull request returned by the management server;
sequentially playing the target multimedia data;
when an error callback event is detected in the current playing process, generating an abnormal playing detection result of the currently played current target multimedia data;
acquiring an abnormal log file of the current target multimedia data;
sending the abnormal playing detection result and the abnormal log file to the management server so that the management server transmits the abnormal playing detection result and the abnormal log file to a management front end; and displaying the abnormal log file and the abnormal playing detection result by the management front end based on a first information display interface.
In another aspect, an embodiment of the present invention provides an anomaly detection server for multimedia data, where the server includes:
the pull request receiving module is used for receiving pull requests of a plurality of target multimedia data sent by a client;
a pull request response module, configured to respond to the pull request, obtain the multiple target multimedia data from multiple multicast streaming media data included in a local server, and send the multiple target multimedia data to the client, so that the client plays the multiple target multimedia data in sequence; when the client detects that an error callback event occurs in the current playing process, the client generates an abnormal playing detection result of the current played target multimedia data; and enabling the client to acquire an abnormal log file of the current target multimedia data;
the abnormal receiving module is used for receiving the abnormal playing detection result and the abnormal log file sent by the client;
and the transmission module is used for transmitting the abnormal playing detection result and the abnormal log file to a management front end so that the management front end displays the abnormal log file and the abnormal playing detection result based on a first information display interface.
In another aspect, an embodiment of the present invention provides an anomaly detection terminal for multimedia data, where the apparatus includes:
the system comprises a pulling request sending module, a pulling request sending module and a pulling request sending module, wherein the pulling request sending module is used for sending a plurality of pulling requests of target multimedia data to a management server; the management server comprises a plurality of multicast streaming media data;
a target multimedia data receiving module, configured to receive the multiple target multimedia data obtained from the multiple broadcast streaming media data in response to the pull request, where the target multimedia data is returned by the management server;
the playing module is used for sequentially playing the plurality of target multimedia data;
the abnormal determining module is used for generating an abnormal playing detection result of the currently played current target multimedia data when detecting that an error callback event occurs in the current playing process;
an abnormal log file obtaining module, configured to obtain an abnormal log file of the current target multimedia data;
the abnormal sending module is used for sending the abnormal playing detection result and the abnormal log file to the management server so that the management server can transmit the abnormal playing detection result and the abnormal log file to a management front end; and displaying the abnormal log file and the abnormal playing detection result by the management front end based on a first information display interface.
In another aspect, the present invention provides an electronic device, which includes a processor and a memory, where at least one instruction or at least one program is stored in the memory, and the at least one instruction or the at least one program is loaded and executed by the processor to implement the method for detecting an anomaly of multimedia data as described above.
In another aspect, the present invention provides a computer-readable storage medium, in which at least one instruction or at least one program is stored, and the at least one instruction or the at least one program is loaded and executed by a processor to implement the method for detecting an anomaly of multimedia data as described above.
The multimedia data anomaly detection method, the terminal and the server provided by the embodiment of the invention have the advantages that when the multimedia data is detected to be anomalous, the client can send a pull request of a plurality of target multimedia data to the management server, the management server responds to the pull request, acquires the plurality of target multimedia data from the plurality of broadcast streaming media data and sends the plurality of target multimedia data to the client, the client plays the plurality of target multimedia data in sequence, if the client detects that an error callback event occurs in the current playing process, the client generates an anomalous playing detection result of the currently played front target multimedia data, acquires an anomalous log file of the current target multimedia data, sends the anomalous playing detection result and the anomalous log file to the management server, and the management server transmits the anomalous playing detection result and the anomalous log file to the management front end, and displaying the abnormal log file and the abnormal playing detection result by the management front end based on the first information display interface. According to the embodiment of the invention, after the client side pulls the target multimedia data, the anomaly detection process of the multimedia data can be automatically completed, and the automation degree of anomaly detection is higher; the client can simultaneously pull a plurality of pieces of target multimedia data and simultaneously perform anomaly detection on the plurality of pieces of target multimedia data without modifying the project file of the player; in addition, the detection result of the target multimedia data by the client can be automatically uploaded to the management server for recording, so that the detection result can be traced and consulted at any time in the follow-up process.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions and advantages of the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
Fig. 1 is a method for detecting an abnormal playing of a multimedia stream in the prior art.
Fig. 2 is a schematic diagram of an implementation environment of a method for detecting an anomaly of multimedia data according to an embodiment of the present invention.
Fig. 3 is a functional structure diagram of a management front end according to an embodiment of the present invention.
Fig. 4 is a flowchart illustrating an anomaly detection method for multimedia data according to an embodiment of the present invention.
Fig. 5 is a flowchart illustrating another method for detecting an anomaly of multimedia data according to an embodiment of the present invention.
Fig. 6 is a flowchart illustrating another method for detecting an anomaly of multimedia data according to an embodiment of the present invention.
Fig. 7 is a schematic structural diagram of a second information display interface according to an embodiment of the present invention.
Fig. 8 is a flowchart illustrating another method for detecting an anomaly of multimedia data according to an embodiment of the present invention.
Fig. 9 is a schematic structural diagram of a first information display interface according to an embodiment of the present invention.
Fig. 10 is an alternative structure diagram of the blockchain system according to the embodiment of the present invention.
Fig. 11 is an alternative schematic diagram of a block structure according to an embodiment of the present invention.
Fig. 12 is a flowchart illustrating another method for detecting an anomaly of multimedia data according to an embodiment of the present invention.
Fig. 13 is a flowchart illustrating another method for detecting an anomaly of multimedia data according to an embodiment of the present invention.
Fig. 14 is a server for detecting an anomaly of multimedia data according to an embodiment of the present invention.
Fig. 15 is a schematic structural diagram of an anomaly detection terminal for multimedia data according to an embodiment of the present invention.
Fig. 16 is a block diagram of a hardware structure of a server according to an embodiment of the present invention.
Detailed Description
Cloud technology refers to a hosting technology for unifying serial resources such as hardware, software, network and the like in a wide area network or a local area network to realize calculation, storage, processing and sharing of data.
The cloud technology is a general term of network technology, information technology, integration technology, management platform technology, application technology and the like applied based on a cloud computing business model, can form a resource pool, is used as required, and is flexible and convenient. Background services of the technical network system require a large amount of computing and storage resources, such as video websites, picture-like websites and more web portals. With the high development and application of the internet industry, each article may have its own identification mark and needs to be transmitted to a background system for logic processing, data in different levels are processed separately, and various industrial data need strong system background support and can only be realized through cloud computing. Specifically, cloud technologies include the technical fields of security, big data, databases, industrial applications, networks, storage, management tools, computing, and the like.
Specifically, the embodiment of the invention relates to a cloud computing technology in the cloud technology.
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or server that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Fig. 2 is a schematic diagram of an implementation environment of a method for detecting an anomaly of multimedia data according to an embodiment of the present invention. As shown in fig. 2, the implementation environment may include at least a client 01, a management front-end 02 and a management server 03, and the client 01, the management front-end 02 and the management server 03 may be directly or indirectly connected through wired or wireless communication, and the present invention is not limited herein.
Specifically, the management server 03 may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, or a cloud server providing basic cloud computing services such as a cloud service, a cloud database, cloud computing, a cloud function, cloud storage, a network service, cloud communication, a middleware service, a domain name service, a security service, a CDN, a big data and artificial intelligence platform, and the like. The client 01 may be a smart phone, a tablet computer, a notebook computer, a desktop computer, a smart speaker, a smart watch, and the like, but is not limited thereto.
Further, the management server 03 may be a linux cloud server, and a HyperText Transfer Protocol (HTTP) service is built using a flash, and provides corresponding request interfaces for the client 01 and the management front-end 02, where linux is a computer operating system, and flash is a lightweight customizable framework written using a computer programming language. By calling corresponding interfaces, the client 01 and the front management front-end 02 can respectively realize functions of reading stream address information, uploading playing conditions, uploading multimedia files and logs and the like. For example, the client 01 reads the stream address information from the server through the connection, and uploads the playback detection result and the abnormal log file to the management server 03 through the connection, the management front-end 02 may upload the stream address information in the third-party server or the locally stored multimedia file to the management server 03 through the connection, and the management server 03 may transmit the playback detection result, the stream address information, the playback record, and the like to the management front-end 02 through the connection.
Fig. 3 is a functional structure diagram of the management front-end 02 according to the embodiment of the present invention. As shown in fig. 3, the management front-end 02 mainly includes a first information display interface and a second information display interface, where the first information display interface is mainly used to display the playing condition of the target multimedia data and provide log analysis and downloading functions of the corresponding abnormal multimedia data, and the second information display interface is mainly used to manage the streaming address information, including constructing the on-demand streaming media data and displaying the on-demand streaming media data.
In order to provide an interface-friendly uploading experience, the management front end 02 uses an open-source jQuery-File-Upload File uploading model, and dynamically inserts hypertext Markup Language (HTML) form fragments by using a JavaScript-Templates template, and performs page beautification by using layerui and bootstrap. The jQuery-File-Upload is a picture uploading component, supports uploading, canceling and deleting of multiple files, previewing of thumbnails before uploading, displaying of picture sizes in a list, supporting display of uploading progress bars and supporting a server side for development of various dynamic languages. JavaScript-Templates is a set of template syntax, a user can write a template block, and an HTML fragment generated by corresponding data is generated according to the input data each time to render different effects.
It should be noted that fig. 2 and 3 are only an example.
Fig. 4 is a flowchart illustrating an anomaly detection method for multimedia data according to an embodiment of the present invention. The method may be used in the implementation environment of fig. 3. The present specification provides steps for the method operations as described in the examples or block diagrams, but may include more or fewer steps based on routine or non-inventive labor. The order of steps recited in the embodiments is merely one manner of performing the steps in a multitude of orders and does not represent the only order of execution. In practice, the system or server product may be implemented in a sequential or parallel manner (e.g., parallel processor or multi-threaded environment) according to the embodiments or methods shown in the figures. Specifically, as shown in fig. 4, the method may include:
s101, a client sends a pulling request of a plurality of target multimedia data to a management server; the management server comprises a plurality of multicast streaming media data.
In one possible embodiment, as shown in fig. 5, before S101, the method may further include:
and S00101, the management server responds to the management front end and constructs a plurality of multimedia data to be detected into a plurality of multicast streaming media data based on uploading requests of the plurality of multimedia data to be detected triggered by the second information display interface.
And S00103, the management server transmits the multicast streaming media data to a management front end.
And S00105, the management front end displays the multi-click streaming media data in a list form based on a second information display interface.
In another possible embodiment, as shown in fig. 6, before S101, the method may further include:
and S00301, the management front end acquires the on-demand stream address information corresponding to the multimedia data to be detected from the third-party server.
S00303, the management front end uploads the on-demand stream address information corresponding to the multimedia data to be detected to the management server.
And S00305, the management server takes the stream address information corresponding to the multimedia data to be detected as the streaming media data of the plurality of multicast points.
And S00307, the management server transmits the multicast streaming media data to a management front end.
S00309, the management front end displays the multi-click streaming media data in a list form based on the second information display interface.
The embodiment of the invention can be applied to the system test stage of a certain player, accurately detect the playing condition of the certain player on the multimedia data, further judge whether the function of the player is influenced or not according to the playing condition of the multimedia data, and improve the stability of the player.
In a possible embodiment, as described in S00101-S00107, before detecting the target multimedia data, a user at the management front end may select to upload a plurality of locally stored multimedia data to be detected, where the plurality of locally stored multimedia data to be detected includes, but is not limited to, an audio file, a video file, an audio/video file, and the like. The management server can respond to the file uploading request of the management front end, and the stream address information corresponding to the plurality of multimedia data to be detected is stored in the root directory of the management server, so that the plurality of multimedia data to be detected are constructed into the multi-spot streaming media data. After the construction of the on-demand streaming media data is completed, the management server transmits the generated on-demand streaming media data to the management front end, and the management front end displays the on-demand streaming media data in a list form through a second information display interface. The user of the management front end may be an operator who performs a test on a system of a certain player. In the embodiment, the multimedia data stored locally is used as the multimedia data to be detected, so that the cost of multimedia data anomaly detection can be reduced, and the multimedia data to be detected is constructed into the on-demand streaming media data because the detection of the client multimedia data is not real-time, so that the client can conveniently select specific multimedia data to detect as required when the client needs to check, and the user experience is improved.
In another possible embodiment, as described in S00301-S00309, before the detection, the user at the management front end may access the third-party server, and add the on-demand streaming address information corresponding to each of the multimedia data to be detected on the third-party server to the data list of the management server, so as to generate a plurality of on-demand streaming media data. The management server transmits the generated multi-click streaming media data to a management front end, and the management front end displays the multi-click streaming media data in a list form through a second information display interface. In the embodiment, the on-demand stream address information is acquired from the third-party server, so that the space of local storage can be saved, and the detection of the multimedia data of the client is not real-time, so that the multimedia data to be detected is constructed into the on-demand stream media data, the client can conveniently select specific multimedia data to detect as required when the client needs to check, and the user experience is improved.
In another feasible embodiment, S00101-S00107 and S00301-S00309 may be further combined, that is, before detecting the target multimedia data, a user at the management front end may upload a plurality of locally stored multimedia data to be detected to the management server, and may add stream address information corresponding to each of the plurality of multimedia data to be detected on the third-party server to a data list of the management server, so as to form a plurality of on-demand stream data according to the locally stored plurality of multimedia data to be detected and the on-demand stream address information corresponding to each of the plurality of multimedia data to be detected on the third-party server. And displaying the multi-click streaming media data in a list form through a second information display interface.
Fig. 7 is a schematic structural diagram of the second information display interface. As shown in fig. 7, the second information presentation interface not only presents the multiple spot streaming media data in a list form, but also presents description information of each spot streaming media data, which includes but is not limited to: the type of the on-demand streaming media data, the source of the on-demand streaming media data, whether the on-demand streaming media data can be played normally, and the like. In addition, a stream address refreshing icon, a deleting icon and a service selection item are also arranged in the second information display interface. Clicking the stream address refreshing icon can refresh and see the newly constructed on-demand stream address, and clicking the deleting icon can delete the corresponding on-demand stream address. The embodiment of the invention mainly aims at the iOS platform and the Android platform to carry out service isolation, and different services are selected through service selection items, so that the data of each service are not mixed and do not interfere with each other. Among them, iOS is a mobile operating system developed by apple inc, and Android is an operating system of a free and open source code based on Linux kernel.
In the embodiment of the invention, the multicast streaming media data and the corresponding description information are displayed in the second information display interface in a list form, so that each multicast streaming media data can be clearly and intuitively displayed, and the client and a user at the management front end can conveniently pull and manage the multicast streaming media data.
In this embodiment of the present invention, after the management server generates the multicast streaming media data, as described in S101, the client may send a pull request of multiple target multimedia data to the management server, so as to pull the multiple target multimedia data.
In the embodiment of the invention, the stream address information can be directly added to the management server by using the management front end, and the client can directly pull a plurality of target multimedia data from the management server when detecting the target multimedia data without modifying the project file of the player, so that the complexity and the cost of multimedia data anomaly detection are reduced, the automation degree of the multimedia data anomaly detection is improved, and the efficiency of the multimedia data anomaly detection is improved.
And S103, the management server responds to the pulling request, acquires a plurality of target multimedia data from the multicast streaming media data, and sends the plurality of target multimedia data to the client.
In this embodiment of the present invention, the plurality of target multimedia data may include a plurality of target data fragments, and each target data fragment has corresponding on-demand stream address information, as shown in fig. 8, S103 may further include:
s10301, the management server responds to the pull request, and obtains target on-demand stream address information corresponding to a plurality of target multimedia data from the multi-point on-demand stream media data, wherein the target on-demand stream address information corresponding to the plurality of target multimedia data comprises on-demand stream address information corresponding to a plurality of corresponding target data fragments.
S10303, the management server sends the target on-demand stream address information corresponding to each of the plurality of target multimedia data to the client.
In practical application, the multimedia data to be detected uploaded to the management server from the management front end may be individual data fragments, the target multimedia data may also include a plurality of target data fragments, each target data fragment has corresponding on-demand stream address information, and then, after receiving a pull request sent by the client, the management server may obtain, for each target multimedia data, on-demand stream address information corresponding to each target data fragment included in the on-demand stream media data from the on-demand stream media data, and use the on-demand stream address information corresponding to each target data fragment included in each target multimedia data as the target on-demand stream address information corresponding to each target multimedia data.
For example, the client wants to pull target multimedia data 1 and target multimedia data 2, the target multimedia data 1 includes a data fragment 11 and a data fragment 12, and the target multimedia data 2 includes a data fragment 21 and a data fragment 22, the management server obtains on-demand stream address information corresponding to each of the data fragment 11, the data fragment 12, the data fragment 21, and the data fragment 22, takes the on-demand stream address information corresponding to each of the data fragment 11 and the data fragment 12 as the target on-demand stream address information corresponding to the target multimedia data 1, and takes the on-demand stream address information corresponding to each of the data fragment 21 and the data fragment 22 as the target stream address information corresponding to the target multimedia data 2.
In this embodiment of the present invention, after S10303, the method may further include:
and the client simultaneously downloads a plurality of target data fragments respectively included by the plurality of target multimedia data from the third-party server based on the target on-demand stream address information respectively corresponding to the plurality of target multimedia data.
The embodiment of the invention provides a tool for one-key downloading of HLS (hyper text transport protocol) Streaming multi-segment, wherein HLS is an abbreviation of SHI HTTP Live Streaming and refers to a Streaming media network transmission protocol based on HTTP proposed by apple Inc. The link of the tool for one-key download of HLS stream multi-segment can be shown in fig. 7, and the relevant description of the download tool can be obtained through the link in fig. 7.
Because only the stream address information is recorded in the management server, the client can download a plurality of target data fragments respectively included in a plurality of target multimedia data to the third-party server by using the tool for one-key downloading of the HLS stream multi-fragment according to the on-demand stream address information returned by the management server. For example, data slice 11, data slice 12, data slice 21, and data slice 22 are downloaded simultaneously using the one-key download facility of the HLS stream multi-slice. Of course, in addition to downloading data from the third party server, if the target multimedia data is stored in the management server, the corresponding multimedia data may be downloaded to the management server according to the corresponding on-demand stream address information.
In this embodiment, by using the tool for one-key downloading of HLS stream multi-segment, the downloading time of each data segment can be saved, and the efficiency of pulling multiple target multimedia data by the client is improved. For example, if the target multimedia data includes 100 pieces of data, if the one-touch downloading tool is not used, each piece of data needs to be downloaded, i.e. 100 times, whereas the 100 files can be downloaded successively by only needing to perform one download according to the one-touch downloading tool of the present invention.
And S105, the client plays a plurality of target multimedia data in sequence.
Specifically, as shown in fig. 8, the S105 may include: the client plays a plurality of target data fragments respectively included by a plurality of target multimedia data in sequence.
In the embodiment of the present invention, after the client pulls the plurality of target multimedia data, since the plurality of target multimedia data respectively include the plurality of target data fragments, the client can sequentially play the plurality of target data fragments respectively included in each target multimedia data.
Specifically, the client may form a multimedia play list with a plurality of target data segments included in each target multimedia data, and the client sequentially plays the target data segments in the multimedia play list. For example, the data segment 11, the data segment 12, the data segment 21, and the data segment 22 are sequentially played.
Therefore, after the client pulls the target multimedia data, the embodiment of the invention can automatically complete the anomaly detection process of the multimedia data, and the automation degree of the anomaly detection is higher; and the client can simultaneously pull a plurality of pieces of target multimedia data and simultaneously perform anomaly detection on the plurality of pieces of target multimedia data without modifying the project file of the player, so that the anomaly detection cost is low and the efficiency is high.
And S107, when the client detects that an error call-back event occurs in the current playing process, the client generates an abnormal playing detection result of the current played target multimedia data.
S109, the client acquires an abnormal log file of the current target multimedia data.
And S1011, the client sends the abnormal playing detection result and the abnormal log file to the management server.
And S1013, the management server transmits the abnormal playing detection result and the abnormal log file to a management front end.
And S1015, the management front end displays the abnormal log file and the abnormal playing detection result based on the first information display interface.
In the embodiment of the invention, if the playing is wrong in the process of playing the target multimedia data by the client, corresponding error call-back events are generated, and the error call-back events can be used as a judgment basis for judging whether the multimedia playing is abnormal or not. That is, if the currently played current target multimedia data is in error, the inside of the player can call back the error state and the error information, when the client receives an error call-back event, it is determined that the playing of the current target multimedia data is abnormal, an abnormal playing detection result of the current target multimedia data is generated, and the abnormal playing detection result is reported to the management server. Including but not limited to a timeout download, a video parsing error, etc. Wherein, the abnormal playing detection result includes but is not limited to: and playing the abnormal stream address information, the abnormal reporting time, the playing equipment information and the like of the abnormal target multimedia data.
Whether an error call-back event occurs or not is detected in the playing process, the error call-back event is used as a judgment basis for judging whether the playing is abnormal or not, and whether the phenomena of video black screen, frame skipping or whether sound and picture are asynchronous or not exist in the playing of the played picture content or not need not to be concerned by detection personnel in the whole playing process, so that the automation degree, the accuracy and the efficiency of abnormal detection are improved.
In a possible embodiment, when the client detects the target multimedia data, the client may capture the playing picture content at regular time, determine whether the playing picture content is abnormal, determine that the playing of the target multimedia data is abnormal if the playing picture content is abnormal, otherwise, determine that the playing of the target multimedia data is normal.
In the embodiment of the invention, in order to facilitate the analysis of the abnormal positioning problem, some key information in the program running process can be written into a text in advance and stored as a log file, and when the current target multimedia data is abnormally played, the abnormal log file of the current target multimedia data can be obtained and sent to the management server. After receiving the abnormal playing detection result and the abnormal log file, the management server may transmit the abnormal playing detection result and the abnormal log file to a management front end, and the management front end displays the abnormal playing detection result and the abnormal log file based on a first information display interface.
In the embodiment of the present invention, the method may further include:
and when the client does not detect that an error call-back event occurs in the current playing process, the client generates a normal playing detection result of the current target multimedia data.
And the client sends the normal playing detection result to the management server.
And the management server transmits the normal play detection result to the management front end.
The management front end displays the abnormal log file, the abnormal playing detection result and the normal playing detection result based on the first information display interface.
In the embodiment of the invention, if the client does not detect the occurrence of the error callback event in the process of playing the multimedia data, the client indicates that the playing of the current target multimedia data is normal, a normal playing detection result of the current target multimedia data is generated, and the normal playing detection result is reported to the management server. The method comprises the steps of playing the abnormal stream address information, the normal reporting time, the playing equipment information and the like of the normal target multimedia data.
Fig. 9 is a schematic structural diagram of a first information display interface, and as shown in fig. 9, the first information display interface may display a normal play detection result and an abnormal play detection result of each target multimedia data, where the normal play detection result and the abnormal play detection result include, but are not limited to: the target on-demand stream address information and the description information corresponding to the target multimedia data, the time reported to the management server, the operator, the normal play state (for example, "√" in fig. 9) corresponding to the normal play detection result, the abnormal play state (for example, "×" in fig. 9) corresponding to the abnormal play detection result, and the abnormal log file, so that the operator can quickly look up the required detection result data.
It should be noted that the first information display interface and the second information display interface are both interfaces that can be displayed by the management front end, and the first information display interface and the second information display interface can be switched with each other according to different operation instructions.
As shown in fig. 9, the client in the embodiment of the present invention automatically uploads the detection result of the target multimedia data to the management server for recording, identifies the normal multimedia data and the abnormal multimedia data, records and archives the conditions of different multimedia data, and displays the conditions through the first information display interface, so that the detection result can be traced and looked up at any time in the following process, thereby facilitating the troubleshooting of the abnormal problem in the later process.
In order to facilitate data screening, the embodiment of the present invention further provides a condition screening function in the first information display interface. Specifically, after the management front end displays the abnormal log file, the abnormal play detection result, and the normal play detection result based on the first information display interface, the method may further include:
the management server responds to an inquiry request of the playing detection result meeting the preset condition, the playing detection result meeting the preset condition is obtained, the inquiry request is triggered by the management front end based on the first information display interface, and the playing detection result comprises a normal detection result and an abnormal detection result.
And the management server transmits the playing detection result meeting the preset condition to the management front end.
The management front end displays the playing detection result meeting the preset conditions based on the first information display interface.
The management server in the embodiment of the present invention may record the play detection result, when an operator needs to query the play detection result at a preset time, a user at the management front end may input a preset condition to be queried in the first information display interface shown in fig. 9 to trigger a query request, and the management server responds to the query request to obtain the play detection result meeting the preset condition, and the play detection result meeting the preset condition is displayed by the first information display interface. By using the condition screening function, a user at the management front end can quickly look up required detection result data.
As shown in fig. 9, in the embodiment of the present invention, an abnormal log file downloading entry is further provided in the first information display interface, and the abnormal log file can be downloaded through the abnormal log file downloading entry. Specifically, after the management front end displays the abnormal log file and the abnormal playing detection result based on the first information display interface, the method may further include:
the management server responds to a downloading request of the target abnormal log file triggered by the management front end based on the first information display interface, and obtains the target abnormal log file.
And the management server transmits the target abnormal log file to the management front end.
And the management front end performs exception analysis on the target exception log file.
The downloading interface of the daily log file provided by the first information display interface in the embodiment of the invention is equivalent to visually displaying the abnormal log file, and after the abnormal log file is downloaded, the user corresponding to the management front end can analyze the abnormal log, so that the user corresponding to the management front end can quickly find a solution for solving the abnormal reason and the abnormal problem.
In practical application, because the player is continuously updated in version iteration, the problem that the existing function is influenced can be caused. For example, after the previous period test is completed, a certain functional module is changed to update the player version, and when the previous period test is performed in this period, if it is found that certain target multimedia data can be normally played in the previous period and cannot be normally played in this period, it may be caused by the modification of the certain functional module, and the modification of the certain functional module may cause the non-playing of certain target multimedia data, and the functional module may not be modified in order to improve the stability of the player.
In one possible embodiment, at least one of the plurality of multicast streaming media data in S101, the plurality of target multimedia data in S103, and the abnormal play detection result in S107 may be stored in the blockchain system. Referring To fig. 10, fig. 10 is a schematic diagram illustrating an alternative structure of a blockchain system according To an embodiment of the present invention, a Peer-To-Peer (P2P) network is formed among a plurality of nodes, and a P2P Protocol is an application layer Protocol operating on a Transmission Control Protocol (TCP). In the blockchain system, any machine such as a server and a terminal can be added to become a node, and the node comprises a hardware layer, a middle layer, an operating system layer and an application layer.
Referring to the functions of each node in the blockchain system shown in fig. 10, the functions involved include:
1) routing, a basic function that a node has, is used to support communication between nodes.
Besides the routing function, the node may also have the following functions:
2) the application is used for being deployed in a block chain, realizing specific services according to actual service requirements, recording data related to the realization functions to form recording data, carrying a digital signature in the recording data to represent a source of task data, and sending the recording data to other nodes in the block chain system, so that the other nodes add the recording data to a temporary block when the source and integrity of the recording data are verified successfully.
3) And the Block chain comprises a series of blocks (blocks) which are mutually connected according to the generated chronological order, new blocks cannot be removed once being added into the Block chain, and recorded data submitted by nodes in the Block chain system are recorded in the blocks.
Referring to fig. 11, fig. 11 is an optional schematic diagram of a Block Structure (Block Structure) according to an embodiment of the present invention, where each Block includes a hash value of a transaction record (hash value of the Block) stored in the Block and a hash value of a previous Block, and the blocks are connected by the hash values to form a Block chain. The block may include information such as a time stamp at the time of block generation. A Blockchain (Blockchain), which is essentially a decentralized database, is a string of data blocks, each of which is associated using cryptography.
Specifically, as shown in fig. 12, the method for detecting an abnormality of multimedia data may further include:
s201, receiving a pull request of a plurality of target multimedia data sent by a client.
In a possible embodiment, before S201, the method may further include:
and responding to the management front end, constructing the multimedia data to be detected into a plurality of multicast streaming media data based on the uploading request of the multimedia data to be detected triggered by the second information display interface, and storing the multimedia data to be detected in the local server.
And transmitting the multi-spot streaming media data to the management front end so that the management front end displays the multi-spot streaming media data in a list form based on the second information display interface.
In a possible embodiment, before S201, the method may further include:
and receiving the on-demand stream address information corresponding to the multiple multimedia data to be detected uploaded by the management front end, wherein the on-demand stream address information corresponding to the multiple multimedia data to be detected is obtained by the management front end from a third-party server.
And taking the stream media data as the multi-point broadcast stream media data based on the broadcast stream address information corresponding to the multimedia data to be detected.
And transmitting the multi-spot streaming media data to the management front end so that the management front end displays the multi-spot streaming media data in a list form based on the second information display interface.
S203, responding to the pull request, acquiring a plurality of target multimedia data from the plurality of multicast streaming media data included in the local server, and sending the plurality of target multimedia data to the client so that the client can play the plurality of target multimedia data in sequence; when the client detects that an error call-back event occurs in the current playing process, the client generates an abnormal playing detection result of the current played target multimedia data; and enabling the client to acquire the abnormal log file of the current target multimedia data.
In this embodiment of the present invention, if the target multimedia data respectively includes a plurality of target data fragments, the method, in response to the pull request, obtains the target multimedia data from a plurality of streaming media data broadcast by the local server, and sends the target multimedia data to the client, so that the client sequentially plays the target multimedia data, may include:
and responding to the pull request, and acquiring target on-demand stream address information corresponding to the plurality of target multimedia data from the plurality of pieces of on-demand stream media data, wherein the target on-demand stream address information corresponding to the plurality of pieces of target multimedia data comprises on-demand stream address information corresponding to the plurality of corresponding target data fragments.
Sending target on-demand stream address information corresponding to the target multimedia data to a client, so that the client can simultaneously download a plurality of target data fragments respectively included in the target multimedia data from a third-party server based on the target on-demand stream address information corresponding to the target multimedia data; and enabling the client to play the target data fragments respectively included in the target multimedia data in sequence.
S205, receiving an abnormal playing detection result and an abnormal log file sent by the client.
And S207, transmitting the abnormal playing detection result and the abnormal log file to a management front end so that the management front end displays the abnormal log file and the abnormal playing detection result on the basis of a first information display interface.
In the embodiment of the present invention, the method may further include: and receiving a normal play detection result sent by the client, wherein the normal play detection result is generated when the client does not detect an error callback event in the current play process.
And transmitting the normal playing detection result to the management front end so that the management front end displays the abnormal log file, the abnormal playing detection result and the normal playing detection result on the basis of the first information display interface.
In the embodiment of the present invention, the method may further include:
responding to a query request of the playing detection result meeting the preset condition, and acquiring the playing detection result meeting the preset condition, wherein the query request is triggered by the management front end based on the first information display interface, and the playing detection result comprises a normal detection result and an abnormal detection result.
And transmitting the playing detection result meeting the preset condition to the management front end so that the management front end displays the playing detection result meeting the preset condition on the basis of the first information display interface.
In the embodiment of the present invention, the method may further include:
and responding to a downloading request of the target abnormal log file triggered by the management front end based on the first information display interface, and acquiring the target abnormal log file.
And transmitting the target abnormal log file to a management front end so that the management front end performs abnormal analysis on the target abnormal log file.
Specifically, as shown in fig. 13, the method for detecting an anomaly of multimedia data may include:
s301, sending a pulling request of a plurality of target multimedia data to a management server; the management server comprises a plurality of multicast streaming media data.
And S303, receiving a plurality of target multimedia data which are returned by the management server and obtained from the multicast streaming media data in response to the pull request.
S305, playing a plurality of target multimedia data in sequence.
And S307, when an error callback event is detected in the current playing process, generating an abnormal playing detection result of the currently played current target multimedia data.
S309, obtaining an abnormal log file of the current target multimedia data.
S3011, sending the abnormal playing detection result and the abnormal log file to a management server so that the management server can transmit the abnormal playing detection result and the abnormal log file to a management front end; and displaying the abnormal log file and the abnormal playing detection result by the management front end based on the first information display interface.
The embodiment of the invention also provides an anomaly detection system of multimedia data, which can comprise a client, a management front end and a management server;
the client is used for sending a plurality of pull requests of target multimedia data to the management server; the management server comprises a plurality of multicast streaming media data; the system comprises a management server, a plurality of multicast streaming media data acquisition units and a plurality of target multimedia data acquisition units, wherein the management server is used for receiving a plurality of target multimedia data which are returned by the management server and acquired from the multicast streaming media data in response to a pull request; and is used for playing a plurality of target multimedia data in sequence; and the abnormal playing detection result is used for generating the abnormal playing detection result of the currently played current target multimedia data when detecting that an error callback event occurs in the current playing process; the abnormal log file is used for acquiring the current target multimedia data; and the system is used for sending the abnormal playing detection result and the abnormal log file to the management server.
The management server is used for receiving a pull request of a plurality of target multimedia data sent by a client; the system comprises a local server, a client and a server, wherein the local server is used for receiving a pull request and sending a plurality of multicast streaming media data to the client; the system comprises a client, a server and a server, wherein the client is used for receiving an abnormal playing detection result and an abnormal log file sent by the client; and the system is used for transmitting the abnormal playing detection result and the abnormal log file to the management front end.
The management front end is used for displaying the abnormal log file and the abnormal playing detection result based on the first information display interface.
As shown in fig. 14, an embodiment of the present invention further provides a schematic structural diagram of an anomaly detection server for multimedia data, where the server may include:
the pull request receiving module 401 may be configured to receive a pull request of multiple target multimedia data sent by a client.
A pull request response module 403, configured to respond to a pull request, obtain multiple target multimedia data from multiple multicast streaming media data included in a local server, and send the multiple target multimedia data to a client, so that the client plays the multiple target multimedia data sequentially; when the client detects that an error call-back event occurs in the current playing process, the client generates an abnormal playing detection result of the current played target multimedia data; and enabling the client to acquire the abnormal log file of the current target multimedia data.
The exception receiving module 405 may be configured to receive an exception playing detection result and an exception log file sent by the client.
The transmission module 407 may be configured to transmit the abnormal playing detection result and the abnormal log file to the management front end, so that the management front end displays the abnormal log file and the abnormal playing detection result based on the first information display interface.
In a possible embodiment, the server may further include:
the construction module can be used for responding to the management front end, constructing the multimedia data to be detected into multi-point broadcast streaming media data based on the uploading request of the multimedia data to be detected triggered by the second information display interface, and storing the multimedia data to be detected in the local server.
The first on-demand streaming media data transmission module may be configured to transmit the on-demand streaming media data to the management front end, so that the management front end displays the on-demand streaming media data in a list form based on the second information display interface.
In another possible embodiment, the server may further include:
the on-demand stream address information receiving module can be used for receiving on-demand stream address information corresponding to the multiple multimedia data to be detected uploaded by the management front end, and the on-demand stream address information corresponding to the multiple multimedia data to be detected is obtained by the management front end from a third-party server.
The on-demand streaming media data generation module can be used for taking on-demand streaming media address information corresponding to the multimedia data to be detected as the on-demand streaming media data.
The second on-demand streaming media data transmission module may be configured to transmit the on-demand streaming media data to the management front end, so that the management front end displays the on-demand streaming media data in a list form based on the second information display interface.
In this embodiment of the present invention, the target multimedia data respectively include a plurality of target data fragments, and each target data fragment has corresponding on-demand stream address information, the pull request response module 403 may include:
the target on-demand stream address information obtaining unit may be configured to respond to the pull request, and obtain target on-demand stream address information corresponding to each of the plurality of target multimedia data from the plurality of on-demand stream media data, where the target on-demand stream address information corresponding to each of the plurality of target multimedia data includes on-demand stream address information corresponding to each of the plurality of target data segments.
The target on-demand streaming address information sending unit may be configured to send target on-demand streaming address information corresponding to each of the plurality of target multimedia data to the client, so that the client simultaneously downloads a plurality of target data fragments included in each of the plurality of target multimedia data from the third-party server based on the target on-demand streaming address information corresponding to each of the plurality of target multimedia data; and enabling the client to play the target data fragments respectively included in the target multimedia data in sequence.
In this embodiment of the present invention, the server may include:
the normal play detection result receiving module may be configured to receive a normal play detection result sent by the client, where the normal play detection result is generated when the client does not detect an error callback event in the current play process.
And the normal play detection result transmission module can be used for transmitting the normal play detection result to the management front end so that the management front end displays the abnormal log file, the abnormal play detection result and the normal play detection result on the basis of the first information display interface.
In this embodiment of the present invention, the server may include:
the query request response module may be configured to respond to a query request for a play detection result meeting a preset condition, to obtain the play detection result meeting the preset condition, where the query request is triggered by the management front end based on the first information display interface, and the play detection result includes a normal detection result and an abnormal detection result.
The playing detection result transmission module can be used for transmitting the playing detection result meeting the preset conditions to the management front end, so that the management front end displays the playing detection result meeting the preset conditions on the basis of the first information display interface.
In this embodiment of the present invention, the server may include:
the download request response module may be configured to respond to a download request of the target abnormal log file triggered by the management front end based on the first information display interface, and acquire the target abnormal log file.
The target abnormal log file transmission module can be used for transmitting the target abnormal log file to the management front end so that the management front end can perform abnormal analysis on the target abnormal log file.
As shown in fig. 15, an embodiment of the present invention further provides a schematic structural diagram of an anomaly detection terminal for multimedia data, where the apparatus may include:
a pull request sending module 501, configured to send a pull request of a plurality of target multimedia data to a management server; the management server comprises a plurality of multicast streaming media data.
A target multimedia data receiving module 503, configured to receive multiple target multimedia data that are returned by the management server and obtained from the multicast streaming media data in response to the pull request;
the playing module 505 may be configured to play a plurality of target multimedia data in sequence.
The anomaly determining module 507 may be configured to generate an abnormal playing detection result of the currently played current target multimedia data when an error callback event is detected in the current playing process.
The abnormal log file obtaining module 509 may be configured to obtain an abnormal log file of the current target multimedia data.
The abnormal sending module 5011 may be configured to send the abnormal playing detection result and the abnormal log file to the management server, so that the management server transmits the abnormal playing detection result and the abnormal log file to the management front end; and displaying the abnormal log file and the abnormal playing detection result by the management front end based on the first information display interface.
It should be noted that the system, apparatus, and server embodiments provided in the embodiments of the present invention are based on the same inventive concept as the above method embodiments.
The multimedia data anomaly detection method, the terminal and the server provided by the embodiment of the invention have the following beneficial effects:
1) the embodiment of the invention fully exerts the automatic detection capability, improves the automatic capability of multimedia data detection, is designed from three aspects of a front end, a server and a client, realizes a set of complete abnormal stream detection scheme of the penguin electronic competition self-research player, provides a visual front-end management platform and ensures the stable updating of the multimedia player.
2) According to the embodiment of the invention, after the client side pulls the target multimedia data, the anomaly detection process of the multimedia data can be automatically completed, and the automation degree of anomaly detection is higher; and the client can simultaneously pull a plurality of pieces of target multimedia data and simultaneously perform anomaly detection on the plurality of pieces of target multimedia data without modifying the project file of the player, so that the anomaly detection cost is low.
3) The client in the embodiment of the invention can automatically upload the detection result of the target multimedia data to the management server for recording, respectively identify the normal multimedia data and the abnormal multimedia data, record and archive the conditions of different multimedia data, and display the conditions through the first information display interface, so that the detection result can be traced and looked up at any time in the follow-up process, and the abnormal problems can be conveniently checked in the later stage.
4) According to the embodiment of the invention, the detection result is automatically filed, so that the functions of players with different versions can be compared and analyzed conveniently, and whether the functions of the players are affected or not can be further judged, and the stability of the players can be enhanced in an auxiliary manner.
The embodiment of the present invention further provides an electronic device for detecting an anomaly of multimedia data, where the electronic device includes a processor and a memory, where the memory stores at least one instruction or at least one program, and the at least one instruction or the at least one program is loaded and executed by the processor to implement the method for detecting an anomaly of multimedia data provided in the foregoing method embodiment.
An embodiment of the present invention further provides a computer-readable storage medium, which may be disposed in a terminal to store at least one instruction or at least one program for implementing an anomaly detection method for multimedia data according to the method embodiment, where the at least one instruction or at least one program is loaded and executed by a processor to implement the anomaly detection method for multimedia data according to the method embodiment.
Alternatively, in the present specification embodiment, the storage medium may be located at least one network server among a plurality of network servers of a computer network. Optionally, in this embodiment, the storage medium may include, but is not limited to: various media capable of storing program codes, such as a usb disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic disk, or an optical disk.
The memory of the embodiments of the present disclosure may be used to store software programs and modules, and the processor may execute various functional applications and data processing by operating the software programs and modules stored in the memory. The memory can mainly comprise a program storage area and a data storage area, wherein the program storage area can store an operating system, application programs needed by functions and the like; the storage data area may store data created according to use of the device, and the like. Further, the memory may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, the memory may also include a memory controller to provide the processor access to the memory.
Embodiments of the present invention also provide a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the anomaly detection method for multimedia data provided by the method embodiments.
The method for detecting the multimedia data abnormity provided by the embodiment of the invention can be executed in a terminal, a computer terminal, a server or a similar arithmetic device. Taking the example of the operation on the server, fig. 16 is a hardware structure block diagram of the server of the multimedia data anomaly detection method according to the embodiment of the present invention. As shown in fig. 16, the server 600 may have a relatively large difference due to different configurations or performances, and may include one or more Central Processing Units (CPUs) 610 (the processor 610 may include but is not limited to a Processing device such as a microprocessor MCU or a programmable logic device FPGA, etc.), a memory 630 for storing data, and one or more storage media 6 for storing an application program 623 or data 62220 (e.g., one or more mass storage devices). Memory 630 and storage medium 620 may be, among other things, transient or persistent storage. The program stored on the storage medium 620 may include one or more modules, each of which may include a series of instruction operations for the server. Still further, the central processor 610 may be configured to communicate with the storage medium 620 to execute a series of instruction operations in the storage medium 620 on the server 600. The Server 600 may also include one or more power supplies 660, one or more wired or wireless network interfaces 650, one or more input-output interfaces 640, and/or one or more operating systems 621, such as a Windows ServerTM，Mac OS XTM，UnixTM，LinuxTM，FreeBSDTMAnd so on.
The input/output interface 640 may be used to receive or transmit data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of the server 600. In one example, i/o Interface 640 includes a Network adapter (NIC) that may be coupled to other Network devices via a base station to communicate with the internet. In one example, the input/output interface 640 may be a Radio Frequency (RF) module, which is used for communicating with the internet in a wireless manner.
It will be understood by those skilled in the art that the structure shown in fig. 16 is merely illustrative and is not intended to limit the structure of the electronic device. For example, server 600 may also include more or fewer components than shown in FIG. 16, or have a different configuration than shown in FIG. 16.
It should be noted that: the precedence order of the above embodiments of the present invention is only for description, and does not represent the merits of the embodiments. And specific embodiments thereof have been described above. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims may be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may also be possible or may be advantageous.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, as for the device and server embodiments, since they are substantially similar to the method embodiments, the description is simple, and the relevant points can be referred to the partial description of the method embodiments.
It will be understood by those skilled in the art that all or part of the steps of implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
The present invention is not limited to the above preferred embodiments, and any modifications, equivalent replacements, improvements, etc. within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (11)

1. A method for detecting the abnormity of multimedia data is applied to a system test stage of a playing device in a client, and the method comprises the following steps:
receiving a pull request of a plurality of target multimedia data sent by a client; the target multimedia data respectively comprise a plurality of target data fragments, and each target data fragment has corresponding on-demand stream address information;
responding to the pull request, and acquiring target on-demand stream address information corresponding to the target multimedia data from to-be-detected multi-point on-demand stream media data included in a local server, wherein the target on-demand stream address information corresponding to the target multimedia data comprises on-demand stream address information corresponding to a plurality of corresponding target data fragments; sending the on-demand stream address information corresponding to the target multimedia data to the client, so that the client can simultaneously download a plurality of target data fragments respectively included in the target multimedia data from a third-party server based on the target on-demand stream address information corresponding to the target multimedia data; the playing device in the client plays a plurality of target data fragments respectively included in the plurality of target multimedia data in sequence; when the client detects that an error call-back event occurs in the current playing process, the client generates an abnormal playing detection result of the current played target multimedia data, wherein the abnormal playing detection result comprises the abnormal on-demand stream address information of the current target multimedia data; and enabling the client to acquire an abnormal log file of the current target multimedia data;
receiving the abnormal playing detection result and the abnormal log file sent by the client;
transmitting the abnormal playing detection result and the abnormal log file to a management front end so that the management front end displays the abnormal log file and the abnormal playing detection result based on a first information display interface; and comparing the abnormal playing detection result with the detection result of the previous period by the management front end, and determining whether to iteratively update the version of the playing device or not by the management front end according to the comparison result.
2. The method of claim 1, wherein prior to receiving the pull request for the plurality of target multimedia data sent by the client, the method further comprises:
receiving on-demand stream address information corresponding to a plurality of to-be-detected multimedia data uploaded by the management front end, wherein the on-demand stream address information corresponding to the plurality of to-be-detected multimedia data is acquired by the management front end from the third-party server;
using the on-demand stream address information corresponding to the multimedia data to be detected as the on-demand stream media data;
and transmitting the multi-click streaming media data to the management front end so that the management front end displays the multi-click streaming media data in a list form based on a second information display interface.
3. The method of claim 2, wherein prior to receiving the pull request for the plurality of target multimedia data sent by the client, the method further comprises:
responding to the management front end, constructing a plurality of multimedia data to be detected into the multi-point broadcast streaming media data based on an uploading request of the plurality of multimedia data to be detected triggered by the second information display interface, wherein the plurality of multimedia data to be detected are stored in the local server;
and transmitting the multi-click streaming media data to the management front end so that the management front end displays the multi-click streaming media data in a list form on the basis of the second information display interface.
4. The method of claim 1, further comprising:
receiving a normal play detection result sent by the client, wherein the normal play detection result is generated when the client does not detect the error callback event in the current play process;
and transmitting the normal play detection result to the management front end so that the management front end displays the abnormal log file, the abnormal play detection result and the normal play detection result on the basis of the first information display interface.
5. The method of claim 4, further comprising:
responding to a query request of a play detection result meeting a preset condition, and acquiring the play detection result meeting the preset condition, wherein the query request is triggered by the management front end based on the first information display interface, and the play detection result comprises a normal detection result and an abnormal detection result;
and transmitting the playing detection result meeting the preset condition to the management front end so that the management front end displays the playing detection result meeting the preset condition on the basis of the first information display interface.
6. The method of claim 1, further comprising:
responding to a downloading request of a target abnormal log file triggered by the management front end based on the first information display interface, and acquiring the target abnormal log file;
and transmitting the target abnormal log file to the management front end so that the management front end performs abnormal analysis on the target abnormal log file.
7. A method for detecting the abnormity of multimedia data is applied to the system test stage of a playing device in a local client, and the method comprises the following steps:
sending a pull request of a plurality of target multimedia data to a management server; the management server comprises a plurality of on-demand streaming media data to be detected, the plurality of target multimedia data respectively comprise a plurality of target data fragments, and each target data fragment has corresponding on-demand streaming address information;
receiving target on-demand stream address information which is returned by the management server and corresponds to the plurality of target multimedia data acquired from the plurality of pieces of on-demand stream media data in response to the pull request, wherein the target on-demand stream address information corresponding to the plurality of pieces of target multimedia data comprises on-demand stream address information corresponding to the plurality of corresponding target data fragments; based on the target on-demand stream address information corresponding to the target multimedia data, simultaneously downloading a plurality of target data fragments respectively included in the target multimedia data from a third-party server;
playing a plurality of target data fragments respectively included by the plurality of target multimedia data in sequence based on the playing equipment;
when an error callback event is detected in the current playing process, generating an abnormal playing detection result of the current played target multimedia data, wherein the abnormal playing detection result comprises the abnormal on-demand stream address information of the current target multimedia data;
acquiring an abnormal log file of the current target multimedia data;
sending the abnormal playing detection result and the abnormal log file to the management server so that the management server transmits the abnormal playing detection result and the abnormal log file to a management front end; and displaying the abnormal log file and the abnormal playing detection result by the management front end based on a first information display interface; and comparing the abnormal playing detection result with the detection result of the previous period by the management front end, and determining whether to iteratively update the version of the playing device or not by the management front end according to the comparison result.
8. An anomaly detection server for multimedia data, said server being applied in a system test phase of a playback device in a client, said server comprising:
the pull request receiving module is used for receiving pull requests of a plurality of target multimedia data sent by a client; the target multimedia data respectively comprise a plurality of target data fragments, and each target data fragment has corresponding on-demand stream address information;
a pull request response module, configured to respond to the pull request, and obtain, from multiple pieces of streaming media data to be detected included in a local server, target on-demand stream address information corresponding to each of the multiple pieces of target multimedia data, where the target on-demand stream address information corresponding to each of the multiple pieces of target multimedia data includes on-demand stream address information corresponding to each of the multiple pieces of target data; sending the on-demand stream address information corresponding to the target multimedia data to the client, so that the client can simultaneously download a plurality of target data fragments respectively included in the target multimedia data from a third-party server based on the target on-demand stream address information corresponding to the target multimedia data; the playing device in the client plays a plurality of target data fragments respectively included in the plurality of target multimedia data in sequence; when the client detects that an error call-back event occurs in the current playing process, the client generates an abnormal playing detection result of the current played target multimedia data, wherein the abnormal playing detection result comprises the abnormal on-demand stream address information of the current target multimedia data; and enabling the client to acquire an abnormal log file of the current target multimedia data;
the abnormal receiving module is used for receiving the abnormal playing detection result and the abnormal log file sent by the client;
the transmission module is used for transmitting the abnormal playing detection result and the abnormal log file to a management front end so that the management front end displays the abnormal log file and the abnormal playing detection result based on a first information display interface; and comparing the abnormal playing detection result with the detection result of the previous period by the management front end, and determining whether to iteratively update the version of the playing device or not by the management front end according to the comparison result.
9. An anomaly detection terminal for multimedia data, characterized in that, the terminal is applied to the system test phase of the playing device in the local client, the terminal includes:
the system comprises a pulling request sending module, a pulling request sending module and a pulling request sending module, wherein the pulling request sending module is used for sending a plurality of pulling requests of target multimedia data to a management server; the management server comprises a plurality of on-demand streaming media data to be detected, the plurality of target multimedia data respectively comprise a plurality of target data fragments, and each target data fragment has corresponding on-demand streaming address information;
a target multimedia data receiving module, configured to receive target on-demand stream address information corresponding to each of the plurality of target multimedia data obtained from the plurality of pieces of on-demand stream media data in response to the pull request, where the target on-demand stream address information corresponding to each of the plurality of target multimedia data includes on-demand stream address information corresponding to each of the plurality of corresponding target data fragments; based on the target on-demand stream address information corresponding to the target multimedia data, simultaneously downloading a plurality of target data fragments respectively included in the target multimedia data from a third-party server;
the playing module is used for sequentially playing a plurality of target data fragments respectively included by the plurality of target multimedia data based on the playing equipment;
an exception determining module, configured to generate an exception play detection result of currently played current target multimedia data when an error callback event is detected in a current playing process, where the exception play detection result includes exception on-demand stream address information of the current target multimedia data;
an abnormal log file obtaining module, configured to obtain an abnormal log file of the current target multimedia data;
the abnormal sending module is used for sending the abnormal playing detection result and the abnormal log file to the management server so that the management server can transmit the abnormal playing detection result and the abnormal log file to a management front end; and displaying the abnormal log file and the abnormal playing detection result by the management front end based on a first information display interface; and comparing the abnormal playing detection result with the detection result of the previous period by the management front end, and determining whether to iteratively update the version of the playing device or not by the management front end according to the comparison result.
10. An electronic device for anomaly detection of multimedia data, characterized in that it comprises a processor and a memory, in which at least one instruction or at least one program is stored, said at least one instruction or said at least one program being loaded by said processor and executing the method for anomaly detection of multimedia data according to any one of claims 1 to 7.
11. A computer-readable storage medium, in which at least one instruction or at least one program is stored, the at least one instruction or the at least one program being loaded and executed by a processor to implement the method for detecting the abnormality of multimedia data according to any one of claims 1 to 7.
CN202011117530.6A 2020-10-19 2020-10-19 Multimedia data anomaly detection method, terminal and server Active CN112261118B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011117530.6A CN112261118B (en) 2020-10-19 2020-10-19 Multimedia data anomaly detection method, terminal and server

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011117530.6A CN112261118B (en) 2020-10-19 2020-10-19 Multimedia data anomaly detection method, terminal and server

Publications (2)

Publication Number Publication Date
CN112261118A CN112261118A (en) 2021-01-22
CN112261118B true CN112261118B (en) 2022-03-25

Family

ID=74244675

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011117530.6A Active CN112261118B (en) 2020-10-19 2020-10-19 Multimedia data anomaly detection method, terminal and server

Country Status (1)

Country Link
CN (1) CN112261118B (en)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112423144B (en) * 2020-10-30 2023-11-21 深圳市酷开软件技术有限公司 Multimedia resource exception handling method, device, equipment and storage medium
CN113824693B (en) * 2021-08-25 2023-04-07 北京达佳互联信息技术有限公司 Multimedia data sharing method, device and system, electronic equipment and storage medium
US11645188B1 (en) 2021-11-16 2023-05-09 International Business Machines Corporation Pull request risk prediction for bug-introducing changes
CN114040312B (en) * 2021-11-29 2023-08-22 四川虹美智能科技有限公司 Microphone detection method and system of voice air conditioner
CN114553735B (en) * 2022-02-21 2024-04-09 福建星网智慧科技有限公司 Multimedia data fault analysis method, system and storage device
CN114584934B (en) * 2022-03-14 2023-01-06 联想(北京)有限公司 Communication processing method, device, system and storage medium
CN114928758A (en) * 2022-05-05 2022-08-19 上海哔哩哔哩科技有限公司 Live broadcast abnormity detection processing method and device
CN114722970B (en) * 2022-05-12 2022-08-26 北京瑞莱智慧科技有限公司 Multimedia detection method, device and storage medium
CN114915622B (en) * 2022-05-31 2024-01-30 广东三维睿新科技有限公司 File transmission method based on http for web terminal

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1195274C (en) * 2003-01-25 2005-03-30 华中科技大学 Division distributed storage method of program source based on cluster video server
CN100433619C (en) * 2004-07-23 2008-11-12 腾讯科技（深圳）有限公司 Data download method and system
CN101521553B (en) * 2008-02-29 2011-08-03 突触计算机系统（上海）有限公司 Method which is based on terminal equipment of point-to-point transmission protocol and used for providing data fragment of data file for other peer terminal equipment and device thereof
CN101247402B (en) * 2008-03-17 2011-09-14 腾讯科技（深圳）有限公司 Multimedia files downloading and broadcasting system and method
CN101540885A (en) * 2009-04-30 2009-09-23 中兴通讯股份有限公司 IPTV on-demand system and method
JP6171319B2 (en) * 2012-12-10 2017-08-02 株式会社リコー Information processing apparatus, information processing method, information processing system, and program
CN103618786A (en) * 2013-11-27 2014-03-05 乐视网信息技术（北京）股份有限公司 Playing error processing method and server
CN105978703A (en) * 2015-08-12 2016-09-28 乐视云计算有限公司 Video fault feedback method, client and server
CN105893420A (en) * 2015-12-01 2016-08-24 乐视网信息技术（北京）股份有限公司 Detection method and device of advertisement playing abnormity
CN105611328B (en) * 2015-12-25 2019-01-01 深圳Tcl新技术有限公司 Video data based on HLS Streaming Media accelerates method for down loading and device
CN110138716B (en) * 2018-02-09 2020-11-27 网宿科技股份有限公司 Key providing method, video playing method, server and client
CN108391179B (en) * 2018-04-26 2021-07-27 腾讯科技（深圳）有限公司 Live broadcast data processing method and device, server, terminal and storage medium
CN110535685B (en) * 2019-07-25 2023-01-13 北京奇艺世纪科技有限公司 Fault determination method and device and computer readable storage medium
CN110457258A (en) * 2019-08-06 2019-11-15 北京字节跳动网络技术有限公司 A kind of blog management method, device, equipment and medium

Also Published As

Publication number Publication date
CN112261118A (en) 2021-01-22

Similar Documents

Publication Publication Date Title
CN112261118B (en) Multimedia data anomaly detection method, terminal and server
US20220362666A1 (en) Interaction scene starting method and apparatus, storage medium, client, and server
US10853227B2 (en) Systems and methods for modular test platform for applications
US8566648B2 (en) Automated testing on devices
CN111177618B (en) Website construction method, device, equipment and computer readable storage medium
US20210081308A1 (en) Generating automated tests based on user interaction with an application
CN111522922A (en) Log information query method and device, storage medium and computer equipment
CN108415820B (en) Test method and device of application installation package
Kunszt et al. iPortal: the swiss grid proteomics portal: Requirements and new features based on experience and usability considerations
AU2007243143A1 (en) Independent actionscript analytics tools and techniques
CN106339273A (en) Application program restoration method, terminal and server
CN102004695A (en) Method and system for testing browser
WO2015006137A1 (en) Cloud services load testing and analysis
CN111651352B (en) Warehouse code merging method and device
CN113934913A (en) Data capture method and device, storage medium and electronic equipment
CN115658496A (en) Extensible Web automatic test method, system, equipment and storage medium
CN113190286B (en) MES system, loading method, terminal and medium for dynamically and remotely loading functional plug-ins
CN104506661A (en) Automatic production method for remotely-configured usage scenario-based power consumption
CN112988600A (en) Service scene testing method and device, electronic equipment and storage medium
CN112579406B (en) Log call chain generation method and device
CN110780894B (en) Thermal upgrade processing method and device and electronic equipment
CN106383765A (en) Data monitoring method and apparatus
US10498616B1 (en) System and method for implementing a client performance capture tool
CN111061627B (en) Webpage embedding method and device, electronic equipment and storage medium
CN113392343A (en) Data extraction method, device, medium and computer program product

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant