CN114339416A - Method, system, equipment, medium and application for monitoring far-end large-screen playing content - Google Patents
Method, system, equipment, medium and application for monitoring far-end large-screen playing content Download PDFInfo
- Publication number
- CN114339416A CN114339416A CN202111632226.XA CN202111632226A CN114339416A CN 114339416 A CN114339416 A CN 114339416A CN 202111632226 A CN202111632226 A CN 202111632226A CN 114339416 A CN114339416 A CN 114339416A
- Authority
- CN
- China
- Prior art keywords
- playing
- screen
- frame
- content
- monitoring
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 63
- 238000000034 method Methods 0.000 title claims abstract description 52
- 238000004422 calculation algorithm Methods 0.000 claims abstract description 25
- 238000012545 processing Methods 0.000 claims description 15
- 230000002159 abnormal effect Effects 0.000 claims description 9
- 238000004364 calculation method Methods 0.000 claims description 7
- 238000004590 computer program Methods 0.000 claims description 7
- 230000007717 exclusion Effects 0.000 claims description 2
- 239000000284 extract Substances 0.000 claims description 2
- 238000004458 analytical method Methods 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 4
- 230000003993 interaction Effects 0.000 description 4
- 230000007547 defect Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000003491 array Methods 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000013079 data visualisation Methods 0.000 description 1
- 239000006185 dispersion Substances 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 210000001503 joint Anatomy 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008092 positive effect Effects 0.000 description 1
- 238000013468 resource allocation Methods 0.000 description 1
- 238000010845 search algorithm Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Abstract
The invention belongs to the technical field of monitoring of unstructured data such as videos, sounds, images and the like, and discloses a method, a system, equipment, a medium and an application for monitoring remote large-screen playing content, wherein a client or a large-screen or large-screen playing control device periodically collects the name of a currently playing resource, the current equipment time, the fingerprint of a frame played to the last time and the current frame or the algorithm of a service end required to be consistent with the service end algorithm, and reports the name to the service end; after the server disassembles the reported data, the reported data is compared with preset data; if the difference is not within the allowable deviation range, the content played on the large screen is not the expected content, otherwise, the content is compared with the expected playing time, and if the difference is within the allowable deviation range, the playing is normal. The invention can monitor whether a certain current large screen plays the appointed content at the appointed time in real time, can greatly reduce the problem of high occupancy rate of the remote large screen monitoring bandwidth, and solves the problem of dependence of large screen monitoring on a front camera.
Description
Technical Field
The invention belongs to the technical field of monitoring of unstructured data such as videos, sounds and images, and particularly relates to a method, a system, equipment, a medium and application for monitoring remote large-screen playing content.
Background
At present, in the digital age, the data visualization demand taking a large screen as a main carrier is increasing day by day. The large screen gives people with shocking visual impact force and presents more information. Many enterprises display strength externally through large screens and expose problems internally, so that a working situation for pursuing your pursuit is formed; government agencies also often display work progress on large screens and provide information to citizens. There are also many organizations sharing key indexes through meeting large screens to discuss management and management problems. Large screens are also often used for efficient strategic direction and global monitoring. Meanwhile, the demand for real-time supervision of large-screen playing contents is also important.
The first prior art is as follows: CN201320255605.6 has no physical gap and is a large screen. A large screen without physical gaps is characterized by comprising a digital high-definition intelligent video control module, a high-definition large screen and a signal acquisition and transmission component; the digital high-definition intelligent video control module is provided with a signal switching matrix, a multiple high-definition picture screen-splitting controller, a signal conversion module and a signal output module; the digital high-definition intelligent video control module is connected with the high-definition large screen through a transmission component; the signal acquisition and transmission system consists of an independent signal source and various transmission cables; the digital high-definition intelligent video control module is connected with the Internet, a high-definition player, video monitoring equipment, mobile storage equipment and a sound system; and a picture seamless processing module is arranged in the digital high-definition intelligent video control module. The intelligent control and seamless high-definition display of a large-screen display system are realized.
The second prior art is: CN201810722061.7 a large screen information push system, large screen equipment and method. The invention discloses a large screen information pushing system, large screen equipment and a method, wherein a mobile terminal converts a user ID into a corresponding audio file; the large screen equipment converts the audio file into a corresponding user ID; the multi-screen interaction server receives the user ID uploaded by the large-screen equipment, inquires data information stored in the database, matches user information content or instructions corresponding to the user ID according to a preset matching strategy, and drives the large-screen equipment to display the corresponding information or content. And the mobile terminal is registered in the multi-screen interaction server in advance and acquires a corresponding user ID. According to the invention, when the mobile terminal of the user approaches a certain large screen, the content which the user is interested in is called back and displayed through the multi-screen interaction server according to the behavior portrait of the user, so that the outdoor media presentation mode is changed.
The prior art is three: control system and method for displaying information on a CN201810722524.X large screen and large screen display information system. The invention provides a control system and a control method for large screen display information and a large screen display information system, wherein a control terminal receives an information name of information to be displayed; the information analysis server receives the information name sent by the control terminal and analyzes the information name in the voice format into the information name in the text format; the screen resource allocation library receives the information name in the text format sent by the information analysis server, searches corresponding information to be displayed according to the information name in the text format, and sends the information to be displayed to the WebSocket server; the WebSocket server sends the information to be displayed to the large-screen computer so that the large screen can display the information to be displayed. The user can carry out remote wireless control on the large screen display information, the operation mode is flexible and quick, the constraint of a fixed place is eliminated, the resource consumption of the server is reduced, and the technical problems of fixed operation place, single operation mode and high resource consumption of the server in the conventional control mode are solved.
The prior art is four: CN201810410730.7 is a large screen broadcast control method and system. The invention discloses a large-screen broadcast control method, which is applied to a large screen and comprises the following steps: receiving a large-screen broadcast message sent by a server; analyzing the large-screen broadcast message, and judging whether the large-screen broadcast message is sent to a local machine; if yes, acquiring a large-screen control command according to the large-screen broadcast message; and executing the large screen control command to realize the control of the large screen. According to the large-screen broadcast control method and the large-screen broadcast control system, synchronous display of the large screen and the mobile display terminal is realized through remote operation of the mobile control terminal, and the operation is convenient; the teacher is not limited on the platform, the interaction with the students during teaching is increased, the teaching effect is improved, and the teaching platform is suitable for different teaching scenes.
The existing large-screen content playing control method generally comprises the following modes:
(1) the playing content is stored in a mobile storage device (such as a U disk), and is accessed to a large screen for playing.
(2) The playing content is stored in a large screen (with a storage function) locally, and the large screen is controlled by the software carried by the large screen.
(3) The playing content is stored in the local control computer, and is connected with the large screen through a network cable, an HDMI (high-definition multimedia interface) and the like, and the playing control software in the computer is used for controlling the large-screen playing content.
(4) The playing content is stored in the remote playing control system, is in butt joint with the special large screen through a specific communication protocol, and is controlled by the remote playing control system.
Under the above large-screen broadcast control mode, it is very difficult to provide timely alarm linkage if the large-screen content needs to be monitored in real time and the difference between the broadcast content and the expected setting is compared. Conceivable ways are:
and arranging a camera in front of each large playing screen, aligning the camera with the playing screen, and transmitting the monitoring picture back to the monitoring end in real time.
And the large-screen equipment or the broadcast control equipment transmits the large-screen broadcast content code stream back to the monitoring end in real time.
And after the monitoring end takes the video code stream, monitoring the playing content in real time through an AI algorithm. Although the method can be realized, the cost and the cost are huge, the landing can hardly be realized, besides the huge bandwidth consumption, a camera needs to be configured for each screen, an AI server needs to be configured, and the like, and therefore, a method which is low in bandwidth occupation, simple and easy to use, low in landing cost and easy to operate is found as a key point for solving the problems.
Through the above analysis, the problems and defects of the prior art are as follows: the existing remote large-screen monitoring bandwidth has high occupancy rate; the dependence of large screen monitoring on a camera in front of the screen can not realize real-time monitoring and alarming when the large screen is played.
The difficulty in solving the above problems and defects is: the analysis of the data needs to rely on AI capabilities; the requirement on network bandwidth is relatively high.
The significance of solving the problems and the defects is as follows: does not need to rely on complex AI computing power; without relying on high bandwidth overhead.
Disclosure of Invention
Aiming at the problems in the prior art, the invention provides a method, a system, equipment, a medium and application for monitoring remote large-screen playing content.
The invention is realized in this way, a method for monitoring the content played by a remote large screen, the monitoring method includes:
performing frame-by-frame disassembly on the played resources in advance at a server, calculating the fingerprint of each frame and storing the fingerprint;
during playing, the client extracts the current playing frame, calculates the fingerprint by adopting the same algorithm as the server, and then uploads the fingerprint to the server for comparison, if the exclusion time deviation exists, the playing resource is proved to be expected;
the client, the large-screen or large-screen broadcast control equipment periodically collects data which are currently broadcast and reports the collected data to the server;
and after the server disassembles the reported data, comparing the reported data with preset data.
Further, the data being played includes the name of the resource, the current device time, the fingerprint of the frame played to the last time and the current frame (the client side fingerprint algorithm needs to be consistent with the server side fingerprint algorithm).
Further, before reporting the collected data to the server, the following steps are required:
the server or the monitoring end disperses the code stream of the playing resources by taking a frame as a unit; calculating a fingerprint for each discrete result by adopting a certain fingerprint algorithm; storing each frame and the corresponding fingerprint in a hash table;
the server side disassembles the reported data and searches the reported frame from the hash table; if the content does not exist, the content played by the large screen is not the expected content; otherwise, comparing with the expected playing time, and if the deviation is within the allowable range, indicating that the playing is normal.
Further, after receiving the message sent by the client, the server of the remote large-screen playing content monitoring method disassembles the name of the video file, and finds out the corresponding fingerprint hash table H according to the name;
if H is empty, the client plays the video data unexpectedly; if the H is not empty, finding a frame subscript X corresponding to the fingerprint of the client from the H, wherein the value is the number of frames played by the client;
if X is empty, the video played by the client is not expected; if X is not null, assuming that the preset value of time deviation is delta, X is the frame number, beta is the number of frames per second of the video, T is the time (accurate to the second) for starting playing the current video preset by the server, L is the time (accurate to the second) for playing the current frame of the client, judging according to the following calculation formula,
L-δ≤(X/β+1+T)≤L+δ
if the calculated formula is satisfied, the playing is satisfied with the expectation.
Further, the method for monitoring the remote large-screen playing content comprises the following steps:
(1) starting;
(2) disassembling a client message to obtain a video name according to client information;
(3) judging whether a corresponding hash table exists according to the video name; if the corresponding hash table exists, executing the step (4); if the corresponding hash table does not exist, performing abnormal playing, and executing the step (7);
(4) judging whether a corresponding frame subscript is found; if the corresponding frame subscript is found, executing the step (5); if the corresponding frame subscript is not found, performing abnormal playing, and executing the step (7);
(5) judging whether the deviation is met; if the deviation is met, executing the step (6); if the deviation is not met, abnormal playing is carried out, and step (7) is executed;
(6) normally playing;
(7) and (6) ending.
Another object of the present invention is to provide a computer apparatus, which includes a memory and a processor, wherein the memory stores a computer program, and the computer program, when executed by the processor, causes the processor to execute the remote large-screen playing content monitoring method.
Another object of the present invention is to provide a computer-readable storage medium, which stores a computer program, and when the computer program is executed by a processor, the processor is caused to execute the remote large-screen playing content monitoring method.
Another object of the present invention is to provide an information data processing terminal, which is used for implementing the method for monitoring the remote large-screen playing content.
Another object of the present invention is to provide a remote large-screen playing content monitoring system for implementing the remote large-screen playing content monitoring method, wherein the remote large-screen playing content monitoring system includes:
the code stream discrete processing module is used for realizing the discrete processing of the code stream of the playing resource by the server side by taking a frame as a unit;
the fingerprint calculation module is used for calculating a fingerprint by adopting a certain fingerprint algorithm for each discrete result;
the fingerprint storage module is used for storing each frame and the corresponding fingerprint in a hash table;
the information acquisition module is used for realizing that the client or the large-screen broadcast control equipment periodically acquires the name of the resource currently being broadcast, the current equipment time, the broadcast to the next frame and the current frame fingerprint and reports the names to the server;
and the data disassembling processing module is used for disassembling the reported data by the server and searching the reported frame from the hash table, if the reported frame does not exist, the content played by the large screen is not the expected content, otherwise, the content is compared with the expected playing time, and if the content is within the deviation allowable range, the playing is normal.
Another object of the present invention is to provide an application of the method for monitoring remote large-screen playing content in monitoring unstructured data, wherein the unstructured data comprises video, sound and image.
By combining all the technical schemes, the invention has the advantages and positive effects that:
the invention provides a method for monitoring remote large-screen playing contents with low bandwidth occupancy rate, which can monitor whether a certain current large screen plays the appointed contents at the appointed time or not in real time.
According to the invention, a certain frame code stream collected by a client can be compressed to a fingerprint with a very small value, and summary messages generated after the summary is carried out on the certain frame code stream are necessarily different as long as the input messages are different according to a fingerprint algorithm; but the same input must produce the same output. Therefore, for the same resource file, as long as the same algorithm is adopted by the client and the server for each frame played, the fingerprint values are definitely consistent, and the fingerprint information is transmitted through the network and is far smaller than the original frame data. The server only needs to compare whether the fingerprint sent by the remote end is consistent with the server or not to judge whether the playing content is in accordance with the expectation or not.
The invention greatly reduces the bandwidth occupation, has simple algorithm and does not depend on AI algorithm and GPU. Compared with the conventional AI mode, the method has the advantages that the data acquisition cost is higher, and no complete project is done, and logically reasoning shows that the method reduces the bandwidth dependence and does not need AI resource consumption.
Drawings
Fig. 1 is a flowchart of a method for monitoring content played on a remote large screen according to an embodiment of the present invention.
Fig. 2 is a schematic structural diagram of a remote large-screen content monitoring system according to an embodiment of the present invention;
in fig. 2: 1. a code stream discrete processing module; 2. a fingerprint calculation module; 3. a fingerprint storage module; 4. an information acquisition module; 5. and the data disassembling and processing module.
Fig. 3 is a flowchart of an implementation of a method for monitoring content played on a remote large screen according to an embodiment of the present invention.
Fig. 4 is a schematic diagram of a fingerprint storage format of a video file after discretization according to an embodiment of the present invention.
Fig. 5 is a schematic diagram of reporting data by a client according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is further described in detail with reference to the following embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
In view of the problems in the prior art, the present invention provides a method, a system, a device, a medium and an application for monitoring a remote large-screen playing content, which are described in detail below with reference to the accompanying drawings.
As shown in fig. 1, the method for monitoring the content played on the remote large screen provided by the present invention includes the following steps:
s101: the server or the monitoring end disperses the code stream of the playing resources by taking a frame as a unit;
s102: calculating a fingerprint for each discrete result by adopting a certain fingerprint algorithm;
s103: storing each frame (which may be relative time) and the corresponding fingerprint in a hash table;
s104: the client, the large screen or the large screen broadcasting control equipment periodically collects the name of the resource currently being played, the current equipment time, the fingerprint of the current frame and the current frame when being played or the algorithm of the current frame is consistent with the algorithm of the server, and reports the name to the server;
s105: the server disassembles the reported data, searches reported frames from the hash table (the server disassembles the played resources frame by frame in advance, calculates fingerprints and stores the fingerprints), if the reported frames do not exist, the content played on the large screen is not the expected content, otherwise, the content is compared with the expected playing time, and if the reported frames are within the deviation allowable range, the playing is normal.
A person skilled in the art can also use other steps to implement the method for monitoring the remote large-screen playing content provided by the present invention, and the method for monitoring the remote large-screen playing content provided by the present invention in fig. 1 is only a specific embodiment.
As shown in fig. 2, the remote large-screen content monitoring system provided by the present invention includes:
the code stream discrete processing module 1 is used for realizing the discrete processing of the code stream of the playing resource by the service end by taking a frame as a unit;
the fingerprint calculation module 2 is used for calculating a fingerprint by adopting a certain fingerprint algorithm for each discrete result;
a fingerprint storage module 3, configured to store each frame and the corresponding fingerprint in a hash table;
the information acquisition module 4 is used for realizing that the client or the large-screen broadcast control equipment periodically acquires the name of the resource currently being broadcast, the current equipment time, the broadcast to the several frames and the current frame fingerprint and reports the information to the server;
and the data disassembling processing module 5 is used for disassembling the reported data by the server, searching the reported frame from the hash table, if the reported frame does not exist, the content played by the large screen is not the expected content, otherwise, the content is compared with the expected playing time, and if the content is within the deviation allowable range, the playing is normal.
The technical solution of the present invention is further described below with reference to the accompanying drawings.
As shown in fig. 3, the method for monitoring the content played on the remote large screen provided by the present invention specifically includes the following steps:
(1) starting;
(2) disassembling a client message to obtain a video name according to client information;
(3) judging whether a corresponding hash table exists according to the video name; if the corresponding hash table exists, executing the step (4); if the corresponding hash table does not exist, performing abnormal playing, and executing the step (7);
(4) judging whether a corresponding frame subscript is found; if the corresponding frame subscript is found, executing the step (5); if the corresponding frame subscript is not found, performing abnormal playing, and executing the step (7);
(5) judging whether the deviation is met; if the deviation is met, executing the step (6); if the deviation is not met, abnormal playing is carried out, and step (7) is executed;
(6) normally playing;
(7) and (6) ending.
The method for monitoring the remote large-screen playing content comprises the steps that a client, a large screen or large-screen playing control device periodically collects the name of a resource currently being played, the time of the current device, the fingerprints of the current frame and the current frame when the current frame is played or the algorithm of the current frame is consistent with that of a server, and reports the names, the time of the current device, the fingerprints of the current frame and the fingerprints of the server to the server; the server disassembles the reported data and searches the reported frame from the hash table (which can be other data search algorithms and is not limited to the hash table).
The object of the present invention is to monitor whether the content displayed on the current large screen meets the desired setting, while the patent of the second prior art aims to display the desired content on the large screen, which are different in nature. As for the reported frame searched in the hash table, the method is only a specific means for information identification and search, and of course, the method may be various, and is not limited to this.
The client, the large-screen or large-screen broadcast control equipment provided by the invention periodically collects the name of the currently played resource, the current equipment time, the fingerprints of the current frame and the current frame after being broadcast or the fingerprints are consistent with the algorithm of the server, and the client, the large-screen or large-screen broadcast control equipment needs to:
the server or the monitoring end disperses the code stream of the playing resources by taking a frame as a unit;
calculating a fingerprint for each discrete result by adopting a certain fingerprint algorithm;
each frame and corresponding fingerprint are stored in a hash table (which may be other data lookup algorithms and is not limited to hash tables).
The time of the client and the time of the server of the method for monitoring the remote large-screen playing content provided by the invention need to be kept basically consistent or a proper time deviation is set. Client and server fingerprinting algorithms need to be absolutely identical. The client can provide accurate data according to the requirements of the server.
Assuming that a video file a.mp4 is set, the server sets the rule that requires the device D to start playing from time T, the allowed time deviation is δ, the total length of the video is 60 seconds, and 60 frames per second, then the fingerprint storage format of the video file after dispersion is as shown in fig. 4.
Fig. 5 shows the data reported by the client.
After receiving the message sent by the client, the server disassembles the name of the video file, and finds out the corresponding fingerprint hash table H according to the name; if H is empty, the client plays the video data unexpectedly, and a frame subscript X corresponding to the client fingerprint is found from H; if X is empty, the video played by the client is not expected, and the fingerprint acquisition time after disassembly is assumed to be L; if L-delta is less than or equal to (X/60+1+ T) and less than or equal to L + delta, the playing is normal.
The following is a specific application case of the embodiment of the present invention.
Suppose we need to play a video a.mp4 on a remote large screen (device ID: DP01) for 10 minutes, requiring 12 months and 12 days in 2021 with 8:00 starting and 8:10 ending, with an allowable time offset of plus or minus 5 seconds.
1. Server side initialization
First, an a.mp4 video file is discretized, and assuming that a video is 60 frames per second, the total number of frames of the video file is 10 × 60 — 36000 frames, which is calculated according to the video duration of 10 minutes.
Fingerprint calculation is performed for each frame code stream, (MD5 (code stream of first frame)) -first frame fingerprint FG _1, where the fingerprint algorithm uses MD5, (MD5 (code stream of second frame)) -second frame fingerprint FG _ 2.
The data after discretization can be expressed as follows in the JSON format:
2. client sending heartbeat
Mp4 and the play start time are received by the client end large screen DP01, and a heartbeat of the play content is sent to the server end every 5 s.
The client starts playing the A.mp4 video file at 2021-12-1208:00 according to the designated time, and sends heartbeat to the server, and the heartbeat content can be expressed as follows according to the JSON format:
3. server side decision
When the server receives the heartbeat of the client, message disassembly is carried out, the fact that DP01 equipment is playing an A.mp4 video is known from two fields of deviceid and name, and meanwhile, the fact that the currently sent playing fingerprint time point is 2021-12-1208: 03 is known according to the time field.
And the server side searches the initialized information of the server side by using the information extracted in the last step, and finds that the deviceid and the name can be matched simultaneously.
And further extracting the current playing fingerprint from the FG field to be FG _1, searching in the source field through FG _1 to find that the corresponding value is 1, and calculating the time of the client for playing the frame, which is 2021-12-1208:01, by the server side by combining the playing start time 2021-12-1208:00 specified by the server side after the two are superposed.
At the moment, the time field of the client displays that the playing time of the frame on the large screen is 2021-12-1208: 03, the difference between the playing time and the playing time of the frame is 2 seconds and is within 5 seconds deviation required by the server, and therefore the server judges that the current large screen playing content meets the preset expectation.
It should be noted that the embodiments of the present invention can be realized by hardware, software, or a combination of software and hardware. The hardware portion may be implemented using dedicated logic; the software portions may be stored in a memory and executed by a suitable instruction execution system, such as a microprocessor or specially designed hardware. Those skilled in the art will appreciate that the apparatus and methods described above may be implemented using computer executable instructions and/or embodied in processor control code, such code being provided on a carrier medium such as a disk, CD-or DVD-ROM, programmable memory such as read only memory (firmware), or a data carrier such as an optical or electronic signal carrier, for example. The apparatus and its modules of the present invention may be implemented by hardware circuits such as very large scale integrated circuits or gate arrays, semiconductors such as logic chips, transistors, or programmable hardware devices such as field programmable gate arrays, programmable logic devices, etc., or by software executed by various types of processors, or by a combination of hardware circuits and software, e.g., firmware.
The above description is only for the purpose of illustrating the present invention and the appended claims are not to be construed as limiting the scope of the invention, which is intended to cover all modifications, equivalents and improvements that are within the spirit and scope of the invention as defined by the appended claims.
Claims (10)
1. A method for monitoring remote large-screen playing content is characterized in that the method for monitoring the remote large-screen playing content comprises the following steps:
performing frame-by-frame disassembly on the played resources in advance at a server, calculating the fingerprint of each frame and storing the fingerprint;
during playing, the client extracts the current playing frame, calculates the fingerprint by adopting the same algorithm as the server, and then uploads the fingerprint to the server for comparison, if the exclusion time deviation exists, the playing resource is proved to be expected;
the client, the large-screen or large-screen broadcast control equipment periodically collects data which are currently broadcast and reports the collected data to the server;
and after the server disassembles the reported data, comparing the reported data with preset data.
2. The method for monitoring the content played on the remote large screen according to claim 1, wherein the data being played includes the name of the resource, the current device time, the fingerprint of the frame played to the last frame and the current frame.
3. The method for monitoring the content played on the remote large screen according to claim 1, wherein before reporting the collected data to the server, the following steps are required:
the server or the monitoring end disperses the code stream of the playing resources by taking a frame as a unit; calculating a fingerprint for each discrete result by adopting a certain fingerprint algorithm; storing each frame and the corresponding fingerprint in a hash table;
the server side disassembles the reported data and searches the reported frame from the hash table; if the content does not exist, the content played by the large screen is not the expected content; otherwise, comparing with the expected playing time, and if the deviation is within the allowable range, indicating that the playing is normal.
4. The method for monitoring the remote large-screen playing content according to claim 1, wherein after receiving the message sent by the client, the server of the method for monitoring the remote large-screen playing content disassembles the name of the video file, and finds the corresponding fingerprint hash table H by the name;
if H is empty, the client plays the video data unexpectedly; if the H is not empty, finding a frame subscript X corresponding to the fingerprint of the client from the H, wherein the value is the number of frames played by the client;
if X is empty, the video played by the client is not expected; if X is not null, assuming that the preset value of time deviation is delta, X is the frame number, beta is the number of frames per second of the video, T is the time for starting playing of the current video preset by the server, L is the time for playing of the current frame of the client, and judging according to the following calculation formula that L-delta is less than or equal to (X/beta +1+ T) and less than or equal to L + delta
If the calculated formula is satisfied, the playing is satisfied with the expectation.
5. The method for monitoring the remote large-screen playing content according to claim 1, wherein the method for monitoring the remote large-screen playing content comprises the following steps:
(1) starting;
(2) disassembling a client message to obtain a video name according to client information;
(3) judging whether a corresponding hash table exists according to the video name; if the corresponding hash table exists, executing the step (4); if the corresponding hash table does not exist, performing abnormal playing, and executing the step (7);
(4) judging whether a corresponding frame subscript is found; if the corresponding frame subscript is found, executing the step (5); if the corresponding frame subscript is not found, performing abnormal playing, and executing the step (7);
(5) judging whether the deviation is met; if the deviation is met, executing the step (6); if the deviation is not met, abnormal playing is carried out, and step (7) is executed;
(6) normally playing;
(7) and (6) ending.
6. A computer device comprising a memory and a processor, wherein the memory stores a computer program, and the computer program, when executed by the processor, causes the processor to perform the method for monitoring remote large-screen content according to any one of claims 1 to 5.
7. A computer-readable storage medium storing a computer program which, when executed by a processor, causes the processor to execute the method for monitoring remote large-screen playback content according to any one of claims 1 to 5.
8. An information data processing terminal, characterized in that the information data processing terminal is used for implementing the method for monitoring the remote large-screen playing content according to any one of claims 1 to 5.
9. A remote large-screen playing content monitoring system for realizing the remote large-screen playing content monitoring method according to any one of claims 1 to 5, wherein the remote large-screen playing content monitoring system comprises:
the code stream discrete processing module is used for realizing the discrete processing of the code stream of the playing resource by the server side by taking a frame as a unit;
the fingerprint calculation module is used for calculating a fingerprint by adopting a certain fingerprint algorithm for each discrete result;
the fingerprint storage module is used for storing each frame and the corresponding fingerprint in a hash table;
the information acquisition module is used for realizing that the client or the large-screen broadcast control equipment periodically acquires the name of the resource currently being broadcast, the current equipment time, the broadcast to the next frame and the current frame fingerprint and reports the names to the server;
and the data disassembling processing module is used for disassembling the reported data by the server and searching the reported frame from the hash table, if the reported frame does not exist, the content played by the large screen is not the expected content, otherwise, the content is compared with the expected playing time, and if the content is within the deviation allowable range, the playing is normal.
10. The application of the method for monitoring the remote large-screen playing content according to any one of claims 1 to 5 in the monitoring of unstructured data, wherein the unstructured data comprises video, sound and images.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111632226.XA CN114339416A (en) | 2021-12-29 | 2021-12-29 | Method, system, equipment, medium and application for monitoring far-end large-screen playing content |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111632226.XA CN114339416A (en) | 2021-12-29 | 2021-12-29 | Method, system, equipment, medium and application for monitoring far-end large-screen playing content |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114339416A true CN114339416A (en) | 2022-04-12 |
Family
ID=81014282
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111632226.XA Pending CN114339416A (en) | 2021-12-29 | 2021-12-29 | Method, system, equipment, medium and application for monitoring far-end large-screen playing content |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114339416A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101021888A (en) * | 2007-03-20 | 2007-08-22 | 陆小潮 | Monitoring device and method for digital multimedia content playing |
| CN102158740A (en) * | 2011-03-22 | 2011-08-17 | 北京九华互联科技有限公司 | Method for locally monitoring multimedia playing |
| CN107318041A (en) * | 2017-06-29 | 2017-11-03 | 深圳市茁壮网络股份有限公司 | The method and system that a kind of Video security is played |
| CN107851104A (en) * | 2015-04-23 | 2018-03-27 | 索伦森媒体有限公司 | Automated content identification fingerprint sequence matching |
| CN110929656A (en) * | 2019-11-27 | 2020-03-27 | 中铁程科技有限责任公司 | Advertisement putting monitoring method, device and system based on image recognition |
| CN112423033A (en) * | 2020-11-20 | 2021-02-26 | 山东海看新媒体研究院有限公司 | Remote monitoring and broadcasting platform, system and method |
| CN113313036A (en) * | 2021-06-01 | 2021-08-27 | 北京市博汇科技股份有限公司 | Method and system for detecting program playing state |
-
2021
- 2021-12-29 CN CN202111632226.XA patent/CN114339416A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101021888A (en) * | 2007-03-20 | 2007-08-22 | 陆小潮 | Monitoring device and method for digital multimedia content playing |
| CN102158740A (en) * | 2011-03-22 | 2011-08-17 | 北京九华互联科技有限公司 | Method for locally monitoring multimedia playing |
| CN107851104A (en) * | 2015-04-23 | 2018-03-27 | 索伦森媒体有限公司 | Automated content identification fingerprint sequence matching |
| CN107318041A (en) * | 2017-06-29 | 2017-11-03 | 深圳市茁壮网络股份有限公司 | The method and system that a kind of Video security is played |
| CN110929656A (en) * | 2019-11-27 | 2020-03-27 | 中铁程科技有限责任公司 | Advertisement putting monitoring method, device and system based on image recognition |
| CN112423033A (en) * | 2020-11-20 | 2021-02-26 | 山东海看新媒体研究院有限公司 | Remote monitoring and broadcasting platform, system and method |
| CN113313036A (en) * | 2021-06-01 | 2021-08-27 | 北京市博汇科技股份有限公司 | Method and system for detecting program playing state |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20220046292A1 (en) | Networked system for real-time computer-aided augmentation of live input video stream | |
| US9819973B2 (en) | Embedded appliance for multimedia capture | |
| US6864901B2 (en) | Real-time screen recording system | |
| CN111723558A (en) | Document display method and device, electronic equipment and storage medium | |
| CN104918137A (en) | Method enabling spliced screen system to play videos | |
| CN111541913A (en) | Video playing method and device of spliced screen, computer equipment and medium | |
| CN106603537A (en) | System and method for marking video signal source of mobile intelligent terminal | |
| CN114339416A (en) | Method, system, equipment, medium and application for monitoring far-end large-screen playing content | |
| US20190200057A1 (en) | Streaming system with a backup mechanism and a backup method thereof | |
| CN114222190B (en) | Remote control processing and response method and device, equipment, medium and product thereof | |
| WO2018003685A1 (en) | Image compressing method, image reconstructing method, image compressing device, image reconstructing device, image compressing program product, and image reconstructing program product | |
| CN111356009B (en) | Audio data processing method and device, storage medium and terminal | |
| JP6284172B1 (en) | Screen image transfer method, image restoration method, screen image transfer system, image restoration system, screen image transfer program, image restoration program, image compression method, image compression system, image compression program | |
| TW201434310A (en) | Digital signage playback system, real-time monitoring system, and real-time monitoring method thereof | |
| AU2019204751B2 (en) | Embedded appliance for multimedia capture | |
| CN117979100A (en) | Playing control method for athletic event, electronic equipment and readable storage medium | |
| KR102319668B1 (en) | Remote control system for semiconductor manuacturing equipment using deep learning | |
| US10984837B2 (en) | Display, method for monitoring played content and system using the same | |
| CN110691256B (en) | Video associated information processing method and device, server and storage medium | |
| CN116684317A (en) | Interactive service monitoring method based on signaling analysis | |
| CN117149122A (en) | Method, device, system, equipment and medium for on-screen interaction | |
| CN117793285A (en) | Video conference monitoring method, system, equipment and storage medium | |
| US20050253838A1 (en) | Key-frame processor for computer system | |
| CN112511891A (en) | Recording file processing method, device, equipment and medium | |
| AU2013254937B2 (en) | Embedded Appliance for Multimedia Capture |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20220412 |