CN113825022A - Play control state detection method and device, storage medium and electronic equipment - Google Patents

Play control state detection method and device, storage medium and electronic equipment Download PDF

Info

Publication number
CN113825022A
CN113825022A CN202111033813.7A CN202111033813A CN113825022A CN 113825022 A CN113825022 A CN 113825022A CN 202111033813 A CN202111033813 A CN 202111033813A CN 113825022 A CN113825022 A CN 113825022A
Authority
CN
China
Prior art keywords
audio
player
playing
control state
similarity
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202111033813.7A
Other languages
Chinese (zh)
Other versions
CN113825022B (en
Inventor
文锐烽
于雪松
熊磊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chengdu Oppo Communication Technology Co ltd
Original Assignee
Chengdu Oppo Communication Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chengdu Oppo Communication Technology Co ltd filed Critical Chengdu Oppo Communication Technology Co ltd
Priority to CN202111033813.7A priority Critical patent/CN113825022B/en
Publication of CN113825022A publication Critical patent/CN113825022A/en
Application granted granted Critical
Publication of CN113825022B publication Critical patent/CN113825022B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44204—Monitoring of content usage, e.g. the number of times a movie has been viewed, copied or the amount which has been watched

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Television Signal Processing For Recording (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The application discloses a play control state detection method, a play control state detection device, a storage medium and electronic equipment, wherein the method comprises the following steps: if the state switching of the playing control state of the player is detected, the display timestamp of the playing content in the player is acquired, the detection audio and video information corresponding to the display timestamp is acquired in the playing content, the source audio and video data corresponding to the playing content is acquired, the sample audio and video information corresponding to the display timestamp is acquired in the source audio and video data, and the state detection result of the playing control state of the player is acquired based on the information similarity of the detection audio and video information and the sample audio and video information. By adopting the method and the device, whether the playing control state of the player is normal is judged by detecting whether the playing content is similar to the source audio and video data when the playing control state is switched, so that steps and time required for detecting the playing control state of the player are reduced, the detection cost is reduced, and the detection efficiency is improved.

Description

Play control state detection method and device, storage medium and electronic equipment
Technical Field
The present application relates to the field of computer technologies, and in particular, to a method and an apparatus for detecting a play control state, a storage medium, and an electronic device.
Background
The player refers to software capable of playing video or audio files stored in a digital signal form, and users often switch the playing state of the player when playing video by using the player, for example, a pause state is switched to a state for starting playing, and when some players switch the playing state, the audio and video are not synchronous, that is, the sound and the picture are not synchronous, due to problems such as decoding errors, so that the playing control state of the player needs to be detected.
Disclosure of Invention
The embodiment of the application provides a method and a device for detecting a playing control state, a storage medium and an electronic device, which can judge whether the playing control state of a player is normal or not by detecting whether playing content is similar to source audio and video data when the playing control state is switched, reduce steps and time required for detecting the playing control state of the player, reduce detection cost and improve detection efficiency. The technical scheme is as follows:
in a first aspect, an embodiment of the present application provides a method for detecting a play control state, where the method includes:
if the situation that the playing control state of the player is switched is detected, acquiring a display timestamp of playing content in the player;
acquiring the detected audio and video information corresponding to the display timestamp from the playing content;
acquiring source audio and video data corresponding to the playing content, and acquiring sample audio and video information corresponding to the display timestamp from the source audio and video data;
and acquiring a state detection result of the playing control state of the player based on the information similarity of the detected audio and video information and the sample audio and video information.
In a second aspect, an embodiment of the present application provides a status detection apparatus, including:
the device comprises a timestamp acquisition module, a display module and a display module, wherein the timestamp acquisition module is used for acquiring a display timestamp of playing content in a player if the condition switching of the playing control state of the player is detected;
the target information acquisition module is used for acquiring the detected audio and video information corresponding to the display timestamp from the playing content;
the sample information acquisition module is used for acquiring source audio and video data corresponding to the playing content and acquiring sample audio and video information corresponding to the display timestamp from the source audio and video data;
and the result acquisition module is used for acquiring the state detection result of the playing control state of the player based on the information similarity of the detected audio and video information and the sample audio and video information.
In a third aspect, embodiments of the present application provide a computer storage medium storing a plurality of instructions adapted to be loaded by a processor and to perform the above-mentioned method steps.
In a fourth aspect, an embodiment of the present application provides an electronic device, which may include: a processor and a memory; wherein the memory stores a computer program adapted to be loaded by the processor and to perform the above-mentioned method steps.
The beneficial effects brought by the technical scheme provided by some embodiments of the application at least comprise:
in one or more embodiments of the present application, if it is detected that a play control state of a player has a state switch, a display timestamp of play content in the player is acquired, detection audio and video information corresponding to the display timestamp is acquired in the play content, source audio and video data corresponding to the play content is acquired in the source audio and video data, sample audio and video information corresponding to the display timestamp is acquired, and a state detection result of the play control state of the player is acquired based on the detection audio and video information and information similarity of the sample audio and video information. Whether the playing control state of the player is normal or not is judged by detecting whether the playing content is similar to the source audio and video data when the playing control state is switched, so that steps and time required for detecting the playing control state of the player are reduced, the detection cost is reduced, and the detection efficiency is improved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic structural diagram of a state detection apparatus according to an embodiment of the present disclosure;
fig. 2 is a schematic flowchart of a method for detecting a play control state according to an embodiment of the present application;
fig. 3 is a schematic flowchart of a method for detecting a play control state according to an embodiment of the present application;
fig. 4 is an exemplary schematic diagram of detecting acquisition of audio/video information according to an embodiment of the present application;
fig. 5 is an exemplary schematic diagram of source audio/video data acquisition provided in an embodiment of the present application;
fig. 6 is a schematic structural diagram of a state detection apparatus according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of a state detection apparatus according to an embodiment of the present application;
fig. 8 is a schematic structural diagram of an electronic device according to an embodiment of the present application;
FIG. 9 is a schematic structural diagram of an operating system and a user space provided in an embodiment of the present application;
FIG. 10 is an architectural diagram of the android operating system of FIG. 8;
FIG. 11 is an architectural diagram of the IOS operating system of FIG. 8.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
In the description of the present application, it is to be understood that the terms "first," "second," and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. In the description of the present application, it is noted that, unless explicitly stated or limited otherwise, "including" and "having" and any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus. The specific meaning of the above terms in the present application can be understood in a specific case by those of ordinary skill in the art. Further, in the description of the present application, "a plurality" means two or more unless otherwise specified. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship.
The playing control state detection method provided by the embodiment of the application can be realized by depending on a computer program and can be operated on a state detection device based on a Von Neumann system. The computer program may be integrated into the application or may run as a separate tool-like application. The play control state detection device in the embodiment of the application can be an electronic device such as a television, a mobile phone, a personal computer, a tablet computer, a handheld device and the like, and can also be a module for realizing the play control state detection method in the electronic device. The state detection device can be used for detecting the playing control state of a player, the player is software capable of playing audio and video files stored in a digital signal form, and can also be an electronic device product with the function of playing the audio and video files, the player carries a decoder to restore compressed media data, the audio and video data can be played on the player by decoding the media data, the audio and video data comprises audio data and video data, the audio data is digitized sound data, and the video data is composed of at least one frame of continuous image frames. The player has different playing states, such as a pause state, a play starting state, a play stopping state, a play time point switching state and the like, and the play control state of the player indicates whether the player is correctly and timely switched among the different playing states, whether the audio and video data after the playing state switching can be correctly decoded, such as whether the audio and video are synchronous or not after the playing state switching, and whether the screen-blooming phenomenon exists or not. The state detection device can detect the playing control state of the player and acquire the state detection result of the player.
Referring to fig. 1, a schematic structural diagram of a status detection apparatus according to an embodiment of the present disclosure is shown, where the status detection apparatus includes a player, a status detection module, an information acquisition module, a source data acquisition module, and a processor. The player is connected with the state detection module, the player is connected with the information acquisition module, the state detection module is connected with the processor, the state detection module is connected with the information acquisition module, the information acquisition module is connected with the processor, and the information acquisition module is connected with the source data acquisition module. The player can be software which is installed in the state detection device and can play audio and video files stored in a digital signal form, or can be software which is installed in other terminal equipment and can play audio and video, or an electronic device product with the function of playing the audio and video files. The state detection module can detect whether there is a state switch in the playing control state of the player, for example, a state switch from the playing state to the pause state, or a state switch from the pause state to the playing stop state, etc. When the state detection module detects that the playing control state of the player is switched, the state detection module acquires a display time stamp of playing content in the player, generates data acquisition information based on the display time stamp, and transmits the data acquisition information to the information acquisition module. The player has a decoder, the player decodes the audio/video file by using the decoder to obtain playing content, and plays the playing content obtained by decoding in the player, the display timestamp is a Predetermined Time System (PTS) timestamp corresponding to the player when the state is switched, the PTS timestamp is used for indicating the display sequence of the player for the image frames, that is, each frame of the image frame in the playing content has a corresponding PTS timestamp, and the player displays the image frames in the playing content frame by frame according to the PTS timestamp. Therefore, when the state detection module detects the state switch, the current PTS timestamp is obtained from the player as the display timestamp. The information acquisition module acquires a display timestamp in the data acquisition information after receiving the data acquisition information, acquires detection audio and video information corresponding to the display timestamp in playing content, the detection audio and video information is a detection image frame and a detection audio clip corresponding to the display timestamp of the playing content of the player, the detection image frame can be an image frame displayed on the player when the display timestamp of the playing content is displayed, and the detection audio clip can be an audio clip with preset duration as clip length and using the display timestamp as starting time in the playing content. And then the information acquisition module acquires a playing path of the playing content in the player, wherein the playing path can be a storage address of the playing content in a local storage or a network address. The information acquisition module transmits the playing path to the source data acquisition module, the source data acquisition module finds source audio and video data corresponding to playing contents according to the playing path and transmits the source audio and video data to the information acquisition module, the method for detecting audio and video information is obtained by analogy, the information acquisition module can also obtain sample audio and video information corresponding to the source audio and video information at a display time stamp, and similarly, the sample audio and video information can comprise a sample image frame and a sample audio fragment.
The information acquisition module transmits the detected audio and video information and the sample audio and video information to the processor, the processor calculates the information similarity of the detected audio and video information and the sample audio and video information, and acquires a state detection result of the playing control state of the player according to the information similarity. The processor may obtain image similarity between the detected image frame and the sample image frame, and obtain audio similarity between the detected audio clip and the sample audio clip, and the information similarity may be composed of the image similarity and the audio similarity. The processor may obtain the image Similarity by comparing Peak Signal to Noise Ratio (PSNR), Structural Similarity (SSIM), and the like, and may obtain the audio Similarity by comparing audio fingerprints. If the image similarity is greater than or equal to the image similarity threshold and the audio similarity is greater than or equal to the audio similarity threshold, it represents that the detected audio and video information and the sample audio and video information are the same or similar, and the audio and video of the player after the playing control state is switched are synchronous, the processor outputs a first detection result, which can indicate that the playing control state of the player is normal and accurate, and the audio and video are synchronous in the playing process of the player. If the image similarity is smaller than the image similarity threshold and/or the audio similarity is smaller than the audio similarity threshold, the processor outputs a second detection result, and the second detection result can indicate that the playing control state of the player is abnormal and inaccurate, audio and video asynchronization exists in the playing process of the player, and related workers need to repair and adjust the player.
The following describes the playback control state detection method provided by the present application in detail with reference to specific embodiments.
Please refer to fig. 2, which is a flowchart illustrating a method for detecting a playback control state according to an embodiment of the present application. As shown in fig. 2, the method of the embodiment of the present application may include the following steps S101-S104.
S101, if the situation that the playing control state of the player is switched is detected, the display time stamp of the playing content in the player is obtained.
Specifically, the state detection device can detect the playing control state of the player and can acquire the state detection result of the player, and when the state detection device is required to detect the player, if the player is software capable of playing audio and video files, the player can be installed on the state detection device; if the player is already installed on other terminal equipment or the player is an electronic device product with an audio/video file, the terminal equipment or the player with the player installed can be connected with the state detection device. The player is started, and the state detection means can detect when the playing control state of the player is switched to a state, such as when the player is switched from a pause state to a play start state, or when the playing time point is switched. When the state detection device detects that the playing control state of the player is switched, the display time stamp of the playing content in the player is acquired.
And S102, acquiring the detected audio and video information corresponding to the display time stamp in the playing content.
Specifically, the state detection device may acquire detected audio and video information corresponding to the display timestamp from the playing content, the detected audio and video information is detected image frames and detected audio segments corresponding to the display timestamp from the playing content, the detected image frames may be image frames displayed on the player when the display timestamp of the playing content is detected, and the detected audio segments may be audio segments having a preset duration as a segment length and using the display timestamp as a start time in the playing content.
S103, acquiring source audio and video data corresponding to the playing content, and acquiring sample audio and video information corresponding to the display timestamp from the source audio and video data.
Specifically, the state detection device may further obtain a playing path of the playing content, where the playing path may be a storage address of the playing content in the local storage, or may be a network address. The state detection device can find source audio and video data corresponding to playing content according to a playing path, and obtain sample audio and video information corresponding to a display timestamp in the source audio and video data, the sample audio and video information can include a sample image frame and a sample audio clip corresponding to the source audio and video data in the display timestamp, the sample image frame can be an image frame corresponding to the display timestamp in the source audio and video data, and the sample audio clip can be an audio clip with preset duration as clip length and with the displayed timestamp as start time in the source audio and video data.
And S104, acquiring a state detection result of the playing control state of the player based on the information similarity of the detected audio and video information and the sample audio and video information.
Specifically, the state detection device may calculate information similarity between the detected audio/video information and the sample audio/video information, and obtain a state detection result of the play control state of the player according to the information similarity, the state detection device may obtain image similarity between the detected image frame and the sample image frame, and obtain audio similarity between the detected audio clip and the sample audio clip, and the information similarity may be composed of the image similarity and the audio similarity. If the image similarity is greater than or equal to the image similarity threshold and the audio similarity is greater than or equal to the audio similarity threshold, it means that the detected audio and video information and the sample audio and video information are the same or similar, and the audio and video of the player after the state switching occurs are synchronous, the state detection device can output a first detection result, and the first detection result can indicate that the playing control state of the player is normal and accurate, and the audio and video are synchronous in the playing process of the player. If the image similarity is smaller than the image similarity threshold and/or the audio similarity is smaller than the audio similarity threshold, the state detection device can output a second detection result, and the second detection result can indicate that the playing control state of the player is abnormal and inaccurate, and audio and video asynchronization exists in the playing process of the player, so that relevant workers need to repair and adjust the player.
In the embodiment of the application, if the state switching of the playing control state of the player is detected, the display time stamp of the playing content in the player is acquired, the detection audio and video information corresponding to the display time stamp is acquired in the playing content, the source audio and video data corresponding to the playing content is acquired in the source audio and video data, the sample audio and video information corresponding to the display time stamp is acquired, and the state detection result of the playing control state of the player is acquired based on the information similarity of the detection audio and video information and the sample audio and video information. Whether the playing control state of the player is normal or not is judged by detecting whether the playing content is similar to the source audio and video data when the playing control state is switched, so that steps and time required for detecting the playing control state of the player are reduced, the detection cost is reduced, and the detection efficiency is improved.
Please refer to fig. 3, which is a flowchart illustrating a method for detecting a playback control state according to an embodiment of the present application. As shown in fig. 3, the method of the embodiment of the present application may include the following steps S201-S206.
S201, if it is detected that the playing control state of the player has state switching, acquiring a display time stamp of playing content in the player.
Specifically, the state detection device can detect the playing control state of the player and can acquire the state detection result of the player, and when the state detection device is required to detect the player, if the player is software capable of playing audio and video files, the player can be installed on the state detection device; if the player is already installed on other terminal equipment or the player is an electronic device product with an audio/video file, the terminal equipment or the player with the player installed can be connected with the state detection device. The player is started, and the state detection means can detect when the playing control state of the player is switched to a state, such as when the player is switched from a pause state to a play start state, or when the playing time point is switched. When the state detection device detects that the playing control state of the player is switched, the display time stamp of the playing content in the player is acquired.
Optionally, a PTS time stamp obtaining interface exists in a decoder in the player, and when the state detection device detects that the play control state of the player is switched, the PTS time stamp obtaining interface may obtain a current PTS time stamp from the decoder in the player, and use the current PTS time stamp as the display time stamp.
S202, obtaining a detection image frame corresponding to the display time stamp in the playing content, and obtaining a detection audio clip corresponding to the display time stamp in the playing content.
Specifically, the state detection device can acquire a detection image frame corresponding to the display timestamp in the playing content, the detection image frame can be an image frame displayed on the player when the state of the player is switched, and acquire a detection audio clip corresponding to the display timestamp in the playing content, the starting time of the detection audio clip is the display timestamp, the length of the clip is preset duration, and the detection image frame and the detection audio clip form detection audio and video information.
Referring to fig. 4, which is a schematic view illustrating an exemplary method for detecting acquisition of audio/video information according to an embodiment of the present disclosure, the player in fig. 4 is switched from a playing state to a paused state, when the state detection device detects that the playing control state of the player is switched, the state detection device acquires a current PTS timestamp of the player, and uses the current PTS timestamp as a display timestamp of playing content, where the PTS timestamp of the playing content of the player shown in fig. 4 is t1Then the display timestamp is t1Then, the state detection device will obtain the detected image frame corresponding to the display time stamp, i.e. the image frame displayed on the player at this time, and use t1And the audio clip with the preset duration as the clip length is the detection audio clip for the starting time.
S203, acquiring a playing path of the playing content of the player, and acquiring source audio and video data based on the playing path.
Specifically, the state detection device can acquire a playing path of playing content in the player, and if the player plays an audio/video file in the local storage, the state detection device can acquire a storage address of the playing content in the local storage and find source audio/video data of the playing content according to the storage address; if the player plays an audio/video file in the network, the state detection device may obtain a network address of the playing content, and find the source audio/video data according to the network address, for example, if the playing content in the player is obtained from the server, the state detection device may obtain a file identifier of the playing content, where the file identifier may be a name, a version number, and the like of the playing content, and send a data obtaining request to the server according to the file identifier, and the server may find the source audio/video data according to the file identifier and send the source audio/video data to the state detection device.
Referring to fig. 5, which is an exemplary schematic diagram of source audio/video data acquisition provided in the embodiment of the present application, if the playing content in the player is acquired from the local storage, the state detection device may acquire a storage address of the playing content, and find the source audio/video data in the local storage according to the storage address; if the player plays a network audio/video file in the server, the state detection device can acquire a file identifier of playing content, generate a data acquisition request containing the file identifier, send the data acquisition request to the server, and the server finds source audio/video data according to the data acquisition request and sends the source audio/video data to the state detection device.
And S204, acquiring a sample image frame corresponding to the display timestamp in the source audio and video data, and acquiring a sample audio clip corresponding to the display timestamp in the source audio and video data.
Specifically, the state detection device can acquire a sample image frame corresponding to a display timestamp in the source audio/video data and acquire a sample audio clip corresponding to the display timestamp in the source audio/video data, the start time of the sample audio clip is the display timestamp, the clip length is a preset duration, and the sample image frame and the sample audio clip form sample audio/video information.
S205, obtaining image similarity of the detection image frame and the sample image frame, obtaining audio similarity of the detection audio clip and the sample audio clip, wherein the image similarity and the audio similarity constitute information similarity.
Specifically, the state detection device may calculate information similarity between the detected audio/video information and the sample audio/video information, and obtain a state detection result of the play control state of the player according to the information similarity, the state detection device may obtain image similarity between the detected image frame and the sample image frame, and obtain audio similarity between the detected audio clip and the sample audio clip, and the information similarity may be composed of the image similarity and the audio similarity. The state detection device can obtain the image similarity by comparing the peak signal-to-noise ratio and the structural similarity of the detected image frame and the sample image frame, and can obtain the audio similarity by comparing the sound fingerprints of the detected audio fragment and the sample audio fragment.
S206, based on the information similarity, obtaining a state detection result of the playing control state of the player.
Specifically, the state detection device may obtain a state detection result of the play control state of the player according to the information similarity.
Optionally, if the image similarity is greater than or equal to the image similarity threshold, and the audio similarity is greater than or equal to the audio similarity threshold, it means that the detected audio and video information and the sample audio and video information are the same or similar, and the audio and video of the player after the state switching occurs are synchronous, the state detection device may output a first detection result, where the first detection result may indicate that the playing control state of the player is normal and accurate, and the audio and video are synchronous in the playing process of the player. If the image similarity is smaller than the image similarity threshold and/or the audio similarity is smaller than the audio similarity threshold, the state detection device may output a second detection result, where the second detection result may indicate that the playing control state of the player is abnormal and inaccurate, and there is a phenomenon of audio and video asynchronization during the playing process of the player, and the relevant staff needs to repair and adjust the player.
Optionally, the state detection device may detect whether the audio and video files are synchronized after the state of the player is switched, and may also detect whether the decoding of the audio and video files by the player after the state is switched is correct, and whether the phenomena such as screen splash and screen blackness occur. If the similarity of the moral image detected by the state detection device is smaller than the image similarity threshold, the fact that the detected image frame is not similar to the sample image frame is represented, the state detection device performs screen splash detection processing on the detected image frame and detects a screen splash part in the detected image frame, if the state detection device detects that the detected image frame has the screen splash part, a third detection result of the playing control state of the player is output, and the third detection result can represent that the player has a screen splash phenomenon in playing contents due to the fact that the player decodes the audio and video files wrongly after the state switching, and related workers are required to correct the player.
Optionally, in a specific use of the player, the state switching occurs mostly because a user sends an instruction to the player, for example, when the user clicks a "pause" button, the player is switched from the playing state to the pause state, and the user drags the progress bar, so that the player will have a playing time point switching state. It can be understood that the time when the state detection device detects that the state switching exists in the playing control state of the player is the time when the player receives the instruction for the state switching and starts to perform the state switching, that is, the display timestamp is displayed, if the state detection device detects that the playing control state switching of the player is completed, the switching timestamp of the playing content is obtained, if the difference between the switching timestamp and the display timestamp is greater than the difference threshold, it indicates that the player does not complete the state switching immediately after receiving the instruction, and the state switching is completed after a certain time, for example, the player does not pause immediately after clicking a "pause" button by the user, but pauses after continuing to play for a certain time. The state detection device may output a fourth detection result of the playing control state of the player, where the fourth detection result may indicate that the player completes the state switching in time, and a certain delay may occur, and the player needs to be corrected by a relevant worker.
In the embodiment of the application, if it is detected that the playing control state of the player is switched, the display time stamp of the playing content in the player is acquired, the detection audio and video information corresponding to the display time stamp is acquired from the playing content, the playing path of the playing content is acquired, the source audio and video data corresponding to the playing content is acquired according to the playing path, the sample audio and video information corresponding to the display time stamp is acquired from the source audio and video data, and the state detection result of the playing control state of the player is acquired based on the information similarity of the detection audio and video information and the sample audio and video information. Whether the playing control state of the player is normal or not is judged by detecting whether the playing content is similar to the source audio and video data when the playing control state is switched, so that steps and time required for detecting the playing control state of the player are reduced, the detection cost is reduced, and the detection efficiency is improved. If the image similarity and the audio similarity are both smaller than the similarity threshold, the audio and the video after state switching are synchronous, and if the image similarity is smaller than the image similarity threshold and/or the audio similarity is smaller than the audio similarity threshold, the audio and the video after state switching are asynchronous. Meanwhile, the state detection device can detect whether the player decodes correctly after state switching, whether phenomena such as screen splash and screen blacking occur, and whether state switching of the player is timely and whether time delay occurs, so that detection items of the state detection device on the playing control state of the player are enriched, and the detection effect of the state detection device on the player is improved.
The condition detecting device provided by the embodiment of the present application will be described in detail with reference to fig. 6 to 7. It should be noted that, the playback control state detection apparatus shown in fig. 6-fig. 7 is used for executing the method of the embodiment shown in fig. 2 and fig. 3 of the present application, and for convenience of description, only the portion related to the embodiment of the present application is shown, and details of the specific technology are not disclosed, please refer to the embodiment shown in fig. 2 and fig. 3 of the present application.
Please refer to fig. 6, which shows a schematic structural diagram of a state detection apparatus according to an exemplary embodiment of the present application. The playback control state detection means may be implemented as all or part of the apparatus by software, hardware, or a combination of both. The apparatus 1 includes a time stamp obtaining module 11, a target information obtaining module 12, a sample information obtaining module 13, and a result obtaining module 14.
A timestamp obtaining module 11, configured to obtain a display timestamp of playing content in a player if it is detected that a playback control state of the player has a state switch;
the target information acquisition module 12 is configured to acquire detected audio/video information corresponding to the display timestamp from the playing content;
a sample information obtaining module 13, configured to obtain source audio/video data corresponding to the playing content, and obtain sample audio/video information corresponding to the display timestamp in the source audio/video data;
and the result obtaining module 14 is configured to obtain a state detection result of the playing control state of the player based on the information similarity between the detected audio/video information and the sample audio/video information.
In this embodiment, if it is detected that a state switching exists in a play control state of a player, a display timestamp of play content in the player is acquired, detected audio/video information corresponding to the display timestamp is acquired in the play content, source audio/video data corresponding to the play content is acquired, sample audio/video information corresponding to the display timestamp is acquired in the source audio/video data, and a state detection result of the play control state of the player is acquired based on information similarity between the detected audio/video information and the sample audio/video information. Whether the playing control state of the player is normal or not is judged by detecting whether the playing content is similar to the source audio and video data when the playing control state is switched, so that steps and time required for detecting the playing control state of the player are reduced, the detection cost is reduced, and the detection efficiency is improved.
Please refer to fig. 7, which shows a schematic structural diagram of a state detection apparatus according to an exemplary embodiment of the present application. The playback control state detection means may be implemented as all or part of the apparatus by software, hardware, or a combination of both. The device 1 includes a timestamp acquisition module 11, a target information acquisition module 12, a sample information acquisition module 13, a result acquisition module 14, an overlap screen detection module 15, and a switch time detection module 16.
A timestamp obtaining module 11, configured to obtain a display timestamp of playing content in a player if it is detected that a playback control state of the player has a state switch;
the target information acquisition module 12 is configured to acquire detected audio/video information corresponding to the display timestamp from the playing content;
optionally, the target information obtaining module 12 is specifically configured to obtain a detection image frame corresponding to the display timestamp in the playing content;
and acquiring a detection audio clip corresponding to the display timestamp in the playing content, wherein the starting time of the detection audio clip is the display timestamp, the length of the clip is a preset duration, and the detection image frame and the detection audio clip form detection audio and video information.
A sample information obtaining module 13, configured to obtain source audio/video data corresponding to the playing content, and obtain sample audio/video information corresponding to the display timestamp in the source audio/video data;
optionally, the sample information obtaining module 13 is specifically configured to obtain source audio/video data corresponding to the playing content;
acquiring a sample image frame corresponding to the display timestamp in the source audio and video data;
and acquiring a sample audio frequency fragment corresponding to the display time stamp in the source audio and video data, wherein the starting time of the sample audio frequency fragment is the display time stamp, the fragment length is the preset duration, and the sample image frame and the sample audio frequency fragment form sample audio and video information.
Optionally, the sample information obtaining module 13 is specifically configured to obtain a playing path of the playing content of the player, and obtain source audio and video data based on the playing path.
And the result obtaining module 14 is configured to obtain a state detection result of the playing control state of the player based on the information similarity between the detected audio/video information and the sample audio/video information.
Optionally, the result obtaining module 14 is specifically configured to obtain image similarity between the detected image frame and the sample image frame, obtain audio similarity between the detected audio clip and the sample audio clip, where the image similarity and the audio similarity constitute information similarity;
and acquiring a state detection result of the playing control state of the player based on the information similarity.
Optionally, the result obtaining module 14 is specifically configured to output a first detection result of the playing control state of the player if the image similarity is greater than or equal to an image similarity threshold and the audio similarity is greater than or equal to an audio similarity threshold;
and if the image similarity is smaller than the image similarity threshold and/or the audio similarity is smaller than the audio similarity threshold, outputting a second detection result of the playing control state of the player.
The screen-splash detection module 15 is configured to perform screen-splash detection processing on the detected image frame if the image similarity is smaller than an image similarity threshold;
if the situation that the screen-splash part exists in the detected image frame is detected, outputting a third detection result of the playing control state of the player;
a switching time detection module 16, configured to obtain a switching timestamp of the playing content if it is detected that the playing control state of the player is switched;
and if the difference value between the switching timestamp and the display timestamp is greater than the difference threshold value, outputting a fourth detection result of the playing control state of the player.
In this embodiment, if it is detected that a state switching exists in a play control state of a player, a display timestamp of play content in the player is acquired, detected audio/video information corresponding to the display timestamp is acquired in the play content, a play path of the play content is acquired, source audio/video data corresponding to the play content is acquired according to the play path, sample audio/video information corresponding to the display timestamp is acquired in the source audio/video data, and a state detection result of the play control state of the player is acquired based on information similarity between the detected audio/video information and the sample audio/video information. Whether the playing control state of the player is normal or not is judged by detecting whether the playing content is similar to the source audio and video data when the playing control state is switched, so that steps and time required for detecting the playing control state of the player are reduced, the detection cost is reduced, and the detection efficiency is improved. If the image similarity and the audio similarity are both smaller than the similarity threshold, the audio and the video after state switching are synchronous, and if the image similarity is smaller than the image similarity threshold and/or the audio similarity is smaller than the audio similarity threshold, the audio and the video after state switching are asynchronous. Meanwhile, the state detection device can detect whether the player decodes correctly after state switching, whether phenomena such as screen splash and screen blacking occur, and whether state switching of the player is timely and whether time delay occurs, so that detection items of the state detection device on the playing control state of the player are enriched, and the detection effect of the state detection device on the player is improved.
It should be noted that, when the playback control state detection apparatus provided in the foregoing embodiment executes the playback control state detection method, only the division of the above functional modules is taken as an example, and in practical applications, the above functions may be distributed by different functional modules according to needs, that is, the internal structure of the device may be divided into different functional modules, so as to complete all or part of the functions described above. In addition, the playback control state detection apparatus and the playback control state detection method provided in the above embodiments belong to the same concept, and details of implementation processes thereof are referred to in the method embodiments, and are not described herein again.
The above-mentioned serial numbers of the embodiments of the present application are merely for description and do not represent the merits of the embodiments.
An embodiment of the present application further provides a computer storage medium, where the computer storage medium may store a plurality of instructions, and the instructions are suitable for being loaded by a processor and executing the method for detecting a playback control state according to the embodiments shown in fig. 2 to 5, and a specific execution process may refer to specific descriptions of the embodiments shown in fig. 2 to 5, which is not described herein again.
The present application further provides a computer program product, where at least one instruction is stored in the computer program product, and the at least one instruction is loaded by the processor and executes the method for detecting a playback control state according to the embodiments shown in fig. 2 to 5, where a specific execution process may refer to specific descriptions of the embodiments shown in fig. 2 to 5, and details are not repeated here.
Referring to fig. 8, a block diagram of an electronic device according to an exemplary embodiment of the present application is shown. The electronic device in the present application may comprise one or more of the following components: a processor 110, a memory 120, an input device 130, an output device 140, and a bus 150. The processor 110, memory 120, input device 130, and output device 140 may be connected by a bus 150.
Processor 110 may include one or more processing cores. The processor 110 connects various parts within the overall electronic device using various interfaces and lines, and performs various functions of the electronic device 100 and processes data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 120 and calling data stored in the memory 120. Alternatively, the processor 110 may be implemented in hardware using at least one of Digital Signal Processing (DSP), field-programmable gate Array (FPGA), and Programmable Logic Array (PLA). The processor 110 may integrate one or more of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a modem, and the like. Wherein, the CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing display content; the modem is used to handle wireless communications. It is understood that the modem may not be integrated into the processor 110, but may be implemented by a communication chip.
The Memory 120 may include a Random Access Memory (RAM) or a read-only Memory (ROM). Optionally, the memory 120 includes a non-transitory computer-readable medium. The memory 120 may be used to store instructions, programs, code sets, or instruction sets. The memory 120 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing various method embodiments described below, and the like, and the operating system may be an Android (Android) system, including a system based on Android system depth development, an IOS system developed by apple, including a system based on IOS system depth development, or other systems. The data storage area may also store data created by the electronic device during use, such as phone books, audio and video data, chat log data, and the like.
Referring to fig. 9, the memory 120 may be divided into an operating system space, in which an operating system runs, and a user space, in which native and third-party applications run. In order to ensure that different third-party application programs can achieve a better operation effect, the operating system allocates corresponding system resources for the different third-party application programs. However, the requirements of different application scenarios in the same third-party application program on system resources are different, for example, in a local resource loading scenario, the third-party application program has a higher requirement on the disk reading speed; in the animation rendering scene, the third-party application program has a high requirement on the performance of the GPU. The operating system and the third-party application program are independent from each other, and the operating system cannot sense the current application scene of the third-party application program in time, so that the operating system cannot perform targeted system resource adaptation according to the specific application scene of the third-party application program.
In order to enable the operating system to distinguish a specific application scenario of the third-party application program, data communication between the third-party application program and the operating system needs to be opened, so that the operating system can acquire current scenario information of the third-party application program at any time, and further perform targeted system resource adaptation based on the current scenario.
Taking an operating system as an Android system as an example, programs and data stored in the memory 120 are as shown in fig. 10, and a Linux kernel layer 320, a system runtime library layer 340, an application framework layer 360, and an application layer 380 may be stored in the memory 120, where the Linux kernel layer 320, the system runtime library layer 340, and the application framework layer 360 belong to an operating system space, and the application layer 380 belongs to a user space. The Linux kernel layer 320 provides underlying drivers for various hardware of the electronic device, such as a display driver, an audio driver, a camera driver, a bluetooth driver, a Wi-Fi driver, power management, and the like. The system runtime library layer 340 provides a main feature support for the Android system through some C/C + + libraries. For example, the SQLite library provides support for a database, the OpenGL/ES library provides support for 3D drawing, the Webkit library provides support for a browser kernel, and the like. Also provided in the system runtime library layer 340 is an Android runtime library (Android runtime), which mainly provides some core libraries that can allow developers to write Android applications using the Java language. The application framework layer 360 provides various APIs that may be used in building an application, and developers may build their own applications by using these APIs, such as activity management, window management, view management, notification management, content provider, package management, session management, resource management, and location management. At least one application program runs in the application layer 380, and the application programs may be native application programs carried by the operating system, such as a contact program, a short message program, a clock program, a camera application, and the like; or a third-party application developed by a third-party developer, such as a game application, an instant messaging program, a photo beautification program, a wallpaper setting program, and the like.
Taking an operating system as an IOS system as an example, programs and data stored in the memory 120 are shown in fig. 11, and the IOS system includes: a Core operating system Layer 420(Core OS Layer), a Core Services Layer 440(Core Services Layer), a Media Layer 460(Media Layer), and a touchable Layer 480(Cocoa Touch Layer). The kernel operating system layer 420 includes an operating system kernel, drivers, and underlying program frameworks that provide functionality closer to hardware for use by program frameworks located in the core services layer 440. The core services layer 440 provides system services and/or program frameworks, such as a Foundation framework, an account framework, an advertisement framework, a data storage framework, a network connection framework, a geographic location framework, a motion framework, and so forth, as required by the application. The media layer 460 provides audiovisual related interfaces for applications, such as graphics image related interfaces, audio technology related interfaces, video technology related interfaces, audio video transmission technology wireless playback (AirPlay) interfaces, and the like. Touchable layer 480 provides various common interface-related frameworks for application development, and touchable layer 480 is responsible for user touch interaction operations on the electronic device. Such as a local notification service, a remote push service, an advertising framework, a game tool framework, a messaging User Interface (UI) framework, a User Interface UIKit framework, a map framework, and so forth.
In the framework illustrated in FIG. 11, the framework associated with most applications includes, but is not limited to: a base framework in the core services layer 440 and a UIKit framework in the touchable layer 480. The base framework provides many basic object classes and data types, provides the most basic system services for all applications, and is UI independent. While the class provided by the UIKit framework is a basic library of UI classes for creating touch-based user interfaces, iOS applications can provide UIs based on the UIKit framework, so it provides an infrastructure for applications for building user interfaces, drawing, processing and user interaction events, responding to gestures, and the like.
The Android system can be referred to as a mode and a principle for realizing data communication between the third-party application program and the operating system in the IOS system, and details are not repeated herein.
The input device 130 is used for receiving input instructions or data, and the input device 130 includes, but is not limited to, a keyboard, a mouse, a camera, a microphone, or a touch device. The output device 140 is used for outputting instructions or data, and the output device 140 includes, but is not limited to, a display device, a speaker, and the like. In one example, the input device 130 and the output device 140 may be combined, and the input device 130 and the output device 140 are touch display screens for receiving touch operations of a user on or near the touch display screens by using any suitable object such as a finger, a touch pen, and the like, and displaying user interfaces of various applications. Touch displays are typically provided on the front panel of an electronic device. The touch display screen may be designed as a full-face screen, a curved screen, or a profiled screen. The touch display screen can also be designed to be a combination of a full-face screen and a curved-face screen, and a combination of a special-shaped screen and a curved-face screen, which is not limited in the embodiment of the present application.
In addition, those skilled in the art will appreciate that the configurations of the electronic devices illustrated in the above-described figures do not constitute limitations on the electronic devices, which may include more or fewer components than illustrated, or some components may be combined, or a different arrangement of components. For example, the electronic device further includes a radio frequency circuit, an input unit, a sensor, an audio circuit, a Wi-Fi module, a power supply, a bluetooth module, and other components, which are not described herein again.
In the embodiment of the present application, the main body of execution of each step may be the electronic device described above. Optionally, the execution subject of each step is an operating system of the electronic device. The operating system may be an android system, an IOS system, or another operating system, which is not limited in this embodiment of the present application.
The electronic device of the embodiment of the application can also be provided with a display device, and the display device can be various devices capable of realizing a display function, for example: a cathode ray tube display (CR), a light-emitting diode display (LED), an electronic ink panel, a Liquid Crystal Display (LCD), a Plasma Display Panel (PDP), and the like. A user may utilize a display device on the electronic device 101 to view information such as displayed text, images, video, and the like. The electronic device may be a smartphone, a tablet computer, a gaming device, an AR (Augmented Reality) device, an automobile, a data storage device, an audio playback device, a video playback device, a notebook, a desktop computing device, a wearable device such as an electronic watch, an electronic glasses, an electronic helmet, an electronic bracelet, an electronic necklace, an electronic garment, or the like.
In the electronic device shown in fig. 8, the processor 110 may be configured to call the play control state detection application stored in the memory 120, and specifically perform the following operations:
if the situation that the playing control state of the player is switched is detected, acquiring a display timestamp of playing content in the player;
acquiring the detected audio and video information corresponding to the display timestamp from the playing content;
acquiring source audio and video data corresponding to the playing content, and acquiring sample audio and video information corresponding to the display timestamp from the source audio and video data;
and acquiring a state detection result of the playing control state of the player based on the information similarity of the detected audio and video information and the sample audio and video information.
In an embodiment, when the processor 110 acquires the detected audio/video information corresponding to the display timestamp from the playing content, the following operations are specifically performed:
acquiring a detection image frame corresponding to the display timestamp in the playing content;
and acquiring a detection audio clip corresponding to the display timestamp in the playing content, wherein the starting time of the detection audio clip is the display timestamp, the length of the clip is a preset duration, and the detection image frame and the detection audio clip form detection audio and video information.
In an embodiment, when the processor 110 executes the following operation of acquiring the source audio/video data corresponding to the playing content and acquiring the sample audio/video information corresponding to the display timestamp from the source audio/video data:
acquiring source audio and video data corresponding to the playing content;
acquiring a sample image frame corresponding to the display timestamp in the source audio and video data;
and acquiring a sample audio frequency fragment corresponding to the display time stamp in the source audio and video data, wherein the starting time of the sample audio frequency fragment is the display time stamp, the fragment length is the preset duration, and the sample image frame and the sample audio frequency fragment form sample audio and video information.
In an embodiment, when the processor 110 acquires the source audio/video data corresponding to the playing content, the following operation is specifically performed:
and acquiring a playing path of the playing content of the player, and acquiring source audio and video data based on the playing path.
In an embodiment, when the processor 110 performs the information similarity between the detected audio/video information and the sample audio/video information to obtain the state detection result of the play control state of the player, the following operations are specifically performed:
acquiring image similarity of the detection image frame and the sample image frame, and acquiring audio similarity of the detection audio clip and the sample audio clip, wherein the image similarity and the audio similarity constitute information similarity;
and acquiring a state detection result of the playing control state of the player based on the information similarity.
In an embodiment, when the processor 110 performs the state detection result of the playing control state of the player based on the information similarity, the following operations are specifically performed:
if the image similarity is greater than or equal to an image similarity threshold and the audio similarity is greater than or equal to an audio similarity threshold, outputting a first detection result of the playing control state of the player;
and if the image similarity is smaller than the image similarity threshold and/or the audio similarity is smaller than the audio similarity threshold, outputting a second detection result of the playing control state of the player.
In one embodiment, the processor 110, when performing the playback control state detection, further performs the following operations:
if the image similarity is smaller than an image similarity threshold value, performing screen-blooming detection processing on the detected image frame;
and if the detection image frame is detected to have a screen-splash part, outputting a third detection result of the playing control state of the player.
In one embodiment, the processor 110, when performing the playback control state detection, further performs the following operations:
if the switching of the playing control state of the player is detected to be completed, acquiring a switching timestamp of the playing content;
and if the difference value between the switching timestamp and the display timestamp is greater than the difference threshold value, outputting a fourth detection result of the playing control state of the player.
In this embodiment, if it is detected that a state switching exists in a play control state of a player, a display timestamp of play content in the player is acquired, detected audio/video information corresponding to the display timestamp is acquired in the play content, a play path of the play content is acquired, source audio/video data corresponding to the play content is acquired according to the play path, sample audio/video information corresponding to the display timestamp is acquired in the source audio/video data, and a state detection result of the play control state of the player is acquired based on information similarity between the detected audio/video information and the sample audio/video information. Whether the playing control state of the player is normal or not is judged by detecting whether the playing content is similar to the source audio and video data when the playing control state is switched, so that steps and time required for detecting the playing control state of the player are reduced, the detection cost is reduced, and the detection efficiency is improved. If the image similarity and the audio similarity are both smaller than the similarity threshold, the audio and the video after state switching are synchronous, and if the image similarity is smaller than the image similarity threshold and/or the audio similarity is smaller than the audio similarity threshold, the audio and the video after state switching are asynchronous. Meanwhile, the state detection device can detect whether the player decodes correctly after state switching, whether phenomena such as screen splash and screen blacking occur, and whether state switching of the player is timely and whether time delay occurs, so that detection items of the state detection device on the playing control state of the player are enriched, and the detection effect of the state detection device on the player is improved.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a read-only memory or a random access memory.
The above disclosure is only for the purpose of illustrating the preferred embodiments of the present application and is not to be construed as limiting the scope of the present application, so that the present application is not limited thereto, and all equivalent variations and modifications can be made to the present application.

Claims (11)

1. A method for detecting a playback control status, the method comprising:
if the situation that the playing control state of the player is switched is detected, acquiring a display timestamp of playing content in the player;
acquiring the detected audio and video information corresponding to the display timestamp from the playing content;
acquiring source audio and video data corresponding to the playing content, and acquiring sample audio and video information corresponding to the display timestamp from the source audio and video data;
and acquiring a state detection result of the playing control state of the player based on the information similarity of the detected audio and video information and the sample audio and video information.
2. The method according to claim 1, wherein the obtaining of the detected audio/video information corresponding to the display timestamp in the playing content comprises:
acquiring a detection image frame corresponding to the display timestamp in the playing content;
and acquiring a detection audio clip corresponding to the display timestamp in the playing content, wherein the starting time of the detection audio clip is the display timestamp, the length of the clip is a preset duration, and the detection image frame and the detection audio clip form detection audio and video information.
3. The method according to claim 2, wherein the obtaining source audio/video data corresponding to the playing content and the obtaining sample audio/video information corresponding to the display timestamp from the source audio/video data comprises:
acquiring source audio and video data corresponding to the playing content;
acquiring a sample image frame corresponding to the display timestamp in the source audio and video data;
and acquiring a sample audio frequency fragment corresponding to the display time stamp in the source audio and video data, wherein the starting time of the sample audio frequency fragment is the display time stamp, the fragment length is the preset duration, and the sample image frame and the sample audio frequency fragment form sample audio and video information.
4. The method according to claim 3, wherein the obtaining of the source audio/video data corresponding to the playing content includes:
and acquiring a playing path of the playing content of the player, and acquiring source audio and video data based on the playing path.
5. The method according to claim 3, wherein the obtaining of the state detection result of the playing control state of the player based on the information similarity between the detected audio/video information and the sample audio/video information comprises:
acquiring image similarity of the detection image frame and the sample image frame, and acquiring audio similarity of the detection audio clip and the sample audio clip, wherein the image similarity and the audio similarity constitute information similarity;
and acquiring a state detection result of the playing control state of the player based on the information similarity.
6. The method according to claim 5, wherein the obtaining a state detection result of the playing control state of the player based on the information similarity comprises:
if the image similarity is greater than or equal to an image similarity threshold and the audio similarity is greater than or equal to an audio similarity threshold, outputting a first detection result of the playing control state of the player;
and if the image similarity is smaller than the image similarity threshold and/or the audio similarity is smaller than the audio similarity threshold, outputting a second detection result of the playing control state of the player.
7. The method of claim 5, further comprising:
if the image similarity is smaller than an image similarity threshold value, performing screen-blooming detection processing on the detected image frame;
and if the detection image frame is detected to have a screen-splash part, outputting a third detection result of the playing control state of the player.
8. The method of claim 1, further comprising:
if the switching of the playing control state of the player is detected to be completed, acquiring a switching timestamp of the playing content;
and if the difference value between the switching timestamp and the display timestamp is greater than the difference threshold value, outputting a fourth detection result of the playing control state of the player.
9. A condition detection apparatus, characterized in that the apparatus comprises:
the device comprises a timestamp acquisition module, a display module and a display module, wherein the timestamp acquisition module is used for acquiring a display timestamp of playing content in a player if the condition switching of the playing control state of the player is detected;
the target information acquisition module is used for acquiring the detected audio and video information corresponding to the display timestamp from the playing content;
the sample information acquisition module is used for acquiring source audio and video data corresponding to the playing content and acquiring sample audio and video information corresponding to the display timestamp from the source audio and video data;
and the result acquisition module is used for acquiring the state detection result of the playing control state of the player based on the information similarity of the detected audio and video information and the sample audio and video information.
10. A computer storage medium, characterized in that it stores a plurality of instructions adapted to be loaded by a processor and to carry out the method steps according to any one of claims 1 to 8.
11. An electronic device, comprising: a processor and a memory; wherein the memory stores a computer program adapted to be loaded by the processor and to perform the method steps of any of claims 1 to 8.
CN202111033813.7A 2021-09-03 2021-09-03 Method and device for detecting play control state, storage medium and electronic equipment Active CN113825022B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111033813.7A CN113825022B (en) 2021-09-03 2021-09-03 Method and device for detecting play control state, storage medium and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111033813.7A CN113825022B (en) 2021-09-03 2021-09-03 Method and device for detecting play control state, storage medium and electronic equipment

Publications (2)

Publication Number Publication Date
CN113825022A true CN113825022A (en) 2021-12-21
CN113825022B CN113825022B (en) 2023-08-18

Family

ID=78914069

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111033813.7A Active CN113825022B (en) 2021-09-03 2021-09-03 Method and device for detecting play control state, storage medium and electronic equipment

Country Status (1)

Country Link
CN (1) CN113825022B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114745574A (en) * 2022-04-24 2022-07-12 武汉风行在线技术有限公司 Video integration cooperation process normative detection method and system

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102761771A (en) * 2012-06-29 2012-10-31 无锡风格软件有限公司 Method and equipment for carrying out detection of inferior broadcasting of video on basis of image objective quality estimation
CN105992040A (en) * 2015-02-15 2016-10-05 深圳市民展科技开发有限公司 Multichannel audio data transmitting method, audio data synchronization playing method and devices
US20170164026A1 (en) * 2015-12-04 2017-06-08 Le Holdings (Beijing) Co., Ltd. Method and device for detecting video data
US20170163955A1 (en) * 2015-12-03 2017-06-08 Le Holdings (Beijing) Co., Ltd. Method and device for playing video
WO2017177524A1 (en) * 2016-04-11 2017-10-19 深圳Tcl新技术有限公司 Audio and video playing synchronization method and device
CN109842795A (en) * 2019-02-28 2019-06-04 苏州科达科技股份有限公司 Audio-visual synchronization performance test methods, device, electronic equipment, storage medium
US20200228683A1 (en) * 2019-01-15 2020-07-16 Amlogic (Shanghai) Co., Ltd. Synchronous modulation method based on embedded player
CN111757158A (en) * 2020-06-29 2020-10-09 北京百度网讯科技有限公司 Audio and video synchronous playing method, device, equipment and storage medium
CA3106792A1 (en) * 2020-01-24 2021-07-24 Arris Enterprises Llc System, method, and computer-readable recording medium of detecting wireless home digital interface devices and configuring parental control for each

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102761771A (en) * 2012-06-29 2012-10-31 无锡风格软件有限公司 Method and equipment for carrying out detection of inferior broadcasting of video on basis of image objective quality estimation
CN105992040A (en) * 2015-02-15 2016-10-05 深圳市民展科技开发有限公司 Multichannel audio data transmitting method, audio data synchronization playing method and devices
US20170163955A1 (en) * 2015-12-03 2017-06-08 Le Holdings (Beijing) Co., Ltd. Method and device for playing video
US20170164026A1 (en) * 2015-12-04 2017-06-08 Le Holdings (Beijing) Co., Ltd. Method and device for detecting video data
WO2017177524A1 (en) * 2016-04-11 2017-10-19 深圳Tcl新技术有限公司 Audio and video playing synchronization method and device
US20200228683A1 (en) * 2019-01-15 2020-07-16 Amlogic (Shanghai) Co., Ltd. Synchronous modulation method based on embedded player
CN109842795A (en) * 2019-02-28 2019-06-04 苏州科达科技股份有限公司 Audio-visual synchronization performance test methods, device, electronic equipment, storage medium
CA3106792A1 (en) * 2020-01-24 2021-07-24 Arris Enterprises Llc System, method, and computer-readable recording medium of detecting wireless home digital interface devices and configuring parental control for each
CN111757158A (en) * 2020-06-29 2020-10-09 北京百度网讯科技有限公司 Audio and video synchronous playing method, device, equipment and storage medium

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114745574A (en) * 2022-04-24 2022-07-12 武汉风行在线技术有限公司 Video integration cooperation process normative detection method and system

Also Published As

Publication number Publication date
CN113825022B (en) 2023-08-18

Similar Documents

Publication Publication Date Title
CN109766053B (en) User interface display method, device, terminal and storage medium
CN107889070B (en) Picture processing method, device, terminal and computer readable storage medium
CN111459586B (en) Remote assistance method, device, storage medium and terminal
CN110413347B (en) Advertisement processing method and device in application program, storage medium and terminal
CN111124668A (en) Memory release method and device, storage medium and terminal
CN113268212A (en) Screen projection method and device, storage medium and electronic equipment
CN110702346B (en) Vibration testing method and device, storage medium and terminal
CN112218130A (en) Control method and device for interactive video, storage medium and terminal
CN106681827B (en) Method and device for detecting slow running of software card and electronic equipment
CN111913614B (en) Multi-picture display control method and device, storage medium and display
CN113825022B (en) Method and device for detecting play control state, storage medium and electronic equipment
JP7482216B2 (en) Video content display method, client, and storage medium
CN112995562A (en) Camera calling method and device, storage medium and terminal
CN113419650A (en) Data moving method and device, storage medium and electronic equipment
CN113950043B (en) Communication method, device, storage medium and terminal
CN113114849A (en) Alarm clock reminding method and device, storage medium and terminal
CN113490028A (en) Video processing method, device, storage medium and terminal
CN113595662A (en) Signal prompting method and device, terminal equipment and storage medium
CN113378895A (en) Classification model generation method and device, storage medium and electronic equipment
CN115145660A (en) Multimedia playing method, device, storage medium and terminal equipment
CN113031775A (en) Gesture data acquisition method and device, terminal and storage medium
CN111859999A (en) Message translation method, device, storage medium and electronic equipment
CN111538997A (en) Image processing method, image processing device, storage medium and terminal
WO2023273936A1 (en) Wallpaper setting method and apparatus, and storage medium and electronic device
CN113691676B (en) Equipment state prompting method and device, storage medium and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant