CN113873221A - Caption distortion detection method, multimedia terminal, server and storage medium - Google Patents
Caption distortion detection method, multimedia terminal, server and storage medium Download PDFInfo
- Publication number
- CN113873221A CN113873221A CN202111000269.6A CN202111000269A CN113873221A CN 113873221 A CN113873221 A CN 113873221A CN 202111000269 A CN202111000269 A CN 202111000269A CN 113873221 A CN113873221 A CN 113873221A
- Authority
- CN
- China
- Prior art keywords
- caption
- subtitle
- subtitles
- display
- played
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
- H04N17/004—Diagnosis, testing or measuring for television systems or their details for digital television systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/488—Data services, e.g. news ticker
- H04N21/4884—Data services, e.g. news ticker for displaying subtitles
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a method for detecting the distortion of a caption, which is used for a multimedia terminal and comprises the following steps: when a caption data packet sent by a server is received, acquiring a display caption based on the caption data packet; when the display caption is played, acquiring a playing caption corresponding to the display caption; and sending the played subtitles to the server so that the server detects the played subtitles by using preset subtitles to obtain a detection result. The invention also discloses a multimedia terminal, a server and a computer readable storage medium. The method overcomes the defect that the center of the prior art lacks a technical scheme for detecting the distortion of the subtitles, and realizes the accurate distortion detection of the subtitles.
Description
Technical Field
The present invention relates to the field of multimedia technologies, and in particular, to a method for detecting subtitle distortion, a multimedia terminal, a server, and a computer-readable storage medium.
Background
With the new home entertainment products of the 5G technology becoming more and more abundant, more 5G multimedia terminals will enter thousands of households. The wide use of the 5G multimedia terminal also benefits from the 5G fusion of the front-end equipment of the operator, and the 5G fusion performed by the front-end signal source promotes the popularization of the 5G multimedia terminal.
In the digital television industry, 5G technology is fused under the standard frameworks of DVB, ATSC, national standards and the like for a long time in the future, so that the quality of the digital television is improved. The front-end equipment integrates the 8K information source and the non-8K information source and transmits the information by using a 5G technology, and finally, the common information source and the 8K information source are displayed on a user side.
When multimedia data is transmitted by the above-mentioned techniques, the transmitted subtitles are distorted, and it is necessary to detect whether the subtitles are distorted, so a subtitle detection technique is needed to determine whether the subtitles are distorted.
Disclosure of Invention
The present invention mainly aims to provide a method for detecting distortion of subtitles, a multimedia terminal, a server and a computer readable storage medium, and aims to solve the technical problem that a subtitle detection technology is urgently needed to determine whether subtitles are distorted in the prior art.
In order to achieve the above object, the present invention provides a method for detecting distortion of subtitles, which is used for a multimedia terminal, and the method comprises the following steps:
when a caption data packet sent by a server is received, acquiring a display caption based on the caption data packet;
when the display caption is played, acquiring a playing caption corresponding to the display caption;
and sending the played subtitles to the server so that the server detects the played subtitles by using preset subtitles to obtain a detection result.
Optionally, the step of obtaining the playing subtitle corresponding to the display subtitle when the display subtitle is played includes:
when the display caption is played, acquiring configuration information of the multimedia terminal, and carrying out screenshot on a playing interface for displaying the caption to obtain a caption screenshot;
and obtaining the played caption based on the configuration information and the caption screenshot.
Optionally, the step of sending the played subtitles to the server to enable the server to detect the played subtitles by using preset subtitles to obtain a detection result includes:
and sending the playing subtitles and the display subtitles to the server so that the server detects the playing subtitles and the display subtitles by using preset subtitles to obtain a detection result.
Optionally, the subtitle data packet is obtained by packing an original subtitle data packet; the step of obtaining display subtitles based on the subtitle data packet includes:
the caption data packet is restored and analyzed to obtain the original caption data packet;
reconstructing the original caption data packet to obtain a first caption picture;
and adding a timestamp to the first subtitle picture by using the playing time to obtain the display subtitle.
In addition, in order to achieve the above object, the present invention further provides a method for detecting distortion of subtitles, which is used for a server, and the method includes the following steps:
sending a caption data packet to a multimedia terminal so that the multimedia terminal obtains a display caption based on the caption data packet, and obtaining a play caption corresponding to the display caption when the display caption is played;
receiving a playing subtitle sent by the multimedia terminal;
and detecting the played subtitles by using preset subtitles to obtain a detection result.
Optionally, the playing of the subtitle includes a subtitle screenshot, and the subtitle screenshot is obtained by screenshot of a playing interface for displaying the subtitle when the subtitle is played; the display caption comprises a first caption picture, and the preset caption comprises a second caption picture; before the step of detecting the played subtitles by using the preset subtitles to obtain a detection result, the method further comprises:
receiving display subtitles sent by the multimedia terminal;
the step of detecting the played subtitles by using the preset subtitles to obtain a detection result comprises the following steps:
comparing the second subtitle picture with the first subtitle picture to obtain a first comparison result;
comparing the second subtitle picture with the subtitle screenshot to obtain a second comparison result;
obtaining the detection result based on the first comparison result and the second comparison result.
Optionally, the playing subtitles further include configuration information, where the configuration information is obtained from the multimedia terminal when the displaying subtitles are played; the step of obtaining the detection result based on the first comparison result and the second comparison result comprises:
when the first comparison result is that the second subtitle picture is the same as the first subtitle picture and the second comparison result is that the second subtitle picture is different from the subtitle screenshot, acquiring the configuration information in the played subtitle;
and obtaining the detection result based on the configuration information.
In addition, to achieve the above object, the present invention further provides a multimedia terminal, including: the apparatus comprises a memory, a processor, and a caption distortion detection program stored on the memory and running on the processor, wherein the caption distortion detection program when executed by the processor implements the steps of the caption distortion detection method as described in any one of the above.
In addition, to achieve the above object, the present invention further provides a server, including: the apparatus comprises a memory, a processor, and a caption distortion detection program stored on the memory and running on the processor, wherein the caption distortion detection program when executed by the processor implements the steps of the caption distortion detection method as described in any one of the above.
Furthermore, to achieve the above object, the present invention also provides a computer-readable storage medium having a caption distortion detection program stored thereon, which when executed by a processor implements the steps of the caption distortion detection method as described in any one of the above.
The technical scheme of the invention provides a method for detecting the distortion of a caption, which is used for a multimedia terminal and comprises the following steps: when a caption data packet sent by a server is received, acquiring a display caption based on the caption data packet; when the display caption is played, acquiring a playing caption corresponding to the display caption; and sending the played subtitles to the server so that the server detects the played subtitles by using preset subtitles to obtain a detection result.
According to the method, the preset subtitles are used for detecting the played subtitles to obtain the distortion detection result of the subtitles, the defect that the technical scheme for detecting the distortions of the subtitles is lacked in the prior art center is overcome, and the accurate distortion detection of the subtitles is realized.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the structures shown in the drawings without creative efforts.
Fig. 1 is a schematic structural diagram of a multimedia terminal in a hardware operating environment according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a server in a hardware operating environment according to an embodiment of the present invention;
fig. 3 is a flowchart illustrating a subtitle distortion detection method according to a first embodiment of the present invention;
fig. 4 is a flowchart illustrating a subtitle distortion detection method according to a second embodiment of the present invention;
fig. 5 is a block diagram illustrating a first embodiment of a caption distortion detection apparatus according to the present invention;
fig. 6 is a block diagram illustrating a second embodiment of a caption distortion detection apparatus according to the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, fig. 1 is a schematic structural diagram of a multimedia terminal in a hardware operating environment according to an embodiment of the present invention.
The multimedia terminal may be a mobile phone, a smart phone, a notebook computer, a digital broadcasting receiver, a Personal Digital Assistant (PDA), a tablet computer (PAD), etc.
Generally, a multimedia terminal includes: at least one processor 301, a memory 302, and a caption distortion detection program stored on the memory and executable on the processor, the caption distortion detection program being configured to implement the steps of the caption distortion detection method as described above.
The processor 301 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and so on. The processor 301 may be implemented in at least one hardware form of a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), and a PLA (Programmable Logic Array). The processor 301 may also include a main processor and a coprocessor, where the main processor is a processor for processing data in an awake state, and is also called a Central Processing Unit (CPU); a coprocessor is a low power processor for processing data in a standby state.
In some embodiments, the terminal may further include: a communication interface 303 and at least one peripheral device. The processor 301, the memory 302 and the communication interface 303 may be connected by a bus or signal lines. Various peripheral devices may be connected to communication interface 303 via a bus, signal line, or circuit board. Specifically, the peripheral device includes: at least one of radio frequency circuitry 304, a display screen 305, and a power source 306.
The communication interface 303 may be used to connect at least one peripheral device related to I/O (Input/Output) to the processor 301 and the memory 302. In some embodiments, processor 301, memory 302, and communication interface 303 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 301, the memory 302 and the communication interface 303 may be implemented on a single chip or circuit board, which is not limited in this embodiment.
The Radio Frequency circuit 304 is used for receiving and transmitting RF (Radio Frequency) signals, also called electromagnetic signals. The radio frequency circuitry 304 communicates with communication networks and other communication devices via electromagnetic signals. The rf circuit 304 converts an electrical signal into an electromagnetic signal to transmit, or converts a received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 304 comprises: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a subscriber identity module card, and so forth.
The display screen 305 is used to display a UI (User Interface). The UI may include graphics, text, icons, video, and any combination thereof. When the display screen 305 is a touch display screen, the display screen 305 also has the ability to capture touch signals on or over the surface of the display screen 305. The touch signal may be input to the processor 301 as a control signal for processing. At this point, the display screen 305 may also be used to provide virtual buttons and/or a virtual keyboard, also referred to as soft buttons and/or a soft keyboard.
The power supply 306 is used to power various components in the electronic device. The power source 306 may be alternating current, direct current, disposable or rechargeable. When the power source 306 includes a rechargeable battery, the rechargeable battery may support wired or wireless charging. The rechargeable battery may also be used to support fast charge technology.
Those skilled in the art will appreciate that the configuration shown in fig. 1 does not constitute a limitation of the multimedia terminal and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
Referring to fig. 2, fig. 2 is a schematic structural diagram of a server in a hardware operating environment according to an embodiment of the present invention.
The server includes a Central Processing Unit (CPU)401, a system memory 404 including a Random Access Memory (RAM)402 and a Read Only Memory (ROM)403, and a system bus 405 connecting the system memory 404 and the central processing unit 401. The server also includes a basic input/output system (I/O system) 406, which facilitates the transfer of information between devices within the computer, and a mass storage device 407 for storing an operating system 413, application programs 414, and other program modules 415.
The basic input/output system 406 includes a display 408 for displaying information and an input device 409 such as a mouse, keyboard, etc. for user input of information. Wherein the display 408 and the input device 409 are connected to the central processing unit 401 through an input output controller 410 connected to the system bus 405. The basic input/output system 406 may also include an input/output controller 410 for receiving and processing input from a number of other devices, such as a keyboard, mouse, or electronic stylus. Similarly, input/output controller 410 may also provide output to a display screen, a printer, or other type of output device.
The mass storage device 407 is connected to the central processing unit 401 through a mass storage controller connected to the system bus 405. The mass storage device 407 and its associated computer-readable media provide non-volatile storage for the server. That is, the mass storage device 407 may include a computer-readable medium such as a hard disk or CD-ROM drive.
Without loss of generality, the computer-readable media may comprise computer storage media and communication media. Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media includes RAM, ROM, EPROM, EEPROM, flash memory or other solid state memory technology, CD-ROM, DVD, or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices. Of course, those skilled in the art will appreciate that the computer storage media is not limited to the foregoing.
The system memory 404 and mass storage device 407 described above may be collectively referred to as memory. According to various embodiments of the present application, the server may also operate with remote computers connected to a network through a network, such as the Internet. That is, the servers may be connected to the network 412 through the network interface unit 411 attached to the system bus 405, or the network interface unit 411 may be used to connect to other types of networks or remote computer systems.
Furthermore, an embodiment of the present invention further provides a computer-readable storage medium, where a subtitle distortion detection program is stored, and when being executed by a processor, the subtitle distortion detection program implements the steps of the subtitle distortion detection method as described above. Therefore, a detailed description thereof will be omitted. In addition, the beneficial effects of the same method are not described in detail. For technical details not disclosed in embodiments of the computer-readable storage medium referred to in the present application, reference is made to the description of embodiments of the method of the present application. It is determined as an example that the program instructions may be deployed to be executed on one multimedia terminal and one server, or on a plurality of multimedia terminals and a plurality of servers located at one site, or on a plurality of multimedia terminals and a plurality of servers distributed at a plurality of sites and interconnected by a communication network.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The computer-readable storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.
Based on the above hardware structure, an embodiment of the caption distortion detection method of the present invention is provided.
Referring to fig. 2, fig. 2 is a flowchart illustrating a method for detecting caption distortion according to a first embodiment of the present invention, where the method is used in a multimedia terminal, and the method includes the following steps:
step S11: and when receiving a caption data packet sent by a server, obtaining a display caption based on the caption data packet.
It should be noted that, in this embodiment of the present invention, the execution main body is a multimedia terminal, the structure of the multimedia terminal refers to the above description, the multimedia terminal is installed with a subtitle distortion detection program, and when the multimedia terminal executes the subtitle distortion detection program, the steps of the subtitle distortion detection method of the present invention are implemented.
Generally, the caption data packet and a target program (the caption data packet is caption data of the target program) played by the multimedia terminal are simultaneously transmitted to the multimedia terminal, and the multimedia terminal plays a display caption corresponding to the caption data packet while playing the target program. The server is usually a program server, and provides various programs for the multimedia terminal, such as a certain fanciful server or a certain chuan guardian server.
Currently, in a multimedia terminal, caption PID data, audio PID, video PID, and the like are put together to perform front-end composition and broadcast, the caption PID, the audio PID, and the video PID are sent by a server (the server obtains the caption PID, the audio PID, and the video PID based on the original audio, video, and caption), and the multimedia terminal receives the PID data, then analyzes the PID data respectively according to the data types described in the PID, and then restores the PID data into the original audio, video, and caption of the server.
In the server, an original subtitle of the target program is stored, the original subtitle is a subtitle picture in a bmp format (a second subtitle picture described below), and the original subtitle is usually a reference subtitle with high integrity and accuracy and is used as a template for detection.
The server packs the original subtitle (second subtitle picture) to obtain an original subtitle data packet (a file in a bin format, for example, a program, bin), and then packs the original subtitle data packet into the subtitle data packet, which is a 5g.bin file, for example: a program-5 g.
The server obtains a preset subtitle by using the second subtitle picture, the preset subtitle is used as a template for subtitle detection, and the preset subtitle also can include a timestamp of the playing time (for convenience of a region, the playing time of the second subtitle picture is the first time, and the playing time is the playing time of the subtitle) of the program name (or other program identifiers and the like) of the target program; the preset captions are referenced in table 1, table 1 is as follows:
TABLE 1
| Name of program | Time stamp | Name of picture |
| Channel 1 | 2021-0812-08:00:00 | a.bmp |
In this example, the target program is Channel 1 (title), and the second subtitle picture is named a.
Similarly, the step of obtaining the display caption based on the caption data packet includes: the caption data packet is restored and analyzed to obtain the original caption data packet; reconstructing the original caption data packet to obtain a first caption picture; and adding a timestamp to the first subtitle picture by using the playing time to obtain the display subtitle.
It can be understood that, when the multimedia terminal processes the subtitle data packet to obtain the first subtitle picture for playing, a timestamp of playing time (second time, time for playing the subtitle) may be added to the first subtitle picture to obtain the display subtitle, and the description of the display subtitle may refer to table 2, where table 2 is as follows:
TABLE 2
| Name of program | Time stamp | Name of picture |
| Channel 1 | 2021-0812-08:00:00 | a1.bmp |
In this example, the target program is Channel 1 (same program as in the example above), and the first subtitle picture is named a1. bmp. As can be seen from tables 1 and 2, for the same program, the playing time of the subtitle (the playing time of the second subtitle picture in the subtitle, i.e., the first time, and the playing time of the first subtitle picture in the subtitle, i.e., the second time) is the same.
Step S12: and when the display caption is played, acquiring a playing caption corresponding to the display caption.
Step S13: and sending the played subtitles to the server so that the server detects the played subtitles by using preset subtitles to obtain a detection result.
It can be understood that, when the display subtitle is played, the first subtitle picture in the display subtitle is actually played, and other information is not played: the time stamp and program name are not played.
In order to facilitate the server to identify which specific program subtitle needs to be detected, the preset subtitle, the display subtitle, and the playing subtitle all need to include the name of the target program (or program identification information, etc.).
In this embodiment, the server detects the played subtitle based on the obtained preset subtitle to obtain a detection result, where the detection result is whether the played subtitle is invalid.
When the multimedia terminal plays the display caption, the played caption is the play caption when the display caption is played at the multimedia terminal, and the play caption obtaining steps are as follows: when the display caption is played, acquiring configuration information of the multimedia terminal, and carrying out screenshot on a playing interface for displaying the caption to obtain a caption screenshot; and obtaining the played caption based on the configuration information and the caption screenshot. The playing subtitle may also have a time stamp of the playing time of the subtitle. It is composed of
It should be noted that, in the present invention, the first subtitle picture, the second subtitle picture, and the subtitle screenshot are in the bmp format. When the display caption is played, the display configuration of the multimedia terminal is acquired as the configuration information, and when different multimedia terminals play the same display caption, the configuration information is different.
Based on the above example, when the multimedia terminal plays and displays the subtitle, the multimedia terminal performs screenshot operation of the playing interface to obtain a subtitle screenshot, and simultaneously obtains configuration information of the multimedia terminal at the moment, and further obtains a playing subtitle, where the playing subtitle also has a timestamp of playing time (third time, corresponding playing time when the subtitle screenshot is obtained), and the display subtitle is expressed as table 3, where table 3 is as follows:
TABLE 3
| Name of program | Time stamp | Name of picture | Display arrangement | Displaying pictures |
| Channel 1 | 2021-0812-08:00:00 | a1.bmp | s.cfg | a2.bmp |
Wherein, s.cfg is the configuration information of the multimedia terminal and is stored in the cfg format. It can be seen that, for the same target program, the playing time of the subtitles (the playing time of the second subtitle picture in the subtitles-the first time, the playing time of the first subtitle picture in the subtitles-the second time, and the playing time corresponding to the subtitle screenshot obtained when the subtitles are displayed-the third time) is preset) is the same.
In this embodiment, the step of sending the played subtitles to the server so that the server detects the played subtitles by using preset subtitles to obtain a detection result includes: and sending the playing subtitles and the display subtitles to the server so that the server detects the playing subtitles and the display subtitles by using preset subtitles to obtain a detection result.
In this embodiment, the server detects the played subtitles (subtitle screenshot) by using the preset subtitles to obtain a detection result, and at the same time, the server detects the displayed subtitles obtained by the multimedia terminal by using the preset subtitles to obtain a detection result, and the server integrates the two detection results to obtain a final detection result.
In addition, in some embodiments, the server may also send the detection result to the multimedia terminal after the server obtains the detection result, store the detection result by the multimedia terminal, or output the detection result, etc.
The technical scheme of the invention provides a method for detecting the distortion of a caption, which is used for a multimedia terminal and comprises the following steps: when a caption data packet sent by a server is received, acquiring a display caption based on the caption data packet; when the display caption is played, acquiring a playing caption corresponding to the display caption; and sending the played subtitles to the server so that the server detects the played subtitles by using preset subtitles to obtain a detection result.
According to the method, the preset subtitles are used for detecting the played subtitles to obtain the distortion detection result of the subtitles, the defect that the technical scheme for detecting the distortions of the subtitles is lacked in the prior art center is overcome, and the accurate distortion detection of the subtitles is realized.
Referring to fig. 4, fig. 4 is a flowchart illustrating a subtitle distortion detection method according to a second embodiment of the present invention. The method is used for a server, and comprises the following steps:
step S21: and sending a caption data packet to a multimedia terminal so that the multimedia terminal obtains a display caption based on the caption data packet, and obtaining a play caption corresponding to the display caption when the display caption is played.
Step S22: and receiving the played subtitles sent by the multimedia terminal.
Step S23: detecting the played subtitles by using preset subtitles to obtain a detection result;
it should be noted that, in this embodiment of the present invention, the execution main body is a server, the server is configured as described above, the server is installed with a subtitle distortion detection program, and when the server executes the subtitle distortion detection program, the steps of the subtitle distortion detection method of the present invention are implemented.
It is understood that the technical effects and specific contents related to this embodiment refer to the descriptions of step S11-step S14 above, and are not described herein again.
Further, based on the above description, the played subtitle includes a subtitle screenshot, and the subtitle screenshot is obtained by screenshot on a playing interface of the displayed subtitle when the displayed subtitle is played; the played caption also comprises configuration information, and the configuration information is obtained from the multimedia terminal when the displayed caption is played; the display caption comprises a first caption picture, and the preset caption comprises a second caption picture;
before the step of detecting the played subtitles by using the preset subtitles to obtain a detection result, the method further comprises: receiving display subtitles sent by the multimedia terminal; correspondingly, the step of detecting the played subtitles by using the preset subtitles to obtain a detection result includes: comparing the second subtitle picture with the first subtitle picture to obtain a first comparison result; comparing the second subtitle picture with the subtitle screenshot to obtain a second comparison result; obtaining the detection result based on the first comparison result and the second comparison result.
Based on the above example, the server compares a.bmp with a1.bmp to obtain a first comparison result, which is a detection result of the displayed caption, and the server compares a.bmp with a2.bmp to obtain a second comparison result, which is a detection result of the played caption (the caption played by the multimedia terminal), and obtains a final detection result based on the two comparison results.
Specifically, the step of obtaining the detection result based on the first comparison result and the second comparison result includes: when the first comparison result is that the second subtitle picture is the same as the first subtitle picture and the second comparison result is that the second subtitle picture is different from the subtitle screenshot, acquiring the configuration information in the played subtitle; and obtaining the detection result based on the configuration information.
If the first comparison result is that the second caption picture is different from the first caption picture, it indicates that the caption data packet corresponding to the displayed caption is damaged or lost when being received, and at this time, it indicates that a transmission process or a data source has a problem, and the obtained detection result includes the description information, which is used for a user to determine that a fault is located based on the description information; if the first comparison result shows that the second caption picture is the same as the first caption picture, indicating that the caption data packet corresponding to the displayed caption is intact when being received; if the second comparison result is that the second caption picture is the same as the caption screenshot, indicating that the display is normal when the multimedia terminal plays the caption; if the first comparison result is that the second subtitle picture is the same as the first subtitle picture and the second comparison result is that the second subtitle picture is different from the subtitle screenshot, it is indicated that display is abnormal when the multimedia terminal plays subtitles, the configuration information in the played subtitles needs to be acquired to determine a fault of the multimedia terminal based on the configuration information, and at the moment, the detection result includes description information such as the fault of the multimedia terminal.
Further, the preset subtitles include a corresponding timestamp (first time) and a program name (or other program identifiers) of the target program, the played subtitles include a corresponding timestamp (third time) and a program name of the target program, the displayed subtitles include a corresponding timestamp (second time) and a program name of the target program, the server determines a subtitle subset corresponding to the target program in a subtitle set including the preset subtitles corresponding to all programs based on the program name of the target program, then determines the corresponding preset subtitles in the subtitle subset based on the timestamp, and then detects the preset subtitles, the displayed subtitles, and the played subtitles having the same timestamp and program names according to the above detection steps.
It can be understood that, for different playing moments (shown as different timestamps), the same target program has different corresponding preset subtitles, display subtitles and playing subtitles, and the corresponding subtitles need to be matched by using the timestamps, so as to realize accurate detection of the subtitles.
In addition, in some embodiments, the server may also send the detection result to the multimedia terminal after the server obtains the detection result, store the detection result by the multimedia terminal, or output the detection result, etc.
The technical scheme of the invention provides a method for detecting the distortion of a subtitle, which is used for a server and comprises the following steps: sending a caption data packet to a multimedia terminal so that the multimedia terminal obtains a display caption based on the caption data packet, and obtaining a play caption corresponding to the display caption when the display caption is played; receiving a playing subtitle sent by the multimedia terminal; and detecting the played subtitles by using preset subtitles to obtain a detection result.
According to the method, the preset subtitles are used for detecting the played subtitles to obtain the distortion detection result of the subtitles, the defect that the technical scheme for detecting the distortions of the subtitles is lacked in the prior art center is overcome, and the accurate distortion detection of the subtitles is realized.
Referring to fig. 5, fig. 5 is a block diagram illustrating a first embodiment of a caption distortion detection apparatus for a multimedia terminal according to the present invention, which includes:
a first receiving module 10, configured to, when receiving a subtitle data packet sent by a server, obtain a display subtitle based on the subtitle data packet;
the playing module 20 is configured to obtain a playing subtitle corresponding to the display subtitle when the display subtitle is played;
the first sending module 30 is configured to send the played subtitles to the server, so that the server detects the played subtitles by using preset subtitles to obtain a detection result.
It should be noted that, since the steps executed by the apparatus of this embodiment are the same as the steps of the foregoing method embodiment, the specific implementation and the achievable technical effects thereof can refer to the foregoing embodiment, and are not described herein again.
Referring to fig. 6, fig. 6 is a block diagram illustrating a second embodiment of a caption distortion detection apparatus according to the present invention, which is used in a server and based on the same inventive concept as the previous embodiment, the apparatus includes:
a second sending module 50, configured to send a caption data packet to a multimedia terminal, so that the multimedia terminal obtains a display caption based on the caption data packet, and obtains a play caption corresponding to the display caption when the display caption is played;
a second receiving module 60, configured to receive the playing subtitles sent by the multimedia terminal;
and the detecting module 70 is configured to detect the played subtitles by using preset subtitles to obtain a detection result.
It should be noted that, since the steps executed by the apparatus of this embodiment are the same as the steps of the foregoing method embodiment, the specific implementation and the achievable technical effects thereof can refer to the foregoing embodiment, and are not described herein again.
The above description is only an alternative embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications and equivalents of the present invention, which are made by the contents of the present specification and the accompanying drawings, or directly/indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (10)
1. A method for detecting caption distortion is characterized in that the method is used for a multimedia terminal, and comprises the following steps:
when a caption data packet sent by a server is received, acquiring a display caption based on the caption data packet;
when the display caption is played, acquiring a playing caption corresponding to the display caption;
and sending the played subtitles to the server so that the server detects the played subtitles by using preset subtitles to obtain a detection result.
2. The method of claim 1, wherein the step of obtaining the playing subtitle corresponding to the display subtitle when playing the display subtitle comprises:
when the display caption is played, acquiring configuration information of the multimedia terminal, and carrying out screenshot on a playing interface for displaying the caption to obtain a caption screenshot;
and obtaining the played caption based on the configuration information and the caption screenshot.
3. The method of claim 2, wherein the step of sending the playing subtitle to the server so that the server detects the playing subtitle by using a preset subtitle to obtain a detection result comprises:
and sending the playing subtitles and the display subtitles to the server so that the server detects the playing subtitles and the display subtitles by using preset subtitles to obtain a detection result.
4. The method of claim 3, wherein the caption data packet is obtained by packing an original caption data packet; the step of obtaining display subtitles based on the subtitle data packet includes:
the caption data packet is restored and analyzed to obtain the original caption data packet;
reconstructing the original caption data packet to obtain a first caption picture;
and adding a timestamp to the first subtitle picture by using the playing time to obtain the display subtitle.
5. A method for detecting distortion of subtitles, the method being used for a server and comprising the steps of:
sending a caption data packet to a multimedia terminal so that the multimedia terminal obtains a display caption based on the caption data packet, and obtaining a play caption corresponding to the display caption when the display caption is played;
receiving a playing subtitle sent by the multimedia terminal;
and detecting the played subtitles by using preset subtitles to obtain a detection result.
6. The method of claim 5, wherein the playing of the subtitle comprises a subtitle screenshot, and the subtitle screenshot is obtained by screenshot the playing interface of the displayed subtitle while the displayed subtitle is played; the display caption comprises a first caption picture, and the preset caption comprises a second caption picture; before the step of detecting the played subtitles by using the preset subtitles to obtain a detection result, the method further comprises:
receiving display subtitles sent by the multimedia terminal;
the step of detecting the played subtitles by using the preset subtitles to obtain a detection result comprises the following steps:
comparing the second subtitle picture with the first subtitle picture to obtain a first comparison result;
comparing the second subtitle picture with the subtitle screenshot to obtain a second comparison result;
obtaining the detection result based on the first comparison result and the second comparison result.
7. The method of claim 6, wherein the playing subtitles further comprise configuration information, the configuration information being obtained from the multimedia terminal when the displaying subtitles are played; the step of obtaining the detection result based on the first comparison result and the second comparison result comprises:
when the first comparison result is that the second subtitle picture is the same as the first subtitle picture and the second comparison result is that the second subtitle picture is different from the subtitle screenshot, acquiring the configuration information in the played subtitle;
and obtaining the detection result based on the configuration information.
8. A multimedia terminal, characterized in that it comprises: memory, a processor and a caption distortion detection program stored on the memory and running on the processor, the caption distortion detection program when executed by the processor implementing the steps of the caption distortion detection method according to any one of claims 1 to 4.
9. A server, characterized in that the server comprises: memory, a processor and a caption distortion detection program stored on the memory and running on the processor, the caption distortion detection program when executed by the processor implementing the steps of the caption distortion detection method according to any one of claims 5 to 7.
10. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon a subtitle distortion detection program, which when executed by a processor implements the steps of the subtitle distortion detection method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111000269.6A CN113873221B (en) | 2021-08-27 | 2021-08-27 | Subtitle distortion detection method, multimedia terminal, server, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111000269.6A CN113873221B (en) | 2021-08-27 | 2021-08-27 | Subtitle distortion detection method, multimedia terminal, server, and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113873221A true CN113873221A (en) | 2021-12-31 |
| CN113873221B CN113873221B (en) | 2023-07-18 |
Family
ID=78988684
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111000269.6A Active CN113873221B (en) | 2021-08-27 | 2021-08-27 | Subtitle distortion detection method, multimedia terminal, server, and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113873221B (en) |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI255140B (en) * | 2004-11-04 | 2006-05-11 | Himax Tech Inc | Caption detection and compensation for interlaced image |
| JP2009260823A (en) * | 2008-04-18 | 2009-11-05 | Toshiba Corp | Caption checking apparatus and caption checking method |
| JP2012070150A (en) * | 2010-09-22 | 2012-04-05 | Sharp Corp | Content playback device, method and program |
| JP2013030963A (en) * | 2011-07-28 | 2013-02-07 | Nippon Hoso Kyokai <Nhk> | Video caption detection device and program therefor |
| CN104967910A (en) * | 2014-10-29 | 2015-10-07 | 腾讯科技（深圳）有限公司 | Multimedia play progress control method and apparatus |
| CN106792097A (en) * | 2016-12-27 | 2017-05-31 | 深圳Tcl数字技术有限公司 | Audio signal captions matching process and device |
| CN108924664A (en) * | 2018-07-26 | 2018-11-30 | 青岛海信电器股份有限公司 | A kind of synchronous display method and terminal of program credits |
| US10423660B1 (en) * | 2017-12-07 | 2019-09-24 | Amazon Technologies, Inc. | System for detecting non-synchronization between audio and subtitle |
| CN110650378A (en) * | 2019-09-27 | 2020-01-03 | 北京奇艺世纪科技有限公司 | Information acquisition method, device, terminal and storage medium |
| CN111225288A (en) * | 2020-01-21 | 2020-06-02 | 北京字节跳动网络技术有限公司 | Method and device for displaying subtitle information and electronic equipment |
| CN111757187A (en) * | 2020-07-07 | 2020-10-09 | 深圳市九洲电器有限公司 | Multi-language subtitle display method, device, terminal equipment and storage medium |
| CN112580302A (en) * | 2020-12-11 | 2021-03-30 | 海信视像科技股份有限公司 | Subtitle correction method and display device |
-
2021
- 2021-08-27 CN CN202111000269.6A patent/CN113873221B/en active Active
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI255140B (en) * | 2004-11-04 | 2006-05-11 | Himax Tech Inc | Caption detection and compensation for interlaced image |
| JP2009260823A (en) * | 2008-04-18 | 2009-11-05 | Toshiba Corp | Caption checking apparatus and caption checking method |
| JP2012070150A (en) * | 2010-09-22 | 2012-04-05 | Sharp Corp | Content playback device, method and program |
| JP2013030963A (en) * | 2011-07-28 | 2013-02-07 | Nippon Hoso Kyokai <Nhk> | Video caption detection device and program therefor |
| CN104967910A (en) * | 2014-10-29 | 2015-10-07 | 腾讯科技（深圳）有限公司 | Multimedia play progress control method and apparatus |
| CN106792097A (en) * | 2016-12-27 | 2017-05-31 | 深圳Tcl数字技术有限公司 | Audio signal captions matching process and device |
| US10423660B1 (en) * | 2017-12-07 | 2019-09-24 | Amazon Technologies, Inc. | System for detecting non-synchronization between audio and subtitle |
| CN108924664A (en) * | 2018-07-26 | 2018-11-30 | 青岛海信电器股份有限公司 | A kind of synchronous display method and terminal of program credits |
| CN110650378A (en) * | 2019-09-27 | 2020-01-03 | 北京奇艺世纪科技有限公司 | Information acquisition method, device, terminal and storage medium |
| CN111225288A (en) * | 2020-01-21 | 2020-06-02 | 北京字节跳动网络技术有限公司 | Method and device for displaying subtitle information and electronic equipment |
| CN111757187A (en) * | 2020-07-07 | 2020-10-09 | 深圳市九洲电器有限公司 | Multi-language subtitle display method, device, terminal equipment and storage medium |
| CN112580302A (en) * | 2020-12-11 | 2021-03-30 | 海信视像科技股份有限公司 | Subtitle correction method and display device |
Non-Patent Citations (1)
| Title |
|---|
| 徐朝阳;王路;陈黎;: "基于图像分析的数字视频字幕检测及恢复", 计算机应用与软件, no. 04 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113873221B (en) | 2023-07-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103546453B (en) | A kind of method and apparatus of striding equipment play multimedia | |
| CN110830823B (en) | Play progress correction method and device, electronic equipment and readable storage medium | |
| CN104066009A (en) | Method, device, terminal, server and system for program identification | |
| CN108124172B (en) | Cloud projection method, device and system | |
| US11936605B2 (en) | Message processing method, apparatus and electronic device | |
| CN104159136A (en) | Interaction information acquisition method, terminal, server and system | |
| CN103139597A (en) | Test method and digital television terminal | |
| CN106997302A (en) | Firmware upgrade method, device and audio-frequence player device | |
| CN111245852B (en) | Streaming data transmission method, device, system, access device and storage medium | |
| CN110750368A (en) | Copying and pasting method and terminal | |
| CN104536787A (en) | Resource preloading method and device | |
| CN111475359A (en) | System testing method, device and storage medium under multi-message interaction scene | |
| CN111641864B (en) | Video information acquisition method, device and equipment | |
| CN105376644A (en) | Method, device and system for testing sensitivity of tuner of set top box | |
| CN108319440B (en) | Audio output method and mobile terminal | |
| CN108833033B (en) | Method and device for determining radio frequency calibration parameters, storage medium and mobile terminal | |
| CN105550260A (en) | Picture display method and device | |
| CN106776847B (en) | Method and device for deleting media file and mobile terminal | |
| CN104038812A (en) | Information push method and device | |
| CN106446042B (en) | Information display method and device | |
| CN112738620A (en) | Media resource screen projection method, equipment and system | |
| CN113873221B (en) | Subtitle distortion detection method, multimedia terminal, server, and storage medium | |
| CN107948904A (en) | The method, apparatus and computer-readable recording medium of speaker degradation | |
| US9485458B2 (en) | Data processing method and device | |
| CN109788372B (en) | Streaming media playing method and related device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |