CN110798635A - Method and device for matching subtitle files for video - Google Patents
Method and device for matching subtitle files for video Download PDFInfo
- Publication number
- CN110798635A CN110798635A CN201910982829.9A CN201910982829A CN110798635A CN 110798635 A CN110798635 A CN 110798635A CN 201910982829 A CN201910982829 A CN 201910982829A CN 110798635 A CN110798635 A CN 110798635A
- Authority
- CN
- China
- Prior art keywords
- subtitle
- video
- subtitle file
- file
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 113
- 230000008569 process Effects 0.000 claims abstract description 58
- 238000004590 computer program Methods 0.000 claims abstract description 17
- 230000006399 behavior Effects 0.000 claims description 30
- 230000015654 memory Effects 0.000 claims description 27
- 230000014759 maintenance of location Effects 0.000 claims 2
- 230000006870 function Effects 0.000 description 10
- 238000010586 diagram Methods 0.000 description 9
- 230000004044 response Effects 0.000 description 7
- 230000005540 biological transmission Effects 0.000 description 3
- 230000005291 magnetic effect Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000004422 calculation algorithm Methods 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 238000012217 deletion Methods 0.000 description 2
- 230000037430 deletion Effects 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 230000007704 transition Effects 0.000 description 1
- 230000003936 working memory Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/278—Subtitling
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/239—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
- H04N21/2393—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/482—End-user interface for program selection
- H04N21/4825—End-user interface for program selection using a list of items to be played back in a given order, e.g. playlists
Abstract
The invention aims to provide a method, a device, a computer program product and a system for matching subtitle files for videos. The method comprises the steps that a network device responds to a caption acquisition request of a playing device for a video to acquire a caption file list corresponding to the video, wherein the caption acquisition request comprises an indication of an identifier of the video; returning the subtitle file list or one subtitle file to the playing equipment; and collecting the subtitle operation behavior data of the user in the video playing process so as to update the matching degree of the subtitle file and the video. Compared with the prior art, the closed-loop subtitle matching process is formed by subtitle matching and updating the matching degree for the matched subtitles.
Description
Technical Field
The invention relates to the technical field of video subtitles, in particular to a technology for matching subtitle files for videos.
Background
The current subtitle matching is mainly based on video names or hash values, and the matching mode is too single. Moreover, the hash values of the same video content may be inconsistent due to different encoding modes, so that the video cannot be matched with the subtitle file.
Disclosure of Invention
The invention aims to provide a method, a device, a computer program product and a system for matching subtitle files for videos.
According to one aspect of the present invention, a method for matching a subtitle file for a video at a network device is provided, wherein the method comprises the following steps:
responding to a subtitle acquisition request of a playing device for a video, and acquiring a subtitle file list corresponding to the video, wherein the subtitle acquisition request comprises an indication of an identifier of the video;
returning the subtitle file list or one subtitle file to the playing equipment;
and collecting the subtitle operation behavior data of the user in the video playing process so as to update the matching degree of the subtitle file and the video.
According to an aspect of the present invention, there is also provided a method for matching a subtitle file for a video at a playback device, wherein the method includes the steps of:
sending a subtitle acquisition request for a video to a network device to acquire subtitle data returned by the network device, wherein the subtitle acquisition request includes an indication of an identifier of the video, and the subtitle data includes any one of the following items:
-a list of subtitle files corresponding to said video;
-a subtitle file from said list of subtitle files;
loading a subtitle file from the subtitle file list in the video playing process;
and reporting the subtitle operation behavior data of the user in the video playing process to the network equipment so as to update the matching degree of the subtitle file and the video.
According to an aspect of the present invention, there is also provided an apparatus for matching a subtitle file for a video at a network device, wherein the apparatus includes:
the device comprises a list acquisition device and a caption acquisition device, wherein the list acquisition device is used for responding to a caption acquisition request of a video from a playing device and acquiring a caption file list corresponding to the video, and the caption acquisition request comprises an indication of an identifier of the video;
the file returning device is used for returning the subtitle file list or one subtitle file to the playing equipment;
and the data updating device is used for collecting the subtitle operation behavior data of the user in the video playing process so as to update the matching degree of the subtitle file and the video.
According to an aspect of the present invention, there is also provided an apparatus for matching a subtitle file for a video at a playback device, wherein the apparatus includes:
a caption request device, configured to send a caption acquisition request for a video to a network device to obtain caption data returned by the network device, where the caption acquisition request includes an indication of an identifier of the video, and the caption data includes any one of the following items:
-a list of subtitle files corresponding to said video;
-a subtitle file from said list of subtitle files;
the subtitle loading device is used for loading the subtitle files from the subtitle file list in the video playing process;
and the data reporting device is used for reporting the subtitle operation behavior data of the user in the video playing process to the network equipment so as to update the matching degree of the subtitle file and the video.
According to an aspect of the present invention, there is also provided a network device, comprising at least one memory and at least one processor, wherein the memory comprises computer-executable instructions that, when executed by the processor, perform the operations of the method for matching a subtitle file for a video at the network device as described above.
According to an aspect of the present invention, there is also provided a computer program product comprising computer executable instructions that, when executed by a network device, are executed as the method for matching subtitle files for video at the network device as described above.
According to an aspect of the present invention, there is also provided a computer-readable storage medium including computer-executable instructions, which, when executed by a network device, are performed as the method for matching subtitle files for video at the network device.
According to an aspect of the present invention, there is also provided a playback device including at least one memory and at least one processor, wherein the memory includes computer-executable instructions that, when executed by the processor, are performed as the operations of the method for matching subtitle files for video at the playback device described above.
According to an aspect of the present invention, there is also provided a computer program product comprising computer executable instructions that, when executed by a playback device, are executed as the method for matching subtitle files for video at a playback device as described above.
According to an aspect of the present invention, there is also provided a computer-readable storage medium including computer-executable instructions, which, when executed by a playback device, are performed as the method for matching subtitle files for a video at the playback device.
Compared with the prior art, the closed-loop subtitle matching process is formed by subtitle matching and updating the matching degree for the matched subtitles. The network equipment obtains a subtitle file list according to the matching degree of the subtitle files and the videos, and updates the matching degree of the corresponding subtitle files according to operation feedback of a user on the displayed subtitle files in the video playing process after the subtitle files in the subtitle file list are displayed to the user, wherein the updated matching degree is used for the subsequent subtitle matching. For a playback device, providing the subtitle files by the network device reduces the acquisition and filtering requirements of the playback device for the subtitles. Particularly, when the playing device is a VR device, the invention can greatly reduce the time for acquiring and filtering the subtitle file by the interface of the VR device, and improve the response performance of the interface, thereby not only ensuring that the front-end program data of the VR device is not repeated, but also reducing the pause phenomenon caused by low response performance of the back-end interface.
Drawings
Other features, objects and advantages of the invention will become more apparent upon reading of the detailed description of non-limiting embodiments made with reference to the following drawings:
fig. 1 shows a flowchart of a method for matching subtitle files for a video by a network device in cooperation with a playback device according to one embodiment of the present invention;
fig. 2 shows a schematic diagram of a system according to an embodiment of the present invention, which includes a network device and a playback device that cooperate to match a subtitle file for a video.
The same or similar reference numbers in the drawings identify the same or similar elements.
Detailed Description
Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments of the present invention are described as an apparatus represented by a block diagram and a process or method represented by a flow diagram. Although a flowchart depicts a sequence of process steps in the present invention, many of the operations can be performed in parallel, concurrently, or simultaneously. In addition, the order of the operations may be re-arranged. The process of the present invention may be terminated when its operations are performed, but may include additional steps not shown in the flowchart. The processes of the present invention may correspond to methods, functions, procedures, subroutines, and the like.
The methods illustrated by the flow diagrams and apparatus illustrated by the block diagrams discussed below may be implemented by hardware, software, firmware, middleware, microcode, hardware description languages, or any combination thereof. When implemented in software, firmware, middleware or microcode, the program code or code segments to perform the necessary tasks may be stored in a machine or computer readable medium such as storage medium. The processor(s) may perform the necessary tasks.
Similarly, it will be further appreciated that any flow charts, flow diagrams, state transition diagrams, and the like represent various processes which may be substantially described as program code stored in computer readable media and so executed by a computing device or processor, whether or not such computing device or processor is explicitly shown.
As used herein, the term "storage medium" may refer to one or more devices for storing data, including Read Only Memory (ROM), Random Access Memory (RAM), magnetic RAM, kernel memory, magnetic disk storage media, optical storage media, flash memory devices, and/or other machine-readable media for storing information. The term "computer-readable medium" can include, but is not limited to portable or fixed storage devices, optical storage devices, and various other mediums capable of storing and/or containing instructions and/or data.
A code segment may represent a procedure, a function, a subprogram, a program, a routine, a subroutine, a module, a software package, a class, or any combination of instructions, data structures, or program descriptions. A code segment may be coupled to another code segment or a hardware circuit by passing and/or receiving information, data, arguments, parameters, or memory contents. Information, arguments, parameters, data, etc. may be passed, forwarded, or transmitted via any suitable means including memory sharing, information passing, token passing, network transmission, etc.
In this context, the term "computer device", such as a network device or a playback device, refers to an electronic device that can execute predetermined processes such as numerical calculation and/or logic calculation by executing predetermined programs or instructions, and may include at least a processor and a memory, wherein the predetermined processes are executed by the processor by executing program instructions prestored in the memory, or the predetermined processes are executed by hardware such as ASIC, FPGA, DSP, or a combination thereof.
The "computer device" is typically embodied in the form of a general-purpose computer device, and its components may include, but are not limited to: one or more processors or processing units, system memory. The system memory may include computer readable media in the form of volatile memory, such as Random Access Memory (RAM) and/or cache memory. "computing device" may further include other removable/non-removable, volatile/nonvolatile computer-readable storage media. The memory may include at least one computer program product having a set (e.g., at least one) of program modules that are configured to perform the functions and/or methods of embodiments of the present invention. The processor executes various functional applications and data processing by executing programs stored in the memory.
For example, the memory stores computer programs for executing various functions and processes implemented by the network device, and the processor executes the corresponding computer programs, so that the scheme of matching subtitle files for videos in the network device is implemented.
As another example, the memory stores a computer program for executing various functions and processes implemented by the playback device of the present invention, and when the processor executes the corresponding computer program, the scheme of matching subtitle files for videos at the playback device of the present invention is implemented.
Typically, the network device includes, but is not limited to, a single network server, a server group of multiple network servers, or a Cloud Computing (Cloud Computing) based Cloud of a large number of computers or network servers, wherein Cloud Computing is one type of distributed Computing, a super virtual computer consisting of a collection of loosely coupled computers. Wherein the computing device is capable of operating alone to implement the invention, or of accessing a network and performing the invention by interoperating with other computing devices in the network.
The playing device includes, but is not limited to, a Personal Computer (PC), a notebook computer, a mobile terminal, and the like, and the mobile terminal includes, but is not limited to, a smart phone, a tablet computer, and the like. In a more specific application scenario, the playback device may be, for example, a VR device. VR devices have independent computing, input, and output capabilities, and for example, as an electronic device, typically include at least a processor, memory, and a display. Wherein the memory is used for storing a computer program; the method of matching subtitle files for video at a playback device as described in the present invention is performed when the processor is used to execute a computer program stored in the memory. VR devices are typically VR all-in-one machines, specifically VR head displays (virtual reality head-mounted display devices) with independent processors. Further, a VR device may be configured to operate with and execute a particular application to perform the operations described herein. The aforementioned specific application, typically a program function module, may be represented as an APP.
The network in which the computer device is located includes, but is not limited to, the internet, a wide area network, a metropolitan area network, a local area network, a VPN network, etc.
It should be noted that the playback device, the network, etc. are only examples, and other existing or future computer devices or networks may also be included in the scope of the present invention, and are included by reference.
Specific structural and functional details disclosed herein are merely representative and are provided for purposes of describing example embodiments of the present invention. The present invention may, however, be embodied in many alternate forms and should not be construed as limited to only the embodiments set forth herein.
It will be understood that, although the terms first, second, etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, a first element may be termed a second element, and, similarly, a second element may be termed a first element, without departing from the scope of example embodiments. As used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items.
It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may be present. In contrast, when an element is referred to as being "directly connected" or "directly coupled" to another element, there are no intervening elements present. Other words used to describe the relationship between elements (e.g., "between" versus "directly between", "adjacent" versus "directly adjacent to", etc.) should be interpreted in a similar manner.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of example embodiments. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used herein, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
It should also be noted that, in some alternative implementations, the functions/acts noted may occur out of the order noted in the figures. For example, two figures shown in succession may, in fact, be executed substantially concurrently, or the figures may sometimes be executed in the reverse order, depending upon the functionality/acts involved.
The invention provides a scheme for matching a subtitle file for a video on network equipment. The network equipment responds to a caption acquisition request of the playing equipment to the video, and obtains a caption file list corresponding to the video, wherein the caption acquisition request comprises an indication of an identifier of the video. Subsequently, the network device returns the subtitle file list or one of the subtitle files to the playing device. In the playing process of the video, the network equipment collects the subtitle operation behavior data of the user so as to update the matching degree of the returned subtitle file and the video.
The invention also provides a scheme for matching the subtitle file for the video on the playing equipment. The playing device sends a subtitle obtaining request for the video to the network device, wherein the subtitle obtaining request comprises an indication of the identification of the video, so as to obtain a subtitle file list returned by the network device or a subtitle file from the subtitle file list. In the playing process of the video, the playing device loads a corresponding subtitle file and reports subtitle operation behavior data of a user in the playing process of the video to the network device so as to update the matching degree of the current subtitle file and the video.
The present invention is described in further detail below with reference to the attached drawing figures.
Fig. 1 shows a flow diagram of a method according to an embodiment of the present invention, which particularly shows a process of matching a subtitle file for a video by a network device in cooperation with a playback device.
As shown in fig. 1, in step S101, a playing device sends a subtitle obtaining request for a video to a network device, where the subtitle obtaining request includes an indication of an identifier of the video; in step S102, the network device obtains a subtitle file list corresponding to the video in response to the subtitle obtaining request; in step S103, the network device returns the subtitle file list or one of the subtitle files to the playing device; in step S104, the playing device loads a subtitle file from the subtitle file list during the playing process of the video; in step S105, the playing device reports subtitle operation behavior data of the user in the playing process of the video to the network device; in step S106, the network device collects subtitle operation behavior data of the user during the playing process of the video to update the matching degree between the subtitle file and the video.
Specifically, in step S101, the playback device sends a subtitle acquisition request for a video, including an indication of an identity of the video, to the network device.
When a user requests to play a video, the playing device sends a subtitle acquisition request for the video to the network device.
According to an embodiment of the present invention, the playing device may directly send a subtitle obtaining request for a currently played video to a network device, specifically, a subtitle server.
According to another embodiment of the present invention, the subtitle acquisition request may be triggered. For example, the playing device may first send a video playing request to the video server, thereby triggering the video server to send a subtitle obtaining request for the video to the network device.
According to yet another embodiment of the present invention, the video server and the subtitle server may be integrated in one network device. The playing device sends a video playing request to the integrated network device, and the video playing request can also be regarded as a subtitle obtaining request, because the integrated network device will then respond to the video playing request and provide the requested video and its corresponding subtitle file list for the playing device.
Here, the subtitle acquisition request includes an indication of the identity of the video. The identification of the video includes, but is not limited to, the name, number, encoded value based on the content of the video, etc. of the video, any identification information that can be used to find the video. The encoded value based on the video content includes, but is not limited to, any encoded information obtained based on a content summarization algorithm, such as an MD5 value.
It should be understood by those skilled in the art that the present invention is not limited to the representation of the video identifier, and any representation that can be used to identify the video is included in the scope of the present invention.
In step S102, the network device obtains a subtitle file list corresponding to the video indicated therein in response to the subtitle obtaining request.
Here, the network may for example maintain a subtitle database in which subtitle files and their metadata are stored. The subtitle files may be obtained from a network, for example, by various crawler tools. The metadata of the subtitle file may include, for example, a video series name, a showing time, a language, a video matching degree, and the like. For some series, such as a comedy, it is also indicated as a specific quaternary episode. The association relationship between the caption file and the corresponding video is established and stored in the caption database. The association may also be included in the metadata of the subtitle file.
After obtaining the caption acquisition request of the video, the network equipment queries a caption database according to the video identification included in the video acquisition request, and obtains a matched caption file list.
According to an embodiment of the present invention, the network device may first obtain an initially matched subtitle file list according to the video identifier, and then filter the subtitle files according to metadata of the subtitle files therein, for example, filter according to language, showing time, and the like, and obtain a finally matched subtitle file list.
In step S103, the network device returns the subtitle file list or one of the subtitle files to the playback device.
According to an embodiment of the present invention, the network device may randomly select one subtitle file from the subtitle file list to return to the playback device.
According to another embodiment of the present invention, the subtitle file list will sort the subtitle files according to the matching degree, and the network device will return the subtitle file with the highest matching degree to the playing device.
According to another embodiment of the present invention, the network device may return the subtitle file list to the playback device, so that the playback device may directly obtain the corresponding subtitle file from the subtitle database.
In step S104, the playback device loads the subtitle file during playback of the video.
The video playing process should be understood in a broad sense, and includes the process from the video starting to playing until the video exits from playing.
According to one embodiment of the invention, the network device returns the subtitle file before the video starts playing, so that the playing device can synchronously load the subtitle file when the video starts playing.
According to another embodiment of the present invention, the network device returns a subtitle file list to the playback device, and the playback device requests the subtitle file ranked first from the subtitle database according to the subtitle file list so that the subtitle file can be loaded synchronously during video playback.
It should be noted that, as will be understood by those skilled in the art, the subtitle file may be sent to the playing device at one time, or may be divided into a plurality of packets to be sent to the playing device, which may be sent to the playing device by any existing transmission method. The invention is not limited in this regard.
In step S105, the playback device reports the subtitle operation behavior data of the user during the video playback process to the network device.
During the playing process of the video, the user may perform a plurality of operations on the subtitle file, such as a subtitle switching operation, staying in the current subtitle file, performing feedback on the subtitle file, and the like.
According to an embodiment of the present invention, after the video starts playing, the user may be dissatisfied with the current subtitle file, and therefore will submit a subtitle switching request. The playing device sends the caption switching request of the user to the network device, and the network device returns a new caption file from the caption file list. For example, the list of subtitle files is sorted by the degree of match and the network device will return the next subtitle file.
According to another embodiment of the present invention, after the video starts playing, the user may be satisfied with the current subtitle file and thus may stay in the current subtitle file without switching. The playing device can collect the stay time of the user on the current subtitle file in the playing process of the video, and the stay time will affect the matching degree of the current subtitle file and the video. Here, even if the user switches the subtitle file, for example, the subtitle file 1 before switching and the subtitle file 2 after switching, the subtitle files 1 and 2 usually have respective dwell durations, and different dwell durations may set different matching degrees.
According to another embodiment of the present invention, during the video playing process, for example, during or after the video playing process is finished, the user may submit feedback, including positive feedback or negative feedback, to the current subtitle file. For example, positive feedback may be a score for the current subtitle file, and negative feedback may be a subtitle file that is not a video match for the current subtitle file.
In step S106, the network device collects subtitle operation behavior data of the user during the playing process of the video to update the matching degree between the current subtitle file and the current video.
According to an embodiment of the present invention, after the video starts playing, if the user initiates the subtitle switching operation, the network device collects the operation behavior data and reduces the matching degree between the current subtitle and the current video.
According to another embodiment of the present invention, after the video starts to be played, the playing device may collect and report the staying time of the user for the current subtitle file during the playing process of the video, and the network device adjusts the matching degree between the network device and the video according to the staying time of the subtitle file. Different dwell times can be set with different degrees of matching. The longer the dwell time, the higher the corresponding degree of matching.
According to another embodiment of the present invention, during the video playing process, for example, during or after the video playing is finished, the network device adjusts the matching degree between the current subtitle and the current video according to the feedback submitted by the user to the current subtitle file. For example, according to the score of the current subtitle file in the positive feedback, the matching degree is correspondingly improved. Or, for example, the degree of matching is reduced based on negative feedback for subtitle files for which the current subtitle file is not video-matched.
According to one embodiment of the invention, the matching degree is further provided with a plurality of thresholds. For example, a matching threshold, which is a threshold that a subtitle file can be added to a subtitle file list of a video only if the degree of matching of the subtitle file with the video exceeds the matching threshold. For example, a removal threshold value, which is a threshold value below which a subtitle file is matched with a video, and which is deleted from the subtitle file list. For example, a deletion threshold, which is a threshold below which a subtitle file is matched to the video, is deleted from the subtitle database. Thereby, the metadata of the subtitle file will also be updated.
The network equipment updates the matching degree of the subtitle file and the video according to the subtitle operation behavior data of the user in the video playing process, and the updated matching degree is used for next round of subtitle file list query, so that the matching degree of the subtitle file and the video can be dynamically updated, a closed loop with subtitle matching and matching degree updating is formed, and accurate matching of the subtitle file and the video is guaranteed.
Fig. 2 shows a schematic apparatus diagram according to an embodiment of the present invention, which specifically shows a network device and a playing device cooperating to match a subtitle file for a video.
As shown in fig. 2, the network device 21 includes a subtitle matching apparatus 210, and the subtitle querying apparatus 210 further includes a list obtaining apparatus 211, a file returning apparatus 212, and a data updating apparatus 213. The playing device 22 includes a caption query device 220, and the caption query device 220 further includes a caption request device 221, a caption loading device 222 and a data reporting device 223.
The subtitle requesting device 221 sends a subtitle obtaining request for a video to the network device 21, where the subtitle obtaining request includes an indication of an identifier of the video; list acquisition means 211 acquires a subtitle file list corresponding to the video in response to the subtitle acquisition request; the file returning device 212 returns the subtitle file list or one of the subtitle files to the playing device 22; the subtitle loading device 222 loads a subtitle file from the subtitle file list during the playing process of the video; the data reporting device 223 reports the caption operation behavior data of the user in the video playing process to the network device 21; the data updating device 213 collects the subtitle operation behavior data of the user during the playing process of the video to update the matching degree of the subtitle file and the video.
Specifically, the subtitle requesting apparatus 221 transmits a subtitle obtaining request for a video including an indication of an identification of the video to the network device 21.
When a user requests to play a video, the subtitle requesting apparatus 221 transmits a subtitle obtaining request for the video to the network device 21.
According to an embodiment of the present invention, the subtitle requesting device 221 may directly send a subtitle obtaining request for the currently played video to the network device 21, specifically, a subtitle server.
According to another embodiment of the present invention, the subtitle acquisition request may be triggered. For example, the subtitle requesting device 221 may first send a video playing request to a video server, thereby triggering the video server to send a subtitle obtaining request for the video to a network device.
According to yet another embodiment of the present invention, the video server and the subtitle server may be integrated in one network device. The caption requesting device 221 sends a video playing request to the integrated network device, which can also be regarded as a caption obtaining request, because the integrated network device will then provide the requested video and its corresponding caption file list to the playing device 22 in response to the video playing request.
Here, the subtitle acquisition request includes an indication of the identity of the video. The identification of the video includes, but is not limited to, the name, number, encoded value based on the content of the video, etc. of the video, any identification information that can be used to find the video. The encoded value based on the video content includes, but is not limited to, any encoded information obtained based on a content summarization algorithm, such as an MD5 value.
It should be understood by those skilled in the art that the present invention is not limited to the representation of the video identifier, and any representation that can be used to identify the video is included in the scope of the present invention.
Subsequently, the list acquisition means 211 acquires a subtitle file list corresponding to the video indicated therein in response to the subtitle acquisition request.
Here, the network may for example maintain a subtitle database in which subtitle files and their metadata are stored. The subtitle files may be obtained from a network, for example, by various crawler tools. The metadata of the subtitle file may include, for example, a video series name, a showing time, a language, a video matching degree, and the like. For some series, such as a comedy, it is also indicated as a specific quaternary episode. The association relationship between the caption file and the corresponding video is established and stored in the caption database. The association may also be included in the metadata of the subtitle file.
After the network device 21 receives the subtitle obtaining request of the video, the list obtaining means 211 queries the subtitle database according to the video identifier included therein to obtain a list of matching subtitle files.
According to an embodiment of the present invention, the list obtaining device 211 may first obtain an initially matched subtitle file list according to the video identifier, and further filter the subtitle files according to metadata of the subtitle files therein, for example, filter the subtitle files according to language, showing time, and the like, and then obtain a finally matched subtitle file list.
Then, the file returning means 212 returns the subtitle file list or one of the subtitle files to the playback device 22.
According to an embodiment of the present invention, the file returning means 212 may randomly select one subtitle file from the subtitle file list to return to the playback device 22.
According to another embodiment of the present invention, the subtitle file list will sort the subtitle files according to the matching degree, and the file returning means 212 returns the subtitle file with the highest matching degree to the playing device 22.
According to still another embodiment of the present invention, the file returning device 212 may return the subtitle file list to the playing device 22 for the playing device 22 to directly obtain the corresponding subtitle file from the subtitle database.
Subsequently, the subtitle loading device 222 loads the subtitle file during the playing of the video.
The video playing process should be understood in a broad sense, and includes the process from the video starting to playing until the video exits from playing.
According to an embodiment of the present invention, the file returning means 212 returns the subtitle file before the video starts playing, so that the subtitle loading means 222 can load the subtitle file synchronously when the video starts playing.
According to another embodiment of the present invention, the file returning means 212 returns a subtitle file list to the playing device 22, and the subtitle loading means 222 requests the subtitle file ranked first from the subtitle database according to the subtitle file list so that the subtitle file can be loaded synchronously while the video is played.
It should be noted that, as will be understood by those skilled in the art, the subtitle file may be sent to the playing device at one time, or may be divided into a plurality of packets to be sent to the playing device, which may be sent to the playing device by any existing transmission method. The invention is not limited in this regard.
Then, the data reporting device 223 reports the caption operation behavior data of the user in the video playing process to the network device 21.
During the playing process of the video, the user may perform a plurality of operations on the subtitle file, such as a subtitle switching operation, staying in the current subtitle file, performing feedback on the subtitle file, and the like.
According to an embodiment of the present invention, after the video starts playing, the user may be dissatisfied with the current subtitle file, and therefore will submit a subtitle switching request. The data reporting means 223 transmits a caption switching request of the user to the network device 21, and the file returning means 212 returns a new caption file from the caption file list. For example, the subtitle file list is sorted according to the matching degree, and the file returning means 212 returns the next subtitle file.
According to another embodiment of the present invention, after the video starts playing, the user may be satisfied with the current subtitle file and thus may stay in the current subtitle file without switching. The data reporting device 223 can collect the stay time of the user for the current subtitle file during the playing process of the video, and the stay time will affect the matching degree of the current subtitle file and the video. Here, even if the user switches the subtitle file, for example, the subtitle file 1 before switching and the subtitle file 2 after switching, the subtitle files 1 and 2 usually have respective dwell durations, and different dwell durations may set different matching degrees.
According to another embodiment of the present invention, during the video playing process, for example, during or after the video playing process is finished, the user may submit feedback, including positive feedback or negative feedback, to the current subtitle file. For example, positive feedback may be a score for the current subtitle file, and negative feedback may be a subtitle file that is not a video match for the current subtitle file.
The data updating device 213 collects the subtitle operation behavior data of the user during the playing process of the video to update the matching degree of the current subtitle file and the current video.
According to an embodiment of the present invention, after the video starts playing, if the user initiates a subtitle switching operation, the data updating apparatus 213 collects the operation behavior data and reduces the matching degree between the current subtitle and the current video.
According to another embodiment of the present invention, after the video starts to be played, the data reporting device 223 may collect and report the staying time of the user for the current subtitle file during the playing process of the video, and the data updating device 213 adjusts the matching degree between the subtitle file and the video according to the staying time of the subtitle file. Different dwell times can be set with different degrees of matching. The longer the dwell time, the higher the corresponding degree of matching.
According to another embodiment of the present invention, during the video playing process, for example, during or after the video playing process is finished, the data updating apparatus 213 adjusts the matching degree between the current subtitle and the current video according to the feedback submitted by the user to the current subtitle file. For example, according to the score of the current subtitle file in the positive feedback, the matching degree is correspondingly improved. Or, for example, the degree of matching is reduced based on negative feedback for subtitle files for which the current subtitle file is not video-matched.
According to an embodiment of the present invention, the matching degree may also be provided with a plurality of thresholds. For example, a matching threshold, which is a threshold that a subtitle file can be added to a subtitle file list of a video only if the degree of matching of the subtitle file with the video exceeds the matching threshold. For example, a removal threshold value, which is a threshold value below which a subtitle file is matched with a video, and which is deleted from the subtitle file list. For example, a deletion threshold, which is a threshold below which a subtitle file is matched to the video, is deleted from the subtitle database. Thereby, the metadata of the subtitle file will also be updated.
Here, since the data updating device 213 updates the matching degree of the subtitle file and the video according to the subtitle operation behavior data of the user during the playing process of the video, the updated matching degree will be used for the next round of subtitle file list query, so that the matching degree of the subtitle file and the video can be dynamically updated, and a closed loop of subtitle matching and matching degree updating is formed, thereby also ensuring the accurate matching of the subtitle file and the video. It should be noted that the present invention may be implemented in software and/or in a combination of software and hardware, for example, as an Application Specific Integrated Circuit (ASIC), a general purpose computer or any other similar hardware device. In one embodiment, the software program of the present invention may be executed by a processor to implement the steps or functions described above. Also, the software programs (including associated data structures) of the present invention can be stored in a computer readable recording medium, such as RAM memory, magnetic or optical drive or diskette and the like. Further, some of the steps or functions of the present invention may be implemented in hardware, for example, as circuitry that cooperates with the processor to perform various steps or functions.
In addition, some of the present invention can be applied as a computer program product, such as computer program instructions, which when executed by a computer, can invoke or provide the method and/or technical solution according to the present invention through the operation of the computer. Program instructions which invoke the methods of the present invention may be stored on a fixed or removable recording medium and/or transmitted via a data stream on a broadcast or other signal-bearing medium and/or stored within a working memory of a computer device operating in accordance with the program instructions. An embodiment according to the invention herein comprises an apparatus comprising a memory for storing computer program instructions and a processor for executing the program instructions, wherein the computer program instructions, when executed by the processor, trigger the apparatus to perform a method and/or solution according to embodiments of the invention as described above.
It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential attributes thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned. Furthermore, it is obvious that the word "comprising" does not exclude other elements or steps, and the singular does not exclude the plural. A plurality of units or means recited in the system claims may also be implemented by one unit or means in software or hardware. The terms first, second, etc. are used to denote names, but not any particular order.
Claims (27)
1. A method for matching a subtitle file for a video at a network device, wherein the method comprises the steps of:
responding to a subtitle acquisition request of a playing device for a video, and acquiring a subtitle file list corresponding to the video, wherein the subtitle acquisition request comprises an indication of an identifier of the video;
returning the subtitle file list or one subtitle file to the playing equipment;
and collecting the subtitle operation behavior data of the user in the video playing process so as to update the matching degree of the subtitle file and the video.
2. The method according to claim 1, wherein in the returning step, only one subtitle file in the subtitle file list is returned to the playing device;
wherein, the method also comprises:
and responding to a subtitle switching request of a user, and returning another subtitle file in the subtitle file list to the playing device again.
3. The method according to claim 1 or 2, wherein the subtitle operation behavior data includes a user's switching operation for a subtitle file;
wherein, the method also comprises:
and reducing the matching degree of the switched subtitle file and the video.
4. The method according to any one of claims 1 to 3, wherein the subtitle operation behavior data includes a user's dwell time for a current subtitle file during the playing of the video;
wherein, the method also comprises:
and updating the matching degree of the current subtitle file and the video according to the retention time.
5. The method of any of claims 1-4, wherein the caption operational behavior data includes user feedback data for a current caption file;
wherein, the method also comprises:
and updating the matching degree of the current subtitle file and the video according to the feedback data.
6. The method of claim 5, wherein the feedback data is positive feedback data or negative feedback data of the user for a current subtitle file;
wherein, the method also comprises:
and improving the matching degree of the current subtitle file and the video according to the positive feedback data, or reducing the matching degree of the current subtitle file and the video according to the negative feedback data.
7. A method of matching a subtitle file for a video at a playback device, wherein the method comprises the steps of:
sending a subtitle acquisition request for a video to a network device to acquire subtitle data returned by the network device, wherein the subtitle acquisition request includes an indication of an identifier of the video, and the subtitle data includes any one of the following items:
-a list of subtitle files corresponding to said video;
-a subtitle file from said list of subtitle files;
loading a subtitle file from the subtitle file list in the video playing process;
and reporting the subtitle operation behavior data of the user in the video playing process to the network equipment so as to update the matching degree of the subtitle file and the video.
8. The method of claim 7, wherein said subtitle data includes a list of subtitle files corresponding to said video;
wherein, the method also comprises:
and loading another subtitle file from the subtitle file list according to the subtitle switching request of the user.
9. The method of claim 7, wherein the subtitle data comprises a subtitle file;
wherein, the method also comprises:
sending a subtitle switching request of the user to the network equipment to obtain another subtitle file returned by the network equipment again according to the subtitle file list;
and switching the current subtitle file into the other subtitle file returned again.
10. The method of any of claims 7 to 9, wherein the caption operational behavior data comprises at least any one of:
-a switching operation of the subtitle file by the user;
-the user's dwell time on the current subtitle file during the playing of the video;
-feedback data of the user to the current subtitle file.
11. An apparatus for matching a subtitle file for a video at a network device, wherein the apparatus comprises:
the device comprises a list acquisition device and a caption acquisition device, wherein the list acquisition device is used for responding to a caption acquisition request of a video from a playing device and acquiring a caption file list corresponding to the video, and the caption acquisition request comprises an indication of an identifier of the video;
the file returning device is used for returning the subtitle file list or one subtitle file to the playing equipment;
and the data updating device is used for collecting the subtitle operation behavior data of the user in the video playing process so as to update the matching degree of the subtitle file and the video.
12. The apparatus according to claim 11, wherein in the returning operation, only one subtitle file in the subtitle file list is returned to the playback device;
wherein the file returning device is further configured to:
and responding to a subtitle switching request of a user, and returning another subtitle file in the subtitle file list to the playing device again.
13. The apparatus according to claim 11 or 12, wherein the subtitle operation behavior data includes a switching operation of a subtitle file by a user;
wherein the data updating apparatus is further configured to:
and the data updating device is used for reducing the matching degree of the switched subtitle file and the video.
14. The apparatus according to any one of claims 11 to 13, wherein the subtitle operation behavior data includes a user's dwell time for a current subtitle file during the playing of the video;
wherein the data updating apparatus is further configured to:
and updating the matching degree of the current subtitle file and the video according to the retention time.
15. The apparatus according to any one of claims 11 to 14, wherein the subtitle operation behavior data includes user feedback data for a current subtitle file;
wherein the data updating apparatus is further configured to:
and updating the matching degree of the current subtitle file and the video according to the feedback data.
16. The apparatus of claim 15, wherein the feedback data is positive feedback data or negative feedback data of the user for a current subtitle file;
wherein the data updating apparatus is further configured to:
and improving the matching degree of the current subtitle file and the video according to the positive feedback data, or reducing the matching degree of the current subtitle file and the video according to the negative feedback data.
17. An apparatus for matching a subtitle file for a video at a playback device, wherein the apparatus comprises:
a caption request device, configured to send a caption acquisition request for a video to a network device to obtain caption data returned by the network device, where the caption acquisition request includes an indication of an identifier of the video, and the caption data includes any one of the following items:
-a list of subtitle files corresponding to said video;
-a subtitle file from said list of subtitle files;
the subtitle loading device is used for loading the subtitle files from the subtitle file list in the video playing process;
and the data reporting device is used for reporting the subtitle operation behavior data of the user in the video playing process to the network equipment so as to update the matching degree of the subtitle file and the video.
18. The apparatus of claim 17, wherein said subtitle data comprises a list of subtitle files corresponding to said video;
wherein the subtitle loading apparatus is further configured to:
and loading another subtitle file from the subtitle file list according to the subtitle switching request of the user.
19. The apparatus of claim 17, wherein the subtitle data comprises a subtitle file;
wherein the subtitle requesting device is further configured to:
sending a subtitle switching request of the user to the network equipment to obtain another subtitle file returned by the network equipment again according to the subtitle file list;
wherein the subtitle loading apparatus is further configured to:
and switching the current subtitle file into the other subtitle file returned again.
20. The apparatus of any of claims 17 to 19, wherein the caption operational behavior data comprises at least any one of:
-a switching operation of the subtitle file by the user;
-the user's dwell time on the current subtitle file during the playing of the video;
-feedback data of the user to the current subtitle file.
21. A network device comprising at least one memory and at least one processor, wherein the memory includes computer-executable instructions that, when executed by the processor, perform operations of the method of any of claims 1 to 6.
22. A computer program product comprising computer executable instructions that when executed by a network device perform the method of any of claims 1 to 6.
23. A computer-readable storage medium comprising computer-executable instructions that, when executed by a network device, perform the method of any of claims 1 to 6.
24. A playback device comprising at least one memory and at least one processor, wherein the memory includes computer-executable instructions that, when executed by the processor, perform operations of the method of any one of claims 7 to 10.
25. A computer program product comprising computer executable instructions that when executed by a playback device perform the method of any of claims 7 to 10.
26. A computer-readable storage medium comprising computer-executable instructions that, when executed by a playback device, perform the method of any of claims 7-10.
27. A system for matching subtitle files for a video, wherein the system comprises a network device according to claim 21 and a playback device according to claim 24.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910982829.9A CN110798635A (en) | 2019-10-16 | 2019-10-16 | Method and device for matching subtitle files for video |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910982829.9A CN110798635A (en) | 2019-10-16 | 2019-10-16 | Method and device for matching subtitle files for video |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110798635A true CN110798635A (en) | 2020-02-14 |
Family
ID=69440331
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910982829.9A Pending CN110798635A (en) | 2019-10-16 | 2019-10-16 | Method and device for matching subtitle files for video |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110798635A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112887806A (en) * | 2021-01-25 | 2021-06-01 | 当趣网络科技(杭州)有限公司 | Subtitle processing method, subtitle processing device, electronic equipment and subtitle processing medium |
| CN112911404A (en) * | 2021-01-25 | 2021-06-04 | 当趣网络科技(杭州)有限公司 | Video subtitle processing method, apparatus, electronic device, and medium |
| CN113688283A (en) * | 2021-08-27 | 2021-11-23 | 北京奇艺世纪科技有限公司 | Method and device for determining matching degree of video subtitles and electronic equipment |
| CN114827717A (en) * | 2022-04-12 | 2022-07-29 | Oppo广东移动通信有限公司 | Subtitle display method, device and equipment and storage medium |
| CN116886941A (en) * | 2023-06-09 | 2023-10-13 | 北京医百科技有限公司 | Method and device for switching caption content in cloud broadcasting guide station |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120301110A1 (en) * | 2011-05-27 | 2012-11-29 | Sony Corporation | Image processing apparatus method and computer program product |
| CN103179093A (en) * | 2011-12-22 | 2013-06-26 | 腾讯科技（深圳）有限公司 | Matching system and method for video subtitles |
| CN105100833A (en) * | 2015-07-01 | 2015-11-25 | 北京奇虎科技有限公司 | Subtitle loading method and device for online playing |
| CN106385629A (en) * | 2016-10-27 | 2017-02-08 | 乐视控股（北京）有限公司 | Method and device for determining effective subtitles |
| CN108924619A (en) * | 2018-06-29 | 2018-11-30 | 北京优酷科技有限公司 | The display methods and device of subtitle |
-
2019
- 2019-10-16 CN CN201910982829.9A patent/CN110798635A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120301110A1 (en) * | 2011-05-27 | 2012-11-29 | Sony Corporation | Image processing apparatus method and computer program product |
| CN103179093A (en) * | 2011-12-22 | 2013-06-26 | 腾讯科技（深圳）有限公司 | Matching system and method for video subtitles |
| CN105100833A (en) * | 2015-07-01 | 2015-11-25 | 北京奇虎科技有限公司 | Subtitle loading method and device for online playing |
| CN106385629A (en) * | 2016-10-27 | 2017-02-08 | 乐视控股（北京）有限公司 | Method and device for determining effective subtitles |
| CN108924619A (en) * | 2018-06-29 | 2018-11-30 | 北京优酷科技有限公司 | The display methods and device of subtitle |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112887806A (en) * | 2021-01-25 | 2021-06-01 | 当趣网络科技(杭州)有限公司 | Subtitle processing method, subtitle processing device, electronic equipment and subtitle processing medium |
| CN112911404A (en) * | 2021-01-25 | 2021-06-04 | 当趣网络科技(杭州)有限公司 | Video subtitle processing method, apparatus, electronic device, and medium |
| CN113688283A (en) * | 2021-08-27 | 2021-11-23 | 北京奇艺世纪科技有限公司 | Method and device for determining matching degree of video subtitles and electronic equipment |
| CN113688283B (en) * | 2021-08-27 | 2023-09-05 | 北京奇艺世纪科技有限公司 | Method and device for determining video subtitle matching degree and electronic equipment |
| CN114827717A (en) * | 2022-04-12 | 2022-07-29 | Oppo广东移动通信有限公司 | Subtitle display method, device and equipment and storage medium |
| CN116886941A (en) * | 2023-06-09 | 2023-10-13 | 北京医百科技有限公司 | Method and device for switching caption content in cloud broadcasting guide station |
| CN116886941B (en) * | 2023-06-09 | 2024-03-26 | 北京医百科技有限公司 | Method and device for switching caption content in cloud broadcasting guide station |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110798635A (en) | Method and device for matching subtitle files for video | |
| US9262899B2 (en) | Method, device and system for implementing video recording retrieval | |
| CN111327955B (en) | User portrait based on-demand method, storage medium and smart television | |
| CN111447102B (en) | SDN network device access method and device, computer device and storage medium | |
| CN110764706A (en) | Storage system, data management method, and storage medium | |
| CN108228709B (en) | Data storage method and system, electronic device, program, and medium | |
| US20140109082A1 (en) | Verification Of Complex Multi-Application And Multi-Node Deployments | |
| CN111784468B (en) | Account association method and device and electronic equipment | |
| CN108833961B (en) | Method, server and system for acquiring flight record data | |
| US20170171307A1 (en) | Method and electronic apparatus for processing picture | |
| CN113986936A (en) | Data processing method and device, electronic equipment and storage medium | |
| CN109218799B (en) | Method, storage medium, device and system for quickly switching high-definition images of android television | |
| CN110602163B (en) | File uploading method and device | |
| CN110222046B (en) | List data processing method, device, server and storage medium | |
| CN111435327B (en) | Log record processing method, device and system | |
| CN106998436B (en) | Video backup method and device | |
| CN107819595B (en) | Network slice management device | |
| EP4180942A1 (en) | Screen projection method and apparatus, electronic device, and computer readable storage medium | |
| CN112799910A (en) | Hierarchical monitoring method and device | |
| JP7133037B2 (en) | Message processing method, device and system | |
| CN105657473A (en) | Data processing method and device | |
| CN113590277A (en) | Task state switching method and device and electronic system | |
| CN113448758A (en) | Task processing method and device and terminal equipment | |
| US20140149419A1 (en) | Complex event processing apparatus for referring to table within external database as external reference object | |
| CN116030398B (en) | Task analysis method, system and storage medium based on multipath video signals |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20200214 |
|
| WD01 | Invention patent application deemed withdrawn after publication |